2024-09-13T15:35:17.899 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T15:35:17.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T15:35:18.019 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903758 branch: wip-rishabh-testing-20240910.095512-reef description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/postgres}} email: null first_in_suite: false job_id: '7903758' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240910.095512-reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 50bbe7f395997dcd871813949c49addbbf630361 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: 50bbe7f395997dcd871813949c49addbbf630361 kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=legacy - wsync syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.095512-reef sha1: 50bbe7f395997dcd871813949c49addbbf630361 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1152 sha1: 50bbe7f395997dcd871813949c49addbbf630361 sleep_before_teardown: 0 subset: 984/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.095512-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 50bbe7f395997dcd871813949c49addbbf630361 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi017.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNHniGmbxcBSRjfth0Sm7T09ICBkFvmsc2uwFDdJ8LXdAxafszVEk1F6RTYpyHpdZpVb2SxMD9mHpW9CzA/NWVw= smithi189.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNRCE6yW6m7jvsZKWqZFS2Xo/wDzxDwWLgDmRFypNGRsqXADJOTl/lAip1QZYjbi6+EcTwqNA2v10xnScc0CJ2o= smithi193.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNJ1HGDjeS6cui2aJVe2pQGODLA5zPzc0+w2i6qH5Chckh7ntk8VWgl9iPSslYtE8AybOyuxSX7X8tJdqN39epo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:36:41 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T15:35:18.019 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa; will attempt to use it 2024-09-13T15:35:18.019 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa/tasks 2024-09-13T15:35:18.020 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T15:35:18.021 INFO:teuthology.task.internal:Checking packages... 2024-09-13T15:35:18.042 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '50bbe7f395997dcd871813949c49addbbf630361' 2024-09-13T15:35:18.042 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T15:35:18.042 INFO:teuthology.packaging:ref: None 2024-09-13T15:35:18.042 INFO:teuthology.packaging:tag: None 2024-09-13T15:35:18.042 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.095512-reef 2024-09-13T15:35:18.042 INFO:teuthology.packaging:sha1: 50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:35:18.042 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240910.095512-reef 2024-09-13T15:35:18.194 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-850.g50bbe7f3 2024-09-13T15:35:18.196 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T15:35:18.206 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T15:35:18.206 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T15:35:18.215 INFO:teuthology.task.internal:Saving configuration 2024-09-13T15:35:18.235 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T15:35:18.243 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T15:35:18.272 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903758', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 15:30:08.473158', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNHniGmbxcBSRjfth0Sm7T09ICBkFvmsc2uwFDdJ8LXdAxafszVEk1F6RTYpyHpdZpVb2SxMD9mHpW9CzA/NWVw='} 2024-09-13T15:35:18.301 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi189.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903758', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 15:30:08.471649', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNRCE6yW6m7jvsZKWqZFS2Xo/wDzxDwWLgDmRFypNGRsqXADJOTl/lAip1QZYjbi6+EcTwqNA2v10xnScc0CJ2o='} 2024-09-13T15:35:18.328 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903758', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 15:30:08.474070', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNJ1HGDjeS6cui2aJVe2pQGODLA5zPzc0+w2i6qH5Chckh7ntk8VWgl9iPSslYtE8AybOyuxSX7X8tJdqN39epo='} 2024-09-13T15:35:18.328 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T15:35:18.336 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-13T15:35:18.336 INFO:teuthology.task.internal:roles: ubuntu@smithi189.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-13T15:35:18.336 INFO:teuthology.task.internal:roles: ubuntu@smithi193.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-13T15:35:18.336 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T15:35:18.442 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f807f423be0>, signals=[15]) 2024-09-13T15:35:18.442 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T15:35:18.449 INFO:teuthology.task.internal:Opening connections... 2024-09-13T15:35:18.449 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi017.front.sepia.ceph.com 2024-09-13T15:35:18.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:35:18.541 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi189.front.sepia.ceph.com 2024-09-13T15:35:18.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:35:18.626 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi193.front.sepia.ceph.com 2024-09-13T15:35:18.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:35:18.711 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T15:35:18.723 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2024-09-13T15:35:18.741 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2024-09-13T15:35:18.741 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-09-13T15:35:18.799 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2024-09-13T15:35:18.799 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9" 2024-09-13T15:35:18.799 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2024-09-13T15:35:18.799 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2024-09-13T15:35:18.799 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9" 2024-09-13T15:35:18.799 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9" 2024-09-13T15:35:18.799 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T15:35:18.799 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2024-09-13T15:35:18.799 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon" 2024-09-13T15:35:18.800 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T15:35:18.800 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2024-09-13T15:35:18.800 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T15:35:18.800 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T15:35:18.800 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T15:35:18.800 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-09-13T15:35:18.828 DEBUG:teuthology.orchestra.run.smithi189:> uname -m 2024-09-13T15:35:18.848 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2024-09-13T15:35:18.848 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-09-13T15:35:18.906 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream" 2024-09-13T15:35:18.906 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="9" 2024-09-13T15:35:18.906 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2024-09-13T15:35:18.906 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2024-09-13T15:35:18.906 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="9" 2024-09-13T15:35:18.907 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el9" 2024-09-13T15:35:18.907 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T15:35:18.907 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2024-09-13T15:35:18.907 INFO:teuthology.orchestra.run.smithi189.stdout:LOGO="fedora-logo-icon" 2024-09-13T15:35:18.907 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T15:35:18.907 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/" 2024-09-13T15:35:18.907 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T15:35:18.907 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T15:35:18.907 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T15:35:18.907 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-09-13T15:35:18.937 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2024-09-13T15:35:18.955 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2024-09-13T15:35:18.956 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2024-09-13T15:35:19.013 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2024-09-13T15:35:19.013 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="9" 2024-09-13T15:35:19.014 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2024-09-13T15:35:19.014 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2024-09-13T15:35:19.014 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="9" 2024-09-13T15:35:19.014 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el9" 2024-09-13T15:35:19.014 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T15:35:19.014 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2024-09-13T15:35:19.014 INFO:teuthology.orchestra.run.smithi193.stdout:LOGO="fedora-logo-icon" 2024-09-13T15:35:19.014 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T15:35:19.014 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2024-09-13T15:35:19.014 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T15:35:19.014 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T15:35:19.014 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T15:35:19.015 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2024-09-13T15:35:19.045 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T15:35:19.061 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T15:35:19.083 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T15:35:19.083 DEBUG:teuthology.orchestra.run.smithi017:> test '!' -e /home/ubuntu/cephtest 2024-09-13T15:35:19.085 DEBUG:teuthology.orchestra.run.smithi189:> test '!' -e /home/ubuntu/cephtest 2024-09-13T15:35:19.087 DEBUG:teuthology.orchestra.run.smithi193:> test '!' -e /home/ubuntu/cephtest 2024-09-13T15:35:19.104 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T15:35:19.115 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T15:35:19.116 DEBUG:teuthology.orchestra.run.smithi017:> test -z $(ls -A /var/lib/ceph) 2024-09-13T15:35:19.143 DEBUG:teuthology.orchestra.run.smithi189:> test -z $(ls -A /var/lib/ceph) 2024-09-13T15:35:19.145 DEBUG:teuthology.orchestra.run.smithi193:> test -z $(ls -A /var/lib/ceph) 2024-09-13T15:35:19.281 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T15:35:19.396 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T15:35:19.423 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-13T15:35:19.424 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-13T15:35:19.424 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-13T15:35:19.424 DEBUG:teuthology.orchestra.run.smithi017:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T15:35:19.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:35:19.442 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-13T15:35:19.612 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T15:35:19.612 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-13T15:35:19.613 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-09-13T15:35:19.631 INFO:teuthology.orchestra.run.smithi017.stdout:5.14.0-503.el9.x86_64 2024-09-13T15:35:19.631 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T15:35:19.632 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-13T15:35:19.632 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum upgrade -y linux-firmware 2024-09-13T15:35:21.901 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-13T15:35:30.252 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 2.8 MB/s | 20 MB 00:07 2024-09-13T15:35:35.103 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 7.3 MB/s | 6.5 MB 00:00 2024-09-13T15:35:36.787 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 19 kB 00:00 2024-09-13T15:35:37.999 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-13T15:35:43.697 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-13T15:35:45.968 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T15:35:45.969 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-13T15:35:45.969 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T15:35:46.092 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T15:35:46.093 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T15:35:46.252 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-13T15:35:46.253 DEBUG:teuthology.orchestra.run.smithi017:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-13T15:35:46.255 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi017.front.sepia.ceph.com to complete... 2024-09-13T15:35:52.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13 15:35:52 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-13T15:35:52.888 INFO:teuthology.orchestra.run.smithi017.stderr:FINISHED --2024-09-13 15:35:52-- 2024-09-13T15:35:52.888 INFO:teuthology.orchestra.run.smithi017.stderr:Total wall clock time: 6.6s 2024-09-13T15:35:52.888 INFO:teuthology.orchestra.run.smithi017.stderr:Downloaded: 1 files, 343M in 6.3s (54.3 MB/s) 2024-09-13T15:35:52.891 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T15:35:52.892 DEBUG:teuthology.orchestra.run.smithi017:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-13T15:35:55.086 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying... ######################################## 2024-09-13T15:35:55.232 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing... ######################################## 2024-09-13T15:35:55.353 INFO:teuthology.orchestra.run.smithi017.stdout:Updating / installing... 2024-09-13T15:36:03.795 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-13T15:36:43.827 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi017.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-13T15:36:43.828 DEBUG:teuthology.orchestra.run.smithi017:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-13T15:36:43.908 INFO:teuthology.orchestra.run.smithi017.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:36:43.908 INFO:teuthology.orchestra.run.smithi017.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:36:43.908 INFO:teuthology.orchestra.run.smithi017.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:36:43.908 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:36:43.908 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-13T15:36:43.908 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-13T15:36:43.909 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-13T15:36:43.909 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-13T15:36:43.909 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-13T15:36:43.909 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-13T15:36:43.909 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-13T15:36:43.909 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-13T15:36:43.909 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-13T15:36:43.909 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-13T15:36:43.909 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-13T15:36:43.909 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-13T15:36:43.909 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-13T15:36:43.909 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-13T15:36:43.909 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-13T15:36:43.910 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-13T15:36:43.910 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-13T15:36:43.910 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-13T15:36:43.910 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-13T15:36:43.910 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-13T15:36:43.910 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-13T15:36:43.910 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-13T15:36:43.910 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-13T15:36:43.910 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-13T15:36:43.910 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-13T15:36:43.910 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-13T15:36:43.910 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-13T15:36:43.910 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-13T15:36:43.911 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-13T15:36:43.911 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-13T15:36:43.911 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-13T15:36:43.911 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-13T15:36:43.911 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-13T15:36:43.911 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-13T15:36:43.911 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-13T15:36:43.911 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-13T15:36:43.911 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-13T15:36:43.911 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-13T15:36:43.911 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-13T15:36:43.911 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-13T15:36:43.911 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-13T15:36:43.912 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-13T15:36:43.912 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-13T15:36:43.912 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-13T15:36:43.912 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-13T15:36:43.912 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-13T15:36:43.912 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-13T15:36:43.912 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-13T15:36:43.912 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-13T15:36:43.912 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-13T15:36:43.912 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-13T15:36:43.912 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-13T15:36:43.912 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-13T15:36:43.913 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-13T15:36:43.913 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-13T15:36:43.913 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-13T15:36:43.913 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-13T15:36:43.913 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-13T15:36:43.913 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-13T15:36:43.913 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-13T15:36:43.913 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-13T15:36:43.913 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-13T15:36:43.913 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-13T15:36:43.913 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-13T15:36:43.913 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-13T15:36:43.913 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-13T15:36:43.913 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-13T15:36:43.914 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-13T15:36:43.914 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-13T15:36:43.914 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-13T15:36:43.914 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-13T15:36:43.914 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-13T15:36:43.914 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-13T15:36:43.914 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-13T15:36:43.914 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-13T15:36:43.914 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-13T15:36:43.914 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-13T15:36:43.914 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-13T15:36:43.914 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-13T15:36:43.914 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-13T15:36:43.914 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-13T15:36:43.915 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-13T15:36:43.915 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-13T15:36:43.915 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-13T15:36:43.915 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-13T15:36:43.915 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-13T15:36:43.915 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-13T15:36:43.915 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-13T15:36:43.915 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-13T15:36:43.915 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-13T15:36:43.915 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-13T15:36:43.915 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-13T15:36:43.915 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-13T15:36:43.915 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-13T15:36:43.916 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-13T15:36:43.916 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-13T15:36:43.916 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-13T15:36:43.916 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-13T15:36:43.916 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-13T15:36:43.916 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-13T15:36:43.916 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-13T15:36:43.916 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-13T15:36:43.916 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-13T15:36:43.916 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-13T15:36:43.916 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-13T15:36:43.916 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-13T15:36:43.916 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-13T15:36:43.917 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-13T15:36:43.917 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-13T15:36:43.917 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-13T15:36:43.917 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-13T15:36:43.917 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-13T15:36:43.917 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-13T15:36:43.917 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-13T15:36:43.917 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-13T15:36:43.917 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-13T15:36:43.917 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-13T15:36:43.917 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-13T15:36:43.917 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-13T15:36:43.918 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-13T15:36:43.918 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-13T15:36:43.918 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-13T15:36:43.918 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-13T15:36:43.918 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-13T15:36:43.918 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-13T15:36:43.918 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-13T15:36:43.918 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-13T15:36:43.918 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-13T15:36:43.918 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-13T15:36:43.918 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-13T15:36:43.918 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-13T15:36:43.918 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-13T15:36:43.918 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-13T15:36:43.919 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-13T15:36:43.919 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-13T15:36:43.919 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-13T15:36:43.919 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-13T15:36:43.919 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-13T15:36:43.919 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-13T15:36:43.919 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-13T15:36:43.919 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-13T15:36:43.919 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-13T15:36:43.919 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-13T15:36:43.919 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-13T15:36:43.919 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-13T15:36:43.919 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-13T15:36:43.919 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-13T15:36:43.920 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-13T15:36:43.920 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-13T15:36:43.920 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-13T15:36:43.920 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-13T15:36:43.920 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-13T15:36:43.920 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-13T15:36:43.920 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-13T15:36:43.920 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-13T15:36:43.920 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-13T15:36:43.920 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-13T15:36:43.920 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-13T15:36:43.920 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-13T15:36:43.920 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-13T15:36:43.921 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-13T15:36:43.921 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-13T15:36:43.921 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-13T15:36:43.921 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-13T15:36:43.921 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-13T15:36:43.921 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-13T15:36:43.921 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-13T15:36:43.921 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-13T15:36:43.921 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-13T15:36:43.921 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-13T15:36:43.922 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-13T15:36:43.922 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-13T15:36:43.922 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-13T15:36:43.922 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-13T15:36:43.922 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-13T15:36:43.922 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-13T15:36:43.922 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-13T15:36:43.922 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-13T15:36:43.922 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-13T15:36:43.922 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-13T15:36:43.922 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-13T15:36:43.922 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-13T15:36:43.922 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-13T15:36:43.923 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-13T15:36:43.923 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-13T15:36:43.923 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-13T15:36:43.923 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-13T15:36:43.923 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-13T15:36:43.923 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-13T15:36:43.923 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-13T15:36:43.923 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-13T15:36:43.923 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-13T15:36:43.923 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-13T15:36:43.923 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-13T15:36:43.923 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-13T15:36:43.923 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-13T15:36:43.923 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-13T15:36:43.924 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-13T15:36:43.924 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-13T15:36:43.924 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-13T15:36:43.924 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-13T15:36:43.924 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-13T15:36:43.924 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-13T15:36:43.924 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-13T15:36:43.924 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-13T15:36:43.924 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-13T15:36:43.924 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-13T15:36:43.924 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-13T15:36:43.924 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-13T15:36:43.924 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-13T15:36:43.925 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-13T15:36:43.925 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-13T15:36:43.925 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-13T15:36:43.925 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-13T15:36:43.925 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-13T15:36:43.925 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-13T15:36:43.925 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-13T15:36:43.925 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-13T15:36:43.925 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-13T15:36:43.925 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-13T15:36:43.925 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-13T15:36:43.926 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-13T15:36:43.926 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-13T15:36:43.926 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-13T15:36:43.926 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-13T15:36:43.926 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-13T15:36:43.926 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-13T15:36:43.926 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-13T15:36:43.926 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-13T15:36:43.926 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-13T15:36:43.926 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-13T15:36:43.926 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-13T15:36:43.926 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-13T15:36:43.927 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-13T15:36:43.927 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-13T15:36:43.927 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-13T15:36:43.927 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-13T15:36:43.927 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-13T15:36:43.927 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-13T15:36:43.927 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-13T15:36:43.927 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-13T15:36:43.927 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-13T15:36:43.927 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-13T15:36:43.927 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-13T15:36:43.927 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-13T15:36:43.927 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-13T15:36:43.927 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-13T15:36:43.928 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-13T15:36:43.928 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-13T15:36:43.928 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-13T15:36:43.928 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-13T15:36:43.928 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-13T15:36:43.928 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-13T15:36:43.928 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-13T15:36:43.928 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-13T15:36:43.928 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-13T15:36:43.928 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-13T15:36:43.928 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-13T15:36:43.928 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-13T15:36:43.928 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-13T15:36:43.928 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-13T15:36:43.929 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-13T15:36:43.929 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-13T15:36:43.929 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-13T15:36:43.929 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-13T15:36:43.929 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-13T15:36:43.929 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-13T15:36:43.929 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-13T15:36:43.929 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-13T15:36:43.929 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-13T15:36:43.929 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-13T15:36:43.929 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-13T15:36:43.929 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-13T15:36:43.929 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-13T15:36:43.929 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-13T15:36:43.930 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-13T15:36:43.930 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-13T15:36:43.930 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-13T15:36:43.930 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-13T15:36:43.930 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-13T15:36:43.930 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-13T15:36:43.930 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-13T15:36:43.930 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-13T15:36:43.930 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-13T15:36:43.930 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-13T15:36:43.930 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-13T15:36:43.930 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-13T15:36:43.930 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-13T15:36:43.931 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-13T15:36:43.931 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-13T15:36:43.931 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-13T15:36:43.931 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-13T15:36:43.931 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-13T15:36:43.931 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-13T15:36:43.931 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-13T15:36:43.931 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-13T15:36:43.931 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-13T15:36:43.931 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-13T15:36:43.931 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-13T15:36:43.931 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-13T15:36:43.931 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-13T15:36:43.932 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-13T15:36:43.932 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-13T15:36:43.932 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-13T15:36:43.932 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-13T15:36:43.932 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-13T15:36:43.932 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-13T15:36:43.932 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-13T15:36:43.932 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-13T15:36:43.932 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-13T15:36:43.932 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-13T15:36:43.932 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-13T15:36:43.932 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-13T15:36:43.932 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-13T15:36:43.933 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-13T15:36:43.933 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-13T15:36:43.933 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-13T15:36:43.933 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-13T15:36:43.933 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-13T15:36:43.933 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-13T15:36:43.933 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-13T15:36:43.933 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-13T15:36:43.933 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-13T15:36:43.933 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-13T15:36:43.933 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-13T15:36:43.933 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-13T15:36:43.933 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-13T15:36:43.933 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-13T15:36:43.934 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-13T15:36:43.934 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-13T15:36:43.934 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-13T15:36:43.934 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-13T15:36:43.934 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-13T15:36:43.934 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-13T15:36:43.934 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-13T15:36:43.934 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-13T15:36:43.934 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-13T15:36:43.934 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-13T15:36:43.934 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-13T15:36:43.934 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-13T15:36:43.934 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-13T15:36:43.934 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-13T15:36:43.935 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-13T15:36:43.935 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-13T15:36:43.935 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-13T15:36:43.935 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-13T15:36:43.935 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-13T15:36:43.935 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-13T15:36:43.935 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-13T15:36:43.935 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-13T15:36:43.935 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-13T15:36:43.935 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-13T15:36:43.935 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-13T15:36:43.935 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-13T15:36:43.935 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-13T15:36:43.936 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-13T15:36:43.936 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-13T15:36:43.936 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-13T15:36:43.936 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-13T15:36:43.936 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-13T15:36:43.936 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-13T15:36:43.936 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-13T15:36:43.936 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-13T15:36:43.936 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-13T15:36:43.936 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-13T15:36:43.936 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-13T15:36:43.936 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-13T15:36:43.936 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-13T15:36:43.937 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-13T15:36:43.937 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-13T15:36:43.937 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-13T15:36:43.937 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-13T15:36:43.937 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-13T15:36:43.937 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-13T15:36:43.937 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-13T15:36:43.937 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-13T15:36:43.937 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-13T15:36:43.937 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-13T15:36:43.937 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-13T15:36:43.937 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-13T15:36:43.938 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-13T15:36:43.938 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-13T15:36:43.938 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-13T15:36:43.938 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-13T15:36:43.938 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-13T15:36:43.938 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-13T15:36:43.938 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-13T15:36:43.938 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-13T15:36:43.938 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-13T15:36:43.938 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-13T15:36:43.938 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-13T15:36:43.938 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-13T15:36:43.938 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-13T15:36:43.938 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-13T15:36:43.939 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-13T15:36:43.939 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-13T15:36:43.939 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-13T15:36:43.939 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-13T15:36:43.939 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-13T15:36:43.939 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-13T15:36:43.939 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-13T15:36:43.939 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-13T15:36:43.939 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-13T15:36:43.939 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-13T15:36:43.939 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-13T15:36:43.939 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-13T15:36:43.939 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-13T15:36:43.939 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-13T15:36:43.940 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-13T15:36:43.940 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-13T15:36:43.940 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-13T15:36:43.940 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-13T15:36:43.940 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-13T15:36:43.940 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-13T15:36:43.940 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-13T15:36:43.940 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-13T15:36:43.940 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-13T15:36:43.940 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-13T15:36:43.940 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-13T15:36:43.940 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-13T15:36:43.940 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-13T15:36:43.941 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-13T15:36:43.941 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-13T15:36:43.941 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-13T15:36:43.941 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-13T15:36:43.941 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-13T15:36:43.941 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-13T15:36:43.941 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-13T15:36:43.941 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-13T15:36:43.941 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-13T15:36:43.941 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-13T15:36:43.941 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-13T15:36:43.941 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-13T15:36:43.941 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-13T15:36:43.941 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-13T15:36:43.942 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-13T15:36:43.942 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-13T15:36:43.942 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-13T15:36:43.942 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-13T15:36:43.942 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-13T15:36:43.942 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-13T15:36:43.942 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-13T15:36:43.942 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-13T15:36:43.942 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-13T15:36:43.942 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-13T15:36:43.942 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-13T15:36:43.942 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-13T15:36:43.942 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-13T15:36:43.942 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-13T15:36:43.943 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-13T15:36:43.943 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-13T15:36:43.943 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-13T15:36:43.943 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-13T15:36:43.943 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-13T15:36:43.943 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-13T15:36:43.943 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-13T15:36:43.943 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-13T15:36:43.943 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-13T15:36:43.943 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-13T15:36:43.943 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-13T15:36:43.943 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-13T15:36:43.943 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-13T15:36:43.943 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-13T15:36:43.944 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-13T15:36:43.944 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-13T15:36:43.944 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-13T15:36:43.944 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-13T15:36:43.944 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-13T15:36:43.944 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-13T15:36:43.944 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-13T15:36:43.944 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-13T15:36:43.944 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-13T15:36:43.944 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-13T15:36:43.945 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-13T15:36:43.945 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-13T15:36:43.945 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-13T15:36:43.945 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-13T15:36:43.945 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-13T15:36:43.945 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-13T15:36:43.945 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-13T15:36:43.945 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-13T15:36:43.945 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-13T15:36:43.945 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-13T15:36:43.945 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-13T15:36:43.945 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-13T15:36:43.945 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-13T15:36:43.946 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-13T15:36:43.946 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-13T15:36:43.946 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-13T15:36:43.946 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-13T15:36:43.946 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-13T15:36:43.946 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-13T15:36:43.946 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-13T15:36:43.946 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-13T15:36:43.946 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-13T15:36:43.946 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-13T15:36:43.946 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-13T15:36:43.946 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-13T15:36:43.946 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-13T15:36:43.947 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-13T15:36:43.947 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-13T15:36:43.947 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-13T15:36:43.947 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-13T15:36:43.947 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-13T15:36:43.947 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-13T15:36:43.947 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-13T15:36:43.947 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-13T15:36:43.947 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-13T15:36:43.947 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-13T15:36:43.947 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-13T15:36:43.947 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-13T15:36:43.947 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-13T15:36:43.948 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-13T15:36:43.948 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-13T15:36:43.948 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-13T15:36:43.948 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-13T15:36:43.948 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-13T15:36:43.948 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-13T15:36:43.948 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-13T15:36:43.948 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-13T15:36:43.948 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-13T15:36:43.948 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-13T15:36:43.948 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-13T15:36:43.948 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-13T15:36:43.948 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-13T15:36:43.949 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-13T15:36:43.949 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-13T15:36:43.949 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-13T15:36:43.949 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-13T15:36:43.949 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-13T15:36:43.949 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-13T15:36:43.949 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-13T15:36:43.949 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-13T15:36:43.949 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-13T15:36:43.949 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-13T15:36:43.949 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-13T15:36:43.949 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-13T15:36:43.949 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-13T15:36:43.949 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-13T15:36:43.950 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-13T15:36:43.950 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-13T15:36:43.950 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-13T15:36:43.950 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-13T15:36:43.950 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-13T15:36:43.950 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-13T15:36:43.950 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-13T15:36:43.950 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-13T15:36:43.950 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-13T15:36:43.950 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-13T15:36:43.950 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-13T15:36:43.950 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-13T15:36:43.950 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-13T15:36:43.950 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-13T15:36:43.951 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-13T15:36:43.951 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-13T15:36:43.951 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-13T15:36:43.951 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-13T15:36:43.951 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-13T15:36:43.951 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-13T15:36:43.951 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-13T15:36:43.951 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-13T15:36:43.951 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-13T15:36:43.951 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-13T15:36:43.951 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-13T15:36:43.951 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-13T15:36:43.951 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-13T15:36:43.951 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-13T15:36:43.952 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-13T15:36:43.952 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-13T15:36:43.952 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-13T15:36:43.952 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-13T15:36:43.952 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-13T15:36:43.952 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-13T15:36:43.952 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-13T15:36:43.952 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-13T15:36:43.952 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-13T15:36:43.953 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-13T15:36:43.953 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-13T15:36:43.953 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-13T15:36:43.953 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-13T15:36:43.953 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-13T15:36:43.953 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-13T15:36:43.953 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-13T15:36:43.953 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-13T15:36:43.953 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-13T15:36:43.953 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-13T15:36:43.953 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-13T15:36:43.953 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-13T15:36:43.953 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-13T15:36:43.954 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-13T15:36:43.954 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-13T15:36:43.954 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-13T15:36:43.954 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-13T15:36:43.954 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-13T15:36:43.954 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-13T15:36:43.954 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-13T15:36:43.954 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-13T15:36:43.954 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-13T15:36:43.954 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-13T15:36:43.954 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-13T15:36:43.954 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-13T15:36:43.954 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-13T15:36:43.954 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-13T15:36:43.955 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-13T15:36:43.955 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-13T15:36:43.955 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-13T15:36:43.955 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-13T15:36:43.955 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-13T15:36:43.955 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-13T15:36:43.955 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-13T15:36:43.955 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-13T15:36:43.955 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-13T15:36:43.955 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-13T15:36:43.955 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-13T15:36:43.955 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-13T15:36:43.955 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-13T15:36:43.955 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-13T15:36:43.956 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-13T15:36:43.956 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-13T15:36:43.956 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-13T15:36:43.956 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-13T15:36:43.956 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-13T15:36:43.956 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-13T15:36:43.956 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-13T15:36:43.956 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-13T15:36:43.956 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-13T15:36:43.956 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-13T15:36:43.956 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-13T15:36:43.956 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-13T15:36:43.956 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-13T15:36:43.957 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-13T15:36:43.957 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-13T15:36:43.957 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-13T15:36:43.957 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-13T15:36:43.957 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-13T15:36:43.957 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-13T15:36:43.957 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-13T15:36:43.957 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-13T15:36:43.957 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-13T15:36:43.957 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-13T15:36:43.957 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-13T15:36:43.957 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-13T15:36:43.957 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-13T15:36:43.957 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-13T15:36:43.957 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-13T15:36:43.958 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-13T15:36:43.958 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-13T15:36:43.958 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-13T15:36:43.958 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-13T15:36:43.958 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-13T15:36:43.958 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-13T15:36:43.958 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-13T15:36:43.958 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-13T15:36:43.958 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-13T15:36:43.958 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-13T15:36:43.958 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-13T15:36:43.958 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-13T15:36:43.958 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-13T15:36:43.958 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-13T15:36:43.959 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-13T15:36:43.959 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-13T15:36:43.959 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-13T15:36:43.959 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-13T15:36:43.959 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-13T15:36:43.959 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-13T15:36:43.959 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-13T15:36:43.959 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-13T15:36:43.959 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-13T15:36:43.959 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-13T15:36:43.959 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-13T15:36:43.959 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-13T15:36:43.959 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-13T15:36:43.960 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-13T15:36:43.960 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-13T15:36:43.960 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-13T15:36:43.960 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-13T15:36:43.960 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-13T15:36:43.960 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-13T15:36:43.960 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-13T15:36:43.960 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-13T15:36:43.960 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-13T15:36:43.960 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-13T15:36:43.960 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-13T15:36:43.960 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-13T15:36:43.960 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-13T15:36:43.961 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-13T15:36:43.961 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-13T15:36:43.961 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-13T15:36:43.961 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-13T15:36:43.961 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-13T15:36:43.961 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-13T15:36:43.961 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-13T15:36:43.961 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-13T15:36:43.961 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-13T15:36:43.961 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-13T15:36:43.961 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-13T15:36:43.961 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-13T15:36:43.961 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-13T15:36:43.962 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-13T15:36:43.962 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-13T15:36:43.962 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-13T15:36:43.962 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-13T15:36:43.962 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-13T15:36:43.962 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-13T15:36:43.962 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-13T15:36:43.962 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-13T15:36:43.962 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-13T15:36:43.962 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-13T15:36:43.962 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-13T15:36:43.962 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-13T15:36:43.962 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-13T15:36:43.962 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-13T15:36:43.963 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-13T15:36:43.963 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-13T15:36:43.963 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-13T15:36:43.963 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-13T15:36:43.963 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-13T15:36:43.963 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-13T15:36:43.963 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-13T15:36:43.963 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-13T15:36:43.963 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-13T15:36:43.963 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-13T15:36:43.963 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-13T15:36:43.963 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-13T15:36:43.963 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-13T15:36:43.964 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-13T15:36:43.964 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-13T15:36:43.964 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-13T15:36:43.964 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-13T15:36:43.964 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-13T15:36:43.964 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-13T15:36:43.964 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-13T15:36:43.964 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-13T15:36:43.964 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-13T15:36:43.964 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-13T15:36:43.964 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-13T15:36:43.964 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-13T15:36:43.964 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-13T15:36:43.965 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-13T15:36:43.965 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-13T15:36:43.965 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-13T15:36:43.965 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-13T15:36:43.965 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-13T15:36:43.965 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-13T15:36:43.965 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-13T15:36:43.965 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-13T15:36:43.965 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-13T15:36:43.965 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-13T15:36:43.965 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-13T15:36:43.965 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-13T15:36:43.965 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-13T15:36:43.965 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-13T15:36:43.966 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-13T15:36:43.966 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-13T15:36:43.966 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-13T15:36:43.966 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-13T15:36:43.966 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-13T15:36:43.966 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-13T15:36:43.966 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-13T15:36:43.966 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-13T15:36:43.966 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-13T15:36:43.966 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-13T15:36:43.966 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-13T15:36:43.966 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-13T15:36:43.966 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-13T15:36:43.966 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-13T15:36:43.967 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-13T15:36:43.967 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-13T15:36:43.967 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-13T15:36:43.967 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-13T15:36:43.967 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-13T15:36:43.967 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-13T15:36:43.967 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-13T15:36:43.967 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-13T15:36:43.967 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-13T15:36:43.967 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-13T15:36:43.967 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-13T15:36:43.967 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-13T15:36:43.967 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-13T15:36:43.967 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-13T15:36:43.968 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-13T15:36:43.968 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-13T15:36:43.968 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-13T15:36:43.968 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-13T15:36:43.968 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-13T15:36:43.968 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-13T15:36:43.968 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-13T15:36:43.968 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-13T15:36:43.968 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-13T15:36:43.968 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-13T15:36:43.968 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-13T15:36:43.968 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-13T15:36:43.968 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-13T15:36:43.969 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-13T15:36:43.969 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-13T15:36:43.969 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-13T15:36:43.969 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-13T15:36:43.969 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-13T15:36:43.969 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-13T15:36:43.969 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-13T15:36:43.969 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-13T15:36:43.969 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-13T15:36:43.969 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-13T15:36:43.969 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-13T15:36:43.969 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-13T15:36:43.969 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-13T15:36:43.969 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-13T15:36:43.970 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-13T15:36:43.970 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-13T15:36:43.970 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-13T15:36:43.970 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-13T15:36:43.970 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-13T15:36:43.970 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-13T15:36:43.970 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-13T15:36:43.970 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-13T15:36:43.970 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-13T15:36:43.970 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-13T15:36:43.970 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-13T15:36:43.970 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-13T15:36:43.970 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-13T15:36:43.970 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-13T15:36:43.971 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-13T15:36:43.971 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-13T15:36:43.971 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-13T15:36:43.971 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-13T15:36:43.971 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-13T15:36:43.971 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-13T15:36:43.971 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-13T15:36:43.971 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-13T15:36:43.971 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-13T15:36:43.971 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-13T15:36:43.971 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-13T15:36:43.971 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-13T15:36:43.971 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-13T15:36:43.972 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-13T15:36:43.972 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-13T15:36:43.972 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-13T15:36:43.972 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-13T15:36:43.972 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-13T15:36:43.972 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-13T15:36:43.972 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-13T15:36:43.972 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-13T15:36:43.972 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-13T15:36:43.972 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-13T15:36:43.972 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-13T15:36:43.972 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-13T15:36:43.972 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-13T15:36:43.972 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-13T15:36:43.973 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-13T15:36:43.973 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-13T15:36:43.973 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-13T15:36:43.973 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-13T15:36:43.973 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-13T15:36:43.973 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-13T15:36:43.973 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-13T15:36:43.973 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-13T15:36:43.973 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-13T15:36:43.973 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-13T15:36:43.973 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-13T15:36:43.973 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-13T15:36:43.973 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-13T15:36:43.974 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-13T15:36:43.974 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-13T15:36:43.974 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-13T15:36:43.974 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-13T15:36:43.974 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-13T15:36:43.974 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-13T15:36:43.974 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-13T15:36:43.974 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-13T15:36:43.974 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-13T15:36:43.974 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-13T15:36:43.974 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-13T15:36:43.974 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-13T15:36:43.974 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-13T15:36:43.974 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-13T15:36:43.975 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-13T15:36:43.975 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-13T15:36:43.975 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-13T15:36:43.975 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-13T15:36:43.975 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-13T15:36:43.975 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-13T15:36:43.975 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-13T15:36:43.975 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-13T15:36:43.975 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-13T15:36:43.975 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-13T15:36:43.975 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-13T15:36:43.975 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-13T15:36:43.975 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-13T15:36:43.975 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-13T15:36:43.975 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-13T15:36:43.976 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-13T15:36:43.976 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-13T15:36:43.976 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-13T15:36:43.976 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-13T15:36:43.976 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-13T15:36:43.976 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-13T15:36:43.976 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-13T15:36:43.976 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-13T15:36:43.976 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-13T15:36:43.976 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-13T15:36:43.976 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-13T15:36:43.976 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-13T15:36:43.976 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-13T15:36:43.977 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-13T15:36:43.977 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-13T15:36:43.977 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-13T15:36:43.977 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-13T15:36:43.977 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-13T15:36:43.977 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-13T15:36:43.977 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-13T15:36:43.977 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-13T15:36:43.977 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-13T15:36:43.977 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-13T15:36:43.977 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-13T15:36:43.977 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-13T15:36:43.977 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-13T15:36:43.977 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-13T15:36:43.978 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-13T15:36:43.978 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-13T15:36:43.978 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-13T15:36:43.978 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-13T15:36:43.978 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-13T15:36:43.978 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-13T15:36:43.978 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-13T15:36:43.978 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-13T15:36:43.978 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-13T15:36:43.978 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-13T15:36:43.978 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-13T15:36:43.978 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-13T15:36:43.978 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-13T15:36:43.978 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-13T15:36:43.979 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-13T15:36:43.979 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-13T15:36:43.979 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-13T15:36:43.979 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-13T15:36:43.979 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-13T15:36:43.979 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-13T15:36:43.979 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-13T15:36:43.979 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-13T15:36:43.979 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-13T15:36:43.979 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-13T15:36:43.979 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-13T15:36:43.979 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-13T15:36:43.979 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-13T15:36:43.979 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-13T15:36:43.979 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-13T15:36:43.980 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-13T15:36:43.980 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-13T15:36:43.980 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-13T15:36:43.980 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-13T15:36:43.980 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-13T15:36:43.980 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-13T15:36:43.980 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-13T15:36:43.980 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-13T15:36:43.980 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-13T15:36:43.980 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-13T15:36:43.980 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-13T15:36:43.980 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-13T15:36:43.980 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-13T15:36:43.980 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-13T15:36:43.981 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-13T15:36:43.981 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-13T15:36:43.981 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-13T15:36:43.981 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-13T15:36:43.981 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-13T15:36:43.981 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-13T15:36:43.981 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-13T15:36:43.981 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-13T15:36:43.981 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-13T15:36:43.981 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-13T15:36:43.981 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-13T15:36:43.981 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-13T15:36:43.981 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-13T15:36:43.981 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-13T15:36:43.982 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-13T15:36:43.982 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-13T15:36:43.982 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-13T15:36:43.982 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-13T15:36:43.982 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-13T15:36:43.982 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-13T15:36:43.982 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-13T15:36:43.982 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-13T15:36:43.982 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-13T15:36:43.982 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-13T15:36:43.982 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-13T15:36:43.982 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-13T15:36:43.982 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-13T15:36:43.982 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-13T15:36:43.982 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-13T15:36:43.983 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-13T15:36:43.983 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-13T15:36:43.983 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-13T15:36:43.983 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-13T15:36:43.983 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-13T15:36:43.983 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-13T15:36:43.983 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-13T15:36:43.983 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-13T15:36:43.983 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-13T15:36:43.983 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-13T15:36:43.983 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-13T15:36:43.983 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-13T15:36:43.983 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-13T15:36:43.983 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-13T15:36:43.984 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-13T15:36:43.984 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-13T15:36:43.984 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-13T15:36:43.984 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-13T15:36:43.984 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-13T15:36:43.984 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-13T15:36:43.984 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-13T15:36:43.984 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-13T15:36:43.984 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-13T15:36:43.984 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-13T15:36:43.984 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-13T15:36:43.984 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-13T15:36:43.984 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-13T15:36:43.984 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-13T15:36:43.985 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-13T15:36:43.985 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-13T15:36:43.985 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-13T15:36:43.985 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-13T15:36:43.985 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-13T15:36:43.985 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-13T15:36:43.985 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-13T15:36:43.985 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-13T15:36:43.985 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-13T15:36:43.985 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-13T15:36:43.985 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-13T15:36:43.985 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-13T15:36:43.985 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-13T15:36:43.985 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-13T15:36:43.986 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-13T15:36:43.986 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-13T15:36:43.986 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-13T15:36:43.986 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-13T15:36:43.986 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-13T15:36:43.986 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-13T15:36:43.986 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-13T15:36:43.986 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-13T15:36:43.986 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-13T15:36:43.986 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-13T15:36:43.986 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-13T15:36:43.986 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-13T15:36:43.986 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-13T15:36:43.986 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-13T15:36:43.987 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-13T15:36:43.987 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-13T15:36:43.987 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-13T15:36:43.987 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-13T15:36:43.987 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-13T15:36:43.987 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-13T15:36:43.987 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-13T15:36:43.987 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-13T15:36:43.987 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-13T15:36:43.987 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-13T15:36:43.987 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-13T15:36:43.987 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-13T15:36:43.987 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-13T15:36:43.987 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-13T15:36:43.987 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-13T15:36:43.988 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-13T15:36:43.988 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-13T15:36:43.988 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-13T15:36:43.988 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-13T15:36:43.988 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-13T15:36:43.988 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-13T15:36:43.988 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-13T15:36:43.988 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-13T15:36:43.988 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-13T15:36:43.988 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-13T15:36:43.988 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-13T15:36:43.988 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-13T15:36:43.989 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-13T15:36:43.989 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-13T15:36:43.989 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-13T15:36:43.989 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-13T15:36:43.989 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-13T15:36:43.989 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-13T15:36:43.989 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-13T15:36:43.989 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-13T15:36:43.989 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-13T15:36:43.989 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-13T15:36:43.989 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-13T15:36:43.990 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-13T15:36:43.990 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-13T15:36:43.990 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-13T15:36:43.990 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-13T15:36:43.990 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-13T15:36:43.990 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-13T15:36:43.990 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-13T15:36:43.990 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-13T15:36:43.990 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-13T15:36:43.990 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-13T15:36:43.990 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-13T15:36:43.990 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-13T15:36:43.990 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-13T15:36:43.990 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-13T15:36:43.991 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-13T15:36:43.991 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-13T15:36:43.991 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-13T15:36:43.991 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-13T15:36:43.991 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-13T15:36:43.991 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-13T15:36:43.991 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-13T15:36:43.991 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-13T15:36:43.991 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-13T15:36:43.991 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-13T15:36:43.991 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-13T15:36:43.991 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-13T15:36:43.991 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-13T15:36:43.991 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-13T15:36:43.992 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-13T15:36:43.992 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-13T15:36:43.992 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-13T15:36:43.992 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-13T15:36:43.992 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-13T15:36:43.992 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-13T15:36:43.992 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-13T15:36:43.992 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-13T15:36:43.992 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-13T15:36:43.992 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-13T15:36:43.992 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-13T15:36:43.992 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-13T15:36:43.992 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-13T15:36:43.993 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-13T15:36:43.993 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-13T15:36:43.993 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-13T15:36:43.993 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-13T15:36:43.993 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-13T15:36:43.993 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-13T15:36:43.993 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-13T15:36:43.993 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-13T15:36:43.993 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-13T15:36:43.993 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-13T15:36:43.993 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-13T15:36:43.993 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-13T15:36:43.993 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-13T15:36:43.993 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-13T15:36:43.994 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-13T15:36:43.994 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-13T15:36:43.994 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-13T15:36:43.994 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-13T15:36:43.994 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-13T15:36:43.994 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-13T15:36:43.994 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-13T15:36:43.994 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-13T15:36:43.994 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-13T15:36:43.994 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-13T15:36:43.994 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-13T15:36:43.994 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-13T15:36:43.994 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-13T15:36:43.994 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-13T15:36:43.995 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-13T15:36:43.995 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-13T15:36:43.995 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-13T15:36:43.995 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-13T15:36:43.995 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-13T15:36:43.995 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-13T15:36:43.995 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-13T15:36:43.995 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-13T15:36:43.995 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-13T15:36:43.995 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-13T15:36:43.995 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-13T15:36:43.995 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-13T15:36:43.995 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-13T15:36:43.995 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-13T15:36:43.996 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-13T15:36:43.996 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-13T15:36:43.996 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-13T15:36:43.996 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-13T15:36:43.996 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-13T15:36:43.996 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-13T15:36:43.996 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-13T15:36:43.996 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-13T15:36:43.996 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-13T15:36:43.996 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-13T15:36:43.996 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-13T15:36:43.996 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-13T15:36:43.996 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-13T15:36:43.997 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-13T15:36:43.997 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-13T15:36:43.997 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-13T15:36:43.997 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-13T15:36:43.997 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-13T15:36:43.997 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-13T15:36:43.997 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-13T15:36:43.997 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-13T15:36:43.997 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-13T15:36:43.997 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-13T15:36:43.997 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-13T15:36:43.997 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-13T15:36:43.997 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-13T15:36:43.997 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-13T15:36:43.998 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-13T15:36:43.998 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-13T15:36:43.998 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-13T15:36:43.998 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-13T15:36:43.998 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-13T15:36:43.998 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-13T15:36:43.998 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-13T15:36:43.998 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-13T15:36:43.998 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-13T15:36:43.998 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-13T15:36:43.998 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-13T15:36:43.998 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-13T15:36:43.998 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-13T15:36:43.998 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-13T15:36:43.998 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-13T15:36:43.999 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-13T15:36:43.999 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-13T15:36:43.999 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-13T15:36:43.999 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-13T15:36:43.999 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-13T15:36:43.999 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-13T15:36:43.999 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-13T15:36:43.999 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-13T15:36:43.999 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-13T15:36:43.999 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-13T15:36:43.999 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-13T15:36:43.999 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-13T15:36:43.999 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-13T15:36:43.999 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-13T15:36:44.000 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-13T15:36:44.000 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-13T15:36:44.000 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-13T15:36:44.000 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-13T15:36:44.000 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-13T15:36:44.000 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-13T15:36:44.000 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-13T15:36:44.000 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-13T15:36:44.000 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-13T15:36:44.000 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-13T15:36:44.000 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-13T15:36:44.000 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-13T15:36:44.000 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-13T15:36:44.001 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-13T15:36:44.001 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-13T15:36:44.001 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-13T15:36:44.001 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-13T15:36:44.001 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-13T15:36:44.001 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-13T15:36:44.001 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-13T15:36:44.001 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-13T15:36:44.001 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-13T15:36:44.001 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-13T15:36:44.001 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-13T15:36:44.001 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-13T15:36:44.001 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-13T15:36:44.001 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-13T15:36:44.002 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-13T15:36:44.002 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-13T15:36:44.002 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-13T15:36:44.002 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-13T15:36:44.002 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-13T15:36:44.002 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-13T15:36:44.002 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-13T15:36:44.002 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-13T15:36:44.002 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-13T15:36:44.002 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-13T15:36:44.002 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-13T15:36:44.002 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-13T15:36:44.002 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-13T15:36:44.002 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-13T15:36:44.003 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-13T15:36:44.003 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-13T15:36:44.003 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-13T15:36:44.003 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-13T15:36:44.003 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-13T15:36:44.003 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-13T15:36:44.003 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-13T15:36:44.003 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-13T15:36:44.003 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-13T15:36:44.003 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-13T15:36:44.003 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-13T15:36:44.003 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-13T15:36:44.003 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-13T15:36:44.003 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-13T15:36:44.004 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-13T15:36:44.004 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-13T15:36:44.004 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-13T15:36:44.004 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-13T15:36:44.004 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-13T15:36:44.004 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-13T15:36:44.004 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-13T15:36:44.004 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-13T15:36:44.004 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-13T15:36:44.004 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-13T15:36:44.004 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-13T15:36:44.004 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-13T15:36:44.004 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-13T15:36:44.005 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-13T15:36:44.005 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-13T15:36:44.005 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-13T15:36:44.005 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-13T15:36:44.005 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-13T15:36:44.005 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-13T15:36:44.005 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-13T15:36:44.005 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-13T15:36:44.005 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-13T15:36:44.005 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-13T15:36:44.005 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-13T15:36:44.005 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-13T15:36:44.005 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-13T15:36:44.005 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-13T15:36:44.006 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-13T15:36:44.006 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-13T15:36:44.006 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-13T15:36:44.006 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-13T15:36:44.006 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-13T15:36:44.006 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-13T15:36:44.006 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-13T15:36:44.006 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-13T15:36:44.006 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-13T15:36:44.006 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-13T15:36:44.006 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-13T15:36:44.006 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-13T15:36:44.006 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-13T15:36:44.006 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-13T15:36:44.007 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-13T15:36:44.007 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-13T15:36:44.007 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-13T15:36:44.007 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-13T15:36:44.007 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-13T15:36:44.007 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-13T15:36:44.007 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-13T15:36:44.007 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-13T15:36:44.007 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-13T15:36:44.007 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-13T15:36:44.007 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-13T15:36:44.007 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-13T15:36:44.007 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-13T15:36:44.007 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-13T15:36:44.008 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-13T15:36:44.008 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-13T15:36:44.008 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-13T15:36:44.008 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-13T15:36:44.008 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-13T15:36:44.008 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-13T15:36:44.008 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-13T15:36:44.008 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-13T15:36:44.008 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-13T15:36:44.008 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-13T15:36:44.008 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-13T15:36:44.008 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-13T15:36:44.008 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-13T15:36:44.008 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-13T15:36:44.009 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-13T15:36:44.009 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-13T15:36:44.009 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-13T15:36:44.009 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-13T15:36:44.009 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-13T15:36:44.009 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-13T15:36:44.009 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-13T15:36:44.009 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-13T15:36:44.009 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-13T15:36:44.009 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-13T15:36:44.009 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-13T15:36:44.009 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-13T15:36:44.009 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-13T15:36:44.009 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-13T15:36:44.010 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-13T15:36:44.010 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-13T15:36:44.010 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-13T15:36:44.010 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-13T15:36:44.010 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-13T15:36:44.010 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-13T15:36:44.010 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-13T15:36:44.010 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-13T15:36:44.010 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-13T15:36:44.010 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-13T15:36:44.010 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-13T15:36:44.010 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-13T15:36:44.010 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-13T15:36:44.011 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-13T15:36:44.011 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-13T15:36:44.011 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-13T15:36:44.011 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-13T15:36:44.011 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-13T15:36:44.011 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-13T15:36:44.011 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-13T15:36:44.011 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-13T15:36:44.011 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-13T15:36:44.011 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-13T15:36:44.011 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-13T15:36:44.011 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-13T15:36:44.011 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-13T15:36:44.011 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-13T15:36:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-13T15:36:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-13T15:36:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-13T15:36:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-13T15:36:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-13T15:36:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-13T15:36:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-13T15:36:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-13T15:36:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-13T15:36:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-13T15:36:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-13T15:36:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-13T15:36:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-13T15:36:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-13T15:36:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-13T15:36:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-13T15:36:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-13T15:36:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-13T15:36:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-13T15:36:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-13T15:36:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-13T15:36:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-13T15:36:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-13T15:36:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-13T15:36:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-13T15:36:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-13T15:36:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-13T15:36:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-13T15:36:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-13T15:36:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-13T15:36:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-13T15:36:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-13T15:36:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-13T15:36:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-13T15:36:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-13T15:36:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-13T15:36:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-13T15:36:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-13T15:36:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-13T15:36:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-13T15:36:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-13T15:36:44.015 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-13T15:36:44.015 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-13T15:36:44.015 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-13T15:36:44.015 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-13T15:36:44.015 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-13T15:36:44.015 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-13T15:36:44.015 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-13T15:36:44.015 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-13T15:36:44.015 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-13T15:36:44.015 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-13T15:36:44.015 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-13T15:36:44.015 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-13T15:36:44.015 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-13T15:36:44.015 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-13T15:36:44.015 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-13T15:36:44.016 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-13T15:36:44.016 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-13T15:36:44.016 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-13T15:36:44.016 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-13T15:36:44.016 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-13T15:36:44.016 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-13T15:36:44.016 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-13T15:36:44.016 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-13T15:36:44.016 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-13T15:36:44.016 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-13T15:36:44.016 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-13T15:36:44.016 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-13T15:36:44.016 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-13T15:36:44.016 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-13T15:36:44.017 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-13T15:36:44.017 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-13T15:36:44.017 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-13T15:36:44.017 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-13T15:36:44.017 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-13T15:36:44.017 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-13T15:36:44.017 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-13T15:36:44.017 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-13T15:36:44.017 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-13T15:36:44.017 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-13T15:36:44.017 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-13T15:36:44.017 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-13T15:36:44.017 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-13T15:36:44.017 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-13T15:36:44.018 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-13T15:36:44.018 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-13T15:36:44.018 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-13T15:36:44.018 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-13T15:36:44.018 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-13T15:36:44.018 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-13T15:36:44.018 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-13T15:36:44.018 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-13T15:36:44.018 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-13T15:36:44.018 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-13T15:36:44.018 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-13T15:36:44.018 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-13T15:36:44.018 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-13T15:36:44.018 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-13T15:36:44.019 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-13T15:36:44.019 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-13T15:36:44.019 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-13T15:36:44.019 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-13T15:36:44.019 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-13T15:36:44.019 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-13T15:36:44.019 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-13T15:36:44.019 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-13T15:36:44.019 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-13T15:36:44.019 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-13T15:36:44.019 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-13T15:36:44.019 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-13T15:36:44.019 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-13T15:36:44.019 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-13T15:36:44.020 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-13T15:36:44.020 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-13T15:36:44.020 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-13T15:36:44.020 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-13T15:36:44.020 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-13T15:36:44.020 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-13T15:36:44.020 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-13T15:36:44.020 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-13T15:36:44.020 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-13T15:36:44.020 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-13T15:36:44.020 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-13T15:36:44.020 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-13T15:36:44.020 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-13T15:36:44.020 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-13T15:36:44.021 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-13T15:36:44.021 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-13T15:36:44.021 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-13T15:36:44.021 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-13T15:36:44.021 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-13T15:36:44.021 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-13T15:36:44.021 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-13T15:36:44.021 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-13T15:36:44.021 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-13T15:36:44.021 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-13T15:36:44.021 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-13T15:36:44.021 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-13T15:36:44.021 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-13T15:36:44.021 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-13T15:36:44.022 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-13T15:36:44.022 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-13T15:36:44.022 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-13T15:36:44.022 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-13T15:36:44.022 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-13T15:36:44.022 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-13T15:36:44.022 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-13T15:36:44.022 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-13T15:36:44.022 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-13T15:36:44.022 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-13T15:36:44.023 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-13T15:36:44.023 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-13T15:36:44.023 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-13T15:36:44.023 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-13T15:36:44.023 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-13T15:36:44.023 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-13T15:36:44.023 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-13T15:36:44.023 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-13T15:36:44.023 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-13T15:36:44.023 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-13T15:36:44.023 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-13T15:36:44.023 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-13T15:36:44.023 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-13T15:36:44.023 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-13T15:36:44.024 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-13T15:36:44.024 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-13T15:36:44.024 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-13T15:36:44.024 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-13T15:36:44.024 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-13T15:36:44.024 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-13T15:36:44.024 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-13T15:36:44.024 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-13T15:36:44.024 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-13T15:36:44.024 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-13T15:36:44.024 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-13T15:36:44.024 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-13T15:36:44.024 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-13T15:36:44.025 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-13T15:36:44.025 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-13T15:36:44.025 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-13T15:36:44.025 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-13T15:36:44.025 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-13T15:36:44.025 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-13T15:36:44.025 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-13T15:36:44.025 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-13T15:36:44.025 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-13T15:36:44.025 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-13T15:36:44.025 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-13T15:36:44.025 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-13T15:36:44.025 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-13T15:36:44.025 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-13T15:36:44.026 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-13T15:36:44.026 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-13T15:36:44.026 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-13T15:36:44.026 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-13T15:36:44.026 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-13T15:36:44.026 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-13T15:36:44.026 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-13T15:36:44.026 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-13T15:36:44.026 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-13T15:36:44.026 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-13T15:36:44.027 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-13T15:36:44.027 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-13T15:36:44.027 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-13T15:36:44.027 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-13T15:36:44.027 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-13T15:36:44.027 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-13T15:36:44.027 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-13T15:36:44.027 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-13T15:36:44.027 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-13T15:36:44.027 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-13T15:36:44.027 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-13T15:36:44.027 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-13T15:36:44.027 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-13T15:36:44.027 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-13T15:36:44.028 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-13T15:36:44.028 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-13T15:36:44.028 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-13T15:36:44.028 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-13T15:36:44.028 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-13T15:36:44.028 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-13T15:36:44.028 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-13T15:36:44.028 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-13T15:36:44.028 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-13T15:36:44.028 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-13T15:36:44.028 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-13T15:36:44.028 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-13T15:36:44.028 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-13T15:36:44.028 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-13T15:36:44.029 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-13T15:36:44.029 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-13T15:36:44.029 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-13T15:36:44.029 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-13T15:36:44.029 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-13T15:36:44.029 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-13T15:36:44.029 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-13T15:36:44.029 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-13T15:36:44.029 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-13T15:36:44.029 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-13T15:36:44.029 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-13T15:36:44.029 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-13T15:36:44.029 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-13T15:36:44.029 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-13T15:36:44.030 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-13T15:36:44.030 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-13T15:36:44.030 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-13T15:36:44.030 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-13T15:36:44.030 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-13T15:36:44.030 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-13T15:36:44.030 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-13T15:36:44.030 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-13T15:36:44.030 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-13T15:36:44.030 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-13T15:36:44.030 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-13T15:36:44.030 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-13T15:36:44.030 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-13T15:36:44.030 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-13T15:36:44.031 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-13T15:36:44.031 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-13T15:36:44.031 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-13T15:36:44.031 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-13T15:36:44.031 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-13T15:36:44.031 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-13T15:36:44.031 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-13T15:36:44.031 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-13T15:36:44.031 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-13T15:36:44.031 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-13T15:36:44.031 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-13T15:36:44.031 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-13T15:36:44.031 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-13T15:36:44.031 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-13T15:36:44.032 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-13T15:36:44.032 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-13T15:36:44.032 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-13T15:36:44.032 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-13T15:36:44.032 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-13T15:36:44.032 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-13T15:36:44.032 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-13T15:36:44.032 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-13T15:36:44.032 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-13T15:36:44.032 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-13T15:36:44.032 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-13T15:36:44.032 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-13T15:36:44.032 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-13T15:36:44.032 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-13T15:36:44.033 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-13T15:36:44.033 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-13T15:36:44.033 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-13T15:36:44.033 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-13T15:36:44.033 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-13T15:36:44.033 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-13T15:36:44.033 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-13T15:36:44.033 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-13T15:36:44.033 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-13T15:36:44.033 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-13T15:36:44.033 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-13T15:36:44.033 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-13T15:36:44.033 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-13T15:36:44.033 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-13T15:36:44.033 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-13T15:36:44.034 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-13T15:36:44.034 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-13T15:36:44.034 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-13T15:36:44.034 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-13T15:36:44.034 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-13T15:36:44.034 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-13T15:36:44.034 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-13T15:36:44.034 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-13T15:36:44.034 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-13T15:36:44.034 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-13T15:36:44.034 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-13T15:36:44.034 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-13T15:36:44.034 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-13T15:36:44.034 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-13T15:36:44.035 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-13T15:36:44.035 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-13T15:36:44.035 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-13T15:36:44.035 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-13T15:36:44.035 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-13T15:36:44.035 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-13T15:36:44.035 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-13T15:36:44.035 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-13T15:36:44.035 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-13T15:36:44.035 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-13T15:36:44.035 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-13T15:36:44.035 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-13T15:36:44.035 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-13T15:36:44.035 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-13T15:36:44.036 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-13T15:36:44.036 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-13T15:36:44.036 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-13T15:36:44.036 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-13T15:36:44.036 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-13T15:36:44.036 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-13T15:36:44.036 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-13T15:36:44.036 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-13T15:36:44.036 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-13T15:36:44.036 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-13T15:36:44.036 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-13T15:36:44.036 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-13T15:36:44.036 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-13T15:36:44.036 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-13T15:36:44.037 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-13T15:36:44.037 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-13T15:36:44.037 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-13T15:36:44.037 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-13T15:36:44.037 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-13T15:36:44.037 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-13T15:36:44.037 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-13T15:36:44.037 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-13T15:36:44.037 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-13T15:36:44.037 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-13T15:36:44.037 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-13T15:36:44.037 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-13T15:36:44.037 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-13T15:36:44.038 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-13T15:36:44.038 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-13T15:36:44.038 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-13T15:36:44.038 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-13T15:36:44.038 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-13T15:36:44.038 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-13T15:36:44.038 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-13T15:36:44.038 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-13T15:36:44.038 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-13T15:36:44.038 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-13T15:36:44.038 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-13T15:36:44.038 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-13T15:36:44.038 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-13T15:36:44.038 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-13T15:36:44.039 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-13T15:36:44.039 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-13T15:36:44.039 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-13T15:36:44.039 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-13T15:36:44.039 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-13T15:36:44.039 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-13T15:36:44.039 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-13T15:36:44.039 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-13T15:36:44.039 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-13T15:36:44.039 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-13T15:36:44.039 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-13T15:36:44.039 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-13T15:36:44.039 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-13T15:36:44.039 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-13T15:36:44.040 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-13T15:36:44.040 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-13T15:36:44.040 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-13T15:36:44.040 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-13T15:36:44.040 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-13T15:36:44.040 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-13T15:36:44.040 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-13T15:36:44.040 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-13T15:36:44.040 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-13T15:36:44.040 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-13T15:36:44.040 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-13T15:36:44.040 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-13T15:36:44.040 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-13T15:36:44.040 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-13T15:36:44.041 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-13T15:36:44.041 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-13T15:36:44.041 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-13T15:36:44.041 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-13T15:36:44.041 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-13T15:36:44.041 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-13T15:36:44.041 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-13T15:36:44.041 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-13T15:36:44.041 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-13T15:36:44.041 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-13T15:36:44.041 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-13T15:36:44.041 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-13T15:36:44.041 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-13T15:36:44.041 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-13T15:36:44.042 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-13T15:36:44.042 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-13T15:36:44.042 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-13T15:36:44.042 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-13T15:36:44.042 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-13T15:36:44.042 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-13T15:36:44.042 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-13T15:36:44.042 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-13T15:36:44.042 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-13T15:36:44.042 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-13T15:36:44.042 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-13T15:36:44.042 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-13T15:36:44.042 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-13T15:36:44.042 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-13T15:36:44.042 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-13T15:36:44.043 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-13T15:36:44.043 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-13T15:36:44.043 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-13T15:36:44.043 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-13T15:36:44.043 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-13T15:36:44.043 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-13T15:36:44.043 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-13T15:36:44.043 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-13T15:36:44.043 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-13T15:36:44.043 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-13T15:36:44.043 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-13T15:36:44.043 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-13T15:36:44.043 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-13T15:36:44.043 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-13T15:36:44.044 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-13T15:36:44.044 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-13T15:36:44.044 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-13T15:36:44.044 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-13T15:36:44.044 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-13T15:36:44.044 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-13T15:36:44.044 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-13T15:36:44.044 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-13T15:36:44.044 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-13T15:36:44.044 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-13T15:36:44.045 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-13T15:36:44.045 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-13T15:36:44.045 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-13T15:36:44.045 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-13T15:36:44.045 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-13T15:36:44.045 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-13T15:36:44.045 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-13T15:36:44.045 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-13T15:36:44.045 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-13T15:36:44.045 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-13T15:36:44.045 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-13T15:36:44.045 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-13T15:36:44.045 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-13T15:36:44.045 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-13T15:36:44.046 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-13T15:36:44.046 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-13T15:36:44.046 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-13T15:36:44.046 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-13T15:36:44.046 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-13T15:36:44.046 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-13T15:36:44.046 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-13T15:36:44.046 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-13T15:36:44.046 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-13T15:36:44.046 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-13T15:36:44.046 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-13T15:36:44.046 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-13T15:36:44.046 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-13T15:36:44.047 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-13T15:36:44.047 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-13T15:36:44.047 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-13T15:36:44.047 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-13T15:36:44.047 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-13T15:36:44.047 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-13T15:36:44.047 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-13T15:36:44.047 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-13T15:36:44.047 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-13T15:36:44.047 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-13T15:36:44.047 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-13T15:36:44.047 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-13T15:36:44.047 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-13T15:36:44.047 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-13T15:36:44.048 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-13T15:36:44.048 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-13T15:36:44.048 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-13T15:36:44.048 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-13T15:36:44.048 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-13T15:36:44.048 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-13T15:36:44.048 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-13T15:36:44.048 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-13T15:36:44.048 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-13T15:36:44.048 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-13T15:36:44.048 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-13T15:36:44.048 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-13T15:36:44.048 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-13T15:36:44.048 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-13T15:36:44.049 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-13T15:36:44.049 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-13T15:36:44.049 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-13T15:36:44.049 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-13T15:36:44.049 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-13T15:36:44.049 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-13T15:36:44.049 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-13T15:36:44.049 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-13T15:36:44.049 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-13T15:36:44.049 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-13T15:36:44.049 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-13T15:36:44.049 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-13T15:36:44.049 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-13T15:36:44.049 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-13T15:36:44.050 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-13T15:36:44.050 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-13T15:36:44.050 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-13T15:36:44.050 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-13T15:36:44.050 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-13T15:36:44.050 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-13T15:36:44.050 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-13T15:36:44.050 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-13T15:36:44.050 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-13T15:36:44.050 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-13T15:36:44.050 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-13T15:36:44.050 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-13T15:36:44.050 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-13T15:36:44.050 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-13T15:36:44.051 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-13T15:36:44.051 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-13T15:36:44.051 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-13T15:36:44.051 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-13T15:36:44.051 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-13T15:36:44.051 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-13T15:36:44.051 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-13T15:36:44.051 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-13T15:36:44.051 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-13T15:36:44.051 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-13T15:36:44.051 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-13T15:36:44.051 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-13T15:36:44.051 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-13T15:36:44.052 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-13T15:36:44.052 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-13T15:36:44.052 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-13T15:36:44.052 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-13T15:36:44.052 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-13T15:36:44.052 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-13T15:36:44.052 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-13T15:36:44.052 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-13T15:36:44.052 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-13T15:36:44.052 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-13T15:36:44.053 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-13T15:36:44.053 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-13T15:36:44.053 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-13T15:36:44.053 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-13T15:36:44.053 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-13T15:36:44.053 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-13T15:36:44.053 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-13T15:36:44.053 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-13T15:36:44.060 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:36:44.060 DEBUG:teuthology.orchestra.run.smithi017:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-13T15:36:44.083 INFO:teuthology.orchestra.run.smithi017.stdout:postinstall scriptlet (using /bin/sh): 2024-09-13T15:36:44.083 INFO:teuthology.orchestra.run.smithi017.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-13T15:36:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-13T15:36:44.084 INFO:teuthology.orchestra.run.smithi017.stdout:fi 2024-09-13T15:36:44.084 INFO:teuthology.orchestra.run.smithi017.stdout:for file in vmlinuz System.map config; do 2024-09-13T15:36:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-13T15:36:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T15:36:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: fi 2024-09-13T15:36:44.084 INFO:teuthology.orchestra.run.smithi017.stdout:done 2024-09-13T15:36:44.084 INFO:teuthology.orchestra.run.smithi017.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-13T15:36:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-13T15:36:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T15:36:44.084 INFO:teuthology.orchestra.run.smithi017.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T15:36:44.084 INFO:teuthology.orchestra.run.smithi017.stdout:fi 2024-09-13T15:36:44.084 INFO:teuthology.orchestra.run.smithi017.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-13T15:36:44.085 INFO:teuthology.orchestra.run.smithi017.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:36:44.085 INFO:teuthology.orchestra.run.smithi017.stdout:fi 2024-09-13T15:36:44.085 INFO:teuthology.orchestra.run.smithi017.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-13T15:36:44.085 INFO:teuthology.orchestra.run.smithi017.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-13T15:36:44.085 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:36:44.085 INFO:teuthology.orchestra.run.smithi017.stdout:fi 2024-09-13T15:36:44.086 DEBUG:teuthology.orchestra.run.smithi017:> sudo rpm -qi grub2-tools 2024-09-13T15:36:44.160 INFO:teuthology.orchestra.run.smithi017.stdout:Name : grub2-tools 2024-09-13T15:36:44.160 INFO:teuthology.orchestra.run.smithi017.stdout:Epoch : 1 2024-09-13T15:36:44.160 INFO:teuthology.orchestra.run.smithi017.stdout:Version : 2.06 2024-09-13T15:36:44.160 INFO:teuthology.orchestra.run.smithi017.stdout:Release : 82.el9 2024-09-13T15:36:44.160 INFO:teuthology.orchestra.run.smithi017.stdout:Architecture: x86_64 2024-09-13T15:36:44.160 INFO:teuthology.orchestra.run.smithi017.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T15:36:44.160 INFO:teuthology.orchestra.run.smithi017.stdout:Group : Unspecified 2024-09-13T15:36:44.160 INFO:teuthology.orchestra.run.smithi017.stdout:Size : 8274670 2024-09-13T15:36:44.160 INFO:teuthology.orchestra.run.smithi017.stdout:License : GPLv3+ 2024-09-13T15:36:44.160 INFO:teuthology.orchestra.run.smithi017.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T15:36:44.161 INFO:teuthology.orchestra.run.smithi017.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T15:36:44.161 INFO:teuthology.orchestra.run.smithi017.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T15:36:44.161 INFO:teuthology.orchestra.run.smithi017.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T15:36:44.161 INFO:teuthology.orchestra.run.smithi017.stdout:Packager : builder@centos.org 2024-09-13T15:36:44.161 INFO:teuthology.orchestra.run.smithi017.stdout:Vendor : CentOS 2024-09-13T15:36:44.161 INFO:teuthology.orchestra.run.smithi017.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T15:36:44.161 INFO:teuthology.orchestra.run.smithi017.stdout:Summary : Support tools for GRUB. 2024-09-13T15:36:44.161 INFO:teuthology.orchestra.run.smithi017.stdout:Description : 2024-09-13T15:36:44.161 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:36:44.161 INFO:teuthology.orchestra.run.smithi017.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T15:36:44.161 INFO:teuthology.orchestra.run.smithi017.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T15:36:44.161 INFO:teuthology.orchestra.run.smithi017.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T15:36:44.161 INFO:teuthology.orchestra.run.smithi017.stdout:hardware devices. 2024-09-13T15:36:44.161 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:36:44.161 INFO:teuthology.orchestra.run.smithi017.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T15:36:44.162 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T15:36:44.163 INFO:teuthology.task.kernel:Updating grub on smithi017 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:36:44.163 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T15:36:44.758 INFO:teuthology.orchestra.run.smithi017.stderr:Generating grub configuration file ... 2024-09-13T15:36:46.166 INFO:teuthology.orchestra.run.smithi017.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T15:36:46.197 INFO:teuthology.orchestra.run.smithi017.stderr:done 2024-09-13T15:36:46.201 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-09-13T15:36:46.216 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.vHM6xswNLZ 2024-09-13T15:36:46.217 DEBUG:teuthology.orchestra.run.smithi017:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.vHM6xswNLZ 2024-09-13T15:36:46.283 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.vHM6xswNLZ 2024-09-13T15:36:46.418 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.vHM6xswNLZ is 6KB 2024-09-13T15:36:46.467 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.vHM6xswNLZ 2024-09-13T15:36:46.481 DEBUG:teuthology.orchestra.run.smithi017:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T15:36:46.544 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T15:36:46.544 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T15:36:46.544 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T15:36:46.544 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-13T15:36:46.545 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:36:46.702 DEBUG:teuthology.orchestra.run.smithi017:> sudo shutdown -r now 2024-09-13T15:37:16.705 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-13T15:37:16.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-13T15:37:16.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:37:35.041 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-09-13T15:37:44.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-13T15:37:44.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:38:44.053 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T15:38:56.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-13T15:38:56.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:38:56.423 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-09-13T15:38:56.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-13T15:38:56.877 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-13T15:38:56.878 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-09-13T15:38:56.913 INFO:teuthology.orchestra.run.smithi017.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:38:56.913 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T15:38:56.913 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T15:38:56.914 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T15:38:57.914 DEBUG:teuthology.parallel:result is None 2024-09-13T15:38:57.915 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T15:38:57.923 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T15:38:57.923 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T15:38:57.927 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T15:38:57.930 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T15:38:57.961 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T15:38:57.968 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T15:38:57.974 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T15:38:57.974 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T15:38:58.006 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T15:38:58.009 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T15:38:58.102 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T15:38:58.108 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T15:38:58.108 DEBUG:teuthology.orchestra.run.smithi189:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T15:38:58.125 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:38:58.128 DEBUG:teuthology.orchestra.run.smithi193:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T15:38:58.145 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:38:58.146 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T15:38:58.150 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T15:38:58.168 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T15:38:58.227 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T15:38:58.246 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T15:38:58.247 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T15:38:58.250 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T15:38:58.267 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T15:38:58.277 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T15:38:58.281 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T15:38:58.288 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T15:38:58.289 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T15:38:58.292 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T15:38:58.295 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T15:38:58.345 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T15:38:58.354 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T15:38:58.355 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T15:38:58.359 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T15:38:58.363 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T15:38:58.389 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T15:38:58.498 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T15:38:58.573 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T15:38:58.638 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T15:38:58.705 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T15:38:58.706 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T15:38:58.760 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T15:38:58.806 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T15:38:58.868 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T15:38:58.915 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T15:38:58.956 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-13T15:38:58.956 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T15:38:59.023 DEBUG:teuthology.orchestra.run.smithi193:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T15:38:59.072 DEBUG:teuthology.orchestra.run.smithi193:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T15:38:59.122 DEBUG:teuthology.orchestra.run.smithi193:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T15:38:59.209 DEBUG:teuthology.orchestra.run.smithi193:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T15:38:59.249 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-13T15:38:59.249 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T15:38:59.316 DEBUG:teuthology.orchestra.run.smithi017:> sudo service rsyslog restart 2024-09-13T15:38:59.320 DEBUG:teuthology.orchestra.run.smithi189:> sudo service rsyslog restart 2024-09-13T15:38:59.323 DEBUG:teuthology.orchestra.run.smithi193:> sudo service rsyslog restart 2024-09-13T15:38:59.363 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T15:38:59.393 INFO:teuthology.orchestra.run.smithi193.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T15:38:59.397 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T15:38:59.819 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T15:38:59.826 INFO:teuthology.task.internal:Starting timer... 2024-09-13T15:38:59.826 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T15:38:59.843 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T15:38:59.853 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-13T15:38:59.853 DEBUG:teuthology.orchestra.run.smithi017:> sudo service auditd rotate 2024-09-13T15:38:59.937 INFO:teuthology.orchestra.run.smithi017.stdout:Rotating logs: 2024-09-13T15:38:59.941 DEBUG:teuthology.orchestra.run.smithi189:> sudo service auditd rotate 2024-09-13T15:39:00.010 INFO:teuthology.orchestra.run.smithi189.stdout:Rotating logs: 2024-09-13T15:39:00.012 DEBUG:teuthology.orchestra.run.smithi193:> sudo service auditd rotate 2024-09-13T15:39:00.072 INFO:teuthology.orchestra.run.smithi193.stdout:Rotating logs: 2024-09-13T15:39:00.074 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T15:39:00.074 DEBUG:teuthology.orchestra.run.smithi017:> /usr/sbin/getenforce 2024-09-13T15:39:00.121 INFO:teuthology.orchestra.run.smithi017.stdout:Permissive 2024-09-13T15:39:00.121 DEBUG:teuthology.orchestra.run.smithi189:> /usr/sbin/getenforce 2024-09-13T15:39:00.145 INFO:teuthology.orchestra.run.smithi189.stdout:Permissive 2024-09-13T15:39:00.145 DEBUG:teuthology.orchestra.run.smithi193:> /usr/sbin/getenforce 2024-09-13T15:39:00.169 INFO:teuthology.orchestra.run.smithi193.stdout:Permissive 2024-09-13T15:39:00.169 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi017.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi189.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi193.front.sepia.ceph.com': 'permissive'} 2024-09-13T15:39:00.169 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T15:39:00.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:39:00.226 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T15:39:00.255 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:39:00.256 DEBUG:teuthology.orchestra.run.smithi193:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T15:39:00.283 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:39:00.284 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T15:39:00.284 DEBUG:teuthology.orchestra.run.smithi017:> sudo /usr/sbin/setenforce permissive 2024-09-13T15:39:00.348 DEBUG:teuthology.orchestra.run.smithi189:> sudo /usr/sbin/setenforce permissive 2024-09-13T15:39:00.380 DEBUG:teuthology.orchestra.run.smithi193:> sudo /usr/sbin/setenforce permissive 2024-09-13T15:39:00.428 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T15:39:00.438 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-13T15:39:00.440 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-13T15:39:00.554 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T15:39:00.565 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T15:39:00.566 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi017.front.sepia.ceph.com,smithi189.front.sepia.ceph.com,smithi193.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T15:43:44.454 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi017.front.sepia.ceph.com'), Remote(name='ubuntu@smithi189.front.sepia.ceph.com'), Remote(name='ubuntu@smithi193.front.sepia.ceph.com')] 2024-09-13T15:43:44.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-13T15:43:44.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:43:44.551 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-09-13T15:43:44.663 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-13T15:43:44.664 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-13T15:43:44.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:43:44.750 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-09-13T15:43:44.830 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-13T15:43:44.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-09-13T15:43:44.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:43:44.934 DEBUG:teuthology.orchestra.run.smithi193:> true 2024-09-13T15:43:45.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-09-13T15:43:45.014 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T15:43:45.030 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T15:43:45.030 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T15:43:45.031 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T15:43:45.035 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T15:43:45.035 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T15:43:45.037 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T15:43:45.037 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T15:43:45.069 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T15:43:45.085 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T15:43:45.085 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T15:43:45.094 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T15:43:45.100 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T15:43:45.112 INFO:teuthology.orchestra.run.smithi189.stderr:sudo: ntpd: command not found 2024-09-13T15:43:45.124 INFO:teuthology.orchestra.run.smithi189.stdout:506 Cannot talk to daemon 2024-09-13T15:43:45.124 INFO:teuthology.orchestra.run.smithi193.stderr:sudo: ntpd: command not found 2024-09-13T15:43:45.124 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T15:43:45.134 INFO:teuthology.orchestra.run.smithi193.stdout:506 Cannot talk to daemon 2024-09-13T15:43:45.138 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T15:43:45.149 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T15:43:45.153 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T15:43:45.163 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T15:43:45.176 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: ntpd: command not found 2024-09-13T15:43:45.200 INFO:teuthology.orchestra.run.smithi017.stdout:506 Cannot talk to daemon 2024-09-13T15:43:45.209 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-09-13T15:43:45.213 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T15:43:45.213 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-09-13T15:43:45.213 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:43:45.213 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:43:45.213 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:43:45.213 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:43:45.220 INFO:teuthology.orchestra.run.smithi193.stderr:bash: line 1: ntpq: command not found 2024-09-13T15:43:45.223 INFO:teuthology.orchestra.run.smithi193.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T15:43:45.223 INFO:teuthology.orchestra.run.smithi193.stdout:=============================================================================== 2024-09-13T15:43:45.223 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:43:45.223 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:43:45.223 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:43:45.223 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:43:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T15:43:45.260 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T15:43:45.364 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-09-13T15:43:45.371 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T15:43:45.371 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-09-13T15:43:45.371 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:43:45.371 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:43:45.372 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:43:45.372 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T15:43:45.373 INFO:teuthology.run_tasks:Running task install... 2024-09-13T15:43:45.381 DEBUG:teuthology.task.install:project ceph 2024-09-13T15:43:45.381 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}} 2024-09-13T15:43:45.381 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'} 2024-09-13T15:43:45.381 INFO:teuthology.task.install:Using flavor: default 2024-09-13T15:43:45.386 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T15:43:45.387 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T15:43:45.387 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'tag': None, 'wait_for_package': False} 2024-09-13T15:43:45.387 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:43:45.389 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'tag': None, 'wait_for_package': False} 2024-09-13T15:43:45.390 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:43:45.390 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'tag': None, 'wait_for_package': False} 2024-09-13T15:43:45.391 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:43:45.540 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/ 2024-09-13T15:43:45.540 INFO:teuthology.task.install.rpm:Package version is 18.2.4-850.g50bbe7f3 2024-09-13T15:43:45.556 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/ 2024-09-13T15:43:45.557 INFO:teuthology.task.install.rpm:Package version is 18.2.4-850.g50bbe7f3 2024-09-13T15:43:45.558 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/ 2024-09-13T15:43:45.558 INFO:teuthology.task.install.rpm:Package version is 18.2.4-850.g50bbe7f3 2024-09-13T15:43:45.665 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T15:43:45.667 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T15:43:45.668 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T15:43:45.677 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T15:43:45.677 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-13T15:43:45.677 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T15:43:45.687 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T15:43:45.687 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-13T15:43:45.687 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T15:43:45.703 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T15:43:45.704 DEBUG:teuthology.orchestra.run.smithi193:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/50bbe7f395997dcd871813949c49addbbf630361/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T15:43:45.713 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T15:43:45.713 DEBUG:teuthology.orchestra.run.smithi189:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/50bbe7f395997dcd871813949c49addbbf630361/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T15:43:45.724 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T15:43:45.725 DEBUG:teuthology.orchestra.run.smithi017:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/50bbe7f395997dcd871813949c49addbbf630361/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T15:43:45.770 DEBUG:teuthology.orchestra.run.smithi193:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T15:43:45.779 DEBUG:teuthology.orchestra.run.smithi189:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T15:43:45.822 DEBUG:teuthology.orchestra.run.smithi017:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T15:43:45.845 DEBUG:teuthology.orchestra.run.smithi193:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T15:43:45.853 DEBUG:teuthology.orchestra.run.smithi189:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T15:43:45.902 DEBUG:teuthology.orchestra.run.smithi017:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T15:43:45.909 INFO:teuthology.orchestra.run.smithi193.stdout:check_obsoletes = 1 2024-09-13T15:43:45.911 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum clean all 2024-09-13T15:43:45.918 INFO:teuthology.orchestra.run.smithi189.stdout:check_obsoletes = 1 2024-09-13T15:43:45.920 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum clean all 2024-09-13T15:43:45.957 INFO:teuthology.orchestra.run.smithi017.stdout:check_obsoletes = 1 2024-09-13T15:43:45.960 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum clean all 2024-09-13T15:43:46.135 INFO:teuthology.orchestra.run.smithi193.stdout:45 files removed 2024-09-13T15:43:46.146 INFO:teuthology.orchestra.run.smithi189.stdout:45 files removed 2024-09-13T15:43:46.162 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T15:43:46.174 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T15:43:46.240 INFO:teuthology.orchestra.run.smithi017.stdout:45 files removed 2024-09-13T15:43:46.274 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T15:43:46.736 INFO:teuthology.orchestra.run.smithi189.stdout:ceph packages for x86_64 272 kB/s | 77 kB 00:00 2024-09-13T15:43:46.776 INFO:teuthology.orchestra.run.smithi193.stdout:ceph packages for x86_64 229 kB/s | 77 kB 00:00 2024-09-13T15:43:46.984 INFO:teuthology.orchestra.run.smithi017.stdout:ceph packages for x86_64 256 kB/s | 77 kB 00:00 2024-09-13T15:43:47.012 INFO:teuthology.orchestra.run.smithi189.stdout:ceph noarch packages 49 kB/s | 11 kB 00:00 2024-09-13T15:43:47.060 INFO:teuthology.orchestra.run.smithi193.stdout:ceph noarch packages 48 kB/s | 11 kB 00:00 2024-09-13T15:43:47.271 INFO:teuthology.orchestra.run.smithi017.stdout:ceph noarch packages 48 kB/s | 11 kB 00:00 2024-09-13T15:43:47.279 INFO:teuthology.orchestra.run.smithi189.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-13T15:43:47.336 INFO:teuthology.orchestra.run.smithi193.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-13T15:43:47.556 INFO:teuthology.orchestra.run.smithi017.stdout:ceph source packages 7.6 kB/s | 1.9 kB 00:00 2024-09-13T15:43:47.837 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-13T15:43:48.347 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-13T15:43:49.027 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.2 MB 00:01 2024-09-13T15:43:51.387 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - AppStream 16 MB/s | 20 MB 00:01 2024-09-13T15:43:54.007 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 20 MB 00:04 2024-09-13T15:43:55.804 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-13T15:43:58.038 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-13T15:43:58.791 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-13T15:43:59.263 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - AppStream 2.0 MB/s | 20 MB 00:10 2024-09-13T15:43:59.501 INFO:teuthology.orchestra.run.smithi193.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-13T15:44:00.450 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 19 kB 00:00 2024-09-13T15:44:01.738 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-13T15:44:04.915 INFO:teuthology.orchestra.run.smithi193.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-13T15:44:05.605 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-13T15:44:07.378 INFO:teuthology.orchestra.run.smithi193.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T15:44:07.379 INFO:teuthology.orchestra.run.smithi193.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T15:44:07.391 INFO:teuthology.orchestra.run.smithi193.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T15:44:07.392 INFO:teuthology.orchestra.run.smithi193.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T15:44:07.393 INFO:teuthology.orchestra.run.smithi193.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T15:44:07.394 INFO:teuthology.orchestra.run.smithi193.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T15:44:07.396 INFO:teuthology.orchestra.run.smithi193.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T15:44:07.399 INFO:teuthology.orchestra.run.smithi193.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T15:44:07.400 INFO:teuthology.orchestra.run.smithi193.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T15:44:07.460 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-13T15:44:07.485 INFO:teuthology.orchestra.run.smithi193.stdout:====================================================================================== 2024-09-13T15:44:07.485 INFO:teuthology.orchestra.run.smithi193.stdout: Package Arch Version Repository Size 2024-09-13T15:44:07.485 INFO:teuthology.orchestra.run.smithi193.stdout:====================================================================================== 2024-09-13T15:44:07.485 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-09-13T15:44:07.485 INFO:teuthology.orchestra.run.smithi193.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T15:44:07.486 INFO:teuthology.orchestra.run.smithi193.stdout: ceph x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 6.5 k 2024-09-13T15:44:07.486 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-base x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 5.1 M 2024-09-13T15:44:07.486 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-fuse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 852 k 2024-09-13T15:44:07.486 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 143 k 2024-09-13T15:44:07.486 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 1.5 M 2024-09-13T15:44:07.486 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-cephadm noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 139 k 2024-09-13T15:44:07.486 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-dashboard noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 3.5 M 2024-09-13T15:44:07.486 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 7.4 M 2024-09-13T15:44:07.486 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-rook noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 49 k 2024-09-13T15:44:07.486 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-radosgw x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 7.8 M 2024-09-13T15:44:07.486 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-test x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 40 M 2024-09-13T15:44:07.487 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-volume noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 264 k 2024-09-13T15:44:07.487 INFO:teuthology.orchestra.run.smithi193.stdout: cephadm noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 226 k 2024-09-13T15:44:07.487 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-mirror x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 224 k 2024-09-13T15:44:07.487 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-top noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 18 k 2024-09-13T15:44:07.487 INFO:teuthology.orchestra.run.smithi193.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T15:44:07.487 INFO:teuthology.orchestra.run.smithi193.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T15:44:07.487 INFO:teuthology.orchestra.run.smithi193.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T15:44:07.487 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs-devel x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 31 k 2024-09-13T15:44:07.487 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 712 k 2024-09-13T15:44:07.488 INFO:teuthology.orchestra.run.smithi193.stdout: librados-devel x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 127 k 2024-09-13T15:44:07.488 INFO:teuthology.orchestra.run.smithi193.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T15:44:07.488 INFO:teuthology.orchestra.run.smithi193.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T15:44:07.488 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T15:44:07.488 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T15:44:07.488 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T15:44:07.488 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T15:44:07.488 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cephfs x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 162 k 2024-09-13T15:44:07.488 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rados x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 319 k 2024-09-13T15:44:07.488 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rbd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 301 k 2024-09-13T15:44:07.488 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rgw x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 99 k 2024-09-13T15:44:07.489 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-fuse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 87 k 2024-09-13T15:44:07.489 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-mirror x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.0 M 2024-09-13T15:44:07.489 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-nbd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 172 k 2024-09-13T15:44:07.489 INFO:teuthology.orchestra.run.smithi193.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T15:44:07.489 INFO:teuthology.orchestra.run.smithi193.stdout:Upgrading: 2024-09-13T15:44:07.489 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T15:44:07.489 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T15:44:07.489 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T15:44:07.489 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T15:44:07.490 INFO:teuthology.orchestra.run.smithi193.stdout: librados2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.3 M 2024-09-13T15:44:07.490 INFO:teuthology.orchestra.run.smithi193.stdout: librbd1 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.0 M 2024-09-13T15:44:07.490 INFO:teuthology.orchestra.run.smithi193.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T15:44:07.490 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T15:44:07.491 INFO:teuthology.orchestra.run.smithi193.stdout:Installing dependencies: 2024-09-13T15:44:07.491 INFO:teuthology.orchestra.run.smithi193.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T15:44:07.491 INFO:teuthology.orchestra.run.smithi193.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T15:44:07.491 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-common x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 18 M 2024-09-13T15:44:07.491 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-grafana-dashboards noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 24 k 2024-09-13T15:44:07.491 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mds x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 2.1 M 2024-09-13T15:44:07.491 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-modules-core noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 246 k 2024-09-13T15:44:07.491 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mon x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 4.7 M 2024-09-13T15:44:07.491 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-osd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 17 M 2024-09-13T15:44:07.491 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-prometheus-alerts noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 16 k 2024-09-13T15:44:07.491 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-selinux x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 25 k 2024-09-13T15:44:07.492 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T15:44:07.492 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T15:44:07.492 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T15:44:07.492 INFO:teuthology.orchestra.run.smithi193.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T15:44:07.492 INFO:teuthology.orchestra.run.smithi193.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T15:44:07.492 INFO:teuthology.orchestra.run.smithi193.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T15:44:07.492 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T15:44:07.492 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T15:44:07.492 INFO:teuthology.orchestra.run.smithi193.stdout: libcephsqlite x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 166 k 2024-09-13T15:44:07.492 INFO:teuthology.orchestra.run.smithi193.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T15:44:07.492 INFO:teuthology.orchestra.run.smithi193.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T15:44:07.492 INFO:teuthology.orchestra.run.smithi193.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T15:44:07.493 INFO:teuthology.orchestra.run.smithi193.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T15:44:07.493 INFO:teuthology.orchestra.run.smithi193.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T15:44:07.493 INFO:teuthology.orchestra.run.smithi193.stdout: libradosstriper1 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 477 k 2024-09-13T15:44:07.493 INFO:teuthology.orchestra.run.smithi193.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T15:44:07.493 INFO:teuthology.orchestra.run.smithi193.stdout: librgw2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 4.5 M 2024-09-13T15:44:07.493 INFO:teuthology.orchestra.run.smithi193.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T15:44:07.493 INFO:teuthology.orchestra.run.smithi193.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T15:44:07.493 INFO:teuthology.orchestra.run.smithi193.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T15:44:07.493 INFO:teuthology.orchestra.run.smithi193.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T15:44:07.493 INFO:teuthology.orchestra.run.smithi193.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T15:44:07.493 INFO:teuthology.orchestra.run.smithi193.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T15:44:07.493 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T15:44:07.493 INFO:teuthology.orchestra.run.smithi193.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T15:44:07.493 INFO:teuthology.orchestra.run.smithi193.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T15:44:07.494 INFO:teuthology.orchestra.run.smithi193.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T15:44:07.494 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T15:44:07.494 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-argparse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 45 k 2024-09-13T15:44:07.494 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-common x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 129 k 2024-09-13T15:44:07.494 INFO:teuthology.orchestra.run.smithi193.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T15:44:07.494 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T15:44:07.494 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T15:44:07.494 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T15:44:07.494 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T15:44:07.494 INFO:teuthology.orchestra.run.smithi193.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T15:44:07.494 INFO:teuthology.orchestra.run.smithi193.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T15:44:07.495 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T15:44:07.495 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T15:44:07.495 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T15:44:07.495 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T15:44:07.495 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T15:44:07.495 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T15:44:07.495 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T15:44:07.495 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T15:44:07.495 INFO:teuthology.orchestra.run.smithi193.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T15:44:07.495 INFO:teuthology.orchestra.run.smithi193.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T15:44:07.495 INFO:teuthology.orchestra.run.smithi193.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T15:44:07.495 INFO:teuthology.orchestra.run.smithi193.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T15:44:07.495 INFO:teuthology.orchestra.run.smithi193.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T15:44:07.496 INFO:teuthology.orchestra.run.smithi193.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T15:44:07.496 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T15:44:07.496 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T15:44:07.496 INFO:teuthology.orchestra.run.smithi193.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T15:44:07.496 INFO:teuthology.orchestra.run.smithi193.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T15:44:07.496 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T15:44:07.496 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T15:44:07.496 INFO:teuthology.orchestra.run.smithi193.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T15:44:07.496 INFO:teuthology.orchestra.run.smithi193.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T15:44:07.496 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T15:44:07.496 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T15:44:07.496 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T15:44:07.496 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T15:44:07.497 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T15:44:07.497 INFO:teuthology.orchestra.run.smithi193.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T15:44:07.497 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T15:44:07.497 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T15:44:07.497 INFO:teuthology.orchestra.run.smithi193.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T15:44:07.497 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T15:44:07.497 INFO:teuthology.orchestra.run.smithi193.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T15:44:07.497 INFO:teuthology.orchestra.run.smithi193.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T15:44:07.497 INFO:teuthology.orchestra.run.smithi193.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T15:44:07.497 INFO:teuthology.orchestra.run.smithi193.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T15:44:07.497 INFO:teuthology.orchestra.run.smithi193.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T15:44:07.497 INFO:teuthology.orchestra.run.smithi193.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T15:44:07.497 INFO:teuthology.orchestra.run.smithi193.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T15:44:07.497 INFO:teuthology.orchestra.run.smithi193.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T15:44:07.498 INFO:teuthology.orchestra.run.smithi193.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T15:44:07.498 INFO:teuthology.orchestra.run.smithi193.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T15:44:07.498 INFO:teuthology.orchestra.run.smithi193.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T15:44:07.498 INFO:teuthology.orchestra.run.smithi193.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T15:44:07.498 INFO:teuthology.orchestra.run.smithi193.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T15:44:07.498 INFO:teuthology.orchestra.run.smithi193.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T15:44:07.498 INFO:teuthology.orchestra.run.smithi193.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T15:44:07.498 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-13T15:44:07.498 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-09-13T15:44:07.498 INFO:teuthology.orchestra.run.smithi193.stdout:====================================================================================== 2024-09-13T15:44:07.498 INFO:teuthology.orchestra.run.smithi193.stdout:Install 130 Packages 2024-09-13T15:44:07.498 INFO:teuthology.orchestra.run.smithi193.stdout:Upgrade 8 Packages 2024-09-13T15:44:07.498 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-13T15:44:07.499 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 203 M 2024-09-13T15:44:07.499 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-09-13T15:44:07.547 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 19 kB 00:00 2024-09-13T15:44:07.742 INFO:teuthology.orchestra.run.smithi193.stdout:(1/138): ceph-18.2.4-850.g50bbe7f3.el9.x86_64.r 54 kB/s | 6.5 kB 00:00 2024-09-13T15:44:07.958 INFO:teuthology.orchestra.run.smithi193.stdout:(2/138): ceph-fuse-18.2.4-850.g50bbe7f3.el9.x86 3.8 MB/s | 852 kB 00:00 2024-09-13T15:44:08.034 INFO:teuthology.orchestra.run.smithi193.stdout:(3/138): ceph-immutable-object-cache-18.2.4-850 1.9 MB/s | 143 kB 00:00 2024-09-13T15:44:08.101 INFO:teuthology.orchestra.run.smithi193.stdout:(4/138): ceph-base-18.2.4-850.g50bbe7f3.el9.x86 11 MB/s | 5.1 MB 00:00 2024-09-13T15:44:08.226 INFO:teuthology.orchestra.run.smithi193.stdout:(5/138): ceph-mgr-18.2.4-850.g50bbe7f3.el9.x86_ 12 MB/s | 1.5 MB 00:00 2024-09-13T15:44:08.268 INFO:teuthology.orchestra.run.smithi193.stdout:(6/138): ceph-mds-18.2.4-850.g50bbe7f3.el9.x86_ 9.0 MB/s | 2.1 MB 00:00 2024-09-13T15:44:08.360 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-13T15:44:08.502 INFO:teuthology.orchestra.run.smithi193.stdout:(7/138): ceph-mon-18.2.4-850.g50bbe7f3.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-13T15:44:08.684 INFO:teuthology.orchestra.run.smithi189.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-13T15:44:08.685 INFO:teuthology.orchestra.run.smithi193.stdout:(8/138): ceph-common-18.2.4-850.g50bbe7f3.el9.x 17 MB/s | 18 MB 00:01 2024-09-13T15:44:08.744 INFO:teuthology.orchestra.run.smithi193.stdout:(9/138): ceph-selinux-18.2.4-850.g50bbe7f3.el9. 433 kB/s | 25 kB 00:00 2024-09-13T15:44:08.936 INFO:teuthology.orchestra.run.smithi193.stdout:(10/138): ceph-radosgw-18.2.4-850.g50bbe7f3.el9 18 MB/s | 7.8 MB 00:00 2024-09-13T15:44:08.986 INFO:teuthology.orchestra.run.smithi193.stdout:(11/138): cephfs-mirror-18.2.4-850.g50bbe7f3.el 4.4 MB/s | 224 kB 00:00 2024-09-13T15:44:09.062 INFO:teuthology.orchestra.run.smithi193.stdout:(12/138): libcephfs-devel-18.2.4-850.g50bbe7f3. 413 kB/s | 31 kB 00:00 2024-09-13T15:44:09.165 INFO:teuthology.orchestra.run.smithi193.stdout:(13/138): libcephfs2-18.2.4-850.g50bbe7f3.el9.x 7.0 MB/s | 712 kB 00:00 2024-09-13T15:44:09.254 INFO:teuthology.orchestra.run.smithi193.stdout:(14/138): libcephsqlite-18.2.4-850.g50bbe7f3.el 1.8 MB/s | 166 kB 00:00 2024-09-13T15:44:09.429 INFO:teuthology.orchestra.run.smithi193.stdout:(15/138): ceph-osd-18.2.4-850.g50bbe7f3.el9.x86 14 MB/s | 17 MB 00:01 2024-09-13T15:44:09.455 INFO:teuthology.orchestra.run.smithi193.stdout:(16/138): librados-devel-18.2.4-850.g50bbe7f3.e 632 kB/s | 127 kB 00:00 2024-09-13T15:44:09.480 INFO:teuthology.orchestra.run.smithi193.stdout:(17/138): libradosstriper1-18.2.4-850.g50bbe7f3 9.4 MB/s | 477 kB 00:00 2024-09-13T15:44:09.538 INFO:teuthology.orchestra.run.smithi193.stdout:(18/138): python3-ceph-argparse-18.2.4-850.g50b 770 kB/s | 45 kB 00:00 2024-09-13T15:44:09.672 INFO:teuthology.orchestra.run.smithi193.stdout:(19/138): librgw2-18.2.4-850.g50bbe7f3.el9.x86_ 21 MB/s | 4.5 MB 00:00 2024-09-13T15:44:09.697 INFO:teuthology.orchestra.run.smithi193.stdout:(20/138): python3-ceph-common-18.2.4-850.g50bbe 815 kB/s | 129 kB 00:00 2024-09-13T15:44:09.723 INFO:teuthology.orchestra.run.smithi193.stdout:(21/138): python3-cephfs-18.2.4-850.g50bbe7f3.e 3.2 MB/s | 162 kB 00:00 2024-09-13T15:44:09.748 INFO:teuthology.orchestra.run.smithi193.stdout:(22/138): python3-rados-18.2.4-850.g50bbe7f3.el 6.2 MB/s | 319 kB 00:00 2024-09-13T15:44:09.782 INFO:teuthology.orchestra.run.smithi193.stdout:(23/138): python3-rbd-18.2.4-850.g50bbe7f3.el9. 5.0 MB/s | 301 kB 00:00 2024-09-13T15:44:09.807 INFO:teuthology.orchestra.run.smithi193.stdout:(24/138): python3-rgw-18.2.4-850.g50bbe7f3.el9. 1.7 MB/s | 99 kB 00:00 2024-09-13T15:44:09.832 INFO:teuthology.orchestra.run.smithi193.stdout:(25/138): rbd-fuse-18.2.4-850.g50bbe7f3.el9.x86 1.7 MB/s | 87 kB 00:00 2024-09-13T15:44:09.907 INFO:teuthology.orchestra.run.smithi193.stdout:(26/138): rbd-nbd-18.2.4-850.g50bbe7f3.el9.x86_ 2.2 MB/s | 172 kB 00:00 2024-09-13T15:44:09.970 INFO:teuthology.orchestra.run.smithi193.stdout:(27/138): rbd-mirror-18.2.4-850.g50bbe7f3.el9.x 18 MB/s | 3.0 MB 00:00 2024-09-13T15:44:09.995 INFO:teuthology.orchestra.run.smithi193.stdout:(28/138): ceph-grafana-dashboards-18.2.4-850.g5 278 kB/s | 24 kB 00:00 2024-09-13T15:44:10.021 INFO:teuthology.orchestra.run.smithi193.stdout:(29/138): ceph-mgr-cephadm-18.2.4-850.g50bbe7f3 2.7 MB/s | 139 kB 00:00 2024-09-13T15:44:10.605 INFO:teuthology.orchestra.run.smithi193.stdout:(30/138): ceph-test-18.2.4-850.g50bbe7f3.el9.x8 21 MB/s | 40 MB 00:01 2024-09-13T15:44:10.663 INFO:teuthology.orchestra.run.smithi193.stdout:(31/138): ceph-mgr-dashboard-18.2.4-850.g50bbe7 5.3 MB/s | 3.5 MB 00:00 2024-09-13T15:44:10.689 INFO:teuthology.orchestra.run.smithi193.stdout:(32/138): ceph-mgr-modules-core-18.2.4-850.g50b 2.9 MB/s | 246 kB 00:00 2024-09-13T15:44:10.714 INFO:teuthology.orchestra.run.smithi193.stdout:(33/138): ceph-mgr-rook-18.2.4-850.g50bbe7f3.el 984 kB/s | 49 kB 00:00 2024-09-13T15:44:10.740 INFO:teuthology.orchestra.run.smithi193.stdout:(34/138): ceph-prometheus-alerts-18.2.4-850.g50 329 kB/s | 16 kB 00:00 2024-09-13T15:44:10.823 INFO:teuthology.orchestra.run.smithi193.stdout:(35/138): ceph-mgr-diskprediction-local-18.2.4- 9.2 MB/s | 7.4 MB 00:00 2024-09-13T15:44:10.848 INFO:teuthology.orchestra.run.smithi193.stdout:(36/138): ceph-volume-18.2.4-850.g50bbe7f3.el9. 1.9 MB/s | 264 kB 00:00 2024-09-13T15:44:10.890 INFO:teuthology.orchestra.run.smithi193.stdout:(37/138): cephfs-top-18.2.4-850.g50bbe7f3.el9.n 273 kB/s | 18 kB 00:00 2024-09-13T15:44:10.915 INFO:teuthology.orchestra.run.smithi193.stdout:(38/138): cephadm-18.2.4-850.g50bbe7f3.el9.noar 1.3 MB/s | 226 kB 00:00 2024-09-13T15:44:11.009 INFO:teuthology.orchestra.run.smithi017.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T15:44:11.010 INFO:teuthology.orchestra.run.smithi017.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T15:44:11.023 INFO:teuthology.orchestra.run.smithi017.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T15:44:11.024 INFO:teuthology.orchestra.run.smithi017.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T15:44:11.025 INFO:teuthology.orchestra.run.smithi017.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T15:44:11.027 INFO:teuthology.orchestra.run.smithi017.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T15:44:11.029 INFO:teuthology.orchestra.run.smithi017.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T15:44:11.032 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T15:44:11.032 INFO:teuthology.orchestra.run.smithi193.stdout:(39/138): fuse-2.9.9-16.el9.x86_64.rpm 434 kB/s | 80 kB 00:00 2024-09-13T15:44:11.033 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T15:44:11.082 INFO:teuthology.orchestra.run.smithi193.stdout:(40/138): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-13T15:44:11.101 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T15:44:11.116 INFO:teuthology.orchestra.run.smithi193.stdout:(41/138): libgfortran-11.5.0-2.el9.x86_64.rpm 3.5 MB/s | 801 kB 00:00 2024-09-13T15:44:11.121 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================== 2024-09-13T15:44:11.121 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-13T15:44:11.122 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================== 2024-09-13T15:44:11.122 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-13T15:44:11.122 INFO:teuthology.orchestra.run.smithi017.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T15:44:11.122 INFO:teuthology.orchestra.run.smithi017.stdout: ceph x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 6.5 k 2024-09-13T15:44:11.122 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 5.1 M 2024-09-13T15:44:11.122 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 852 k 2024-09-13T15:44:11.122 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 143 k 2024-09-13T15:44:11.122 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 1.5 M 2024-09-13T15:44:11.122 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 139 k 2024-09-13T15:44:11.122 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 3.5 M 2024-09-13T15:44:11.122 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 7.4 M 2024-09-13T15:44:11.122 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 49 k 2024-09-13T15:44:11.123 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 7.8 M 2024-09-13T15:44:11.123 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 40 M 2024-09-13T15:44:11.123 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 264 k 2024-09-13T15:44:11.123 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 226 k 2024-09-13T15:44:11.123 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 224 k 2024-09-13T15:44:11.123 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 18 k 2024-09-13T15:44:11.123 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T15:44:11.123 INFO:teuthology.orchestra.run.smithi017.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T15:44:11.123 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T15:44:11.123 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 31 k 2024-09-13T15:44:11.123 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 712 k 2024-09-13T15:44:11.123 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 127 k 2024-09-13T15:44:11.123 INFO:teuthology.orchestra.run.smithi017.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T15:44:11.124 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T15:44:11.124 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T15:44:11.124 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T15:44:11.124 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T15:44:11.124 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T15:44:11.124 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 162 k 2024-09-13T15:44:11.124 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 319 k 2024-09-13T15:44:11.124 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 301 k 2024-09-13T15:44:11.124 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 99 k 2024-09-13T15:44:11.124 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 87 k 2024-09-13T15:44:11.124 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.0 M 2024-09-13T15:44:11.124 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 172 k 2024-09-13T15:44:11.125 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T15:44:11.125 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrading: 2024-09-13T15:44:11.125 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T15:44:11.125 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T15:44:11.125 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T15:44:11.125 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T15:44:11.125 INFO:teuthology.orchestra.run.smithi017.stdout: librados2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.3 M 2024-09-13T15:44:11.125 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.0 M 2024-09-13T15:44:11.125 INFO:teuthology.orchestra.run.smithi017.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T15:44:11.125 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T15:44:11.125 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-13T15:44:11.125 INFO:teuthology.orchestra.run.smithi017.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T15:44:11.125 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T15:44:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 18 M 2024-09-13T15:44:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 24 k 2024-09-13T15:44:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 2.1 M 2024-09-13T15:44:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 246 k 2024-09-13T15:44:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 4.7 M 2024-09-13T15:44:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 17 M 2024-09-13T15:44:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 16 k 2024-09-13T15:44:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 25 k 2024-09-13T15:44:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T15:44:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T15:44:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T15:44:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T15:44:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T15:44:11.127 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T15:44:11.127 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T15:44:11.127 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T15:44:11.127 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 166 k 2024-09-13T15:44:11.127 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T15:44:11.127 INFO:teuthology.orchestra.run.smithi017.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T15:44:11.128 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T15:44:11.128 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T15:44:11.128 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T15:44:11.128 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 477 k 2024-09-13T15:44:11.128 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T15:44:11.128 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 4.5 M 2024-09-13T15:44:11.128 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T15:44:11.128 INFO:teuthology.orchestra.run.smithi017.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T15:44:11.128 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T15:44:11.128 INFO:teuthology.orchestra.run.smithi017.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T15:44:11.128 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T15:44:11.128 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T15:44:11.129 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T15:44:11.129 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T15:44:11.129 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T15:44:11.129 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T15:44:11.129 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T15:44:11.129 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 45 k 2024-09-13T15:44:11.129 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 129 k 2024-09-13T15:44:11.129 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T15:44:11.129 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T15:44:11.129 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T15:44:11.129 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T15:44:11.129 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T15:44:11.129 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T15:44:11.130 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T15:44:11.130 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T15:44:11.130 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T15:44:11.130 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T15:44:11.130 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T15:44:11.130 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T15:44:11.130 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T15:44:11.130 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T15:44:11.130 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T15:44:11.130 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T15:44:11.130 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T15:44:11.130 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T15:44:11.130 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T15:44:11.130 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T15:44:11.131 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T15:44:11.131 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T15:44:11.131 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T15:44:11.131 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T15:44:11.131 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T15:44:11.131 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T15:44:11.131 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T15:44:11.131 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T15:44:11.131 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T15:44:11.131 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T15:44:11.131 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T15:44:11.131 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T15:44:11.131 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T15:44:11.131 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T15:44:11.132 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T15:44:11.132 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T15:44:11.132 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T15:44:11.132 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T15:44:11.132 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T15:44:11.132 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T15:44:11.132 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T15:44:11.132 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T15:44:11.132 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T15:44:11.132 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T15:44:11.132 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T15:44:11.132 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T15:44:11.132 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T15:44:11.133 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T15:44:11.133 INFO:teuthology.orchestra.run.smithi017.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T15:44:11.133 INFO:teuthology.orchestra.run.smithi017.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T15:44:11.133 INFO:teuthology.orchestra.run.smithi017.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T15:44:11.133 INFO:teuthology.orchestra.run.smithi017.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T15:44:11.133 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T15:44:11.133 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T15:44:11.133 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:44:11.133 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-13T15:44:11.133 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================== 2024-09-13T15:44:11.133 INFO:teuthology.orchestra.run.smithi017.stdout:Install 130 Packages 2024-09-13T15:44:11.133 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrade 8 Packages 2024-09-13T15:44:11.133 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:44:11.134 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 203 M 2024-09-13T15:44:11.134 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-13T15:44:11.142 INFO:teuthology.orchestra.run.smithi193.stdout:(42/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-13T15:44:11.158 INFO:teuthology.orchestra.run.smithi193.stdout:(43/138): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-13T15:44:11.200 INFO:teuthology.orchestra.run.smithi193.stdout:(44/138): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-13T15:44:11.217 INFO:teuthology.orchestra.run.smithi193.stdout:(45/138): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-13T15:44:11.243 INFO:teuthology.orchestra.run.smithi193.stdout:(46/138): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-09-13T15:44:11.268 INFO:teuthology.orchestra.run.smithi193.stdout:(47/138): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-13T15:44:11.460 INFO:teuthology.orchestra.run.smithi193.stdout:(48/138): boost-program-options-1.75.0-8.el9.x8 557 kB/s | 107 kB 00:00 2024-09-13T15:44:11.511 INFO:teuthology.orchestra.run.smithi193.stdout:(49/138): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-09-13T15:44:11.536 INFO:teuthology.orchestra.run.smithi193.stdout:(50/138): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-09-13T15:44:11.586 INFO:teuthology.orchestra.run.smithi193.stdout:(51/138): flexiblas-3.0.4-8.el9.x86_64.rpm 657 kB/s | 33 kB 00:00 2024-09-13T15:44:11.619 INFO:teuthology.orchestra.run.smithi193.stdout:(52/138): bison-3.7.4-5.el9.x86_64.rpm 2.4 MB/s | 943 kB 00:00 2024-09-13T15:44:11.645 INFO:teuthology.orchestra.run.smithi193.stdout:(53/138): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-09-13T15:44:11.678 INFO:teuthology.orchestra.run.smithi193.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-13T15:44:11.704 INFO:teuthology.orchestra.run.smithi193.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-09-13T15:44:11.737 INFO:teuthology.orchestra.run.smithi193.stdout:(56/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-13T15:44:11.762 INFO:teuthology.orchestra.run.smithi193.stdout:(57/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-09-13T15:44:11.854 INFO:teuthology.orchestra.run.smithi193.stdout:(58/138): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-13T15:44:11.888 INFO:teuthology.orchestra.run.smithi193.stdout:(59/138): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-13T15:44:11.905 INFO:teuthology.orchestra.run.smithi193.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 485 kB/s | 24 kB 00:00 2024-09-13T15:44:11.930 INFO:teuthology.orchestra.run.smithi193.stdout:(61/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-13T15:44:11.964 INFO:teuthology.orchestra.run.smithi193.stdout:(62/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-13T15:44:11.981 INFO:teuthology.orchestra.run.smithi193.stdout:(63/138): openblas-0.3.26-2.el9.x86_64.rpm 765 kB/s | 38 kB 00:00 2024-09-13T15:44:12.012 INFO:teuthology.orchestra.run.smithi017.stdout:(1/138): ceph-18.2.4-850.g50bbe7f3.el9.x86_64.r 43 kB/s | 6.5 kB 00:00 2024-09-13T15:44:12.196 INFO:teuthology.orchestra.run.smithi017.stdout:(2/138): ceph-fuse-18.2.4-850.g50bbe7f3.el9.x86 4.5 MB/s | 852 kB 00:00 2024-09-13T15:44:12.354 INFO:teuthology.orchestra.run.smithi017.stdout:(3/138): ceph-immutable-object-cache-18.2.4-850 903 kB/s | 143 kB 00:00 2024-09-13T15:44:12.438 INFO:teuthology.orchestra.run.smithi017.stdout:(4/138): ceph-base-18.2.4-850.g50bbe7f3.el9.x86 8.8 MB/s | 5.1 MB 00:00 2024-09-13T15:44:12.530 INFO:teuthology.orchestra.run.smithi017.stdout:(5/138): ceph-mds-18.2.4-850.g50bbe7f3.el9.x86_ 12 MB/s | 2.1 MB 00:00 2024-09-13T15:44:12.588 INFO:teuthology.orchestra.run.smithi017.stdout:(6/138): ceph-mgr-18.2.4-850.g50bbe7f3.el9.x86_ 9.7 MB/s | 1.5 MB 00:00 2024-09-13T15:44:12.673 INFO:teuthology.orchestra.run.smithi193.stdout:(64/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-09-13T15:44:12.930 INFO:teuthology.orchestra.run.smithi017.stdout:(7/138): ceph-mon-18.2.4-850.g50bbe7f3.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-13T15:44:13.122 INFO:teuthology.orchestra.run.smithi017.stdout:(8/138): ceph-common-18.2.4-850.g50bbe7f3.el9.x 15 MB/s | 18 MB 00:01 2024-09-13T15:44:13.164 INFO:teuthology.orchestra.run.smithi017.stdout:(9/138): ceph-selinux-18.2.4-850.g50bbe7f3.el9. 611 kB/s | 25 kB 00:00 2024-09-13T15:44:13.423 INFO:teuthology.orchestra.run.smithi017.stdout:(10/138): ceph-radosgw-18.2.4-850.g50bbe7f3.el9 16 MB/s | 7.8 MB 00:00 2024-09-13T15:44:13.450 INFO:teuthology.orchestra.run.smithi193.stdout:(65/138): postgresql-13.16-1.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-09-13T15:44:13.482 INFO:teuthology.orchestra.run.smithi017.stdout:(11/138): cephfs-mirror-18.2.4-850.g50bbe7f3.el 3.8 MB/s | 224 kB 00:00 2024-09-13T15:44:13.673 INFO:teuthology.orchestra.run.smithi017.stdout:(12/138): ceph-osd-18.2.4-850.g50bbe7f3.el9.x86 15 MB/s | 17 MB 00:01 2024-09-13T15:44:13.682 INFO:teuthology.orchestra.run.smithi193.stdout:(66/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.6 MB/s | 4.4 MB 00:01 2024-09-13T15:44:13.690 INFO:teuthology.orchestra.run.smithi017.stdout:(13/138): libcephfs-devel-18.2.4-850.g50bbe7f3. 149 kB/s | 31 kB 00:00 2024-09-13T15:44:13.732 INFO:teuthology.orchestra.run.smithi017.stdout:(14/138): libcephfs2-18.2.4-850.g50bbe7f3.el9.x 12 MB/s | 712 kB 00:00 2024-09-13T15:44:13.757 INFO:teuthology.orchestra.run.smithi017.stdout:(15/138): libcephsqlite-18.2.4-850.g50bbe7f3.el 2.4 MB/s | 166 kB 00:00 2024-09-13T15:44:13.799 INFO:teuthology.orchestra.run.smithi193.stdout:(67/138): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-13T15:44:13.800 INFO:teuthology.orchestra.run.smithi017.stdout:(16/138): librados-devel-18.2.4-850.g50bbe7f3.e 1.8 MB/s | 127 kB 00:00 2024-09-13T15:44:13.859 INFO:teuthology.orchestra.run.smithi017.stdout:(17/138): libradosstriper1-18.2.4-850.g50bbe7f3 4.6 MB/s | 477 kB 00:00 2024-09-13T15:44:13.917 INFO:teuthology.orchestra.run.smithi017.stdout:(18/138): python3-ceph-argparse-18.2.4-850.g50b 777 kB/s | 45 kB 00:00 2024-09-13T15:44:13.974 INFO:teuthology.orchestra.run.smithi193.stdout:(68/138): postgresql-contrib-13.16-1.el9.x86_64 1.7 MB/s | 910 kB 00:00 2024-09-13T15:44:14.001 INFO:teuthology.orchestra.run.smithi017.stdout:(19/138): python3-ceph-common-18.2.4-850.g50bbe 1.5 MB/s | 129 kB 00:00 2024-09-13T15:44:14.084 INFO:teuthology.orchestra.run.smithi017.stdout:(20/138): librgw2-18.2.4-850.g50bbe7f3.el9.x86_ 16 MB/s | 4.5 MB 00:00 2024-09-13T15:44:14.109 INFO:teuthology.orchestra.run.smithi017.stdout:(21/138): python3-cephfs-18.2.4-850.g50bbe7f3.e 1.5 MB/s | 162 kB 00:00 2024-09-13T15:44:14.124 INFO:teuthology.orchestra.run.smithi193.stdout:(69/138): openblas-openmp-0.3.26-2.el9.x86_64.r 2.3 MB/s | 4.9 MB 00:02 2024-09-13T15:44:14.134 INFO:teuthology.orchestra.run.smithi017.stdout:(22/138): python3-rados-18.2.4-850.g50bbe7f3.el 6.2 MB/s | 319 kB 00:00 2024-09-13T15:44:14.157 INFO:teuthology.orchestra.run.smithi189.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-13T15:44:14.160 INFO:teuthology.orchestra.run.smithi017.stdout:(23/138): python3-rbd-18.2.4-850.g50bbe7f3.el9. 5.9 MB/s | 301 kB 00:00 2024-09-13T15:44:14.185 INFO:teuthology.orchestra.run.smithi017.stdout:(24/138): python3-rgw-18.2.4-850.g50bbe7f3.el9. 1.9 MB/s | 99 kB 00:00 2024-09-13T15:44:14.210 INFO:teuthology.orchestra.run.smithi017.stdout:(25/138): rbd-fuse-18.2.4-850.g50bbe7f3.el9.x86 1.7 MB/s | 87 kB 00:00 2024-09-13T15:44:14.269 INFO:teuthology.orchestra.run.smithi017.stdout:(26/138): rbd-nbd-18.2.4-850.g50bbe7f3.el9.x86_ 2.9 MB/s | 172 kB 00:00 2024-09-13T15:44:14.274 INFO:teuthology.orchestra.run.smithi193.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-13T15:44:14.353 INFO:teuthology.orchestra.run.smithi017.stdout:(27/138): rbd-mirror-18.2.4-850.g50bbe7f3.el9.x 18 MB/s | 3.0 MB 00:00 2024-09-13T15:44:14.378 INFO:teuthology.orchestra.run.smithi017.stdout:(28/138): ceph-grafana-dashboards-18.2.4-850.g5 225 kB/s | 24 kB 00:00 2024-09-13T15:44:14.403 INFO:teuthology.orchestra.run.smithi017.stdout:(29/138): ceph-mgr-cephadm-18.2.4-850.g50bbe7f3 2.7 MB/s | 139 kB 00:00 2024-09-13T15:44:14.425 INFO:teuthology.orchestra.run.smithi193.stdout:(71/138): python3-jinja2-2.11.3-6.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-09-13T15:44:14.475 INFO:teuthology.orchestra.run.smithi193.stdout:(72/138): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-09-13T15:44:14.525 INFO:teuthology.orchestra.run.smithi193.stdout:(73/138): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-13T15:44:14.562 INFO:teuthology.orchestra.run.smithi017.stdout:(30/138): ceph-mgr-dashboard-18.2.4-850.g50bbe7 19 MB/s | 3.5 MB 00:00 2024-09-13T15:44:14.629 INFO:teuthology.orchestra.run.smithi017.stdout:(31/138): ceph-mgr-modules-core-18.2.4-850.g50b 3.6 MB/s | 246 kB 00:00 2024-09-13T15:44:14.642 INFO:teuthology.orchestra.run.smithi193.stdout:(74/138): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-13T15:44:14.688 INFO:teuthology.orchestra.run.smithi017.stdout:(32/138): ceph-mgr-rook-18.2.4-850.g50bbe7f3.el 849 kB/s | 49 kB 00:00 2024-09-13T15:44:14.692 INFO:teuthology.orchestra.run.smithi193.stdout:(75/138): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-09-13T15:44:14.827 INFO:teuthology.orchestra.run.smithi017.stdout:(33/138): ceph-mgr-diskprediction-local-18.2.4- 17 MB/s | 7.4 MB 00:00 2024-09-13T15:44:14.855 INFO:teuthology.orchestra.run.smithi017.stdout:(34/138): ceph-prometheus-alerts-18.2.4-850.g50 98 kB/s | 16 kB 00:00 2024-09-13T15:44:14.881 INFO:teuthology.orchestra.run.smithi017.stdout:(35/138): ceph-volume-18.2.4-850.g50bbe7f3.el9. 4.8 MB/s | 264 kB 00:00 2024-09-13T15:44:14.906 INFO:teuthology.orchestra.run.smithi017.stdout:(36/138): cephadm-18.2.4-850.g50bbe7f3.el9.noar 4.4 MB/s | 226 kB 00:00 2024-09-13T15:44:14.931 INFO:teuthology.orchestra.run.smithi017.stdout:(37/138): cephfs-top-18.2.4-850.g50bbe7f3.el9.n 363 kB/s | 18 kB 00:00 2024-09-13T15:44:15.365 INFO:teuthology.orchestra.run.smithi017.stdout:(38/138): ceph-test-18.2.4-850.g50bbe7f3.el9.x8 18 MB/s | 40 MB 00:02 2024-09-13T15:44:15.390 INFO:teuthology.orchestra.run.smithi017.stdout:(39/138): fuse-2.9.9-16.el9.x86_64.rpm 165 kB/s | 80 kB 00:00 2024-09-13T15:44:15.515 INFO:teuthology.orchestra.run.smithi017.stdout:(40/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-13T15:44:15.549 INFO:teuthology.orchestra.run.smithi017.stdout:(41/138): libgfortran-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 801 kB 00:00 2024-09-13T15:44:15.574 INFO:teuthology.orchestra.run.smithi017.stdout:(42/138): libquadmath-11.5.0-2.el9.x86_64.rpm 915 kB/s | 191 kB 00:00 2024-09-13T15:44:15.599 INFO:teuthology.orchestra.run.smithi017.stdout:(43/138): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-13T15:44:15.641 INFO:teuthology.orchestra.run.smithi017.stdout:(44/138): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-13T15:44:15.667 INFO:teuthology.orchestra.run.smithi017.stdout:(45/138): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-13T15:44:15.692 INFO:teuthology.orchestra.run.smithi017.stdout:(46/138): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-13T15:44:15.717 INFO:teuthology.orchestra.run.smithi017.stdout:(47/138): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-13T15:44:15.885 INFO:teuthology.orchestra.run.smithi017.stdout:(48/138): boost-program-options-1.75.0-8.el9.x8 641 kB/s | 107 kB 00:00 2024-09-13T15:44:16.026 INFO:teuthology.orchestra.run.smithi017.stdout:(49/138): elfutils-libelf-devel-0.191-4.el9.x86 153 kB/s | 22 kB 00:00 2024-09-13T15:44:16.068 INFO:teuthology.orchestra.run.smithi017.stdout:(50/138): automake-1.16.2-8.el9.noarch.rpm 1.7 MB/s | 689 kB 00:00 2024-09-13T15:44:16.105 INFO:teuthology.orchestra.run.smithi017.stdout:(51/138): bison-3.7.4-5.el9.x86_64.rpm 2.3 MB/s | 943 kB 00:00 2024-09-13T15:44:16.127 INFO:teuthology.orchestra.run.smithi017.stdout:(52/138): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-09-13T15:44:16.152 INFO:teuthology.orchestra.run.smithi017.stdout:(53/138): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-13T15:44:16.178 INFO:teuthology.orchestra.run.smithi017.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-09-13T15:44:16.195 INFO:teuthology.orchestra.run.smithi017.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 266 kB/s | 11 kB 00:00 2024-09-13T15:44:16.237 INFO:teuthology.orchestra.run.smithi017.stdout:(56/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-13T15:44:16.254 INFO:teuthology.orchestra.run.smithi017.stdout:(57/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-09-13T15:44:16.312 INFO:teuthology.orchestra.run.smithi017.stdout:(58/138): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-09-13T15:44:16.371 INFO:teuthology.orchestra.run.smithi017.stdout:(59/138): libtool-2.4.6-46.el9.x86_64.rpm 4.8 MB/s | 581 kB 00:00 2024-09-13T15:44:16.396 INFO:teuthology.orchestra.run.smithi017.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 293 kB/s | 24 kB 00:00 2024-09-13T15:44:16.446 INFO:teuthology.orchestra.run.smithi017.stdout:(61/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 957 kB/s | 47 kB 00:00 2024-09-13T15:44:16.467 INFO:teuthology.orchestra.run.smithi189.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T15:44:16.468 INFO:teuthology.orchestra.run.smithi189.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T15:44:16.478 INFO:teuthology.orchestra.run.smithi189.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T15:44:16.479 INFO:teuthology.orchestra.run.smithi189.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T15:44:16.480 INFO:teuthology.orchestra.run.smithi189.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T15:44:16.481 INFO:teuthology.orchestra.run.smithi189.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T15:44:16.483 INFO:teuthology.orchestra.run.smithi189.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T15:44:16.485 INFO:teuthology.orchestra.run.smithi189.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T15:44:16.486 INFO:teuthology.orchestra.run.smithi189.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T15:44:16.488 INFO:teuthology.orchestra.run.smithi017.stdout:(62/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-13T15:44:16.514 INFO:teuthology.orchestra.run.smithi017.stdout:(63/138): openblas-0.3.26-2.el9.x86_64.rpm 576 kB/s | 38 kB 00:00 2024-09-13T15:44:16.546 INFO:teuthology.orchestra.run.smithi189.stdout:Dependencies resolved. 2024-09-13T15:44:16.564 INFO:teuthology.orchestra.run.smithi189.stdout:====================================================================================== 2024-09-13T15:44:16.565 INFO:teuthology.orchestra.run.smithi189.stdout: Package Arch Version Repository Size 2024-09-13T15:44:16.565 INFO:teuthology.orchestra.run.smithi189.stdout:====================================================================================== 2024-09-13T15:44:16.565 INFO:teuthology.orchestra.run.smithi189.stdout:Installing: 2024-09-13T15:44:16.565 INFO:teuthology.orchestra.run.smithi189.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T15:44:16.565 INFO:teuthology.orchestra.run.smithi189.stdout: ceph x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 6.5 k 2024-09-13T15:44:16.565 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 5.1 M 2024-09-13T15:44:16.565 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 852 k 2024-09-13T15:44:16.565 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 143 k 2024-09-13T15:44:16.565 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 1.5 M 2024-09-13T15:44:16.565 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 139 k 2024-09-13T15:44:16.565 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 3.5 M 2024-09-13T15:44:16.565 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 7.4 M 2024-09-13T15:44:16.566 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 49 k 2024-09-13T15:44:16.566 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 7.8 M 2024-09-13T15:44:16.566 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 40 M 2024-09-13T15:44:16.566 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 264 k 2024-09-13T15:44:16.566 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 226 k 2024-09-13T15:44:16.566 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 224 k 2024-09-13T15:44:16.566 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-top noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 18 k 2024-09-13T15:44:16.566 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T15:44:16.566 INFO:teuthology.orchestra.run.smithi189.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T15:44:16.566 INFO:teuthology.orchestra.run.smithi189.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T15:44:16.566 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 31 k 2024-09-13T15:44:16.566 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 712 k 2024-09-13T15:44:16.567 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 127 k 2024-09-13T15:44:16.567 INFO:teuthology.orchestra.run.smithi189.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T15:44:16.567 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T15:44:16.567 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T15:44:16.567 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T15:44:16.567 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T15:44:16.567 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T15:44:16.567 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 162 k 2024-09-13T15:44:16.567 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 319 k 2024-09-13T15:44:16.567 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 301 k 2024-09-13T15:44:16.567 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 99 k 2024-09-13T15:44:16.567 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 87 k 2024-09-13T15:44:16.567 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.0 M 2024-09-13T15:44:16.567 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 172 k 2024-09-13T15:44:16.568 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T15:44:16.568 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrading: 2024-09-13T15:44:16.568 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T15:44:16.568 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T15:44:16.568 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T15:44:16.568 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T15:44:16.568 INFO:teuthology.orchestra.run.smithi189.stdout: librados2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.3 M 2024-09-13T15:44:16.568 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 3.0 M 2024-09-13T15:44:16.568 INFO:teuthology.orchestra.run.smithi189.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T15:44:16.568 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T15:44:16.568 INFO:teuthology.orchestra.run.smithi189.stdout:Installing dependencies: 2024-09-13T15:44:16.568 INFO:teuthology.orchestra.run.smithi189.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T15:44:16.569 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T15:44:16.569 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 18 M 2024-09-13T15:44:16.569 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 24 k 2024-09-13T15:44:16.569 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 2.1 M 2024-09-13T15:44:16.569 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 246 k 2024-09-13T15:44:16.569 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 4.7 M 2024-09-13T15:44:16.569 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 17 M 2024-09-13T15:44:16.569 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts noarch 2:18.2.4-850.g50bbe7f3.el9 ceph-noarch 16 k 2024-09-13T15:44:16.569 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 25 k 2024-09-13T15:44:16.569 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T15:44:16.569 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T15:44:16.569 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T15:44:16.570 INFO:teuthology.orchestra.run.smithi189.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T15:44:16.570 INFO:teuthology.orchestra.run.smithi189.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T15:44:16.570 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T15:44:16.570 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T15:44:16.570 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T15:44:16.570 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 166 k 2024-09-13T15:44:16.570 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T15:44:16.570 INFO:teuthology.orchestra.run.smithi189.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T15:44:16.570 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T15:44:16.570 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T15:44:16.570 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T15:44:16.570 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 477 k 2024-09-13T15:44:16.570 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T15:44:16.571 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2 x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 4.5 M 2024-09-13T15:44:16.571 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T15:44:16.571 INFO:teuthology.orchestra.run.smithi189.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T15:44:16.571 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T15:44:16.571 INFO:teuthology.orchestra.run.smithi189.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T15:44:16.571 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T15:44:16.571 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T15:44:16.571 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T15:44:16.571 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T15:44:16.571 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T15:44:16.571 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T15:44:16.571 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T15:44:16.571 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 45 k 2024-09-13T15:44:16.571 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common x86_64 2:18.2.4-850.g50bbe7f3.el9 ceph 129 k 2024-09-13T15:44:16.572 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T15:44:16.572 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T15:44:16.572 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T15:44:16.572 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T15:44:16.572 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T15:44:16.572 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T15:44:16.572 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T15:44:16.572 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T15:44:16.572 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T15:44:16.572 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T15:44:16.572 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T15:44:16.572 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T15:44:16.572 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T15:44:16.573 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T15:44:16.573 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T15:44:16.573 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T15:44:16.573 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T15:44:16.573 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T15:44:16.573 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T15:44:16.573 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T15:44:16.573 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T15:44:16.573 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T15:44:16.573 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T15:44:16.573 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T15:44:16.573 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T15:44:16.573 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T15:44:16.573 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T15:44:16.574 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T15:44:16.574 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T15:44:16.574 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T15:44:16.574 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T15:44:16.574 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T15:44:16.574 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T15:44:16.574 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T15:44:16.574 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T15:44:16.574 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T15:44:16.574 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T15:44:16.574 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T15:44:16.574 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T15:44:16.574 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T15:44:16.574 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T15:44:16.575 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T15:44:16.575 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T15:44:16.575 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T15:44:16.575 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T15:44:16.575 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T15:44:16.575 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T15:44:16.575 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T15:44:16.575 INFO:teuthology.orchestra.run.smithi189.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T15:44:16.575 INFO:teuthology.orchestra.run.smithi189.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T15:44:16.575 INFO:teuthology.orchestra.run.smithi189.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T15:44:16.575 INFO:teuthology.orchestra.run.smithi189.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T15:44:16.575 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T15:44:16.576 INFO:teuthology.orchestra.run.smithi189.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T15:44:16.576 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-13T15:44:16.576 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction Summary 2024-09-13T15:44:16.576 INFO:teuthology.orchestra.run.smithi189.stdout:====================================================================================== 2024-09-13T15:44:16.576 INFO:teuthology.orchestra.run.smithi189.stdout:Install 130 Packages 2024-09-13T15:44:16.576 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrade 8 Packages 2024-09-13T15:44:16.576 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-13T15:44:16.577 INFO:teuthology.orchestra.run.smithi189.stdout:Total download size: 203 M 2024-09-13T15:44:16.577 INFO:teuthology.orchestra.run.smithi189.stdout:Downloading Packages: 2024-09-13T15:44:16.607 INFO:teuthology.orchestra.run.smithi017.stdout:(64/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.9 MB/s | 3.0 MB 00:00 2024-09-13T15:44:16.689 INFO:teuthology.orchestra.run.smithi017.stdout:(65/138): postgresql-13.16-1.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-13T15:44:16.773 INFO:teuthology.orchestra.run.smithi017.stdout:(66/138): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-13T15:44:16.809 INFO:teuthology.orchestra.run.smithi193.stdout:(76/138): postgresql-server-13.16-1.el9.x86_64. 1.9 MB/s | 5.8 MB 00:03 2024-09-13T15:44:16.840 INFO:teuthology.orchestra.run.smithi017.stdout:(67/138): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-13T15:44:16.893 INFO:teuthology.orchestra.run.smithi193.stdout:(77/138): python3-babel-2.9.1-2.el9.noarch.rpm 2.0 MB/s | 6.0 MB 00:02 2024-09-13T15:44:17.000 INFO:teuthology.orchestra.run.smithi189.stdout:(1/138): ceph-18.2.4-850.g50bbe7f3.el9.x86_64.r 53 kB/s | 6.5 kB 00:00 2024-09-13T15:44:17.001 INFO:teuthology.orchestra.run.smithi193.stdout:(78/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 250 kB 00:00 2024-09-13T15:44:17.007 INFO:teuthology.orchestra.run.smithi017.stdout:(68/138): postgresql-server-13.16-1.el9.x86_64. 35 MB/s | 5.8 MB 00:00 2024-09-13T15:44:17.052 INFO:teuthology.orchestra.run.smithi193.stdout:(79/138): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-09-13T15:44:17.102 INFO:teuthology.orchestra.run.smithi193.stdout:(80/138): python3-packaging-20.9-5.el9.noarch.r 770 kB/s | 77 kB 00:00 2024-09-13T15:44:17.127 INFO:teuthology.orchestra.run.smithi193.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 562 kB/s | 42 kB 00:00 2024-09-13T15:44:17.182 INFO:teuthology.orchestra.run.smithi017.stdout:(69/138): python3-babel-2.9.1-2.el9.noarch.rpm 34 MB/s | 6.0 MB 00:00 2024-09-13T15:44:17.208 INFO:teuthology.orchestra.run.smithi189.stdout:(2/138): ceph-fuse-18.2.4-850.g50bbe7f3.el9.x86 4.0 MB/s | 852 kB 00:00 2024-09-13T15:44:17.210 INFO:teuthology.orchestra.run.smithi193.stdout:(82/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-13T15:44:17.241 INFO:teuthology.orchestra.run.smithi017.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-13T15:44:17.261 INFO:teuthology.orchestra.run.smithi193.stdout:(83/138): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-13T15:44:17.275 INFO:teuthology.orchestra.run.smithi189.stdout:(3/138): ceph-immutable-object-cache-18.2.4-850 2.1 MB/s | 143 kB 00:00 2024-09-13T15:44:17.299 INFO:teuthology.orchestra.run.smithi017.stdout:(71/138): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-13T15:44:17.320 INFO:teuthology.orchestra.run.smithi193.stdout:(84/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.9 MB/s | 5.1 MB 00:02 2024-09-13T15:44:17.342 INFO:teuthology.orchestra.run.smithi189.stdout:(4/138): ceph-base-18.2.4-850.g50bbe7f3.el9.x86 11 MB/s | 5.1 MB 00:00 2024-09-13T15:44:17.349 INFO:teuthology.orchestra.run.smithi017.stdout:(72/138): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-09-13T15:44:17.400 INFO:teuthology.orchestra.run.smithi017.stdout:(73/138): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-13T15:44:17.445 INFO:teuthology.orchestra.run.smithi193.stdout:(85/138): python3-pyasn1-modules-0.4.8-6.el9.no 878 kB/s | 279 kB 00:00 2024-09-13T15:44:17.458 INFO:teuthology.orchestra.run.smithi017.stdout:(74/138): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-13T15:44:17.459 INFO:teuthology.orchestra.run.smithi189.stdout:(5/138): ceph-mds-18.2.4-850.g50bbe7f3.el9.x86_ 11 MB/s | 2.1 MB 00:00 2024-09-13T15:44:17.470 INFO:teuthology.orchestra.run.smithi193.stdout:(86/138): python3-requests-oauthlib-1.3.0-12.el 257 kB/s | 54 kB 00:00 2024-09-13T15:44:17.496 INFO:teuthology.orchestra.run.smithi193.stdout:(87/138): python3-toml-0.10.2-6.el9.noarch.rpm 825 kB/s | 42 kB 00:00 2024-09-13T15:44:17.501 INFO:teuthology.orchestra.run.smithi189.stdout:(6/138): ceph-mgr-18.2.4-850.g50bbe7f3.el9.x86_ 9.2 MB/s | 1.5 MB 00:00 2024-09-13T15:44:17.526 INFO:teuthology.orchestra.run.smithi017.stdout:(75/138): openblas-openmp-0.3.26-2.el9.x86_64.r 4.8 MB/s | 4.9 MB 00:01 2024-09-13T15:44:17.546 INFO:teuthology.orchestra.run.smithi193.stdout:(88/138): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-13T15:44:17.551 INFO:teuthology.orchestra.run.smithi017.stdout:(76/138): python3-markupsafe-1.1.1-12.el9.x86_6 377 kB/s | 35 kB 00:00 2024-09-13T15:44:17.609 INFO:teuthology.orchestra.run.smithi017.stdout:(77/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-13T15:44:17.621 INFO:teuthology.orchestra.run.smithi193.stdout:(89/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.2 MB/s | 96 kB 00:00 2024-09-13T15:44:17.655 INFO:teuthology.orchestra.run.smithi193.stdout:(90/138): socat-1.7.4.1-6.el9.x86_64.rpm 1.6 MB/s | 304 kB 00:00 2024-09-13T15:44:17.699 INFO:teuthology.orchestra.run.smithi017.stdout:(78/138): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-13T15:44:17.705 INFO:teuthology.orchestra.run.smithi193.stdout:(91/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 761 kB/s | 64 kB 00:00 2024-09-13T15:44:17.730 INFO:teuthology.orchestra.run.smithi193.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 595 kB/s | 45 kB 00:00 2024-09-13T15:44:17.760 INFO:teuthology.orchestra.run.smithi017.stdout:(79/138): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-13T15:44:17.789 INFO:teuthology.orchestra.run.smithi193.stdout:(93/138): fmt-8.1.1-5.el9.x86_64.rpm 1.3 MB/s | 111 kB 00:00 2024-09-13T15:44:17.819 INFO:teuthology.orchestra.run.smithi017.stdout:(80/138): python3-prettytable-0.7.2-27.el9.noar 727 kB/s | 42 kB 00:00 2024-09-13T15:44:17.831 INFO:teuthology.orchestra.run.smithi193.stdout:(94/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 3.0 MB/s | 308 kB 00:00 2024-09-13T15:44:17.843 INFO:teuthology.orchestra.run.smithi189.stdout:(7/138): ceph-mon-18.2.4-850.g50bbe7f3.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-13T15:44:17.856 INFO:teuthology.orchestra.run.smithi193.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-13T15:44:17.890 INFO:teuthology.orchestra.run.smithi193.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-13T15:44:17.919 INFO:teuthology.orchestra.run.smithi017.stdout:(81/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-09-13T15:44:17.923 INFO:teuthology.orchestra.run.smithi193.stdout:(97/138): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-13T15:44:17.986 INFO:teuthology.orchestra.run.smithi017.stdout:(82/138): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-09-13T15:44:18.015 INFO:teuthology.orchestra.run.smithi193.stdout:(98/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-13T15:44:18.035 INFO:teuthology.orchestra.run.smithi189.stdout:(8/138): ceph-common-18.2.4-850.g50bbe7f3.el9.x 16 MB/s | 18 MB 00:01 2024-09-13T15:44:18.045 INFO:teuthology.orchestra.run.smithi017.stdout:(83/138): python3-pytz-2021.1-5.el9.noarch.rpm 875 kB/s | 51 kB 00:00 2024-09-13T15:44:18.069 INFO:teuthology.orchestra.run.smithi189.stdout:(9/138): ceph-selinux-18.2.4-850.g50bbe7f3.el9. 763 kB/s | 25 kB 00:00 2024-09-13T15:44:18.074 INFO:teuthology.orchestra.run.smithi193.stdout:(99/138): python3-asyncssh-2.13.2-5.el9.noarch. 9.2 MB/s | 548 kB 00:00 2024-09-13T15:44:18.091 INFO:teuthology.orchestra.run.smithi193.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-13T15:44:18.103 INFO:teuthology.orchestra.run.smithi017.stdout:(84/138): python3-requests-oauthlib-1.3.0-12.el 925 kB/s | 54 kB 00:00 2024-09-13T15:44:18.108 INFO:teuthology.orchestra.run.smithi193.stdout:(101/138): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-13T15:44:18.125 INFO:teuthology.orchestra.run.smithi193.stdout:(102/138): python3-certifi-2023.05.07-4.el9.noa 847 kB/s | 14 kB 00:00 2024-09-13T15:44:18.192 INFO:teuthology.orchestra.run.smithi193.stdout:(103/138): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-13T15:44:18.217 INFO:teuthology.orchestra.run.smithi193.stdout:(104/138): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-09-13T15:44:18.251 INFO:teuthology.orchestra.run.smithi193.stdout:(105/138): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-13T15:44:18.276 INFO:teuthology.orchestra.run.smithi193.stdout:(106/138): python3-jaraco-8.2.1-3.el9.noarch.rp 425 kB/s | 11 kB 00:00 2024-09-13T15:44:18.301 INFO:teuthology.orchestra.run.smithi193.stdout:(107/138): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-13T15:44:18.327 INFO:teuthology.orchestra.run.smithi193.stdout:(108/138): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-13T15:44:18.352 INFO:teuthology.orchestra.run.smithi193.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-13T15:44:18.377 INFO:teuthology.orchestra.run.smithi193.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-13T15:44:18.402 INFO:teuthology.orchestra.run.smithi189.stdout:(10/138): ceph-radosgw-18.2.4-850.g50bbe7f3.el9 14 MB/s | 7.8 MB 00:00 2024-09-13T15:44:18.403 INFO:teuthology.orchestra.run.smithi193.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-13T15:44:18.453 INFO:teuthology.orchestra.run.smithi193.stdout:(112/138): python3-logutils-0.3.5-21.el9.noarch 927 kB/s | 46 kB 00:00 2024-09-13T15:44:18.462 INFO:teuthology.orchestra.run.smithi017.stdout:(85/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2024-09-13T15:44:18.487 INFO:teuthology.orchestra.run.smithi193.stdout:(113/138): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-13T15:44:18.512 INFO:teuthology.orchestra.run.smithi017.stdout:(86/138): python3-toml-0.10.2-6.el9.noarch.rpm 835 kB/s | 42 kB 00:00 2024-09-13T15:44:18.529 INFO:teuthology.orchestra.run.smithi193.stdout:(114/138): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-13T15:44:18.554 INFO:teuthology.orchestra.run.smithi193.stdout:(115/138): python3-natsort-7.1.1-5.el9.noarch.r 859 kB/s | 58 kB 00:00 2024-09-13T15:44:18.569 INFO:teuthology.orchestra.run.smithi189.stdout:(11/138): ceph-osd-18.2.4-850.g50bbe7f3.el9.x86 15 MB/s | 17 MB 00:01 2024-09-13T15:44:18.571 INFO:teuthology.orchestra.run.smithi017.stdout:(87/138): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-13T15:44:18.579 INFO:teuthology.orchestra.run.smithi193.stdout:(116/138): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-13T15:44:18.594 INFO:teuthology.orchestra.run.smithi189.stdout:(12/138): cephfs-mirror-18.2.4-850.g50bbe7f3.el 1.1 MB/s | 224 kB 00:00 2024-09-13T15:44:18.605 INFO:teuthology.orchestra.run.smithi193.stdout:(117/138): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-13T15:44:18.619 INFO:teuthology.orchestra.run.smithi189.stdout:(13/138): libcephfs-devel-18.2.4-850.g50bbe7f3. 624 kB/s | 31 kB 00:00 2024-09-13T15:44:18.630 INFO:teuthology.orchestra.run.smithi193.stdout:(118/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-13T15:44:18.653 INFO:teuthology.orchestra.run.smithi189.stdout:(14/138): libcephfs2-18.2.4-850.g50bbe7f3.el9.x 12 MB/s | 712 kB 00:00 2024-09-13T15:44:18.655 INFO:teuthology.orchestra.run.smithi193.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-13T15:44:18.678 INFO:teuthology.orchestra.run.smithi189.stdout:(15/138): libcephsqlite-18.2.4-850.g50bbe7f3.el 2.8 MB/s | 166 kB 00:00 2024-09-13T15:44:18.680 INFO:teuthology.orchestra.run.smithi193.stdout:(120/138): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-13T15:44:18.696 INFO:teuthology.orchestra.run.smithi017.stdout:(88/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.4 MB/s | 5.1 MB 00:01 2024-09-13T15:44:18.703 INFO:teuthology.orchestra.run.smithi189.stdout:(16/138): librados-devel-18.2.4-850.g50bbe7f3.e 2.5 MB/s | 127 kB 00:00 2024-09-13T15:44:18.706 INFO:teuthology.orchestra.run.smithi193.stdout:(121/138): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-13T15:44:18.721 INFO:teuthology.orchestra.run.smithi017.stdout:(89/138): uuid-1.6.2-55.el9.x86_64.rpm 385 kB/s | 58 kB 00:00 2024-09-13T15:44:18.731 INFO:teuthology.orchestra.run.smithi193.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-13T15:44:18.747 INFO:teuthology.orchestra.run.smithi017.stdout:(90/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-13T15:44:18.758 INFO:teuthology.orchestra.run.smithi193.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-13T15:44:18.758 INFO:teuthology.orchestra.run.smithi189.stdout:(17/138): libradosstriper1-18.2.4-850.g50bbe7f3 6.2 MB/s | 477 kB 00:00 2024-09-13T15:44:18.772 INFO:teuthology.orchestra.run.smithi017.stdout:(91/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-13T15:44:18.782 INFO:teuthology.orchestra.run.smithi193.stdout:(124/138): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-13T15:44:18.806 INFO:teuthology.orchestra.run.smithi017.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 762 kB/s | 45 kB 00:00 2024-09-13T15:44:18.807 INFO:teuthology.orchestra.run.smithi193.stdout:(125/138): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-13T15:44:18.821 INFO:teuthology.orchestra.run.smithi189.stdout:(18/138): python3-ceph-argparse-18.2.4-850.g50b 677 kB/s | 45 kB 00:00 2024-09-13T15:44:18.832 INFO:teuthology.orchestra.run.smithi193.stdout:(126/138): python3-zc-lockfile-2.0-10.el9.noarc 799 kB/s | 20 kB 00:00 2024-09-13T15:44:18.848 INFO:teuthology.orchestra.run.smithi017.stdout:(93/138): fmt-8.1.1-5.el9.x86_64.rpm 1.4 MB/s | 111 kB 00:00 2024-09-13T15:44:18.866 INFO:teuthology.orchestra.run.smithi193.stdout:(127/138): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-09-13T15:44:18.891 INFO:teuthology.orchestra.run.smithi193.stdout:(128/138): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-13T15:44:18.896 INFO:teuthology.orchestra.run.smithi189.stdout:(19/138): python3-ceph-common-18.2.4-850.g50bbe 1.7 MB/s | 129 kB 00:00 2024-09-13T15:44:18.906 INFO:teuthology.orchestra.run.smithi017.stdout:(94/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 3.1 MB/s | 308 kB 00:00 2024-09-13T15:44:18.932 INFO:teuthology.orchestra.run.smithi017.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-13T15:44:18.957 INFO:teuthology.orchestra.run.smithi017.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T15:44:18.966 INFO:teuthology.orchestra.run.smithi193.stdout:(129/138): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-13T15:44:18.980 INFO:teuthology.orchestra.run.smithi189.stdout:(20/138): librgw2-18.2.4-850.g50bbe7f3.el9.x86_ 16 MB/s | 4.5 MB 00:00 2024-09-13T15:44:18.982 INFO:teuthology.orchestra.run.smithi017.stdout:(97/138): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-13T15:44:19.005 INFO:teuthology.orchestra.run.smithi189.stdout:(21/138): python3-cephfs-18.2.4-850.g50bbe7f3.e 1.5 MB/s | 162 kB 00:00 2024-09-13T15:44:19.039 INFO:teuthology.orchestra.run.smithi189.stdout:(22/138): python3-rados-18.2.4-850.g50bbe7f3.el 5.3 MB/s | 319 kB 00:00 2024-09-13T15:44:19.064 INFO:teuthology.orchestra.run.smithi189.stdout:(23/138): python3-rbd-18.2.4-850.g50bbe7f3.el9. 5.0 MB/s | 301 kB 00:00 2024-09-13T15:44:19.066 INFO:teuthology.orchestra.run.smithi017.stdout:(98/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.9 MB/s | 839 kB 00:00 2024-09-13T15:44:19.089 INFO:teuthology.orchestra.run.smithi189.stdout:(24/138): python3-rgw-18.2.4-850.g50bbe7f3.el9. 1.9 MB/s | 99 kB 00:00 2024-09-13T15:44:19.131 INFO:teuthology.orchestra.run.smithi189.stdout:(25/138): rbd-fuse-18.2.4-850.g50bbe7f3.el9.x86 1.3 MB/s | 87 kB 00:00 2024-09-13T15:44:19.150 INFO:teuthology.orchestra.run.smithi017.stdout:(99/138): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-13T15:44:19.214 INFO:teuthology.orchestra.run.smithi189.stdout:(26/138): rbd-nbd-18.2.4-850.g50bbe7f3.el9.x86_ 2.0 MB/s | 172 kB 00:00 2024-09-13T15:44:19.217 INFO:teuthology.orchestra.run.smithi193.stdout:(130/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.6 MB/s | 16 MB 00:01 2024-09-13T15:44:19.284 INFO:teuthology.orchestra.run.smithi193.stdout:(131/138): librados2-18.2.4-850.g50bbe7f3.el9.x 8.4 MB/s | 3.3 MB 00:00 2024-09-13T15:44:19.294 INFO:teuthology.orchestra.run.smithi017.stdout:(100/138): python3-asyncssh-2.13.2-5.el9.noarch 2.4 MB/s | 548 kB 00:00 2024-09-13T15:44:19.306 INFO:teuthology.orchestra.run.smithi189.stdout:(27/138): ceph-grafana-dashboards-18.2.4-850.g5 266 kB/s | 24 kB 00:00 2024-09-13T15:44:19.356 INFO:teuthology.orchestra.run.smithi189.stdout:(28/138): rbd-mirror-18.2.4-850.g50bbe7f3.el9.x 11 MB/s | 3.0 MB 00:00 2024-09-13T15:44:19.369 INFO:teuthology.orchestra.run.smithi017.stdout:(101/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.6 MB/s | 4.4 MB 00:02 2024-09-13T15:44:19.390 INFO:teuthology.orchestra.run.smithi189.stdout:(29/138): ceph-mgr-cephadm-18.2.4-850.g50bbe7f3 1.6 MB/s | 139 kB 00:00 2024-09-13T15:44:19.394 INFO:teuthology.orchestra.run.smithi017.stdout:(102/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 178 kB/s | 43 kB 00:00 2024-09-13T15:44:19.426 INFO:teuthology.orchestra.run.smithi193.stdout:(132/138): librbd1-18.2.4-850.g50bbe7f3.el9.x86 6.6 MB/s | 3.0 MB 00:00 2024-09-13T15:44:19.428 INFO:teuthology.orchestra.run.smithi017.stdout:(103/138): python3-cachetools-4.2.4-1.el9.noarc 240 kB/s | 32 kB 00:00 2024-09-13T15:44:19.453 INFO:teuthology.orchestra.run.smithi017.stdout:(104/138): python3-certifi-2023.05.07-4.el9.noa 169 kB/s | 14 kB 00:00 2024-09-13T15:44:19.478 INFO:teuthology.orchestra.run.smithi017.stdout:(105/138): python3-cheroot-8.6.0-4.el9.noarch.r 2.3 MB/s | 172 kB 00:00 2024-09-13T15:44:19.503 INFO:teuthology.orchestra.run.smithi017.stdout:(106/138): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-13T15:44:19.529 INFO:teuthology.orchestra.run.smithi017.stdout:(107/138): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-09-13T15:44:19.554 INFO:teuthology.orchestra.run.smithi017.stdout:(108/138): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-09-13T15:44:19.559 INFO:teuthology.orchestra.run.smithi193.stdout:(133/138): NetworkManager-1.49.90-1.el9.x86_64. 6.8 MB/s | 2.3 MB 00:00 2024-09-13T15:44:19.576 INFO:teuthology.orchestra.run.smithi193.stdout:(134/138): NetworkManager-team-1.49.90-1.el9.x8 271 kB/s | 41 kB 00:00 2024-09-13T15:44:19.579 INFO:teuthology.orchestra.run.smithi017.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-13T15:44:19.605 INFO:teuthology.orchestra.run.smithi017.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-13T15:44:19.618 INFO:teuthology.orchestra.run.smithi193.stdout:(135/138): NetworkManager-libnm-1.49.90-1.el9.x 5.4 MB/s | 1.8 MB 00:00 2024-09-13T15:44:19.630 INFO:teuthology.orchestra.run.smithi017.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-13T15:44:19.643 INFO:teuthology.orchestra.run.smithi193.stdout:(136/138): NetworkManager-tui-1.49.90-1.el9.x86 2.9 MB/s | 249 kB 00:00 2024-09-13T15:44:19.657 INFO:teuthology.orchestra.run.smithi189.stdout:(30/138): ceph-mgr-dashboard-18.2.4-850.g50bbe7 12 MB/s | 3.5 MB 00:00 2024-09-13T15:44:19.719 INFO:teuthology.orchestra.run.smithi017.stdout:(112/138): python3-google-auth-2.34.0-1.el9.noa 839 kB/s | 220 kB 00:00 2024-09-13T15:44:19.732 INFO:teuthology.orchestra.run.smithi189.stdout:(31/138): ceph-mgr-modules-core-18.2.4-850.g50b 3.2 MB/s | 246 kB 00:00 2024-09-13T15:44:19.752 INFO:teuthology.orchestra.run.smithi193.stdout:(137/138): openssl-3.2.2-6.el9.x86_64.rpm 7.7 MB/s | 1.4 MB 00:00 2024-09-13T15:44:19.756 INFO:teuthology.orchestra.run.smithi017.stdout:(113/138): python3-logutils-0.3.5-21.el9.noarch 369 kB/s | 46 kB 00:00 2024-09-13T15:44:19.781 INFO:teuthology.orchestra.run.smithi017.stdout:(114/138): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-09-13T15:44:19.794 INFO:teuthology.orchestra.run.smithi193.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-09-13T15:44:19.798 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-09-13T15:44:19.798 INFO:teuthology.orchestra.run.smithi193.stdout:Total 16 MB/s | 203 MB 00:12 2024-09-13T15:44:19.799 INFO:teuthology.orchestra.run.smithi189.stdout:(32/138): ceph-mgr-rook-18.2.4-850.g50bbe7f3.el 742 kB/s | 49 kB 00:00 2024-09-13T15:44:19.806 INFO:teuthology.orchestra.run.smithi017.stdout:(115/138): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-13T15:44:19.831 INFO:teuthology.orchestra.run.smithi017.stdout:(116/138): python3-portend-3.1.0-2.el9.noarch.r 666 kB/s | 16 kB 00:00 2024-09-13T15:44:19.857 INFO:teuthology.orchestra.run.smithi017.stdout:(117/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-13T15:44:19.882 INFO:teuthology.orchestra.run.smithi017.stdout:(118/138): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-13T15:44:19.907 INFO:teuthology.orchestra.run.smithi017.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-13T15:44:19.933 INFO:teuthology.orchestra.run.smithi017.stdout:(120/138): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-13T15:44:19.958 INFO:teuthology.orchestra.run.smithi017.stdout:(121/138): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-13T15:44:19.983 INFO:teuthology.orchestra.run.smithi017.stdout:(122/138): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-13T15:44:20.008 INFO:teuthology.orchestra.run.smithi017.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-13T15:44:20.034 INFO:teuthology.orchestra.run.smithi017.stdout:(124/138): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-13T15:44:20.059 INFO:teuthology.orchestra.run.smithi017.stdout:(125/138): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-13T15:44:20.268 INFO:teuthology.orchestra.run.smithi189.stdout:(33/138): ceph-test-18.2.4-850.g50bbe7f3.el9.x8 19 MB/s | 40 MB 00:02 2024-09-13T15:44:20.268 INFO:teuthology.orchestra.run.smithi189.stdout:(34/138): ceph-prometheus-alerts-18.2.4-850.g50 41 kB/s | 16 kB 00:00 2024-09-13T15:44:20.268 INFO:teuthology.orchestra.run.smithi189.stdout:(35/138): ceph-volume-18.2.4-850.g50bbe7f3.el9. 5.2 MB/s | 264 kB 00:00 2024-09-13T15:44:20.268 INFO:teuthology.orchestra.run.smithi189.stdout:(36/138): cephadm-18.2.4-850.g50bbe7f3.el9.noar 4.4 MB/s | 226 kB 00:00 2024-09-13T15:44:20.268 INFO:teuthology.orchestra.run.smithi017.stdout:(126/138): python3-zc-lockfile-2.0-10.el9.noarc 810 kB/s | 20 kB 00:00 2024-09-13T15:44:20.269 INFO:teuthology.orchestra.run.smithi017.stdout:(127/138): python3-kubernetes-26.1.0-2.el9.noar 2.0 MB/s | 1.0 MB 00:00 2024-09-13T15:44:20.269 INFO:teuthology.orchestra.run.smithi017.stdout:(128/138): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-13T15:44:20.269 INFO:teuthology.orchestra.run.smithi017.stdout:(129/138): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-13T15:44:20.269 INFO:teuthology.orchestra.run.smithi017.stdout:(130/138): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-13T15:44:20.334 INFO:teuthology.orchestra.run.smithi189.stdout:(37/138): cephfs-top-18.2.4-850.g50bbe7f3.el9.n 168 kB/s | 18 kB 00:00 2024-09-13T15:44:20.411 INFO:teuthology.orchestra.run.smithi017.stdout:(131/138): librados2-18.2.4-850.g50bbe7f3.el9.x 13 MB/s | 3.3 MB 00:00 2024-09-13T15:44:20.443 INFO:teuthology.orchestra.run.smithi189.stdout:(38/138): ceph-mgr-diskprediction-local-18.2.4- 7.0 MB/s | 7.4 MB 00:01 2024-09-13T15:44:20.503 INFO:teuthology.orchestra.run.smithi017.stdout:(132/138): librbd1-18.2.4-850.g50bbe7f3.el9.x86 9.3 MB/s | 3.0 MB 00:00 2024-09-13T15:44:20.561 INFO:teuthology.orchestra.run.smithi017.stdout:(133/138): NetworkManager-1.49.90-1.el9.x86_64. 7.1 MB/s | 2.3 MB 00:00 2024-09-13T15:44:20.584 INFO:teuthology.orchestra.run.smithi189.stdout:(39/138): fuse-2.9.9-16.el9.x86_64.rpm 239 kB/s | 80 kB 00:00 2024-09-13T15:44:20.612 INFO:teuthology.orchestra.run.smithi017.stdout:(134/138): NetworkManager-team-1.49.90-1.el9.x8 376 kB/s | 41 kB 00:00 2024-09-13T15:44:20.643 INFO:teuthology.orchestra.run.smithi189.stdout:(40/138): libquadmath-11.5.0-2.el9.x86_64.rpm 956 kB/s | 191 kB 00:00 2024-09-13T15:44:20.662 INFO:teuthology.orchestra.run.smithi017.stdout:(135/138): NetworkManager-tui-1.49.90-1.el9.x86 2.4 MB/s | 249 kB 00:00 2024-09-13T15:44:20.676 INFO:teuthology.orchestra.run.smithi189.stdout:(41/138): libgfortran-11.5.0-2.el9.x86_64.rpm 2.3 MB/s | 801 kB 00:00 2024-09-13T15:44:20.702 INFO:teuthology.orchestra.run.smithi189.stdout:(42/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-13T15:44:20.727 INFO:teuthology.orchestra.run.smithi189.stdout:(43/138): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-13T15:44:20.760 INFO:teuthology.orchestra.run.smithi189.stdout:(44/138): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-13T15:44:20.762 INFO:teuthology.orchestra.run.smithi017.stdout:(136/138): NetworkManager-libnm-1.49.90-1.el9.x 5.1 MB/s | 1.8 MB 00:00 2024-09-13T15:44:20.794 INFO:teuthology.orchestra.run.smithi189.stdout:(45/138): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-13T15:44:20.820 INFO:teuthology.orchestra.run.smithi189.stdout:(46/138): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-13T15:44:20.829 INFO:teuthology.orchestra.run.smithi017.stdout:(137/138): openssl-3.2.2-6.el9.x86_64.rpm 6.2 MB/s | 1.4 MB 00:00 2024-09-13T15:44:20.853 INFO:teuthology.orchestra.run.smithi189.stdout:(47/138): python3-cryptography-36.0.1-4.el9.x86 5.8 MB/s | 1.2 MB 00:00 2024-09-13T15:44:20.871 INFO:teuthology.orchestra.run.smithi017.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-09-13T15:44:20.877 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-13T15:44:20.877 INFO:teuthology.orchestra.run.smithi017.stdout:Total 21 MB/s | 203 MB 00:09 2024-09-13T15:44:20.898 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-09-13T15:44:20.953 INFO:teuthology.orchestra.run.smithi189.stdout:(48/138): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-09-13T15:44:20.979 INFO:teuthology.orchestra.run.smithi189.stdout:(49/138): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-09-13T15:44:20.995 INFO:teuthology.orchestra.run.smithi189.stdout:(50/138): elfutils-libelf-devel-0.191-4.el9.x86 520 kB/s | 22 kB 00:00 2024-09-13T15:44:21.021 INFO:teuthology.orchestra.run.smithi189.stdout:(51/138): flex-2.6.4-9.el9.x86_64.rpm 7.3 MB/s | 313 kB 00:00 2024-09-13T15:44:21.037 INFO:teuthology.orchestra.run.smithi189.stdout:(52/138): flexiblas-3.0.4-8.el9.x86_64.rpm 789 kB/s | 33 kB 00:00 2024-09-13T15:44:21.044 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-09-13T15:44:21.044 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-09-13T15:44:21.071 INFO:teuthology.orchestra.run.smithi189.stdout:(53/138): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 943 kB 00:00 2024-09-13T15:44:21.097 INFO:teuthology.orchestra.run.smithi189.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 310 kB/s | 18 kB 00:00 2024-09-13T15:44:21.122 INFO:teuthology.orchestra.run.smithi189.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-13T15:44:21.147 INFO:teuthology.orchestra.run.smithi189.stdout:(56/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-13T15:44:21.172 INFO:teuthology.orchestra.run.smithi189.stdout:(57/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-13T15:44:21.206 INFO:teuthology.orchestra.run.smithi189.stdout:(58/138): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-13T15:44:21.273 INFO:teuthology.orchestra.run.smithi189.stdout:(59/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-09-13T15:44:21.298 INFO:teuthology.orchestra.run.smithi189.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 267 kB/s | 24 kB 00:00 2024-09-13T15:44:21.323 INFO:teuthology.orchestra.run.smithi189.stdout:(61/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 949 kB/s | 47 kB 00:00 2024-09-13T15:44:21.349 INFO:teuthology.orchestra.run.smithi189.stdout:(62/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-13T15:44:21.374 INFO:teuthology.orchestra.run.smithi189.stdout:(63/138): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-13T15:44:21.399 INFO:teuthology.orchestra.run.smithi189.stdout:(64/138): libtool-2.4.6-46.el9.x86_64.rpm 2.5 MB/s | 581 kB 00:00 2024-09-13T15:44:21.516 INFO:teuthology.orchestra.run.smithi189.stdout:(65/138): openblas-openmp-0.3.26-2.el9.x86_64.r 30 MB/s | 4.9 MB 00:00 2024-09-13T15:44:21.558 INFO:teuthology.orchestra.run.smithi189.stdout:(66/138): postgresql-13.16-1.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-13T15:44:21.616 INFO:teuthology.orchestra.run.smithi189.stdout:(67/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-13T15:44:21.642 INFO:teuthology.orchestra.run.smithi189.stdout:(68/138): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-13T15:44:21.684 INFO:teuthology.orchestra.run.smithi189.stdout:(69/138): postgresql-contrib-13.16-1.el9.x86_64 5.3 MB/s | 910 kB 00:00 2024-09-13T15:44:21.734 INFO:teuthology.orchestra.run.smithi189.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-13T15:44:21.809 INFO:teuthology.orchestra.run.smithi189.stdout:(71/138): postgresql-server-13.16-1.el9.x86_64. 30 MB/s | 5.8 MB 00:00 2024-09-13T15:44:21.893 INFO:teuthology.orchestra.run.smithi189.stdout:(72/138): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-09-13T15:44:21.909 INFO:teuthology.orchestra.run.smithi189.stdout:(73/138): python3-jsonpatch-1.21-16.el9.noarch. 256 kB/s | 26 kB 00:00 2024-09-13T15:44:21.935 INFO:teuthology.orchestra.run.smithi189.stdout:(74/138): python3-jsonpointer-2.0-4.el9.noarch. 457 kB/s | 19 kB 00:00 2024-09-13T15:44:21.960 INFO:teuthology.orchestra.run.smithi189.stdout:(75/138): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-13T15:44:21.977 INFO:teuthology.orchestra.run.smithi189.stdout:(76/138): python3-markupsafe-1.1.1-12.el9.x86_6 828 kB/s | 35 kB 00:00 2024-09-13T15:44:22.061 INFO:teuthology.orchestra.run.smithi189.stdout:(77/138): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-13T15:44:22.086 INFO:teuthology.orchestra.run.smithi189.stdout:(78/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-13T15:44:22.111 INFO:teuthology.orchestra.run.smithi189.stdout:(79/138): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-13T15:44:22.137 INFO:teuthology.orchestra.run.smithi189.stdout:(80/138): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-13T15:44:22.153 INFO:teuthology.orchestra.run.smithi189.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-13T15:44:22.179 INFO:teuthology.orchestra.run.smithi189.stdout:(82/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.7 MB/s | 159 kB 00:00 2024-09-13T15:44:22.204 INFO:teuthology.orchestra.run.smithi189.stdout:(83/138): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-13T15:44:22.221 INFO:teuthology.orchestra.run.smithi189.stdout:(84/138): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-13T15:44:22.238 INFO:teuthology.orchestra.run.smithi189.stdout:(85/138): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-13T15:44:22.313 INFO:teuthology.orchestra.run.smithi189.stdout:(86/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-13T15:44:22.331 INFO:teuthology.orchestra.run.smithi189.stdout:(87/138): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-09-13T15:44:22.364 INFO:teuthology.orchestra.run.smithi189.stdout:(88/138): socat-1.7.4.1-6.el9.x86_64.rpm 6.0 MB/s | 304 kB 00:00 2024-09-13T15:44:22.389 INFO:teuthology.orchestra.run.smithi189.stdout:(89/138): uuid-1.6.2-55.el9.x86_64.rpm 986 kB/s | 58 kB 00:00 2024-09-13T15:44:22.414 INFO:teuthology.orchestra.run.smithi189.stdout:(90/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-13T15:44:22.440 INFO:teuthology.orchestra.run.smithi189.stdout:(91/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-13T15:44:22.465 INFO:teuthology.orchestra.run.smithi189.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-09-13T15:44:22.507 INFO:teuthology.orchestra.run.smithi189.stdout:(93/138): fmt-8.1.1-5.el9.x86_64.rpm 1.6 MB/s | 111 kB 00:00 2024-09-13T15:44:22.557 INFO:teuthology.orchestra.run.smithi189.stdout:(94/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 3.3 MB/s | 308 kB 00:00 2024-09-13T15:44:22.591 INFO:teuthology.orchestra.run.smithi189.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 782 kB/s | 26 kB 00:00 2024-09-13T15:44:22.616 INFO:teuthology.orchestra.run.smithi189.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T15:44:22.633 INFO:teuthology.orchestra.run.smithi189.stdout:(97/138): libunwind-1.6.2-1.el9.x86_64.rpm 4.0 MB/s | 67 kB 00:00 2024-09-13T15:44:22.684 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-09-13T15:44:22.684 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-09-13T15:44:22.699 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-13T15:44:22.825 INFO:teuthology.orchestra.run.smithi189.stdout:(98/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-13T15:44:22.867 INFO:teuthology.orchestra.run.smithi189.stdout:(99/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.5 MB/s | 839 kB 00:00 2024-09-13T15:44:22.887 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-13T15:44:22.887 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-13T15:44:22.900 INFO:teuthology.orchestra.run.smithi189.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.6 MB/s | 43 kB 00:00 2024-09-13T15:44:22.926 INFO:teuthology.orchestra.run.smithi189.stdout:(101/138): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-09-13T15:44:22.951 INFO:teuthology.orchestra.run.smithi189.stdout:(102/138): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-13T15:44:23.026 INFO:teuthology.orchestra.run.smithi189.stdout:(103/138): libarrow-9.0.0-11.el9.x86_64.rpm 8.5 MB/s | 4.4 MB 00:00 2024-09-13T15:44:23.051 INFO:teuthology.orchestra.run.smithi189.stdout:(104/138): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-09-13T15:44:23.076 INFO:teuthology.orchestra.run.smithi189.stdout:(105/138): python3-asyncssh-2.13.2-5.el9.noarch 2.1 MB/s | 548 kB 00:00 2024-09-13T15:44:23.093 INFO:teuthology.orchestra.run.smithi189.stdout:(106/138): python3-jaraco-8.2.1-3.el9.noarch.rp 644 kB/s | 11 kB 00:00 2024-09-13T15:44:23.118 INFO:teuthology.orchestra.run.smithi189.stdout:(107/138): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-13T15:44:23.144 INFO:teuthology.orchestra.run.smithi189.stdout:(108/138): python3-google-auth-2.34.0-1.el9.noa 2.3 MB/s | 220 kB 00:00 2024-09-13T15:44:23.177 INFO:teuthology.orchestra.run.smithi189.stdout:(109/138): python3-jaraco-classes-3.2.1-5.el9.n 210 kB/s | 18 kB 00:00 2024-09-13T15:44:23.203 INFO:teuthology.orchestra.run.smithi189.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 332 kB/s | 19 kB 00:00 2024-09-13T15:44:23.228 INFO:teuthology.orchestra.run.smithi189.stdout:(111/138): python3-jaraco-collections-3.0.0-8.e 276 kB/s | 23 kB 00:00 2024-09-13T15:44:23.253 INFO:teuthology.orchestra.run.smithi189.stdout:(112/138): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-09-13T15:44:23.279 INFO:teuthology.orchestra.run.smithi189.stdout:(113/138): python3-logutils-0.3.5-21.el9.noarch 922 kB/s | 46 kB 00:00 2024-09-13T15:44:23.295 INFO:teuthology.orchestra.run.smithi189.stdout:(114/138): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2024-09-13T15:44:23.321 INFO:teuthology.orchestra.run.smithi189.stdout:(115/138): python3-natsort-7.1.1-5.el9.noarch.r 1.3 MB/s | 58 kB 00:00 2024-09-13T15:44:23.346 INFO:teuthology.orchestra.run.smithi189.stdout:(116/138): python3-portend-3.1.0-2.el9.noarch.r 665 kB/s | 16 kB 00:00 2024-09-13T15:44:23.371 INFO:teuthology.orchestra.run.smithi189.stdout:(117/138): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-13T15:44:23.397 INFO:teuthology.orchestra.run.smithi189.stdout:(118/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-13T15:44:23.422 INFO:teuthology.orchestra.run.smithi189.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-13T15:44:23.447 INFO:teuthology.orchestra.run.smithi189.stdout:(120/138): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-13T15:44:23.472 INFO:teuthology.orchestra.run.smithi189.stdout:(121/138): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-13T15:44:23.498 INFO:teuthology.orchestra.run.smithi189.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-13T15:44:23.523 INFO:teuthology.orchestra.run.smithi189.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-13T15:44:23.557 INFO:teuthology.orchestra.run.smithi189.stdout:(124/138): python3-kubernetes-26.1.0-2.el9.noar 2.9 MB/s | 1.0 MB 00:00 2024-09-13T15:44:23.582 INFO:teuthology.orchestra.run.smithi189.stdout:(125/138): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-13T15:44:23.607 INFO:teuthology.orchestra.run.smithi189.stdout:(126/138): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-13T15:44:23.632 INFO:teuthology.orchestra.run.smithi189.stdout:(127/138): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-13T15:44:23.657 INFO:teuthology.orchestra.run.smithi189.stdout:(128/138): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-13T15:44:23.700 INFO:teuthology.orchestra.run.smithi189.stdout:(129/138): re2-20211101-20.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-13T15:44:23.758 INFO:teuthology.orchestra.run.smithi189.stdout:(130/138): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-13T15:44:23.933 INFO:teuthology.orchestra.run.smithi189.stdout:(131/138): librados2-18.2.4-850.g50bbe7f3.el9.x 12 MB/s | 3.3 MB 00:00 2024-09-13T15:44:23.984 INFO:teuthology.orchestra.run.smithi189.stdout:(132/138): librbd1-18.2.4-850.g50bbe7f3.el9.x86 11 MB/s | 3.0 MB 00:00 2024-09-13T15:44:24.059 INFO:teuthology.orchestra.run.smithi189.stdout:(133/138): NetworkManager-team-1.49.90-1.el9.x8 543 kB/s | 41 kB 00:00 2024-09-13T15:44:24.176 INFO:teuthology.orchestra.run.smithi189.stdout:(134/138): NetworkManager-tui-1.49.90-1.el9.x86 2.1 MB/s | 249 kB 00:00 2024-09-13T15:44:24.309 INFO:teuthology.orchestra.run.smithi189.stdout:(135/138): NetworkManager-libnm-1.49.90-1.el9.x 4.8 MB/s | 1.8 MB 00:00 2024-09-13T15:44:24.493 INFO:teuthology.orchestra.run.smithi189.stdout:(136/138): openssl-3.2.2-6.el9.x86_64.rpm 4.3 MB/s | 1.4 MB 00:00 2024-09-13T15:44:24.627 INFO:teuthology.orchestra.run.smithi189.stdout:(137/138): NetworkManager-1.49.90-1.el9.x86_64. 2.7 MB/s | 2.3 MB 00:00 2024-09-13T15:44:25.212 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-13T15:44:25.216 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-13T15:44:25.468 INFO:teuthology.orchestra.run.smithi189.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.1 MB/s | 2.4 MB 00:01 2024-09-13T15:44:25.475 INFO:teuthology.orchestra.run.smithi189.stdout:-------------------------------------------------------------------------------- 2024-09-13T15:44:25.475 INFO:teuthology.orchestra.run.smithi189.stdout:Total 23 MB/s | 203 MB 00:08 2024-09-13T15:44:26.584 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction check 2024-09-13T15:44:26.729 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction check succeeded. 2024-09-13T15:44:26.729 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction test 2024-09-13T15:44:28.271 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-09-13T15:44:28.355 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction test succeeded. 2024-09-13T15:44:28.355 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction 2024-09-13T15:44:28.364 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T15:44:28.402 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T15:44:28.456 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T15:44:28.498 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T15:44:28.524 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T15:44:28.568 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T15:44:28.882 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T15:44:29.009 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T15:44:29.312 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T15:44:29.343 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T15:44:29.434 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T15:44:29.465 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 10/146 2024-09-13T15:44:29.614 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T15:44:29.670 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T15:44:29.698 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T15:44:29.799 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T15:44:29.824 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 14/146 2024-09-13T15:44:29.998 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 14/146 2024-09-13T15:44:30.112 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T15:44:30.208 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:44:30.289 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:44:30.563 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:44:30.602 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T15:44:30.637 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T15:44:30.710 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T15:44:30.745 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T15:44:30.780 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T15:44:30.850 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T15:44:30.903 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T15:44:30.933 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T15:44:30.986 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T15:44:31.062 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T15:44:31.096 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x 27/146 2024-09-13T15:44:31.141 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9 28/146 2024-09-13T15:44:31.214 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 29/146 2024-09-13T15:44:31.304 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-13T15:44:31.349 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T15:44:31.400 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T15:44:31.461 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T15:44:31.745 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T15:44:31.836 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T15:44:31.880 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T15:44:31.911 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T15:44:31.939 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T15:44:31.974 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T15:44:32.016 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T15:44:32.063 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T15:44:32.100 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 35/146 2024-09-13T15:44:32.141 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T15:44:32.293 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T15:44:32.338 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T15:44:32.343 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T15:44:32.449 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T15:44:32.453 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T15:44:32.488 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T15:44:32.543 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T15:44:32.581 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T15:44:32.612 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T15:44:32.615 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T15:44:32.648 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T15:44:32.683 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T15:44:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T15:44:32.730 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T15:44:32.768 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 10/146 2024-09-13T15:44:32.775 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T15:44:32.817 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T15:44:32.953 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T15:44:32.985 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T15:44:32.995 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T15:44:33.037 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T15:44:33.058 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T15:44:33.091 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T15:44:33.138 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T15:44:33.170 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T15:44:33.201 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T15:44:33.227 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T15:44:33.236 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T15:44:33.258 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T15:44:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 14/146 2024-09-13T15:44:33.300 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T15:44:33.328 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T15:44:33.363 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T15:44:33.399 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T15:44:33.438 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T15:44:33.472 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T15:44:33.506 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T15:44:33.509 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 14/146 2024-09-13T15:44:33.547 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T15:44:33.582 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T15:44:33.617 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T15:44:33.664 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T15:44:33.664 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T15:44:33.762 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T15:44:33.777 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:44:33.810 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T15:44:33.861 INFO:teuthology.orchestra.run.smithi189.stdout: Preparing : 1/1 2024-09-13T15:44:33.874 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:44:34.005 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T15:44:34.043 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T15:44:34.105 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T15:44:34.139 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T15:44:34.173 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T15:44:34.224 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T15:44:34.241 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:44:34.280 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T15:44:34.325 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T15:44:34.409 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T15:44:34.449 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T15:44:34.482 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T15:44:34.533 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T15:44:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T15:44:34.582 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T15:44:34.616 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T15:44:34.628 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T15:44:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T15:44:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T15:44:34.714 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T15:44:34.725 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T15:44:34.740 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T15:44:34.767 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T15:44:34.817 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T15:44:34.857 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x 27/146 2024-09-13T15:44:34.858 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T15:44:34.891 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T15:44:34.902 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9 28/146 2024-09-13T15:44:34.950 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T15:44:34.981 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T15:44:34.982 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T15:44:34.991 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 29/146 2024-09-13T15:44:35.021 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 10/146 2024-09-13T15:44:35.059 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T15:44:35.164 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T15:44:35.167 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T15:44:35.234 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T15:44:35.234 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T15:44:35.263 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T15:44:35.364 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T15:44:35.389 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 14/146 2024-09-13T15:44:35.580 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 14/146 2024-09-13T15:44:35.685 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T15:44:35.702 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T15:44:35.803 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:44:35.829 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T15:44:35.878 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:44:35.908 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T15:44:36.019 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T15:44:36.088 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T15:44:36.135 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 35/146 2024-09-13T15:44:36.164 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T15:44:36.188 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T15:44:36.207 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T15:44:36.242 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T15:44:36.316 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T15:44:36.350 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T15:44:36.377 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T15:44:36.378 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T15:44:36.443 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T15:44:36.446 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T15:44:36.508 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T15:44:36.546 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T15:44:36.583 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T15:44:36.599 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T15:44:36.622 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T15:44:36.691 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T15:44:36.692 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T15:44:36.726 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x 27/146 2024-09-13T15:44:36.771 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9 28/146 2024-09-13T15:44:36.785 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T15:44:36.844 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 29/146 2024-09-13T15:44:36.877 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T15:44:36.979 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T15:44:37.042 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T15:44:37.051 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T15:44:37.130 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T15:44:37.158 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T15:44:37.191 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T15:44:37.337 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T15:44:37.396 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T15:44:37.447 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T15:44:37.493 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T15:44:37.497 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T15:44:37.546 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 84/146 2024-09-13T15:44:37.576 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T15:44:37.620 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 84/146 2024-09-13T15:44:37.650 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 85/146 2024-09-13T15:44:37.661 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T15:44:37.677 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T15:44:37.686 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T15:44:37.700 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T15:44:37.728 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T15:44:37.737 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 35/146 2024-09-13T15:44:37.772 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T15:44:37.778 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T15:44:37.902 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T15:44:37.928 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T15:44:37.945 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T15:44:37.979 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T15:44:37.987 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T15:44:38.046 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T15:44:38.090 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T15:44:38.093 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T15:44:38.094 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T15:44:38.123 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 88/146 2024-09-13T15:44:38.131 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T15:44:38.133 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T15:44:38.169 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T15:44:38.187 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T15:44:38.195 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 88/146 2024-09-13T15:44:38.209 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T15:44:38.225 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 89/146 2024-09-13T15:44:38.250 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T15:44:38.251 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T15:44:38.284 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T15:44:38.295 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T15:44:38.320 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T15:44:38.329 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T15:44:38.363 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T15:44:38.366 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T15:44:38.407 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T15:44:38.412 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T15:44:38.439 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T15:44:38.462 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T15:44:38.474 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T15:44:38.534 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T15:44:38.605 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T15:44:38.656 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T15:44:38.671 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T15:44:38.697 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T15:44:38.740 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T15:44:38.798 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T15:44:38.839 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T15:44:38.886 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T15:44:38.920 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T15:44:38.947 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T15:44:38.972 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T15:44:39.001 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T15:44:39.035 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T15:44:39.072 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T15:44:39.102 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T15:44:39.136 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T15:44:39.170 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T15:44:39.211 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T15:44:39.246 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T15:44:39.280 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T15:44:39.327 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T15:44:39.433 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T15:44:39.490 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T15:44:39.684 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T15:44:39.740 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T15:44:39.774 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T15:44:39.892 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T15:44:39.932 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T15:44:40.197 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T15:44:40.200 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T15:44:40.237 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T15:44:40.254 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T15:44:40.278 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:44:40.288 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T15:44:40.306 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:44:40.346 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T15:44:40.385 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T15:44:40.430 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T15:44:40.613 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T15:44:40.653 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T15:44:40.729 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T15:44:40.826 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:44:40.859 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 91/146 2024-09-13T15:44:40.963 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 91/146 2024-09-13T15:44:40.963 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T15:44:40.963 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T15:44:40.963 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-13T15:44:40.994 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 92/146 2024-09-13T15:44:41.190 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T15:44:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T15:44:41.363 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T15:44:41.490 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T15:44:42.712 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T15:44:42.789 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T15:44:42.816 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T15:44:42.850 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T15:44:43.007 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T15:44:43.102 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T15:44:43.147 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T15:44:43.149 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T15:44:43.180 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T15:44:43.198 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 84/146 2024-09-13T15:44:43.289 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 84/146 2024-09-13T15:44:43.319 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 85/146 2024-09-13T15:44:43.355 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T15:44:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T15:44:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 84/146 2024-09-13T15:44:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 84/146 2024-09-13T15:44:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 85/146 2024-09-13T15:44:43.758 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T15:44:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T15:44:43.793 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 88/146 2024-09-13T15:44:43.863 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 88/146 2024-09-13T15:44:43.886 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 89/146 2024-09-13T15:44:44.258 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T15:44:44.296 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 88/146 2024-09-13T15:44:44.387 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 88/146 2024-09-13T15:44:44.414 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 89/146 2024-09-13T15:44:45.913 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:44:45.957 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:44:46.477 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:44:46.510 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 91/146 2024-09-13T15:44:46.630 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 91/146 2024-09-13T15:44:46.630 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T15:44:46.630 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T15:44:46.630 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-13T15:44:46.661 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 92/146 2024-09-13T15:44:46.768 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:44:46.811 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:44:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 90/146 2024-09-13T15:44:47.510 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 91/146 2024-09-13T15:44:47.646 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 91/146 2024-09-13T15:44:47.646 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T15:44:47.646 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T15:44:47.646 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:44:47.691 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 92/146 2024-09-13T15:44:52.713 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 92/146 2024-09-13T15:44:52.713 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /sys 2024-09-13T15:44:52.713 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /proc 2024-09-13T15:44:52.713 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /mnt 2024-09-13T15:44:52.713 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /var/tmp 2024-09-13T15:44:52.713 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /home 2024-09-13T15:44:52.714 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /root 2024-09-13T15:44:52.714 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /tmp 2024-09-13T15:44:52.714 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-13T15:44:52.873 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 93/146 2024-09-13T15:44:52.889 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 93/146 2024-09-13T15:44:52.889 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:44:52.889 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T15:44:52.889 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-13T15:44:54.341 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 94/146 2024-09-13T15:44:54.369 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 94/146 2024-09-13T15:44:54.369 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:44:54.369 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T15:44:54.369 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T15:44:54.369 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T15:44:54.370 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-13T15:44:54.568 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 95/146 2024-09-13T15:44:54.592 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 95/146 2024-09-13T15:44:54.593 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:44:54.593 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T15:44:54.593 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T15:44:54.593 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T15:44:54.593 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-13T15:44:55.036 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 96/146 2024-09-13T15:44:55.060 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 96/146 2024-09-13T15:44:55.061 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:44:55.061 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T15:44:55.061 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T15:44:55.061 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T15:44:55.061 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-13T15:44:55.175 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T15:44:55.232 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T15:44:55.287 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T15:44:55.473 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T15:44:55.529 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T15:44:55.608 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T15:44:55.713 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T15:44:55.852 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T15:44:55.896 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T15:44:55.928 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T15:44:55.956 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T15:44:56.404 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 108/146 2024-09-13T15:44:56.430 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 108/146 2024-09-13T15:44:56.458 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el 109/146 2024-09-13T15:44:56.522 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.e 110/146 2024-09-13T15:44:56.552 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 111/146 2024-09-13T15:44:57.600 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 111/146 2024-09-13T15:44:57.629 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 112/146 2024-09-13T15:44:58.132 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 92/146 2024-09-13T15:44:58.132 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /sys 2024-09-13T15:44:58.132 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /proc 2024-09-13T15:44:58.132 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /mnt 2024-09-13T15:44:58.133 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /var/tmp 2024-09-13T15:44:58.133 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /home 2024-09-13T15:44:58.133 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /root 2024-09-13T15:44:58.133 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /tmp 2024-09-13T15:44:58.133 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-13T15:44:58.294 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 93/146 2024-09-13T15:44:58.310 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 93/146 2024-09-13T15:44:58.310 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:44:58.310 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T15:44:58.310 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-13T15:44:58.595 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 112/146 2024-09-13T15:44:58.630 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 113/146 2024-09-13T15:44:58.732 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 113/146 2024-09-13T15:44:58.895 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9 114/146 2024-09-13T15:44:58.924 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 115/146 2024-09-13T15:44:58.949 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 115/146 2024-09-13T15:44:58.949 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:44:58.949 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T15:44:58.950 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T15:44:58.950 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T15:44:58.950 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-13T15:44:59.000 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 116/146 2024-09-13T15:44:59.011 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 116/146 2024-09-13T15:44:59.106 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 117/146 2024-09-13T15:44:59.157 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 118/146 2024-09-13T15:44:59.738 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 94/146 2024-09-13T15:44:59.766 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 94/146 2024-09-13T15:44:59.766 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:44:59.766 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T15:44:59.766 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T15:44:59.766 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T15:44:59.766 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-13T15:44:59.874 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T15:44:59.911 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 120/146 2024-09-13T15:44:59.934 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 120/146 2024-09-13T15:44:59.935 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:44:59.935 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T15:44:59.935 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T15:44:59.935 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T15:44:59.935 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-13T15:44:59.972 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 95/146 2024-09-13T15:44:59.978 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 121/146 2024-09-13T15:44:59.996 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 95/146 2024-09-13T15:44:59.996 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:44:59.996 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T15:44:59.996 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T15:44:59.996 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T15:44:59.997 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-13T15:45:00.001 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 121/146 2024-09-13T15:45:00.001 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:45:00.001 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T15:45:00.001 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-13T15:45:00.045 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 122/146 2024-09-13T15:45:00.069 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 122/146 2024-09-13T15:45:00.069 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:45:00.069 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T15:45:00.069 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T15:45:00.070 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T15:45:00.070 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-13T15:45:00.362 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 123/146 2024-09-13T15:45:00.386 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 123/146 2024-09-13T15:45:00.386 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:45:00.387 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T15:45:00.387 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T15:45:00.387 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T15:45:00.387 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-13T15:45:00.450 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 96/146 2024-09-13T15:45:00.473 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 96/146 2024-09-13T15:45:00.474 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:45:00.474 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T15:45:00.474 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T15:45:00.474 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T15:45:00.474 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-13T15:45:00.579 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T15:45:00.628 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T15:45:00.683 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T15:45:00.830 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 92/146 2024-09-13T15:45:00.830 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /sys 2024-09-13T15:45:00.830 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /proc 2024-09-13T15:45:00.830 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /mnt 2024-09-13T15:45:00.830 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /var/tmp 2024-09-13T15:45:00.830 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /home 2024-09-13T15:45:00.830 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /root 2024-09-13T15:45:00.830 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /tmp 2024-09-13T15:45:00.831 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:45:00.869 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T15:45:00.934 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T15:45:01.012 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T15:45:01.036 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 93/146 2024-09-13T15:45:01.072 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 93/146 2024-09-13T15:45:01.072 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:45:01.072 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T15:45:01.072 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:45:01.101 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T15:45:01.240 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T15:45:01.283 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T15:45:01.315 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T15:45:01.343 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T15:45:01.782 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 108/146 2024-09-13T15:45:01.816 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 108/146 2024-09-13T15:45:01.845 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el 109/146 2024-09-13T15:45:01.909 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.e 110/146 2024-09-13T15:45:01.939 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 111/146 2024-09-13T15:45:02.697 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 94/146 2024-09-13T15:45:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 94/146 2024-09-13T15:45:02.756 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:45:02.756 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T15:45:02.756 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T15:45:02.756 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T15:45:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:45:02.979 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 111/146 2024-09-13T15:45:02.997 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 95/146 2024-09-13T15:45:03.016 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 112/146 2024-09-13T15:45:03.048 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 95/146 2024-09-13T15:45:03.048 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:45:03.049 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T15:45:03.049 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T15:45:03.049 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T15:45:03.049 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:45:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 96/146 2024-09-13T15:45:03.700 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 96/146 2024-09-13T15:45:03.700 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:45:03.700 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T15:45:03.700 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T15:45:03.700 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T15:45:03.700 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:45:03.833 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T15:45:03.894 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T15:45:03.967 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T15:45:03.983 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 112/146 2024-09-13T15:45:04.008 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 113/146 2024-09-13T15:45:04.042 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 124/146 2024-09-13T15:45:04.082 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 125/146 2024-09-13T15:45:04.110 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 113/146 2024-09-13T15:45:04.123 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 126/146 2024-09-13T15:45:04.155 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T15:45:04.203 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T15:45:04.272 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9 114/146 2024-09-13T15:45:04.278 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T15:45:04.301 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 115/146 2024-09-13T15:45:04.325 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 115/146 2024-09-13T15:45:04.325 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:45:04.325 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T15:45:04.325 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T15:45:04.325 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T15:45:04.326 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-13T15:45:04.331 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T15:45:04.366 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T15:45:04.369 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 116/146 2024-09-13T15:45:04.370 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T15:45:04.381 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 116/146 2024-09-13T15:45:04.401 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_6 130/146 2024-09-13T15:45:04.431 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T15:45:04.474 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 117/146 2024-09-13T15:45:04.477 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T15:45:04.494 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T15:45:04.533 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 118/146 2024-09-13T15:45:04.662 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T15:45:04.719 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T15:45:04.758 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T15:45:04.784 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T15:45:05.093 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T15:45:05.134 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T15:45:05.155 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T15:45:05.252 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T15:45:05.275 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 108/146 2024-09-13T15:45:05.288 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 120/146 2024-09-13T15:45:05.308 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 108/146 2024-09-13T15:45:05.311 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 120/146 2024-09-13T15:45:05.312 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:45:05.312 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T15:45:05.312 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T15:45:05.312 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T15:45:05.312 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-13T15:45:05.346 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el 109/146 2024-09-13T15:45:05.355 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 121/146 2024-09-13T15:45:05.378 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 121/146 2024-09-13T15:45:05.379 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:45:05.379 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T15:45:05.379 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-13T15:45:05.418 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.e 110/146 2024-09-13T15:45:05.431 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 122/146 2024-09-13T15:45:05.454 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 122/146 2024-09-13T15:45:05.454 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:45:05.455 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T15:45:05.455 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T15:45:05.455 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T15:45:05.455 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-13T15:45:05.455 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 111/146 2024-09-13T15:45:05.748 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 123/146 2024-09-13T15:45:05.772 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 123/146 2024-09-13T15:45:05.772 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:45:05.772 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T15:45:05.772 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T15:45:05.772 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T15:45:05.772 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-13T15:45:05.991 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 134/146 2024-09-13T15:45:06.073 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T15:45:06.106 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T15:45:06.188 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T15:45:06.226 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T15:45:06.252 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T15:45:06.278 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T15:45:06.278 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T15:45:06.362 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T15:45:06.362 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T15:45:06.446 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T15:45:06.471 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T15:45:06.477 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T15:45:06.477 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T15:45:06.665 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T15:45:06.665 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T15:45:06.744 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 111/146 2024-09-13T15:45:06.749 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T15:45:06.782 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 112/146 2024-09-13T15:45:06.812 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T15:45:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 112/146 2024-09-13T15:45:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 113/146 2024-09-13T15:45:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 113/146 2024-09-13T15:45:08.283 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9 114/146 2024-09-13T15:45:08.310 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 115/146 2024-09-13T15:45:08.363 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 115/146 2024-09-13T15:45:08.363 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:45:08.363 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T15:45:08.363 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T15:45:08.363 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T15:45:08.363 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:45:08.419 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 116/146 2024-09-13T15:45:08.445 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 116/146 2024-09-13T15:45:08.564 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 117/146 2024-09-13T15:45:08.641 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 118/146 2024-09-13T15:45:09.418 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 124/146 2024-09-13T15:45:09.460 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 125/146 2024-09-13T15:45:09.481 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T15:45:09.508 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 126/146 2024-09-13T15:45:09.513 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 120/146 2024-09-13T15:45:09.550 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T15:45:09.565 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 120/146 2024-09-13T15:45:09.565 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:45:09.565 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T15:45:09.566 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T15:45:09.566 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T15:45:09.566 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:45:09.614 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 121/146 2024-09-13T15:45:09.664 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 121/146 2024-09-13T15:45:09.664 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:45:09.664 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T15:45:09.664 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:45:09.723 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 122/146 2024-09-13T15:45:09.741 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T15:45:09.774 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 122/146 2024-09-13T15:45:09.774 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:45:09.774 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T15:45:09.774 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T15:45:09.774 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T15:45:09.774 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:45:09.780 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T15:45:09.811 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_6 130/146 2024-09-13T15:45:09.842 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T15:45:09.890 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T15:45:10.124 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 123/146 2024-09-13T15:45:10.176 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 123/146 2024-09-13T15:45:10.176 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T15:45:10.176 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T15:45:10.176 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T15:45:10.176 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T15:45:10.176 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:45:10.524 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T15:45:10.570 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T15:45:10.590 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T15:45:11.444 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 134/146 2024-09-13T15:45:11.524 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T15:45:11.565 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T15:45:11.649 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T15:45:11.694 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T15:45:11.728 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T15:45:11.754 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T15:45:11.754 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T15:45:11.838 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T15:45:11.838 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T15:45:11.922 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T15:45:11.946 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T15:45:11.952 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T15:45:11.952 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T15:45:12.019 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T15:45:12.019 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 1/146 2024-09-13T15:45:12.019 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 2/146 2024-09-13T15:45:12.020 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 3/146 2024-09-13T15:45:12.020 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 4/146 2024-09-13T15:45:12.020 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 5/146 2024-09-13T15:45:12.020 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 6/146 2024-09-13T15:45:12.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 7/146 2024-09-13T15:45:12.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T15:45:12.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T15:45:12.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 10/146 2024-09-13T15:45:12.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 11/146 2024-09-13T15:45:12.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 12/146 2024-09-13T15:45:12.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T15:45:12.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_6 14/146 2024-09-13T15:45:12.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 15/146 2024-09-13T15:45:12.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 16/146 2024-09-13T15:45:12.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 17/146 2024-09-13T15:45:12.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 18/146 2024-09-13T15:45:12.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 19/146 2024-09-13T15:45:12.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9 20/146 2024-09-13T15:45:12.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x 21/146 2024-09-13T15:45:12.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 22/146 2024-09-13T15:45:12.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 23/146 2024-09-13T15:45:12.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 24/146 2024-09-13T15:45:12.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 25/146 2024-09-13T15:45:12.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 26/146 2024-09-13T15:45:12.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 27/146 2024-09-13T15:45:12.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 28/146 2024-09-13T15:45:12.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.e 29/146 2024-09-13T15:45:12.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 30/146 2024-09-13T15:45:12.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 31/146 2024-09-13T15:45:12.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 32/146 2024-09-13T15:45:12.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9 33/146 2024-09-13T15:45:12.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 34/146 2024-09-13T15:45:12.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el 35/146 2024-09-13T15:45:12.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 36/146 2024-09-13T15:45:12.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 37/146 2024-09-13T15:45:12.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 38/146 2024-09-13T15:45:12.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T15:45:12.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T15:45:12.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T15:45:12.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T15:45:12.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T15:45:12.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T15:45:12.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T15:45:12.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T15:45:12.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T15:45:12.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T15:45:12.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T15:45:12.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T15:45:12.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T15:45:12.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T15:45:12.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T15:45:12.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T15:45:12.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T15:45:12.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T15:45:12.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T15:45:12.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T15:45:12.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T15:45:12.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T15:45:12.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T15:45:12.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T15:45:12.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T15:45:12.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T15:45:12.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T15:45:12.025 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T15:45:12.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T15:45:12.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T15:45:12.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T15:45:12.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T15:45:12.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T15:45:12.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T15:45:12.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T15:45:12.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T15:45:12.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T15:45:12.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T15:45:12.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T15:45:12.026 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T15:45:12.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T15:45:12.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T15:45:12.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T15:45:12.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T15:45:12.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T15:45:12.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T15:45:12.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T15:45:12.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T15:45:12.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T15:45:12.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T15:45:12.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T15:45:12.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T15:45:12.027 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T15:45:12.028 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T15:45:12.028 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T15:45:12.028 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T15:45:12.028 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T15:45:12.028 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T15:45:12.028 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T15:45:12.028 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T15:45:12.028 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T15:45:12.028 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T15:45:12.028 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T15:45:12.028 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T15:45:12.029 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T15:45:12.029 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T15:45:12.029 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T15:45:12.029 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T15:45:12.029 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T15:45:12.029 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T15:45:12.029 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T15:45:12.029 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T15:45:12.029 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T15:45:12.029 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T15:45:12.029 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T15:45:12.029 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T15:45:12.030 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T15:45:12.030 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T15:45:12.030 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T15:45:12.030 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T15:45:12.030 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T15:45:12.030 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T15:45:12.030 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T15:45:12.030 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T15:45:12.030 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T15:45:12.030 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T15:45:12.031 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T15:45:12.031 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T15:45:12.031 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T15:45:12.031 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T15:45:12.031 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T15:45:12.031 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T15:45:12.031 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 131/146 2024-09-13T15:45:12.031 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T15:45:12.031 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 133/146 2024-09-13T15:45:12.031 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T15:45:12.031 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T15:45:12.031 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T15:45:12.031 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T15:45:12.032 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T15:45:12.032 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T15:45:12.032 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T15:45:12.032 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T15:45:12.032 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T15:45:12.032 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T15:45:12.032 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T15:45:12.032 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T15:45:12.132 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T15:45:12.132 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T15:45:12.199 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T15:45:12.271 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T15:45:14.380 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 124/146 2024-09-13T15:45:14.430 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 125/146 2024-09-13T15:45:14.481 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 126/146 2024-09-13T15:45:14.518 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T15:45:14.569 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T15:45:14.569 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-13T15:45:14.569 INFO:teuthology.orchestra.run.smithi193.stdout:Upgraded: 2024-09-13T15:45:14.569 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T15:45:14.569 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T15:45:14.570 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T15:45:14.570 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T15:45:14.570 INFO:teuthology.orchestra.run.smithi193.stdout: librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.570 INFO:teuthology.orchestra.run.smithi193.stdout: librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.570 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T15:45:14.570 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T15:45:14.570 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-09-13T15:45:14.570 INFO:teuthology.orchestra.run.smithi193.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T15:45:14.570 INFO:teuthology.orchestra.run.smithi193.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T15:45:14.570 INFO:teuthology.orchestra.run.smithi193.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T15:45:14.570 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.570 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.570 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.571 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.571 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:14.571 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-immutable-object-cache-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.571 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.571 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.571 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:14.571 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:14.571 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-diskprediction-local-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:14.571 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:14.571 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:14.571 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.571 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.571 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:14.572 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.572 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.572 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.572 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:14.572 INFO:teuthology.orchestra.run.smithi193.stdout: cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:14.572 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.572 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:14.572 INFO:teuthology.orchestra.run.smithi193.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T15:45:14.572 INFO:teuthology.orchestra.run.smithi193.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T15:45:14.572 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T15:45:14.572 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T15:45:14.572 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T15:45:14.572 INFO:teuthology.orchestra.run.smithi193.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T15:45:14.573 INFO:teuthology.orchestra.run.smithi193.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T15:45:14.573 INFO:teuthology.orchestra.run.smithi193.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T15:45:14.573 INFO:teuthology.orchestra.run.smithi193.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T15:45:14.573 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T15:45:14.573 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T15:45:14.573 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.573 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.573 INFO:teuthology.orchestra.run.smithi193.stdout: libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.573 INFO:teuthology.orchestra.run.smithi193.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T15:45:14.573 INFO:teuthology.orchestra.run.smithi193.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T15:45:14.573 INFO:teuthology.orchestra.run.smithi193.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T15:45:14.573 INFO:teuthology.orchestra.run.smithi193.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T15:45:14.573 INFO:teuthology.orchestra.run.smithi193.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T15:45:14.574 INFO:teuthology.orchestra.run.smithi193.stdout: librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.574 INFO:teuthology.orchestra.run.smithi193.stdout: libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.574 INFO:teuthology.orchestra.run.smithi193.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T15:45:14.574 INFO:teuthology.orchestra.run.smithi193.stdout: librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.574 INFO:teuthology.orchestra.run.smithi193.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T15:45:14.574 INFO:teuthology.orchestra.run.smithi193.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T15:45:14.574 INFO:teuthology.orchestra.run.smithi193.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T15:45:14.574 INFO:teuthology.orchestra.run.smithi193.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T15:45:14.574 INFO:teuthology.orchestra.run.smithi193.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T15:45:14.574 INFO:teuthology.orchestra.run.smithi193.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T15:45:14.574 INFO:teuthology.orchestra.run.smithi193.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T15:45:14.574 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T15:45:14.575 INFO:teuthology.orchestra.run.smithi193.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T15:45:14.575 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T15:45:14.575 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T15:45:14.575 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T15:45:14.575 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T15:45:14.575 INFO:teuthology.orchestra.run.smithi193.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T15:45:14.575 INFO:teuthology.orchestra.run.smithi193.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T15:45:14.575 INFO:teuthology.orchestra.run.smithi193.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T15:45:14.575 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T15:45:14.575 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.575 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.576 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.576 INFO:teuthology.orchestra.run.smithi193.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T15:45:14.576 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T15:45:14.576 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T15:45:14.576 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T15:45:14.576 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T15:45:14.576 INFO:teuthology.orchestra.run.smithi193.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T15:45:14.576 INFO:teuthology.orchestra.run.smithi193.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T15:45:14.576 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T15:45:14.576 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T15:45:14.576 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T15:45:14.576 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T15:45:14.576 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T15:45:14.577 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T15:45:14.577 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T15:45:14.577 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T15:45:14.577 INFO:teuthology.orchestra.run.smithi193.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T15:45:14.577 INFO:teuthology.orchestra.run.smithi193.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T15:45:14.577 INFO:teuthology.orchestra.run.smithi193.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T15:45:14.578 INFO:teuthology.orchestra.run.smithi193.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T15:45:14.578 INFO:teuthology.orchestra.run.smithi193.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T15:45:14.578 INFO:teuthology.orchestra.run.smithi193.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T15:45:14.578 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T15:45:14.578 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T15:45:14.578 INFO:teuthology.orchestra.run.smithi193.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T15:45:14.578 INFO:teuthology.orchestra.run.smithi193.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T15:45:14.578 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T15:45:14.578 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T15:45:14.578 INFO:teuthology.orchestra.run.smithi193.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T15:45:14.578 INFO:teuthology.orchestra.run.smithi193.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T15:45:14.578 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T15:45:14.578 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T15:45:14.579 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T15:45:14.579 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T15:45:14.579 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T15:45:14.579 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.579 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.579 INFO:teuthology.orchestra.run.smithi193.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T15:45:14.579 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T15:45:14.579 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T15:45:14.579 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.579 INFO:teuthology.orchestra.run.smithi193.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T15:45:14.579 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T15:45:14.580 INFO:teuthology.orchestra.run.smithi193.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T15:45:14.580 INFO:teuthology.orchestra.run.smithi193.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T15:45:14.580 INFO:teuthology.orchestra.run.smithi193.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T15:45:14.580 INFO:teuthology.orchestra.run.smithi193.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T15:45:14.580 INFO:teuthology.orchestra.run.smithi193.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T15:45:14.580 INFO:teuthology.orchestra.run.smithi193.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T15:45:14.580 INFO:teuthology.orchestra.run.smithi193.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T15:45:14.580 INFO:teuthology.orchestra.run.smithi193.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T15:45:14.580 INFO:teuthology.orchestra.run.smithi193.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T15:45:14.580 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.580 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.581 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:14.581 INFO:teuthology.orchestra.run.smithi193.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T15:45:14.581 INFO:teuthology.orchestra.run.smithi193.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T15:45:14.581 INFO:teuthology.orchestra.run.smithi193.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T15:45:14.581 INFO:teuthology.orchestra.run.smithi193.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T15:45:14.581 INFO:teuthology.orchestra.run.smithi193.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T15:45:14.581 INFO:teuthology.orchestra.run.smithi193.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T15:45:14.582 INFO:teuthology.orchestra.run.smithi193.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T15:45:14.582 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-13T15:45:14.582 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-13T15:45:14.776 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T15:45:14.825 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T15:45:14.855 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_6 130/146 2024-09-13T15:45:14.887 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T15:45:14.932 DEBUG:teuthology.parallel:result is None 2024-09-13T15:45:14.938 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T15:45:15.679 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T15:45:15.749 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T15:45:15.791 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T15:45:17.182 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 134/146 2024-09-13T15:45:17.284 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T15:45:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T15:45:17.461 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T15:45:17.495 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T15:45:17.531 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T15:45:17.531 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 1/146 2024-09-13T15:45:17.531 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 2/146 2024-09-13T15:45:17.531 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 3/146 2024-09-13T15:45:17.531 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 4/146 2024-09-13T15:45:17.531 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 5/146 2024-09-13T15:45:17.531 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 6/146 2024-09-13T15:45:17.531 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 7/146 2024-09-13T15:45:17.531 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T15:45:17.532 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T15:45:17.532 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 10/146 2024-09-13T15:45:17.532 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 11/146 2024-09-13T15:45:17.532 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 12/146 2024-09-13T15:45:17.532 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T15:45:17.532 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_6 14/146 2024-09-13T15:45:17.532 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 15/146 2024-09-13T15:45:17.532 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 16/146 2024-09-13T15:45:17.532 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 17/146 2024-09-13T15:45:17.532 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 18/146 2024-09-13T15:45:17.532 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 19/146 2024-09-13T15:45:17.532 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9 20/146 2024-09-13T15:45:17.533 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x 21/146 2024-09-13T15:45:17.533 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 22/146 2024-09-13T15:45:17.533 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 23/146 2024-09-13T15:45:17.533 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 24/146 2024-09-13T15:45:17.533 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 25/146 2024-09-13T15:45:17.533 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 26/146 2024-09-13T15:45:17.533 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 27/146 2024-09-13T15:45:17.533 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 28/146 2024-09-13T15:45:17.533 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.e 29/146 2024-09-13T15:45:17.534 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T15:45:17.544 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 30/146 2024-09-13T15:45:17.545 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 31/146 2024-09-13T15:45:17.545 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 32/146 2024-09-13T15:45:17.545 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9 33/146 2024-09-13T15:45:17.545 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 34/146 2024-09-13T15:45:17.545 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el 35/146 2024-09-13T15:45:17.545 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 36/146 2024-09-13T15:45:17.545 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 37/146 2024-09-13T15:45:17.545 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 38/146 2024-09-13T15:45:17.545 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T15:45:17.545 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T15:45:17.545 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T15:45:17.545 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T15:45:17.546 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T15:45:17.546 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T15:45:17.546 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T15:45:17.546 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T15:45:17.546 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T15:45:17.546 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T15:45:17.546 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T15:45:17.546 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T15:45:17.546 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T15:45:17.546 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T15:45:17.547 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T15:45:17.547 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T15:45:17.547 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T15:45:17.547 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T15:45:17.547 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T15:45:17.547 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T15:45:17.547 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T15:45:17.547 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T15:45:17.547 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T15:45:17.547 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T15:45:17.547 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T15:45:17.547 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T15:45:17.547 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T15:45:17.548 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T15:45:17.548 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T15:45:17.548 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T15:45:17.548 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T15:45:17.548 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T15:45:17.548 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T15:45:17.548 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T15:45:17.548 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T15:45:17.548 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T15:45:17.548 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T15:45:17.548 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T15:45:17.548 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T15:45:17.549 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T15:45:17.549 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T15:45:17.549 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T15:45:17.549 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T15:45:17.549 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T15:45:17.549 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T15:45:17.549 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T15:45:17.549 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T15:45:17.549 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T15:45:17.549 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T15:45:17.549 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T15:45:17.549 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T15:45:17.549 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T15:45:17.550 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T15:45:17.550 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T15:45:17.550 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T15:45:17.550 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T15:45:17.550 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T15:45:17.550 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T15:45:17.550 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T15:45:17.550 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T15:45:17.550 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T15:45:17.550 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T15:45:17.550 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T15:45:17.550 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T15:45:17.550 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T15:45:17.550 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T15:45:17.551 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T15:45:17.551 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T15:45:17.551 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T15:45:17.551 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T15:45:17.551 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T15:45:17.551 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T15:45:17.551 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T15:45:17.551 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T15:45:17.551 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T15:45:17.551 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T15:45:17.551 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T15:45:17.551 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T15:45:17.551 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T15:45:17.552 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T15:45:17.552 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T15:45:17.552 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T15:45:17.552 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T15:45:17.552 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T15:45:17.552 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T15:45:17.552 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T15:45:17.552 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T15:45:17.552 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T15:45:17.552 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T15:45:17.552 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T15:45:17.552 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T15:45:17.552 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T15:45:17.553 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 131/146 2024-09-13T15:45:17.553 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T15:45:17.553 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 133/146 2024-09-13T15:45:17.553 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T15:45:17.553 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T15:45:17.553 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T15:45:17.553 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T15:45:17.553 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T15:45:17.553 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T15:45:17.553 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T15:45:17.553 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T15:45:17.553 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T15:45:17.553 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T15:45:17.554 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T15:45:17.554 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T15:45:17.573 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T15:45:17.574 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T15:45:17.698 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T15:45:17.698 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T15:45:17.807 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T15:45:17.831 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T15:45:17.847 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T15:45:17.848 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T15:45:18.092 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T15:45:18.092 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T15:45:18.202 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T15:45:18.286 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T15:45:18.487 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T15:45:18.487 INFO:teuthology.orchestra.run.smithi017.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-13T15:45:18.487 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:45:20.175 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T15:45:20.175 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-13T15:45:20.176 INFO:teuthology.orchestra.run.smithi189.stdout:Upgraded: 2024-09-13T15:45:20.176 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T15:45:20.176 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T15:45:20.176 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T15:45:20.176 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T15:45:20.176 INFO:teuthology.orchestra.run.smithi189.stdout: librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.176 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.176 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T15:45:20.176 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T15:45:20.176 INFO:teuthology.orchestra.run.smithi189.stdout:Installed: 2024-09-13T15:45:20.177 INFO:teuthology.orchestra.run.smithi189.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T15:45:20.177 INFO:teuthology.orchestra.run.smithi189.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T15:45:20.177 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T15:45:20.177 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.177 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.177 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.177 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.177 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:20.177 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.177 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.178 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.178 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:20.178 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:20.178 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:20.178 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:20.178 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:20.178 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.178 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.179 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:20.179 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.179 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.179 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.179 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:20.179 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:20.179 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.179 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:20.179 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T15:45:20.180 INFO:teuthology.orchestra.run.smithi189.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T15:45:20.180 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T15:45:20.180 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T15:45:20.180 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T15:45:20.180 INFO:teuthology.orchestra.run.smithi189.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T15:45:20.180 INFO:teuthology.orchestra.run.smithi189.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T15:45:20.180 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T15:45:20.180 INFO:teuthology.orchestra.run.smithi189.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T15:45:20.181 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T15:45:20.181 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T15:45:20.181 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.181 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.181 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.181 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T15:45:20.181 INFO:teuthology.orchestra.run.smithi189.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T15:45:20.181 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T15:45:20.181 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T15:45:20.181 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T15:45:20.182 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.182 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.182 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T15:45:20.182 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.182 INFO:teuthology.orchestra.run.smithi189.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T15:45:20.182 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T15:45:20.182 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T15:45:20.182 INFO:teuthology.orchestra.run.smithi189.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T15:45:20.182 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T15:45:20.182 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T15:45:20.182 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T15:45:20.182 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T15:45:20.182 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T15:45:20.182 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T15:45:20.183 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T15:45:20.183 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T15:45:20.183 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T15:45:20.183 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T15:45:20.183 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T15:45:20.183 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T15:45:20.183 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T15:45:20.183 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.183 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.183 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.183 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T15:45:20.183 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T15:45:20.183 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T15:45:20.184 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T15:45:20.184 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T15:45:20.184 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T15:45:20.184 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T15:45:20.184 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T15:45:20.184 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T15:45:20.184 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T15:45:20.184 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T15:45:20.184 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T15:45:20.184 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T15:45:20.184 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T15:45:20.184 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T15:45:20.185 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T15:45:20.185 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T15:45:20.185 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T15:45:20.185 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T15:45:20.185 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T15:45:20.185 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T15:45:20.185 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T15:45:20.185 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T15:45:20.185 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T15:45:20.185 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T15:45:20.185 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T15:45:20.185 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T15:45:20.186 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T15:45:20.186 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T15:45:20.186 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T15:45:20.186 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T15:45:20.186 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T15:45:20.186 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T15:45:20.186 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T15:45:20.186 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.186 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.186 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T15:45:20.186 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T15:45:20.186 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T15:45:20.187 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.187 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T15:45:20.187 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T15:45:20.187 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T15:45:20.187 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T15:45:20.187 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T15:45:20.187 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T15:45:20.187 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T15:45:20.187 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T15:45:20.187 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T15:45:20.187 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T15:45:20.188 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T15:45:20.188 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.188 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.188 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:20.188 INFO:teuthology.orchestra.run.smithi189.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T15:45:20.188 INFO:teuthology.orchestra.run.smithi189.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T15:45:20.188 INFO:teuthology.orchestra.run.smithi189.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T15:45:20.188 INFO:teuthology.orchestra.run.smithi189.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T15:45:20.188 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T15:45:20.188 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T15:45:20.189 INFO:teuthology.orchestra.run.smithi189.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T15:45:20.189 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-13T15:45:20.189 INFO:teuthology.orchestra.run.smithi189.stdout:Complete! 2024-09-13T15:45:20.577 DEBUG:teuthology.parallel:result is None 2024-09-13T15:45:23.700 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 1/146 2024-09-13T15:45:23.701 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 2/146 2024-09-13T15:45:23.701 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 3/146 2024-09-13T15:45:23.701 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 4/146 2024-09-13T15:45:23.701 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-850.g50bbe7 5/146 2024-09-13T15:45:23.701 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 6/146 2024-09-13T15:45:23.701 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 7/146 2024-09-13T15:45:23.701 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 8/146 2024-09-13T15:45:23.701 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 9/146 2024-09-13T15:45:23.701 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 10/146 2024-09-13T15:45:23.701 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 11/146 2024-09-13T15:45:23.701 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 12/146 2024-09-13T15:45:23.701 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 13/146 2024-09-13T15:45:23.701 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_6 14/146 2024-09-13T15:45:23.702 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 15/146 2024-09-13T15:45:23.702 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 16/146 2024-09-13T15:45:23.702 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 17/146 2024-09-13T15:45:23.702 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_ 18/146 2024-09-13T15:45:23.702 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 19/146 2024-09-13T15:45:23.702 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9 20/146 2024-09-13T15:45:23.702 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x 21/146 2024-09-13T15:45:23.702 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 22/146 2024-09-13T15:45:23.702 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 23/146 2024-09-13T15:45:23.702 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 24/146 2024-09-13T15:45:23.702 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 25/146 2024-09-13T15:45:23.702 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 26/146 2024-09-13T15:45:23.702 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 27/146 2024-09-13T15:45:23.713 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 28/146 2024-09-13T15:45:23.713 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.e 29/146 2024-09-13T15:45:23.713 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noar 30/146 2024-09-13T15:45:23.713 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.no 31/146 2024-09-13T15:45:23.713 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-850.g50bb 32/146 2024-09-13T15:45:23.713 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9 33/146 2024-09-13T15:45:23.713 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 34/146 2024-09-13T15:45:23.713 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el 35/146 2024-09-13T15:45:23.714 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 36/146 2024-09-13T15:45:23.714 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 37/146 2024-09-13T15:45:23.714 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 38/146 2024-09-13T15:45:23.714 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T15:45:23.714 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T15:45:23.714 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T15:45:23.714 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T15:45:23.714 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T15:45:23.714 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T15:45:23.714 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T15:45:23.714 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T15:45:23.714 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T15:45:23.714 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T15:45:23.715 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T15:45:23.715 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T15:45:23.715 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T15:45:23.715 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T15:45:23.715 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T15:45:23.715 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T15:45:23.715 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T15:45:23.715 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T15:45:23.715 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T15:45:23.715 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T15:45:23.715 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T15:45:23.715 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T15:45:23.715 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T15:45:23.715 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T15:45:23.716 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T15:45:23.716 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T15:45:23.716 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T15:45:23.716 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T15:45:23.716 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T15:45:23.716 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T15:45:23.716 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T15:45:23.716 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T15:45:23.716 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T15:45:23.716 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T15:45:23.716 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T15:45:23.716 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T15:45:23.716 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T15:45:23.717 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T15:45:23.717 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T15:45:23.717 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T15:45:23.717 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T15:45:23.717 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T15:45:23.717 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T15:45:23.717 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T15:45:23.717 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T15:45:23.717 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T15:45:23.717 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T15:45:23.717 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T15:45:23.717 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T15:45:23.717 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T15:45:23.718 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T15:45:23.718 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T15:45:23.718 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T15:45:23.718 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T15:45:23.718 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T15:45:23.718 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T15:45:23.718 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T15:45:23.718 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T15:45:23.718 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T15:45:23.718 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T15:45:23.718 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T15:45:23.718 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T15:45:23.718 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T15:45:23.718 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T15:45:23.719 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T15:45:23.719 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T15:45:23.719 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T15:45:23.719 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T15:45:23.719 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T15:45:23.719 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T15:45:23.719 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T15:45:23.719 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T15:45:23.719 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T15:45:23.719 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T15:45:23.719 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T15:45:23.719 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T15:45:23.719 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T15:45:23.719 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T15:45:23.720 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T15:45:23.720 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T15:45:23.720 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T15:45:23.720 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T15:45:23.720 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T15:45:23.720 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T15:45:23.720 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T15:45:23.720 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T15:45:23.720 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T15:45:23.720 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T15:45:23.720 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T15:45:23.720 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T15:45:23.720 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T15:45:23.721 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T15:45:23.721 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 131/146 2024-09-13T15:45:23.721 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T15:45:23.721 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 133/146 2024-09-13T15:45:23.721 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T15:45:23.721 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T15:45:23.721 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T15:45:23.721 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T15:45:23.721 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T15:45:23.721 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T15:45:23.721 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T15:45:23.721 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T15:45:23.721 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T15:45:23.721 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T15:45:23.722 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T15:45:23.722 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T15:45:25.819 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T15:45:25.820 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:45:25.820 INFO:teuthology.orchestra.run.smithi017.stdout:Upgraded: 2024-09-13T15:45:25.820 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T15:45:25.821 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T15:45:25.821 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T15:45:25.821 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T15:45:25.821 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.821 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.822 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T15:45:25.822 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T15:45:25.822 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-13T15:45:25.822 INFO:teuthology.orchestra.run.smithi017.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T15:45:25.822 INFO:teuthology.orchestra.run.smithi017.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T15:45:25.822 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T15:45:25.823 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.823 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.823 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.824 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.824 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:25.824 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.824 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.825 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.825 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:25.825 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:25.825 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:25.826 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:25.826 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:25.826 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.826 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.826 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:25.827 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.827 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.827 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.827 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:25.828 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:25.828 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.829 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top-2:18.2.4-850.g50bbe7f3.el9.noarch 2024-09-13T15:45:25.829 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T15:45:25.829 INFO:teuthology.orchestra.run.smithi017.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T15:45:25.829 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T15:45:25.829 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T15:45:25.830 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T15:45:25.830 INFO:teuthology.orchestra.run.smithi017.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T15:45:25.830 INFO:teuthology.orchestra.run.smithi017.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T15:45:25.830 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T15:45:25.831 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T15:45:25.831 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T15:45:25.831 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T15:45:25.831 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.832 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.832 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.832 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T15:45:25.832 INFO:teuthology.orchestra.run.smithi017.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T15:45:25.833 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T15:45:25.833 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T15:45:25.833 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T15:45:25.836 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.836 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.836 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T15:45:25.836 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.836 INFO:teuthology.orchestra.run.smithi017.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T15:45:25.836 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T15:45:25.836 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T15:45:25.836 INFO:teuthology.orchestra.run.smithi017.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T15:45:25.837 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T15:45:25.837 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T15:45:25.837 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T15:45:25.837 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T15:45:25.837 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T15:45:25.837 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T15:45:25.837 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T15:45:25.838 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T15:45:25.838 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T15:45:25.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T15:45:25.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T15:45:25.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T15:45:25.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T15:45:25.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T15:45:25.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T15:45:25.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T15:45:25.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T15:45:25.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T15:45:25.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T15:45:25.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T15:45:25.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T15:45:25.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T15:45:25.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T15:45:25.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T15:45:25.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T15:45:25.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T15:45:25.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T15:45:25.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T15:45:25.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T15:45:25.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T15:45:25.840 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T15:45:25.840 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T15:45:25.840 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T15:45:25.840 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T15:45:25.840 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T15:45:25.840 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T15:45:25.840 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T15:45:25.840 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T15:45:25.840 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T15:45:25.840 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T15:45:25.840 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T15:45:25.840 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T15:45:25.840 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T15:45:25.841 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T15:45:25.841 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T15:45:25.841 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T15:45:25.841 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T15:45:25.841 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.841 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.841 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T15:45:25.841 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T15:45:25.841 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T15:45:25.841 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.841 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T15:45:25.841 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T15:45:25.841 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T15:45:25.841 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T15:45:25.842 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T15:45:25.842 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T15:45:25.842 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T15:45:25.842 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T15:45:25.842 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T15:45:25.842 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T15:45:25.842 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T15:45:25.842 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.842 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.842 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-2:18.2.4-850.g50bbe7f3.el9.x86_64 2024-09-13T15:45:25.842 INFO:teuthology.orchestra.run.smithi017.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T15:45:25.842 INFO:teuthology.orchestra.run.smithi017.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T15:45:25.842 INFO:teuthology.orchestra.run.smithi017.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T15:45:25.842 INFO:teuthology.orchestra.run.smithi017.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T15:45:25.843 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T15:45:25.843 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T15:45:25.843 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T15:45:25.843 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:45:25.843 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T15:45:26.386 DEBUG:teuthology.parallel:result is None 2024-09-13T15:45:26.386 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:45:26.536 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T15:45:26.582 INFO:teuthology.orchestra.run.smithi017.stdout:18.2.4-850.g50bbe7f3.el9 2024-09-13T15:45:26.583 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-850.g50bbe7f3.el9 2024-09-13T15:45:26.583 INFO:teuthology.task.install:The correct ceph version 18.2.4-850.g50bbe7f3 is installed. 2024-09-13T15:45:26.585 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:45:26.728 DEBUG:teuthology.orchestra.run.smithi189:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T15:45:26.755 INFO:teuthology.orchestra.run.smithi189.stdout:18.2.4-850.g50bbe7f3.el9 2024-09-13T15:45:26.755 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-850.g50bbe7f3.el9 2024-09-13T15:45:26.755 INFO:teuthology.task.install:The correct ceph version 18.2.4-850.g50bbe7f3 is installed. 2024-09-13T15:45:26.757 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:45:26.906 DEBUG:teuthology.orchestra.run.smithi193:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T15:45:26.932 INFO:teuthology.orchestra.run.smithi193.stdout:18.2.4-850.g50bbe7f3.el9 2024-09-13T15:45:26.932 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-850.g50bbe7f3.el9 2024-09-13T15:45:26.933 INFO:teuthology.task.install:The correct ceph version 18.2.4-850.g50bbe7f3 is installed. 2024-09-13T15:45:26.934 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T15:45:26.935 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T15:45:26.935 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T15:45:26.994 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-13T15:45:26.995 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T15:45:27.027 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-13T15:45:27.027 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T15:45:27.061 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T15:45:27.062 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T15:45:27.062 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T15:45:27.120 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T15:45:27.220 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-13T15:45:27.220 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T15:45:27.250 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T15:45:27.319 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-13T15:45:27.319 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T15:45:27.349 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T15:45:27.417 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T15:45:27.418 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T15:45:27.418 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T15:45:27.475 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T15:45:27.578 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-13T15:45:27.578 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T15:45:27.608 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T15:45:27.677 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-13T15:45:27.677 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T15:45:27.707 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T15:45:27.776 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T15:45:27.777 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T15:45:27.777 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T15:45:27.834 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T15:45:27.934 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-13T15:45:27.935 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T15:45:27.965 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T15:45:28.034 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-13T15:45:28.035 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T15:45:28.064 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T15:45:28.132 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-13T15:45:28.224 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'subvols': {'create': 2}} 2024-09-13T15:45:28.224 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:45:28.224 INFO:tasks.cephadm:Cluster fsid is 3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T15:45:28.225 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-13T15:45:28.225 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.17', 'mon.b': '172.21.15.189', 'mon.c': '172.21.15.193'} 2024-09-13T15:45:28.225 INFO:tasks.cephadm:First mon is mon.a on smithi017 2024-09-13T15:45:28.225 INFO:tasks.cephadm:First mgr is x 2024-09-13T15:45:28.225 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-13T15:45:28.225 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname $(hostname -s) 2024-09-13T15:45:28.285 DEBUG:teuthology.orchestra.run.smithi189:> sudo hostname $(hostname -s) 2024-09-13T15:45:28.316 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname $(hostname -s) 2024-09-13T15:45:28.346 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-13T15:45:28.347 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:45:28.503 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82946/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.4-850-g50bbe7f3', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.4-850.g50bbe7f3'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 12:31:04.094992', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240910.095512-reef', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-13T15:45:28.650 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-rishabh-testing-20240910.095512-reef, sha1 50bbe7f395997dcd871813949c49addbbf630361 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:45:28.652 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/x86_64/flavors/default/cephadm 2024-09-13T15:45:28.652 DEBUG:teuthology.orchestra.run.smithi017:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T15:45:29.025 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r--. 1 ubuntu ubuntu 217224 Sep 13 15:45 /home/ubuntu/cephtest/cephadm 2024-09-13T15:45:29.026 DEBUG:teuthology.orchestra.run.smithi189:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T15:45:29.370 INFO:teuthology.orchestra.run.smithi189.stdout:-rw-r--r--. 1 ubuntu ubuntu 217224 Sep 13 15:45 /home/ubuntu/cephtest/cephadm 2024-09-13T15:45:29.370 DEBUG:teuthology.orchestra.run.smithi193:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T15:45:29.707 INFO:teuthology.orchestra.run.smithi193.stdout:-rw-r--r--. 1 ubuntu ubuntu 217224 Sep 13 15:45 /home/ubuntu/cephtest/cephadm 2024-09-13T15:45:29.708 DEBUG:teuthology.orchestra.run.smithi017:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T15:45:29.748 DEBUG:teuthology.orchestra.run.smithi189:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T15:45:29.768 DEBUG:teuthology.orchestra.run.smithi193:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T15:45:29.803 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 on all hosts... 2024-09-13T15:45:29.803 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 pull 2024-09-13T15:45:29.807 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 pull 2024-09-13T15:45:29.811 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 pull 2024-09-13T15:45:31.360 INFO:teuthology.orchestra.run.smithi193.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361... 2024-09-13T15:45:31.450 INFO:teuthology.orchestra.run.smithi189.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361... 2024-09-13T15:45:32.682 INFO:teuthology.orchestra.run.smithi017.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361... 2024-09-13T15:46:18.572 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-13T15:46:18.573 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable)", 2024-09-13T15:46:18.573 INFO:teuthology.orchestra.run.smithi017.stdout: "image_id": "152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c", 2024-09-13T15:46:18.573 INFO:teuthology.orchestra.run.smithi017.stdout: "repo_digests": [ 2024-09-13T15:46:18.573 INFO:teuthology.orchestra.run.smithi017.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a" 2024-09-13T15:46:18.573 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-13T15:46:18.574 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-13T15:46:31.103 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-09-13T15:46:31.104 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_version": "ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable)", 2024-09-13T15:46:31.104 INFO:teuthology.orchestra.run.smithi193.stdout: "image_id": "152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c", 2024-09-13T15:46:31.104 INFO:teuthology.orchestra.run.smithi193.stdout: "repo_digests": [ 2024-09-13T15:46:31.104 INFO:teuthology.orchestra.run.smithi193.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a" 2024-09-13T15:46:31.104 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-09-13T15:46:31.104 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-09-13T15:46:31.384 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-13T15:46:31.384 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_version": "ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable)", 2024-09-13T15:46:31.384 INFO:teuthology.orchestra.run.smithi189.stdout: "image_id": "152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c", 2024-09-13T15:46:31.384 INFO:teuthology.orchestra.run.smithi189.stdout: "repo_digests": [ 2024-09-13T15:46:31.384 INFO:teuthology.orchestra.run.smithi189.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a" 2024-09-13T15:46:31.384 INFO:teuthology.orchestra.run.smithi189.stdout: ] 2024-09-13T15:46:31.384 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-13T15:46:31.403 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph 2024-09-13T15:46:31.471 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /etc/ceph 2024-09-13T15:46:31.498 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /etc/ceph 2024-09-13T15:46:31.528 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 777 /etc/ceph 2024-09-13T15:46:31.586 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 777 /etc/ceph 2024-09-13T15:46:31.611 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 777 /etc/ceph 2024-09-13T15:46:31.637 INFO:tasks.cephadm:Writing seed config... 2024-09-13T15:46:31.638 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-13T15:46:31.638 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-13T15:46:31.638 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-13T15:46:31.639 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-13T15:46:31.639 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-13T15:46:31.639 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-13T15:46:31.639 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-13T15:46:31.639 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-13T15:46:31.639 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-13T15:46:31.639 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-13T15:46:31.639 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-13T15:46:31.639 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-13T15:46:31.640 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-13T15:46:31.640 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-13T15:46:31.640 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-13T15:46:31.640 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-13T15:46:31.640 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-13T15:46:31.640 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-13T15:46:31.641 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-13T15:46:31.641 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-13T15:46:31.641 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-13T15:46:31.641 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-13T15:46:31.641 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-13T15:46:31.641 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-13T15:46:31.642 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-13T15:46:31.642 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-13T15:46:31.642 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-13T15:46:31.642 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-13T15:46:31.642 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-13T15:46:31.642 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-13T15:46:31.642 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-13T15:46:31.642 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-13T15:46:31.643 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-13T15:46:31.643 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-13T15:46:31.643 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-13T15:46:31.643 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-13T15:46:31.643 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-13T15:46:31.643 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-13T15:46:31.643 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-13T15:46:31.643 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-13T15:46:31.643 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-13T15:46:31.644 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-13T15:46:31.644 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-13T15:46:31.644 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-13T15:46:31.644 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-13T15:46:31.645 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T15:46:31.645 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-13T15:46:31.682 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 3334a620-71e7-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-13T15:46:31.682 DEBUG:teuthology.orchestra.run.smithi017:mon.a> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mon.a.service 2024-09-13T15:46:31.727 DEBUG:teuthology.orchestra.run.smithi017:mgr.x> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mgr.x.service 2024-09-13T15:46:31.771 INFO:tasks.cephadm:Bootstrapping... 2024-09-13T15:46:31.771 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 -v bootstrap --fsid 3334a620-71e7-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.17 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-13T15:46:31.976 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-13T15:46:31.977 INFO:teuthology.orchestra.run.smithi017.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361', '-v', 'bootstrap', '--fsid', '3334a620-71e7-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.17', '--skip-admin-label'] 2024-09-13T15:46:32.023 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 5.2.2 2024-09-13T15:46:32.023 INFO:teuthology.orchestra.run.smithi017.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-13T15:46:32.023 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying podman|docker is present... 2024-09-13T15:46:32.068 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 5.2.2 2024-09-13T15:46:32.068 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying lvm2 is present... 2024-09-13T15:46:32.068 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying time synchronization is in place... 2024-09-13T15:46:32.082 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T15:46:32.082 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T15:46:32.094 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T15:46:32.094 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-13T15:46:32.108 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout enabled 2024-09-13T15:46:32.120 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout active 2024-09-13T15:46:32.120 INFO:teuthology.orchestra.run.smithi017.stdout:Unit chronyd.service is enabled and running 2024-09-13T15:46:32.120 INFO:teuthology.orchestra.run.smithi017.stdout:Repeating the final host check... 2024-09-13T15:46:32.163 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 5.2.2 2024-09-13T15:46:32.163 INFO:teuthology.orchestra.run.smithi017.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-13T15:46:32.163 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl is present 2024-09-13T15:46:32.163 INFO:teuthology.orchestra.run.smithi017.stdout:lvcreate is present 2024-09-13T15:46:32.176 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T15:46:32.176 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T15:46:32.188 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T15:46:32.188 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-13T15:46:32.201 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout enabled 2024-09-13T15:46:32.214 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout active 2024-09-13T15:46:32.214 INFO:teuthology.orchestra.run.smithi017.stdout:Unit chronyd.service is enabled and running 2024-09-13T15:46:32.214 INFO:teuthology.orchestra.run.smithi017.stdout:Host looks OK 2024-09-13T15:46:32.214 INFO:teuthology.orchestra.run.smithi017.stdout:Cluster fsid: 3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T15:46:32.214 INFO:teuthology.orchestra.run.smithi017.stdout:Acquiring lock 140405945216592 on /run/cephadm/3334a620-71e7-11ef-bceb-c7b262605968.lock 2024-09-13T15:46:32.214 INFO:teuthology.orchestra.run.smithi017.stdout:Lock 140405945216592 acquired on /run/cephadm/3334a620-71e7-11ef-bceb-c7b262605968.lock 2024-09-13T15:46:32.215 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying IP 172.21.15.17 port 3300 ... 2024-09-13T15:46:32.215 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying IP 172.21.15.17 port 6789 ... 2024-09-13T15:46:32.215 INFO:teuthology.orchestra.run.smithi017.stdout:Base mon IP(s) is [172.21.15.17:3300, 172.21.15.17:6789], mon addrv is [v2:172.21.15.17:3300,v1:172.21.15.17:6789] 2024-09-13T15:46:32.222 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.17 metric 100 2024-09-13T15:46:32.222 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.17 metric 100 2024-09-13T15:46:32.228 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-13T15:46:32.228 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-13T15:46:32.228 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1793sec hoplimit 64 pref medium 2024-09-13T15:46:32.233 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-13T15:46:32.233 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-13T15:46:32.234 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T15:46:32.234 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-13T15:46:32.234 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-13T15:46:32.234 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T15:46:32.234 INFO:teuthology.orchestra.run.smithi017.stdout:Mon IP `172.21.15.17` is in CIDR network `172.21.0.0/20` 2024-09-13T15:46:32.234 INFO:teuthology.orchestra.run.smithi017.stdout:Mon IP `172.21.15.17` is in CIDR network `172.21.0.0/20` 2024-09-13T15:46:32.234 INFO:teuthology.orchestra.run.smithi017.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-13T15:46:32.235 INFO:teuthology.orchestra.run.smithi017.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-13T15:46:32.236 INFO:teuthology.orchestra.run.smithi017.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361... 2024-09-13T15:46:32.964 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c 2024-09-13T15:46:32.964 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361... 2024-09-13T15:46:32.964 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Getting image source signatures 2024-09-13T15:46:32.964 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-13T15:46:32.964 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying blob sha256:3bf8bde7788a2a6694fefa78ba3da98c997a778335fd0748e145012f747287ae 2024-09-13T15:46:32.964 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying config sha256:152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c 2024-09-13T15:46:32.964 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-13T15:46:33.966 INFO:teuthology.orchestra.run.smithi017.stdout:ceph: stdout ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable) 2024-09-13T15:46:33.966 INFO:teuthology.orchestra.run.smithi017.stdout:Ceph version: ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable) 2024-09-13T15:46:33.966 INFO:teuthology.orchestra.run.smithi017.stdout:Extracting ceph user uid/gid from container image... 2024-09-13T15:46:34.995 INFO:teuthology.orchestra.run.smithi017.stdout:stat: stdout 167 167 2024-09-13T15:46:34.995 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial keys... 2024-09-13T15:46:35.992 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQBbXuRm2m4GFRAAjxW9dsYRSxLkZfLTkhirkA== 2024-09-13T15:46:44.913 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQBcXuRm9DvbFRAAszT6g7Dhp/nVHjpGRMb5bA== 2024-09-13T15:46:45.900 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQBlXuRmhpd9ERAA4bJ5NbOi91sf7iKARPofuw== 2024-09-13T15:46:45.901 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial monmap... 2024-09-13T15:46:46.932 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T15:46:46.932 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-13T15:46:46.932 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T15:46:46.932 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T15:46:46.932 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool for a [v2:172.21.15.17:3300,v1:172.21.15.17:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T15:46:46.932 INFO:teuthology.orchestra.run.smithi017.stdout:setting min_mon_release = pacific 2024-09-13T15:46:46.932 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: set fsid to 3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T15:46:46.932 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T15:46:46.932 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:46:46.932 INFO:teuthology.orchestra.run.smithi017.stdout:Creating mon... 2024-09-13T15:46:47.960 INFO:teuthology.orchestra.run.smithi017.stdout:create mon.a on 2024-09-13T15:46:48.278 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-13T15:46:48.513 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-13T15:46:48.789 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-3334a620-71e7-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-3334a620-71e7-11ef-bceb-c7b262605968.target. 2024-09-13T15:46:48.789 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-3334a620-71e7-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-3334a620-71e7-11ef-bceb-c7b262605968.target. 2024-09-13T15:46:49.135 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3334a620-71e7-11ef-bceb-c7b262605968@mon.a 2024-09-13T15:46:49.135 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3334a620-71e7-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-3334a620-71e7-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-13T15:46:49.411 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3334a620-71e7-11ef-bceb-c7b262605968.target.wants/ceph-3334a620-71e7-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-3334a620-71e7-11ef-bceb-c7b262605968@.service. 2024-09-13T15:46:50.480 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:50 smithi017 podman[30110]: 2024-09-13 15:46:50.415848049 +0000 UTC m=+0.763670565 container start 4d78bc992dd3d67aeb4f9973da9275b54dc0a8bf125b12b1d6cf92e26f72fe79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-13T15:46:50.480 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:50 smithi017 ceph-mon[30131]: mkfs 3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T15:46:50.544 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T15:46:50.544 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-09-13T15:46:50.557 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T15:46:50.557 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-13T15:46:50.558 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-09-13T15:46:50.558 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T15:46:50.558 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mon to start... 2024-09-13T15:46:50.558 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mon... 2024-09-13T15:46:50.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:50 smithi017 ceph-mon[30131]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T15:46:50.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:50 smithi017 bash[30110]: 4d78bc992dd3d67aeb4f9973da9275b54dc0a8bf125b12b1d6cf92e26f72fe79 2024-09-13T15:46:50.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:50 smithi017 systemd[1]: Started Ceph mon.a for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T15:46:51.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:51 smithi017 ceph-mon[30131]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T15:46:51.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:51 smithi017 ceph-mon[30131]: monmap e1: 1 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T15:46:51.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:51 smithi017 ceph-mon[30131]: fsmap 2024-09-13T15:46:51.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:51 smithi017 ceph-mon[30131]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T15:46:51.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:51 smithi017 ceph-mon[30131]: mgrmap e1: no daemons active 2024-09-13T15:46:51.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:51 smithi017 ceph-mon[30131]: from='client.? 172.21.15.17:0/1188741807' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-13T15:46:51.935 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout cluster: 2024-09-13T15:46:51.935 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout id: 3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T15:46:51.935 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-13T15:46:51.935 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-13T15:46:51.936 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout services: 2024-09-13T15:46:51.936 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.673316s) 2024-09-13T15:46:51.936 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-13T15:46:51.936 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-13T15:46:51.936 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-13T15:46:51.936 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout data: 2024-09-13T15:46:51.937 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-13T15:46:51.937 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-13T15:46:51.937 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-13T15:46:51.937 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout pgs: 2024-09-13T15:46:51.937 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-13T15:46:51.937 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.069+0000 7fa017e00640 1 Processor -- start 2024-09-13T15:46:51.938 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.070+0000 7fa017e00640 1 -- start start 2024-09-13T15:46:51.938 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.070+0000 7fa017e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0181078f0 0x7fa018107cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:46:51.938 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.070+0000 7fa017e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0181082c0 con 0x7fa0181078f0 2024-09-13T15:46:51.938 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.071+0000 7fa016a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0181078f0 0x7fa018107cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:46:51.938 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.071+0000 7fa016a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0181078f0 0x7fa018107cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39572/0 (socket says 172.21.15.17:39572) 2024-09-13T15:46:51.938 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.071+0000 7fa016a00640 1 -- 172.21.15.17:0/1409341669 learned_addr learned my addr 172.21.15.17:0/1409341669 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:46:51.938 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.071+0000 7fa016a00640 1 -- 172.21.15.17:0/1409341669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0181087a0 con 0x7fa0181078f0 2024-09-13T15:46:51.939 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.074+0000 7fa016a00640 1 --2- 172.21.15.17:0/1409341669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0181078f0 0x7fa018107cf0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa008009820 tx=0x7fa00802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24541b738a94db8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:46:51.939 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.074+0000 7fa015600640 1 -- 172.21.15.17:0/1409341669 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa00802ae70 con 0x7fa0181078f0 2024-09-13T15:46:51.939 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.074+0000 7fa015600640 1 -- 172.21.15.17:0/1409341669 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa008032440 con 0x7fa0181078f0 2024-09-13T15:46:51.939 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.074+0000 7fa015600640 1 -- 172.21.15.17:0/1409341669 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa008032700 con 0x7fa0181078f0 2024-09-13T15:46:51.939 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.075+0000 7fa017e00640 1 -- 172.21.15.17:0/1409341669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0181078f0 msgr2=0x7fa018107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:46:51.939 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.075+0000 7fa017e00640 1 --2- 172.21.15.17:0/1409341669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0181078f0 0x7fa018107cf0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa008009820 tx=0x7fa00802a270 comp rx=0 tx=0).stop 2024-09-13T15:46:51.939 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.075+0000 7fa017e00640 1 -- 172.21.15.17:0/1409341669 shutdown_connections 2024-09-13T15:46:51.939 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.075+0000 7fa017e00640 1 --2- 172.21.15.17:0/1409341669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0181078f0 0x7fa018107cf0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:46:51.939 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.075+0000 7fa017e00640 1 -- 172.21.15.17:0/1409341669 >> 172.21.15.17:0/1409341669 conn(0x7fa01807abb0 msgr2=0x7fa01807afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:46:51.939 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.075+0000 7fa017e00640 1 -- 172.21.15.17:0/1409341669 shutdown_connections 2024-09-13T15:46:51.939 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.075+0000 7fa017e00640 1 -- 172.21.15.17:0/1409341669 wait complete. 2024-09-13T15:46:51.939 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.076+0000 7fa017e00640 1 Processor -- start 2024-09-13T15:46:51.939 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.076+0000 7fa017e00640 1 -- start start 2024-09-13T15:46:51.940 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.076+0000 7fa017e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0181078f0 0x7fa01819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:46:51.940 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.076+0000 7fa017e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01819b080 con 0x7fa0181078f0 2024-09-13T15:46:51.940 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.077+0000 7fa016a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0181078f0 0x7fa01819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:46:51.940 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.077+0000 7fa016a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0181078f0 0x7fa01819ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39582/0 (socket says 172.21.15.17:39582) 2024-09-13T15:46:51.940 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.077+0000 7fa016a00640 1 -- 172.21.15.17:0/1188741807 learned_addr learned my addr 172.21.15.17:0/1188741807 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:46:51.940 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.077+0000 7fa016a00640 1 -- 172.21.15.17:0/1188741807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0080094d0 con 0x7fa0181078f0 2024-09-13T15:46:51.940 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.077+0000 7fa016a00640 1 --2- 172.21.15.17:0/1188741807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0181078f0 0x7fa01819ab40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa0080090b0 tx=0x7fa0080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:46:51.940 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.078+0000 7fa00f400640 1 -- 172.21.15.17:0/1188741807 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0080308d0 con 0x7fa0181078f0 2024-09-13T15:46:51.941 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.078+0000 7fa00f400640 1 -- 172.21.15.17:0/1188741807 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa008030a30 con 0x7fa0181078f0 2024-09-13T15:46:51.941 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.078+0000 7fa00f400640 1 -- 172.21.15.17:0/1188741807 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa008030cf0 con 0x7fa0181078f0 2024-09-13T15:46:51.941 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.078+0000 7fa017e00640 1 -- 172.21.15.17:0/1188741807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01819b280 con 0x7fa0181078f0 2024-09-13T15:46:51.941 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.078+0000 7fa017e00640 1 -- 172.21.15.17:0/1188741807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa01819b720 con 0x7fa0181078f0 2024-09-13T15:46:51.941 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.078+0000 7fa00f400640 1 -- 172.21.15.17:0/1188741807 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa008039040 con 0x7fa0181078f0 2024-09-13T15:46:51.941 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.078+0000 7fa00f400640 1 -- 172.21.15.17:0/1188741807 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa0080468c0 con 0x7fa0181078f0 2024-09-13T15:46:51.941 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.079+0000 7fa017e00640 1 -- 172.21.15.17:0/1188741807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0181093c0 con 0x7fa0181078f0 2024-09-13T15:46:51.941 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.082+0000 7fa00f400640 1 -- 172.21.15.17:0/1188741807 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fa008037070 con 0x7fa0181078f0 2024-09-13T15:46:51.941 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.146+0000 7fa017e00640 1 -- 172.21.15.17:0/1188741807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fa01819e000 con 0x7fa0181078f0 2024-09-13T15:46:51.941 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.147+0000 7fa00f400640 1 -- 172.21.15.17:0/1188741807 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7fa008046a80 con 0x7fa0181078f0 2024-09-13T15:46:51.941 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.147+0000 7fa017e00640 1 -- 172.21.15.17:0/1188741807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0181078f0 msgr2=0x7fa01819ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:46:51.941 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.147+0000 7fa017e00640 1 --2- 172.21.15.17:0/1188741807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0181078f0 0x7fa01819ab40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa0080090b0 tx=0x7fa0080046c0 comp rx=0 tx=0).stop 2024-09-13T15:46:51.941 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.147+0000 7fa017e00640 1 -- 172.21.15.17:0/1188741807 shutdown_connections 2024-09-13T15:46:51.942 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.147+0000 7fa017e00640 1 --2- 172.21.15.17:0/1188741807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0181078f0 0x7fa01819ab40 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:46:51.942 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.147+0000 7fa017e00640 1 -- 172.21.15.17:0/1188741807 >> 172.21.15.17:0/1188741807 conn(0x7fa01807abb0 msgr2=0x7fa01818ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:46:51.942 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.148+0000 7fa017e00640 1 -- 172.21.15.17:0/1188741807 shutdown_connections 2024-09-13T15:46:51.942 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:51.148+0000 7fa017e00640 1 -- 172.21.15.17:0/1188741807 wait complete. 2024-09-13T15:46:51.942 INFO:teuthology.orchestra.run.smithi017.stdout:mon is available 2024-09-13T15:46:51.942 INFO:teuthology.orchestra.run.smithi017.stdout:Assimilating anything we can from ceph.conf... 2024-09-13T15:46:52.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:52 smithi017 ceph-mon[30131]: from='client.? 172.21.15.17:0/3403929243' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T15:46:52.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:52 smithi017 ceph-mon[30131]: from='client.? 172.21.15.17:0/3403929243' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-13T15:46:53.191 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-13T15:46:53.191 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T15:46:53.191 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout fsid = 3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T15:46:53.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.17:3300,v1:172.21.15.17:6789] 2024-09-13T15:46:53.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T15:46:53.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T15:46:53.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T15:46:53.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T15:46:53.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-13T15:46:53.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T15:46:53.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T15:46:53.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-13T15:46:53.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T15:46:53.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T15:46:53.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T15:46:53.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T15:46:53.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T15:46:53.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T15:46:53.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.426+0000 7f8c87e00640 1 Processor -- start 2024-09-13T15:46:53.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.426+0000 7f8c87e00640 1 -- start start 2024-09-13T15:46:53.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.427+0000 7f8c87e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8007f5c0 0x7f8c8007f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:46:53.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.427+0000 7f8c87e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8007ff90 con 0x7f8c8007f5c0 2024-09-13T15:46:53.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.427+0000 7f8c85400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8007f5c0 0x7f8c8007f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:46:53.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.427+0000 7f8c85400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8007f5c0 0x7f8c8007f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39588/0 (socket says 172.21.15.17:39588) 2024-09-13T15:46:53.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.427+0000 7f8c85400640 1 -- 172.21.15.17:0/2789438162 learned_addr learned my addr 172.21.15.17:0/2789438162 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:46:53.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.428+0000 7f8c85400640 1 -- 172.21.15.17:0/2789438162 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8010cd90 con 0x7f8c8007f5c0 2024-09-13T15:46:53.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.429+0000 7f8c85400640 1 --2- 172.21.15.17:0/2789438162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8007f5c0 0x7f8c8007f9c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009820 tx=0x7f8c7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545cecd4700e900f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:46:53.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.429+0000 7f8c7fe00640 1 -- 172.21.15.17:0/2789438162 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c7402ae70 con 0x7f8c8007f5c0 2024-09-13T15:46:53.194 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.429+0000 7f8c7fe00640 1 -- 172.21.15.17:0/2789438162 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c74032440 con 0x7f8c8007f5c0 2024-09-13T15:46:53.194 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.429+0000 7f8c7fe00640 1 -- 172.21.15.17:0/2789438162 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c74032700 con 0x7f8c8007f5c0 2024-09-13T15:46:53.194 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.429+0000 7f8c87e00640 1 -- 172.21.15.17:0/2789438162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8007f5c0 msgr2=0x7f8c8007f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:46:53.194 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.429+0000 7f8c87e00640 1 --2- 172.21.15.17:0/2789438162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8007f5c0 0x7f8c8007f9c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009820 tx=0x7f8c7402a270 comp rx=0 tx=0).stop 2024-09-13T15:46:53.194 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.430+0000 7f8c87e00640 1 -- 172.21.15.17:0/2789438162 shutdown_connections 2024-09-13T15:46:53.194 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.430+0000 7f8c87e00640 1 --2- 172.21.15.17:0/2789438162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8007f5c0 0x7f8c8007f9c0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:46:53.194 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.430+0000 7f8c87e00640 1 -- 172.21.15.17:0/2789438162 >> 172.21.15.17:0/2789438162 conn(0x7f8c8007ad90 msgr2=0x7f8c8007d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:46:53.194 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.430+0000 7f8c87e00640 1 -- 172.21.15.17:0/2789438162 shutdown_connections 2024-09-13T15:46:53.194 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.430+0000 7f8c87e00640 1 -- 172.21.15.17:0/2789438162 wait complete. 2024-09-13T15:46:53.194 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.431+0000 7f8c87e00640 1 Processor -- start 2024-09-13T15:46:53.194 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.431+0000 7f8c87e00640 1 -- start start 2024-09-13T15:46:53.194 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.431+0000 7f8c87e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8007f5c0 0x7f8c8019f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:46:53.195 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.431+0000 7f8c87e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8019f640 con 0x7f8c8007f5c0 2024-09-13T15:46:53.195 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.431+0000 7f8c85400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8007f5c0 0x7f8c8019f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:46:53.195 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.431+0000 7f8c85400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8007f5c0 0x7f8c8019f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39600/0 (socket says 172.21.15.17:39600) 2024-09-13T15:46:53.195 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.431+0000 7f8c85400640 1 -- 172.21.15.17:0/3403929243 learned_addr learned my addr 172.21.15.17:0/3403929243 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:46:53.195 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.432+0000 7f8c85400640 1 -- 172.21.15.17:0/3403929243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c740094d0 con 0x7f8c8007f5c0 2024-09-13T15:46:53.195 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.432+0000 7f8c85400640 1 --2- 172.21.15.17:0/3403929243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8007f5c0 0x7f8c8019f100 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8c740090b0 tx=0x7f8c740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:46:53.195 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.432+0000 7f8c7e000640 1 -- 172.21.15.17:0/3403929243 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c740308d0 con 0x7f8c8007f5c0 2024-09-13T15:46:53.195 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.432+0000 7f8c7e000640 1 -- 172.21.15.17:0/3403929243 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c74030a30 con 0x7f8c8007f5c0 2024-09-13T15:46:53.195 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.432+0000 7f8c7e000640 1 -- 172.21.15.17:0/3403929243 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c74030cf0 con 0x7f8c8007f5c0 2024-09-13T15:46:53.195 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.432+0000 7f8c87e00640 1 -- 172.21.15.17:0/3403929243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c8019f840 con 0x7f8c8007f5c0 2024-09-13T15:46:53.195 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.433+0000 7f8c87e00640 1 -- 172.21.15.17:0/3403929243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c8019fce0 con 0x7f8c8007f5c0 2024-09-13T15:46:53.195 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.433+0000 7f8c7e000640 1 -- 172.21.15.17:0/3403929243 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f8c74039040 con 0x7f8c8007f5c0 2024-09-13T15:46:53.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.433+0000 7f8c7e000640 1 -- 172.21.15.17:0/3403929243 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8c740468c0 con 0x7f8c8007f5c0 2024-09-13T15:46:53.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.434+0000 7f8c87e00640 1 -- 172.21.15.17:0/3403929243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c8010d940 con 0x7f8c8007f5c0 2024-09-13T15:46:53.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.436+0000 7f8c7e000640 1 -- 172.21.15.17:0/3403929243 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f8c74037070 con 0x7f8c8007f5c0 2024-09-13T15:46:53.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.498+0000 7f8c87e00640 1 -- 172.21.15.17:0/3403929243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f8c801a25c0 con 0x7f8c8007f5c0 2024-09-13T15:46:53.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.503+0000 7f8c7e000640 1 -- 172.21.15.17:0/3403929243 <== mon.0 v2:172.21.15.17:3300/0 7 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8c7404f8d0 con 0x7f8c8007f5c0 2024-09-13T15:46:53.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.503+0000 7f8c7e000640 1 -- 172.21.15.17:0/3403929243 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f8c74046a80 con 0x7f8c8007f5c0 2024-09-13T15:46:53.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.504+0000 7f8c87e00640 1 -- 172.21.15.17:0/3403929243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8007f5c0 msgr2=0x7f8c8019f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:46:53.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.504+0000 7f8c87e00640 1 --2- 172.21.15.17:0/3403929243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8007f5c0 0x7f8c8019f100 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8c740090b0 tx=0x7f8c740046c0 comp rx=0 tx=0).stop 2024-09-13T15:46:53.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.504+0000 7f8c87e00640 1 -- 172.21.15.17:0/3403929243 shutdown_connections 2024-09-13T15:46:53.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.504+0000 7f8c87e00640 1 --2- 172.21.15.17:0/3403929243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8007f5c0 0x7f8c8019f100 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:46:53.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.504+0000 7f8c87e00640 1 -- 172.21.15.17:0/3403929243 >> 172.21.15.17:0/3403929243 conn(0x7f8c8007ad90 msgr2=0x7f8c801935b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:46:53.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.504+0000 7f8c87e00640 1 -- 172.21.15.17:0/3403929243 shutdown_connections 2024-09-13T15:46:53.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:52.504+0000 7f8c87e00640 1 -- 172.21.15.17:0/3403929243 wait complete. 2024-09-13T15:46:53.197 INFO:teuthology.orchestra.run.smithi017.stdout:Generating new minimal ceph.conf... 2024-09-13T15:46:54.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:53 smithi017 ceph-mon[30131]: from='client.? 172.21.15.17:0/224984107' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:46:54.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.621+0000 7fe5ad400640 1 Processor -- start 2024-09-13T15:46:54.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.621+0000 7fe5ad400640 1 -- start start 2024-09-13T15:46:54.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.621+0000 7fe5ad400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5a81077f0 0x7fe5a8107bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:46:54.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.621+0000 7fe5ad400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a81081c0 con 0x7fe5a81077f0 2024-09-13T15:46:54.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.622+0000 7fe5a6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5a81077f0 0x7fe5a8107bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:46:54.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.622+0000 7fe5a6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5a81077f0 0x7fe5a8107bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39610/0 (socket says 172.21.15.17:39610) 2024-09-13T15:46:54.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.622+0000 7fe5a6800640 1 -- 172.21.15.17:0/1551547500 learned_addr learned my addr 172.21.15.17:0/1551547500 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:46:54.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.622+0000 7fe5a6800640 1 -- 172.21.15.17:0/1551547500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a8108990 con 0x7fe5a81077f0 2024-09-13T15:46:54.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.623+0000 7fe5a6800640 1 --2- 172.21.15.17:0/1551547500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5a81077f0 0x7fe5a8107bf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe598009820 tx=0x7fe59802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b730b252e0205e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:46:54.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.623+0000 7fe5a5400640 1 -- 172.21.15.17:0/1551547500 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe59802ae70 con 0x7fe5a81077f0 2024-09-13T15:46:54.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.623+0000 7fe5a5400640 1 -- 172.21.15.17:0/1551547500 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe5980328e0 con 0x7fe5a81077f0 2024-09-13T15:46:54.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.623+0000 7fe5a5400640 1 -- 172.21.15.17:0/1551547500 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5980308c0 con 0x7fe5a81077f0 2024-09-13T15:46:54.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.624+0000 7fe5ad400640 1 -- 172.21.15.17:0/1551547500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5a81077f0 msgr2=0x7fe5a8107bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:46:54.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.624+0000 7fe5ad400640 1 --2- 172.21.15.17:0/1551547500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5a81077f0 0x7fe5a8107bf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe598009820 tx=0x7fe59802a270 comp rx=0 tx=0).stop 2024-09-13T15:46:54.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.624+0000 7fe5ad400640 1 -- 172.21.15.17:0/1551547500 shutdown_connections 2024-09-13T15:46:54.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.624+0000 7fe5ad400640 1 --2- 172.21.15.17:0/1551547500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5a81077f0 0x7fe5a8107bf0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:46:54.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.624+0000 7fe5ad400640 1 -- 172.21.15.17:0/1551547500 >> 172.21.15.17:0/1551547500 conn(0x7fe5a807ad80 msgr2=0x7fe5a807b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:46:54.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.624+0000 7fe5ad400640 1 -- 172.21.15.17:0/1551547500 shutdown_connections 2024-09-13T15:46:54.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.624+0000 7fe5ad400640 1 -- 172.21.15.17:0/1551547500 wait complete. 2024-09-13T15:46:54.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.625+0000 7fe5ad400640 1 Processor -- start 2024-09-13T15:46:54.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.625+0000 7fe5ad400640 1 -- start start 2024-09-13T15:46:54.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.625+0000 7fe5ad400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5a81077f0 0x7fe5a819b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:46:54.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.625+0000 7fe5ad400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a819b9e0 con 0x7fe5a81077f0 2024-09-13T15:46:54.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.626+0000 7fe5a6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5a81077f0 0x7fe5a819b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:46:54.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.626+0000 7fe5a6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5a81077f0 0x7fe5a819b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39612/0 (socket says 172.21.15.17:39612) 2024-09-13T15:46:54.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.626+0000 7fe5a6800640 1 -- 172.21.15.17:0/224984107 learned_addr learned my addr 172.21.15.17:0/224984107 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:46:54.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.626+0000 7fe5a6800640 1 -- 172.21.15.17:0/224984107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5980094d0 con 0x7fe5a81077f0 2024-09-13T15:46:54.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.626+0000 7fe5a6800640 1 --2- 172.21.15.17:0/224984107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5a81077f0 0x7fe5a819b4a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe5980097f0 tx=0x7fe598030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:46:54.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.627+0000 7fe59f400640 1 -- 172.21.15.17:0/224984107 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe598032d90 con 0x7fe5a81077f0 2024-09-13T15:46:54.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.627+0000 7fe59f400640 1 -- 172.21.15.17:0/224984107 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe59803b8d0 con 0x7fe5a81077f0 2024-09-13T15:46:54.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.627+0000 7fe59f400640 1 -- 172.21.15.17:0/224984107 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe59803a780 con 0x7fe5a81077f0 2024-09-13T15:46:54.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.627+0000 7fe5ad400640 1 -- 172.21.15.17:0/224984107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a819bbe0 con 0x7fe5a81077f0 2024-09-13T15:46:54.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.627+0000 7fe5ad400640 1 -- 172.21.15.17:0/224984107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a819c080 con 0x7fe5a81077f0 2024-09-13T15:46:54.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.627+0000 7fe59f400640 1 -- 172.21.15.17:0/224984107 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fe598039040 con 0x7fe5a81077f0 2024-09-13T15:46:54.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.627+0000 7fe59f400640 1 -- 172.21.15.17:0/224984107 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe59804c350 con 0x7fe5a81077f0 2024-09-13T15:46:54.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.628+0000 7fe5ad400640 1 -- 172.21.15.17:0/224984107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a810bbc0 con 0x7fe5a81077f0 2024-09-13T15:46:54.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.631+0000 7fe59f400640 1 -- 172.21.15.17:0/224984107 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fe598049060 con 0x7fe5a81077f0 2024-09-13T15:46:54.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.692+0000 7fe5ad400640 1 -- 172.21.15.17:0/224984107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fe5a810bd80 con 0x7fe5a81077f0 2024-09-13T15:46:54.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.692+0000 7fe59f400640 1 -- 172.21.15.17:0/224984107 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fe598052090 con 0x7fe5a81077f0 2024-09-13T15:46:54.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.693+0000 7fe5ad400640 1 -- 172.21.15.17:0/224984107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5a81077f0 msgr2=0x7fe5a819b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:46:54.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.693+0000 7fe5ad400640 1 --2- 172.21.15.17:0/224984107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5a81077f0 0x7fe5a819b4a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe5980097f0 tx=0x7fe598030db0 comp rx=0 tx=0).stop 2024-09-13T15:46:54.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.693+0000 7fe5ad400640 1 -- 172.21.15.17:0/224984107 shutdown_connections 2024-09-13T15:46:54.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.693+0000 7fe5ad400640 1 --2- 172.21.15.17:0/224984107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5a81077f0 0x7fe5a819b4a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:46:54.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.693+0000 7fe5ad400640 1 -- 172.21.15.17:0/224984107 >> 172.21.15.17:0/224984107 conn(0x7fe5a807ad80 msgr2=0x7fe5a81054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:46:54.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.694+0000 7fe5ad400640 1 -- 172.21.15.17:0/224984107 shutdown_connections 2024-09-13T15:46:54.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:53.694+0000 7fe5ad400640 1 -- 172.21.15.17:0/224984107 wait complete. 2024-09-13T15:46:54.374 INFO:teuthology.orchestra.run.smithi017.stdout:Restarting the monitor... 2024-09-13T15:46:54.751 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:54 smithi017 systemd[1]: Stopping Ceph mon.a for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T15:46:55.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:54 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-a[30127]: 2024-09-13T15:46:54.749+0000 7f80cfa00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T15:46:55.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:54 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-a[30127]: 2024-09-13T15:46:54.749+0000 7f80cfa00640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-13T15:46:55.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:54 smithi017 podman[30371]: 2024-09-13 15:46:54.87362581 +0000 UTC m=+0.261556622 container died 4d78bc992dd3d67aeb4f9973da9275b54dc0a8bf125b12b1d6cf92e26f72fe79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T15:46:55.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:55 smithi017 podman[30371]: 2024-09-13 15:46:55.279406939 +0000 UTC m=+0.667337758 container cleanup 4d78bc992dd3d67aeb4f9973da9275b54dc0a8bf125b12b1d6cf92e26f72fe79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-a, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-13T15:46:55.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:55 smithi017 bash[30371]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-a 2024-09-13T15:46:55.788 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:55 smithi017 podman[30382]: 2024-09-13 15:46:55.527147014 +0000 UTC m=+0.638878905 container remove 4d78bc992dd3d67aeb4f9973da9275b54dc0a8bf125b12b1d6cf92e26f72fe79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-a, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-13T15:46:55.788 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:55 smithi017 systemd[1]: ceph-3334a620-71e7-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-13T15:46:55.788 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:55 smithi017 systemd[1]: Stopped Ceph mon.a for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T15:46:55.788 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:55 smithi017 systemd[1]: ceph-3334a620-71e7-11ef-bceb-c7b262605968@mon.a.service: Consumed 1.243s CPU time. 2024-09-13T15:46:55.788 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:55 smithi017 systemd[1]: Starting Ceph mon.a for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T15:46:56.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:55 smithi017 podman[30475]: 2024-09-13 15:46:55.98951529 +0000 UTC m=+0.105500685 container create 14945298a9848fdf15ea3a380264236d33988d5dc2e5f6015fdb2494a21c2607 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T15:46:56.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 podman[30475]: 2024-09-13 15:46:55.911028825 +0000 UTC m=+0.027014232 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:46:56.259 INFO:teuthology.orchestra.run.smithi017.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-13T15:46:56.496 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 podman[30475]: 2024-09-13 15:46:56.18382423 +0000 UTC m=+0.299809649 container init 14945298a9848fdf15ea3a380264236d33988d5dc2e5f6015fdb2494a21c2607 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD) 2024-09-13T15:46:56.496 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 podman[30475]: 2024-09-13 15:46:56.190337367 +0000 UTC m=+0.306322764 container start 14945298a9848fdf15ea3a380264236d33988d5dc2e5f6015fdb2494a21c2607 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T15:46:56.496 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T15:46:56.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable), process ceph-mon, pid 2 2024-09-13T15:46:56.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: pidfile_write: ignore empty --pid-file 2024-09-13T15:46:56.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: load: jerasure load: lrc 2024-09-13T15:46:56.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: RocksDB version: 7.9.2 2024-09-13T15:46:56.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Git sha 0 2024-09-13T15:46:56.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Compile date 2024-09-10 11:17:42 2024-09-13T15:46:56.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: DB SUMMARY 2024-09-13T15:46:56.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: DB Session ID: ODV7F0Y9XXMFUBBI5YHV 2024-09-13T15:46:56.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: CURRENT file: CURRENT 2024-09-13T15:46:56.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T15:46:56.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-13T15:46:56.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-13T15:46:56.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 99291 ; 2024-09-13T15:46:56.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.error_if_exists: 0 2024-09-13T15:46:56.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.create_if_missing: 0 2024-09-13T15:46:56.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.paranoid_checks: 1 2024-09-13T15:46:56.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T15:46:56.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T15:46:56.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T15:46:56.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.env: 0x5627a40c2bc0 2024-09-13T15:46:56.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T15:46:56.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.info_log: 0x5627c33e4b40 2024-09-13T15:46:56.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T15:46:56.500 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.statistics: (nil) 2024-09-13T15:46:56.500 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.use_fsync: 0 2024-09-13T15:46:56.500 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_log_file_size: 0 2024-09-13T15:46:56.500 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T15:46:56.500 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T15:46:56.500 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T15:46:56.500 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T15:46:56.500 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.allow_fallocate: 1 2024-09-13T15:46:56.500 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T15:46:56.501 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T15:46:56.501 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.use_direct_reads: 0 2024-09-13T15:46:56.501 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T15:46:56.501 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T15:46:56.501 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.db_log_dir: 2024-09-13T15:46:56.501 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.wal_dir: 2024-09-13T15:46:56.501 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T15:46:56.501 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T15:46:56.501 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T15:46:56.501 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T15:46:56.501 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T15:46:56.501 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T15:46:56.501 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T15:46:56.502 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T15:46:56.502 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.write_buffer_manager: 0x5627c33f2320 2024-09-13T15:46:56.502 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T15:46:56.502 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T15:46:56.502 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T15:46:56.502 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T15:46:56.502 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T15:46:56.502 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T15:46:56.502 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T15:46:56.502 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T15:46:56.502 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.unordered_write: 0 2024-09-13T15:46:56.502 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T15:46:56.502 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T15:46:56.503 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T15:46:56.503 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T15:46:56.503 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.row_cache: None 2024-09-13T15:46:56.503 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.wal_filter: None 2024-09-13T15:46:56.503 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T15:46:56.503 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T15:46:56.503 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.two_write_queues: 0 2024-09-13T15:46:56.503 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T15:46:56.503 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.wal_compression: 0 2024-09-13T15:46:56.503 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.atomic_flush: 0 2024-09-13T15:46:56.503 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T15:46:56.503 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T15:46:56.503 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T15:46:56.503 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.log_readahead_size: 0 2024-09-13T15:46:56.504 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T15:46:56.504 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T15:46:56.504 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T15:46:56.504 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T15:46:56.504 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T15:46:56.504 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T15:46:56.504 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T15:46:56.504 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_background_jobs: 2 2024-09-13T15:46:56.504 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_background_compactions: -1 2024-09-13T15:46:56.504 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_subcompactions: 1 2024-09-13T15:46:56.504 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T15:46:56.504 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T15:46:56.504 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T15:46:56.505 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T15:46:56.505 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T15:46:56.505 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T15:46:56.505 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T15:46:56.505 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T15:46:56.505 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_open_files: -1 2024-09-13T15:46:56.505 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T15:46:56.505 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T15:46:56.505 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T15:46:56.505 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T15:46:56.505 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_background_flushes: -1 2024-09-13T15:46:56.505 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Compression algorithms supported: 2024-09-13T15:46:56.505 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: kZSTD supported: 0 2024-09-13T15:46:56.506 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: kXpressCompression supported: 0 2024-09-13T15:46:56.506 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: kBZip2Compression supported: 0 2024-09-13T15:46:56.506 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T15:46:56.506 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: kLZ4Compression supported: 1 2024-09-13T15:46:56.506 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: kZlibCompression supported: 1 2024-09-13T15:46:56.506 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T15:46:56.506 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: kSnappyCompression supported: 1 2024-09-13T15:46:56.506 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T15:46:56.506 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T15:46:56.506 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-13T15:46:56.506 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T15:46:56.506 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T15:46:56.506 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.merge_operator: 2024-09-13T15:46:56.506 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compaction_filter: None 2024-09-13T15:46:56.507 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T15:46:56.507 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T15:46:56.507 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T15:46:56.507 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T15:46:56.507 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5627c33e4760) 2024-09-13T15:46:56.507 INFO:journalctl@ceph.mon.a.smithi017.stdout: cache_index_and_filter_blocks: 1 2024-09-13T15:46:56.507 INFO:journalctl@ceph.mon.a.smithi017.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T15:46:56.507 INFO:journalctl@ceph.mon.a.smithi017.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T15:46:56.507 INFO:journalctl@ceph.mon.a.smithi017.stdout: pin_top_level_index_and_filter: 1 2024-09-13T15:46:56.507 INFO:journalctl@ceph.mon.a.smithi017.stdout: index_type: 0 2024-09-13T15:46:56.507 INFO:journalctl@ceph.mon.a.smithi017.stdout: data_block_index_type: 0 2024-09-13T15:46:56.507 INFO:journalctl@ceph.mon.a.smithi017.stdout: index_shortening: 1 2024-09-13T15:46:56.507 INFO:journalctl@ceph.mon.a.smithi017.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T15:46:56.508 INFO:journalctl@ceph.mon.a.smithi017.stdout: checksum: 4 2024-09-13T15:46:56.508 INFO:journalctl@ceph.mon.a.smithi017.stdout: no_block_cache: 0 2024-09-13T15:46:56.508 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache: 0x5627c33d91f0 2024-09-13T15:46:56.508 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache_name: BinnedLRUCache 2024-09-13T15:46:56.508 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache_options: 2024-09-13T15:46:56.508 INFO:journalctl@ceph.mon.a.smithi017.stdout: capacity : 536870912 2024-09-13T15:46:56.508 INFO:journalctl@ceph.mon.a.smithi017.stdout: num_shard_bits : 4 2024-09-13T15:46:56.508 INFO:journalctl@ceph.mon.a.smithi017.stdout: strict_capacity_limit : 0 2024-09-13T15:46:56.508 INFO:journalctl@ceph.mon.a.smithi017.stdout: high_pri_pool_ratio: 0.000 2024-09-13T15:46:56.508 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache_compressed: (nil) 2024-09-13T15:46:56.508 INFO:journalctl@ceph.mon.a.smithi017.stdout: persistent_cache: (nil) 2024-09-13T15:46:56.508 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_size: 4096 2024-09-13T15:46:56.508 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_size_deviation: 10 2024-09-13T15:46:56.508 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_restart_interval: 16 2024-09-13T15:46:56.509 INFO:journalctl@ceph.mon.a.smithi017.stdout: index_block_restart_interval: 1 2024-09-13T15:46:56.509 INFO:journalctl@ceph.mon.a.smithi017.stdout: metadata_block_size: 4096 2024-09-13T15:46:56.509 INFO:journalctl@ceph.mon.a.smithi017.stdout: partition_filters: 0 2024-09-13T15:46:56.509 INFO:journalctl@ceph.mon.a.smithi017.stdout: use_delta_encoding: 1 2024-09-13T15:46:56.509 INFO:journalctl@ceph.mon.a.smithi017.stdout: filter_policy: bloomfilter 2024-09-13T15:46:56.509 INFO:journalctl@ceph.mon.a.smithi017.stdout: whole_key_filtering: 1 2024-09-13T15:46:56.509 INFO:journalctl@ceph.mon.a.smithi017.stdout: verify_compression: 0 2024-09-13T15:46:56.509 INFO:journalctl@ceph.mon.a.smithi017.stdout: read_amp_bytes_per_bit: 0 2024-09-13T15:46:56.509 INFO:journalctl@ceph.mon.a.smithi017.stdout: format_version: 5 2024-09-13T15:46:56.509 INFO:journalctl@ceph.mon.a.smithi017.stdout: enable_index_compression: 1 2024-09-13T15:46:56.509 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_align: 0 2024-09-13T15:46:56.509 INFO:journalctl@ceph.mon.a.smithi017.stdout: max_auto_readahead_size: 262144 2024-09-13T15:46:56.510 INFO:journalctl@ceph.mon.a.smithi017.stdout: prepopulate_block_cache: 0 2024-09-13T15:46:56.510 INFO:journalctl@ceph.mon.a.smithi017.stdout: initial_auto_readahead_size: 8192 2024-09-13T15:46:56.510 INFO:journalctl@ceph.mon.a.smithi017.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T15:46:56.510 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T15:46:56.510 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T15:46:56.510 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compression: NoCompression 2024-09-13T15:46:56.510 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T15:46:56.510 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T15:46:56.510 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T15:46:56.510 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.num_levels: 7 2024-09-13T15:46:56.510 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T15:46:56.510 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T15:46:56.510 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T15:46:56.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T15:46:56.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T15:46:56.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T15:46:56.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T15:46:56.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T15:46:56.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T15:46:56.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T15:46:56.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T15:46:56.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T15:46:56.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T15:46:56.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T15:46:56.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T15:46:56.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T15:46:56.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T15:46:56.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T15:46:56.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T15:46:56.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T15:46:56.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T15:46:56.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T15:46:56.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T15:46:56.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T15:46:56.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T15:46:56.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T15:46:56.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T15:46:56.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T15:46:56.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T15:46:56.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T15:46:56.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T15:46:56.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T15:46:56.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T15:46:56.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T15:46:56.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T15:46:56.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T15:46:56.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T15:46:56.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T15:46:56.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T15:46:56.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T15:46:56.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T15:46:56.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T15:46:56.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T15:46:56.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T15:46:56.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T15:46:56.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T15:46:56.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T15:46:56.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T15:46:56.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T15:46:56.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T15:46:56.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T15:46:56.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T15:46:56.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T15:46:56.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T15:46:56.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.inplace_update_support: 0 2024-09-13T15:46:56.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T15:46:56.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T15:46:56.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T15:46:56.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T15:46:56.515 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.bloom_locality: 0 2024-09-13T15:46:56.515 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.max_successive_merges: 0 2024-09-13T15:46:56.515 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T15:46:56.515 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T15:46:56.515 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T15:46:56.515 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T15:46:56.515 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.ttl: 2592000 2024-09-13T15:46:56.515 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T15:46:56.515 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T15:46:56.515 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T15:46:56.515 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.enable_blob_files: false 2024-09-13T15:46:56.515 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.min_blob_size: 0 2024-09-13T15:46:56.515 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T15:46:56.515 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T15:46:56.516 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T15:46:56.516 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T15:46:56.516 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T15:46:56.516 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T15:46:56.516 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T15:46:56.516 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T15:46:56.516 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-13T15:46:56.516 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-13T15:46:56.516 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a353cf85-01d9-48dc-a81a-ab0ee1a549cc 2024-09-13T15:46:56.516 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726242416232360, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-13T15:46:56.516 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-13T15:46:56.516 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726242416234396, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94513, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 316, "table_properties": {"data_size": 92485, "index_size": 284, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13759, "raw_average_key_size": 50, "raw_value_size": 84993, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 275, "num_filter_entries": 275, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726242416, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a353cf85-01d9-48dc-a81a-ab0ee1a549cc", "db_session_id": "ODV7F0Y9XXMFUBBI5YHV", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-13T15:46:56.516 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726242416234575, "job": 1, "event": "recovery_finished"} 2024-09-13T15:46:56.516 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-13T15:46:56.517 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T15:46:56.517 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5627c3406e00 2024-09-13T15:46:56.517 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: DB pointer 0x5627c34fa000 2024-09-13T15:46:56.517 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T15:46:56.517 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T15:46:56.517 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** DB Stats ** 2024-09-13T15:46:56.517 INFO:journalctl@ceph.mon.a.smithi017.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T15:46:56.517 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T15:46:56.517 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T15:46:56.517 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T15:46:56.517 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T15:46:56.517 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T15:46:56.517 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T15:46:56.518 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-13T15:46:56.518 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** Compaction Stats [default] ** 2024-09-13T15:46:56.518 INFO:journalctl@ceph.mon.a.smithi017.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T15:46:56.518 INFO:journalctl@ceph.mon.a.smithi017.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T15:46:56.518 INFO:journalctl@ceph.mon.a.smithi017.stdout: L0 2/0 94.16 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 62.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T15:46:56.518 INFO:journalctl@ceph.mon.a.smithi017.stdout: Sum 2/0 94.16 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 62.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T15:46:56.518 INFO:journalctl@ceph.mon.a.smithi017.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 62.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T15:46:56.518 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-13T15:46:56.518 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** Compaction Stats [default] ** 2024-09-13T15:46:56.518 INFO:journalctl@ceph.mon.a.smithi017.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T15:46:56.518 INFO:journalctl@ceph.mon.a.smithi017.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T15:46:56.518 INFO:journalctl@ceph.mon.a.smithi017.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 62.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T15:46:56.518 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-13T15:46:56.519 INFO:journalctl@ceph.mon.a.smithi017.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T15:46:56.519 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-13T15:46:56.519 INFO:journalctl@ceph.mon.a.smithi017.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T15:46:56.519 INFO:journalctl@ceph.mon.a.smithi017.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T15:46:56.519 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T15:46:56.519 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T15:46:56.519 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T15:46:56.519 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T15:46:56.519 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative compaction: 0.00 GB write, 14.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T15:46:56.519 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval compaction: 0.00 GB write, 14.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T15:46:56.519 INFO:journalctl@ceph.mon.a.smithi017.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T15:46:56.519 INFO:journalctl@ceph.mon.a.smithi017.stdout: Block cache BinnedLRUCache@0x5627c33d91f0#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-13T15:46:56.519 INFO:journalctl@ceph.mon.a.smithi017.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-13T15:46:56.519 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-13T15:46:56.520 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T15:46:56.520 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: starting mon.a rank 0 at public addrs [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] at bind addrs [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T15:46:56.520 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: mon.a@-1(???) e1 preinit fsid 3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T15:46:56.520 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: mon.a@-1(???).mds e1 new map 2024-09-13T15:46:56.520 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: mon.a@-1(???).mds e1 print_map 2024-09-13T15:46:56.520 INFO:journalctl@ceph.mon.a.smithi017.stdout: e1 2024-09-13T15:46:56.520 INFO:journalctl@ceph.mon.a.smithi017.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T15:46:56.520 INFO:journalctl@ceph.mon.a.smithi017.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T15:46:56.520 INFO:journalctl@ceph.mon.a.smithi017.stdout: legacy client fscid: -1 2024-09-13T15:46:56.520 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-13T15:46:56.520 INFO:journalctl@ceph.mon.a.smithi017.stdout: No filesystems configured 2024-09-13T15:46:56.520 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T15:46:56.520 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T15:46:56.520 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T15:46:56.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T15:46:56.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-13T15:46:56.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 bash[30475]: 14945298a9848fdf15ea3a380264236d33988d5dc2e5f6015fdb2494a21c2607 2024-09-13T15:46:56.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 systemd[1]: Started Ceph mon.a for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T15:46:56.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T15:46:56.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: monmap e1: 1 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T15:46:56.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: fsmap 2024-09-13T15:46:56.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T15:46:56.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:56 smithi017 ceph-mon[30494]: mgrmap e1: no daemons active 2024-09-13T15:46:57.398 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.722+0000 7f9126600640 1 Processor -- start 2024-09-13T15:46:57.398 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.722+0000 7f9126600640 1 -- start start 2024-09-13T15:46:57.399 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.722+0000 7f9126600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f912007f580 0x7f912007f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:46:57.399 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.722+0000 7f9126600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912007ff50 con 0x7f912007f580 2024-09-13T15:46:57.399 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.723+0000 7f911f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f912007f580 0x7f912007f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:46:57.399 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.723+0000 7f911f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f912007f580 0x7f912007f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39620/0 (socket says 172.21.15.17:39620) 2024-09-13T15:46:57.399 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.723+0000 7f911f400640 1 -- 172.21.15.17:0/688810188 learned_addr learned my addr 172.21.15.17:0/688810188 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:46:57.399 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.723+0000 7f911f400640 1 -- 172.21.15.17:0/688810188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912010cdc0 con 0x7f912007f580 2024-09-13T15:46:57.399 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.726+0000 7f911f400640 1 --2- 172.21.15.17:0/688810188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f912007f580 0x7f912007f980 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9110009820 tx=0x7f911002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e1530900a3bc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:46:57.399 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.727+0000 7f911e000640 1 -- 172.21.15.17:0/688810188 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f911002ae70 con 0x7f912007f580 2024-09-13T15:46:57.399 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.727+0000 7f911e000640 1 -- 172.21.15.17:0/688810188 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f91100328e0 con 0x7f912007f580 2024-09-13T15:46:57.399 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.727+0000 7f911e000640 1 -- 172.21.15.17:0/688810188 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91100308c0 con 0x7f912007f580 2024-09-13T15:46:57.399 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.727+0000 7f9126600640 1 -- 172.21.15.17:0/688810188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f912007f580 msgr2=0x7f912007f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:46:57.399 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.727+0000 7f9126600640 1 --2- 172.21.15.17:0/688810188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f912007f580 0x7f912007f980 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9110009820 tx=0x7f911002a270 comp rx=0 tx=0).stop 2024-09-13T15:46:57.400 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.727+0000 7f9126600640 1 -- 172.21.15.17:0/688810188 shutdown_connections 2024-09-13T15:46:57.400 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.727+0000 7f9126600640 1 --2- 172.21.15.17:0/688810188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f912007f580 0x7f912007f980 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:46:57.400 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.727+0000 7f9126600640 1 -- 172.21.15.17:0/688810188 >> 172.21.15.17:0/688810188 conn(0x7f912007ad60 msgr2=0x7f912007d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:46:57.400 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.728+0000 7f9126600640 1 -- 172.21.15.17:0/688810188 shutdown_connections 2024-09-13T15:46:57.400 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.728+0000 7f9126600640 1 -- 172.21.15.17:0/688810188 wait complete. 2024-09-13T15:46:57.400 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.728+0000 7f9126600640 1 Processor -- start 2024-09-13T15:46:57.400 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.729+0000 7f9126600640 1 -- start start 2024-09-13T15:46:57.400 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.729+0000 7f9126600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f912007f580 0x7f912019f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:46:57.400 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.729+0000 7f9126600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912019fe10 con 0x7f912007f580 2024-09-13T15:46:57.400 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.729+0000 7f911f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f912007f580 0x7f912019f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:46:57.401 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.729+0000 7f911f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f912007f580 0x7f912019f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39628/0 (socket says 172.21.15.17:39628) 2024-09-13T15:46:57.401 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.729+0000 7f911f400640 1 -- 172.21.15.17:0/4072879778 learned_addr learned my addr 172.21.15.17:0/4072879778 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:46:57.401 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.730+0000 7f911f400640 1 -- 172.21.15.17:0/4072879778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91100094d0 con 0x7f912007f580 2024-09-13T15:46:57.401 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.730+0000 7f911f400640 1 --2- 172.21.15.17:0/4072879778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f912007f580 0x7f912019f8d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f911002a790 tx=0x7f9110030e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:46:57.401 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.730+0000 7f9117e00640 1 -- 172.21.15.17:0/4072879778 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9110032d90 con 0x7f912007f580 2024-09-13T15:46:57.401 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.730+0000 7f9117e00640 1 -- 172.21.15.17:0/4072879778 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f911003b8d0 con 0x7f912007f580 2024-09-13T15:46:57.401 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.730+0000 7f9117e00640 1 -- 172.21.15.17:0/4072879778 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f911003a800 con 0x7f912007f580 2024-09-13T15:46:57.401 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.730+0000 7f9126600640 1 -- 172.21.15.17:0/4072879778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91201a0010 con 0x7f912007f580 2024-09-13T15:46:57.401 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.731+0000 7f9126600640 1 -- 172.21.15.17:0/4072879778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91201a04b0 con 0x7f912007f580 2024-09-13T15:46:57.401 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.731+0000 7f9117e00640 1 -- 172.21.15.17:0/4072879778 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f9110039040 con 0x7f912007f580 2024-09-13T15:46:57.402 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.731+0000 7f9117e00640 1 -- 172.21.15.17:0/4072879778 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9110044d00 con 0x7f912007f580 2024-09-13T15:46:57.402 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.732+0000 7f9126600640 1 -- 172.21.15.17:0/4072879778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f912010fff0 con 0x7f912007f580 2024-09-13T15:46:57.402 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.735+0000 7f9117e00640 1 -- 172.21.15.17:0/4072879778 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f9110049060 con 0x7f912007f580 2024-09-13T15:46:57.402 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.799+0000 7f9126600640 1 -- 172.21.15.17:0/4072879778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f91201101b0 con 0x7f912007f580 2024-09-13T15:46:57.402 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.802+0000 7f9117e00640 1 -- 172.21.15.17:0/4072879778 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f911003f070 con 0x7f912007f580 2024-09-13T15:46:57.402 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.803+0000 7f9126600640 1 -- 172.21.15.17:0/4072879778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f912007f580 msgr2=0x7f912019f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:46:57.402 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.803+0000 7f9126600640 1 --2- 172.21.15.17:0/4072879778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f912007f580 0x7f912019f8d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f911002a790 tx=0x7f9110030e20 comp rx=0 tx=0).stop 2024-09-13T15:46:57.402 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.803+0000 7f9126600640 1 -- 172.21.15.17:0/4072879778 shutdown_connections 2024-09-13T15:46:57.402 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.803+0000 7f9126600640 1 --2- 172.21.15.17:0/4072879778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f912007f580 0x7f912019f8d0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:46:57.403 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.803+0000 7f9126600640 1 -- 172.21.15.17:0/4072879778 >> 172.21.15.17:0/4072879778 conn(0x7f912007ad60 msgr2=0x7f912007b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:46:57.403 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.803+0000 7f9126600640 1 -- 172.21.15.17:0/4072879778 shutdown_connections 2024-09-13T15:46:57.403 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:56.803+0000 7f9126600640 1 -- 172.21.15.17:0/4072879778 wait complete. 2024-09-13T15:46:57.403 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-13T15:46:57.423 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-13T15:46:57.423 INFO:teuthology.orchestra.run.smithi017.stdout:Creating mgr... 2024-09-13T15:46:57.423 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-13T15:46:57.423 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-13T15:46:57.765 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3334a620-71e7-11ef-bceb-c7b262605968@mgr.x 2024-09-13T15:46:57.765 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3334a620-71e7-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-3334a620-71e7-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-13T15:46:58.003 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3334a620-71e7-11ef-bceb-c7b262605968.target.wants/ceph-3334a620-71e7-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-3334a620-71e7-11ef-bceb-c7b262605968@.service. 2024-09-13T15:46:58.039 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:57 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/4072879778' entity='client.admin' 2024-09-13T15:46:58.363 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:46:58 smithi017 systemd[1]: Starting Ceph mgr.x for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T15:46:58.644 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:46:58 smithi017 podman[30706]: 2024-09-13 15:46:58.266409152 +0000 UTC m=+0.027393693 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:46:58.644 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:46:58 smithi017 podman[30706]: 2024-09-13 15:46:58.366335868 +0000 UTC m=+0.127320408 container create 3d6d82a23b12c04fb00f5ba9ef69ef9b5635b3b7226c02c14e48fe46a440b0f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T15:46:58.644 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:46:58 smithi017 podman[30706]: 2024-09-13 15:46:58.551982511 +0000 UTC m=+0.312967066 container init 3d6d82a23b12c04fb00f5ba9ef69ef9b5635b3b7226c02c14e48fe46a440b0f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-13T15:46:58.645 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:46:58 smithi017 podman[30706]: 2024-09-13 15:46:58.558381973 +0000 UTC m=+0.319366514 container start 3d6d82a23b12c04fb00f5ba9ef69ef9b5635b3b7226c02c14e48fe46a440b0f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux ) 2024-09-13T15:46:58.645 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:46:58 smithi017 bash[30706]: 3d6d82a23b12c04fb00f5ba9ef69ef9b5635b3b7226c02c14e48fe46a440b0f5 2024-09-13T15:46:58.673 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T15:46:58.673 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-09-13T15:46:58.688 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T15:46:58.689 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-13T15:46:58.689 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-09-13T15:46:58.689 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T15:46:58.705 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T15:46:58.705 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-09-13T15:46:58.719 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T15:46:58.719 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-13T15:46:58.719 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-09-13T15:46:58.719 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-13T15:46:58.719 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr to start... 2024-09-13T15:46:58.720 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr... 2024-09-13T15:46:58.997 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:46:58 smithi017 systemd[1]: Started Ceph mgr.x for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T15:46:58.997 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:46:58 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:46:58.730+0000 7f2ee8175040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T15:46:58.997 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:46:58 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:46:58.803+0000 7f2ee8175040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T15:46:59.261 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:46:59 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:46:59.003+0000 7f2ee8175040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T15:46:59.261 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:46:59 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:46:59.086+0000 7f2ee8175040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T15:46:59.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:46:59 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/161218810' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T15:46:59.601 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:46:59 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:46:59.270+0000 7f2ee8175040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T15:46:59.601 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:46:59 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:46:59.450+0000 7f2ee8175040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T15:46:59.913 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:46:59 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:46:59.836+0000 7f2ee8175040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T15:46:59.917 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:46:59 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:46:59.910+0000 7f2ee8175040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T15:46:59.944 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-13T15:46:59.944 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-13T15:46:59.944 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "3334a620-71e7-11ef-bceb-c7b262605968", 2024-09-13T15:46:59.944 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T15:46:59.944 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T15:46:59.944 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T15:46:59.944 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T15:46:59.944 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-13T15:46:59.944 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T15:46:59.945 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T15:46:59.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2024-09-13T15:46:59.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-13T15:46:59.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T15:46:59.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T15:46:59.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-13T15:46:59.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-13T15:46:59.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T15:46:59.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T15:46:59.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T15:46:59.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T15:46:59.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-13T15:46:59.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T15:46:59.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T15:46:59.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T15:46:59.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T15:46:59.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T15:46:59.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T15:46:59.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T15:46:59.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T15:46:59.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-13T15:46:59.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T15:46:59.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T15:46:59.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T15:46:59.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T15:46:59.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T15:46:59.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T15:46:59.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T15:46:59.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T15:46:59.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T15:46:59.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-13T15:46:59.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T15:46:59.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T15:46:59.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T15:46:59.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T15:46:59.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-13T15:46:59.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T15:46:59.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T15:46:59.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T15:46:59.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T15:46:59.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T15:46:59.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T15:46:59.958 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T15:46:59.958 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-13T15:46:59.958 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T15:46:59.958 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-13T15:46:59.958 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T15:46:59.958 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T15:46:59.958 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T15:46:50.476256+0000", 2024-09-13T15:46:59.958 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T15:46:59.958 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-13T15:46:59.958 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T15:46:59.958 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-13T15:46:59.958 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.230+0000 7f55fe400640 1 Processor -- start 2024-09-13T15:46:59.958 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.230+0000 7f55fe400640 1 -- start start 2024-09-13T15:46:59.958 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.230+0000 7f55fe400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f81077f0 0x7f55f8107bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:46:59.959 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.230+0000 7f55fe400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f81081c0 con 0x7f55f81077f0 2024-09-13T15:46:59.959 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.231+0000 7f55f7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f81077f0 0x7f55f8107bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:46:59.959 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.231+0000 7f55f7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f81077f0 0x7f55f8107bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39382/0 (socket says 172.21.15.17:39382) 2024-09-13T15:46:59.959 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.231+0000 7f55f7400640 1 -- 172.21.15.17:0/2657749790 learned_addr learned my addr 172.21.15.17:0/2657749790 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:46:59.959 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.231+0000 7f55f7400640 1 -- 172.21.15.17:0/2657749790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f8108990 con 0x7f55f81077f0 2024-09-13T15:46:59.959 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.232+0000 7f55f7400640 1 --2- 172.21.15.17:0/2657749790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f81077f0 0x7f55f8107bf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009820 tx=0x7f55e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a270d242b318c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:46:59.959 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.232+0000 7f55f6000640 1 -- 172.21.15.17:0/2657749790 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55e802ae70 con 0x7f55f81077f0 2024-09-13T15:46:59.959 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.232+0000 7f55f6000640 1 -- 172.21.15.17:0/2657749790 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f55e80328e0 con 0x7f55f81077f0 2024-09-13T15:46:59.959 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.232+0000 7f55f6000640 1 -- 172.21.15.17:0/2657749790 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55e80308c0 con 0x7f55f81077f0 2024-09-13T15:46:59.959 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.233+0000 7f55fe400640 1 -- 172.21.15.17:0/2657749790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f81077f0 msgr2=0x7f55f8107bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:46:59.959 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.233+0000 7f55fe400640 1 --2- 172.21.15.17:0/2657749790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f81077f0 0x7f55f8107bf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009820 tx=0x7f55e802a270 comp rx=0 tx=0).stop 2024-09-13T15:46:59.959 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.233+0000 7f55fe400640 1 -- 172.21.15.17:0/2657749790 shutdown_connections 2024-09-13T15:46:59.959 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.233+0000 7f55fe400640 1 --2- 172.21.15.17:0/2657749790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f81077f0 0x7f55f8107bf0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:46:59.960 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.233+0000 7f55fe400640 1 -- 172.21.15.17:0/2657749790 >> 172.21.15.17:0/2657749790 conn(0x7f55f807ad80 msgr2=0x7f55f807b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:46:59.960 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.233+0000 7f55fe400640 1 -- 172.21.15.17:0/2657749790 shutdown_connections 2024-09-13T15:46:59.960 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.233+0000 7f55fe400640 1 -- 172.21.15.17:0/2657749790 wait complete. 2024-09-13T15:46:59.960 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.234+0000 7f55fe400640 1 Processor -- start 2024-09-13T15:46:59.960 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.234+0000 7f55fe400640 1 -- start start 2024-09-13T15:46:59.960 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.235+0000 7f55fe400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f81077f0 0x7f55f819b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:46:59.960 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.235+0000 7f55fe400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f819b9e0 con 0x7f55f81077f0 2024-09-13T15:46:59.960 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.235+0000 7f55f7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f81077f0 0x7f55f819b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:46:59.960 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.235+0000 7f55f7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f81077f0 0x7f55f819b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39386/0 (socket says 172.21.15.17:39386) 2024-09-13T15:46:59.960 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.235+0000 7f55f7400640 1 -- 172.21.15.17:0/161218810 learned_addr learned my addr 172.21.15.17:0/161218810 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:46:59.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.235+0000 7f55f7400640 1 -- 172.21.15.17:0/161218810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e80094d0 con 0x7f55f81077f0 2024-09-13T15:46:59.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.236+0000 7f55f7400640 1 --2- 172.21.15.17:0/161218810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f81077f0 0x7f55f819b4a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f55e80097f0 tx=0x7f55e8030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:46:59.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.236+0000 7f55efe00640 1 -- 172.21.15.17:0/161218810 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55e8032d90 con 0x7f55f81077f0 2024-09-13T15:46:59.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.236+0000 7f55efe00640 1 -- 172.21.15.17:0/161218810 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f55e803b8d0 con 0x7f55f81077f0 2024-09-13T15:46:59.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.236+0000 7f55fe400640 1 -- 172.21.15.17:0/161218810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f819bbe0 con 0x7f55f81077f0 2024-09-13T15:46:59.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.236+0000 7f55efe00640 1 -- 172.21.15.17:0/161218810 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55e803a780 con 0x7f55f81077f0 2024-09-13T15:46:59.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.236+0000 7f55fe400640 1 -- 172.21.15.17:0/161218810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f819c080 con 0x7f55f81077f0 2024-09-13T15:46:59.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.237+0000 7f55efe00640 1 -- 172.21.15.17:0/161218810 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f55e8039040 con 0x7f55f81077f0 2024-09-13T15:46:59.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.237+0000 7f55efe00640 1 -- 172.21.15.17:0/161218810 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f55e804c350 con 0x7f55f81077f0 2024-09-13T15:46:59.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.237+0000 7f55fe400640 1 -- 172.21.15.17:0/161218810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f810bbc0 con 0x7f55f81077f0 2024-09-13T15:46:59.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.240+0000 7f55efe00640 1 -- 172.21.15.17:0/161218810 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f55e8049060 con 0x7f55f81077f0 2024-09-13T15:46:59.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.304+0000 7f55fe400640 1 -- 172.21.15.17:0/161218810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f55f810bd80 con 0x7f55f81077f0 2024-09-13T15:46:59.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.305+0000 7f55efe00640 1 -- 172.21.15.17:0/161218810 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f55e803f070 con 0x7f55f81077f0 2024-09-13T15:46:59.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.306+0000 7f55fe400640 1 -- 172.21.15.17:0/161218810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f81077f0 msgr2=0x7f55f819b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:46:59.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.306+0000 7f55fe400640 1 --2- 172.21.15.17:0/161218810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f81077f0 0x7f55f819b4a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f55e80097f0 tx=0x7f55e8030db0 comp rx=0 tx=0).stop 2024-09-13T15:46:59.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.306+0000 7f55fe400640 1 -- 172.21.15.17:0/161218810 shutdown_connections 2024-09-13T15:46:59.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.306+0000 7f55fe400640 1 --2- 172.21.15.17:0/161218810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f81077f0 0x7f55f819b4a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:46:59.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.306+0000 7f55fe400640 1 -- 172.21.15.17:0/161218810 >> 172.21.15.17:0/161218810 conn(0x7f55f807ad80 msgr2=0x7f55f81054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:46:59.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.306+0000 7f55fe400640 1 -- 172.21.15.17:0/161218810 shutdown_connections 2024-09-13T15:46:59.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:46:59.306+0000 7f55fe400640 1 -- 172.21.15.17:0/161218810 wait complete. 2024-09-13T15:46:59.962 INFO:teuthology.orchestra.run.smithi017.stdout:mgr not available, waiting (1/15)... 2024-09-13T15:47:00.261 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:00 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:00.134+0000 7f2ee8175040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T15:47:01.761 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:01 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:01.267+0000 7f2ee8175040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T15:47:01.761 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:01 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:01.348+0000 7f2ee8175040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T15:47:02.344 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:02 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:02.336+0000 7f2ee8175040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T15:47:02.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:02 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1199967584' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T15:47:02.689 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:02 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:02.492+0000 7f2ee8175040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T15:47:02.689 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:02 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:02.687+0000 7f2ee8175040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T15:47:02.945 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:02 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:02.764+0000 7f2ee8175040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T15:47:02.946 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:02 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:02.943+0000 7f2ee8175040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T15:47:03.256 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:03 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:03.030+0000 7f2ee8175040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T15:47:03.256 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:03 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:03.104+0000 7f2ee8175040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T15:47:03.273 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-13T15:47:03.273 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-13T15:47:03.273 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "3334a620-71e7-11ef-bceb-c7b262605968", 2024-09-13T15:47:03.273 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T15:47:03.273 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T15:47:03.274 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T15:47:03.274 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T15:47:03.274 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-13T15:47:03.274 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T15:47:03.274 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T15:47:03.274 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2024-09-13T15:47:03.274 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-13T15:47:03.274 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T15:47:03.274 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T15:47:03.274 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-13T15:47:03.274 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-13T15:47:03.274 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T15:47:03.275 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T15:47:03.275 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T15:47:03.275 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T15:47:03.275 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-13T15:47:03.275 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T15:47:03.275 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T15:47:03.275 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T15:47:03.275 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T15:47:03.275 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T15:47:03.275 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T15:47:03.275 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T15:47:03.275 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T15:47:03.275 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-13T15:47:03.275 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T15:47:03.275 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T15:47:03.276 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T15:47:03.276 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T15:47:03.276 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T15:47:03.276 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T15:47:03.276 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T15:47:03.276 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T15:47:03.276 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T15:47:03.276 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-13T15:47:03.276 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T15:47:03.276 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T15:47:03.276 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T15:47:03.276 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T15:47:03.276 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-13T15:47:03.277 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T15:47:03.277 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T15:47:03.277 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T15:47:03.277 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T15:47:03.277 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T15:47:03.277 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T15:47:03.277 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T15:47:03.277 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-13T15:47:03.277 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T15:47:03.277 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-13T15:47:03.277 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T15:47:03.277 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T15:47:03.277 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T15:46:50.476256+0000", 2024-09-13T15:47:03.277 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T15:47:03.278 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-13T15:47:03.278 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T15:47:03.278 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-13T15:47:03.278 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.451+0000 7f6179000640 1 Processor -- start 2024-09-13T15:47:03.278 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.451+0000 7f6179000640 1 -- start start 2024-09-13T15:47:03.278 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.451+0000 7f6179000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61741077f0 0x7f6174107bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:03.278 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.451+0000 7f6179000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61741081c0 con 0x7f61741077f0 2024-09-13T15:47:03.278 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.452+0000 7f6171e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61741077f0 0x7f6174107bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:03.278 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.452+0000 7f6171e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61741077f0 0x7f6174107bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39402/0 (socket says 172.21.15.17:39402) 2024-09-13T15:47:03.278 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.452+0000 7f6171e00640 1 -- 172.21.15.17:0/2065805621 learned_addr learned my addr 172.21.15.17:0/2065805621 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:03.278 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.452+0000 7f6171e00640 1 -- 172.21.15.17:0/2065805621 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6174108990 con 0x7f61741077f0 2024-09-13T15:47:03.278 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.453+0000 7f6171e00640 1 --2- 172.21.15.17:0/2065805621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61741077f0 0x7f6174107bf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6164009820 tx=0x7f616402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff1a909855c7451 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:03.278 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.454+0000 7f6170a00640 1 -- 172.21.15.17:0/2065805621 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f616402ae70 con 0x7f61741077f0 2024-09-13T15:47:03.279 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.454+0000 7f6170a00640 1 -- 172.21.15.17:0/2065805621 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f61640328e0 con 0x7f61741077f0 2024-09-13T15:47:03.279 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.454+0000 7f6170a00640 1 -- 172.21.15.17:0/2065805621 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61640308c0 con 0x7f61741077f0 2024-09-13T15:47:03.279 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.454+0000 7f6179000640 1 -- 172.21.15.17:0/2065805621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61741077f0 msgr2=0x7f6174107bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:03.279 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.454+0000 7f6179000640 1 --2- 172.21.15.17:0/2065805621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61741077f0 0x7f6174107bf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6164009820 tx=0x7f616402a270 comp rx=0 tx=0).stop 2024-09-13T15:47:03.279 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.454+0000 7f6179000640 1 -- 172.21.15.17:0/2065805621 shutdown_connections 2024-09-13T15:47:03.279 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.454+0000 7f6179000640 1 --2- 172.21.15.17:0/2065805621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61741077f0 0x7f6174107bf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:03.279 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.454+0000 7f6179000640 1 -- 172.21.15.17:0/2065805621 >> 172.21.15.17:0/2065805621 conn(0x7f617407ad80 msgr2=0x7f617407b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:03.279 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.455+0000 7f6179000640 1 -- 172.21.15.17:0/2065805621 shutdown_connections 2024-09-13T15:47:03.279 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.455+0000 7f6179000640 1 -- 172.21.15.17:0/2065805621 wait complete. 2024-09-13T15:47:03.279 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.456+0000 7f6179000640 1 Processor -- start 2024-09-13T15:47:03.279 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.456+0000 7f6179000640 1 -- start start 2024-09-13T15:47:03.279 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.456+0000 7f6179000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61741077f0 0x7f617419b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:03.279 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.456+0000 7f6179000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617419b9e0 con 0x7f61741077f0 2024-09-13T15:47:03.280 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.456+0000 7f6171e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61741077f0 0x7f617419b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:03.280 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.456+0000 7f6171e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61741077f0 0x7f617419b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39404/0 (socket says 172.21.15.17:39404) 2024-09-13T15:47:03.280 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.456+0000 7f6171e00640 1 -- 172.21.15.17:0/1199967584 learned_addr learned my addr 172.21.15.17:0/1199967584 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:03.280 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.457+0000 7f6171e00640 1 -- 172.21.15.17:0/1199967584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61640094d0 con 0x7f61741077f0 2024-09-13T15:47:03.280 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.457+0000 7f6171e00640 1 --2- 172.21.15.17:0/1199967584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61741077f0 0x7f617419b4a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f61640097f0 tx=0x7f6164030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:03.280 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.457+0000 7f616aa00640 1 -- 172.21.15.17:0/1199967584 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6164032d90 con 0x7f61741077f0 2024-09-13T15:47:03.280 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.457+0000 7f616aa00640 1 -- 172.21.15.17:0/1199967584 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f616403b8d0 con 0x7f61741077f0 2024-09-13T15:47:03.280 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.457+0000 7f616aa00640 1 -- 172.21.15.17:0/1199967584 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f616403a780 con 0x7f61741077f0 2024-09-13T15:47:03.280 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.457+0000 7f6179000640 1 -- 172.21.15.17:0/1199967584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617419bbe0 con 0x7f61741077f0 2024-09-13T15:47:03.280 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.457+0000 7f6179000640 1 -- 172.21.15.17:0/1199967584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617419c080 con 0x7f61741077f0 2024-09-13T15:47:03.281 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.458+0000 7f616aa00640 1 -- 172.21.15.17:0/1199967584 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6164039040 con 0x7f61741077f0 2024-09-13T15:47:03.281 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.458+0000 7f616aa00640 1 -- 172.21.15.17:0/1199967584 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f616404c350 con 0x7f61741077f0 2024-09-13T15:47:03.281 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.459+0000 7f6179000640 1 -- 172.21.15.17:0/1199967584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617410bbc0 con 0x7f61741077f0 2024-09-13T15:47:03.281 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.461+0000 7f616aa00640 1 -- 172.21.15.17:0/1199967584 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f6164049060 con 0x7f61741077f0 2024-09-13T15:47:03.281 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.540+0000 7f6179000640 1 -- 172.21.15.17:0/1199967584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f617410bd80 con 0x7f61741077f0 2024-09-13T15:47:03.281 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.541+0000 7f616aa00640 1 -- 172.21.15.17:0/1199967584 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f6164052090 con 0x7f61741077f0 2024-09-13T15:47:03.281 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.542+0000 7f6179000640 1 -- 172.21.15.17:0/1199967584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61741077f0 msgr2=0x7f617419b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:03.281 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.542+0000 7f6179000640 1 --2- 172.21.15.17:0/1199967584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61741077f0 0x7f617419b4a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f61640097f0 tx=0x7f6164030db0 comp rx=0 tx=0).stop 2024-09-13T15:47:03.281 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.542+0000 7f6179000640 1 -- 172.21.15.17:0/1199967584 shutdown_connections 2024-09-13T15:47:03.281 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.542+0000 7f6179000640 1 --2- 172.21.15.17:0/1199967584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61741077f0 0x7f617419b4a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:03.281 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.542+0000 7f6179000640 1 -- 172.21.15.17:0/1199967584 >> 172.21.15.17:0/1199967584 conn(0x7f617407ad80 msgr2=0x7f61741054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:03.281 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.542+0000 7f6179000640 1 -- 172.21.15.17:0/1199967584 shutdown_connections 2024-09-13T15:47:03.281 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:02.542+0000 7f6179000640 1 -- 172.21.15.17:0/1199967584 wait complete. 2024-09-13T15:47:03.281 INFO:teuthology.orchestra.run.smithi017.stdout:mgr not available, waiting (2/15)... 2024-09-13T15:47:03.511 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:03 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:03.295+0000 7f2ee8175040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T15:47:03.511 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:03 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:03.375+0000 7f2ee8175040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T15:47:03.511 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:03 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:03.457+0000 7f2ee8175040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T15:47:04.011 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:03 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:03.557+0000 7f2ee8175040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T15:47:04.011 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:03 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:03.630+0000 7f2ee8175040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T15:47:04.011 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:03 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:03.702+0000 7f2ee8175040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T15:47:05.011 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:04 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:04.639+0000 7f2ee8175040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T15:47:05.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:04 smithi017 ceph-mon[30494]: Activating manager daemon x 2024-09-13T15:47:05.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:04 smithi017 ceph-mon[30494]: mgrmap e2: x(active, starting, since 0.00388737s) 2024-09-13T15:47:05.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:04 smithi017 ceph-mon[30494]: from='mgr.14100 172.21.15.17:0/2769085152' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T15:47:05.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:04 smithi017 ceph-mon[30494]: from='mgr.14100 172.21.15.17:0/2769085152' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T15:47:05.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:04 smithi017 ceph-mon[30494]: from='mgr.14100 172.21.15.17:0/2769085152' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T15:47:05.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:04 smithi017 ceph-mon[30494]: from='mgr.14100 172.21.15.17:0/2769085152' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T15:47:05.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:04 smithi017 ceph-mon[30494]: from='mgr.14100 172.21.15.17:0/2769085152' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-13T15:47:05.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:04 smithi017 ceph-mon[30494]: Manager daemon x is now available 2024-09-13T15:47:05.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:04 smithi017 ceph-mon[30494]: from='mgr.14100 172.21.15.17:0/2769085152' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T15:47:05.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:04 smithi017 ceph-mon[30494]: from='mgr.14100 172.21.15.17:0/2769085152' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T15:47:05.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:04 smithi017 ceph-mon[30494]: from='mgr.14100 172.21.15.17:0/2769085152' entity='mgr.x' 2024-09-13T15:47:05.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:04 smithi017 ceph-mon[30494]: from='mgr.14100 172.21.15.17:0/2769085152' entity='mgr.x' 2024-09-13T15:47:05.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:04 smithi017 ceph-mon[30494]: from='mgr.14100 172.21.15.17:0/2769085152' entity='mgr.x' 2024-09-13T15:47:06.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:06 smithi017 ceph-mon[30494]: mgrmap e3: x(active, since 1.00885s) 2024-09-13T15:47:06.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:06 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/2373536571' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T15:47:06.872 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-13T15:47:06.872 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-13T15:47:06.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "3334a620-71e7-11ef-bceb-c7b262605968", 2024-09-13T15:47:06.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T15:47:06.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T15:47:06.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T15:47:06.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T15:47:06.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-13T15:47:06.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T15:47:06.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T15:47:06.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2024-09-13T15:47:06.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-13T15:47:06.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T15:47:06.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T15:47:06.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-13T15:47:06.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-13T15:47:06.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T15:47:06.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T15:47:06.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T15:47:06.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T15:47:06.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-13T15:47:06.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T15:47:06.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T15:47:06.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T15:47:06.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T15:47:06.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T15:47:06.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T15:47:06.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T15:47:06.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T15:47:06.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-13T15:47:06.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T15:47:06.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T15:47:06.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T15:47:06.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T15:47:06.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T15:47:06.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T15:47:06.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T15:47:06.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T15:47:06.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T15:47:06.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-13T15:47:06.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T15:47:06.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T15:47:06.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T15:47:06.876 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T15:47:06.876 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-13T15:47:06.876 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T15:47:06.876 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T15:47:06.876 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T15:47:06.876 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T15:47:06.876 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T15:47:06.876 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T15:47:06.876 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T15:47:06.876 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-13T15:47:06.876 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T15:47:06.876 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-13T15:47:06.876 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T15:47:06.877 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T15:47:06.877 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T15:46:50.476256+0000", 2024-09-13T15:47:06.877 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T15:47:06.877 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-13T15:47:06.877 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T15:47:06.877 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-13T15:47:06.877 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.791+0000 7fa946200640 1 Processor -- start 2024-09-13T15:47:06.877 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.791+0000 7fa946200640 1 -- start start 2024-09-13T15:47:06.877 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.791+0000 7fa946200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9401077f0 0x7fa940107bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:06.877 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.791+0000 7fa946200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9401081c0 con 0x7fa9401077f0 2024-09-13T15:47:06.877 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.792+0000 7fa93f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9401077f0 0x7fa940107bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:06.877 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.792+0000 7fa93f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9401077f0 0x7fa940107bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39456/0 (socket says 172.21.15.17:39456) 2024-09-13T15:47:06.877 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.792+0000 7fa93f400640 1 -- 172.21.15.17:0/2257975675 learned_addr learned my addr 172.21.15.17:0/2257975675 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:06.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.792+0000 7fa93f400640 1 -- 172.21.15.17:0/2257975675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa940108990 con 0x7fa9401077f0 2024-09-13T15:47:06.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.793+0000 7fa93f400640 1 --2- 172.21.15.17:0/2257975675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9401077f0 0x7fa940107bf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa930009820 tx=0x7fa93002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6b6e1ec46cf23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:06.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.793+0000 7fa93ea00640 1 -- 172.21.15.17:0/2257975675 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa93002ae70 con 0x7fa9401077f0 2024-09-13T15:47:06.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.793+0000 7fa93ea00640 1 -- 172.21.15.17:0/2257975675 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa9300328e0 con 0x7fa9401077f0 2024-09-13T15:47:06.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.793+0000 7fa93ea00640 1 -- 172.21.15.17:0/2257975675 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9300308c0 con 0x7fa9401077f0 2024-09-13T15:47:06.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.794+0000 7fa946200640 1 -- 172.21.15.17:0/2257975675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9401077f0 msgr2=0x7fa940107bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:06.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.794+0000 7fa946200640 1 --2- 172.21.15.17:0/2257975675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9401077f0 0x7fa940107bf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa930009820 tx=0x7fa93002a270 comp rx=0 tx=0).stop 2024-09-13T15:47:06.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.794+0000 7fa946200640 1 -- 172.21.15.17:0/2257975675 shutdown_connections 2024-09-13T15:47:06.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.794+0000 7fa946200640 1 --2- 172.21.15.17:0/2257975675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9401077f0 0x7fa940107bf0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:06.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.794+0000 7fa946200640 1 -- 172.21.15.17:0/2257975675 >> 172.21.15.17:0/2257975675 conn(0x7fa94007ad80 msgr2=0x7fa94007b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:06.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.794+0000 7fa946200640 1 -- 172.21.15.17:0/2257975675 shutdown_connections 2024-09-13T15:47:06.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.794+0000 7fa946200640 1 -- 172.21.15.17:0/2257975675 wait complete. 2024-09-13T15:47:06.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.795+0000 7fa946200640 1 Processor -- start 2024-09-13T15:47:06.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.795+0000 7fa946200640 1 -- start start 2024-09-13T15:47:06.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.796+0000 7fa946200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9401077f0 0x7fa94019b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:06.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.796+0000 7fa946200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94019b9e0 con 0x7fa9401077f0 2024-09-13T15:47:06.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.796+0000 7fa93f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9401077f0 0x7fa94019b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:06.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.796+0000 7fa93f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9401077f0 0x7fa94019b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39458/0 (socket says 172.21.15.17:39458) 2024-09-13T15:47:06.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.796+0000 7fa93f400640 1 -- 172.21.15.17:0/2373536571 learned_addr learned my addr 172.21.15.17:0/2373536571 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:06.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.796+0000 7fa93f400640 1 -- 172.21.15.17:0/2373536571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9300094d0 con 0x7fa9401077f0 2024-09-13T15:47:06.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.796+0000 7fa93f400640 1 --2- 172.21.15.17:0/2373536571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9401077f0 0x7fa94019b4a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa9300305d0 tx=0x7fa930032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:06.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.797+0000 7fa93cc00640 1 -- 172.21.15.17:0/2373536571 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa930032c60 con 0x7fa9401077f0 2024-09-13T15:47:06.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.797+0000 7fa93cc00640 1 -- 172.21.15.17:0/2373536571 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa930032dc0 con 0x7fa9401077f0 2024-09-13T15:47:06.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.797+0000 7fa93cc00640 1 -- 172.21.15.17:0/2373536571 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa93003a740 con 0x7fa9401077f0 2024-09-13T15:47:06.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.797+0000 7fa946200640 1 -- 172.21.15.17:0/2373536571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94019bbe0 con 0x7fa9401077f0 2024-09-13T15:47:06.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.797+0000 7fa946200640 1 -- 172.21.15.17:0/2373536571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94019c080 con 0x7fa9401077f0 2024-09-13T15:47:06.880 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.798+0000 7fa93cc00640 1 -- 172.21.15.17:0/2373536571 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 3) v1 ==== 45424+0+0 (secure 0 0 0) 0x7fa930039040 con 0x7fa9401077f0 2024-09-13T15:47:06.880 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.798+0000 7fa946200640 1 -- 172.21.15.17:0/2373536571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa94010bbc0 con 0x7fa9401077f0 2024-09-13T15:47:06.880 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.798+0000 7fa93cc00640 1 --2- 172.21.15.17:0/2373536571 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7fa924038500 0x7fa92403a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:06.880 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.798+0000 7fa93cc00640 1 -- 172.21.15.17:0/2373536571 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa93006b460 con 0x7fa9401077f0 2024-09-13T15:47:06.880 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.799+0000 7fa936a00640 1 --2- 172.21.15.17:0/2373536571 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7fa924038500 0x7fa92403a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:06.880 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.799+0000 7fa936a00640 1 --2- 172.21.15.17:0/2373536571 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7fa924038500 0x7fa92403a9c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa9280098c0 tx=0x7fa928006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:06.880 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:05.804+0000 7fa93cc00640 1 -- 172.21.15.17:0/2373536571 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa9300313a0 con 0x7fa9401077f0 2024-09-13T15:47:06.880 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:06.050+0000 7fa946200640 1 -- 172.21.15.17:0/2373536571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fa94010be00 con 0x7fa9401077f0 2024-09-13T15:47:06.880 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:06.050+0000 7fa93cc00640 1 -- 172.21.15.17:0/2373536571 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1237 (secure 0 0 0) 0x7fa93003f090 con 0x7fa9401077f0 2024-09-13T15:47:06.880 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:06.052+0000 7fa946200640 1 -- 172.21.15.17:0/2373536571 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7fa924038500 msgr2=0x7fa92403a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:06.880 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:06.052+0000 7fa946200640 1 --2- 172.21.15.17:0/2373536571 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7fa924038500 0x7fa92403a9c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa9280098c0 tx=0x7fa928006db0 comp rx=0 tx=0).stop 2024-09-13T15:47:06.880 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:06.052+0000 7fa946200640 1 -- 172.21.15.17:0/2373536571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9401077f0 msgr2=0x7fa94019b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:06.880 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:06.052+0000 7fa946200640 1 --2- 172.21.15.17:0/2373536571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9401077f0 0x7fa94019b4a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa9300305d0 tx=0x7fa930032670 comp rx=0 tx=0).stop 2024-09-13T15:47:06.881 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:06.052+0000 7fa946200640 1 -- 172.21.15.17:0/2373536571 shutdown_connections 2024-09-13T15:47:06.881 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:06.052+0000 7fa946200640 1 --2- 172.21.15.17:0/2373536571 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7fa924038500 0x7fa92403a9c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:06.881 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:06.053+0000 7fa946200640 1 --2- 172.21.15.17:0/2373536571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9401077f0 0x7fa94019b4a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:06.881 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:06.053+0000 7fa946200640 1 -- 172.21.15.17:0/2373536571 >> 172.21.15.17:0/2373536571 conn(0x7fa94007ad80 msgr2=0x7fa9401054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:06.881 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:06.053+0000 7fa946200640 1 -- 172.21.15.17:0/2373536571 shutdown_connections 2024-09-13T15:47:06.881 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:06.053+0000 7fa946200640 1 -- 172.21.15.17:0/2373536571 wait complete. 2024-09-13T15:47:06.881 INFO:teuthology.orchestra.run.smithi017.stdout:mgr is available 2024-09-13T15:47:07.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:07 smithi017 ceph-mon[30494]: mgrmap e4: x(active, since 2s) 2024-09-13T15:47:07.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:07 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/781723175' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T15:47:08.247 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-13T15:47:08.247 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T15:47:08.247 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout fsid = 3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T15:47:08.247 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T15:47:08.247 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T15:47:08.247 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T15:47:08.247 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T15:47:08.247 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-13T15:47:08.247 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T15:47:08.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T15:47:08.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-13T15:47:08.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T15:47:08.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T15:47:08.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T15:47:08.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T15:47:08.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T15:47:08.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T15:47:08.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.454+0000 7f271da00640 1 Processor -- start 2024-09-13T15:47:08.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.454+0000 7f271da00640 1 -- start start 2024-09-13T15:47:08.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.454+0000 7f271da00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27181077f0 0x7f2718107bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:08.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.454+0000 7f271da00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27181081c0 con 0x7f27181077f0 2024-09-13T15:47:08.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.455+0000 7f2716a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27181077f0 0x7f2718107bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:08.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.455+0000 7f2716a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27181077f0 0x7f2718107bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39460/0 (socket says 172.21.15.17:39460) 2024-09-13T15:47:08.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.455+0000 7f2716a00640 1 -- 172.21.15.17:0/1559684977 learned_addr learned my addr 172.21.15.17:0/1559684977 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:08.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.455+0000 7f2716a00640 1 -- 172.21.15.17:0/1559684977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2718108990 con 0x7f27181077f0 2024-09-13T15:47:08.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.456+0000 7f2716a00640 1 --2- 172.21.15.17:0/1559684977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27181077f0 0x7f2718107bf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2708009820 tx=0x7f270802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee089d993763e98 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:08.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.456+0000 7f2716000640 1 -- 172.21.15.17:0/1559684977 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f270802ae70 con 0x7f27181077f0 2024-09-13T15:47:08.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.456+0000 7f2716000640 1 -- 172.21.15.17:0/1559684977 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f27080328e0 con 0x7f27181077f0 2024-09-13T15:47:08.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.456+0000 7f2716000640 1 -- 172.21.15.17:0/1559684977 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27080308c0 con 0x7f27181077f0 2024-09-13T15:47:08.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.457+0000 7f271da00640 1 -- 172.21.15.17:0/1559684977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27181077f0 msgr2=0x7f2718107bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:08.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.457+0000 7f271da00640 1 --2- 172.21.15.17:0/1559684977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27181077f0 0x7f2718107bf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2708009820 tx=0x7f270802a270 comp rx=0 tx=0).stop 2024-09-13T15:47:08.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.457+0000 7f271da00640 1 -- 172.21.15.17:0/1559684977 shutdown_connections 2024-09-13T15:47:08.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.457+0000 7f271da00640 1 --2- 172.21.15.17:0/1559684977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27181077f0 0x7f2718107bf0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:08.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.457+0000 7f271da00640 1 -- 172.21.15.17:0/1559684977 >> 172.21.15.17:0/1559684977 conn(0x7f271807ad80 msgr2=0x7f271807b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:08.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.457+0000 7f271da00640 1 -- 172.21.15.17:0/1559684977 shutdown_connections 2024-09-13T15:47:08.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.457+0000 7f271da00640 1 -- 172.21.15.17:0/1559684977 wait complete. 2024-09-13T15:47:08.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.458+0000 7f271da00640 1 Processor -- start 2024-09-13T15:47:08.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.458+0000 7f271da00640 1 -- start start 2024-09-13T15:47:08.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.458+0000 7f271da00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27181077f0 0x7f271819b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:08.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.458+0000 7f271da00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271819b9e0 con 0x7f27181077f0 2024-09-13T15:47:08.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.459+0000 7f2716a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27181077f0 0x7f271819b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:08.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.459+0000 7f2716a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27181077f0 0x7f271819b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39462/0 (socket says 172.21.15.17:39462) 2024-09-13T15:47:08.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.459+0000 7f2716a00640 1 -- 172.21.15.17:0/781723175 learned_addr learned my addr 172.21.15.17:0/781723175 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:08.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.459+0000 7f2716a00640 1 -- 172.21.15.17:0/781723175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27080094d0 con 0x7f27181077f0 2024-09-13T15:47:08.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.459+0000 7f2716a00640 1 --2- 172.21.15.17:0/781723175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27181077f0 0x7f271819b4a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f27080305d0 tx=0x7f2708032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:08.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.460+0000 7f270fe00640 1 -- 172.21.15.17:0/781723175 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2708032c60 con 0x7f27181077f0 2024-09-13T15:47:08.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.460+0000 7f270fe00640 1 -- 172.21.15.17:0/781723175 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2708032dc0 con 0x7f27181077f0 2024-09-13T15:47:08.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.460+0000 7f270fe00640 1 -- 172.21.15.17:0/781723175 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f270803a740 con 0x7f27181077f0 2024-09-13T15:47:08.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.460+0000 7f271da00640 1 -- 172.21.15.17:0/781723175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271819bbe0 con 0x7f27181077f0 2024-09-13T15:47:08.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.460+0000 7f271da00640 1 -- 172.21.15.17:0/781723175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271819c080 con 0x7f27181077f0 2024-09-13T15:47:08.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.461+0000 7f270fe00640 1 -- 172.21.15.17:0/781723175 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7f2708039040 con 0x7f27181077f0 2024-09-13T15:47:08.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.461+0000 7f271da00640 1 -- 172.21.15.17:0/781723175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f271810bbc0 con 0x7f27181077f0 2024-09-13T15:47:08.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.461+0000 7f270fe00640 1 --2- 172.21.15.17:0/781723175 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7f26fc038620 0x7f26fc03aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:08.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.461+0000 7f270fe00640 1 -- 172.21.15.17:0/781723175 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f270806b6b0 con 0x7f27181077f0 2024-09-13T15:47:08.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.461+0000 7f270e000640 1 --2- 172.21.15.17:0/781723175 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7f26fc038620 0x7f26fc03aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:08.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.462+0000 7f270e000640 1 --2- 172.21.15.17:0/781723175 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7f26fc038620 0x7f26fc03aae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f27000098c0 tx=0x7f2700006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:08.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.467+0000 7f270fe00640 1 -- 172.21.15.17:0/781723175 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2708031580 con 0x7f27181077f0 2024-09-13T15:47:08.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.646+0000 7f271da00640 1 -- 172.21.15.17:0/781723175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f271810be00 con 0x7f27181077f0 2024-09-13T15:47:08.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.648+0000 7f270fe00640 1 -- 172.21.15.17:0/781723175 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f270803f020 con 0x7f27181077f0 2024-09-13T15:47:08.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.650+0000 7f271da00640 1 -- 172.21.15.17:0/781723175 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7f26fc038620 msgr2=0x7f26fc03aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:08.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.650+0000 7f271da00640 1 --2- 172.21.15.17:0/781723175 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7f26fc038620 0x7f26fc03aae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f27000098c0 tx=0x7f2700006db0 comp rx=0 tx=0).stop 2024-09-13T15:47:08.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.650+0000 7f271da00640 1 -- 172.21.15.17:0/781723175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27181077f0 msgr2=0x7f271819b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:08.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.650+0000 7f271da00640 1 --2- 172.21.15.17:0/781723175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27181077f0 0x7f271819b4a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f27080305d0 tx=0x7f2708032670 comp rx=0 tx=0).stop 2024-09-13T15:47:08.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.650+0000 7f271da00640 1 -- 172.21.15.17:0/781723175 shutdown_connections 2024-09-13T15:47:08.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.650+0000 7f271da00640 1 --2- 172.21.15.17:0/781723175 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7f26fc038620 0x7f26fc03aae0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:08.252 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.650+0000 7f271da00640 1 --2- 172.21.15.17:0/781723175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27181077f0 0x7f271819b4a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:08.252 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.650+0000 7f271da00640 1 -- 172.21.15.17:0/781723175 >> 172.21.15.17:0/781723175 conn(0x7f271807ad80 msgr2=0x7f27181054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:08.252 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.650+0000 7f271da00640 1 -- 172.21.15.17:0/781723175 shutdown_connections 2024-09-13T15:47:08.252 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:07.650+0000 7f271da00640 1 -- 172.21.15.17:0/781723175 wait complete. 2024-09-13T15:47:08.252 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling cephadm module... 2024-09-13T15:47:09.243 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:09 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/13665340' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-13T15:47:09.243 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:09 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: ignoring --setuser ceph since I am not root 2024-09-13T15:47:09.243 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:09 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: ignoring --setgroup ceph since I am not root 2024-09-13T15:47:09.243 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:09 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:09.241+0000 7f9487e19040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T15:47:09.507 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:09 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:09.313+0000 7f9487e19040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T15:47:09.507 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:09 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:09.505+0000 7f9487e19040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T15:47:09.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.728+0000 7fa8f8e00640 1 Processor -- start 2024-09-13T15:47:09.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.728+0000 7fa8f8e00640 1 -- start start 2024-09-13T15:47:09.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.728+0000 7fa8f8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4105580 0x7fa8f4105980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:09.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.728+0000 7fa8f8e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f4105f50 con 0x7fa8f4105580 2024-09-13T15:47:09.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.728+0000 7fa8f1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4105580 0x7fa8f4105980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:09.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.728+0000 7fa8f1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4105580 0x7fa8f4105980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39476/0 (socket says 172.21.15.17:39476) 2024-09-13T15:47:09.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.728+0000 7fa8f1e00640 1 -- 172.21.15.17:0/3162317559 learned_addr learned my addr 172.21.15.17:0/3162317559 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:09.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.728+0000 7fa8f1e00640 1 -- 172.21.15.17:0/3162317559 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f4106780 con 0x7fa8f4105580 2024-09-13T15:47:09.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.729+0000 7fa8f1e00640 1 --2- 172.21.15.17:0/3162317559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4105580 0x7fa8f4105980 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009820 tx=0x7fa8e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f12fb043217fde server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:09.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.730+0000 7fa8f1400640 1 -- 172.21.15.17:0/3162317559 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8e402ae70 con 0x7fa8f4105580 2024-09-13T15:47:09.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.730+0000 7fa8f1400640 1 -- 172.21.15.17:0/3162317559 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa8e40328e0 con 0x7fa8f4105580 2024-09-13T15:47:09.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.730+0000 7fa8f1400640 1 -- 172.21.15.17:0/3162317559 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8e40308c0 con 0x7fa8f4105580 2024-09-13T15:47:09.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.730+0000 7fa8f8e00640 1 -- 172.21.15.17:0/3162317559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4105580 msgr2=0x7fa8f4105980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:09.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.730+0000 7fa8f8e00640 1 --2- 172.21.15.17:0/3162317559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4105580 0x7fa8f4105980 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009820 tx=0x7fa8e402a270 comp rx=0 tx=0).stop 2024-09-13T15:47:09.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.730+0000 7fa8f8e00640 1 -- 172.21.15.17:0/3162317559 shutdown_connections 2024-09-13T15:47:09.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.730+0000 7fa8f8e00640 1 --2- 172.21.15.17:0/3162317559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4105580 0x7fa8f4105980 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:09.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.730+0000 7fa8f8e00640 1 -- 172.21.15.17:0/3162317559 >> 172.21.15.17:0/3162317559 conn(0x7fa8f4100d10 msgr2=0x7fa8f4103150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:09.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.730+0000 7fa8f8e00640 1 -- 172.21.15.17:0/3162317559 shutdown_connections 2024-09-13T15:47:09.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.730+0000 7fa8f8e00640 1 -- 172.21.15.17:0/3162317559 wait complete. 2024-09-13T15:47:09.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.731+0000 7fa8f8e00640 1 Processor -- start 2024-09-13T15:47:09.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.731+0000 7fa8f8e00640 1 -- start start 2024-09-13T15:47:09.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.732+0000 7fa8f8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4105580 0x7fa8f4199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:09.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.732+0000 7fa8f8e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f4199870 con 0x7fa8f4105580 2024-09-13T15:47:09.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.732+0000 7fa8f1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4105580 0x7fa8f4199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:09.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.732+0000 7fa8f1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4105580 0x7fa8f4199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39492/0 (socket says 172.21.15.17:39492) 2024-09-13T15:47:09.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.732+0000 7fa8f1e00640 1 -- 172.21.15.17:0/13665340 learned_addr learned my addr 172.21.15.17:0/13665340 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:09.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.732+0000 7fa8f1e00640 1 -- 172.21.15.17:0/13665340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e40094d0 con 0x7fa8f4105580 2024-09-13T15:47:09.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.733+0000 7fa8f1e00640 1 --2- 172.21.15.17:0/13665340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4105580 0x7fa8f4199330 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa8e40305d0 tx=0x7fa8e4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:09.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.733+0000 7fa8eb400640 1 -- 172.21.15.17:0/13665340 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8e4032d90 con 0x7fa8f4105580 2024-09-13T15:47:09.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.733+0000 7fa8eb400640 1 -- 172.21.15.17:0/13665340 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa8e403b8d0 con 0x7fa8f4105580 2024-09-13T15:47:09.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.733+0000 7fa8eb400640 1 -- 172.21.15.17:0/13665340 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8e403a800 con 0x7fa8f4105580 2024-09-13T15:47:09.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.733+0000 7fa8f8e00640 1 -- 172.21.15.17:0/13665340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f4199a70 con 0x7fa8f4105580 2024-09-13T15:47:09.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.733+0000 7fa8f8e00640 1 -- 172.21.15.17:0/13665340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f4199f10 con 0x7fa8f4105580 2024-09-13T15:47:09.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.734+0000 7fa8eb400640 1 -- 172.21.15.17:0/13665340 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7fa8e4039040 con 0x7fa8f4105580 2024-09-13T15:47:09.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.734+0000 7fa8f8e00640 1 -- 172.21.15.17:0/13665340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f41099b0 con 0x7fa8f4105580 2024-09-13T15:47:09.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.734+0000 7fa8eb400640 1 --2- 172.21.15.17:0/13665340 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7fa8d8038670 0x7fa8d803ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:09.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.734+0000 7fa8eb400640 1 -- 172.21.15.17:0/13665340 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa8e406b730 con 0x7fa8f4105580 2024-09-13T15:47:09.697 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.735+0000 7fa8e9400640 1 --2- 172.21.15.17:0/13665340 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7fa8d8038670 0x7fa8d803ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:09.697 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.735+0000 7fa8e9400640 1 --2- 172.21.15.17:0/13665340 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7fa8d8038670 0x7fa8d803ab30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc0098c0 tx=0x7fa8dc006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:09.697 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.741+0000 7fa8eb400640 1 -- 172.21.15.17:0/13665340 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa8e403bdb0 con 0x7fa8f4105580 2024-09-13T15:47:09.697 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:08.964+0000 7fa8f8e00640 1 -- 172.21.15.17:0/13665340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fa8f4109bf0 con 0x7fa8f4105580 2024-09-13T15:47:09.697 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:09.017+0000 7fa8eb400640 1 -- 172.21.15.17:0/13665340 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fa8e4040260 con 0x7fa8f4105580 2024-09-13T15:47:09.697 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:09.019+0000 7fa8eb400640 1 -- 172.21.15.17:0/13665340 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fa8e4031970 con 0x7fa8f4105580 2024-09-13T15:47:09.697 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:09.022+0000 7fa8f8e00640 1 -- 172.21.15.17:0/13665340 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7fa8d8038670 msgr2=0x7fa8d803ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:09.697 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:09.022+0000 7fa8f8e00640 1 --2- 172.21.15.17:0/13665340 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7fa8d8038670 0x7fa8d803ab30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc0098c0 tx=0x7fa8dc006db0 comp rx=0 tx=0).stop 2024-09-13T15:47:09.697 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:09.022+0000 7fa8f8e00640 1 -- 172.21.15.17:0/13665340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4105580 msgr2=0x7fa8f4199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:09.698 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:09.022+0000 7fa8f8e00640 1 --2- 172.21.15.17:0/13665340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4105580 0x7fa8f4199330 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa8e40305d0 tx=0x7fa8e4032670 comp rx=0 tx=0).stop 2024-09-13T15:47:09.698 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:09.022+0000 7fa8f8e00640 1 -- 172.21.15.17:0/13665340 shutdown_connections 2024-09-13T15:47:09.698 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:09.022+0000 7fa8f8e00640 1 --2- 172.21.15.17:0/13665340 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7fa8d8038670 0x7fa8d803ab30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:09.698 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:09.022+0000 7fa8f8e00640 1 --2- 172.21.15.17:0/13665340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4105580 0x7fa8f4199330 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:09.698 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:09.022+0000 7fa8f8e00640 1 -- 172.21.15.17:0/13665340 >> 172.21.15.17:0/13665340 conn(0x7fa8f4100d10 msgr2=0x7fa8f41018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:09.698 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:09.023+0000 7fa8f8e00640 1 -- 172.21.15.17:0/13665340 shutdown_connections 2024-09-13T15:47:09.698 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:09.023+0000 7fa8f8e00640 1 -- 172.21.15.17:0/13665340 wait complete. 2024-09-13T15:47:09.761 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:09 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:09.586+0000 7f9487e19040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T15:47:10.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:10 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/13665340' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-13T15:47:10.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:10 smithi017 ceph-mon[30494]: mgrmap e5: x(active, since 4s) 2024-09-13T15:47:10.127 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:09 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:09.771+0000 7f9487e19040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T15:47:10.128 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:09 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:09.941+0000 7f9487e19040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T15:47:10.401 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:10 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:10.327+0000 7f9487e19040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T15:47:10.402 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:10 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:10.400+0000 7f9487e19040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T15:47:10.761 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:10 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:10.617+0000 7f9487e19040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T15:47:11.057 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-13T15:47:11.057 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-13T15:47:11.058 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T15:47:11.058 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-13T15:47:11.058 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T15:47:11.058 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-13T15:47:11.058 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.234+0000 7fc879000640 1 Processor -- start 2024-09-13T15:47:11.058 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.234+0000 7fc879000640 1 -- start start 2024-09-13T15:47:11.058 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.235+0000 7fc879000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc874105340 0x7fc874105740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:11.058 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.235+0000 7fc879000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc874105d10 con 0x7fc874105340 2024-09-13T15:47:11.058 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.235+0000 7fc873400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc874105340 0x7fc874105740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:11.058 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.235+0000 7fc873400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc874105340 0x7fc874105740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56254/0 (socket says 172.21.15.17:56254) 2024-09-13T15:47:11.058 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.235+0000 7fc873400640 1 -- 172.21.15.17:0/2938572734 learned_addr learned my addr 172.21.15.17:0/2938572734 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:11.058 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.236+0000 7fc873400640 1 -- 172.21.15.17:0/2938572734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc874106540 con 0x7fc874105340 2024-09-13T15:47:11.059 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.236+0000 7fc873400640 1 --2- 172.21.15.17:0/2938572734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc874105340 0x7fc874105740 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc864009820 tx=0x7fc86402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31285fbddedc5c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:11.059 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.237+0000 7fc872a00640 1 -- 172.21.15.17:0/2938572734 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc86402ae70 con 0x7fc874105340 2024-09-13T15:47:11.059 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.237+0000 7fc872a00640 1 -- 172.21.15.17:0/2938572734 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc8640328e0 con 0x7fc874105340 2024-09-13T15:47:11.059 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.237+0000 7fc872a00640 1 -- 172.21.15.17:0/2938572734 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc8640308c0 con 0x7fc874105340 2024-09-13T15:47:11.059 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.237+0000 7fc879000640 1 -- 172.21.15.17:0/2938572734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc874105340 msgr2=0x7fc874105740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:11.059 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.237+0000 7fc879000640 1 --2- 172.21.15.17:0/2938572734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc874105340 0x7fc874105740 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc864009820 tx=0x7fc86402a270 comp rx=0 tx=0).stop 2024-09-13T15:47:11.059 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.238+0000 7fc879000640 1 -- 172.21.15.17:0/2938572734 shutdown_connections 2024-09-13T15:47:11.059 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.238+0000 7fc879000640 1 --2- 172.21.15.17:0/2938572734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc874105340 0x7fc874105740 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:11.059 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.238+0000 7fc879000640 1 -- 172.21.15.17:0/2938572734 >> 172.21.15.17:0/2938572734 conn(0x7fc874100b50 msgr2=0x7fc874102f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:11.059 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.238+0000 7fc879000640 1 -- 172.21.15.17:0/2938572734 shutdown_connections 2024-09-13T15:47:11.060 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.238+0000 7fc879000640 1 -- 172.21.15.17:0/2938572734 wait complete. 2024-09-13T15:47:11.060 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.239+0000 7fc879000640 1 Processor -- start 2024-09-13T15:47:11.060 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.239+0000 7fc879000640 1 -- start start 2024-09-13T15:47:11.060 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.239+0000 7fc879000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc874105340 0x7fc8741990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:11.060 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.239+0000 7fc879000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc874199630 con 0x7fc874105340 2024-09-13T15:47:11.060 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.239+0000 7fc873400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc874105340 0x7fc8741990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:11.060 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.239+0000 7fc873400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc874105340 0x7fc8741990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56264/0 (socket says 172.21.15.17:56264) 2024-09-13T15:47:11.060 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.239+0000 7fc873400640 1 -- 172.21.15.17:0/3007219732 learned_addr learned my addr 172.21.15.17:0/3007219732 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:11.060 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.240+0000 7fc873400640 1 -- 172.21.15.17:0/3007219732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8640094d0 con 0x7fc874105340 2024-09-13T15:47:11.060 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.240+0000 7fc873400640 1 --2- 172.21.15.17:0/3007219732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc874105340 0x7fc8741990f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc8640305d0 tx=0x7fc864032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:11.060 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.241+0000 7fc870c00640 1 -- 172.21.15.17:0/3007219732 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc864032c60 con 0x7fc874105340 2024-09-13T15:47:11.060 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.241+0000 7fc870c00640 1 -- 172.21.15.17:0/3007219732 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc864032dc0 con 0x7fc874105340 2024-09-13T15:47:11.060 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.241+0000 7fc870c00640 1 -- 172.21.15.17:0/3007219732 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc86403a770 con 0x7fc874105340 2024-09-13T15:47:11.061 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.241+0000 7fc879000640 1 -- 172.21.15.17:0/3007219732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc874199830 con 0x7fc874105340 2024-09-13T15:47:11.061 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.241+0000 7fc879000640 1 -- 172.21.15.17:0/3007219732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc874199cd0 con 0x7fc874105340 2024-09-13T15:47:11.061 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.242+0000 7fc879000640 1 -- 172.21.15.17:0/3007219732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc874109770 con 0x7fc874105340 2024-09-13T15:47:11.061 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.242+0000 7fc870c00640 1 -- 172.21.15.17:0/3007219732 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fc864039040 con 0x7fc874105340 2024-09-13T15:47:11.061 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.243+0000 7fc870c00640 1 --2- 172.21.15.17:0/3007219732 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7fc858038670 0x7fc85803ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:11.061 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.243+0000 7fc870c00640 1 -- 172.21.15.17:0/3007219732 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc86406b6a0 con 0x7fc874105340 2024-09-13T15:47:11.061 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.243+0000 7fc86aa00640 1 -- 172.21.15.17:0/3007219732 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7fc858038670 msgr2=0x7fc85803ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1047258336 2024-09-13T15:47:11.061 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.243+0000 7fc86aa00640 1 --2- 172.21.15.17:0/3007219732 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7fc858038670 0x7fc85803ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T15:47:11.061 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.247+0000 7fc870c00640 1 -- 172.21.15.17:0/3007219732 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc86403bbd0 con 0x7fc874105340 2024-09-13T15:47:11.061 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.444+0000 7fc86aa00640 1 -- 172.21.15.17:0/3007219732 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7fc858038670 msgr2=0x7fc85803ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1047258336 2024-09-13T15:47:11.061 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.444+0000 7fc86aa00640 1 --2- 172.21.15.17:0/3007219732 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7fc858038670 0x7fc85803ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T15:47:11.061 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.475+0000 7fc879000640 1 -- 172.21.15.17:0/3007219732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fc87419c610 con 0x7fc874105340 2024-09-13T15:47:11.061 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.476+0000 7fc870c00640 1 -- 172.21.15.17:0/3007219732 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7fc86403f070 con 0x7fc874105340 2024-09-13T15:47:11.062 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.479+0000 7fc879000640 1 -- 172.21.15.17:0/3007219732 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7fc858038670 msgr2=0x7fc85803ab30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:47:11.062 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.479+0000 7fc879000640 1 --2- 172.21.15.17:0/3007219732 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7fc858038670 0x7fc85803ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:11.062 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.479+0000 7fc879000640 1 -- 172.21.15.17:0/3007219732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc874105340 msgr2=0x7fc8741990f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:11.062 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.479+0000 7fc879000640 1 --2- 172.21.15.17:0/3007219732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc874105340 0x7fc8741990f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc8640305d0 tx=0x7fc864032670 comp rx=0 tx=0).stop 2024-09-13T15:47:11.062 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.479+0000 7fc879000640 1 -- 172.21.15.17:0/3007219732 shutdown_connections 2024-09-13T15:47:11.062 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.479+0000 7fc879000640 1 --2- 172.21.15.17:0/3007219732 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7fc858038670 0x7fc85803ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:11.062 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.479+0000 7fc879000640 1 --2- 172.21.15.17:0/3007219732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc874105340 0x7fc8741990f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:11.062 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.479+0000 7fc879000640 1 -- 172.21.15.17:0/3007219732 >> 172.21.15.17:0/3007219732 conn(0x7fc874100b50 msgr2=0x7fc874101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:11.062 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.479+0000 7fc879000640 1 -- 172.21.15.17:0/3007219732 shutdown_connections 2024-09-13T15:47:11.062 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:10.479+0000 7fc879000640 1 -- 172.21.15.17:0/3007219732 wait complete. 2024-09-13T15:47:11.062 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for the mgr to restart... 2024-09-13T15:47:11.062 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr epoch 5... 2024-09-13T15:47:11.201 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:11 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3007219732' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T15:47:12.011 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:11 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:11.745+0000 7f9487e19040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T15:47:12.011 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:11 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:11.827+0000 7f9487e19040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T15:47:13.076 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:12 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:12.767+0000 7f9487e19040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T15:47:13.076 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:12 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:12.907+0000 7f9487e19040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T15:47:13.076 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:13 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:13.075+0000 7f9487e19040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T15:47:13.406 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:13 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:13.149+0000 7f9487e19040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T15:47:13.407 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:13 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:13.322+0000 7f9487e19040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T15:47:13.407 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:13 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:13.405+0000 7f9487e19040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T15:47:13.663 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:13 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:13.479+0000 7f9487e19040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T15:47:13.663 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:13 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:13.662+0000 7f9487e19040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T15:47:13.922 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:13 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:13.741+0000 7f9487e19040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T15:47:13.922 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:13 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:13.822+0000 7f9487e19040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T15:47:13.922 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:13 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:13.921+0000 7f9487e19040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T15:47:14.261 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:13 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:13.993+0000 7f9487e19040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T15:47:14.261 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:14 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:14.065+0000 7f9487e19040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T15:47:15.261 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:14 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:14.994+0000 7f9487e19040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T15:47:15.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:15 smithi017 ceph-mon[30494]: Active manager daemon x restarted 2024-09-13T15:47:15.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:15 smithi017 ceph-mon[30494]: Activating manager daemon x 2024-09-13T15:47:15.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:15 smithi017 ceph-mon[30494]: osdmap e2: 0 total, 0 up, 0 in 2024-09-13T15:47:15.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:15 smithi017 ceph-mon[30494]: mgrmap e6: x(active, starting, since 0.00374539s) 2024-09-13T15:47:15.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:15 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T15:47:15.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:15 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-13T15:47:15.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:15 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T15:47:15.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:15 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T15:47:15.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:15 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T15:47:15.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:15 smithi017 ceph-mon[30494]: Manager daemon x is now available 2024-09-13T15:47:15.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:15 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' 2024-09-13T15:47:15.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:15 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' 2024-09-13T15:47:15.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:15 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:47:15.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:15 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:47:15.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:15 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T15:47:16.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-mon[30494]: Found migration_current of "None". Setting to last migration. 2024-09-13T15:47:16.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T15:47:16.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' 2024-09-13T15:47:16.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' 2024-09-13T15:47:16.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-mon[30494]: mgrmap e7: x(active, since 1.00594s) 2024-09-13T15:47:16.685 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-13T15:47:16.685 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-13T15:47:16.685 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T15:47:16.685 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-13T15:47:16.685 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.592+0000 7f7df5600640 1 Processor -- start 2024-09-13T15:47:16.685 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.592+0000 7f7df5600640 1 -- start start 2024-09-13T15:47:16.685 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.592+0000 7f7df5600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df01077f0 0x7f7df0107bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:16.686 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.592+0000 7f7df5600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df01081c0 con 0x7f7df01077f0 2024-09-13T15:47:16.686 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.592+0000 7f7deea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df01077f0 0x7f7df0107bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:16.686 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.592+0000 7f7deea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df01077f0 0x7f7df0107bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56272/0 (socket says 172.21.15.17:56272) 2024-09-13T15:47:16.686 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.592+0000 7f7deea00640 1 -- 172.21.15.17:0/2571138673 learned_addr learned my addr 172.21.15.17:0/2571138673 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:16.686 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.593+0000 7f7deea00640 1 -- 172.21.15.17:0/2571138673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df0108990 con 0x7f7df01077f0 2024-09-13T15:47:16.686 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.594+0000 7f7deea00640 1 --2- 172.21.15.17:0/2571138673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df01077f0 0x7f7df0107bf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009820 tx=0x7f7de002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2169df5ad9bd74 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:16.686 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.594+0000 7f7ded600640 1 -- 172.21.15.17:0/2571138673 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7de002ae70 con 0x7f7df01077f0 2024-09-13T15:47:16.686 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.594+0000 7f7ded600640 1 -- 172.21.15.17:0/2571138673 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7de00328e0 con 0x7f7df01077f0 2024-09-13T15:47:16.686 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.594+0000 7f7ded600640 1 -- 172.21.15.17:0/2571138673 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7de00308c0 con 0x7f7df01077f0 2024-09-13T15:47:16.686 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.595+0000 7f7df5600640 1 -- 172.21.15.17:0/2571138673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df01077f0 msgr2=0x7f7df0107bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:16.686 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.595+0000 7f7df5600640 1 --2- 172.21.15.17:0/2571138673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df01077f0 0x7f7df0107bf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009820 tx=0x7f7de002a270 comp rx=0 tx=0).stop 2024-09-13T15:47:16.686 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.595+0000 7f7df5600640 1 -- 172.21.15.17:0/2571138673 shutdown_connections 2024-09-13T15:47:16.687 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.595+0000 7f7df5600640 1 --2- 172.21.15.17:0/2571138673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df01077f0 0x7f7df0107bf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:16.687 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.595+0000 7f7df5600640 1 -- 172.21.15.17:0/2571138673 >> 172.21.15.17:0/2571138673 conn(0x7f7df007ad80 msgr2=0x7f7df007b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:16.687 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.595+0000 7f7df5600640 1 -- 172.21.15.17:0/2571138673 shutdown_connections 2024-09-13T15:47:16.687 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.595+0000 7f7df5600640 1 -- 172.21.15.17:0/2571138673 wait complete. 2024-09-13T15:47:16.687 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.596+0000 7f7df5600640 1 Processor -- start 2024-09-13T15:47:16.687 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.596+0000 7f7df5600640 1 -- start start 2024-09-13T15:47:16.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.596+0000 7f7df5600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df01077f0 0x7f7df019b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:16.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.596+0000 7f7df5600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df019b9e0 con 0x7f7df01077f0 2024-09-13T15:47:16.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.597+0000 7f7deea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df01077f0 0x7f7df019b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:16.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.597+0000 7f7deea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df01077f0 0x7f7df019b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56278/0 (socket says 172.21.15.17:56278) 2024-09-13T15:47:16.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.597+0000 7f7deea00640 1 -- 172.21.15.17:0/2477034802 learned_addr learned my addr 172.21.15.17:0/2477034802 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:16.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.597+0000 7f7deea00640 1 -- 172.21.15.17:0/2477034802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de00094d0 con 0x7f7df01077f0 2024-09-13T15:47:16.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.597+0000 7f7deea00640 1 --2- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df01077f0 0x7f7df019b4a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7de00097f0 tx=0x7f7de0030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:16.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.598+0000 7f7de7400640 1 -- 172.21.15.17:0/2477034802 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7de0032d90 con 0x7f7df01077f0 2024-09-13T15:47:16.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.598+0000 7f7de7400640 1 -- 172.21.15.17:0/2477034802 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7de003b8d0 con 0x7f7df01077f0 2024-09-13T15:47:16.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.598+0000 7f7de7400640 1 -- 172.21.15.17:0/2477034802 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7de003a780 con 0x7f7df01077f0 2024-09-13T15:47:16.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.598+0000 7f7df5600640 1 -- 172.21.15.17:0/2477034802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df019bbe0 con 0x7f7df01077f0 2024-09-13T15:47:16.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.598+0000 7f7df5600640 1 -- 172.21.15.17:0/2477034802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df019c080 con 0x7f7df01077f0 2024-09-13T15:47:16.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.599+0000 7f7de7400640 1 -- 172.21.15.17:0/2477034802 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f7de0039040 con 0x7f7df01077f0 2024-09-13T15:47:16.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.600+0000 7f7de7400640 1 --2- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7f7dd4038670 0x7f7dd403ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:16.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.600+0000 7f7de7400640 1 -- 172.21.15.17:0/2477034802 --> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7dd403b240 con 0x7f7dd4038670 2024-09-13T15:47:16.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.600+0000 7f7de7400640 1 -- 172.21.15.17:0/2477034802 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7de006b6d0 con 0x7f7df01077f0 2024-09-13T15:47:16.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.600+0000 7f7dee000640 1 -- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7f7dd4038670 msgr2=0x7f7dd403ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1047258336 2024-09-13T15:47:16.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.600+0000 7f7dee000640 1 --2- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7f7dd4038670 0x7f7dd403ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T15:47:16.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.801+0000 7f7dee000640 1 -- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7f7dd4038670 msgr2=0x7f7dd403ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1047258336 2024-09-13T15:47:16.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:11.801+0000 7f7dee000640 1 --2- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7f7dd4038670 0x7f7dd403ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T15:47:16.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:12.202+0000 7f7dee000640 1 -- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7f7dd4038670 msgr2=0x7f7dd403ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1047258336 2024-09-13T15:47:16.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:12.202+0000 7f7dee000640 1 --2- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7f7dd4038670 0x7f7dd403ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T15:47:16.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:13.003+0000 7f7dee000640 1 -- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7f7dd4038670 msgr2=0x7f7dd403ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1047258336 2024-09-13T15:47:16.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:13.003+0000 7f7dee000640 1 --2- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7f7dd4038670 0x7f7dd403ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T15:47:16.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:14.604+0000 7f7dee000640 1 -- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7f7dd4038670 msgr2=0x7f7dd403ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1047258336 2024-09-13T15:47:16.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:14.604+0000 7f7dee000640 1 --2- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7f7dd4038670 0x7f7dd403ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-13T15:47:16.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:14.998+0000 7f7de7400640 1 -- 172.21.15.17:0/2477034802 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mgrmap(e 6) v1 ==== 45308+0+0 (secure 0 0 0) 0x7f7de0049c40 con 0x7f7df01077f0 2024-09-13T15:47:16.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:14.999+0000 7f7de7400640 1 -- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7f7dd4038670 msgr2=0x7f7dd403ab30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:47:16.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:14.999+0000 7f7de7400640 1 --2- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7f7dd4038670 0x7f7dd403ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:16.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:16.000+0000 7f7de7400640 1 -- 172.21.15.17:0/2477034802 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 7) v1 ==== 45435+0+0 (secure 0 0 0) 0x7f7de006cf50 con 0x7f7df01077f0 2024-09-13T15:47:16.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:16.000+0000 7f7de7400640 1 --2- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f7dd403bf50 0x7f7dd403e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:16.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:16.000+0000 7f7de7400640 1 -- 172.21.15.17:0/2477034802 --> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7dd403b240 con 0x7f7dd403bf50 2024-09-13T15:47:16.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:16.001+0000 7f7dee000640 1 --2- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f7dd403bf50 0x7f7dd403e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:16.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:16.003+0000 7f7dee000640 1 --2- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f7dd403bf50 0x7f7dd403e340 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc003980 tx=0x7f7ddc0092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:16.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:16.004+0000 7f7de7400640 1 -- 172.21.15.17:0/2477034802 <== mgr.14118 v2:172.21.15.17:6800/386837955 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f7dd403b240 con 0x7f7dd403bf50 2024-09-13T15:47:16.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:16.009+0000 7f7df5600640 1 -- 172.21.15.17:0/2477034802 --> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f7df010bbc0 con 0x7f7dd403bf50 2024-09-13T15:47:16.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:16.010+0000 7f7de7400640 1 -- 172.21.15.17:0/2477034802 <== mgr.14118 v2:172.21.15.17:6800/386837955 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f7df010bbc0 con 0x7f7dd403bf50 2024-09-13T15:47:16.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:16.010+0000 7f7df5600640 1 -- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f7dd403bf50 msgr2=0x7f7dd403e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:16.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:16.010+0000 7f7df5600640 1 --2- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f7dd403bf50 0x7f7dd403e340 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc003980 tx=0x7f7ddc0092b0 comp rx=0 tx=0).stop 2024-09-13T15:47:16.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:16.010+0000 7f7df5600640 1 -- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df01077f0 msgr2=0x7f7df019b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:16.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:16.010+0000 7f7df5600640 1 --2- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df01077f0 0x7f7df019b4a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7de00097f0 tx=0x7f7de0030db0 comp rx=0 tx=0).stop 2024-09-13T15:47:16.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:16.010+0000 7f7df5600640 1 -- 172.21.15.17:0/2477034802 shutdown_connections 2024-09-13T15:47:16.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:16.010+0000 7f7df5600640 1 --2- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f7dd403bf50 0x7f7dd403e340 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:16.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:16.010+0000 7f7df5600640 1 --2- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:6800/1047258336,v1:172.21.15.17:6801/1047258336] conn(0x7f7dd4038670 0x7f7dd403ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:16.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:16.010+0000 7f7df5600640 1 --2- 172.21.15.17:0/2477034802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df01077f0 0x7f7df019b4a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:16.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:16.010+0000 7f7df5600640 1 -- 172.21.15.17:0/2477034802 >> 172.21.15.17:0/2477034802 conn(0x7f7df007ad80 msgr2=0x7f7df01054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:16.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:16.011+0000 7f7df5600640 1 -- 172.21.15.17:0/2477034802 shutdown_connections 2024-09-13T15:47:16.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:16.011+0000 7f7df5600640 1 -- 172.21.15.17:0/2477034802 wait complete. 2024-09-13T15:47:16.692 INFO:teuthology.orchestra.run.smithi017.stdout:mgr epoch 5 is available 2024-09-13T15:47:16.692 INFO:teuthology.orchestra.run.smithi017.stdout:Setting orchestrator backend to cephadm... 2024-09-13T15:47:17.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:17 smithi017 ceph-mon[30494]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T15:47:17.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:17 smithi017 ceph-mon[30494]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T15:47:17.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:17 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:47:17.262 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:16.930+0000 7f93e1200640 -1 log_channel(cephadm) log [ERR] : [13/Sep/2024:15:47:16] ENGINE Error in HTTPServer.serve 2024-09-13T15:47:17.262 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: Traceback (most recent call last): 2024-09-13T15:47:17.262 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T15:47:17.262 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: self._connections.run(self.expiration_interval) 2024-09-13T15:47:17.262 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T15:47:17.262 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: self._run(expiration_interval) 2024-09-13T15:47:17.262 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T15:47:17.262 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T15:47:17.262 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T15:47:17.262 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T15:47:17.262 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T15:47:17.262 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: s = self.context.wrap_socket( 2024-09-13T15:47:17.263 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T15:47:17.263 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: return self.sslsocket_class._create( 2024-09-13T15:47:17.263 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T15:47:17.263 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: self.do_handshake() 2024-09-13T15:47:17.263 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T15:47:17.263 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: self._sslobj.do_handshake() 2024-09-13T15:47:17.263 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T15:47:17.263 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:17.953 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.139+0000 7effd3200640 1 Processor -- start 2024-09-13T15:47:17.953 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.139+0000 7effd3200640 1 -- start start 2024-09-13T15:47:17.953 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.139+0000 7effd3200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc07be60 0x7effcc07a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:17.953 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.139+0000 7effd3200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc07a890 con 0x7effcc07be60 2024-09-13T15:47:17.953 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.140+0000 7effcbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc07be60 0x7effcc07a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:17.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.140+0000 7effcbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc07be60 0x7effcc07a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56328/0 (socket says 172.21.15.17:56328) 2024-09-13T15:47:17.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.140+0000 7effcbe00640 1 -- 172.21.15.17:0/3609570278 learned_addr learned my addr 172.21.15.17:0/3609570278 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:17.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.140+0000 7effcbe00640 1 -- 172.21.15.17:0/3609570278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effcc07a9d0 con 0x7effcc07be60 2024-09-13T15:47:17.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.141+0000 7effcbe00640 1 --2- 172.21.15.17:0/3609570278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc07be60 0x7effcc07a2c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7effbc009820 tx=0x7effbc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ef6b67512ecfcc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:17.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.141+0000 7effcaa00640 1 -- 172.21.15.17:0/3609570278 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effbc02ae70 con 0x7effcc07be60 2024-09-13T15:47:17.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.142+0000 7effcaa00640 1 -- 172.21.15.17:0/3609570278 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7effbc0328e0 con 0x7effcc07be60 2024-09-13T15:47:17.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.142+0000 7effcaa00640 1 -- 172.21.15.17:0/3609570278 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effbc0308c0 con 0x7effcc07be60 2024-09-13T15:47:17.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.142+0000 7effd3200640 1 -- 172.21.15.17:0/3609570278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc07be60 msgr2=0x7effcc07a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:17.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.142+0000 7effd3200640 1 --2- 172.21.15.17:0/3609570278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc07be60 0x7effcc07a2c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7effbc009820 tx=0x7effbc02a270 comp rx=0 tx=0).stop 2024-09-13T15:47:17.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.142+0000 7effd3200640 1 -- 172.21.15.17:0/3609570278 shutdown_connections 2024-09-13T15:47:17.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.142+0000 7effd3200640 1 --2- 172.21.15.17:0/3609570278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc07be60 0x7effcc07a2c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:17.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.142+0000 7effd3200640 1 -- 172.21.15.17:0/3609570278 >> 172.21.15.17:0/3609570278 conn(0x7effcc100d40 msgr2=0x7effcc103160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:17.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.142+0000 7effd3200640 1 -- 172.21.15.17:0/3609570278 shutdown_connections 2024-09-13T15:47:17.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.142+0000 7effd3200640 1 -- 172.21.15.17:0/3609570278 wait complete. 2024-09-13T15:47:17.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.143+0000 7effd3200640 1 Processor -- start 2024-09-13T15:47:17.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.143+0000 7effd3200640 1 -- start start 2024-09-13T15:47:17.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.144+0000 7effd3200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc07be60 0x7effcc19f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:17.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.144+0000 7effd3200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc19fe60 con 0x7effcc07be60 2024-09-13T15:47:17.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.144+0000 7effcbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc07be60 0x7effcc19f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:17.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.144+0000 7effcbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc07be60 0x7effcc19f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56338/0 (socket says 172.21.15.17:56338) 2024-09-13T15:47:17.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.144+0000 7effcbe00640 1 -- 172.21.15.17:0/821616537 learned_addr learned my addr 172.21.15.17:0/821616537 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:17.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.144+0000 7effcbe00640 1 -- 172.21.15.17:0/821616537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc0094d0 con 0x7effcc07be60 2024-09-13T15:47:17.955 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.145+0000 7effcbe00640 1 --2- 172.21.15.17:0/821616537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc07be60 0x7effcc19f920 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7effbc0305d0 tx=0x7effbc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:17.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.145+0000 7effc8c00640 1 -- 172.21.15.17:0/821616537 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effbc032d90 con 0x7effcc07be60 2024-09-13T15:47:17.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.145+0000 7effc8c00640 1 -- 172.21.15.17:0/821616537 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7effbc03b8d0 con 0x7effcc07be60 2024-09-13T15:47:17.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.145+0000 7effd3200640 1 -- 172.21.15.17:0/821616537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effcc1a0060 con 0x7effcc07be60 2024-09-13T15:47:17.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.145+0000 7effc8c00640 1 -- 172.21.15.17:0/821616537 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effbc03a800 con 0x7effcc07be60 2024-09-13T15:47:17.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.145+0000 7effd3200640 1 -- 172.21.15.17:0/821616537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effcc1a0500 con 0x7effcc07be60 2024-09-13T15:47:17.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.146+0000 7effc8c00640 1 -- 172.21.15.17:0/821616537 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7effbc039040 con 0x7effcc07be60 2024-09-13T15:47:17.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.146+0000 7effd3200640 1 -- 172.21.15.17:0/821616537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effcc107570 con 0x7effcc07be60 2024-09-13T15:47:17.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.147+0000 7effc8c00640 1 --2- 172.21.15.17:0/821616537 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7effb0038620 0x7effb003aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:17.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.147+0000 7effc8c00640 1 -- 172.21.15.17:0/821616537 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7effbc06b8e0 con 0x7effcc07be60 2024-09-13T15:47:17.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.147+0000 7effcb400640 1 --2- 172.21.15.17:0/821616537 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7effb0038620 0x7effb003aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:17.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.148+0000 7effcb400640 1 --2- 172.21.15.17:0/821616537 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7effb0038620 0x7effb003aae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7effb80098c0 tx=0x7effb8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:17.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.152+0000 7effc8c00640 1 -- 172.21.15.17:0/821616537 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7effbc03bdb0 con 0x7effcc07be60 2024-09-13T15:47:17.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.349+0000 7effd3200640 1 -- 172.21.15.17:0/821616537 --> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7effcc0608f0 con 0x7effb0038620 2024-09-13T15:47:17.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.357+0000 7effc8c00640 1 -- 172.21.15.17:0/821616537 <== mgr.14118 v2:172.21.15.17:6800/386837955 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7effcc0608f0 con 0x7effb0038620 2024-09-13T15:47:17.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.360+0000 7effd3200640 1 -- 172.21.15.17:0/821616537 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7effb0038620 msgr2=0x7effb003aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:17.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.360+0000 7effd3200640 1 --2- 172.21.15.17:0/821616537 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7effb0038620 0x7effb003aae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7effb80098c0 tx=0x7effb8006db0 comp rx=0 tx=0).stop 2024-09-13T15:47:17.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.360+0000 7effd3200640 1 -- 172.21.15.17:0/821616537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc07be60 msgr2=0x7effcc19f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:17.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.360+0000 7effd3200640 1 --2- 172.21.15.17:0/821616537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc07be60 0x7effcc19f920 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7effbc0305d0 tx=0x7effbc032670 comp rx=0 tx=0).stop 2024-09-13T15:47:17.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.360+0000 7effd3200640 1 -- 172.21.15.17:0/821616537 shutdown_connections 2024-09-13T15:47:17.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.360+0000 7effd3200640 1 --2- 172.21.15.17:0/821616537 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7effb0038620 0x7effb003aae0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:17.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.360+0000 7effd3200640 1 --2- 172.21.15.17:0/821616537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc07be60 0x7effcc19f920 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:17.958 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.360+0000 7effd3200640 1 -- 172.21.15.17:0/821616537 >> 172.21.15.17:0/821616537 conn(0x7effcc100d40 msgr2=0x7effcc103130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:17.958 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.361+0000 7effd3200640 1 -- 172.21.15.17:0/821616537 shutdown_connections 2024-09-13T15:47:17.958 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:17.361+0000 7effd3200640 1 -- 172.21.15.17:0/821616537 wait complete. 2024-09-13T15:47:18.201 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:18 smithi017 ceph-mon[30494]: [13/Sep/2024:15:47:16] ENGINE Bus STARTING 2024-09-13T15:47:18.201 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:18 smithi017 ceph-mon[30494]: [13/Sep/2024:15:47:16] ENGINE Serving on http://172.21.15.17:8765 2024-09-13T15:47:18.201 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:18 smithi017 ceph-mon[30494]: [13/Sep/2024:15:47:16] ENGINE Serving on https://172.21.15.17:7150 2024-09-13T15:47:18.201 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:18 smithi017 ceph-mon[30494]: [13/Sep/2024:15:47:16] ENGINE Bus STARTED 2024-09-13T15:47:18.201 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:18 smithi017 ceph-mon[30494]: [13/Sep/2024:15:47:16] ENGINE Error in HTTPServer.serve 2024-09-13T15:47:18.201 INFO:journalctl@ceph.mon.a.smithi017.stdout: Traceback (most recent call last): 2024-09-13T15:47:18.201 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T15:47:18.201 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._connections.run(self.expiration_interval) 2024-09-13T15:47:18.201 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T15:47:18.201 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._run(expiration_interval) 2024-09-13T15:47:18.202 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T15:47:18.202 INFO:journalctl@ceph.mon.a.smithi017.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T15:47:18.202 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T15:47:18.202 INFO:journalctl@ceph.mon.a.smithi017.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T15:47:18.202 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T15:47:18.202 INFO:journalctl@ceph.mon.a.smithi017.stdout: s = self.context.wrap_socket( 2024-09-13T15:47:18.202 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T15:47:18.202 INFO:journalctl@ceph.mon.a.smithi017.stdout: return self.sslsocket_class._create( 2024-09-13T15:47:18.202 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T15:47:18.202 INFO:journalctl@ceph.mon.a.smithi017.stdout: self.do_handshake() 2024-09-13T15:47:18.202 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T15:47:18.202 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._sslobj.do_handshake() 2024-09-13T15:47:18.202 INFO:journalctl@ceph.mon.a.smithi017.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T15:47:18.203 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:18 smithi017 ceph-mon[30494]: mgrmap e8: x(active, since 2s) 2024-09-13T15:47:18.203 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:18 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' 2024-09-13T15:47:18.203 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:18 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:47:19.223 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:19 smithi017 ceph-mon[30494]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:47:19.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-13T15:47:19.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.412+0000 7ff837c00640 1 Processor -- start 2024-09-13T15:47:19.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.412+0000 7ff837c00640 1 -- start start 2024-09-13T15:47:19.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.412+0000 7ff837c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8301077f0 0x7ff830107bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:19.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.412+0000 7ff837c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8301081c0 con 0x7ff8301077f0 2024-09-13T15:47:19.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.413+0000 7ff835200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8301077f0 0x7ff830107bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:19.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.413+0000 7ff835200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8301077f0 0x7ff830107bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56344/0 (socket says 172.21.15.17:56344) 2024-09-13T15:47:19.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.413+0000 7ff835200640 1 -- 172.21.15.17:0/362787100 learned_addr learned my addr 172.21.15.17:0/362787100 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:19.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.413+0000 7ff835200640 1 -- 172.21.15.17:0/362787100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff830108990 con 0x7ff8301077f0 2024-09-13T15:47:19.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.414+0000 7ff835200640 1 --2- 172.21.15.17:0/362787100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8301077f0 0x7ff830107bf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff824009820 tx=0x7ff82402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab8051e63d38728 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:19.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.414+0000 7ff82f400640 1 -- 172.21.15.17:0/362787100 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff82402ae70 con 0x7ff8301077f0 2024-09-13T15:47:19.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.414+0000 7ff82f400640 1 -- 172.21.15.17:0/362787100 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff8240328e0 con 0x7ff8301077f0 2024-09-13T15:47:19.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.414+0000 7ff82f400640 1 -- 172.21.15.17:0/362787100 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8240308c0 con 0x7ff8301077f0 2024-09-13T15:47:19.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.415+0000 7ff837c00640 1 -- 172.21.15.17:0/362787100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8301077f0 msgr2=0x7ff830107bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:19.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.415+0000 7ff837c00640 1 --2- 172.21.15.17:0/362787100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8301077f0 0x7ff830107bf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff824009820 tx=0x7ff82402a270 comp rx=0 tx=0).stop 2024-09-13T15:47:19.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.415+0000 7ff837c00640 1 -- 172.21.15.17:0/362787100 shutdown_connections 2024-09-13T15:47:19.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.415+0000 7ff837c00640 1 --2- 172.21.15.17:0/362787100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8301077f0 0x7ff830107bf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:19.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.415+0000 7ff837c00640 1 -- 172.21.15.17:0/362787100 >> 172.21.15.17:0/362787100 conn(0x7ff83007ad80 msgr2=0x7ff83007b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:19.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.415+0000 7ff837c00640 1 -- 172.21.15.17:0/362787100 shutdown_connections 2024-09-13T15:47:19.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.415+0000 7ff837c00640 1 -- 172.21.15.17:0/362787100 wait complete. 2024-09-13T15:47:19.239 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.416+0000 7ff837c00640 1 Processor -- start 2024-09-13T15:47:19.239 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.416+0000 7ff837c00640 1 -- start start 2024-09-13T15:47:19.239 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.417+0000 7ff837c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8301077f0 0x7ff83019b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:19.239 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.417+0000 7ff837c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83019b9e0 con 0x7ff8301077f0 2024-09-13T15:47:19.239 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.417+0000 7ff835200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8301077f0 0x7ff83019b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:19.239 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.417+0000 7ff835200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8301077f0 0x7ff83019b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56350/0 (socket says 172.21.15.17:56350) 2024-09-13T15:47:19.239 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.417+0000 7ff835200640 1 -- 172.21.15.17:0/3829508472 learned_addr learned my addr 172.21.15.17:0/3829508472 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:19.240 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.417+0000 7ff835200640 1 -- 172.21.15.17:0/3829508472 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8240094d0 con 0x7ff8301077f0 2024-09-13T15:47:19.240 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.418+0000 7ff835200640 1 --2- 172.21.15.17:0/3829508472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8301077f0 0x7ff83019b4a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff8240097f0 tx=0x7ff824030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:19.240 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.418+0000 7ff82d600640 1 -- 172.21.15.17:0/3829508472 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff824032d90 con 0x7ff8301077f0 2024-09-13T15:47:19.240 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.418+0000 7ff82d600640 1 -- 172.21.15.17:0/3829508472 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff82403b8d0 con 0x7ff8301077f0 2024-09-13T15:47:19.240 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.418+0000 7ff82d600640 1 -- 172.21.15.17:0/3829508472 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff82403a780 con 0x7ff8301077f0 2024-09-13T15:47:19.240 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.418+0000 7ff837c00640 1 -- 172.21.15.17:0/3829508472 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83019bbe0 con 0x7ff8301077f0 2024-09-13T15:47:19.240 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.418+0000 7ff837c00640 1 -- 172.21.15.17:0/3829508472 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83019c080 con 0x7ff8301077f0 2024-09-13T15:47:19.240 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.419+0000 7ff82d600640 1 -- 172.21.15.17:0/3829508472 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7ff824039040 con 0x7ff8301077f0 2024-09-13T15:47:19.240 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.419+0000 7ff837c00640 1 -- 172.21.15.17:0/3829508472 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83010bbc0 con 0x7ff8301077f0 2024-09-13T15:47:19.240 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.420+0000 7ff82d600640 1 --2- 172.21.15.17:0/3829508472 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7ff8180386c0 0x7ff81803ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:19.240 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.420+0000 7ff82d600640 1 -- 172.21.15.17:0/3829508472 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff82406b7e0 con 0x7ff8301077f0 2024-09-13T15:47:19.241 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.420+0000 7ff82fe00640 1 --2- 172.21.15.17:0/3829508472 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7ff8180386c0 0x7ff81803ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:19.241 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.421+0000 7ff82fe00640 1 --2- 172.21.15.17:0/3829508472 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7ff8180386c0 0x7ff81803ab80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0098c0 tx=0x7ff81c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:19.241 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.425+0000 7ff82d600640 1 -- 172.21.15.17:0/3829508472 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff82403bd90 con 0x7ff8301077f0 2024-09-13T15:47:19.241 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.610+0000 7ff837c00640 1 -- 172.21.15.17:0/3829508472 --> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7ff830105c00 con 0x7ff8180386c0 2024-09-13T15:47:19.241 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.611+0000 7ff82d600640 1 -- 172.21.15.17:0/3829508472 <== mgr.14118 v2:172.21.15.17:6800/386837955 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7ff830105c00 con 0x7ff8180386c0 2024-09-13T15:47:19.241 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.613+0000 7ff837c00640 1 -- 172.21.15.17:0/3829508472 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7ff8180386c0 msgr2=0x7ff81803ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:19.241 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.613+0000 7ff837c00640 1 --2- 172.21.15.17:0/3829508472 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7ff8180386c0 0x7ff81803ab80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0098c0 tx=0x7ff81c006db0 comp rx=0 tx=0).stop 2024-09-13T15:47:19.241 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.613+0000 7ff837c00640 1 -- 172.21.15.17:0/3829508472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8301077f0 msgr2=0x7ff83019b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:19.241 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.613+0000 7ff837c00640 1 --2- 172.21.15.17:0/3829508472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8301077f0 0x7ff83019b4a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff8240097f0 tx=0x7ff824030db0 comp rx=0 tx=0).stop 2024-09-13T15:47:19.241 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.614+0000 7ff837c00640 1 -- 172.21.15.17:0/3829508472 shutdown_connections 2024-09-13T15:47:19.241 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.614+0000 7ff837c00640 1 --2- 172.21.15.17:0/3829508472 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7ff8180386c0 0x7ff81803ab80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:19.242 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.614+0000 7ff837c00640 1 --2- 172.21.15.17:0/3829508472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8301077f0 0x7ff83019b4a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:19.242 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.614+0000 7ff837c00640 1 -- 172.21.15.17:0/3829508472 >> 172.21.15.17:0/3829508472 conn(0x7ff83007ad80 msgr2=0x7ff8301054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:19.242 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.614+0000 7ff837c00640 1 -- 172.21.15.17:0/3829508472 shutdown_connections 2024-09-13T15:47:19.242 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:18.614+0000 7ff837c00640 1 -- 172.21.15.17:0/3829508472 wait complete. 2024-09-13T15:47:19.242 INFO:teuthology.orchestra.run.smithi017.stdout:Generating ssh key... 2024-09-13T15:47:20.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:20 smithi017 ceph-mon[30494]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:47:20.512 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: Generating public/private rsa key pair. 2024-09-13T15:47:20.512 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: Your identification has been saved in /tmp/tmp7z0fiyyz/key 2024-09-13T15:47:20.512 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: Your public key has been saved in /tmp/tmp7z0fiyyz/key.pub 2024-09-13T15:47:20.512 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: The key fingerprint is: 2024-09-13T15:47:20.512 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: SHA256:y6hGI/0iaZWHaIA7Q3+GlWMZRUJUvfSDXm+TxqehDaI ceph-3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T15:47:20.512 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: The key's randomart image is: 2024-09-13T15:47:20.512 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: +---[RSA 3072]----+ 2024-09-13T15:47:20.512 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: | o+++. | 2024-09-13T15:47:20.512 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: | .. o | 2024-09-13T15:47:20.512 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: |. + . + | 2024-09-13T15:47:20.512 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: |o. * o + | 2024-09-13T15:47:20.513 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: |.o.o+o. S . + . | 2024-09-13T15:47:20.513 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: |+ +oBo.o + . O . | 2024-09-13T15:47:20.513 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: | + =o+. + . * = | 2024-09-13T15:47:20.513 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: | + o..E . o | 2024-09-13T15:47:20.513 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: | . o.. | 2024-09-13T15:47:20.513 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: +----[SHA256]-----+ 2024-09-13T15:47:20.905 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.691+0000 7f7e61000640 1 Processor -- start 2024-09-13T15:47:20.906 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.692+0000 7f7e61000640 1 -- start start 2024-09-13T15:47:20.906 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.692+0000 7f7e61000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e5c1078a0 0x7f7e5c107ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:20.906 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.692+0000 7f7e61000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c108270 con 0x7f7e5c1078a0 2024-09-13T15:47:20.906 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.693+0000 7f7e5b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e5c1078a0 0x7f7e5c107ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:20.906 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.693+0000 7f7e5b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e5c1078a0 0x7f7e5c107ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52600/0 (socket says 172.21.15.17:52600) 2024-09-13T15:47:20.906 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.693+0000 7f7e5b400640 1 -- 172.21.15.17:0/690184469 learned_addr learned my addr 172.21.15.17:0/690184469 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:20.906 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.693+0000 7f7e5b400640 1 -- 172.21.15.17:0/690184469 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c1087c0 con 0x7f7e5c1078a0 2024-09-13T15:47:20.906 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.694+0000 7f7e5b400640 1 --2- 172.21.15.17:0/690184469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e5c1078a0 0x7f7e5c107ca0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009820 tx=0x7f7e4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2545aee1717db7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:20.906 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.694+0000 7f7e5aa00640 1 -- 172.21.15.17:0/690184469 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e4c02ae70 con 0x7f7e5c1078a0 2024-09-13T15:47:20.906 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.694+0000 7f7e5aa00640 1 -- 172.21.15.17:0/690184469 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7e4c0328e0 con 0x7f7e5c1078a0 2024-09-13T15:47:20.906 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.694+0000 7f7e5aa00640 1 -- 172.21.15.17:0/690184469 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e4c0308c0 con 0x7f7e5c1078a0 2024-09-13T15:47:20.906 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.695+0000 7f7e61000640 1 -- 172.21.15.17:0/690184469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e5c1078a0 msgr2=0x7f7e5c107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:20.907 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.695+0000 7f7e61000640 1 --2- 172.21.15.17:0/690184469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e5c1078a0 0x7f7e5c107ca0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009820 tx=0x7f7e4c02a270 comp rx=0 tx=0).stop 2024-09-13T15:47:20.907 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.695+0000 7f7e61000640 1 -- 172.21.15.17:0/690184469 shutdown_connections 2024-09-13T15:47:20.907 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.695+0000 7f7e61000640 1 --2- 172.21.15.17:0/690184469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e5c1078a0 0x7f7e5c107ca0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:20.907 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.695+0000 7f7e61000640 1 -- 172.21.15.17:0/690184469 >> 172.21.15.17:0/690184469 conn(0x7f7e5c07ac20 msgr2=0x7f7e5c07b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:20.907 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.695+0000 7f7e61000640 1 -- 172.21.15.17:0/690184469 shutdown_connections 2024-09-13T15:47:20.907 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.695+0000 7f7e61000640 1 -- 172.21.15.17:0/690184469 wait complete. 2024-09-13T15:47:20.907 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.696+0000 7f7e61000640 1 Processor -- start 2024-09-13T15:47:20.907 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.696+0000 7f7e61000640 1 -- start start 2024-09-13T15:47:20.907 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.697+0000 7f7e61000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e5c1078a0 0x7f7e5c19b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:20.907 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.697+0000 7f7e61000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c19b7d0 con 0x7f7e5c1078a0 2024-09-13T15:47:20.907 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.697+0000 7f7e5b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e5c1078a0 0x7f7e5c19b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:20.907 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.697+0000 7f7e5b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e5c1078a0 0x7f7e5c19b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52616/0 (socket says 172.21.15.17:52616) 2024-09-13T15:47:20.907 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.697+0000 7f7e5b400640 1 -- 172.21.15.17:0/1730736435 learned_addr learned my addr 172.21.15.17:0/1730736435 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:20.907 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.698+0000 7f7e5b400640 1 -- 172.21.15.17:0/1730736435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4c0094d0 con 0x7f7e5c1078a0 2024-09-13T15:47:20.908 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.698+0000 7f7e5b400640 1 --2- 172.21.15.17:0/1730736435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e5c1078a0 0x7f7e5c19b290 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0097f0 tx=0x7f7e4c030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:20.908 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.698+0000 7f7e58c00640 1 -- 172.21.15.17:0/1730736435 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e4c032d90 con 0x7f7e5c1078a0 2024-09-13T15:47:20.908 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.698+0000 7f7e61000640 1 -- 172.21.15.17:0/1730736435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5c19b9d0 con 0x7f7e5c1078a0 2024-09-13T15:47:20.908 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.698+0000 7f7e58c00640 1 -- 172.21.15.17:0/1730736435 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7e4c03b8d0 con 0x7f7e5c1078a0 2024-09-13T15:47:20.908 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.698+0000 7f7e61000640 1 -- 172.21.15.17:0/1730736435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5c19be70 con 0x7f7e5c1078a0 2024-09-13T15:47:20.908 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.698+0000 7f7e58c00640 1 -- 172.21.15.17:0/1730736435 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e4c03a780 con 0x7f7e5c1078a0 2024-09-13T15:47:20.908 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.699+0000 7f7e58c00640 1 -- 172.21.15.17:0/1730736435 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f7e4c039040 con 0x7f7e5c1078a0 2024-09-13T15:47:20.908 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.700+0000 7f7e61000640 1 -- 172.21.15.17:0/1730736435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e38005280 con 0x7f7e5c1078a0 2024-09-13T15:47:20.908 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.700+0000 7f7e58c00640 1 --2- 172.21.15.17:0/1730736435 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f7e40038670 0x7f7e4003ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:20.908 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.700+0000 7f7e58c00640 1 -- 172.21.15.17:0/1730736435 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7e4c06b7a0 con 0x7f7e5c1078a0 2024-09-13T15:47:20.909 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.700+0000 7f7e53e00640 1 --2- 172.21.15.17:0/1730736435 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f7e40038670 0x7f7e4003ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:20.909 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.701+0000 7f7e53e00640 1 --2- 172.21.15.17:0/1730736435 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f7e40038670 0x7f7e4003ab30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7e440098c0 tx=0x7f7e44006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:20.909 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.709+0000 7f7e58c00640 1 -- 172.21.15.17:0/1730736435 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7e4c04b710 con 0x7f7e5c1078a0 2024-09-13T15:47:20.909 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:19.907+0000 7f7e61000640 1 -- 172.21.15.17:0/1730736435 --> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e38000bf0 con 0x7f7e40038670 2024-09-13T15:47:20.909 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:20.248+0000 7f7e58c00640 1 -- 172.21.15.17:0/1730736435 <== mgr.14118 v2:172.21.15.17:6800/386837955 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7e38000bf0 con 0x7f7e40038670 2024-09-13T15:47:20.909 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:20.250+0000 7f7e61000640 1 -- 172.21.15.17:0/1730736435 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f7e40038670 msgr2=0x7f7e4003ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:20.909 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:20.250+0000 7f7e61000640 1 --2- 172.21.15.17:0/1730736435 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f7e40038670 0x7f7e4003ab30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7e440098c0 tx=0x7f7e44006db0 comp rx=0 tx=0).stop 2024-09-13T15:47:20.909 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:20.250+0000 7f7e61000640 1 -- 172.21.15.17:0/1730736435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e5c1078a0 msgr2=0x7f7e5c19b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:20.909 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:20.250+0000 7f7e61000640 1 --2- 172.21.15.17:0/1730736435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e5c1078a0 0x7f7e5c19b290 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0097f0 tx=0x7f7e4c030db0 comp rx=0 tx=0).stop 2024-09-13T15:47:20.909 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:20.250+0000 7f7e61000640 1 -- 172.21.15.17:0/1730736435 shutdown_connections 2024-09-13T15:47:20.909 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:20.250+0000 7f7e61000640 1 --2- 172.21.15.17:0/1730736435 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f7e40038670 0x7f7e4003ab30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:20.909 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:20.250+0000 7f7e61000640 1 --2- 172.21.15.17:0/1730736435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e5c1078a0 0x7f7e5c19b290 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:20.909 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:20.250+0000 7f7e61000640 1 -- 172.21.15.17:0/1730736435 >> 172.21.15.17:0/1730736435 conn(0x7f7e5c07ac20 msgr2=0x7f7e5c1054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:20.910 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:20.251+0000 7f7e61000640 1 -- 172.21.15.17:0/1730736435 shutdown_connections 2024-09-13T15:47:20.910 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:20.251+0000 7f7e61000640 1 -- 172.21.15.17:0/1730736435 wait complete. 2024-09-13T15:47:21.147 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:21 smithi017 ceph-mon[30494]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:47:21.147 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:21 smithi017 ceph-mon[30494]: Generating ssh key... 2024-09-13T15:47:21.147 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:21 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' 2024-09-13T15:47:21.147 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:21 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' 2024-09-13T15:47:22.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8WcuSieCRhJuBZrBtIKQ7OSqo6CcwSf+QqAaJuMRXuTgJUTBGZLExh74jBGGxahVmAL8L2CH50Ms8VFDgAOXMKUVZEe3Z91djyQrMlYEHe+A6RT7ZPE7t3yMJiMT+sa6ce6bWIU9vR/L/ez69f62qhD1U8NXSuQOjtRxVMQ6KYGX/bBkSSah9hIu+P8PJEbZcNK6c8DzEsroYQbvJhZHS2T/G70uY7PlxRRN/c379NsXOXYaQiB3Z3rXJn2nCW3D+ZZAl2wbhpwhW3tAnHuLjXfWnDlVSIgAzS7uN1oLChpVvJaO9YBcm09XZINZrvnL4cmHM7Fs7p6ime14Xq9bR6Yi2tZgzfHthsufdcyabPJjdt9qcKJauCfamEaj4WI6to4rB15tsRUS5RqurVO/nUmEiRFKOR7VYn/R6/1X3b+98a2HBjufWi765YJcTdj34RlZQEdvLG63bXwbNLIz9a6KYC9q1SYTzg78b6fMp2S0PTM9wclV3lk+R9gj7xFE= ceph-3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T15:47:22.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.364+0000 7fb9f5600640 1 Processor -- start 2024-09-13T15:47:22.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.365+0000 7fb9f5600640 1 -- start start 2024-09-13T15:47:22.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.365+0000 7fb9f5600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9f01078f0 0x7fb9f0107cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:22.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.365+0000 7fb9f5600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f01082c0 con 0x7fb9f01078f0 2024-09-13T15:47:22.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.365+0000 7fb9efe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9f01078f0 0x7fb9f0107cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:22.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.365+0000 7fb9efe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9f01078f0 0x7fb9f0107cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52632/0 (socket says 172.21.15.17:52632) 2024-09-13T15:47:22.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.365+0000 7fb9efe00640 1 -- 172.21.15.17:0/3706211939 learned_addr learned my addr 172.21.15.17:0/3706211939 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:22.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.366+0000 7fb9efe00640 1 -- 172.21.15.17:0/3706211939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f01087c0 con 0x7fb9f01078f0 2024-09-13T15:47:22.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.367+0000 7fb9efe00640 1 --2- 172.21.15.17:0/3706211939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9f01078f0 0x7fb9f0107cf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009820 tx=0x7fb9e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d562da7d446ecc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:22.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.367+0000 7fb9ef400640 1 -- 172.21.15.17:0/3706211939 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9e002ae70 con 0x7fb9f01078f0 2024-09-13T15:47:22.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.367+0000 7fb9ef400640 1 -- 172.21.15.17:0/3706211939 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb9e00328e0 con 0x7fb9f01078f0 2024-09-13T15:47:22.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.367+0000 7fb9ef400640 1 -- 172.21.15.17:0/3706211939 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9e00308c0 con 0x7fb9f01078f0 2024-09-13T15:47:22.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.367+0000 7fb9f5600640 1 -- 172.21.15.17:0/3706211939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9f01078f0 msgr2=0x7fb9f0107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:22.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.367+0000 7fb9f5600640 1 --2- 172.21.15.17:0/3706211939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9f01078f0 0x7fb9f0107cf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009820 tx=0x7fb9e002a270 comp rx=0 tx=0).stop 2024-09-13T15:47:22.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.368+0000 7fb9f5600640 1 -- 172.21.15.17:0/3706211939 shutdown_connections 2024-09-13T15:47:22.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.368+0000 7fb9f5600640 1 --2- 172.21.15.17:0/3706211939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9f01078f0 0x7fb9f0107cf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:22.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.368+0000 7fb9f5600640 1 -- 172.21.15.17:0/3706211939 >> 172.21.15.17:0/3706211939 conn(0x7fb9f007aba0 msgr2=0x7fb9f007afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:22.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.368+0000 7fb9f5600640 1 -- 172.21.15.17:0/3706211939 shutdown_connections 2024-09-13T15:47:22.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.368+0000 7fb9f5600640 1 -- 172.21.15.17:0/3706211939 wait complete. 2024-09-13T15:47:22.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.369+0000 7fb9f5600640 1 Processor -- start 2024-09-13T15:47:22.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.369+0000 7fb9f5600640 1 -- start start 2024-09-13T15:47:22.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.369+0000 7fb9f5600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9f01078f0 0x7fb9f019b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:22.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.369+0000 7fb9f5600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f019b890 con 0x7fb9f01078f0 2024-09-13T15:47:22.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.369+0000 7fb9efe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9f01078f0 0x7fb9f019b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:22.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.369+0000 7fb9efe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9f01078f0 0x7fb9f019b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52642/0 (socket says 172.21.15.17:52642) 2024-09-13T15:47:22.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.369+0000 7fb9efe00640 1 -- 172.21.15.17:0/310503420 learned_addr learned my addr 172.21.15.17:0/310503420 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:22.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.370+0000 7fb9efe00640 1 -- 172.21.15.17:0/310503420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e00094d0 con 0x7fb9f01078f0 2024-09-13T15:47:22.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.370+0000 7fb9efe00640 1 --2- 172.21.15.17:0/310503420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9f01078f0 0x7fb9f019b350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0030480 tx=0x7fb9e0030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:22.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.370+0000 7fb9ed600640 1 -- 172.21.15.17:0/310503420 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9e0032d90 con 0x7fb9f01078f0 2024-09-13T15:47:22.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.370+0000 7fb9ed600640 1 -- 172.21.15.17:0/310503420 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb9e003b8b0 con 0x7fb9f01078f0 2024-09-13T15:47:22.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.370+0000 7fb9ed600640 1 -- 172.21.15.17:0/310503420 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9e003a6e0 con 0x7fb9f01078f0 2024-09-13T15:47:22.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.370+0000 7fb9f5600640 1 -- 172.21.15.17:0/310503420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f019ba90 con 0x7fb9f01078f0 2024-09-13T15:47:22.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.370+0000 7fb9f5600640 1 -- 172.21.15.17:0/310503420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f019bf30 con 0x7fb9f01078f0 2024-09-13T15:47:22.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.371+0000 7fb9ed600640 1 -- 172.21.15.17:0/310503420 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fb9e0039040 con 0x7fb9f01078f0 2024-09-13T15:47:22.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.372+0000 7fb9f5600640 1 -- 172.21.15.17:0/310503420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f010b9f0 con 0x7fb9f01078f0 2024-09-13T15:47:22.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.372+0000 7fb9ed600640 1 --2- 172.21.15.17:0/310503420 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7fb9d4038670 0x7fb9d403ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:22.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.372+0000 7fb9ed600640 1 -- 172.21.15.17:0/310503420 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb9e006b6c0 con 0x7fb9f01078f0 2024-09-13T15:47:22.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.372+0000 7fb9e7e00640 1 --2- 172.21.15.17:0/310503420 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7fb9d4038670 0x7fb9d403ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:22.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.373+0000 7fb9e7e00640 1 --2- 172.21.15.17:0/310503420 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7fb9d4038670 0x7fb9d403ab30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb9d80098c0 tx=0x7fb9d8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:22.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.378+0000 7fb9ed600640 1 -- 172.21.15.17:0/310503420 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb9e003ba20 con 0x7fb9f01078f0 2024-09-13T15:47:22.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.558+0000 7fb9f5600640 1 -- 172.21.15.17:0/310503420 --> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9f0105d00 con 0x7fb9d4038670 2024-09-13T15:47:22.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.559+0000 7fb9ed600640 1 -- 172.21.15.17:0/310503420 <== mgr.14118 v2:172.21.15.17:6800/386837955 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fb9f0105d00 con 0x7fb9d4038670 2024-09-13T15:47:22.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.561+0000 7fb9f5600640 1 -- 172.21.15.17:0/310503420 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7fb9d4038670 msgr2=0x7fb9d403ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:22.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.561+0000 7fb9f5600640 1 --2- 172.21.15.17:0/310503420 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7fb9d4038670 0x7fb9d403ab30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb9d80098c0 tx=0x7fb9d8006db0 comp rx=0 tx=0).stop 2024-09-13T15:47:22.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.561+0000 7fb9f5600640 1 -- 172.21.15.17:0/310503420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9f01078f0 msgr2=0x7fb9f019b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:22.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.561+0000 7fb9f5600640 1 --2- 172.21.15.17:0/310503420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9f01078f0 0x7fb9f019b350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0030480 tx=0x7fb9e0030db0 comp rx=0 tx=0).stop 2024-09-13T15:47:22.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.561+0000 7fb9f5600640 1 -- 172.21.15.17:0/310503420 shutdown_connections 2024-09-13T15:47:22.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.561+0000 7fb9f5600640 1 --2- 172.21.15.17:0/310503420 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7fb9d4038670 0x7fb9d403ab30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:22.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.562+0000 7fb9f5600640 1 --2- 172.21.15.17:0/310503420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9f01078f0 0x7fb9f019b350 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:22.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.562+0000 7fb9f5600640 1 -- 172.21.15.17:0/310503420 >> 172.21.15.17:0/310503420 conn(0x7fb9f007aba0 msgr2=0x7fb9f01055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:22.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.562+0000 7fb9f5600640 1 -- 172.21.15.17:0/310503420 shutdown_connections 2024-09-13T15:47:22.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:21.562+0000 7fb9f5600640 1 -- 172.21.15.17:0/310503420 wait complete. 2024-09-13T15:47:22.184 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-13T15:47:22.184 INFO:teuthology.orchestra.run.smithi017.stdout:Adding key to root@localhost authorized_keys... 2024-09-13T15:47:22.195 INFO:teuthology.orchestra.run.smithi017.stdout:Adding host smithi017... 2024-09-13T15:47:22.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:22 smithi017 ceph-mon[30494]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:47:23.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:23 smithi017 ceph-mon[30494]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi017", "addr": "172.21.15.17", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:47:25.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:25 smithi017 ceph-mon[30494]: Deploying cephadm binary to smithi017 2024-09-13T15:47:27.437 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Added host 'smithi017' with addr '172.21.15.17' 2024-09-13T15:47:27.438 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.671+0000 7efecb400640 1 Processor -- start 2024-09-13T15:47:27.438 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.671+0000 7efecb400640 1 -- start start 2024-09-13T15:47:27.438 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.671+0000 7efecb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec4105590 0x7efec4105990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:27.438 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.671+0000 7efecb400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec4105f60 con 0x7efec4105590 2024-09-13T15:47:27.438 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.672+0000 7efec8a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec4105590 0x7efec4105990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:27.438 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.672+0000 7efec8a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec4105590 0x7efec4105990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52644/0 (socket says 172.21.15.17:52644) 2024-09-13T15:47:27.438 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.672+0000 7efec8a00640 1 -- 172.21.15.17:0/936875663 learned_addr learned my addr 172.21.15.17:0/936875663 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:27.438 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.672+0000 7efec8a00640 1 -- 172.21.15.17:0/936875663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec4106790 con 0x7efec4105590 2024-09-13T15:47:27.438 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.673+0000 7efec8a00640 1 --2- 172.21.15.17:0/936875663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec4105590 0x7efec4105990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009820 tx=0x7efeb802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283f8ee0a87cdafa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:27.438 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.673+0000 7efec3400640 1 -- 172.21.15.17:0/936875663 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efeb802ae70 con 0x7efec4105590 2024-09-13T15:47:27.438 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.673+0000 7efec3400640 1 -- 172.21.15.17:0/936875663 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efeb80328e0 con 0x7efec4105590 2024-09-13T15:47:27.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.673+0000 7efec3400640 1 -- 172.21.15.17:0/936875663 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efeb80308c0 con 0x7efec4105590 2024-09-13T15:47:27.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.674+0000 7efecb400640 1 -- 172.21.15.17:0/936875663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec4105590 msgr2=0x7efec4105990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:27.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.674+0000 7efecb400640 1 --2- 172.21.15.17:0/936875663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec4105590 0x7efec4105990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009820 tx=0x7efeb802a270 comp rx=0 tx=0).stop 2024-09-13T15:47:27.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.674+0000 7efecb400640 1 -- 172.21.15.17:0/936875663 shutdown_connections 2024-09-13T15:47:27.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.674+0000 7efecb400640 1 --2- 172.21.15.17:0/936875663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec4105590 0x7efec4105990 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:27.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.674+0000 7efecb400640 1 -- 172.21.15.17:0/936875663 >> 172.21.15.17:0/936875663 conn(0x7efec4100d40 msgr2=0x7efec4103160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:27.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.674+0000 7efecb400640 1 -- 172.21.15.17:0/936875663 shutdown_connections 2024-09-13T15:47:27.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.674+0000 7efecb400640 1 -- 172.21.15.17:0/936875663 wait complete. 2024-09-13T15:47:27.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.675+0000 7efecb400640 1 Processor -- start 2024-09-13T15:47:27.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.675+0000 7efecb400640 1 -- start start 2024-09-13T15:47:27.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.675+0000 7efecb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec4105590 0x7efec407baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:27.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.675+0000 7efecb400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec407c030 con 0x7efec4105590 2024-09-13T15:47:27.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.676+0000 7efec8a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec4105590 0x7efec407baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:27.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.676+0000 7efec8a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec4105590 0x7efec407baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52654/0 (socket says 172.21.15.17:52654) 2024-09-13T15:47:27.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.676+0000 7efec8a00640 1 -- 172.21.15.17:0/3000791586 learned_addr learned my addr 172.21.15.17:0/3000791586 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:27.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.676+0000 7efec8a00640 1 -- 172.21.15.17:0/3000791586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb80094d0 con 0x7efec4105590 2024-09-13T15:47:27.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.676+0000 7efec8a00640 1 --2- 172.21.15.17:0/3000791586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec4105590 0x7efec407baf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efeb802a790 tx=0x7efeb8030e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:27.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.677+0000 7efec1600640 1 -- 172.21.15.17:0/3000791586 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efeb8032d90 con 0x7efec4105590 2024-09-13T15:47:27.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.677+0000 7efec1600640 1 -- 172.21.15.17:0/3000791586 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efeb803b8d0 con 0x7efec4105590 2024-09-13T15:47:27.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.677+0000 7efec1600640 1 -- 172.21.15.17:0/3000791586 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efeb803a800 con 0x7efec4105590 2024-09-13T15:47:27.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.677+0000 7efecb400640 1 -- 172.21.15.17:0/3000791586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec407a220 con 0x7efec4105590 2024-09-13T15:47:27.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.677+0000 7efecb400640 1 -- 172.21.15.17:0/3000791586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec407a6c0 con 0x7efec4105590 2024-09-13T15:47:27.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.678+0000 7efec1600640 1 -- 172.21.15.17:0/3000791586 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7efeb8039040 con 0x7efec4105590 2024-09-13T15:47:27.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.678+0000 7efecb400640 1 -- 172.21.15.17:0/3000791586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec41099c0 con 0x7efec4105590 2024-09-13T15:47:27.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.678+0000 7efec1600640 1 --2- 172.21.15.17:0/3000791586 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7efeac038670 0x7efeac03ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:27.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.678+0000 7efec1600640 1 -- 172.21.15.17:0/3000791586 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7efeb806b880 con 0x7efec4105590 2024-09-13T15:47:27.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.679+0000 7efec3e00640 1 --2- 172.21.15.17:0/3000791586 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7efeac038670 0x7efeac03ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:27.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.679+0000 7efec3e00640 1 --2- 172.21.15.17:0/3000791586 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7efeac038670 0x7efeac03ab30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efeb00098c0 tx=0x7efeb0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:27.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.683+0000 7efec1600640 1 -- 172.21.15.17:0/3000791586 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efeb803bd90 con 0x7efec4105590 2024-09-13T15:47:27.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:22.869+0000 7efecb400640 1 -- 172.21.15.17:0/3000791586 --> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi017", "addr": "172.21.15.17", "target": ["mon-mgr", ""]}) v1 -- 0x7efec407ae20 con 0x7efeac038670 2024-09-13T15:47:27.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:26.810+0000 7efec1600640 1 -- 172.21.15.17:0/3000791586 <== mgr.14118 v2:172.21.15.17:6800/386837955 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7efec407ae20 con 0x7efeac038670 2024-09-13T15:47:27.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:26.813+0000 7efecb400640 1 -- 172.21.15.17:0/3000791586 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7efeac038670 msgr2=0x7efeac03ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:27.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:26.813+0000 7efecb400640 1 --2- 172.21.15.17:0/3000791586 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7efeac038670 0x7efeac03ab30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efeb00098c0 tx=0x7efeb0006db0 comp rx=0 tx=0).stop 2024-09-13T15:47:27.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:26.813+0000 7efecb400640 1 -- 172.21.15.17:0/3000791586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec4105590 msgr2=0x7efec407baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:27.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:26.813+0000 7efecb400640 1 --2- 172.21.15.17:0/3000791586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec4105590 0x7efec407baf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efeb802a790 tx=0x7efeb8030e20 comp rx=0 tx=0).stop 2024-09-13T15:47:27.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:26.814+0000 7efecb400640 1 -- 172.21.15.17:0/3000791586 shutdown_connections 2024-09-13T15:47:27.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:26.814+0000 7efecb400640 1 --2- 172.21.15.17:0/3000791586 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7efeac038670 0x7efeac03ab30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:27.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:26.814+0000 7efecb400640 1 --2- 172.21.15.17:0/3000791586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec4105590 0x7efec407baf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:27.442 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:26.814+0000 7efecb400640 1 -- 172.21.15.17:0/3000791586 >> 172.21.15.17:0/3000791586 conn(0x7efec4100d40 msgr2=0x7efec4101940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:27.442 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:26.814+0000 7efecb400640 1 -- 172.21.15.17:0/3000791586 shutdown_connections 2024-09-13T15:47:27.442 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:26.814+0000 7efecb400640 1 -- 172.21.15.17:0/3000791586 wait complete. 2024-09-13T15:47:27.442 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying unmanaged mon service... 2024-09-13T15:47:28.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:27 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' 2024-09-13T15:47:28.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:27 smithi017 ceph-mon[30494]: Added host smithi017 2024-09-13T15:47:28.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:27 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:47:29.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:29 smithi017 ceph-mon[30494]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:47:29.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:29 smithi017 ceph-mon[30494]: Saving service mon spec with placement count:5 2024-09-13T15:47:29.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:29 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' 2024-09-13T15:47:29.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:29 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' 2024-09-13T15:47:29.825 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-13T15:47:29.826 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.146+0000 7f964aa00640 1 Processor -- start 2024-09-13T15:47:29.826 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.146+0000 7f964aa00640 1 -- start start 2024-09-13T15:47:29.826 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.146+0000 7f964aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96441077f0 0x7f9644107bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:29.826 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.146+0000 7f964aa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96441081c0 con 0x7f96441077f0 2024-09-13T15:47:29.826 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.147+0000 7f9649600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96441077f0 0x7f9644107bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:29.826 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.147+0000 7f9649600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96441077f0 0x7f9644107bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52658/0 (socket says 172.21.15.17:52658) 2024-09-13T15:47:29.826 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.147+0000 7f9649600640 1 -- 172.21.15.17:0/2558896126 learned_addr learned my addr 172.21.15.17:0/2558896126 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:29.827 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.147+0000 7f9649600640 1 -- 172.21.15.17:0/2558896126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9644108300 con 0x7f96441077f0 2024-09-13T15:47:29.827 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.148+0000 7f9649600640 1 --2- 172.21.15.17:0/2558896126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96441077f0 0x7f9644107bf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9638009820 tx=0x7f963802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3364444829ed4cd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:29.827 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.149+0000 7f9643e00640 1 -- 172.21.15.17:0/2558896126 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f963802ae70 con 0x7f96441077f0 2024-09-13T15:47:29.827 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.149+0000 7f9643e00640 1 -- 172.21.15.17:0/2558896126 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f96380328e0 con 0x7f96441077f0 2024-09-13T15:47:29.827 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.149+0000 7f9643e00640 1 -- 172.21.15.17:0/2558896126 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96380308c0 con 0x7f96441077f0 2024-09-13T15:47:29.827 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.149+0000 7f964aa00640 1 -- 172.21.15.17:0/2558896126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96441077f0 msgr2=0x7f9644107bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:29.827 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.149+0000 7f964aa00640 1 --2- 172.21.15.17:0/2558896126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96441077f0 0x7f9644107bf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9638009820 tx=0x7f963802a270 comp rx=0 tx=0).stop 2024-09-13T15:47:29.827 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.149+0000 7f964aa00640 1 -- 172.21.15.17:0/2558896126 shutdown_connections 2024-09-13T15:47:29.827 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.149+0000 7f964aa00640 1 --2- 172.21.15.17:0/2558896126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96441077f0 0x7f9644107bf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:29.827 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.149+0000 7f964aa00640 1 -- 172.21.15.17:0/2558896126 >> 172.21.15.17:0/2558896126 conn(0x7f964407ab90 msgr2=0x7f964407afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:29.827 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.149+0000 7f964aa00640 1 -- 172.21.15.17:0/2558896126 shutdown_connections 2024-09-13T15:47:29.827 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.149+0000 7f964aa00640 1 -- 172.21.15.17:0/2558896126 wait complete. 2024-09-13T15:47:29.827 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.150+0000 7f964aa00640 1 Processor -- start 2024-09-13T15:47:29.827 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.150+0000 7f964aa00640 1 -- start start 2024-09-13T15:47:29.828 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.151+0000 7f964aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96441077f0 0x7f964419b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:29.828 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.151+0000 7f964aa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964419b7f0 con 0x7f96441077f0 2024-09-13T15:47:29.828 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.151+0000 7f9649600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96441077f0 0x7f964419b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:29.828 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.151+0000 7f9649600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96441077f0 0x7f964419b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52668/0 (socket says 172.21.15.17:52668) 2024-09-13T15:47:29.828 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.151+0000 7f9649600640 1 -- 172.21.15.17:0/512479148 learned_addr learned my addr 172.21.15.17:0/512479148 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:29.828 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.151+0000 7f9649600640 1 -- 172.21.15.17:0/512479148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96380094d0 con 0x7f96441077f0 2024-09-13T15:47:29.828 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.152+0000 7f9649600640 1 --2- 172.21.15.17:0/512479148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96441077f0 0x7f964419b2b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f96380097f0 tx=0x7f9638030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:29.828 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.152+0000 7f9642000640 1 -- 172.21.15.17:0/512479148 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9638032d90 con 0x7f96441077f0 2024-09-13T15:47:29.828 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.152+0000 7f9642000640 1 -- 172.21.15.17:0/512479148 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f963803b8d0 con 0x7f96441077f0 2024-09-13T15:47:29.828 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.152+0000 7f9642000640 1 -- 172.21.15.17:0/512479148 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f963803a780 con 0x7f96441077f0 2024-09-13T15:47:29.828 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.152+0000 7f964aa00640 1 -- 172.21.15.17:0/512479148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964419b9f0 con 0x7f96441077f0 2024-09-13T15:47:29.828 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.152+0000 7f964aa00640 1 -- 172.21.15.17:0/512479148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964419be90 con 0x7f96441077f0 2024-09-13T15:47:29.828 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.153+0000 7f9642000640 1 -- 172.21.15.17:0/512479148 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f9638039040 con 0x7f96441077f0 2024-09-13T15:47:29.829 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.153+0000 7f964aa00640 1 -- 172.21.15.17:0/512479148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9644109450 con 0x7f96441077f0 2024-09-13T15:47:29.829 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.153+0000 7f9642000640 1 --2- 172.21.15.17:0/512479148 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f962c038670 0x7f962c03ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:29.829 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.153+0000 7f9642000640 1 -- 172.21.15.17:0/512479148 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f963806b7e0 con 0x7f96441077f0 2024-09-13T15:47:29.829 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.154+0000 7f9648c00640 1 --2- 172.21.15.17:0/512479148 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f962c038670 0x7f962c03ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:29.829 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.154+0000 7f9648c00640 1 --2- 172.21.15.17:0/512479148 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f962c038670 0x7f962c03ab30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f96300098c0 tx=0x7f9630006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:29.829 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.159+0000 7f9642000640 1 -- 172.21.15.17:0/512479148 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f963803bd90 con 0x7f96441077f0 2024-09-13T15:47:29.829 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.358+0000 7f964aa00640 1 -- 172.21.15.17:0/512479148 --> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f964419e7d0 con 0x7f962c038670 2024-09-13T15:47:29.829 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.364+0000 7f9642000640 1 -- 172.21.15.17:0/512479148 <== mgr.14118 v2:172.21.15.17:6800/386837955 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f964419e7d0 con 0x7f962c038670 2024-09-13T15:47:29.829 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.367+0000 7f964aa00640 1 -- 172.21.15.17:0/512479148 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f962c038670 msgr2=0x7f962c03ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:29.829 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.367+0000 7f964aa00640 1 --2- 172.21.15.17:0/512479148 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f962c038670 0x7f962c03ab30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f96300098c0 tx=0x7f9630006db0 comp rx=0 tx=0).stop 2024-09-13T15:47:29.829 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.367+0000 7f964aa00640 1 -- 172.21.15.17:0/512479148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96441077f0 msgr2=0x7f964419b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:29.829 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.367+0000 7f964aa00640 1 --2- 172.21.15.17:0/512479148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96441077f0 0x7f964419b2b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f96380097f0 tx=0x7f9638030db0 comp rx=0 tx=0).stop 2024-09-13T15:47:29.829 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.367+0000 7f964aa00640 1 -- 172.21.15.17:0/512479148 shutdown_connections 2024-09-13T15:47:29.830 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.367+0000 7f964aa00640 1 --2- 172.21.15.17:0/512479148 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f962c038670 0x7f962c03ab30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:29.830 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.367+0000 7f964aa00640 1 --2- 172.21.15.17:0/512479148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96441077f0 0x7f964419b2b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:29.830 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.367+0000 7f964aa00640 1 -- 172.21.15.17:0/512479148 >> 172.21.15.17:0/512479148 conn(0x7f964407ab90 msgr2=0x7f96441054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:29.830 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.367+0000 7f964aa00640 1 -- 172.21.15.17:0/512479148 shutdown_connections 2024-09-13T15:47:29.830 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:28.367+0000 7f964aa00640 1 -- 172.21.15.17:0/512479148 wait complete. 2024-09-13T15:47:29.830 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying unmanaged mgr service... 2024-09-13T15:47:31.135 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:30 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' 2024-09-13T15:47:31.136 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:30 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' 2024-09-13T15:47:31.423 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-13T15:47:31.423 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.562+0000 7fa631800640 1 Processor -- start 2024-09-13T15:47:31.423 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.562+0000 7fa631800640 1 -- start start 2024-09-13T15:47:31.423 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.563+0000 7fa631800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c1078f0 0x7fa62c107cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:31.423 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.563+0000 7fa631800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c1082c0 con 0x7fa62c1078f0 2024-09-13T15:47:31.424 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.563+0000 7fa62be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c1078f0 0x7fa62c107cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:31.424 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.563+0000 7fa62be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c1078f0 0x7fa62c107cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35636/0 (socket says 172.21.15.17:35636) 2024-09-13T15:47:31.424 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.563+0000 7fa62be00640 1 -- 172.21.15.17:0/2152150302 learned_addr learned my addr 172.21.15.17:0/2152150302 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:31.424 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.563+0000 7fa62be00640 1 -- 172.21.15.17:0/2152150302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c1087c0 con 0x7fa62c1078f0 2024-09-13T15:47:31.424 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.564+0000 7fa62be00640 1 --2- 172.21.15.17:0/2152150302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c1078f0 0x7fa62c107cf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009820 tx=0x7fa61c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c89dc988bf2693 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:31.424 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.565+0000 7fa62b400640 1 -- 172.21.15.17:0/2152150302 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa61c02ae70 con 0x7fa62c1078f0 2024-09-13T15:47:31.424 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.565+0000 7fa62b400640 1 -- 172.21.15.17:0/2152150302 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa61c032900 con 0x7fa62c1078f0 2024-09-13T15:47:31.424 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.565+0000 7fa62b400640 1 -- 172.21.15.17:0/2152150302 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa61c030880 con 0x7fa62c1078f0 2024-09-13T15:47:31.424 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.565+0000 7fa631800640 1 -- 172.21.15.17:0/2152150302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c1078f0 msgr2=0x7fa62c107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:31.424 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.565+0000 7fa631800640 1 --2- 172.21.15.17:0/2152150302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c1078f0 0x7fa62c107cf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009820 tx=0x7fa61c02a270 comp rx=0 tx=0).stop 2024-09-13T15:47:31.424 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.565+0000 7fa631800640 1 -- 172.21.15.17:0/2152150302 shutdown_connections 2024-09-13T15:47:31.424 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.565+0000 7fa631800640 1 --2- 172.21.15.17:0/2152150302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c1078f0 0x7fa62c107cf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:31.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.565+0000 7fa631800640 1 -- 172.21.15.17:0/2152150302 >> 172.21.15.17:0/2152150302 conn(0x7fa62c07aba0 msgr2=0x7fa62c07afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:31.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.565+0000 7fa631800640 1 -- 172.21.15.17:0/2152150302 shutdown_connections 2024-09-13T15:47:31.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.566+0000 7fa631800640 1 -- 172.21.15.17:0/2152150302 wait complete. 2024-09-13T15:47:31.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.566+0000 7fa631800640 1 Processor -- start 2024-09-13T15:47:31.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.567+0000 7fa631800640 1 -- start start 2024-09-13T15:47:31.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.567+0000 7fa631800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c1078f0 0x7fa62c19b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:31.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.567+0000 7fa631800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c19b7f0 con 0x7fa62c1078f0 2024-09-13T15:47:31.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.567+0000 7fa62be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c1078f0 0x7fa62c19b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:31.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.567+0000 7fa62be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c1078f0 0x7fa62c19b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35646/0 (socket says 172.21.15.17:35646) 2024-09-13T15:47:31.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.567+0000 7fa62be00640 1 -- 172.21.15.17:0/2336531144 learned_addr learned my addr 172.21.15.17:0/2336531144 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:31.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.568+0000 7fa62be00640 1 -- 172.21.15.17:0/2336531144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c0094d0 con 0x7fa62c1078f0 2024-09-13T15:47:31.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.568+0000 7fa62be00640 1 --2- 172.21.15.17:0/2336531144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c1078f0 0x7fa62c19b2b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0097f0 tx=0x7fa61c030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:31.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.568+0000 7fa629600640 1 -- 172.21.15.17:0/2336531144 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa61c032c80 con 0x7fa62c1078f0 2024-09-13T15:47:31.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.568+0000 7fa631800640 1 -- 172.21.15.17:0/2336531144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62c19b9f0 con 0x7fa62c1078f0 2024-09-13T15:47:31.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.568+0000 7fa629600640 1 -- 172.21.15.17:0/2336531144 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa61c032de0 con 0x7fa62c1078f0 2024-09-13T15:47:31.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.568+0000 7fa629600640 1 -- 172.21.15.17:0/2336531144 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa61c03a690 con 0x7fa62c1078f0 2024-09-13T15:47:31.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.568+0000 7fa631800640 1 -- 172.21.15.17:0/2336531144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62c19be90 con 0x7fa62c1078f0 2024-09-13T15:47:31.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.570+0000 7fa631800640 1 -- 172.21.15.17:0/2336531144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62c10b9f0 con 0x7fa62c1078f0 2024-09-13T15:47:31.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.570+0000 7fa629600640 1 -- 172.21.15.17:0/2336531144 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fa61c039040 con 0x7fa62c1078f0 2024-09-13T15:47:31.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.571+0000 7fa629600640 1 --2- 172.21.15.17:0/2336531144 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7fa610038620 0x7fa61003aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:31.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.571+0000 7fa629600640 1 -- 172.21.15.17:0/2336531144 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa61c06b840 con 0x7fa62c1078f0 2024-09-13T15:47:31.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.571+0000 7fa623e00640 1 --2- 172.21.15.17:0/2336531144 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7fa610038620 0x7fa61003aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:31.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.572+0000 7fa623e00640 1 --2- 172.21.15.17:0/2336531144 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7fa610038620 0x7fa61003aae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa6140098c0 tx=0x7fa614006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:31.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.575+0000 7fa629600640 1 -- 172.21.15.17:0/2336531144 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa61c0313a0 con 0x7fa62c1078f0 2024-09-13T15:47:31.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.799+0000 7fa631800640 1 -- 172.21.15.17:0/2336531144 --> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fa62c105bb0 con 0x7fa610038620 2024-09-13T15:47:31.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.804+0000 7fa629600640 1 -- 172.21.15.17:0/2336531144 <== mgr.14118 v2:172.21.15.17:6800/386837955 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fa62c105bb0 con 0x7fa610038620 2024-09-13T15:47:31.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.807+0000 7fa631800640 1 -- 172.21.15.17:0/2336531144 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7fa610038620 msgr2=0x7fa61003aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:31.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.807+0000 7fa631800640 1 --2- 172.21.15.17:0/2336531144 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7fa610038620 0x7fa61003aae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa6140098c0 tx=0x7fa614006db0 comp rx=0 tx=0).stop 2024-09-13T15:47:31.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.807+0000 7fa631800640 1 -- 172.21.15.17:0/2336531144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c1078f0 msgr2=0x7fa62c19b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:31.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.807+0000 7fa631800640 1 --2- 172.21.15.17:0/2336531144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c1078f0 0x7fa62c19b2b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0097f0 tx=0x7fa61c030d70 comp rx=0 tx=0).stop 2024-09-13T15:47:31.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.807+0000 7fa631800640 1 -- 172.21.15.17:0/2336531144 shutdown_connections 2024-09-13T15:47:31.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.807+0000 7fa631800640 1 --2- 172.21.15.17:0/2336531144 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7fa610038620 0x7fa61003aae0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:31.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.807+0000 7fa631800640 1 --2- 172.21.15.17:0/2336531144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c1078f0 0x7fa62c19b2b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:31.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.807+0000 7fa631800640 1 -- 172.21.15.17:0/2336531144 >> 172.21.15.17:0/2336531144 conn(0x7fa62c07aba0 msgr2=0x7fa62c1054a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:31.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.807+0000 7fa631800640 1 -- 172.21.15.17:0/2336531144 shutdown_connections 2024-09-13T15:47:31.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:30.807+0000 7fa631800640 1 -- 172.21.15.17:0/2336531144 wait complete. 2024-09-13T15:47:32.252 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:31 smithi017 ceph-mon[30494]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:47:32.253 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:31 smithi017 ceph-mon[30494]: Saving service mgr spec with placement count:2 2024-09-13T15:47:33.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.104+0000 7f536dc00640 1 Processor -- start 2024-09-13T15:47:33.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.105+0000 7f536dc00640 1 -- start start 2024-09-13T15:47:33.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.105+0000 7f536dc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53681078f0 0x7f5368107cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:33.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.105+0000 7f536dc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53681082c0 con 0x7f53681078f0 2024-09-13T15:47:33.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.105+0000 7f5367e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53681078f0 0x7f5368107cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:33.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.105+0000 7f5367e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53681078f0 0x7f5368107cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35656/0 (socket says 172.21.15.17:35656) 2024-09-13T15:47:33.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.105+0000 7f5367e00640 1 -- 172.21.15.17:0/972994384 learned_addr learned my addr 172.21.15.17:0/972994384 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:33.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.106+0000 7f5367e00640 1 -- 172.21.15.17:0/972994384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53681087c0 con 0x7f53681078f0 2024-09-13T15:47:33.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.106+0000 7f5367e00640 1 --2- 172.21.15.17:0/972994384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53681078f0 0x7f5368107cf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5358009820 tx=0x7f535802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68684473892c973a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:33.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.107+0000 7f5367400640 1 -- 172.21.15.17:0/972994384 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f535802ae70 con 0x7f53681078f0 2024-09-13T15:47:33.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.107+0000 7f5367400640 1 -- 172.21.15.17:0/972994384 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5358032900 con 0x7f53681078f0 2024-09-13T15:47:33.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.107+0000 7f5367400640 1 -- 172.21.15.17:0/972994384 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5358030880 con 0x7f53681078f0 2024-09-13T15:47:33.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.107+0000 7f536dc00640 1 -- 172.21.15.17:0/972994384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53681078f0 msgr2=0x7f5368107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:33.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.107+0000 7f536dc00640 1 --2- 172.21.15.17:0/972994384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53681078f0 0x7f5368107cf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5358009820 tx=0x7f535802a270 comp rx=0 tx=0).stop 2024-09-13T15:47:33.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.107+0000 7f536dc00640 1 -- 172.21.15.17:0/972994384 shutdown_connections 2024-09-13T15:47:33.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.107+0000 7f536dc00640 1 --2- 172.21.15.17:0/972994384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53681078f0 0x7f5368107cf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:33.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.107+0000 7f536dc00640 1 -- 172.21.15.17:0/972994384 >> 172.21.15.17:0/972994384 conn(0x7f536807aba0 msgr2=0x7f536807afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:33.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.108+0000 7f536dc00640 1 -- 172.21.15.17:0/972994384 shutdown_connections 2024-09-13T15:47:33.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.108+0000 7f536dc00640 1 -- 172.21.15.17:0/972994384 wait complete. 2024-09-13T15:47:33.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.109+0000 7f536dc00640 1 Processor -- start 2024-09-13T15:47:33.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.109+0000 7f536dc00640 1 -- start start 2024-09-13T15:47:33.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.109+0000 7f536dc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53681078f0 0x7f536819b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:33.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.109+0000 7f536dc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536819b7c0 con 0x7f53681078f0 2024-09-13T15:47:33.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.109+0000 7f5367e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53681078f0 0x7f536819b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:33.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.109+0000 7f5367e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53681078f0 0x7f536819b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35672/0 (socket says 172.21.15.17:35672) 2024-09-13T15:47:33.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.109+0000 7f5367e00640 1 -- 172.21.15.17:0/3087659235 learned_addr learned my addr 172.21.15.17:0/3087659235 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:33.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.110+0000 7f5367e00640 1 -- 172.21.15.17:0/3087659235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53580094d0 con 0x7f53681078f0 2024-09-13T15:47:33.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.110+0000 7f5367e00640 1 --2- 172.21.15.17:0/3087659235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53681078f0 0x7f536819b280 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f53580097f0 tx=0x7f5358030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:33.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.110+0000 7f5365600640 1 -- 172.21.15.17:0/3087659235 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5358032c80 con 0x7f53681078f0 2024-09-13T15:47:33.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.110+0000 7f5365600640 1 -- 172.21.15.17:0/3087659235 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5358032de0 con 0x7f53681078f0 2024-09-13T15:47:33.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.110+0000 7f536dc00640 1 -- 172.21.15.17:0/3087659235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f536819b9c0 con 0x7f53681078f0 2024-09-13T15:47:33.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.110+0000 7f5365600640 1 -- 172.21.15.17:0/3087659235 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f535803a690 con 0x7f53681078f0 2024-09-13T15:47:33.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.110+0000 7f536dc00640 1 -- 172.21.15.17:0/3087659235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f536819be60 con 0x7f53681078f0 2024-09-13T15:47:33.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.111+0000 7f5365600640 1 -- 172.21.15.17:0/3087659235 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f5358039040 con 0x7f53681078f0 2024-09-13T15:47:33.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.111+0000 7f536dc00640 1 -- 172.21.15.17:0/3087659235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f536810b9f0 con 0x7f53681078f0 2024-09-13T15:47:33.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.112+0000 7f5365600640 1 --2- 172.21.15.17:0/3087659235 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f534c038620 0x7f534c03aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:33.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.112+0000 7f5365600640 1 -- 172.21.15.17:0/3087659235 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f535806b840 con 0x7f53681078f0 2024-09-13T15:47:33.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.112+0000 7f535fe00640 1 --2- 172.21.15.17:0/3087659235 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f534c038620 0x7f534c03aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:33.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.113+0000 7f535fe00640 1 --2- 172.21.15.17:0/3087659235 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f534c038620 0x7f534c03aae0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f53500098c0 tx=0x7f5350006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:33.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.117+0000 7f5365600640 1 -- 172.21.15.17:0/3087659235 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f53580313a0 con 0x7f53681078f0 2024-09-13T15:47:33.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.297+0000 7f536dc00640 1 -- 172.21.15.17:0/3087659235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f536819e7a0 con 0x7f53681078f0 2024-09-13T15:47:33.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.300+0000 7f5365600640 1 -- 172.21.15.17:0/3087659235 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f535803f0d0 con 0x7f53681078f0 2024-09-13T15:47:33.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.303+0000 7f536dc00640 1 -- 172.21.15.17:0/3087659235 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f534c038620 msgr2=0x7f534c03aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:33.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.303+0000 7f536dc00640 1 --2- 172.21.15.17:0/3087659235 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f534c038620 0x7f534c03aae0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f53500098c0 tx=0x7f5350006db0 comp rx=0 tx=0).stop 2024-09-13T15:47:33.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.303+0000 7f536dc00640 1 -- 172.21.15.17:0/3087659235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53681078f0 msgr2=0x7f536819b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:33.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.303+0000 7f536dc00640 1 --2- 172.21.15.17:0/3087659235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53681078f0 0x7f536819b280 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f53580097f0 tx=0x7f5358030d70 comp rx=0 tx=0).stop 2024-09-13T15:47:33.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.303+0000 7f536dc00640 1 -- 172.21.15.17:0/3087659235 shutdown_connections 2024-09-13T15:47:33.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.303+0000 7f536dc00640 1 --2- 172.21.15.17:0/3087659235 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f534c038620 0x7f534c03aae0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:33.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.303+0000 7f536dc00640 1 --2- 172.21.15.17:0/3087659235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53681078f0 0x7f536819b280 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:33.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.303+0000 7f536dc00640 1 -- 172.21.15.17:0/3087659235 >> 172.21.15.17:0/3087659235 conn(0x7f536807aba0 msgr2=0x7f5368105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:33.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.303+0000 7f536dc00640 1 -- 172.21.15.17:0/3087659235 shutdown_connections 2024-09-13T15:47:33.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:32.303+0000 7f536dc00640 1 -- 172.21.15.17:0/3087659235 wait complete. 2024-09-13T15:47:33.472 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:33 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3087659235' entity='client.admin' 2024-09-13T15:47:33.472 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:33 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' 2024-09-13T15:47:34.514 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.698+0000 7f799ee00640 1 Processor -- start 2024-09-13T15:47:34.514 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.698+0000 7f799ee00640 1 -- start start 2024-09-13T15:47:34.514 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.699+0000 7f799ee00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7998105590 0x7f7998105990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:34.514 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.699+0000 7f799ee00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7998105f60 con 0x7f7998105590 2024-09-13T15:47:34.514 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.699+0000 7f7997e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7998105590 0x7f7998105990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:34.514 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.699+0000 7f7997e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7998105590 0x7f7998105990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35678/0 (socket says 172.21.15.17:35678) 2024-09-13T15:47:34.515 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.699+0000 7f7997e00640 1 -- 172.21.15.17:0/1266104829 learned_addr learned my addr 172.21.15.17:0/1266104829 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:34.515 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.699+0000 7f7997e00640 1 -- 172.21.15.17:0/1266104829 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7998106790 con 0x7f7998105590 2024-09-13T15:47:34.515 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.700+0000 7f7997e00640 1 --2- 172.21.15.17:0/1266104829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7998105590 0x7f7998105990 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7988009820 tx=0x7f798802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d6470d0c4c775f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:34.515 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.701+0000 7f7997400640 1 -- 172.21.15.17:0/1266104829 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f798802ae70 con 0x7f7998105590 2024-09-13T15:47:34.515 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.701+0000 7f7997400640 1 -- 172.21.15.17:0/1266104829 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7988032900 con 0x7f7998105590 2024-09-13T15:47:34.515 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.701+0000 7f7997400640 1 -- 172.21.15.17:0/1266104829 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7988030880 con 0x7f7998105590 2024-09-13T15:47:34.515 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.702+0000 7f799ee00640 1 -- 172.21.15.17:0/1266104829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7998105590 msgr2=0x7f7998105990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:34.515 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.702+0000 7f799ee00640 1 --2- 172.21.15.17:0/1266104829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7998105590 0x7f7998105990 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7988009820 tx=0x7f798802a270 comp rx=0 tx=0).stop 2024-09-13T15:47:34.515 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.702+0000 7f799ee00640 1 -- 172.21.15.17:0/1266104829 shutdown_connections 2024-09-13T15:47:34.516 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.702+0000 7f799ee00640 1 --2- 172.21.15.17:0/1266104829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7998105590 0x7f7998105990 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:34.516 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.702+0000 7f799ee00640 1 -- 172.21.15.17:0/1266104829 >> 172.21.15.17:0/1266104829 conn(0x7f7998100d40 msgr2=0x7f7998103160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:34.516 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.702+0000 7f799ee00640 1 -- 172.21.15.17:0/1266104829 shutdown_connections 2024-09-13T15:47:34.516 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.702+0000 7f799ee00640 1 -- 172.21.15.17:0/1266104829 wait complete. 2024-09-13T15:47:34.516 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.703+0000 7f799ee00640 1 Processor -- start 2024-09-13T15:47:34.516 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.703+0000 7f799ee00640 1 -- start start 2024-09-13T15:47:34.516 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.703+0000 7f799ee00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7998105590 0x7f799807baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:34.516 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.703+0000 7f799ee00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799807c030 con 0x7f7998105590 2024-09-13T15:47:34.516 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.704+0000 7f7997e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7998105590 0x7f799807baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:34.516 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.704+0000 7f7997e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7998105590 0x7f799807baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35686/0 (socket says 172.21.15.17:35686) 2024-09-13T15:47:34.516 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.704+0000 7f7997e00640 1 -- 172.21.15.17:0/1769383696 learned_addr learned my addr 172.21.15.17:0/1769383696 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:34.516 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.704+0000 7f7997e00640 1 -- 172.21.15.17:0/1769383696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79880094d0 con 0x7f7998105590 2024-09-13T15:47:34.516 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.704+0000 7f7997e00640 1 --2- 172.21.15.17:0/1769383696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7998105590 0x7f799807baf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7988030380 tx=0x7f7988030de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:34.517 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.705+0000 7f7995600640 1 -- 172.21.15.17:0/1769383696 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7988032db0 con 0x7f7998105590 2024-09-13T15:47:34.517 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.705+0000 7f7995600640 1 -- 172.21.15.17:0/1769383696 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f798803b8f0 con 0x7f7998105590 2024-09-13T15:47:34.517 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.705+0000 7f799ee00640 1 -- 172.21.15.17:0/1769383696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799807a220 con 0x7f7998105590 2024-09-13T15:47:34.517 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.705+0000 7f799ee00640 1 -- 172.21.15.17:0/1769383696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799807a6c0 con 0x7f7998105590 2024-09-13T15:47:34.517 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.705+0000 7f7995600640 1 -- 172.21.15.17:0/1769383696 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f798803a760 con 0x7f7998105590 2024-09-13T15:47:34.517 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.706+0000 7f7995600640 1 -- 172.21.15.17:0/1769383696 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f7988039040 con 0x7f7998105590 2024-09-13T15:47:34.517 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.706+0000 7f799ee00640 1 -- 172.21.15.17:0/1769383696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79981099c0 con 0x7f7998105590 2024-09-13T15:47:34.517 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.706+0000 7f7995600640 1 --2- 172.21.15.17:0/1769383696 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f797c038670 0x7f797c03ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:34.517 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.707+0000 7f7995600640 1 -- 172.21.15.17:0/1769383696 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f798806b750 con 0x7f7998105590 2024-09-13T15:47:34.517 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.707+0000 7f798fe00640 1 --2- 172.21.15.17:0/1769383696 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f797c038670 0x7f797c03ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:34.517 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.708+0000 7f798fe00640 1 --2- 172.21.15.17:0/1769383696 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f797c038670 0x7f797c03ab30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f79800098c0 tx=0x7f7980006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:34.517 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.711+0000 7f7995600640 1 -- 172.21.15.17:0/1769383696 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f798803ae40 con 0x7f7998105590 2024-09-13T15:47:34.518 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.898+0000 7f799ee00640 1 -- 172.21.15.17:0/1769383696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f7998109c30 con 0x7f7998105590 2024-09-13T15:47:34.518 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.903+0000 7f7995600640 1 -- 172.21.15.17:0/1769383696 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f79880370c0 con 0x7f7998105590 2024-09-13T15:47:34.518 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.906+0000 7f799ee00640 1 -- 172.21.15.17:0/1769383696 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f797c038670 msgr2=0x7f797c03ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:34.518 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.906+0000 7f799ee00640 1 --2- 172.21.15.17:0/1769383696 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f797c038670 0x7f797c03ab30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f79800098c0 tx=0x7f7980006db0 comp rx=0 tx=0).stop 2024-09-13T15:47:34.518 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.906+0000 7f799ee00640 1 -- 172.21.15.17:0/1769383696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7998105590 msgr2=0x7f799807baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:34.518 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.906+0000 7f799ee00640 1 --2- 172.21.15.17:0/1769383696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7998105590 0x7f799807baf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7988030380 tx=0x7f7988030de0 comp rx=0 tx=0).stop 2024-09-13T15:47:34.518 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.906+0000 7f799ee00640 1 -- 172.21.15.17:0/1769383696 shutdown_connections 2024-09-13T15:47:34.518 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.906+0000 7f799ee00640 1 --2- 172.21.15.17:0/1769383696 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f797c038670 0x7f797c03ab30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:34.518 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.906+0000 7f799ee00640 1 --2- 172.21.15.17:0/1769383696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7998105590 0x7f799807baf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:34.518 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.906+0000 7f799ee00640 1 -- 172.21.15.17:0/1769383696 >> 172.21.15.17:0/1769383696 conn(0x7f7998100d40 msgr2=0x7f7998101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:34.518 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.906+0000 7f799ee00640 1 -- 172.21.15.17:0/1769383696 shutdown_connections 2024-09-13T15:47:34.518 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:33.906+0000 7f799ee00640 1 -- 172.21.15.17:0/1769383696 wait complete. 2024-09-13T15:47:34.518 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling the dashboard module... 2024-09-13T15:47:35.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:34 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1769383696' entity='client.admin' 2024-09-13T15:47:35.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:34 smithi017 ceph-mon[30494]: from='mgr.14118 172.21.15.17:0/3402017858' entity='mgr.x' 2024-09-13T15:47:36.016 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:36 smithi017 ceph-mon[30494]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:47:36.016 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:36 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3630513961' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-13T15:47:36.333 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:36 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: ignoring --setuser ceph since I am not root 2024-09-13T15:47:36.333 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:36 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: ignoring --setgroup ceph since I am not root 2024-09-13T15:47:36.333 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:36 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:36.258+0000 7f3c20834040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T15:47:36.333 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:36 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:36.331+0000 7f3c20834040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T15:47:36.605 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:36 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:36.522+0000 7f3c20834040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T15:47:36.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.952+0000 7fa5a8800640 1 Processor -- start 2024-09-13T15:47:36.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.953+0000 7fa5a8800640 1 -- start start 2024-09-13T15:47:36.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.953+0000 7fa5a8800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a007f580 0x7fa5a007f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:36.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.953+0000 7fa5a8800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a007ff50 con 0x7fa5a007f580 2024-09-13T15:47:36.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.953+0000 7fa5a5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a007f580 0x7fa5a007f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:36.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.953+0000 7fa5a5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a007f580 0x7fa5a007f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35696/0 (socket says 172.21.15.17:35696) 2024-09-13T15:47:36.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.953+0000 7fa5a5e00640 1 -- 172.21.15.17:0/441237618 learned_addr learned my addr 172.21.15.17:0/441237618 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:36.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.954+0000 7fa5a5e00640 1 -- 172.21.15.17:0/441237618 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a010cdc0 con 0x7fa5a007f580 2024-09-13T15:47:36.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.955+0000 7fa5a5e00640 1 --2- 172.21.15.17:0/441237618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a007f580 0x7fa5a007f980 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa594009820 tx=0x7fa59402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e1f70828bb2c85 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:36.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.955+0000 7fa5a4a00640 1 -- 172.21.15.17:0/441237618 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa59402ae70 con 0x7fa5a007f580 2024-09-13T15:47:36.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.955+0000 7fa5a4a00640 1 -- 172.21.15.17:0/441237618 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa594032900 con 0x7fa5a007f580 2024-09-13T15:47:36.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.955+0000 7fa5a4a00640 1 -- 172.21.15.17:0/441237618 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa594030880 con 0x7fa5a007f580 2024-09-13T15:47:36.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.956+0000 7fa5a8800640 1 -- 172.21.15.17:0/441237618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a007f580 msgr2=0x7fa5a007f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:36.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.956+0000 7fa5a8800640 1 --2- 172.21.15.17:0/441237618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a007f580 0x7fa5a007f980 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa594009820 tx=0x7fa59402a270 comp rx=0 tx=0).stop 2024-09-13T15:47:36.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.956+0000 7fa5a8800640 1 -- 172.21.15.17:0/441237618 shutdown_connections 2024-09-13T15:47:36.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.956+0000 7fa5a8800640 1 --2- 172.21.15.17:0/441237618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a007f580 0x7fa5a007f980 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:36.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.956+0000 7fa5a8800640 1 -- 172.21.15.17:0/441237618 >> 172.21.15.17:0/441237618 conn(0x7fa5a007ad60 msgr2=0x7fa5a007d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:36.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.956+0000 7fa5a8800640 1 -- 172.21.15.17:0/441237618 shutdown_connections 2024-09-13T15:47:36.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.956+0000 7fa5a8800640 1 -- 172.21.15.17:0/441237618 wait complete. 2024-09-13T15:47:36.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.957+0000 7fa5a8800640 1 Processor -- start 2024-09-13T15:47:36.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.957+0000 7fa5a8800640 1 -- start start 2024-09-13T15:47:36.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.957+0000 7fa5a8800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a007f580 0x7fa5a019f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:36.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.957+0000 7fa5a8800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a019fd90 con 0x7fa5a007f580 2024-09-13T15:47:36.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.958+0000 7fa5a5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a007f580 0x7fa5a019f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:36.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.958+0000 7fa5a5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a007f580 0x7fa5a019f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35712/0 (socket says 172.21.15.17:35712) 2024-09-13T15:47:36.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.958+0000 7fa5a5e00640 1 -- 172.21.15.17:0/3630513961 learned_addr learned my addr 172.21.15.17:0/3630513961 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:36.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.958+0000 7fa5a5e00640 1 -- 172.21.15.17:0/3630513961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5940094d0 con 0x7fa5a007f580 2024-09-13T15:47:36.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.959+0000 7fa5a5e00640 1 --2- 172.21.15.17:0/3630513961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a007f580 0x7fa5a019f850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa594030380 tx=0x7fa594030de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:36.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.959+0000 7fa59aa00640 1 -- 172.21.15.17:0/3630513961 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa594032db0 con 0x7fa5a007f580 2024-09-13T15:47:36.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.959+0000 7fa59aa00640 1 -- 172.21.15.17:0/3630513961 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa59403b8f0 con 0x7fa5a007f580 2024-09-13T15:47:36.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.959+0000 7fa5a8800640 1 -- 172.21.15.17:0/3630513961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a019ff90 con 0x7fa5a007f580 2024-09-13T15:47:36.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.959+0000 7fa59aa00640 1 -- 172.21.15.17:0/3630513961 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa59403a760 con 0x7fa5a007f580 2024-09-13T15:47:36.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.959+0000 7fa5a8800640 1 -- 172.21.15.17:0/3630513961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a01a0430 con 0x7fa5a007f580 2024-09-13T15:47:36.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.960+0000 7fa59aa00640 1 -- 172.21.15.17:0/3630513961 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fa594039040 con 0x7fa5a007f580 2024-09-13T15:47:36.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.960+0000 7fa5a8800640 1 -- 172.21.15.17:0/3630513961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a010fff0 con 0x7fa5a007f580 2024-09-13T15:47:36.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.961+0000 7fa59aa00640 1 --2- 172.21.15.17:0/3630513961 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7fa588038670 0x7fa58803ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:36.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.961+0000 7fa59aa00640 1 -- 172.21.15.17:0/3630513961 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa59406b8b0 con 0x7fa5a007f580 2024-09-13T15:47:36.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.961+0000 7fa5a5400640 1 --2- 172.21.15.17:0/3630513961 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7fa588038670 0x7fa58803ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:36.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.962+0000 7fa5a5400640 1 --2- 172.21.15.17:0/3630513961 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7fa588038670 0x7fa58803ab30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa5900098c0 tx=0x7fa590006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:36.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:34.966+0000 7fa59aa00640 1 -- 172.21.15.17:0/3630513961 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa594031580 con 0x7fa5a007f580 2024-09-13T15:47:36.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:35.197+0000 7fa5a8800640 1 -- 172.21.15.17:0/3630513961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fa5a0110230 con 0x7fa5a007f580 2024-09-13T15:47:36.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:36.010+0000 7fa59aa00640 1 -- 172.21.15.17:0/3630513961 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fa59406dc60 con 0x7fa5a007f580 2024-09-13T15:47:36.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:36.011+0000 7fa59aa00640 1 -- 172.21.15.17:0/3630513961 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fa594031970 con 0x7fa5a007f580 2024-09-13T15:47:36.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:36.014+0000 7fa5a8800640 1 -- 172.21.15.17:0/3630513961 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7fa588038670 msgr2=0x7fa58803ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:36.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:36.014+0000 7fa5a8800640 1 --2- 172.21.15.17:0/3630513961 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7fa588038670 0x7fa58803ab30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa5900098c0 tx=0x7fa590006db0 comp rx=0 tx=0).stop 2024-09-13T15:47:36.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:36.014+0000 7fa5a8800640 1 -- 172.21.15.17:0/3630513961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a007f580 msgr2=0x7fa5a019f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:36.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:36.014+0000 7fa5a8800640 1 --2- 172.21.15.17:0/3630513961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a007f580 0x7fa5a019f850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa594030380 tx=0x7fa594030de0 comp rx=0 tx=0).stop 2024-09-13T15:47:36.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:36.014+0000 7fa5a8800640 1 -- 172.21.15.17:0/3630513961 shutdown_connections 2024-09-13T15:47:36.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:36.014+0000 7fa5a8800640 1 --2- 172.21.15.17:0/3630513961 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7fa588038670 0x7fa58803ab30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:36.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:36.014+0000 7fa5a8800640 1 --2- 172.21.15.17:0/3630513961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a007f580 0x7fa5a019f850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:36.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:36.014+0000 7fa5a8800640 1 -- 172.21.15.17:0/3630513961 >> 172.21.15.17:0/3630513961 conn(0x7fa5a007ad60 msgr2=0x7fa5a007b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:36.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:36.014+0000 7fa5a8800640 1 -- 172.21.15.17:0/3630513961 shutdown_connections 2024-09-13T15:47:36.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:36.014+0000 7fa5a8800640 1 -- 172.21.15.17:0/3630513961 wait complete. 2024-09-13T15:47:36.860 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:36 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:36.603+0000 7f3c20834040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T15:47:36.861 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:36 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:36.794+0000 7f3c20834040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T15:47:37.145 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:36 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:36.965+0000 7f3c20834040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T15:47:37.145 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:37 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3630513961' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-13T15:47:37.146 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:37 smithi017 ceph-mon[30494]: mgrmap e9: x(active, since 21s) 2024-09-13T15:47:37.425 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:37 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:37.348+0000 7f3c20834040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T15:47:37.425 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:37 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:37.423+0000 7f3c20834040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T15:47:37.761 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:37 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:37.641+0000 7f3c20834040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T15:47:38.124 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:38 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/746503834' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T15:47:38.132 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-13T15:47:38.141 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-13T15:47:38.141 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T15:47:38.141 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-13T15:47:38.141 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T15:47:38.141 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-13T15:47:38.141 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.253+0000 7f3111800640 1 Processor -- start 2024-09-13T15:47:38.141 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.253+0000 7f3111800640 1 -- start start 2024-09-13T15:47:38.141 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.253+0000 7f3111800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c1077f0 0x7f310c107bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:38.141 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.253+0000 7f3111800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310c1081c0 con 0x7f310c1077f0 2024-09-13T15:47:38.141 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.254+0000 7f310aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c1077f0 0x7f310c107bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:38.142 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.254+0000 7f310aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c1077f0 0x7f310c107bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35746/0 (socket says 172.21.15.17:35746) 2024-09-13T15:47:38.142 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.254+0000 7f310aa00640 1 -- 172.21.15.17:0/918556280 learned_addr learned my addr 172.21.15.17:0/918556280 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:38.142 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.254+0000 7f310aa00640 1 -- 172.21.15.17:0/918556280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310c108990 con 0x7f310c1077f0 2024-09-13T15:47:38.142 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.255+0000 7f310aa00640 1 --2- 172.21.15.17:0/918556280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c1077f0 0x7f310c107bf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f30fc009820 tx=0x7f30fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e92b6ed2a320d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:38.142 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.255+0000 7f3109600640 1 -- 172.21.15.17:0/918556280 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f30fc02ae70 con 0x7f310c1077f0 2024-09-13T15:47:38.142 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.255+0000 7f3109600640 1 -- 172.21.15.17:0/918556280 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30fc032900 con 0x7f310c1077f0 2024-09-13T15:47:38.142 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.255+0000 7f3109600640 1 -- 172.21.15.17:0/918556280 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f30fc030880 con 0x7f310c1077f0 2024-09-13T15:47:38.142 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.256+0000 7f3111800640 1 -- 172.21.15.17:0/918556280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c1077f0 msgr2=0x7f310c107bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:38.142 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.256+0000 7f3111800640 1 --2- 172.21.15.17:0/918556280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c1077f0 0x7f310c107bf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f30fc009820 tx=0x7f30fc02a270 comp rx=0 tx=0).stop 2024-09-13T15:47:38.142 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.256+0000 7f3111800640 1 -- 172.21.15.17:0/918556280 shutdown_connections 2024-09-13T15:47:38.142 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.256+0000 7f3111800640 1 --2- 172.21.15.17:0/918556280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c1077f0 0x7f310c107bf0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:38.142 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.256+0000 7f3111800640 1 -- 172.21.15.17:0/918556280 >> 172.21.15.17:0/918556280 conn(0x7f310c07ad80 msgr2=0x7f310c07b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:38.142 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.256+0000 7f3111800640 1 -- 172.21.15.17:0/918556280 shutdown_connections 2024-09-13T15:47:38.143 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.256+0000 7f3111800640 1 -- 172.21.15.17:0/918556280 wait complete. 2024-09-13T15:47:38.143 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.258+0000 7f3111800640 1 Processor -- start 2024-09-13T15:47:38.143 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.258+0000 7f3111800640 1 -- start start 2024-09-13T15:47:38.143 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.258+0000 7f3111800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c1077f0 0x7f310c19b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:38.143 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.258+0000 7f3111800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310c19b980 con 0x7f310c1077f0 2024-09-13T15:47:38.143 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.259+0000 7f310aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c1077f0 0x7f310c19b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:38.143 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.259+0000 7f310aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c1077f0 0x7f310c19b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35758/0 (socket says 172.21.15.17:35758) 2024-09-13T15:47:38.143 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.259+0000 7f310aa00640 1 -- 172.21.15.17:0/746503834 learned_addr learned my addr 172.21.15.17:0/746503834 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:38.143 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.259+0000 7f310aa00640 1 -- 172.21.15.17:0/746503834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30fc0094d0 con 0x7f310c1077f0 2024-09-13T15:47:38.143 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.259+0000 7f310aa00640 1 --2- 172.21.15.17:0/746503834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c1077f0 0x7f310c19b440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f30fc0097f0 tx=0x7f30fc030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:38.143 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.260+0000 7f3103400640 1 -- 172.21.15.17:0/746503834 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f30fc032c80 con 0x7f310c1077f0 2024-09-13T15:47:38.143 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.260+0000 7f3111800640 1 -- 172.21.15.17:0/746503834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310c19bb80 con 0x7f310c1077f0 2024-09-13T15:47:38.143 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.260+0000 7f3103400640 1 -- 172.21.15.17:0/746503834 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30fc032de0 con 0x7f310c1077f0 2024-09-13T15:47:38.143 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.260+0000 7f3103400640 1 -- 172.21.15.17:0/746503834 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f30fc03a760 con 0x7f310c1077f0 2024-09-13T15:47:38.144 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.260+0000 7f3111800640 1 -- 172.21.15.17:0/746503834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310c19c020 con 0x7f310c1077f0 2024-09-13T15:47:38.144 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.261+0000 7f3103400640 1 -- 172.21.15.17:0/746503834 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f30fc039040 con 0x7f310c1077f0 2024-09-13T15:47:38.144 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.261+0000 7f3111800640 1 -- 172.21.15.17:0/746503834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f310c10bbc0 con 0x7f310c1077f0 2024-09-13T15:47:38.144 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.261+0000 7f3103400640 1 --2- 172.21.15.17:0/746503834 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f30f00386c0 0x7f30f003ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:38.144 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.261+0000 7f3103400640 1 -- 172.21.15.17:0/746503834 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f30fc06b850 con 0x7f310c1077f0 2024-09-13T15:47:38.144 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.261+0000 7f310a000640 1 -- 172.21.15.17:0/746503834 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f30f00386c0 msgr2=0x7f30f003ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/386837955 2024-09-13T15:47:38.144 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.262+0000 7f310a000640 1 --2- 172.21.15.17:0/746503834 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f30f00386c0 0x7f30f003ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T15:47:38.144 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.267+0000 7f3103400640 1 -- 172.21.15.17:0/746503834 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f30fc0313a0 con 0x7f310c1077f0 2024-09-13T15:47:38.144 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.463+0000 7f310a000640 1 -- 172.21.15.17:0/746503834 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f30f00386c0 msgr2=0x7f30f003ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/386837955 2024-09-13T15:47:38.144 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.463+0000 7f310a000640 1 --2- 172.21.15.17:0/746503834 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f30f00386c0 0x7f30f003ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T15:47:38.144 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.500+0000 7f3111800640 1 -- 172.21.15.17:0/746503834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f310c19e900 con 0x7f310c1077f0 2024-09-13T15:47:38.144 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.501+0000 7f3103400640 1 -- 172.21.15.17:0/746503834 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f30fc03f070 con 0x7f310c1077f0 2024-09-13T15:47:38.144 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.503+0000 7f3111800640 1 -- 172.21.15.17:0/746503834 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f30f00386c0 msgr2=0x7f30f003ab80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:47:38.145 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.503+0000 7f3111800640 1 --2- 172.21.15.17:0/746503834 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f30f00386c0 0x7f30f003ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:38.145 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.503+0000 7f3111800640 1 -- 172.21.15.17:0/746503834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c1077f0 msgr2=0x7f310c19b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:38.145 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.503+0000 7f3111800640 1 --2- 172.21.15.17:0/746503834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c1077f0 0x7f310c19b440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f30fc0097f0 tx=0x7f30fc030d70 comp rx=0 tx=0).stop 2024-09-13T15:47:38.145 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.503+0000 7f3111800640 1 -- 172.21.15.17:0/746503834 shutdown_connections 2024-09-13T15:47:38.145 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.503+0000 7f3111800640 1 --2- 172.21.15.17:0/746503834 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f30f00386c0 0x7f30f003ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:38.145 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.503+0000 7f3111800640 1 --2- 172.21.15.17:0/746503834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c1077f0 0x7f310c19b440 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:38.145 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.504+0000 7f3111800640 1 -- 172.21.15.17:0/746503834 >> 172.21.15.17:0/746503834 conn(0x7f310c07ad80 msgr2=0x7f310c105490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:38.145 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.504+0000 7f3111800640 1 -- 172.21.15.17:0/746503834 shutdown_connections 2024-09-13T15:47:38.145 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:37.504+0000 7f3111800640 1 -- 172.21.15.17:0/746503834 wait complete. 2024-09-13T15:47:38.145 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for the mgr to restart... 2024-09-13T15:47:38.145 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr epoch 9... 2024-09-13T15:47:39.261 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:38 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:38.789+0000 7f3c20834040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T15:47:39.261 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:38 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:38.870+0000 7f3c20834040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T15:47:40.122 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:39 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:39.812+0000 7f3c20834040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T15:47:40.122 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:39 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:39.952+0000 7f3c20834040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T15:47:40.122 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:40 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:40.120+0000 7f3c20834040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T15:47:40.454 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:40 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:40.195+0000 7f3c20834040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T15:47:40.454 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:40 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:40.368+0000 7f3c20834040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T15:47:40.454 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:40 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:40.452+0000 7f3c20834040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T15:47:40.712 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:40 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:40.525+0000 7f3c20834040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T15:47:40.712 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:40 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:40.710+0000 7f3c20834040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T15:47:40.972 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:40 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:40.789+0000 7f3c20834040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T15:47:40.972 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:40 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:40.870+0000 7f3c20834040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T15:47:40.972 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:40 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:40.970+0000 7f3c20834040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T15:47:41.261 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:41 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:41.042+0000 7f3c20834040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T15:47:41.261 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:41 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:41.114+0000 7f3c20834040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T15:47:42.322 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:42 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:42.045+0000 7f3c20834040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T15:47:42.323 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:42 smithi017 ceph-mon[30494]: Active manager daemon x restarted 2024-09-13T15:47:42.323 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:42 smithi017 ceph-mon[30494]: Activating manager daemon x 2024-09-13T15:47:42.323 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:42 smithi017 ceph-mon[30494]: osdmap e3: 0 total, 0 up, 0 in 2024-09-13T15:47:42.323 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:42 smithi017 ceph-mon[30494]: mgrmap e10: x(active, starting, since 0.00456996s) 2024-09-13T15:47:42.323 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T15:47:42.323 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-13T15:47:42.323 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T15:47:42.323 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T15:47:42.323 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T15:47:42.323 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:42 smithi017 ceph-mon[30494]: Manager daemon x is now available 2024-09-13T15:47:42.324 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:47:42.324 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T15:47:43.475 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T15:47:43.475 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:43 smithi017 ceph-mon[30494]: mgrmap e11: x(active, since 1.00865s) 2024-09-13T15:47:43.788 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-13T15:47:43.788 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-13T15:47:43.788 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T15:47:43.789 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-13T15:47:43.789 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.651+0000 7f6076000640 1 Processor -- start 2024-09-13T15:47:43.789 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.651+0000 7f6076000640 1 -- start start 2024-09-13T15:47:43.789 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.651+0000 7f6076000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070105590 0x7f6070105990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:43.789 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.651+0000 7f6076000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6070105f60 con 0x7f6070105590 2024-09-13T15:47:43.789 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.652+0000 7f606f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070105590 0x7f6070105990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:43.789 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.652+0000 7f606f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070105590 0x7f6070105990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35760/0 (socket says 172.21.15.17:35760) 2024-09-13T15:47:43.789 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.652+0000 7f606f400640 1 -- 172.21.15.17:0/3668512225 learned_addr learned my addr 172.21.15.17:0/3668512225 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:43.789 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.652+0000 7f606f400640 1 -- 172.21.15.17:0/3668512225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6070106790 con 0x7f6070105590 2024-09-13T15:47:43.789 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.653+0000 7f606f400640 1 --2- 172.21.15.17:0/3668512225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070105590 0x7f6070105990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6060009820 tx=0x7f606002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b9bf47c0947f4b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:43.789 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.653+0000 7f606e000640 1 -- 172.21.15.17:0/3668512225 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f606002ae70 con 0x7f6070105590 2024-09-13T15:47:43.790 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.654+0000 7f606e000640 1 -- 172.21.15.17:0/3668512225 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6060032900 con 0x7f6070105590 2024-09-13T15:47:43.790 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.654+0000 7f606e000640 1 -- 172.21.15.17:0/3668512225 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6060030880 con 0x7f6070105590 2024-09-13T15:47:43.790 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.654+0000 7f6076000640 1 -- 172.21.15.17:0/3668512225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070105590 msgr2=0x7f6070105990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:43.790 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.654+0000 7f6076000640 1 --2- 172.21.15.17:0/3668512225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070105590 0x7f6070105990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6060009820 tx=0x7f606002a270 comp rx=0 tx=0).stop 2024-09-13T15:47:43.790 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.654+0000 7f6076000640 1 -- 172.21.15.17:0/3668512225 shutdown_connections 2024-09-13T15:47:43.790 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.654+0000 7f6076000640 1 --2- 172.21.15.17:0/3668512225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070105590 0x7f6070105990 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:43.790 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.654+0000 7f6076000640 1 -- 172.21.15.17:0/3668512225 >> 172.21.15.17:0/3668512225 conn(0x7f6070100d80 msgr2=0x7f60701031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:43.790 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.654+0000 7f6076000640 1 -- 172.21.15.17:0/3668512225 shutdown_connections 2024-09-13T15:47:43.790 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.654+0000 7f6076000640 1 -- 172.21.15.17:0/3668512225 wait complete. 2024-09-13T15:47:43.790 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.655+0000 7f6076000640 1 Processor -- start 2024-09-13T15:47:43.790 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.656+0000 7f6076000640 1 -- start start 2024-09-13T15:47:43.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.656+0000 7f6076000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070105590 0x7f607019b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:43.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.656+0000 7f6076000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607019ba00 con 0x7f6070105590 2024-09-13T15:47:43.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.656+0000 7f606f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070105590 0x7f607019b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:43.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.656+0000 7f606f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070105590 0x7f607019b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35768/0 (socket says 172.21.15.17:35768) 2024-09-13T15:47:43.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.656+0000 7f606f400640 1 -- 172.21.15.17:0/984204593 learned_addr learned my addr 172.21.15.17:0/984204593 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:43.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.657+0000 7f606f400640 1 -- 172.21.15.17:0/984204593 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60600094d0 con 0x7f6070105590 2024-09-13T15:47:43.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.657+0000 7f606f400640 1 --2- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070105590 0x7f607019b4c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f60600097f0 tx=0x7f6060030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:43.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.657+0000 7f6067e00640 1 -- 172.21.15.17:0/984204593 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6060032c80 con 0x7f6070105590 2024-09-13T15:47:43.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.657+0000 7f6076000640 1 -- 172.21.15.17:0/984204593 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607019bc00 con 0x7f6070105590 2024-09-13T15:47:43.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.657+0000 7f6067e00640 1 -- 172.21.15.17:0/984204593 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6060032de0 con 0x7f6070105590 2024-09-13T15:47:43.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.657+0000 7f6067e00640 1 -- 172.21.15.17:0/984204593 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f606003a690 con 0x7f6070105590 2024-09-13T15:47:43.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.657+0000 7f6076000640 1 -- 172.21.15.17:0/984204593 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607019c0a0 con 0x7f6070105590 2024-09-13T15:47:43.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.659+0000 7f6067e00640 1 -- 172.21.15.17:0/984204593 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f6060039040 con 0x7f6070105590 2024-09-13T15:47:43.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.659+0000 7f6067e00640 1 --2- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f6054038670 0x7f605403ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:43.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.659+0000 7f6067e00640 1 -- 172.21.15.17:0/984204593 --> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f605403b240 con 0x7f6054038670 2024-09-13T15:47:43.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.659+0000 7f6067e00640 1 -- 172.21.15.17:0/984204593 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f606006b7b0 con 0x7f6070105590 2024-09-13T15:47:43.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.659+0000 7f606ea00640 1 -- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f6054038670 msgr2=0x7f605403ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/386837955 2024-09-13T15:47:43.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.659+0000 7f606ea00640 1 --2- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f6054038670 0x7f605403ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T15:47:43.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.860+0000 7f606ea00640 1 -- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f6054038670 msgr2=0x7f605403ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/386837955 2024-09-13T15:47:43.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:38.860+0000 7f606ea00640 1 --2- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f6054038670 0x7f605403ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T15:47:43.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:39.261+0000 7f606ea00640 1 -- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f6054038670 msgr2=0x7f605403ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/386837955 2024-09-13T15:47:43.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:39.261+0000 7f606ea00640 1 --2- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f6054038670 0x7f605403ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T15:47:43.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:40.062+0000 7f606ea00640 1 -- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f6054038670 msgr2=0x7f605403ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/386837955 2024-09-13T15:47:43.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:40.062+0000 7f606ea00640 1 --2- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f6054038670 0x7f605403ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T15:47:43.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:41.663+0000 7f606ea00640 1 -- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f6054038670 msgr2=0x7f605403ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/386837955 2024-09-13T15:47:43.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:41.663+0000 7f606ea00640 1 --2- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f6054038670 0x7f605403ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-13T15:47:43.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:42.050+0000 7f6067e00640 1 -- 172.21.15.17:0/984204593 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mgrmap(e 10) v1 ==== 45321+0+0 (secure 0 0 0) 0x7f606003b430 con 0x7f6070105590 2024-09-13T15:47:43.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:42.050+0000 7f6067e00640 1 -- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f6054038670 msgr2=0x7f605403ab30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:47:43.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:42.050+0000 7f6067e00640 1 --2- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f6054038670 0x7f605403ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:43.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:43.052+0000 7f6067e00640 1 -- 172.21.15.17:0/984204593 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 11) v1 ==== 45448+0+0 (secure 0 0 0) 0x7f606006a1f0 con 0x7f6070105590 2024-09-13T15:47:43.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:43.052+0000 7f6067e00640 1 --2- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f605403bff0 0x7f605403e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:43.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:43.053+0000 7f6067e00640 1 -- 172.21.15.17:0/984204593 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f605403b240 con 0x7f605403bff0 2024-09-13T15:47:43.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:43.053+0000 7f606ea00640 1 --2- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f605403bff0 0x7f605403e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:43.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:43.055+0000 7f606ea00640 1 --2- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f605403bff0 0x7f605403e3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f605c003980 tx=0x7f605c009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:43.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:43.056+0000 7f6067e00640 1 -- 172.21.15.17:0/984204593 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f605403b240 con 0x7f605403bff0 2024-09-13T15:47:43.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:43.062+0000 7f6076000640 1 -- 172.21.15.17:0/984204593 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f60701099c0 con 0x7f605403bff0 2024-09-13T15:47:43.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:43.062+0000 7f6067e00640 1 -- 172.21.15.17:0/984204593 <== mgr.14150 v2:172.21.15.17:6800/1039314076 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f60701099c0 con 0x7f605403bff0 2024-09-13T15:47:43.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:43.063+0000 7f6076000640 1 -- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f605403bff0 msgr2=0x7f605403e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:43.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:43.063+0000 7f6076000640 1 --2- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f605403bff0 0x7f605403e3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f605c003980 tx=0x7f605c009290 comp rx=0 tx=0).stop 2024-09-13T15:47:43.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:43.063+0000 7f6076000640 1 -- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070105590 msgr2=0x7f607019b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:43.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:43.063+0000 7f6076000640 1 --2- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070105590 0x7f607019b4c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f60600097f0 tx=0x7f6060030d70 comp rx=0 tx=0).stop 2024-09-13T15:47:43.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:43.063+0000 7f6076000640 1 -- 172.21.15.17:0/984204593 shutdown_connections 2024-09-13T15:47:43.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:43.063+0000 7f6076000640 1 --2- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f605403bff0 0x7f605403e3e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:43.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:43.063+0000 7f6076000640 1 --2- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:6800/386837955,v1:172.21.15.17:6801/386837955] conn(0x7f6054038670 0x7f605403ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:43.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:43.063+0000 7f6076000640 1 --2- 172.21.15.17:0/984204593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070105590 0x7f607019b4c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:43.795 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:43.063+0000 7f6076000640 1 -- 172.21.15.17:0/984204593 >> 172.21.15.17:0/984204593 conn(0x7f6070100d80 msgr2=0x7f6070101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:43.795 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:43.063+0000 7f6076000640 1 -- 172.21.15.17:0/984204593 shutdown_connections 2024-09-13T15:47:43.795 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:43.063+0000 7f6076000640 1 -- 172.21.15.17:0/984204593 wait complete. 2024-09-13T15:47:43.795 INFO:teuthology.orchestra.run.smithi017.stdout:mgr epoch 9 is available 2024-09-13T15:47:43.795 INFO:teuthology.orchestra.run.smithi017.stdout:Generating a dashboard self-signed certificate... 2024-09-13T15:47:44.041 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:43.881+0000 7f3b7ea00640 -1 log_channel(cephadm) log [ERR] : [13/Sep/2024:15:47:43] ENGINE Error in HTTPServer.serve 2024-09-13T15:47:44.041 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: Traceback (most recent call last): 2024-09-13T15:47:44.041 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T15:47:44.041 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: self._connections.run(self.expiration_interval) 2024-09-13T15:47:44.041 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T15:47:44.041 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: self._run(expiration_interval) 2024-09-13T15:47:44.042 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T15:47:44.042 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T15:47:44.042 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T15:47:44.042 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T15:47:44.042 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T15:47:44.042 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: s = self.context.wrap_socket( 2024-09-13T15:47:44.042 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T15:47:44.042 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: return self.sslsocket_class._create( 2024-09-13T15:47:44.042 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T15:47:44.042 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: self.do_handshake() 2024-09-13T15:47:44.042 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T15:47:44.042 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: self._sslobj.do_handshake() 2024-09-13T15:47:44.042 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T15:47:44.042 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:47:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:47:44.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:44 smithi017 ceph-mon[30494]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T15:47:44.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:44 smithi017 ceph-mon[30494]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T15:47:45.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:45 smithi017 ceph-mon[30494]: [13/Sep/2024:15:47:43] ENGINE Bus STARTING 2024-09-13T15:47:45.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:45 smithi017 ceph-mon[30494]: [13/Sep/2024:15:47:43] ENGINE Serving on https://172.21.15.17:7150 2024-09-13T15:47:45.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:45 smithi017 ceph-mon[30494]: [13/Sep/2024:15:47:43] ENGINE Error in HTTPServer.serve 2024-09-13T15:47:45.432 INFO:journalctl@ceph.mon.a.smithi017.stdout: Traceback (most recent call last): 2024-09-13T15:47:45.432 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T15:47:45.432 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._connections.run(self.expiration_interval) 2024-09-13T15:47:45.432 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T15:47:45.433 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._run(expiration_interval) 2024-09-13T15:47:45.433 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T15:47:45.433 INFO:journalctl@ceph.mon.a.smithi017.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T15:47:45.433 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T15:47:45.433 INFO:journalctl@ceph.mon.a.smithi017.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T15:47:45.433 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T15:47:45.433 INFO:journalctl@ceph.mon.a.smithi017.stdout: s = self.context.wrap_socket( 2024-09-13T15:47:45.433 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T15:47:45.433 INFO:journalctl@ceph.mon.a.smithi017.stdout: return self.sslsocket_class._create( 2024-09-13T15:47:45.433 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T15:47:45.433 INFO:journalctl@ceph.mon.a.smithi017.stdout: self.do_handshake() 2024-09-13T15:47:45.433 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T15:47:45.433 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._sslobj.do_handshake() 2024-09-13T15:47:45.433 INFO:journalctl@ceph.mon.a.smithi017.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T15:47:45.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:45 smithi017 ceph-mon[30494]: [13/Sep/2024:15:47:43] ENGINE Serving on http://172.21.15.17:8765 2024-09-13T15:47:45.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:45 smithi017 ceph-mon[30494]: [13/Sep/2024:15:47:43] ENGINE Bus STARTED 2024-09-13T15:47:45.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:45 smithi017 ceph-mon[30494]: mgrmap e12: x(active, since 2s) 2024-09-13T15:47:45.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:45 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:47:45.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:45 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:47:45.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:45 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:47:45.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-13T15:47:45.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.638+0000 7fd84fa00640 1 Processor -- start 2024-09-13T15:47:45.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.638+0000 7fd84fa00640 1 -- start start 2024-09-13T15:47:45.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.639+0000 7fd84fa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8481077f0 0x7fd848107bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:45.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.639+0000 7fd84fa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8481081c0 con 0x7fd8481077f0 2024-09-13T15:47:45.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.639+0000 7fd84d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8481077f0 0x7fd848107bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:45.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.639+0000 7fd84d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8481077f0 0x7fd848107bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53376/0 (socket says 172.21.15.17:53376) 2024-09-13T15:47:45.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.639+0000 7fd84d000640 1 -- 172.21.15.17:0/3648850183 learned_addr learned my addr 172.21.15.17:0/3648850183 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:45.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.640+0000 7fd84d000640 1 -- 172.21.15.17:0/3648850183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd848108990 con 0x7fd8481077f0 2024-09-13T15:47:45.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.641+0000 7fd84d000640 1 --2- 172.21.15.17:0/3648850183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8481077f0 0x7fd848107bf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd83c009820 tx=0x7fd83c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a119e610d23c76e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:45.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.641+0000 7fd847400640 1 -- 172.21.15.17:0/3648850183 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd83c02ae70 con 0x7fd8481077f0 2024-09-13T15:47:45.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.641+0000 7fd847400640 1 -- 172.21.15.17:0/3648850183 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd83c032900 con 0x7fd8481077f0 2024-09-13T15:47:45.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.641+0000 7fd847400640 1 -- 172.21.15.17:0/3648850183 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd83c030880 con 0x7fd8481077f0 2024-09-13T15:47:45.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.642+0000 7fd84fa00640 1 -- 172.21.15.17:0/3648850183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8481077f0 msgr2=0x7fd848107bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:45.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.642+0000 7fd84fa00640 1 --2- 172.21.15.17:0/3648850183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8481077f0 0x7fd848107bf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd83c009820 tx=0x7fd83c02a270 comp rx=0 tx=0).stop 2024-09-13T15:47:45.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.642+0000 7fd84fa00640 1 -- 172.21.15.17:0/3648850183 shutdown_connections 2024-09-13T15:47:45.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.642+0000 7fd84fa00640 1 --2- 172.21.15.17:0/3648850183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8481077f0 0x7fd848107bf0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:45.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.642+0000 7fd84fa00640 1 -- 172.21.15.17:0/3648850183 >> 172.21.15.17:0/3648850183 conn(0x7fd84807ad80 msgr2=0x7fd84807b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:45.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.642+0000 7fd84fa00640 1 -- 172.21.15.17:0/3648850183 shutdown_connections 2024-09-13T15:47:45.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.642+0000 7fd84fa00640 1 -- 172.21.15.17:0/3648850183 wait complete. 2024-09-13T15:47:45.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.643+0000 7fd84fa00640 1 Processor -- start 2024-09-13T15:47:45.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.643+0000 7fd84fa00640 1 -- start start 2024-09-13T15:47:45.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.643+0000 7fd84fa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8481077f0 0x7fd84819b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:45.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.643+0000 7fd84fa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84819b980 con 0x7fd8481077f0 2024-09-13T15:47:45.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.644+0000 7fd84d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8481077f0 0x7fd84819b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:45.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.644+0000 7fd84d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8481077f0 0x7fd84819b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53392/0 (socket says 172.21.15.17:53392) 2024-09-13T15:47:45.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.644+0000 7fd84d000640 1 -- 172.21.15.17:0/3459741608 learned_addr learned my addr 172.21.15.17:0/3459741608 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:45.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.644+0000 7fd84d000640 1 -- 172.21.15.17:0/3459741608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c0094d0 con 0x7fd8481077f0 2024-09-13T15:47:45.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.644+0000 7fd84d000640 1 --2- 172.21.15.17:0/3459741608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8481077f0 0x7fd84819b440 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd83c030410 tx=0x7fd83c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:45.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.645+0000 7fd845600640 1 -- 172.21.15.17:0/3459741608 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd83c032c80 con 0x7fd8481077f0 2024-09-13T15:47:45.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.645+0000 7fd845600640 1 -- 172.21.15.17:0/3459741608 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd83c032de0 con 0x7fd8481077f0 2024-09-13T15:47:45.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.645+0000 7fd84fa00640 1 -- 172.21.15.17:0/3459741608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84819bb80 con 0x7fd8481077f0 2024-09-13T15:47:45.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.645+0000 7fd845600640 1 -- 172.21.15.17:0/3459741608 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd83c03a780 con 0x7fd8481077f0 2024-09-13T15:47:45.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.645+0000 7fd84fa00640 1 -- 172.21.15.17:0/3459741608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84819c020 con 0x7fd8481077f0 2024-09-13T15:47:45.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.646+0000 7fd845600640 1 -- 172.21.15.17:0/3459741608 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fd83c039040 con 0x7fd8481077f0 2024-09-13T15:47:45.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.646+0000 7fd84fa00640 1 -- 172.21.15.17:0/3459741608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd84810bbc0 con 0x7fd8481077f0 2024-09-13T15:47:45.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.646+0000 7fd845600640 1 --2- 172.21.15.17:0/3459741608 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd830038670 0x7fd83003ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:45.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.646+0000 7fd845600640 1 -- 172.21.15.17:0/3459741608 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd83c06bb20 con 0x7fd8481077f0 2024-09-13T15:47:45.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.647+0000 7fd847e00640 1 --2- 172.21.15.17:0/3459741608 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd830038670 0x7fd83003ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:45.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.647+0000 7fd847e00640 1 --2- 172.21.15.17:0/3459741608 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd830038670 0x7fd83003ab30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd8340098c0 tx=0x7fd834006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:45.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.656+0000 7fd845600640 1 -- 172.21.15.17:0/3459741608 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd83c04b8f0 con 0x7fd8481077f0 2024-09-13T15:47:45.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.853+0000 7fd84fa00640 1 -- 172.21.15.17:0/3459741608 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fd848105ba0 con 0x7fd830038670 2024-09-13T15:47:45.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.967+0000 7fd845600640 1 -- 172.21.15.17:0/3459741608 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fd848105ba0 con 0x7fd830038670 2024-09-13T15:47:45.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.970+0000 7fd84fa00640 1 -- 172.21.15.17:0/3459741608 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd830038670 msgr2=0x7fd83003ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:45.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.970+0000 7fd84fa00640 1 --2- 172.21.15.17:0/3459741608 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd830038670 0x7fd83003ab30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd8340098c0 tx=0x7fd834006db0 comp rx=0 tx=0).stop 2024-09-13T15:47:45.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.970+0000 7fd84fa00640 1 -- 172.21.15.17:0/3459741608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8481077f0 msgr2=0x7fd84819b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:45.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.970+0000 7fd84fa00640 1 --2- 172.21.15.17:0/3459741608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8481077f0 0x7fd84819b440 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd83c030410 tx=0x7fd83c032670 comp rx=0 tx=0).stop 2024-09-13T15:47:45.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.970+0000 7fd84fa00640 1 -- 172.21.15.17:0/3459741608 shutdown_connections 2024-09-13T15:47:45.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.970+0000 7fd84fa00640 1 --2- 172.21.15.17:0/3459741608 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd830038670 0x7fd83003ab30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:45.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.970+0000 7fd84fa00640 1 --2- 172.21.15.17:0/3459741608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8481077f0 0x7fd84819b440 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:45.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.970+0000 7fd84fa00640 1 -- 172.21.15.17:0/3459741608 >> 172.21.15.17:0/3459741608 conn(0x7fd84807ad80 msgr2=0x7fd848105490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:45.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.970+0000 7fd84fa00640 1 -- 172.21.15.17:0/3459741608 shutdown_connections 2024-09-13T15:47:45.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:44.970+0000 7fd84fa00640 1 -- 172.21.15.17:0/3459741608 wait complete. 2024-09-13T15:47:45.754 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial admin user... 2024-09-13T15:47:46.318 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:46 smithi017 ceph-mon[30494]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:47:46.318 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:47:48.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:47 smithi017 ceph-mon[30494]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:47:48.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:47 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:47:48.247 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$IJyRbG2MBEaN5uoMeOkRAuRnMvIKib7.VXTu.kVpmKXWPbCUYipW6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726242466, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-13T15:47:48.247 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.322+0000 7f7705c00640 1 Processor -- start 2024-09-13T15:47:48.247 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.322+0000 7f7705c00640 1 -- start start 2024-09-13T15:47:48.247 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.322+0000 7f7705c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7700105390 0x7f7700105790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:48.247 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.322+0000 7f7705c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7700105d60 con 0x7f7700105390 2024-09-13T15:47:48.247 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.323+0000 7f76ffe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7700105390 0x7f7700105790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:48.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.323+0000 7f76ffe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7700105390 0x7f7700105790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53404/0 (socket says 172.21.15.17:53404) 2024-09-13T15:47:48.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.323+0000 7f76ffe00640 1 -- 172.21.15.17:0/12117388 learned_addr learned my addr 172.21.15.17:0/12117388 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:48.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.323+0000 7f76ffe00640 1 -- 172.21.15.17:0/12117388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7700106590 con 0x7f7700105390 2024-09-13T15:47:48.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.324+0000 7f76ffe00640 1 --2- 172.21.15.17:0/12117388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7700105390 0x7f7700105790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009820 tx=0x7f76f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ecbe9571f96515 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:48.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.324+0000 7f76fea00640 1 -- 172.21.15.17:0/12117388 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76f002ae70 con 0x7f7700105390 2024-09-13T15:47:48.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.325+0000 7f76fea00640 1 -- 172.21.15.17:0/12117388 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76f0032900 con 0x7f7700105390 2024-09-13T15:47:48.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.325+0000 7f76fea00640 1 -- 172.21.15.17:0/12117388 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76f0030880 con 0x7f7700105390 2024-09-13T15:47:48.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.325+0000 7f7705c00640 1 -- 172.21.15.17:0/12117388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7700105390 msgr2=0x7f7700105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:48.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.325+0000 7f7705c00640 1 --2- 172.21.15.17:0/12117388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7700105390 0x7f7700105790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009820 tx=0x7f76f002a270 comp rx=0 tx=0).stop 2024-09-13T15:47:48.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.325+0000 7f7705c00640 1 -- 172.21.15.17:0/12117388 shutdown_connections 2024-09-13T15:47:48.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.325+0000 7f7705c00640 1 --2- 172.21.15.17:0/12117388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7700105390 0x7f7700105790 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:48.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.325+0000 7f7705c00640 1 -- 172.21.15.17:0/12117388 >> 172.21.15.17:0/12117388 conn(0x7f7700100ba0 msgr2=0x7f7700102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:48.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.325+0000 7f7705c00640 1 -- 172.21.15.17:0/12117388 shutdown_connections 2024-09-13T15:47:48.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.325+0000 7f7705c00640 1 -- 172.21.15.17:0/12117388 wait complete. 2024-09-13T15:47:48.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.326+0000 7f7705c00640 1 Processor -- start 2024-09-13T15:47:48.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.326+0000 7f7705c00640 1 -- start start 2024-09-13T15:47:48.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.327+0000 7f7705c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7700105390 0x7f7700199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:48.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.327+0000 7f7705c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77001995c0 con 0x7f7700105390 2024-09-13T15:47:48.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.327+0000 7f76ffe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7700105390 0x7f7700199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:48.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.327+0000 7f76ffe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7700105390 0x7f7700199080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53414/0 (socket says 172.21.15.17:53414) 2024-09-13T15:47:48.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.327+0000 7f76ffe00640 1 -- 172.21.15.17:0/2235601437 learned_addr learned my addr 172.21.15.17:0/2235601437 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:48.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.327+0000 7f76ffe00640 1 -- 172.21.15.17:0/2235601437 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f00094d0 con 0x7f7700105390 2024-09-13T15:47:48.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.328+0000 7f76ffe00640 1 --2- 172.21.15.17:0/2235601437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7700105390 0x7f7700199080 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f76f00097f0 tx=0x7f76f0030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:48.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.328+0000 7f76fcc00640 1 -- 172.21.15.17:0/2235601437 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76f0032c80 con 0x7f7700105390 2024-09-13T15:47:48.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.328+0000 7f76fcc00640 1 -- 172.21.15.17:0/2235601437 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76f0032de0 con 0x7f7700105390 2024-09-13T15:47:48.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.328+0000 7f7705c00640 1 -- 172.21.15.17:0/2235601437 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77001997c0 con 0x7f7700105390 2024-09-13T15:47:48.252 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.328+0000 7f76fcc00640 1 -- 172.21.15.17:0/2235601437 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76f003a690 con 0x7f7700105390 2024-09-13T15:47:48.252 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.328+0000 7f7705c00640 1 -- 172.21.15.17:0/2235601437 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7700199c60 con 0x7f7700105390 2024-09-13T15:47:48.253 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.329+0000 7f76fcc00640 1 -- 172.21.15.17:0/2235601437 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f76f0039040 con 0x7f7700105390 2024-09-13T15:47:48.253 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.329+0000 7f7705c00640 1 -- 172.21.15.17:0/2235601437 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77001097c0 con 0x7f7700105390 2024-09-13T15:47:48.253 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.330+0000 7f76fcc00640 1 --2- 172.21.15.17:0/2235601437 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f76e40386c0 0x7f76e403ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:48.253 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.330+0000 7f76fcc00640 1 -- 172.21.15.17:0/2235601437 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f76f006b900 con 0x7f7700105390 2024-09-13T15:47:48.253 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.330+0000 7f76ff400640 1 --2- 172.21.15.17:0/2235601437 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f76e40386c0 0x7f76e403ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:48.253 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.331+0000 7f76ff400640 1 --2- 172.21.15.17:0/2235601437 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f76e40386c0 0x7f76e403ab80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0098c0 tx=0x7f76ec006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:48.254 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.335+0000 7f76fcc00640 1 -- 172.21.15.17:0/2235601437 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f76f00313a0 con 0x7f7700105390 2024-09-13T15:47:48.254 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.547+0000 7f7705c00640 1 -- 172.21.15.17:0/2235601437 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f770019c600 con 0x7f76e40386c0 2024-09-13T15:47:48.254 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.797+0000 7f76fcc00640 1 -- 172.21.15.17:0/2235601437 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f770019c600 con 0x7f76e40386c0 2024-09-13T15:47:48.254 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.799+0000 7f7705c00640 1 -- 172.21.15.17:0/2235601437 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f76e40386c0 msgr2=0x7f76e403ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:48.254 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.799+0000 7f7705c00640 1 --2- 172.21.15.17:0/2235601437 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f76e40386c0 0x7f76e403ab80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0098c0 tx=0x7f76ec006db0 comp rx=0 tx=0).stop 2024-09-13T15:47:48.254 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.799+0000 7f7705c00640 1 -- 172.21.15.17:0/2235601437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7700105390 msgr2=0x7f7700199080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:48.255 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.799+0000 7f7705c00640 1 --2- 172.21.15.17:0/2235601437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7700105390 0x7f7700199080 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f76f00097f0 tx=0x7f76f0030d70 comp rx=0 tx=0).stop 2024-09-13T15:47:48.255 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.800+0000 7f7705c00640 1 -- 172.21.15.17:0/2235601437 shutdown_connections 2024-09-13T15:47:48.255 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.800+0000 7f7705c00640 1 --2- 172.21.15.17:0/2235601437 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f76e40386c0 0x7f76e403ab80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:48.255 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.800+0000 7f7705c00640 1 --2- 172.21.15.17:0/2235601437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7700105390 0x7f7700199080 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:48.255 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.800+0000 7f7705c00640 1 -- 172.21.15.17:0/2235601437 >> 172.21.15.17:0/2235601437 conn(0x7f7700100ba0 msgr2=0x7f77001016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:48.256 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.800+0000 7f7705c00640 1 -- 172.21.15.17:0/2235601437 shutdown_connections 2024-09-13T15:47:48.256 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:46.800+0000 7f7705c00640 1 -- 172.21.15.17:0/2235601437 wait complete. 2024-09-13T15:47:48.256 INFO:teuthology.orchestra.run.smithi017.stdout:Fetching dashboard port number... 2024-09-13T15:47:49.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 8443 2024-09-13T15:47:49.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.723+0000 7f6559200640 1 Processor -- start 2024-09-13T15:47:49.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.723+0000 7f6559200640 1 -- start start 2024-09-13T15:47:49.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.723+0000 7f6559200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65541078a0 0x7f6554107ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:49.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.723+0000 7f6559200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6554108270 con 0x7f65541078a0 2024-09-13T15:47:49.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.724+0000 7f6551e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65541078a0 0x7f6554107ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:49.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.724+0000 7f6551e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65541078a0 0x7f6554107ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53426/0 (socket says 172.21.15.17:53426) 2024-09-13T15:47:49.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.724+0000 7f6551e00640 1 -- 172.21.15.17:0/725844551 learned_addr learned my addr 172.21.15.17:0/725844551 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:49.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.724+0000 7f6551e00640 1 -- 172.21.15.17:0/725844551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6554108990 con 0x7f65541078a0 2024-09-13T15:47:49.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.725+0000 7f6551e00640 1 --2- 172.21.15.17:0/725844551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65541078a0 0x7f6554107ca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6544009820 tx=0x7f654402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e49786259d794b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:49.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.726+0000 7f6550a00640 1 -- 172.21.15.17:0/725844551 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f654402ae70 con 0x7f65541078a0 2024-09-13T15:47:49.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.726+0000 7f6550a00640 1 -- 172.21.15.17:0/725844551 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6544032900 con 0x7f65541078a0 2024-09-13T15:47:49.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.726+0000 7f6550a00640 1 -- 172.21.15.17:0/725844551 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6544030880 con 0x7f65541078a0 2024-09-13T15:47:49.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.726+0000 7f6559200640 1 -- 172.21.15.17:0/725844551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65541078a0 msgr2=0x7f6554107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:49.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.726+0000 7f6559200640 1 --2- 172.21.15.17:0/725844551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65541078a0 0x7f6554107ca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6544009820 tx=0x7f654402a270 comp rx=0 tx=0).stop 2024-09-13T15:47:49.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.727+0000 7f6559200640 1 -- 172.21.15.17:0/725844551 shutdown_connections 2024-09-13T15:47:49.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.727+0000 7f6559200640 1 --2- 172.21.15.17:0/725844551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65541078a0 0x7f6554107ca0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:49.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.727+0000 7f6559200640 1 -- 172.21.15.17:0/725844551 >> 172.21.15.17:0/725844551 conn(0x7f655407ae00 msgr2=0x7f655407b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:49.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.727+0000 7f6559200640 1 -- 172.21.15.17:0/725844551 shutdown_connections 2024-09-13T15:47:49.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.727+0000 7f6559200640 1 -- 172.21.15.17:0/725844551 wait complete. 2024-09-13T15:47:49.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.728+0000 7f6559200640 1 Processor -- start 2024-09-13T15:47:49.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.728+0000 7f6559200640 1 -- start start 2024-09-13T15:47:49.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.729+0000 7f6559200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65541078a0 0x7f655419b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:49.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.729+0000 7f6559200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655419ba10 con 0x7f65541078a0 2024-09-13T15:47:49.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.729+0000 7f6551e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65541078a0 0x7f655419b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:49.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.729+0000 7f6551e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65541078a0 0x7f655419b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53428/0 (socket says 172.21.15.17:53428) 2024-09-13T15:47:49.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.729+0000 7f6551e00640 1 -- 172.21.15.17:0/94140573 learned_addr learned my addr 172.21.15.17:0/94140573 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:49.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.729+0000 7f6551e00640 1 -- 172.21.15.17:0/94140573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65440094d0 con 0x7f65541078a0 2024-09-13T15:47:49.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.730+0000 7f6551e00640 1 --2- 172.21.15.17:0/94140573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65541078a0 0x7f655419b4d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6544030380 tx=0x7f6544030de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:49.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.730+0000 7f654aa00640 1 -- 172.21.15.17:0/94140573 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6544032db0 con 0x7f65541078a0 2024-09-13T15:47:49.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.730+0000 7f6559200640 1 -- 172.21.15.17:0/94140573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655419bc10 con 0x7f65541078a0 2024-09-13T15:47:49.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.730+0000 7f654aa00640 1 -- 172.21.15.17:0/94140573 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f654403b8f0 con 0x7f65541078a0 2024-09-13T15:47:49.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.730+0000 7f654aa00640 1 -- 172.21.15.17:0/94140573 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f654403a760 con 0x7f65541078a0 2024-09-13T15:47:49.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.730+0000 7f6559200640 1 -- 172.21.15.17:0/94140573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655419c0b0 con 0x7f65541078a0 2024-09-13T15:47:49.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.731+0000 7f654aa00640 1 -- 172.21.15.17:0/94140573 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f6544039040 con 0x7f65541078a0 2024-09-13T15:47:49.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.731+0000 7f6559200640 1 -- 172.21.15.17:0/94140573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655410bbc0 con 0x7f65541078a0 2024-09-13T15:47:49.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.732+0000 7f654aa00640 1 --2- 172.21.15.17:0/94140573 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6538038710 0x7f653803abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:49.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.732+0000 7f654aa00640 1 -- 172.21.15.17:0/94140573 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f654406bb90 con 0x7f65541078a0 2024-09-13T15:47:49.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.732+0000 7f6551400640 1 --2- 172.21.15.17:0/94140573 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6538038710 0x7f653803abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:49.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.733+0000 7f6551400640 1 --2- 172.21.15.17:0/94140573 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6538038710 0x7f653803abd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f65400098c0 tx=0x7f6540006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:49.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.737+0000 7f654aa00640 1 -- 172.21.15.17:0/94140573 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f654404b710 con 0x7f65541078a0 2024-09-13T15:47:49.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.800+0000 7f654aa00640 1 -- 172.21.15.17:0/94140573 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f654403bcd0 con 0x7f65541078a0 2024-09-13T15:47:49.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.920+0000 7f6559200640 1 -- 172.21.15.17:0/94140573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f655410be30 con 0x7f65541078a0 2024-09-13T15:47:49.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.921+0000 7f654aa00640 1 -- 172.21.15.17:0/94140573 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f654406be60 con 0x7f65541078a0 2024-09-13T15:47:49.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.924+0000 7f6559200640 1 -- 172.21.15.17:0/94140573 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6538038710 msgr2=0x7f653803abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:49.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.924+0000 7f6559200640 1 --2- 172.21.15.17:0/94140573 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6538038710 0x7f653803abd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f65400098c0 tx=0x7f6540006db0 comp rx=0 tx=0).stop 2024-09-13T15:47:49.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.924+0000 7f6559200640 1 -- 172.21.15.17:0/94140573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65541078a0 msgr2=0x7f655419b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:49.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.924+0000 7f6559200640 1 --2- 172.21.15.17:0/94140573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65541078a0 0x7f655419b4d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6544030380 tx=0x7f6544030de0 comp rx=0 tx=0).stop 2024-09-13T15:47:49.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.924+0000 7f6559200640 1 -- 172.21.15.17:0/94140573 shutdown_connections 2024-09-13T15:47:49.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.924+0000 7f6559200640 1 --2- 172.21.15.17:0/94140573 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6538038710 0x7f653803abd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:49.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.924+0000 7f6559200640 1 --2- 172.21.15.17:0/94140573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65541078a0 0x7f655419b4d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:49.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.924+0000 7f6559200640 1 -- 172.21.15.17:0/94140573 >> 172.21.15.17:0/94140573 conn(0x7f655407ae00 msgr2=0x7f6554105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:49.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.924+0000 7f6559200640 1 -- 172.21.15.17:0/94140573 shutdown_connections 2024-09-13T15:47:49.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:48.924+0000 7f6559200640 1 -- 172.21.15.17:0/94140573 wait complete. 2024-09-13T15:47:49.606 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T15:47:49.607 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-09-13T15:47:49.620 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T15:47:49.620 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-13T15:47:49.620 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-09-13T15:47:49.620 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-13T15:47:49.623 INFO:teuthology.orchestra.run.smithi017.stdout:Ceph Dashboard is now available at: 2024-09-13T15:47:49.623 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:47:49.623 INFO:teuthology.orchestra.run.smithi017.stdout: URL: https://smithi017.front.sepia.ceph.com:8443/ 2024-09-13T15:47:49.623 INFO:teuthology.orchestra.run.smithi017.stdout: User: admin 2024-09-13T15:47:49.623 INFO:teuthology.orchestra.run.smithi017.stdout: Password: pkrn7owj3a 2024-09-13T15:47:49.624 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:47:49.624 INFO:teuthology.orchestra.run.smithi017.stdout:Saving cluster configuration to /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/config directory 2024-09-13T15:47:49.624 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling autotune for osd_memory_target 2024-09-13T15:47:49.919 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:49 smithi017 ceph-mon[30494]: mgrmap e13: x(active, since 6s) 2024-09-13T15:47:49.919 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:49 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/94140573' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-13T15:47:50.950 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.138+0000 7fc279e00640 1 Processor -- start 2024-09-13T15:47:50.950 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.138+0000 7fc279e00640 1 -- start start 2024-09-13T15:47:50.951 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.138+0000 7fc279e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc274107840 0x7fc274107c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:50.951 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.138+0000 7fc279e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc274108210 con 0x7fc274107840 2024-09-13T15:47:50.951 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.138+0000 7fc272a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc274107840 0x7fc274107c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:50.951 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.138+0000 7fc272a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc274107840 0x7fc274107c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34536/0 (socket says 172.21.15.17:34536) 2024-09-13T15:47:50.951 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.138+0000 7fc272a00640 1 -- 172.21.15.17:0/3814903815 learned_addr learned my addr 172.21.15.17:0/3814903815 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:50.951 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.139+0000 7fc272a00640 1 -- 172.21.15.17:0/3814903815 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2741089b0 con 0x7fc274107840 2024-09-13T15:47:50.951 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.140+0000 7fc272a00640 1 --2- 172.21.15.17:0/3814903815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc274107840 0x7fc274107c40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc264009820 tx=0x7fc26402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b47b4b2b471585 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:50.951 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.140+0000 7fc272000640 1 -- 172.21.15.17:0/3814903815 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc26402ae70 con 0x7fc274107840 2024-09-13T15:47:50.951 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.140+0000 7fc272000640 1 -- 172.21.15.17:0/3814903815 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc264032900 con 0x7fc274107840 2024-09-13T15:47:50.951 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.140+0000 7fc272000640 1 -- 172.21.15.17:0/3814903815 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc264030880 con 0x7fc274107840 2024-09-13T15:47:50.951 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.141+0000 7fc279e00640 1 -- 172.21.15.17:0/3814903815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc274107840 msgr2=0x7fc274107c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:50.951 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.141+0000 7fc279e00640 1 --2- 172.21.15.17:0/3814903815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc274107840 0x7fc274107c40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc264009820 tx=0x7fc26402a270 comp rx=0 tx=0).stop 2024-09-13T15:47:50.951 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.141+0000 7fc279e00640 1 -- 172.21.15.17:0/3814903815 shutdown_connections 2024-09-13T15:47:50.952 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.141+0000 7fc279e00640 1 --2- 172.21.15.17:0/3814903815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc274107840 0x7fc274107c40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:50.952 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.141+0000 7fc279e00640 1 -- 172.21.15.17:0/3814903815 >> 172.21.15.17:0/3814903815 conn(0x7fc27407ad90 msgr2=0x7fc27407b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:50.952 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.141+0000 7fc279e00640 1 -- 172.21.15.17:0/3814903815 shutdown_connections 2024-09-13T15:47:50.952 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.141+0000 7fc279e00640 1 -- 172.21.15.17:0/3814903815 wait complete. 2024-09-13T15:47:50.952 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.142+0000 7fc279e00640 1 Processor -- start 2024-09-13T15:47:50.952 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.142+0000 7fc279e00640 1 -- start start 2024-09-13T15:47:50.952 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.142+0000 7fc279e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc274107840 0x7fc27419b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:50.952 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.142+0000 7fc279e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27419ba10 con 0x7fc274107840 2024-09-13T15:47:50.952 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.142+0000 7fc272a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc274107840 0x7fc27419b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:50.952 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.142+0000 7fc272a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc274107840 0x7fc27419b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34538/0 (socket says 172.21.15.17:34538) 2024-09-13T15:47:50.952 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.142+0000 7fc272a00640 1 -- 172.21.15.17:0/3790149279 learned_addr learned my addr 172.21.15.17:0/3790149279 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:50.952 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.143+0000 7fc272a00640 1 -- 172.21.15.17:0/3790149279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2640094d0 con 0x7fc274107840 2024-09-13T15:47:50.953 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.143+0000 7fc272a00640 1 --2- 172.21.15.17:0/3790149279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc274107840 0x7fc27419b4d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc264030590 tx=0x7fc264032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:50.953 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.143+0000 7fc278a00640 1 -- 172.21.15.17:0/3790149279 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc264032db0 con 0x7fc274107840 2024-09-13T15:47:50.953 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.143+0000 7fc278a00640 1 -- 172.21.15.17:0/3790149279 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc26403b8f0 con 0x7fc274107840 2024-09-13T15:47:50.953 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.143+0000 7fc278a00640 1 -- 172.21.15.17:0/3790149279 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc26403a820 con 0x7fc274107840 2024-09-13T15:47:50.953 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.143+0000 7fc279e00640 1 -- 172.21.15.17:0/3790149279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27419bc10 con 0x7fc274107840 2024-09-13T15:47:50.953 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.144+0000 7fc279e00640 1 -- 172.21.15.17:0/3790149279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27419c0b0 con 0x7fc274107840 2024-09-13T15:47:50.953 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.145+0000 7fc278a00640 1 -- 172.21.15.17:0/3790149279 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fc264039040 con 0x7fc274107840 2024-09-13T15:47:50.953 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.145+0000 7fc279e00640 1 -- 172.21.15.17:0/3790149279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27410bbe0 con 0x7fc274107840 2024-09-13T15:47:50.953 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.145+0000 7fc278a00640 1 --2- 172.21.15.17:0/3790149279 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc2580387b0 0x7fc25803ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:50.953 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.145+0000 7fc278a00640 1 -- 172.21.15.17:0/3790149279 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc26406bb30 con 0x7fc274107840 2024-09-13T15:47:50.953 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.145+0000 7fc26be00640 1 --2- 172.21.15.17:0/3790149279 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc2580387b0 0x7fc25803ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:50.953 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.146+0000 7fc26be00640 1 --2- 172.21.15.17:0/3790149279 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc2580387b0 0x7fc25803ac70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc25c0098c0 tx=0x7fc25c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:50.953 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.150+0000 7fc278a00640 1 -- 172.21.15.17:0/3790149279 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc264049e30 con 0x7fc274107840 2024-09-13T15:47:50.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.329+0000 7fc279e00640 1 -- 172.21.15.17:0/3790149279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fc27410be20 con 0x7fc274107840 2024-09-13T15:47:50.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.329+0000 7fc278a00640 1 -- 172.21.15.17:0/3790149279 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fc26403f070 con 0x7fc274107840 2024-09-13T15:47:50.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.331+0000 7fc279e00640 1 -- 172.21.15.17:0/3790149279 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc2580387b0 msgr2=0x7fc25803ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:50.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.331+0000 7fc279e00640 1 --2- 172.21.15.17:0/3790149279 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc2580387b0 0x7fc25803ac70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc25c0098c0 tx=0x7fc25c006db0 comp rx=0 tx=0).stop 2024-09-13T15:47:50.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.331+0000 7fc279e00640 1 -- 172.21.15.17:0/3790149279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc274107840 msgr2=0x7fc27419b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:50.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.331+0000 7fc279e00640 1 --2- 172.21.15.17:0/3790149279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc274107840 0x7fc27419b4d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc264030590 tx=0x7fc264032670 comp rx=0 tx=0).stop 2024-09-13T15:47:50.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.331+0000 7fc279e00640 1 -- 172.21.15.17:0/3790149279 shutdown_connections 2024-09-13T15:47:50.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.331+0000 7fc279e00640 1 --2- 172.21.15.17:0/3790149279 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc2580387b0 0x7fc25803ac70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:50.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.331+0000 7fc279e00640 1 --2- 172.21.15.17:0/3790149279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc274107840 0x7fc27419b4d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:50.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.332+0000 7fc279e00640 1 -- 172.21.15.17:0/3790149279 >> 172.21.15.17:0/3790149279 conn(0x7fc27407ad90 msgr2=0x7fc2741054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:50.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.332+0000 7fc279e00640 1 -- 172.21.15.17:0/3790149279 shutdown_connections 2024-09-13T15:47:50.954 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:50.332+0000 7fc279e00640 1 -- 172.21.15.17:0/3790149279 wait complete. 2024-09-13T15:47:52.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.453+0000 7fbcd3800640 1 Processor -- start 2024-09-13T15:47:52.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.453+0000 7fbcd3800640 1 -- start start 2024-09-13T15:47:52.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.453+0000 7fbcd3800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbccc1078a0 0x7fbccc107ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:52.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.453+0000 7fbcd3800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc108270 con 0x7fbccc1078a0 2024-09-13T15:47:52.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.454+0000 7fbcd0e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbccc1078a0 0x7fbccc107ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:52.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.454+0000 7fbcd0e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbccc1078a0 0x7fbccc107ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34548/0 (socket says 172.21.15.17:34548) 2024-09-13T15:47:52.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.454+0000 7fbcd0e00640 1 -- 172.21.15.17:0/3899836770 learned_addr learned my addr 172.21.15.17:0/3899836770 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:52.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.454+0000 7fbcd0e00640 1 -- 172.21.15.17:0/3899836770 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbccc108990 con 0x7fbccc1078a0 2024-09-13T15:47:52.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.455+0000 7fbcd0e00640 1 --2- 172.21.15.17:0/3899836770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbccc1078a0 0x7fbccc107ca0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0009820 tx=0x7fbcc002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23ad11e1e069746 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:52.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.455+0000 7fbccb400640 1 -- 172.21.15.17:0/3899836770 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbcc002ae70 con 0x7fbccc1078a0 2024-09-13T15:47:52.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.455+0000 7fbccb400640 1 -- 172.21.15.17:0/3899836770 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbcc0032900 con 0x7fbccc1078a0 2024-09-13T15:47:52.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.455+0000 7fbccb400640 1 -- 172.21.15.17:0/3899836770 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbcc0030880 con 0x7fbccc1078a0 2024-09-13T15:47:52.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.456+0000 7fbcd3800640 1 -- 172.21.15.17:0/3899836770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbccc1078a0 msgr2=0x7fbccc107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:52.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.456+0000 7fbcd3800640 1 --2- 172.21.15.17:0/3899836770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbccc1078a0 0x7fbccc107ca0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0009820 tx=0x7fbcc002a270 comp rx=0 tx=0).stop 2024-09-13T15:47:52.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.456+0000 7fbcd3800640 1 -- 172.21.15.17:0/3899836770 shutdown_connections 2024-09-13T15:47:52.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.456+0000 7fbcd3800640 1 --2- 172.21.15.17:0/3899836770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbccc1078a0 0x7fbccc107ca0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:52.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.456+0000 7fbcd3800640 1 -- 172.21.15.17:0/3899836770 >> 172.21.15.17:0/3899836770 conn(0x7fbccc07ae00 msgr2=0x7fbccc07b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:52.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.456+0000 7fbcd3800640 1 -- 172.21.15.17:0/3899836770 shutdown_connections 2024-09-13T15:47:52.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.456+0000 7fbcd3800640 1 -- 172.21.15.17:0/3899836770 wait complete. 2024-09-13T15:47:52.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.457+0000 7fbcd3800640 1 Processor -- start 2024-09-13T15:47:52.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.457+0000 7fbcd3800640 1 -- start start 2024-09-13T15:47:52.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.458+0000 7fbcd3800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbccc1078a0 0x7fbccc19b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:52.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.458+0000 7fbcd3800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc19ba10 con 0x7fbccc1078a0 2024-09-13T15:47:52.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.458+0000 7fbcd0e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbccc1078a0 0x7fbccc19b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:52.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.458+0000 7fbcd0e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbccc1078a0 0x7fbccc19b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34562/0 (socket says 172.21.15.17:34562) 2024-09-13T15:47:52.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.458+0000 7fbcd0e00640 1 -- 172.21.15.17:0/3896932142 learned_addr learned my addr 172.21.15.17:0/3896932142 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:52.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.458+0000 7fbcd0e00640 1 -- 172.21.15.17:0/3896932142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc00094d0 con 0x7fbccc1078a0 2024-09-13T15:47:52.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.458+0000 7fbcd0e00640 1 --2- 172.21.15.17:0/3896932142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbccc1078a0 0x7fbccc19b4d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0030380 tx=0x7fbcc0030de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:52.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.459+0000 7fbcc9600640 1 -- 172.21.15.17:0/3896932142 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbcc0032db0 con 0x7fbccc1078a0 2024-09-13T15:47:52.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.459+0000 7fbcc9600640 1 -- 172.21.15.17:0/3896932142 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbcc003b8f0 con 0x7fbccc1078a0 2024-09-13T15:47:52.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.459+0000 7fbcd3800640 1 -- 172.21.15.17:0/3896932142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbccc19bc10 con 0x7fbccc1078a0 2024-09-13T15:47:52.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.459+0000 7fbcc9600640 1 -- 172.21.15.17:0/3896932142 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbcc003a760 con 0x7fbccc1078a0 2024-09-13T15:47:52.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.459+0000 7fbcd3800640 1 -- 172.21.15.17:0/3896932142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbccc19c0b0 con 0x7fbccc1078a0 2024-09-13T15:47:52.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.460+0000 7fbcd3800640 1 -- 172.21.15.17:0/3896932142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbccc10bbc0 con 0x7fbccc1078a0 2024-09-13T15:47:52.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.460+0000 7fbcc9600640 1 -- 172.21.15.17:0/3896932142 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fbcc0039040 con 0x7fbccc1078a0 2024-09-13T15:47:52.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.460+0000 7fbcc9600640 1 --2- 172.21.15.17:0/3896932142 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbcb4038710 0x7fbcb403abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:52.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.460+0000 7fbcc9600640 1 -- 172.21.15.17:0/3896932142 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fbcc006ba80 con 0x7fbccc1078a0 2024-09-13T15:47:52.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.461+0000 7fbccbe00640 1 --2- 172.21.15.17:0/3896932142 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbcb4038710 0x7fbcb403abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:52.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.461+0000 7fbccbe00640 1 --2- 172.21.15.17:0/3896932142 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbcb4038710 0x7fbcb403abd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbcb80098c0 tx=0x7fbcb8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:52.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.466+0000 7fbcc9600640 1 -- 172.21.15.17:0/3896932142 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbcc003ba60 con 0x7fbccc1078a0 2024-09-13T15:47:52.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.740+0000 7fbcd3800640 1 -- 172.21.15.17:0/3896932142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fbccc10be30 con 0x7fbccc1078a0 2024-09-13T15:47:52.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.742+0000 7fbcc9600640 1 -- 172.21.15.17:0/3896932142 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7fbcc003f0c0 con 0x7fbccc1078a0 2024-09-13T15:47:52.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-13T15:47:52.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.745+0000 7fbcd3800640 1 -- 172.21.15.17:0/3896932142 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbcb4038710 msgr2=0x7fbcb403abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:52.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.745+0000 7fbcd3800640 1 --2- 172.21.15.17:0/3896932142 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbcb4038710 0x7fbcb403abd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbcb80098c0 tx=0x7fbcb8006db0 comp rx=0 tx=0).stop 2024-09-13T15:47:52.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.745+0000 7fbcd3800640 1 -- 172.21.15.17:0/3896932142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbccc1078a0 msgr2=0x7fbccc19b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:52.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.745+0000 7fbcd3800640 1 --2- 172.21.15.17:0/3896932142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbccc1078a0 0x7fbccc19b4d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0030380 tx=0x7fbcc0030de0 comp rx=0 tx=0).stop 2024-09-13T15:47:52.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.745+0000 7fbcd3800640 1 -- 172.21.15.17:0/3896932142 shutdown_connections 2024-09-13T15:47:52.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.745+0000 7fbcd3800640 1 --2- 172.21.15.17:0/3896932142 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbcb4038710 0x7fbcb403abd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:52.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.745+0000 7fbcd3800640 1 --2- 172.21.15.17:0/3896932142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbccc1078a0 0x7fbccc19b4d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:52.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.745+0000 7fbcd3800640 1 -- 172.21.15.17:0/3896932142 >> 172.21.15.17:0/3896932142 conn(0x7fbccc07ae00 msgr2=0x7fbccc105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:52.389 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.745+0000 7fbcd3800640 1 -- 172.21.15.17:0/3896932142 shutdown_connections 2024-09-13T15:47:52.389 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-13T15:47:51.745+0000 7fbcd3800640 1 -- 172.21.15.17:0/3896932142 wait complete. 2024-09-13T15:47:52.389 INFO:teuthology.orchestra.run.smithi017.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-13T15:47:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:47:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-13T15:47:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:47:52.389 INFO:teuthology.orchestra.run.smithi017.stdout:Or, if you are only running a single cluster on this host: 2024-09-13T15:47:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:47:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-13T15:47:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:47:52.389 INFO:teuthology.orchestra.run.smithi017.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-13T15:47:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:47:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: ceph telemetry on 2024-09-13T15:47:52.389 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:47:52.390 INFO:teuthology.orchestra.run.smithi017.stdout:For more information see: 2024-09-13T15:47:52.390 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:47:52.390 INFO:teuthology.orchestra.run.smithi017.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-13T15:47:52.390 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:47:52.390 INFO:teuthology.orchestra.run.smithi017.stdout:Bootstrap complete. 2024-09-13T15:47:52.433 INFO:tasks.cephadm:Fetching config... 2024-09-13T15:47:52.434 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T15:47:52.434 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-13T15:47:52.469 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-13T15:47:52.469 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T15:47:52.469 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-13T15:47:52.547 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-13T15:47:52.547 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T15:47:52.547 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-13T15:47:52.645 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-13T15:47:52.645 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T15:47:52.645 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-13T15:47:52.721 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-13T15:47:52.721 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8WcuSieCRhJuBZrBtIKQ7OSqo6CcwSf+QqAaJuMRXuTgJUTBGZLExh74jBGGxahVmAL8L2CH50Ms8VFDgAOXMKUVZEe3Z91djyQrMlYEHe+A6RT7ZPE7t3yMJiMT+sa6ce6bWIU9vR/L/ez69f62qhD1U8NXSuQOjtRxVMQ6KYGX/bBkSSah9hIu+P8PJEbZcNK6c8DzEsroYQbvJhZHS2T/G70uY7PlxRRN/c379NsXOXYaQiB3Z3rXJn2nCW3D+ZZAl2wbhpwhW3tAnHuLjXfWnDlVSIgAzS7uN1oLChpVvJaO9YBcm09XZINZrvnL4cmHM7Fs7p6ime14Xq9bR6Yi2tZgzfHthsufdcyabPJjdt9qcKJauCfamEaj4WI6to4rB15tsRUS5RqurVO/nUmEiRFKOR7VYn/R6/1X3b+98a2HBjufWi765YJcTdj34RlZQEdvLG63bXwbNLIz9a6KYC9q1SYTzg78b6fMp2S0PTM9wclV3lk+R9gj7xFE= ceph-3334a620-71e7-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T15:47:52.842 INFO:teuthology.orchestra.run.smithi017.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8WcuSieCRhJuBZrBtIKQ7OSqo6CcwSf+QqAaJuMRXuTgJUTBGZLExh74jBGGxahVmAL8L2CH50Ms8VFDgAOXMKUVZEe3Z91djyQrMlYEHe+A6RT7ZPE7t3yMJiMT+sa6ce6bWIU9vR/L/ez69f62qhD1U8NXSuQOjtRxVMQ6KYGX/bBkSSah9hIu+P8PJEbZcNK6c8DzEsroYQbvJhZHS2T/G70uY7PlxRRN/c379NsXOXYaQiB3Z3rXJn2nCW3D+ZZAl2wbhpwhW3tAnHuLjXfWnDlVSIgAzS7uN1oLChpVvJaO9YBcm09XZINZrvnL4cmHM7Fs7p6ime14Xq9bR6Yi2tZgzfHthsufdcyabPJjdt9qcKJauCfamEaj4WI6to4rB15tsRUS5RqurVO/nUmEiRFKOR7VYn/R6/1X3b+98a2HBjufWi765YJcTdj34RlZQEdvLG63bXwbNLIz9a6KYC9q1SYTzg78b6fMp2S0PTM9wclV3lk+R9gj7xFE= ceph-3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T15:47:52.873 DEBUG:teuthology.orchestra.run.smithi189:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8WcuSieCRhJuBZrBtIKQ7OSqo6CcwSf+QqAaJuMRXuTgJUTBGZLExh74jBGGxahVmAL8L2CH50Ms8VFDgAOXMKUVZEe3Z91djyQrMlYEHe+A6RT7ZPE7t3yMJiMT+sa6ce6bWIU9vR/L/ez69f62qhD1U8NXSuQOjtRxVMQ6KYGX/bBkSSah9hIu+P8PJEbZcNK6c8DzEsroYQbvJhZHS2T/G70uY7PlxRRN/c379NsXOXYaQiB3Z3rXJn2nCW3D+ZZAl2wbhpwhW3tAnHuLjXfWnDlVSIgAzS7uN1oLChpVvJaO9YBcm09XZINZrvnL4cmHM7Fs7p6ime14Xq9bR6Yi2tZgzfHthsufdcyabPJjdt9qcKJauCfamEaj4WI6to4rB15tsRUS5RqurVO/nUmEiRFKOR7VYn/R6/1X3b+98a2HBjufWi765YJcTdj34RlZQEdvLG63bXwbNLIz9a6KYC9q1SYTzg78b6fMp2S0PTM9wclV3lk+R9gj7xFE= ceph-3334a620-71e7-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T15:47:52.916 INFO:teuthology.orchestra.run.smithi189.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8WcuSieCRhJuBZrBtIKQ7OSqo6CcwSf+QqAaJuMRXuTgJUTBGZLExh74jBGGxahVmAL8L2CH50Ms8VFDgAOXMKUVZEe3Z91djyQrMlYEHe+A6RT7ZPE7t3yMJiMT+sa6ce6bWIU9vR/L/ez69f62qhD1U8NXSuQOjtRxVMQ6KYGX/bBkSSah9hIu+P8PJEbZcNK6c8DzEsroYQbvJhZHS2T/G70uY7PlxRRN/c379NsXOXYaQiB3Z3rXJn2nCW3D+ZZAl2wbhpwhW3tAnHuLjXfWnDlVSIgAzS7uN1oLChpVvJaO9YBcm09XZINZrvnL4cmHM7Fs7p6ime14Xq9bR6Yi2tZgzfHthsufdcyabPJjdt9qcKJauCfamEaj4WI6to4rB15tsRUS5RqurVO/nUmEiRFKOR7VYn/R6/1X3b+98a2HBjufWi765YJcTdj34RlZQEdvLG63bXwbNLIz9a6KYC9q1SYTzg78b6fMp2S0PTM9wclV3lk+R9gj7xFE= ceph-3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T15:47:52.929 DEBUG:teuthology.orchestra.run.smithi193:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8WcuSieCRhJuBZrBtIKQ7OSqo6CcwSf+QqAaJuMRXuTgJUTBGZLExh74jBGGxahVmAL8L2CH50Ms8VFDgAOXMKUVZEe3Z91djyQrMlYEHe+A6RT7ZPE7t3yMJiMT+sa6ce6bWIU9vR/L/ez69f62qhD1U8NXSuQOjtRxVMQ6KYGX/bBkSSah9hIu+P8PJEbZcNK6c8DzEsroYQbvJhZHS2T/G70uY7PlxRRN/c379NsXOXYaQiB3Z3rXJn2nCW3D+ZZAl2wbhpwhW3tAnHuLjXfWnDlVSIgAzS7uN1oLChpVvJaO9YBcm09XZINZrvnL4cmHM7Fs7p6ime14Xq9bR6Yi2tZgzfHthsufdcyabPJjdt9qcKJauCfamEaj4WI6to4rB15tsRUS5RqurVO/nUmEiRFKOR7VYn/R6/1X3b+98a2HBjufWi765YJcTdj34RlZQEdvLG63bXwbNLIz9a6KYC9q1SYTzg78b6fMp2S0PTM9wclV3lk+R9gj7xFE= ceph-3334a620-71e7-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T15:47:52.958 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:52 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3896932142' entity='client.admin' 2024-09-13T15:47:52.970 INFO:teuthology.orchestra.run.smithi193.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8WcuSieCRhJuBZrBtIKQ7OSqo6CcwSf+QqAaJuMRXuTgJUTBGZLExh74jBGGxahVmAL8L2CH50Ms8VFDgAOXMKUVZEe3Z91djyQrMlYEHe+A6RT7ZPE7t3yMJiMT+sa6ce6bWIU9vR/L/ez69f62qhD1U8NXSuQOjtRxVMQ6KYGX/bBkSSah9hIu+P8PJEbZcNK6c8DzEsroYQbvJhZHS2T/G70uY7PlxRRN/c379NsXOXYaQiB3Z3rXJn2nCW3D+ZZAl2wbhpwhW3tAnHuLjXfWnDlVSIgAzS7uN1oLChpVvJaO9YBcm09XZINZrvnL4cmHM7Fs7p6ime14Xq9bR6Yi2tZgzfHthsufdcyabPJjdt9qcKJauCfamEaj4WI6to4rB15tsRUS5RqurVO/nUmEiRFKOR7VYn/R6/1X3b+98a2HBjufWi765YJcTdj34RlZQEdvLG63bXwbNLIz9a6KYC9q1SYTzg78b6fMp2S0PTM9wclV3lk+R9gj7xFE= ceph-3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T15:47:52.983 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-13T15:47:53.290 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:47:55.874 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:55 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:47:55.875 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:55 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:47:55.875 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:55 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi017", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:47:55.875 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:55 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:47:55.875 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:55 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:47:55.875 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:55 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:47:55.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.888+0000 7fb0f3e00640 1 -- 172.21.15.17:0/3473475940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f40744e0 msgr2=0x7fb0f4072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:55.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.888+0000 7fb0f3e00640 1 --2- 172.21.15.17:0/3473475940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f40744e0 0x7fb0f4072940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4009880 tx=0x7fb0e402a5d0 comp rx=0 tx=0).stop 2024-09-13T15:47:55.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.888+0000 7fb0f3e00640 1 -- 172.21.15.17:0/3473475940 shutdown_connections 2024-09-13T15:47:55.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.888+0000 7fb0f3e00640 1 --2- 172.21.15.17:0/3473475940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f40744e0 0x7fb0f4072940 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:55.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.888+0000 7fb0f3e00640 1 -- 172.21.15.17:0/3473475940 >> 172.21.15.17:0/3473475940 conn(0x7fb0f40fadb0 msgr2=0x7fb0f40fd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:55.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.888+0000 7fb0f3e00640 1 -- 172.21.15.17:0/3473475940 shutdown_connections 2024-09-13T15:47:55.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.888+0000 7fb0f3e00640 1 -- 172.21.15.17:0/3473475940 wait complete. 2024-09-13T15:47:55.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.889+0000 7fb0f3e00640 1 Processor -- start 2024-09-13T15:47:55.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.889+0000 7fb0f3e00640 1 -- start start 2024-09-13T15:47:55.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.889+0000 7fb0f3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f40744e0 0x7fb0f4196c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:55.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.889+0000 7fb0f3e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4197190 con 0x7fb0f40744e0 2024-09-13T15:47:55.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.889+0000 7fb0f2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f40744e0 0x7fb0f4196c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:55.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.889+0000 7fb0f2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f40744e0 0x7fb0f4196c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34578/0 (socket says 172.21.15.17:34578) 2024-09-13T15:47:55.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.889+0000 7fb0f2a00640 1 -- 172.21.15.17:0/1627738093 learned_addr learned my addr 172.21.15.17:0/1627738093 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:55.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.890+0000 7fb0f2a00640 1 -- 172.21.15.17:0/1627738093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e4009560 con 0x7fb0f40744e0 2024-09-13T15:47:55.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.890+0000 7fb0f2a00640 1 --2- 172.21.15.17:0/1627738093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f40744e0 0x7fb0f4196c50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4005ab0 tx=0x7fb0e4005160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:55.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.890+0000 7fb0eb400640 1 -- 172.21.15.17:0/1627738093 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0e4005580 con 0x7fb0f40744e0 2024-09-13T15:47:55.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.890+0000 7fb0eb400640 1 -- 172.21.15.17:0/1627738093 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb0e4003ab0 con 0x7fb0f40744e0 2024-09-13T15:47:55.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.890+0000 7fb0f3e00640 1 -- 172.21.15.17:0/1627738093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f4197390 con 0x7fb0f40744e0 2024-09-13T15:47:55.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.890+0000 7fb0eb400640 1 -- 172.21.15.17:0/1627738093 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0e403ca30 con 0x7fb0f40744e0 2024-09-13T15:47:55.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.891+0000 7fb0f3e00640 1 -- 172.21.15.17:0/1627738093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f4197830 con 0x7fb0f40744e0 2024-09-13T15:47:55.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.891+0000 7fb0eb400640 1 -- 172.21.15.17:0/1627738093 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fb0e403cbd0 con 0x7fb0f40744e0 2024-09-13T15:47:55.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.892+0000 7fb0f3e00640 1 -- 172.21.15.17:0/1627738093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f4072940 con 0x7fb0f40744e0 2024-09-13T15:47:55.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.892+0000 7fb0eb400640 1 --2- 172.21.15.17:0/1627738093 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb0d8038710 0x7fb0d803abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:55.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.892+0000 7fb0eb400640 1 -- 172.21.15.17:0/1627738093 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb0e406c530 con 0x7fb0f40744e0 2024-09-13T15:47:55.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.892+0000 7fb0ebe00640 1 --2- 172.21.15.17:0/1627738093 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb0d8038710 0x7fb0d803abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.893+0000 7fb0ebe00640 1 --2- 172.21.15.17:0/1627738093 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb0d8038710 0x7fb0d803abd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0098c0 tx=0x7fb0dc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:55.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:55.897+0000 7fb0eb400640 1 -- 172.21.15.17:0/1627738093 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb0e40443b0 con 0x7fb0f40744e0 2024-09-13T15:47:56.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:56.080+0000 7fb0f3e00640 1 -- 172.21.15.17:0/1627738093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fb0f4190540 con 0x7fb0f40744e0 2024-09-13T15:47:56.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:56.083+0000 7fb0eb400640 1 -- 172.21.15.17:0/1627738093 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fb0e4035020 con 0x7fb0f40744e0 2024-09-13T15:47:56.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:56.086+0000 7fb0f3e00640 1 -- 172.21.15.17:0/1627738093 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb0d8038710 msgr2=0x7fb0d803abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:56.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:56.086+0000 7fb0f3e00640 1 --2- 172.21.15.17:0/1627738093 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb0d8038710 0x7fb0d803abd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0098c0 tx=0x7fb0dc006db0 comp rx=0 tx=0).stop 2024-09-13T15:47:56.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:56.086+0000 7fb0f3e00640 1 -- 172.21.15.17:0/1627738093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f40744e0 msgr2=0x7fb0f4196c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:56.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:56.086+0000 7fb0f3e00640 1 --2- 172.21.15.17:0/1627738093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f40744e0 0x7fb0f4196c50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4005ab0 tx=0x7fb0e4005160 comp rx=0 tx=0).stop 2024-09-13T15:47:56.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:56.086+0000 7fb0f3e00640 1 -- 172.21.15.17:0/1627738093 shutdown_connections 2024-09-13T15:47:56.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:56.086+0000 7fb0f3e00640 1 --2- 172.21.15.17:0/1627738093 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb0d8038710 0x7fb0d803abd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:56.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:56.086+0000 7fb0f3e00640 1 --2- 172.21.15.17:0/1627738093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f40744e0 0x7fb0f4196c50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:56.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:56.086+0000 7fb0f3e00640 1 -- 172.21.15.17:0/1627738093 >> 172.21.15.17:0/1627738093 conn(0x7fb0f40fadb0 msgr2=0x7fb0f40fb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:56.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:56.087+0000 7fb0f3e00640 1 -- 172.21.15.17:0/1627738093 shutdown_connections 2024-09-13T15:47:56.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:56.087+0000 7fb0f3e00640 1 -- 172.21.15.17:0/1627738093 wait complete. 2024-09-13T15:47:56.869 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-13T15:47:56.869 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-13T15:47:57.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:57 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1627738093' entity='client.admin' 2024-09-13T15:47:57.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:57 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:47:57.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:47:57 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:47:57.564 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:47:59.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.307+0000 7f1707200640 1 -- 172.21.15.17:0/593415305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1708102f30 msgr2=0x7f1708103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:59.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.307+0000 7f1707200640 1 --2- 172.21.15.17:0/593415305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1708102f30 0x7f1708103330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009c20 tx=0x7f16f802aa90 comp rx=0 tx=0).stop 2024-09-13T15:47:59.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.307+0000 7f1707200640 1 -- 172.21.15.17:0/593415305 shutdown_connections 2024-09-13T15:47:59.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.307+0000 7f1707200640 1 --2- 172.21.15.17:0/593415305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1708102f30 0x7f1708103330 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:59.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.307+0000 7f1707200640 1 -- 172.21.15.17:0/593415305 >> 172.21.15.17:0/593415305 conn(0x7f17080fd030 msgr2=0x7f17080ff420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:59.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.307+0000 7f1707200640 1 -- 172.21.15.17:0/593415305 shutdown_connections 2024-09-13T15:47:59.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.307+0000 7f1707200640 1 -- 172.21.15.17:0/593415305 wait complete. 2024-09-13T15:47:59.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.308+0000 7f1707200640 1 Processor -- start 2024-09-13T15:47:59.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.308+0000 7f1707200640 1 -- start start 2024-09-13T15:47:59.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.308+0000 7f1707200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1708102f30 0x7f1708196de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:59.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.308+0000 7f1707200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1708197320 con 0x7f1708102f30 2024-09-13T15:47:59.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.308+0000 7f1705e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1708102f30 0x7f1708196de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:59.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.308+0000 7f1705e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1708102f30 0x7f1708196de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32902/0 (socket says 172.21.15.17:32902) 2024-09-13T15:47:59.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.308+0000 7f1705e00640 1 -- 172.21.15.17:0/1948024783 learned_addr learned my addr 172.21.15.17:0/1948024783 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:47:59.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.309+0000 7f1705e00640 1 -- 172.21.15.17:0/1948024783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f8009900 con 0x7f1708102f30 2024-09-13T15:47:59.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.309+0000 7f1705e00640 1 --2- 172.21.15.17:0/1948024783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1708102f30 0x7f1708196de0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f16f802e5f0 tx=0x7f16f802e620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:59.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.309+0000 7f16ff400640 1 -- 172.21.15.17:0/1948024783 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f16f803e070 con 0x7f1708102f30 2024-09-13T15:47:59.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.309+0000 7f1707200640 1 -- 172.21.15.17:0/1948024783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1708197520 con 0x7f1708102f30 2024-09-13T15:47:59.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.309+0000 7f16ff400640 1 -- 172.21.15.17:0/1948024783 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16f8004040 con 0x7f1708102f30 2024-09-13T15:47:59.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.309+0000 7f16ff400640 1 -- 172.21.15.17:0/1948024783 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f16f8043470 con 0x7f1708102f30 2024-09-13T15:47:59.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.310+0000 7f1707200640 1 -- 172.21.15.17:0/1948024783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17081979c0 con 0x7f1708102f30 2024-09-13T15:47:59.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.311+0000 7f16ff400640 1 -- 172.21.15.17:0/1948024783 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f16f800a040 con 0x7f1708102f30 2024-09-13T15:47:59.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.311+0000 7f1707200640 1 -- 172.21.15.17:0/1948024783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17081033b0 con 0x7f1708102f30 2024-09-13T15:47:59.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.311+0000 7f16ff400640 1 --2- 172.21.15.17:0/1948024783 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f16ec0386d0 0x7f16ec03ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:47:59.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.311+0000 7f16ff400640 1 -- 172.21.15.17:0/1948024783 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f16f806c930 con 0x7f1708102f30 2024-09-13T15:47:59.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.312+0000 7f16fd400640 1 --2- 172.21.15.17:0/1948024783 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f16ec0386d0 0x7f16ec03ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:47:59.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.312+0000 7f16fd400640 1 --2- 172.21.15.17:0/1948024783 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f16ec0386d0 0x7f16ec03ab90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f16f00098c0 tx=0x7f16f0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:47:59.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.316+0000 7f16ff400640 1 -- 172.21.15.17:0/1948024783 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f16f80041b0 con 0x7f1708102f30 2024-09-13T15:47:59.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.500+0000 7f1707200640 1 -- 172.21.15.17:0/1948024783 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f17080608f0 con 0x7f16ec0386d0 2024-09-13T15:47:59.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.504+0000 7f16ff400640 1 -- 172.21.15.17:0/1948024783 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f17080608f0 con 0x7f16ec0386d0 2024-09-13T15:47:59.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.506+0000 7f1707200640 1 -- 172.21.15.17:0/1948024783 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f16ec0386d0 msgr2=0x7f16ec03ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:59.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.506+0000 7f1707200640 1 --2- 172.21.15.17:0/1948024783 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f16ec0386d0 0x7f16ec03ab90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f16f00098c0 tx=0x7f16f0006db0 comp rx=0 tx=0).stop 2024-09-13T15:47:59.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.506+0000 7f1707200640 1 -- 172.21.15.17:0/1948024783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1708102f30 msgr2=0x7f1708196de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:47:59.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.506+0000 7f1707200640 1 --2- 172.21.15.17:0/1948024783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1708102f30 0x7f1708196de0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f16f802e5f0 tx=0x7f16f802e620 comp rx=0 tx=0).stop 2024-09-13T15:47:59.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.507+0000 7f1707200640 1 -- 172.21.15.17:0/1948024783 shutdown_connections 2024-09-13T15:47:59.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.507+0000 7f1707200640 1 --2- 172.21.15.17:0/1948024783 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f16ec0386d0 0x7f16ec03ab90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:59.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.507+0000 7f1707200640 1 --2- 172.21.15.17:0/1948024783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1708102f30 0x7f1708196de0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:47:59.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.507+0000 7f1707200640 1 -- 172.21.15.17:0/1948024783 >> 172.21.15.17:0/1948024783 conn(0x7f17080fd030 msgr2=0x7f17080fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:47:59.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.507+0000 7f1707200640 1 -- 172.21.15.17:0/1948024783 shutdown_connections 2024-09-13T15:47:59.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:47:59.507+0000 7f1707200640 1 -- 172.21.15.17:0/1948024783 wait complete. 2024-09-13T15:48:00.294 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi189 2024-09-13T15:48:00.294 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-13T15:48:00.294 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/etc/ceph/ceph.conf 2024-09-13T15:48:00.313 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-13T15:48:00.313 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T15:48:00.372 INFO:tasks.cephadm:Adding host smithi189 to orchestrator... 2024-09-13T15:48:00.372 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph orch host add smithi189 2024-09-13T15:48:00.694 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:48:00.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:00 smithi017 ceph-mon[30494]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:48:00.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:00.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:48:00.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:00.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:48:00.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:00 smithi017 ceph-mon[30494]: Updating smithi017:/etc/ceph/ceph.conf 2024-09-13T15:48:00.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:00 smithi017 ceph-mon[30494]: Updating smithi017:/var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T15:48:01.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:01 smithi017 ceph-mon[30494]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2024-09-13T15:48:01.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:01 smithi017 ceph-mon[30494]: Updating smithi017:/var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T15:48:01.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:01 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:01.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:01 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:01.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:01 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:02.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.568+0000 7f2d0b200640 1 -- 172.21.15.17:0/258044585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d0c107790 msgr2=0x7f2d0c107b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:02.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.568+0000 7f2d0b200640 1 --2- 172.21.15.17:0/258044585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d0c107790 0x7f2d0c107b70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc009880 tx=0x7f2cfc02a5d0 comp rx=0 tx=0).stop 2024-09-13T15:48:02.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.569+0000 7f2d0b200640 1 -- 172.21.15.17:0/258044585 shutdown_connections 2024-09-13T15:48:02.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.569+0000 7f2d0b200640 1 --2- 172.21.15.17:0/258044585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d0c107790 0x7f2d0c107b70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:02.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.569+0000 7f2d0b200640 1 -- 172.21.15.17:0/258044585 >> 172.21.15.17:0/258044585 conn(0x7f2d0c0fd490 msgr2=0x7f2d0c0ff8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:48:02.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.569+0000 7f2d0b200640 1 -- 172.21.15.17:0/258044585 shutdown_connections 2024-09-13T15:48:02.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.569+0000 7f2d0b200640 1 -- 172.21.15.17:0/258044585 wait complete. 2024-09-13T15:48:02.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.570+0000 7f2d0b200640 1 Processor -- start 2024-09-13T15:48:02.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.570+0000 7f2d0b200640 1 -- start start 2024-09-13T15:48:02.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.570+0000 7f2d0b200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d0c107790 0x7f2d0c196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:02.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.570+0000 7f2d0b200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c1974a0 con 0x7f2d0c107790 2024-09-13T15:48:02.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.571+0000 7f2d09e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d0c107790 0x7f2d0c196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:02.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.571+0000 7f2d09e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d0c107790 0x7f2d0c196f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32920/0 (socket says 172.21.15.17:32920) 2024-09-13T15:48:02.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.571+0000 7f2d09e00640 1 -- 172.21.15.17:0/2124206524 learned_addr learned my addr 172.21.15.17:0/2124206524 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:48:02.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.571+0000 7f2d09e00640 1 -- 172.21.15.17:0/2124206524 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc009560 con 0x7f2d0c107790 2024-09-13T15:48:02.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.571+0000 7f2d09e00640 1 --2- 172.21.15.17:0/2124206524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d0c107790 0x7f2d0c196f60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc009230 tx=0x7f2cfc004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:48:02.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.571+0000 7f2d02a00640 1 -- 172.21.15.17:0/2124206524 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cfc0054d0 con 0x7f2d0c107790 2024-09-13T15:48:02.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.571+0000 7f2d0b200640 1 -- 172.21.15.17:0/2124206524 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0c197700 con 0x7f2d0c107790 2024-09-13T15:48:02.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.572+0000 7f2d02a00640 1 -- 172.21.15.17:0/2124206524 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cfc003ab0 con 0x7f2d0c107790 2024-09-13T15:48:02.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.572+0000 7f2d02a00640 1 -- 172.21.15.17:0/2124206524 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cfc03c940 con 0x7f2d0c107790 2024-09-13T15:48:02.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.572+0000 7f2d0b200640 1 -- 172.21.15.17:0/2124206524 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0c197b80 con 0x7f2d0c107790 2024-09-13T15:48:02.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.573+0000 7f2d02a00640 1 -- 172.21.15.17:0/2124206524 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f2cfc003c20 con 0x7f2d0c107790 2024-09-13T15:48:02.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.573+0000 7f2d0b200640 1 -- 172.21.15.17:0/2124206524 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0c102ed0 con 0x7f2d0c107790 2024-09-13T15:48:02.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.573+0000 7f2d02a00640 1 --2- 172.21.15.17:0/2124206524 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2cf0038760 0x7f2cf003ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:02.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.573+0000 7f2d02a00640 1 -- 172.21.15.17:0/2124206524 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2cfc06c410 con 0x7f2d0c107790 2024-09-13T15:48:02.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.573+0000 7f2d03e00640 1 --2- 172.21.15.17:0/2124206524 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2cf0038760 0x7f2cf003ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:02.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.574+0000 7f2d03e00640 1 --2- 172.21.15.17:0/2124206524 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2cf0038760 0x7f2cf003ac20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2cf40098c0 tx=0x7f2cf4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:48:02.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.579+0000 7f2d02a00640 1 -- 172.21.15.17:0/2124206524 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2cfc04d530 con 0x7f2d0c107790 2024-09-13T15:48:02.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:02 smithi017 ceph-mon[30494]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:02.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:02.764+0000 7f2d0b200640 1 -- 172.21.15.17:0/2124206524 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi189", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d0c10bb70 con 0x7f2cf0038760 2024-09-13T15:48:03.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:03 smithi017 ceph-mon[30494]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi189", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:48:05.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:04 smithi017 ceph-mon[30494]: Deploying cephadm binary to smithi189 2024-09-13T15:48:05.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:04 smithi017 ceph-mon[30494]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:06.121 INFO:teuthology.orchestra.run.smithi017.stdout:Added host 'smithi189' with addr '172.21.15.189' 2024-09-13T15:48:06.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:06.119+0000 7f2d02a00640 1 -- 172.21.15.17:0/2124206524 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f2d0c10bb70 con 0x7f2cf0038760 2024-09-13T15:48:06.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:06.121+0000 7f2d0b200640 1 -- 172.21.15.17:0/2124206524 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2cf0038760 msgr2=0x7f2cf003ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:06.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:06.121+0000 7f2d0b200640 1 --2- 172.21.15.17:0/2124206524 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2cf0038760 0x7f2cf003ac20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2cf40098c0 tx=0x7f2cf4006db0 comp rx=0 tx=0).stop 2024-09-13T15:48:06.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:06.121+0000 7f2d0b200640 1 -- 172.21.15.17:0/2124206524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d0c107790 msgr2=0x7f2d0c196f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:06.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:06.121+0000 7f2d0b200640 1 --2- 172.21.15.17:0/2124206524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d0c107790 0x7f2d0c196f60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc009230 tx=0x7f2cfc004e50 comp rx=0 tx=0).stop 2024-09-13T15:48:06.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:06.122+0000 7f2d0b200640 1 -- 172.21.15.17:0/2124206524 shutdown_connections 2024-09-13T15:48:06.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:06.122+0000 7f2d0b200640 1 --2- 172.21.15.17:0/2124206524 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2cf0038760 0x7f2cf003ac20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:06.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:06.122+0000 7f2d0b200640 1 --2- 172.21.15.17:0/2124206524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d0c107790 0x7f2d0c196f60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:06.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:06.122+0000 7f2d0b200640 1 -- 172.21.15.17:0/2124206524 >> 172.21.15.17:0/2124206524 conn(0x7f2d0c0fd490 msgr2=0x7f2d0c0fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:48:06.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:06.122+0000 7f2d0b200640 1 -- 172.21.15.17:0/2124206524 shutdown_connections 2024-09-13T15:48:06.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:06.122+0000 7f2d0b200640 1 -- 172.21.15.17:0/2124206524 wait complete. 2024-09-13T15:48:06.798 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T15:48:07.107 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:48:07.383 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:07 smithi017 ceph-mon[30494]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:07.383 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:07 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:07.383 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:07 smithi017 ceph-mon[30494]: Added host smithi189 2024-09-13T15:48:07.383 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:07 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:48:07.383 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:07 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:07.383 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:07 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:08.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:08 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:08.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:08 smithi017 ceph-mon[30494]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:08.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.795+0000 7f7dd9800640 1 -- 172.21.15.17:0/1167893536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dd4107990 msgr2=0x7f7dd4107d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:08.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.795+0000 7f7dd9800640 1 --2- 172.21.15.17:0/1167893536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dd4107990 0x7f7dd4107d70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009880 tx=0x7f7dc402a5d0 comp rx=0 tx=0).stop 2024-09-13T15:48:08.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.796+0000 7f7dd9800640 1 -- 172.21.15.17:0/1167893536 shutdown_connections 2024-09-13T15:48:08.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.796+0000 7f7dd9800640 1 --2- 172.21.15.17:0/1167893536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dd4107990 0x7f7dd4107d70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:08.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.796+0000 7f7dd9800640 1 -- 172.21.15.17:0/1167893536 >> 172.21.15.17:0/1167893536 conn(0x7f7dd40fd670 msgr2=0x7f7dd40ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:48:08.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.796+0000 7f7dd9800640 1 -- 172.21.15.17:0/1167893536 shutdown_connections 2024-09-13T15:48:08.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.796+0000 7f7dd9800640 1 -- 172.21.15.17:0/1167893536 wait complete. 2024-09-13T15:48:08.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.797+0000 7f7dd9800640 1 Processor -- start 2024-09-13T15:48:08.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.797+0000 7f7dd9800640 1 -- start start 2024-09-13T15:48:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.797+0000 7f7dd9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dd4107990 0x7f7dd41971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.797+0000 7f7dd9800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd41976e0 con 0x7f7dd4107990 2024-09-13T15:48:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.797+0000 7f7dd2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dd4107990 0x7f7dd41971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.797+0000 7f7dd2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dd4107990 0x7f7dd41971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32940/0 (socket says 172.21.15.17:32940) 2024-09-13T15:48:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.797+0000 7f7dd2a00640 1 -- 172.21.15.17:0/2105182797 learned_addr learned my addr 172.21.15.17:0/2105182797 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:48:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.798+0000 7f7dd2a00640 1 -- 172.21.15.17:0/2105182797 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc4009560 con 0x7f7dd4107990 2024-09-13T15:48:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.798+0000 7f7dd2a00640 1 --2- 172.21.15.17:0/2105182797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dd4107990 0x7f7dd41971a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009230 tx=0x7f7dc4004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:48:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.798+0000 7f7dcbe00640 1 -- 172.21.15.17:0/2105182797 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7dc40054d0 con 0x7f7dd4107990 2024-09-13T15:48:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.798+0000 7f7dcbe00640 1 -- 172.21.15.17:0/2105182797 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7dc4003ab0 con 0x7f7dd4107990 2024-09-13T15:48:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.799+0000 7f7dd9800640 1 -- 172.21.15.17:0/2105182797 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd4197940 con 0x7f7dd4107990 2024-09-13T15:48:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.799+0000 7f7dcbe00640 1 -- 172.21.15.17:0/2105182797 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7dc403c940 con 0x7f7dd4107990 2024-09-13T15:48:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.799+0000 7f7dd9800640 1 -- 172.21.15.17:0/2105182797 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd4197dc0 con 0x7f7dd4107990 2024-09-13T15:48:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.800+0000 7f7dcbe00640 1 -- 172.21.15.17:0/2105182797 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f7dc403cbb0 con 0x7f7dd4107990 2024-09-13T15:48:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.800+0000 7f7dd9800640 1 -- 172.21.15.17:0/2105182797 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd41030d0 con 0x7f7dd4107990 2024-09-13T15:48:08.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.800+0000 7f7dcbe00640 1 --2- 172.21.15.17:0/2105182797 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7db8038710 0x7f7db803abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:08.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.800+0000 7f7dcbe00640 1 -- 172.21.15.17:0/2105182797 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7dc406c420 con 0x7f7dd4107990 2024-09-13T15:48:08.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.801+0000 7f7dca000640 1 --2- 172.21.15.17:0/2105182797 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7db8038710 0x7f7db803abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:08.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.801+0000 7f7dca000640 1 --2- 172.21.15.17:0/2105182797 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7db8038710 0x7f7db803abd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0098c0 tx=0x7f7dbc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:48:08.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.805+0000 7f7dcbe00640 1 -- 172.21.15.17:0/2105182797 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7dc403acf0 con 0x7f7dd4107990 2024-09-13T15:48:08.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.990+0000 7f7dd9800640 1 -- 172.21.15.17:0/2105182797 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7dd410bd00 con 0x7f7db8038710 2024-09-13T15:48:08.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.991+0000 7f7dcbe00640 1 -- 172.21.15.17:0/2105182797 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f7dd410bd00 con 0x7f7db8038710 2024-09-13T15:48:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:48:08.993 INFO:teuthology.orchestra.run.smithi017.stdout:[{"addr": "172.21.15.17", "hostname": "smithi017", "labels": [], "status": ""}, {"addr": "172.21.15.189", "hostname": "smithi189", "labels": [], "status": ""}] 2024-09-13T15:48:08.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.993+0000 7f7dd9800640 1 -- 172.21.15.17:0/2105182797 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7db8038710 msgr2=0x7f7db803abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:08.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.993+0000 7f7dd9800640 1 --2- 172.21.15.17:0/2105182797 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7db8038710 0x7f7db803abd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0098c0 tx=0x7f7dbc006db0 comp rx=0 tx=0).stop 2024-09-13T15:48:08.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.993+0000 7f7dd9800640 1 -- 172.21.15.17:0/2105182797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dd4107990 msgr2=0x7f7dd41971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:08.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.993+0000 7f7dd9800640 1 --2- 172.21.15.17:0/2105182797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dd4107990 0x7f7dd41971a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009230 tx=0x7f7dc4004e50 comp rx=0 tx=0).stop 2024-09-13T15:48:08.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.993+0000 7f7dd9800640 1 -- 172.21.15.17:0/2105182797 shutdown_connections 2024-09-13T15:48:08.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.993+0000 7f7dd9800640 1 --2- 172.21.15.17:0/2105182797 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7db8038710 0x7f7db803abd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:08.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.993+0000 7f7dd9800640 1 --2- 172.21.15.17:0/2105182797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dd4107990 0x7f7dd41971a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:08.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.993+0000 7f7dd9800640 1 -- 172.21.15.17:0/2105182797 >> 172.21.15.17:0/2105182797 conn(0x7f7dd40fd670 msgr2=0x7f7dd40fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:48:08.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.993+0000 7f7dd9800640 1 -- 172.21.15.17:0/2105182797 shutdown_connections 2024-09-13T15:48:08.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:08.993+0000 7f7dd9800640 1 -- 172.21.15.17:0/2105182797 wait complete. 2024-09-13T15:48:09.630 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:09 smithi017 ceph-mon[30494]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T15:48:09.659 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi193 2024-09-13T15:48:09.659 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-13T15:48:09.659 DEBUG:teuthology.orchestra.run.smithi193:> dd of=/etc/ceph/ceph.conf 2024-09-13T15:48:09.679 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-13T15:48:09.679 DEBUG:teuthology.orchestra.run.smithi193:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T15:48:09.737 INFO:tasks.cephadm:Adding host smithi193 to orchestrator... 2024-09-13T15:48:09.737 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph orch host add smithi193 2024-09-13T15:48:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:48:10.483 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:10 smithi017 ceph-mon[30494]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:10.483 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:10 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:10.483 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:10 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:10.483 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:10 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:10.483 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:10 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:10.483 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:10 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi189", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:48:10.484 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:10 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:10.484 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:10 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:48:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.901+0000 7f1efd200640 1 -- 172.21.15.17:0/2544746759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ef8105660 msgr2=0x7f1ef8105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.901+0000 7f1efd200640 1 --2- 172.21.15.17:0/2544746759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ef8105660 0x7f1ef8105a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009880 tx=0x7f1ee802a5d0 comp rx=0 tx=0).stop 2024-09-13T15:48:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.901+0000 7f1efd200640 1 -- 172.21.15.17:0/2544746759 shutdown_connections 2024-09-13T15:48:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.901+0000 7f1efd200640 1 --2- 172.21.15.17:0/2544746759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ef8105660 0x7f1ef8105a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.901+0000 7f1efd200640 1 -- 172.21.15.17:0/2544746759 >> 172.21.15.17:0/2544746759 conn(0x7f1ef80fb250 msgr2=0x7f1ef80fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:48:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.901+0000 7f1efd200640 1 -- 172.21.15.17:0/2544746759 shutdown_connections 2024-09-13T15:48:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.901+0000 7f1efd200640 1 -- 172.21.15.17:0/2544746759 wait complete. 2024-09-13T15:48:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.902+0000 7f1efd200640 1 Processor -- start 2024-09-13T15:48:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.902+0000 7f1efd200640 1 -- start start 2024-09-13T15:48:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.902+0000 7f1efd200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ef8105660 0x7f1ef80727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.902+0000 7f1efd200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef80746c0 con 0x7f1ef8105660 2024-09-13T15:48:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.902+0000 7f1ef7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ef8105660 0x7f1ef80727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.902+0000 7f1ef7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ef8105660 0x7f1ef80727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35988/0 (socket says 172.21.15.17:35988) 2024-09-13T15:48:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.902+0000 7f1ef7400640 1 -- 172.21.15.17:0/2540276351 learned_addr learned my addr 172.21.15.17:0/2540276351 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:48:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.903+0000 7f1ef7400640 1 -- 172.21.15.17:0/2540276351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee8009560 con 0x7f1ef8105660 2024-09-13T15:48:11.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.903+0000 7f1ef7400640 1 --2- 172.21.15.17:0/2540276351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ef8105660 0x7f1ef80727b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009230 tx=0x7f1ee8004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:48:11.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.903+0000 7f1eefe00640 1 -- 172.21.15.17:0/2540276351 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ee80054d0 con 0x7f1ef8105660 2024-09-13T15:48:11.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.903+0000 7f1eefe00640 1 -- 172.21.15.17:0/2540276351 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ee8003ab0 con 0x7f1ef8105660 2024-09-13T15:48:11.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.903+0000 7f1eefe00640 1 -- 172.21.15.17:0/2540276351 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ee803c940 con 0x7f1ef8105660 2024-09-13T15:48:11.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.903+0000 7f1efd200640 1 -- 172.21.15.17:0/2540276351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef8072cf0 con 0x7f1ef8105660 2024-09-13T15:48:11.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.904+0000 7f1efd200640 1 -- 172.21.15.17:0/2540276351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef80731f0 con 0x7f1ef8105660 2024-09-13T15:48:11.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.904+0000 7f1eefe00640 1 -- 172.21.15.17:0/2540276351 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f1ee8003c20 con 0x7f1ef8105660 2024-09-13T15:48:11.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.905+0000 7f1efd200640 1 -- 172.21.15.17:0/2540276351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef8100d10 con 0x7f1ef8105660 2024-09-13T15:48:11.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.905+0000 7f1eefe00640 1 --2- 172.21.15.17:0/2540276351 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1edc038760 0x7f1edc03ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:11.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.905+0000 7f1eefe00640 1 -- 172.21.15.17:0/2540276351 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1ee806c420 con 0x7f1ef8105660 2024-09-13T15:48:11.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.905+0000 7f1ef6a00640 1 --2- 172.21.15.17:0/2540276351 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1edc038760 0x7f1edc03ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:11.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.906+0000 7f1ef6a00640 1 --2- 172.21.15.17:0/2540276351 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1edc038760 0x7f1edc03ac20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40098c0 tx=0x7f1ee4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:48:11.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:11.910+0000 7f1eefe00640 1 -- 172.21.15.17:0/2540276351 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1ee804d530 con 0x7f1ef8105660 2024-09-13T15:48:12.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:12.101+0000 7f1efd200640 1 -- 172.21.15.17:0/2540276351 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi193", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ef80734a0 con 0x7f1edc038760 2024-09-13T15:48:12.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:12 smithi017 ceph-mon[30494]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-13T15:48:12.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:12 smithi017 ceph-mon[30494]: Updating smithi189:/var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T15:48:12.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:12 smithi017 ceph-mon[30494]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-13T15:48:12.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:12 smithi017 ceph-mon[30494]: Updating smithi189:/var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T15:48:12.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:12 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:12.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:12 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:12.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:12 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:13 smithi017 ceph-mon[30494]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:13 smithi017 ceph-mon[30494]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi193", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:48:15.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:15.351+0000 7f1eefe00640 1 -- 172.21.15.17:0/2540276351 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f1ef80734a0 con 0x7f1edc038760 2024-09-13T15:48:15.353 INFO:teuthology.orchestra.run.smithi017.stdout:Added host 'smithi193' with addr '172.21.15.193' 2024-09-13T15:48:15.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:15.353+0000 7f1efd200640 1 -- 172.21.15.17:0/2540276351 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1edc038760 msgr2=0x7f1edc03ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:15.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:15.353+0000 7f1efd200640 1 --2- 172.21.15.17:0/2540276351 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1edc038760 0x7f1edc03ac20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40098c0 tx=0x7f1ee4006db0 comp rx=0 tx=0).stop 2024-09-13T15:48:15.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:15.353+0000 7f1efd200640 1 -- 172.21.15.17:0/2540276351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ef8105660 msgr2=0x7f1ef80727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:15.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:15.353+0000 7f1efd200640 1 --2- 172.21.15.17:0/2540276351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ef8105660 0x7f1ef80727b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009230 tx=0x7f1ee8004e50 comp rx=0 tx=0).stop 2024-09-13T15:48:15.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:15.353+0000 7f1efd200640 1 -- 172.21.15.17:0/2540276351 shutdown_connections 2024-09-13T15:48:15.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:15.353+0000 7f1efd200640 1 --2- 172.21.15.17:0/2540276351 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1edc038760 0x7f1edc03ac20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:15.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:15.353+0000 7f1efd200640 1 --2- 172.21.15.17:0/2540276351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ef8105660 0x7f1ef80727b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:15.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:15.353+0000 7f1efd200640 1 -- 172.21.15.17:0/2540276351 >> 172.21.15.17:0/2540276351 conn(0x7f1ef80fb250 msgr2=0x7f1ef80fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:48:15.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:15.354+0000 7f1efd200640 1 -- 172.21.15.17:0/2540276351 shutdown_connections 2024-09-13T15:48:15.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:15.354+0000 7f1efd200640 1 -- 172.21.15.17:0/2540276351 wait complete. 2024-09-13T15:48:15.369 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:15 smithi017 ceph-mon[30494]: Deploying cephadm binary to smithi193 2024-09-13T15:48:15.369 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:15 smithi017 ceph-mon[30494]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:16.165 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T15:48:16.473 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:48:16.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:16.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:16 smithi017 ceph-mon[30494]: Added host smithi193 2024-09-13T15:48:16.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:48:16.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:16.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:16.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:16 smithi017 ceph-mon[30494]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:17.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:17 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:18.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.197+0000 7fed36400640 1 -- 172.21.15.17:0/3684857623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed30107990 msgr2=0x7fed30107d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:18.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.197+0000 7fed36400640 1 --2- 172.21.15.17:0/3684857623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed30107990 0x7fed30107d70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fed20009880 tx=0x7fed2002a5d0 comp rx=0 tx=0).stop 2024-09-13T15:48:18.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.197+0000 7fed36400640 1 -- 172.21.15.17:0/3684857623 shutdown_connections 2024-09-13T15:48:18.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.197+0000 7fed36400640 1 --2- 172.21.15.17:0/3684857623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed30107990 0x7fed30107d70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:18.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.197+0000 7fed36400640 1 -- 172.21.15.17:0/3684857623 >> 172.21.15.17:0/3684857623 conn(0x7fed300fd670 msgr2=0x7fed300ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:48:18.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.197+0000 7fed36400640 1 -- 172.21.15.17:0/3684857623 shutdown_connections 2024-09-13T15:48:18.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.197+0000 7fed36400640 1 -- 172.21.15.17:0/3684857623 wait complete. 2024-09-13T15:48:18.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.198+0000 7fed36400640 1 Processor -- start 2024-09-13T15:48:18.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.198+0000 7fed36400640 1 -- start start 2024-09-13T15:48:18.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.198+0000 7fed36400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed30107990 0x7fed301971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:18.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.198+0000 7fed36400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed301976e0 con 0x7fed30107990 2024-09-13T15:48:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.199+0000 7fed2f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed30107990 0x7fed301971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.199+0000 7fed2f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed30107990 0x7fed301971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36020/0 (socket says 172.21.15.17:36020) 2024-09-13T15:48:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.199+0000 7fed2f400640 1 -- 172.21.15.17:0/2141788674 learned_addr learned my addr 172.21.15.17:0/2141788674 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:48:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.199+0000 7fed2f400640 1 -- 172.21.15.17:0/2141788674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed20009560 con 0x7fed30107990 2024-09-13T15:48:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.199+0000 7fed2f400640 1 --2- 172.21.15.17:0/2141788674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed30107990 0x7fed301971a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fed20009230 tx=0x7fed20004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:48:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.199+0000 7fed2cc00640 1 -- 172.21.15.17:0/2141788674 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed200054d0 con 0x7fed30107990 2024-09-13T15:48:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.200+0000 7fed2cc00640 1 -- 172.21.15.17:0/2141788674 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fed20003ab0 con 0x7fed30107990 2024-09-13T15:48:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.200+0000 7fed2cc00640 1 -- 172.21.15.17:0/2141788674 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed2003c940 con 0x7fed30107990 2024-09-13T15:48:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.200+0000 7fed36400640 1 -- 172.21.15.17:0/2141788674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed30197940 con 0x7fed30107990 2024-09-13T15:48:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.200+0000 7fed36400640 1 -- 172.21.15.17:0/2141788674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed30197dc0 con 0x7fed30107990 2024-09-13T15:48:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.201+0000 7fed2cc00640 1 -- 172.21.15.17:0/2141788674 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fed20003c20 con 0x7fed30107990 2024-09-13T15:48:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.201+0000 7fed36400640 1 -- 172.21.15.17:0/2141788674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed301030d0 con 0x7fed30107990 2024-09-13T15:48:18.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.201+0000 7fed2cc00640 1 --2- 172.21.15.17:0/2141788674 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fed14038760 0x7fed1403ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:18.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.201+0000 7fed2cc00640 1 -- 172.21.15.17:0/2141788674 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fed2006c420 con 0x7fed30107990 2024-09-13T15:48:18.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.202+0000 7fed26a00640 1 --2- 172.21.15.17:0/2141788674 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fed14038760 0x7fed1403ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:18.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.202+0000 7fed26a00640 1 --2- 172.21.15.17:0/2141788674 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fed14038760 0x7fed1403ac20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fed180098c0 tx=0x7fed18006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:48:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.206+0000 7fed2cc00640 1 -- 172.21.15.17:0/2141788674 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fed2004d530 con 0x7fed30107990 2024-09-13T15:48:18.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.392+0000 7fed36400640 1 -- 172.21.15.17:0/2141788674 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed3010bd70 con 0x7fed14038760 2024-09-13T15:48:18.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.394+0000 7fed2cc00640 1 -- 172.21.15.17:0/2141788674 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+240 (secure 0 0 0) 0x7fed3010bd70 con 0x7fed14038760 2024-09-13T15:48:18.396 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:48:18.396 INFO:teuthology.orchestra.run.smithi017.stdout:[{"addr": "172.21.15.17", "hostname": "smithi017", "labels": [], "status": ""}, {"addr": "172.21.15.189", "hostname": "smithi189", "labels": [], "status": ""}, {"addr": "172.21.15.193", "hostname": "smithi193", "labels": [], "status": ""}] 2024-09-13T15:48:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.396+0000 7fed36400640 1 -- 172.21.15.17:0/2141788674 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fed14038760 msgr2=0x7fed1403ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.396+0000 7fed36400640 1 --2- 172.21.15.17:0/2141788674 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fed14038760 0x7fed1403ac20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fed180098c0 tx=0x7fed18006db0 comp rx=0 tx=0).stop 2024-09-13T15:48:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.396+0000 7fed36400640 1 -- 172.21.15.17:0/2141788674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed30107990 msgr2=0x7fed301971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.396+0000 7fed36400640 1 --2- 172.21.15.17:0/2141788674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed30107990 0x7fed301971a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fed20009230 tx=0x7fed20004e50 comp rx=0 tx=0).stop 2024-09-13T15:48:18.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.396+0000 7fed36400640 1 -- 172.21.15.17:0/2141788674 shutdown_connections 2024-09-13T15:48:18.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.396+0000 7fed36400640 1 --2- 172.21.15.17:0/2141788674 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fed14038760 0x7fed1403ac20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:18.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.396+0000 7fed36400640 1 --2- 172.21.15.17:0/2141788674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed30107990 0x7fed301971a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:18.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.396+0000 7fed36400640 1 -- 172.21.15.17:0/2141788674 >> 172.21.15.17:0/2141788674 conn(0x7fed300fd670 msgr2=0x7fed300fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:48:18.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.396+0000 7fed36400640 1 -- 172.21.15.17:0/2141788674 shutdown_connections 2024-09-13T15:48:18.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:18.397+0000 7fed36400640 1 -- 172.21.15.17:0/2141788674 wait complete. 2024-09-13T15:48:18.989 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:18 smithi017 ceph-mon[30494]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:19.032 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-13T15:48:19.033 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-13T15:48:19.347 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:48:19.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:19 smithi017 ceph-mon[30494]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T15:48:19.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:19 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:19.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:19 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:19.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:19 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:19.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:19 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:19.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:19 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi193", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:48:19.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:19 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:19.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:19 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:48:20.921 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:20 smithi017 ceph-mon[30494]: Updating smithi193:/etc/ceph/ceph.conf 2024-09-13T15:48:20.921 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:20 smithi017 ceph-mon[30494]: Updating smithi193:/var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T15:48:20.921 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:20 smithi017 ceph-mon[30494]: Updating smithi193:/etc/ceph/ceph.client.admin.keyring 2024-09-13T15:48:20.921 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:20 smithi017 ceph-mon[30494]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:20.921 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:20 smithi017 ceph-mon[30494]: Updating smithi193:/var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T15:48:20.921 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:20 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:20.921 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:20 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:20.921 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:20 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:21.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.177+0000 7f0a20000640 1 -- 172.21.15.17:0/1036184919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a18106540 msgr2=0x7f0a18106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:21.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.177+0000 7f0a20000640 1 --2- 172.21.15.17:0/1036184919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a18106540 0x7f0a18106920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009880 tx=0x7f0a0c02a5d0 comp rx=0 tx=0).stop 2024-09-13T15:48:21.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.177+0000 7f0a20000640 1 -- 172.21.15.17:0/1036184919 shutdown_connections 2024-09-13T15:48:21.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.177+0000 7f0a20000640 1 --2- 172.21.15.17:0/1036184919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a18106540 0x7f0a18106920 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:21.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.177+0000 7f0a20000640 1 -- 172.21.15.17:0/1036184919 >> 172.21.15.17:0/1036184919 conn(0x7f0a180784f0 msgr2=0x7f0a180747f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:48:21.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.177+0000 7f0a20000640 1 -- 172.21.15.17:0/1036184919 shutdown_connections 2024-09-13T15:48:21.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.177+0000 7f0a20000640 1 -- 172.21.15.17:0/1036184919 wait complete. 2024-09-13T15:48:21.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.178+0000 7f0a20000640 1 Processor -- start 2024-09-13T15:48:21.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.178+0000 7f0a20000640 1 -- start start 2024-09-13T15:48:21.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.179+0000 7f0a20000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a18106540 0x7f0a1819b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:21.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.179+0000 7f0a20000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1819bb60 con 0x7f0a18106540 2024-09-13T15:48:21.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.179+0000 7f0a1d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a18106540 0x7f0a1819b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:21.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.179+0000 7f0a1d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a18106540 0x7f0a1819b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53394/0 (socket says 172.21.15.17:53394) 2024-09-13T15:48:21.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.179+0000 7f0a1d600640 1 -- 172.21.15.17:0/2600635118 learned_addr learned my addr 172.21.15.17:0/2600635118 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:48:21.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.179+0000 7f0a1d600640 1 -- 172.21.15.17:0/2600635118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c009560 con 0x7f0a18106540 2024-09-13T15:48:21.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.180+0000 7f0a1d600640 1 --2- 172.21.15.17:0/2600635118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a18106540 0x7f0a1819b620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009230 tx=0x7f0a0c004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:48:21.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.180+0000 7f0a16000640 1 -- 172.21.15.17:0/2600635118 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a0c0054d0 con 0x7f0a18106540 2024-09-13T15:48:21.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.180+0000 7f0a16000640 1 -- 172.21.15.17:0/2600635118 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a0c003ab0 con 0x7f0a18106540 2024-09-13T15:48:21.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.180+0000 7f0a16000640 1 -- 172.21.15.17:0/2600635118 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a0c03c940 con 0x7f0a18106540 2024-09-13T15:48:21.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.180+0000 7f0a20000640 1 -- 172.21.15.17:0/2600635118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1819bd60 con 0x7f0a18106540 2024-09-13T15:48:21.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.180+0000 7f0a20000640 1 -- 172.21.15.17:0/2600635118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1819c180 con 0x7f0a18106540 2024-09-13T15:48:21.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.181+0000 7f0a16000640 1 -- 172.21.15.17:0/2600635118 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f0a0c003c20 con 0x7f0a18106540 2024-09-13T15:48:21.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.181+0000 7f0a20000640 1 -- 172.21.15.17:0/2600635118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a18107500 con 0x7f0a18106540 2024-09-13T15:48:21.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.182+0000 7f0a16000640 1 --2- 172.21.15.17:0/2600635118 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0a00038710 0x7f0a0003abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:21.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.182+0000 7f0a16000640 1 -- 172.21.15.17:0/2600635118 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0a0c06c480 con 0x7f0a18106540 2024-09-13T15:48:21.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.182+0000 7f0a1cc00640 1 --2- 172.21.15.17:0/2600635118 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0a00038710 0x7f0a0003abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:21.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.183+0000 7f0a1cc00640 1 --2- 172.21.15.17:0/2600635118 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0a00038710 0x7f0a0003abd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0a040098c0 tx=0x7f0a04006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:48:21.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.186+0000 7f0a16000640 1 -- 172.21.15.17:0/2600635118 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0a0c04d530 con 0x7f0a18106540 2024-09-13T15:48:21.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.372+0000 7f0a20000640 1 -- 172.21.15.17:0/2600635118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f0a1819caa0 con 0x7f0a18106540 2024-09-13T15:48:21.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.659+0000 7f0a16000640 1 -- 172.21.15.17:0/2600635118 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0a0c035020 con 0x7f0a18106540 2024-09-13T15:48:21.661 INFO:teuthology.orchestra.run.smithi017.stderr:adjusted tunables profile to default 2024-09-13T15:48:21.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.661+0000 7f0a20000640 1 -- 172.21.15.17:0/2600635118 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0a00038710 msgr2=0x7f0a0003abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:21.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.661+0000 7f0a20000640 1 --2- 172.21.15.17:0/2600635118 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0a00038710 0x7f0a0003abd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0a040098c0 tx=0x7f0a04006db0 comp rx=0 tx=0).stop 2024-09-13T15:48:21.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.661+0000 7f0a20000640 1 -- 172.21.15.17:0/2600635118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a18106540 msgr2=0x7f0a1819b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:21.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.661+0000 7f0a20000640 1 --2- 172.21.15.17:0/2600635118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a18106540 0x7f0a1819b620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009230 tx=0x7f0a0c004e50 comp rx=0 tx=0).stop 2024-09-13T15:48:21.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.662+0000 7f0a20000640 1 -- 172.21.15.17:0/2600635118 shutdown_connections 2024-09-13T15:48:21.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.662+0000 7f0a20000640 1 --2- 172.21.15.17:0/2600635118 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0a00038710 0x7f0a0003abd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:21.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.662+0000 7f0a20000640 1 --2- 172.21.15.17:0/2600635118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a18106540 0x7f0a1819b620 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:21.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.662+0000 7f0a20000640 1 -- 172.21.15.17:0/2600635118 >> 172.21.15.17:0/2600635118 conn(0x7f0a180784f0 msgr2=0x7f0a1810da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:48:21.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.662+0000 7f0a20000640 1 -- 172.21.15.17:0/2600635118 shutdown_connections 2024-09-13T15:48:21.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:21.662+0000 7f0a20000640 1 -- 172.21.15.17:0/2600635118 wait complete. 2024-09-13T15:48:21.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:21 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/2600635118' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T15:48:22.273 INFO:tasks.cephadm:Adding mon.a on smithi017 2024-09-13T15:48:22.274 INFO:tasks.cephadm:Adding mon.b on smithi189 2024-09-13T15:48:22.274 INFO:tasks.cephadm:Adding mon.c on smithi193 2024-09-13T15:48:22.274 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi017:172.21.15.17=a;smithi189:172.21.15.189=b;smithi193:172.21.15.193=c' 2024-09-13T15:48:22.473 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T15:48:23.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:22 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/2600635118' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T15:48:23.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:22 smithi017 ceph-mon[30494]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T15:48:23.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:22 smithi017 ceph-mon[30494]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:23.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.900+0000 7fd9f870e640 1 -- 172.21.15.193:0/987441072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f01057a0 msgr2=0x7fd9f0105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:23.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.900+0000 7fd9f870e640 1 --2- 172.21.15.193:0/987441072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f01057a0 0x7fd9f0105b80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009880 tx=0x7fd9e402a5d0 comp rx=0 tx=0).stop 2024-09-13T15:48:23.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.900+0000 7fd9f870e640 1 -- 172.21.15.193:0/987441072 shutdown_connections 2024-09-13T15:48:23.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.900+0000 7fd9f870e640 1 --2- 172.21.15.193:0/987441072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f01057a0 0x7fd9f0105b80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:23.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.900+0000 7fd9f870e640 1 -- 172.21.15.193:0/987441072 >> 172.21.15.193:0/987441072 conn(0x7fd9f0076500 msgr2=0x7fd9f0076910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:48:23.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.900+0000 7fd9f870e640 1 -- 172.21.15.193:0/987441072 shutdown_connections 2024-09-13T15:48:23.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.900+0000 7fd9f870e640 1 -- 172.21.15.193:0/987441072 wait complete. 2024-09-13T15:48:23.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.900+0000 7fd9f870e640 1 Processor -- start 2024-09-13T15:48:23.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.900+0000 7fd9f870e640 1 -- start start 2024-09-13T15:48:23.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.901+0000 7fd9f870e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f01057a0 0x7fd9f0194f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:23.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.901+0000 7fd9f870e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f01954c0 con 0x7fd9f01057a0 2024-09-13T15:48:23.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.901+0000 7fd9f64aa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f01057a0 0x7fd9f0194f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:23.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.901+0000 7fd9f64aa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f01057a0 0x7fd9f0194f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.193:35342/0 (socket says 172.21.15.193:35342) 2024-09-13T15:48:23.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.901+0000 7fd9f64aa640 1 -- 172.21.15.193:0/2989484775 learned_addr learned my addr 172.21.15.193:0/2989484775 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-13T15:48:23.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.901+0000 7fd9f64aa640 1 -- 172.21.15.193:0/2989484775 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e4009560 con 0x7fd9f01057a0 2024-09-13T15:48:23.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.902+0000 7fd9f64aa640 1 --2- 172.21.15.193:0/2989484775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f01057a0 0x7fd9f0194f80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009230 tx=0x7fd9e4004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:48:23.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.902+0000 7fd9e37fe640 1 -- 172.21.15.193:0/2989484775 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9e40054d0 con 0x7fd9f01057a0 2024-09-13T15:48:23.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.902+0000 7fd9f870e640 1 -- 172.21.15.193:0/2989484775 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f0195720 con 0x7fd9f01057a0 2024-09-13T15:48:23.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.902+0000 7fd9e37fe640 1 -- 172.21.15.193:0/2989484775 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd9e4003ab0 con 0x7fd9f01057a0 2024-09-13T15:48:23.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.902+0000 7fd9e37fe640 1 -- 172.21.15.193:0/2989484775 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9e403c940 con 0x7fd9f01057a0 2024-09-13T15:48:23.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.902+0000 7fd9f870e640 1 -- 172.21.15.193:0/2989484775 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f0195ba0 con 0x7fd9f01057a0 2024-09-13T15:48:23.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.903+0000 7fd9f870e640 1 -- 172.21.15.193:0/2989484775 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f0100e70 con 0x7fd9f01057a0 2024-09-13T15:48:23.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.903+0000 7fd9e37fe640 1 -- 172.21.15.193:0/2989484775 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fd9e4003c20 con 0x7fd9f01057a0 2024-09-13T15:48:23.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.903+0000 7fd9e37fe640 1 --2- 172.21.15.193:0/2989484775 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd9dc038710 0x7fd9dc03abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:23.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.903+0000 7fd9e37fe640 1 -- 172.21.15.193:0/2989484775 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd9e406c380 con 0x7fd9f01057a0 2024-09-13T15:48:23.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.904+0000 7fd9f5ca9640 1 --2- 172.21.15.193:0/2989484775 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd9dc038710 0x7fd9dc03abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:23.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.904+0000 7fd9f5ca9640 1 --2- 172.21.15.193:0/2989484775 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd9dc038710 0x7fd9dc03abd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0098c0 tx=0x7fd9ec006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:48:23.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:23.909+0000 7fd9e37fe640 1 -- 172.21.15.193:0/2989484775 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd9e404d530 con 0x7fd9f01057a0 2024-09-13T15:48:24.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:24.081+0000 7fd9f870e640 1 -- 172.21.15.193:0/2989484775 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi017:172.21.15.17=a;smithi189:172.21.15.189=b;smithi193:172.21.15.193=c", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9f0109bb0 con 0x7fd9dc038710 2024-09-13T15:48:24.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:24.088+0000 7fd9e37fe640 1 -- 172.21.15.193:0/2989484775 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd9f0109bb0 con 0x7fd9dc038710 2024-09-13T15:48:24.089 INFO:teuthology.orchestra.run.smithi193.stdout:Scheduled mon update... 2024-09-13T15:48:24.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:24.090+0000 7fd9f870e640 1 -- 172.21.15.193:0/2989484775 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd9dc038710 msgr2=0x7fd9dc03abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:24.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:24.090+0000 7fd9f870e640 1 --2- 172.21.15.193:0/2989484775 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd9dc038710 0x7fd9dc03abd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0098c0 tx=0x7fd9ec006db0 comp rx=0 tx=0).stop 2024-09-13T15:48:24.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:24.090+0000 7fd9f870e640 1 -- 172.21.15.193:0/2989484775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f01057a0 msgr2=0x7fd9f0194f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:24.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:24.090+0000 7fd9f870e640 1 --2- 172.21.15.193:0/2989484775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f01057a0 0x7fd9f0194f80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009230 tx=0x7fd9e4004e50 comp rx=0 tx=0).stop 2024-09-13T15:48:24.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:24.090+0000 7fd9f870e640 1 -- 172.21.15.193:0/2989484775 shutdown_connections 2024-09-13T15:48:24.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:24.090+0000 7fd9f870e640 1 --2- 172.21.15.193:0/2989484775 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd9dc038710 0x7fd9dc03abd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:24.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:24.090+0000 7fd9f870e640 1 --2- 172.21.15.193:0/2989484775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f01057a0 0x7fd9f0194f80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:24.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:24.090+0000 7fd9f870e640 1 -- 172.21.15.193:0/2989484775 >> 172.21.15.193:0/2989484775 conn(0x7fd9f0076500 msgr2=0x7fd9f0101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:48:24.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:24.090+0000 7fd9f870e640 1 -- 172.21.15.193:0/2989484775 shutdown_connections 2024-09-13T15:48:24.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:24.090+0000 7fd9f870e640 1 -- 172.21.15.193:0/2989484775 wait complete. 2024-09-13T15:48:24.622 DEBUG:teuthology.orchestra.run.smithi189:mon.b> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mon.b.service 2024-09-13T15:48:24.625 DEBUG:teuthology.orchestra.run.smithi193:mon.c> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mon.c.service 2024-09-13T15:48:24.627 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T15:48:24.628 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T15:48:25.276 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T15:48:25.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:25 smithi017 ceph-mon[30494]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:25.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:25 smithi017 ceph-mon[30494]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi017:172.21.15.17=a;smithi189:172.21.15.189=b;smithi193:172.21.15.193=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:48:25.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:25 smithi017 ceph-mon[30494]: Saving service mon spec with placement smithi017:172.21.15.17=a;smithi189:172.21.15.189=b;smithi193:172.21.15.193=c;count:3 2024-09-13T15:48:25.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:25 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:25.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:25 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:48:25.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:25 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:25.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:25 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:48:25.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:25 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:25.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:25 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T15:48:25.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:25 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:25.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:25 smithi017 ceph-mon[30494]: Deploying daemon mon.c on smithi193 2024-09-13T15:48:27.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:27 smithi017 ceph-mon[30494]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:27.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.854+0000 7f6353df8640 1 -- 172.21.15.193:0/827691954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f634c104650 msgr2=0x7f634c104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:27.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.854+0000 7f6353df8640 1 --2- 172.21.15.193:0/827691954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f634c104650 0x7f634c104a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f633c009c20 tx=0x7f633c02aa90 comp rx=0 tx=0).stop 2024-09-13T15:48:27.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.854+0000 7f6353df8640 1 -- 172.21.15.193:0/827691954 shutdown_connections 2024-09-13T15:48:27.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.854+0000 7f6353df8640 1 --2- 172.21.15.193:0/827691954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f634c104650 0x7f634c104a30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:27.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.854+0000 7f6353df8640 1 -- 172.21.15.193:0/827691954 >> 172.21.15.193:0/827691954 conn(0x7f634c075490 msgr2=0x7f634c0fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:48:27.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.854+0000 7f6353df8640 1 -- 172.21.15.193:0/827691954 shutdown_connections 2024-09-13T15:48:27.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.854+0000 7f6353df8640 1 -- 172.21.15.193:0/827691954 wait complete. 2024-09-13T15:48:27.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.855+0000 7f6353df8640 1 Processor -- start 2024-09-13T15:48:27.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.855+0000 7f6353df8640 1 -- start start 2024-09-13T15:48:27.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.855+0000 7f6353df8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f634c104650 0x7f634c193f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:27.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.855+0000 7f6353df8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c1944c0 con 0x7f634c104650 2024-09-13T15:48:27.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.856+0000 7f6351b94640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f634c104650 0x7f634c193f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:27.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.856+0000 7f6351b94640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f634c104650 0x7f634c193f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.193:35368/0 (socket says 172.21.15.193:35368) 2024-09-13T15:48:27.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.856+0000 7f6351b94640 1 -- 172.21.15.193:0/3774282910 learned_addr learned my addr 172.21.15.193:0/3774282910 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-13T15:48:27.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.856+0000 7f6351b94640 1 -- 172.21.15.193:0/3774282910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c009900 con 0x7f634c104650 2024-09-13T15:48:27.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.856+0000 7f6351b94640 1 --2- 172.21.15.193:0/3774282910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f634c104650 0x7f634c193f80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f633c005e30 tx=0x7f633c02f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:48:27.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.857+0000 7f634affd640 1 -- 172.21.15.193:0/3774282910 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f633c040070 con 0x7f634c104650 2024-09-13T15:48:27.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.857+0000 7f6353df8640 1 -- 172.21.15.193:0/3774282910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634c1946c0 con 0x7f634c104650 2024-09-13T15:48:27.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.857+0000 7f634affd640 1 -- 172.21.15.193:0/3774282910 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f633c02e880 con 0x7f634c104650 2024-09-13T15:48:27.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.857+0000 7f634affd640 1 -- 172.21.15.193:0/3774282910 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f633c03acf0 con 0x7f634c104650 2024-09-13T15:48:27.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.857+0000 7f6353df8640 1 -- 172.21.15.193:0/3774282910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634c194b40 con 0x7f634c104650 2024-09-13T15:48:27.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.858+0000 7f6353df8640 1 -- 172.21.15.193:0/3774282910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634c0fd330 con 0x7f634c104650 2024-09-13T15:48:27.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.858+0000 7f634affd640 1 -- 172.21.15.193:0/3774282910 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f633c00a040 con 0x7f634c104650 2024-09-13T15:48:27.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.858+0000 7f634affd640 1 --2- 172.21.15.193:0/3774282910 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6334038710 0x7f633403abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:27.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.858+0000 7f634affd640 1 -- 172.21.15.193:0/3774282910 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f633c06e9a0 con 0x7f634c104650 2024-09-13T15:48:27.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.858+0000 7f6351393640 1 --2- 172.21.15.193:0/3774282910 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6334038710 0x7f633403abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:27.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.859+0000 7f6351393640 1 --2- 172.21.15.193:0/3774282910 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6334038710 0x7f633403abd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f63400098c0 tx=0x7f6340006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:48:27.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:27.864+0000 7f634affd640 1 -- 172.21.15.193:0/3774282910 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f633c044840 con 0x7f634c104650 2024-09-13T15:48:28.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:28.089+0000 7f6353df8640 1 -- 172.21.15.193:0/3774282910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f634c0ffd90 con 0x7f634c104650 2024-09-13T15:48:28.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:28.091+0000 7f634affd640 1 -- 172.21.15.193:0/3774282910 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7f633c033030 con 0x7f634c104650 2024-09-13T15:48:28.092 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-13T15:48:28.093 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","modified":"2024-09-13T15:46:46.348538Z","created":"2024-09-13T15:46:46.348538Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T15:48:28.093 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-13T15:48:28.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:28.093+0000 7f6353df8640 1 -- 172.21.15.193:0/3774282910 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6334038710 msgr2=0x7f633403abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:28.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:28.093+0000 7f6353df8640 1 --2- 172.21.15.193:0/3774282910 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6334038710 0x7f633403abd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f63400098c0 tx=0x7f6340006db0 comp rx=0 tx=0).stop 2024-09-13T15:48:28.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:28.093+0000 7f6353df8640 1 -- 172.21.15.193:0/3774282910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f634c104650 msgr2=0x7f634c193f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:28.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:28.093+0000 7f6353df8640 1 --2- 172.21.15.193:0/3774282910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f634c104650 0x7f634c193f80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f633c005e30 tx=0x7f633c02f8a0 comp rx=0 tx=0).stop 2024-09-13T15:48:28.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:28.093+0000 7f6353df8640 1 -- 172.21.15.193:0/3774282910 shutdown_connections 2024-09-13T15:48:28.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:28.093+0000 7f6353df8640 1 --2- 172.21.15.193:0/3774282910 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6334038710 0x7f633403abd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:28.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:28.093+0000 7f6353df8640 1 --2- 172.21.15.193:0/3774282910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f634c104650 0x7f634c193f80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:28.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:28.093+0000 7f6353df8640 1 -- 172.21.15.193:0/3774282910 >> 172.21.15.193:0/3774282910 conn(0x7f634c075490 msgr2=0x7f634c0fb7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:48:28.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:28.093+0000 7f6353df8640 1 -- 172.21.15.193:0/3774282910 shutdown_connections 2024-09-13T15:48:28.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:28.093+0000 7f6353df8640 1 -- 172.21.15.193:0/3774282910 wait complete. 2024-09-13T15:48:29.414 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:29 smithi017 ceph-mon[30494]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:29.414 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:29 smithi017 ceph-mon[30494]: from='client.? 172.21.15.193:0/3774282910' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T15:48:30.003 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T15:48:30.004 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T15:48:30.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:29 smithi193 systemd[1]: Started Ceph mon.c for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T15:48:30.204 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T15:48:35.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.110+0000 7f793e1ef640 1 -- 172.21.15.193:0/36271145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7924003530 msgr2=0x7f79240059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:35.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.110+0000 7f793e1ef640 1 --2- 172.21.15.193:0/36271145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7924003530 0x7f79240059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7938100d00 tx=0x7f792802c3f0 comp rx=0 tx=0).stop 2024-09-13T15:48:35.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.110+0000 7f793e1ef640 1 -- 172.21.15.193:0/36271145 shutdown_connections 2024-09-13T15:48:35.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.110+0000 7f793e1ef640 1 --2- 172.21.15.193:0/36271145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7924003530 0x7f79240059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:35.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.110+0000 7f793e1ef640 1 -- 172.21.15.193:0/36271145 >> 172.21.15.193:0/36271145 conn(0x7f79380fb570 msgr2=0x7f79380fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:48:35.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.110+0000 7f793e1ef640 1 -- 172.21.15.193:0/36271145 shutdown_connections 2024-09-13T15:48:35.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.110+0000 7f793e1ef640 1 -- 172.21.15.193:0/36271145 wait complete. 2024-09-13T15:48:35.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.111+0000 7f793e1ef640 1 Processor -- start 2024-09-13T15:48:35.113 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:48:35.113 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: mon.a calling monitor election 2024-09-13T15:48:35.113 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T15:48:35.113 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:35.113 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:48:35.113 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:48:35.113 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: mon.c calling monitor election 2024-09-13T15:48:35.113 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:35.113 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:48:35.113 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:48:35.113 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:35.113 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:48:35.113 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T15:48:35.114 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: monmap e2: 2 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0],c=[v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T15:48:35.114 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: fsmap 2024-09-13T15:48:35.114 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T15:48:35.114 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: mgrmap e13: x(active, since 52s) 2024-09-13T15:48:35.114 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: overall HEALTH_OK 2024-09-13T15:48:35.114 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:35.114 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:35.114 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:35.114 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T15:48:35.114 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:35.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.111+0000 7f793e1ef640 1 -- start start 2024-09-13T15:48:35.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.111+0000 7f793e1ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7924003530 0x7f79380727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:35.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.111+0000 7f793e1ef640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7938072cf0 0x7f7938073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:35.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.111+0000 7f793e1ef640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79380746c0 con 0x7f7924003530 2024-09-13T15:48:35.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.111+0000 7f793e1ef640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79381a1340 con 0x7f7938072cf0 2024-09-13T15:48:35.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.111+0000 7f792ffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7938072cf0 0x7f7938073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:35.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.111+0000 7f792ffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7938072cf0 0x7f7938073150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:34182/0 (socket says 172.21.15.193:34182) 2024-09-13T15:48:35.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.111+0000 7f792ffff640 1 -- 172.21.15.193:0/1391686554 learned_addr learned my addr 172.21.15.193:0/1391686554 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-13T15:48:35.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.111+0000 7f79377fe640 1 --2- 172.21.15.193:0/1391686554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7924003530 0x7f79380727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:35.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.112+0000 7f792ffff640 1 -- 172.21.15.193:0/1391686554 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7938072cf0 msgr2=0x7f7938073150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T15:48:35.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.112+0000 7f792ffff640 1 -- 172.21.15.193:0/1391686554 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7938072cf0 msgr2=0x7f7938073150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T15:48:35.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.112+0000 7f792ffff640 1 --2- 172.21.15.193:0/1391686554 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7938072cf0 0x7f7938073150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:48:35.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.112+0000 7f792ffff640 1 --2- 172.21.15.193:0/1391686554 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7938072cf0 0x7f7938073150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T15:48:35.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.112+0000 7f79377fe640 1 -- 172.21.15.193:0/1391686554 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7938072cf0 msgr2=0x7f7938073150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:48:35.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.112+0000 7f79377fe640 1 --2- 172.21.15.193:0/1391686554 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7938072cf0 0x7f7938073150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:35.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.112+0000 7f79377fe640 1 -- 172.21.15.193:0/1391686554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7928014930 con 0x7f7924003530 2024-09-13T15:48:35.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.112+0000 7f79377fe640 1 --2- 172.21.15.193:0/1391686554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7924003530 0x7f79380727b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7928014cc0 tx=0x7f7928012f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:48:35.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.112+0000 7f79357fa640 1 -- 172.21.15.193:0/1391686554 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f7928041070 con 0x7f7924003530 2024-09-13T15:48:35.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.112+0000 7f79357fa640 1 -- 172.21.15.193:0/1391686554 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7928012450 con 0x7f7924003530 2024-09-13T15:48:35.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.112+0000 7f79357fa640 1 -- 172.21.15.193:0/1391686554 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f792803d710 con 0x7f7924003530 2024-09-13T15:48:35.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.113+0000 7f793e1ef640 1 -- 172.21.15.193:0/1391686554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79381a1480 con 0x7f7924003530 2024-09-13T15:48:35.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.113+0000 7f793e1ef640 1 -- 172.21.15.193:0/1391686554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79381a19a0 con 0x7f7924003530 2024-09-13T15:48:35.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.114+0000 7f79357fa640 1 -- 172.21.15.193:0/1391686554 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f7928046410 con 0x7f7924003530 2024-09-13T15:48:35.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.114+0000 7f79357fa640 1 --2- 172.21.15.193:0/1391686554 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7918038550 0x7f791803aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:35.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.114+0000 7f79357fa640 1 -- 172.21.15.193:0/1391686554 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7928000e40 con 0x7f7924003530 2024-09-13T15:48:35.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.114+0000 7f793e1ef640 1 -- 172.21.15.193:0/1391686554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7938100fb0 con 0x7f7924003530 2024-09-13T15:48:35.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.114+0000 7f792ffff640 1 --2- 172.21.15.193:0/1391686554 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7918038550 0x7f791803aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:35.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.115+0000 7f792ffff640 1 --2- 172.21.15.193:0/1391686554 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7918038550 0x7f791803aa10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7920009100 tx=0x7f7920008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:48:35.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.120+0000 7f79357fa640 1 -- 172.21.15.193:0/1391686554 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f792803b700 con 0x7f7924003530 2024-09-13T15:48:35.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:48:35.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: mon.a calling monitor election 2024-09-13T15:48:35.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T15:48:35.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:35.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:48:35.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:48:35.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: mon.c calling monitor election 2024-09-13T15:48:35.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:35.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:48:35.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:48:35.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:35.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:48:35.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T15:48:35.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: monmap e2: 2 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0],c=[v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T15:48:35.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: fsmap 2024-09-13T15:48:35.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T15:48:35.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: mgrmap e13: x(active, since 52s) 2024-09-13T15:48:35.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: overall HEALTH_OK 2024-09-13T15:48:35.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:35.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:35.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:35.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T15:48:35.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:35.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.346+0000 7f793e1ef640 1 -- 172.21.15.193:0/1391686554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7938108910 con 0x7f7924003530 2024-09-13T15:48:35.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.346+0000 7f79357fa640 1 -- 172.21.15.193:0/1391686554 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7f792803b340 con 0x7f7924003530 2024-09-13T15:48:35.348 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-13T15:48:35.348 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":2,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","modified":"2024-09-13T15:48:29.782511Z","created":"2024-09-13T15:46:46.348538Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:3300","nonce":0},{"type":"v1","addr":"172.21.15.193:6789","nonce":0}]},"addr":"172.21.15.193:6789/0","public_addr":"172.21.15.193:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T15:48:35.348 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 2 2024-09-13T15:48:35.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.349+0000 7f793e1ef640 1 -- 172.21.15.193:0/1391686554 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7918038550 msgr2=0x7f791803aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:35.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.349+0000 7f793e1ef640 1 --2- 172.21.15.193:0/1391686554 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7918038550 0x7f791803aa10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7920009100 tx=0x7f7920008040 comp rx=0 tx=0).stop 2024-09-13T15:48:35.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.349+0000 7f793e1ef640 1 -- 172.21.15.193:0/1391686554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7924003530 msgr2=0x7f79380727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:35.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.349+0000 7f793e1ef640 1 --2- 172.21.15.193:0/1391686554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7924003530 0x7f79380727b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7928014cc0 tx=0x7f7928012f40 comp rx=0 tx=0).stop 2024-09-13T15:48:35.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.349+0000 7f793e1ef640 1 -- 172.21.15.193:0/1391686554 shutdown_connections 2024-09-13T15:48:35.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.349+0000 7f793e1ef640 1 --2- 172.21.15.193:0/1391686554 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7918038550 0x7f791803aa10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:35.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.349+0000 7f793e1ef640 1 --2- 172.21.15.193:0/1391686554 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7938072cf0 0x7f7938073150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:35.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.349+0000 7f793e1ef640 1 --2- 172.21.15.193:0/1391686554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7924003530 0x7f79380727b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:35.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.349+0000 7f793e1ef640 1 -- 172.21.15.193:0/1391686554 >> 172.21.15.193:0/1391686554 conn(0x7f79380fb570 msgr2=0x7f79380fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:48:35.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.349+0000 7f793e1ef640 1 -- 172.21.15.193:0/1391686554 shutdown_connections 2024-09-13T15:48:35.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:35.349+0000 7f793e1ef640 1 -- 172.21.15.193:0/1391686554 wait complete. 2024-09-13T15:48:36.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:35 smithi193 ceph-mon[35248]: Deploying daemon mon.b on smithi189 2024-09-13T15:48:36.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:35 smithi193 ceph-mon[35248]: from='client.? 172.21.15.193:0/1391686554' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T15:48:36.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:35 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:48:36.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:35 smithi017 ceph-mon[30494]: Deploying daemon mon.b on smithi189 2024-09-13T15:48:36.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:35 smithi017 ceph-mon[30494]: from='client.? 172.21.15.193:0/1391686554' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T15:48:36.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:35 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:48:36.888 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T15:48:36.888 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T15:48:37.092 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T15:48:37.212 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:36 smithi193 ceph-mon[35248]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:37.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:36 smithi017 ceph-mon[30494]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:37.261 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:48:36 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:48:36.782+0000 7f3bbf000640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T15:48:38.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.434+0000 7f29e80f0640 1 -- 172.21.15.193:0/216770410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29e01046f0 msgr2=0x7f29e0104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:38.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.434+0000 7f29e80f0640 1 --2- 172.21.15.193:0/216770410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29e01046f0 0x7f29e0104ad0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009c20 tx=0x7f29d002aa90 comp rx=0 tx=0).stop 2024-09-13T15:48:38.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.434+0000 7f29e80f0640 1 -- 172.21.15.193:0/216770410 shutdown_connections 2024-09-13T15:48:38.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.434+0000 7f29e80f0640 1 --2- 172.21.15.193:0/216770410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29e01046f0 0x7f29e0104ad0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:38.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.434+0000 7f29e80f0640 1 -- 172.21.15.193:0/216770410 >> 172.21.15.193:0/216770410 conn(0x7f29e0075580 msgr2=0x7f29e00fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:48:38.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.434+0000 7f29e80f0640 1 -- 172.21.15.193:0/216770410 shutdown_connections 2024-09-13T15:48:38.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.434+0000 7f29e80f0640 1 -- 172.21.15.193:0/216770410 wait complete. 2024-09-13T15:48:38.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.435+0000 7f29e80f0640 1 Processor -- start 2024-09-13T15:48:38.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.435+0000 7f29e80f0640 1 -- start start 2024-09-13T15:48:38.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.435+0000 7f29e80f0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f29e01046f0 0x7f29e0194060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:38.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.435+0000 7f29e80f0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29e01945a0 0x7f29e01989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:38.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.435+0000 7f29e80f0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e0194b10 con 0x7f29e01945a0 2024-09-13T15:48:38.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.435+0000 7f29e80f0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e0194c80 con 0x7f29e01046f0 2024-09-13T15:48:38.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.435+0000 7f29e5e8c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f29e01046f0 0x7f29e0194060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:38.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.435+0000 7f29e5e8c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f29e01046f0 0x7f29e0194060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:56080/0 (socket says 172.21.15.193:56080) 2024-09-13T15:48:38.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.435+0000 7f29e5e8c640 1 -- 172.21.15.193:0/1529809039 learned_addr learned my addr 172.21.15.193:0/1529809039 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-13T15:48:38.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.435+0000 7f29e5e8c640 1 -- 172.21.15.193:0/1529809039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f29e01046f0 msgr2=0x7f29e0194060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-13T15:48:38.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.435+0000 7f29e5e8c640 1 -- 172.21.15.193:0/1529809039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f29e01046f0 msgr2=0x7f29e0194060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T15:48:38.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.435+0000 7f29e5e8c640 1 --2- 172.21.15.193:0/1529809039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f29e01046f0 0x7f29e0194060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:48:38.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.435+0000 7f29e5e8c640 1 --2- 172.21.15.193:0/1529809039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f29e01046f0 0x7f29e0194060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T15:48:38.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.436+0000 7f29e568b640 1 --2- 172.21.15.193:0/1529809039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29e01945a0 0x7f29e01989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:38.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.436+0000 7f29e568b640 1 -- 172.21.15.193:0/1529809039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f29e01046f0 msgr2=0x7f29e0194060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:48:38.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.436+0000 7f29e568b640 1 --2- 172.21.15.193:0/1529809039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f29e01046f0 0x7f29e0194060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:38.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.436+0000 7f29e568b640 1 -- 172.21.15.193:0/1529809039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d0009900 con 0x7f29e01945a0 2024-09-13T15:48:38.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.436+0000 7f29e568b640 1 --2- 172.21.15.193:0/1529809039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29e01945a0 0x7f29e01989a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f29d400b3d0 tx=0x7f29d400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:48:38.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.436+0000 7f29deffd640 1 -- 172.21.15.193:0/1529809039 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f29d4011630 con 0x7f29e01945a0 2024-09-13T15:48:38.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.436+0000 7f29e80f0640 1 -- 172.21.15.193:0/1529809039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e0198ee0 con 0x7f29e01945a0 2024-09-13T15:48:38.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.436+0000 7f29deffd640 1 -- 172.21.15.193:0/1529809039 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f29d4011c50 con 0x7f29e01945a0 2024-09-13T15:48:38.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.436+0000 7f29deffd640 1 -- 172.21.15.193:0/1529809039 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f29d4010d10 con 0x7f29e01945a0 2024-09-13T15:48:38.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.437+0000 7f29e80f0640 1 -- 172.21.15.193:0/1529809039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e0199430 con 0x7f29e01945a0 2024-09-13T15:48:38.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.437+0000 7f29e80f0640 1 -- 172.21.15.193:0/1529809039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e01036c0 con 0x7f29e01945a0 2024-09-13T15:48:38.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.437+0000 7f29deffd640 1 -- 172.21.15.193:0/1529809039 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f29d4010410 con 0x7f29e01945a0 2024-09-13T15:48:38.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.438+0000 7f29deffd640 1 --2- 172.21.15.193:0/1529809039 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f29c80384f0 0x7f29c803a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:38.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.438+0000 7f29deffd640 1 -- 172.21.15.193:0/1529809039 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f29d404af80 con 0x7f29e01945a0 2024-09-13T15:48:38.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.438+0000 7f29e5e8c640 1 --2- 172.21.15.193:0/1529809039 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f29c80384f0 0x7f29c803a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:38.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.439+0000 7f29e5e8c640 1 --2- 172.21.15.193:0/1529809039 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f29c80384f0 0x7f29c803a9b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009430 tx=0x7f29d003c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:48:38.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.443+0000 7f29deffd640 1 -- 172.21.15.193:0/1529809039 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f29d4011dc0 con 0x7f29e01945a0 2024-09-13T15:48:38.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.631+0000 7f29deffd640 1 -- 172.21.15.193:0/1529809039 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4011dc0 con 0x7f29e01945a0 2024-09-13T15:48:38.637 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:38 smithi189 ceph-mon[34790]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-13T15:48:38.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:38.672+0000 7f29e80f0640 1 -- 172.21.15.193:0/1529809039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f29e00ffe30 con 0x7f29e01945a0 2024-09-13T15:48:39.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:38 smithi189 bash[34768]: 57064e1ca85e84348d702d399fc8293fda8f622446e99840fc3168a73fe55c52 2024-09-13T15:48:39.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:38 smithi189 systemd[1]: Started Ceph mon.b for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T15:48:43.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:43.640+0000 7f29deffd640 1 -- 172.21.15.193:0/1529809039 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1274 (secure 0 0 0) 0x7f29d4017730 con 0x7f29e01945a0 2024-09-13T15:48:43.642 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-13T15:48:43.642 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":3,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","modified":"2024-09-13T15:48:38.630255Z","created":"2024-09-13T15:46:46.348538Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:3300","nonce":0},{"type":"v1","addr":"172.21.15.193:6789","nonce":0}]},"addr":"172.21.15.193:6789/0","public_addr":"172.21.15.193:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:3300","nonce":0},{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T15:48:43.642 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 3 2024-09-13T15:48:43.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:43.643+0000 7f29e80f0640 1 -- 172.21.15.193:0/1529809039 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f29c80384f0 msgr2=0x7f29c803a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:43.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:43.643+0000 7f29e80f0640 1 --2- 172.21.15.193:0/1529809039 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f29c80384f0 0x7f29c803a9b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009430 tx=0x7f29d003c040 comp rx=0 tx=0).stop 2024-09-13T15:48:43.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:43.643+0000 7f29e80f0640 1 -- 172.21.15.193:0/1529809039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29e01945a0 msgr2=0x7f29e01989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:43.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:43.643+0000 7f29e80f0640 1 --2- 172.21.15.193:0/1529809039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29e01945a0 0x7f29e01989a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f29d400b3d0 tx=0x7f29d400b890 comp rx=0 tx=0).stop 2024-09-13T15:48:43.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:43.643+0000 7f29e80f0640 1 -- 172.21.15.193:0/1529809039 shutdown_connections 2024-09-13T15:48:43.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:43.643+0000 7f29e80f0640 1 --2- 172.21.15.193:0/1529809039 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f29c80384f0 0x7f29c803a9b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:43.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:43.643+0000 7f29e80f0640 1 --2- 172.21.15.193:0/1529809039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29e01945a0 0x7f29e01989a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:43.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:43.643+0000 7f29e80f0640 1 --2- 172.21.15.193:0/1529809039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f29e01046f0 0x7f29e0194060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:43.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:43.643+0000 7f29e80f0640 1 -- 172.21.15.193:0/1529809039 >> 172.21.15.193:0/1529809039 conn(0x7f29e0075580 msgr2=0x7f29e00fbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:48:43.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:43.643+0000 7f29e80f0640 1 -- 172.21.15.193:0/1529809039 shutdown_connections 2024-09-13T15:48:43.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:43.643+0000 7f29e80f0640 1 -- 172.21.15.193:0/1529809039 wait complete. 2024-09-13T15:48:44.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T15:48:44.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:44.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: mon.a calling monitor election 2024-09-13T15:48:44.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: mon.c calling monitor election 2024-09-13T15:48:44.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:48:44.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: from='client.? 172.21.15.193:0/1529809039' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T15:48:44.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:44.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:44.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:44.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:44.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:44.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:44.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:44.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T15:48:44.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: monmap e3: 3 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0],b=[v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0],c=[v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T15:48:44.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: fsmap 2024-09-13T15:48:44.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T15:48:44.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: mgrmap e13: x(active, since 61s) 2024-09-13T15:48:44.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-13T15:48:44.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-13T15:48:44.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-13T15:48:44.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: mon.b (rank 2) addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] is down (out of quorum) 2024-09-13T15:48:44.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:44.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:44.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:44.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:44.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T15:48:44.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:44.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: mon.a calling monitor election 2024-09-13T15:48:44.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: mon.c calling monitor election 2024-09-13T15:48:44.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:48:44.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: from='client.? 172.21.15.193:0/1529809039' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T15:48:44.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:44.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:44.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:44.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:44.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:44.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:44.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:44.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T15:48:44.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: monmap e3: 3 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0],b=[v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0],c=[v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T15:48:44.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: fsmap 2024-09-13T15:48:44.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T15:48:44.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: mgrmap e13: x(active, since 61s) 2024-09-13T15:48:44.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-13T15:48:44.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-13T15:48:44.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-13T15:48:44.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: mon.b (rank 2) addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] is down (out of quorum) 2024-09-13T15:48:44.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:44.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:44.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:44.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:44.372 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-13T15:48:44.373 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-13T15:48:44.690 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:48:44.959 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:44 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:48:44.960 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:44 smithi017 ceph-mon[30494]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:44.960 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:44 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:45.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:44 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:48:45.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:44 smithi193 ceph-mon[35248]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:45.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:44 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:46.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T15:48:46.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:46.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: mon.a calling monitor election 2024-09-13T15:48:46.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: mon.c calling monitor election 2024-09-13T15:48:46.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:48:46.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: from='client.? 172.21.15.193:0/1529809039' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T15:48:46.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:46.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:46.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:46.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:46.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:46.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:46.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:46.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T15:48:46.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: monmap e3: 3 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0],b=[v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0],c=[v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T15:48:46.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: fsmap 2024-09-13T15:48:46.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T15:48:46.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: mgrmap e13: x(active, since 61s) 2024-09-13T15:48:46.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-13T15:48:46.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-13T15:48:46.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-13T15:48:46.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: mon.b (rank 2) addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] is down (out of quorum) 2024-09-13T15:48:46.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:46.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:46.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:46.109 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:46.109 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:48:46.109 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:46.109 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:46.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.617+0000 7f0a6f200640 1 -- 172.21.15.17:0/3387906086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a70105630 msgr2=0x7f0a70105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:46.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.617+0000 7f0a6f200640 1 --2- 172.21.15.17:0/3387906086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a70105630 0x7f0a70105a10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0a60009880 tx=0x7f0a6002a5d0 comp rx=0 tx=0).stop 2024-09-13T15:48:46.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.617+0000 7f0a6f200640 1 -- 172.21.15.17:0/3387906086 shutdown_connections 2024-09-13T15:48:46.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.617+0000 7f0a6f200640 1 --2- 172.21.15.17:0/3387906086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a70105630 0x7f0a70105a10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:46.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.617+0000 7f0a6f200640 1 -- 172.21.15.17:0/3387906086 >> 172.21.15.17:0/3387906086 conn(0x7f0a700777a0 msgr2=0x7f0a70077bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:48:46.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.617+0000 7f0a6f200640 1 -- 172.21.15.17:0/3387906086 shutdown_connections 2024-09-13T15:48:46.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.617+0000 7f0a6f200640 1 -- 172.21.15.17:0/3387906086 wait complete. 2024-09-13T15:48:46.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.618+0000 7f0a6f200640 1 Processor -- start 2024-09-13T15:48:46.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.618+0000 7f0a6f200640 1 -- start start 2024-09-13T15:48:46.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.618+0000 7f0a6f200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a70105630 0x7f0a70197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:46.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.618+0000 7f0a6f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a70197770 0x7f0a7019bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:46.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.618+0000 7f0a6f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a7019c0b0 0x7f0a7019c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:46.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.618+0000 7f0a6f200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a70197e40 con 0x7f0a70197770 2024-09-13T15:48:46.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.618+0000 7f0a6f200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a701a3e20 con 0x7f0a7019c0b0 2024-09-13T15:48:46.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.618+0000 7f0a6f200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a701a3f60 con 0x7f0a70105630 2024-09-13T15:48:46.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.619+0000 7f0a6d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a70197770 0x7f0a7019bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:46.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.619+0000 7f0a6de00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a70105630 0x7f0a70197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:46.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.619+0000 7f0a6d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a70197770 0x7f0a7019bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59952/0 (socket says 172.21.15.17:59952) 2024-09-13T15:48:46.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.619+0000 7f0a6d400640 1 -- 172.21.15.17:0/1667970897 learned_addr learned my addr 172.21.15.17:0/1667970897 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:48:46.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.619+0000 7f0a6e800640 1 --2- 172.21.15.17:0/1667970897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a7019c0b0 0x7f0a7019c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:46.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.619+0000 7f0a6d400640 1 -- 172.21.15.17:0/1667970897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a70105630 msgr2=0x7f0a70197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:46.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.619+0000 7f0a6d400640 1 --2- 172.21.15.17:0/1667970897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a70105630 0x7f0a70197230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:46.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.619+0000 7f0a6d400640 1 -- 172.21.15.17:0/1667970897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a7019c0b0 msgr2=0x7f0a7019c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:46.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.619+0000 7f0a6d400640 1 --2- 172.21.15.17:0/1667970897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a7019c0b0 0x7f0a7019c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:46.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.619+0000 7f0a6d400640 1 -- 172.21.15.17:0/1667970897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a60009560 con 0x7f0a70197770 2024-09-13T15:48:46.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.619+0000 7f0a6de00640 1 --2- 172.21.15.17:0/1667970897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a70105630 0x7f0a70197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:48:46.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.620+0000 7f0a6d400640 1 --2- 172.21.15.17:0/1667970897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a70197770 0x7f0a7019bb70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00b550 tx=0x7f0a5c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:48:46.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.620+0000 7f0a66a00640 1 -- 172.21.15.17:0/1667970897 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c004230 con 0x7f0a70197770 2024-09-13T15:48:46.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.620+0000 7f0a66a00640 1 -- 172.21.15.17:0/1667970897 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a5c004390 con 0x7f0a70197770 2024-09-13T15:48:46.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.620+0000 7f0a66a00640 1 -- 172.21.15.17:0/1667970897 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c003b10 con 0x7f0a70197770 2024-09-13T15:48:46.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.620+0000 7f0a6f200640 1 -- 172.21.15.17:0/1667970897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a701a4210 con 0x7f0a70197770 2024-09-13T15:48:46.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.620+0000 7f0a6f200640 1 -- 172.21.15.17:0/1667970897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a701a46e0 con 0x7f0a70197770 2024-09-13T15:48:46.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.621+0000 7f0a6f200640 1 -- 172.21.15.17:0/1667970897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a70100d20 con 0x7f0a70197770 2024-09-13T15:48:46.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.622+0000 7f0a66a00640 1 -- 172.21.15.17:0/1667970897 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f0a5c003c90 con 0x7f0a70197770 2024-09-13T15:48:46.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.622+0000 7f0a66a00640 1 --2- 172.21.15.17:0/1667970897 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0a54038b90 0x7f0a5403b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:46.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.622+0000 7f0a66a00640 1 -- 172.21.15.17:0/1667970897 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0a5c04aad0 con 0x7f0a70197770 2024-09-13T15:48:46.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.623+0000 7f0a6de00640 1 --2- 172.21.15.17:0/1667970897 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0a54038b90 0x7f0a5403b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:46.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.623+0000 7f0a6de00640 1 --2- 172.21.15.17:0/1667970897 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0a54038b90 0x7f0a5403b050 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0a60000c00 tx=0x7f0a60031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:48:46.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.627+0000 7f0a66a00640 1 -- 172.21.15.17:0/1667970897 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0a5c00c900 con 0x7f0a70197770 2024-09-13T15:48:46.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: mon.b calling monitor election 2024-09-13T15:48:46.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: Updating smithi193:/var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T15:48:46.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: Updating smithi189:/var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T15:48:46.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: Updating smithi017:/var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T15:48:46.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: mon.b calling monitor election 2024-09-13T15:48:46.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: mon.c calling monitor election 2024-09-13T15:48:46.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: mon.a calling monitor election 2024-09-13T15:48:46.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-13T15:48:46.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: monmap e3: 3 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0],b=[v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0],c=[v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T15:48:46.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: fsmap 2024-09-13T15:48:46.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T15:48:46.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: mgrmap e13: x(active, since 63s) 2024-09-13T15:48:46.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-13T15:48:46.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: Cluster is now healthy 2024-09-13T15:48:46.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: overall HEALTH_OK 2024-09-13T15:48:46.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:46.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:46.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:46.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:46.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:46.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:46.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:46.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:46.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T15:48:46.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T15:48:46.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:46.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.810+0000 7f0a6f200640 1 -- 172.21.15.17:0/1667970897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f0a70105a90 con 0x7f0a70197770 2024-09-13T15:48:46.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.811+0000 7f0a66a00640 1 -- 172.21.15.17:0/1667970897 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+275 (secure 0 0 0) 0x7f0a5c00c310 con 0x7f0a70197770 2024-09-13T15:48:46.813 INFO:teuthology.orchestra.run.smithi017.stdout:# minimal ceph.conf for 3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T15:48:46.813 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2024-09-13T15:48:46.813 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = 3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T15:48:46.813 INFO:teuthology.orchestra.run.smithi017.stdout: mon_host = [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] 2024-09-13T15:48:46.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.814+0000 7f0a6f200640 1 -- 172.21.15.17:0/1667970897 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0a54038b90 msgr2=0x7f0a5403b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:46.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.814+0000 7f0a6f200640 1 --2- 172.21.15.17:0/1667970897 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0a54038b90 0x7f0a5403b050 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0a60000c00 tx=0x7f0a60031400 comp rx=0 tx=0).stop 2024-09-13T15:48:46.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.814+0000 7f0a6f200640 1 -- 172.21.15.17:0/1667970897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a70197770 msgr2=0x7f0a7019bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:46.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.814+0000 7f0a6f200640 1 --2- 172.21.15.17:0/1667970897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a70197770 0x7f0a7019bb70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00b550 tx=0x7f0a5c00ba10 comp rx=0 tx=0).stop 2024-09-13T15:48:46.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.814+0000 7f0a6f200640 1 -- 172.21.15.17:0/1667970897 shutdown_connections 2024-09-13T15:48:46.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.814+0000 7f0a6f200640 1 --2- 172.21.15.17:0/1667970897 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0a54038b90 0x7f0a5403b050 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:46.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.814+0000 7f0a6f200640 1 --2- 172.21.15.17:0/1667970897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a7019c0b0 0x7f0a7019c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:46.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.814+0000 7f0a6f200640 1 --2- 172.21.15.17:0/1667970897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a70197770 0x7f0a7019bb70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:46.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.814+0000 7f0a6f200640 1 --2- 172.21.15.17:0/1667970897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a70105630 0x7f0a70197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:46.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.814+0000 7f0a6f200640 1 -- 172.21.15.17:0/1667970897 >> 172.21.15.17:0/1667970897 conn(0x7f0a700777a0 msgr2=0x7f0a70072f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:48:46.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.814+0000 7f0a6f200640 1 -- 172.21.15.17:0/1667970897 shutdown_connections 2024-09-13T15:48:46.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:48:46.814+0000 7f0a6f200640 1 -- 172.21.15.17:0/1667970897 wait complete. 2024-09-13T15:48:46.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: mon.b calling monitor election 2024-09-13T15:48:46.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: Updating smithi193:/var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T15:48:46.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: Updating smithi189:/var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T15:48:46.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: Updating smithi017:/var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T15:48:46.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: mon.b calling monitor election 2024-09-13T15:48:46.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: mon.c calling monitor election 2024-09-13T15:48:46.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: mon.a calling monitor election 2024-09-13T15:48:46.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-13T15:48:46.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: monmap e3: 3 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0],b=[v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0],c=[v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T15:48:46.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: fsmap 2024-09-13T15:48:46.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T15:48:46.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: mgrmap e13: x(active, since 63s) 2024-09-13T15:48:46.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-13T15:48:46.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: Cluster is now healthy 2024-09-13T15:48:46.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: overall HEALTH_OK 2024-09-13T15:48:46.858 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:46.858 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:46.858 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:46.858 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:46.858 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:46.858 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:46.858 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:46.858 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:46.858 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T15:48:46.858 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T15:48:46.858 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:46 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:47.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: mon.b calling monitor election 2024-09-13T15:48:47.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: Updating smithi193:/var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T15:48:47.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: Updating smithi189:/var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T15:48:47.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: Updating smithi017:/var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T15:48:47.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: mon.b calling monitor election 2024-09-13T15:48:47.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: mon.c calling monitor election 2024-09-13T15:48:47.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: mon.a calling monitor election 2024-09-13T15:48:47.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-13T15:48:47.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: monmap e3: 3 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0],b=[v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0],c=[v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T15:48:47.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: fsmap 2024-09-13T15:48:47.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T15:48:47.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: mgrmap e13: x(active, since 63s) 2024-09-13T15:48:47.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-13T15:48:47.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: Cluster is now healthy 2024-09-13T15:48:47.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: overall HEALTH_OK 2024-09-13T15:48:47.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:47.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:47.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:47.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:47.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:47.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:47.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:47.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:47.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T15:48:47.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T15:48:47.006 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:46 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:47.632 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-13T15:48:47.632 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T15:48:47.632 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T15:48:47.691 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T15:48:47.691 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T15:48:47.787 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-13T15:48:47.787 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T15:48:47.805 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:47 smithi017 ceph-mon[30494]: Reconfiguring mon.a (unknown last config time)... 2024-09-13T15:48:47.805 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:47 smithi017 ceph-mon[30494]: Reconfiguring daemon mon.a on smithi017 2024-09-13T15:48:47.805 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:47 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:47.806 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:47 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1667970897' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:47.806 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:47 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:47.816 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:47 smithi189 ceph-mon[34790]: Reconfiguring mon.a (unknown last config time)... 2024-09-13T15:48:47.816 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:47 smithi189 ceph-mon[34790]: Reconfiguring daemon mon.a on smithi017 2024-09-13T15:48:47.816 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:47 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:47.816 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:47 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1667970897' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:47.816 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:47 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:47.821 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-13T15:48:47.821 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T15:48:47.890 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-13T15:48:47.890 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T15:48:47.918 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:47 smithi193 ceph-mon[35248]: Reconfiguring mon.a (unknown last config time)... 2024-09-13T15:48:47.919 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:47 smithi193 ceph-mon[35248]: Reconfiguring daemon mon.a on smithi017 2024-09-13T15:48:47.919 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:47 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:48:47.919 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:47 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1667970897' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:47.919 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:47 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:47.924 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-13T15:48:47.924 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T15:48:47.992 INFO:tasks.cephadm:Adding mgr.x on smithi017 2024-09-13T15:48:47.992 INFO:tasks.cephadm:Adding mgr.y on smithi189 2024-09-13T15:48:47.992 INFO:tasks.cephadm:Adding mgr.z on smithi193 2024-09-13T15:48:47.993 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi017=x;smithi189=y;smithi193=z' 2024-09-13T15:48:48.230 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T15:48:48.624 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:48 smithi193 ceph-mon[35248]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:48.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:48 smithi017 ceph-mon[30494]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:48.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:48 smithi189 ceph-mon[34790]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:49.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.645+0000 7f404207f640 1 -- 172.21.15.193:0/3783610863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f403c100400 msgr2=0x7f403c1027f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:49.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.645+0000 7f404207f640 1 --2- 172.21.15.193:0/3783610863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f403c100400 0x7f403c1027f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f402c009880 tx=0x7f402c02a5d0 comp rx=0 tx=0).stop 2024-09-13T15:48:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.645+0000 7f404207f640 1 -- 172.21.15.193:0/3783610863 shutdown_connections 2024-09-13T15:48:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.645+0000 7f404207f640 1 --2- 172.21.15.193:0/3783610863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f403c100400 0x7f403c1027f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.645+0000 7f404207f640 1 -- 172.21.15.193:0/3783610863 >> 172.21.15.193:0/3783610863 conn(0x7f403c0f9fa0 msgr2=0x7f403c0fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:48:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.645+0000 7f404207f640 1 -- 172.21.15.193:0/3783610863 shutdown_connections 2024-09-13T15:48:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.645+0000 7f404207f640 1 -- 172.21.15.193:0/3783610863 wait complete. 2024-09-13T15:48:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.646+0000 7f404207f640 1 Processor -- start 2024-09-13T15:48:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.646+0000 7f404207f640 1 -- start start 2024-09-13T15:48:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.646+0000 7f404207f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f403c100400 0x7f403c194e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.646+0000 7f404207f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f403c1953c0 0x7f403c19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.646+0000 7f404207f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f403c195840 0x7f403c19c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.646+0000 7f404207f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c19d150 con 0x7f403c100400 2024-09-13T15:48:49.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.646+0000 7f404207f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c19d2c0 con 0x7f403c195840 2024-09-13T15:48:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.646+0000 7f404207f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c19d480 con 0x7f403c1953c0 2024-09-13T15:48:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.646+0000 7f403affd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f403c1953c0 0x7f403c19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.647+0000 7f403affd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f403c1953c0 0x7f403c19a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:57200/0 (socket says 172.21.15.193:57200) 2024-09-13T15:48:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.647+0000 7f403affd640 1 -- 172.21.15.193:0/1378017723 learned_addr learned my addr 172.21.15.193:0/1378017723 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-13T15:48:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.647+0000 7f403b7fe640 1 --2- 172.21.15.193:0/1378017723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f403c100400 0x7f403c194e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.647+0000 7f403bfff640 1 --2- 172.21.15.193:0/1378017723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f403c195840 0x7f403c19c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.647+0000 7f403affd640 1 -- 172.21.15.193:0/1378017723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f403c195840 msgr2=0x7f403c19c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.647+0000 7f403affd640 1 --2- 172.21.15.193:0/1378017723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f403c195840 0x7f403c19c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.647+0000 7f403affd640 1 -- 172.21.15.193:0/1378017723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f403c100400 msgr2=0x7f403c194e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.647+0000 7f403affd640 1 --2- 172.21.15.193:0/1378017723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f403c100400 0x7f403c194e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.647+0000 7f403affd640 1 -- 172.21.15.193:0/1378017723 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402c009560 con 0x7f403c1953c0 2024-09-13T15:48:49.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.647+0000 7f403bfff640 1 --2- 172.21.15.193:0/1378017723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f403c195840 0x7f403c19c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:48:49.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.647+0000 7f403affd640 1 --2- 172.21.15.193:0/1378017723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f403c1953c0 0x7f403c19a430 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f403000bb00 tx=0x7f4030009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:48:49.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.647+0000 7f4038ff9640 1 -- 172.21.15.193:0/1378017723 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4030003b90 con 0x7f403c1953c0 2024-09-13T15:48:49.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.647+0000 7f4038ff9640 1 -- 172.21.15.193:0/1378017723 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f40300099b0 con 0x7f403c1953c0 2024-09-13T15:48:49.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.647+0000 7f4038ff9640 1 -- 172.21.15.193:0/1378017723 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40300045e0 con 0x7f403c1953c0 2024-09-13T15:48:49.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.647+0000 7f404207f640 1 -- 172.21.15.193:0/1378017723 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f403c19d760 con 0x7f403c1953c0 2024-09-13T15:48:49.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.647+0000 7f404207f640 1 -- 172.21.15.193:0/1378017723 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403c19dc90 con 0x7f403c1953c0 2024-09-13T15:48:49.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.648+0000 7f4038ff9640 1 -- 172.21.15.193:0/1378017723 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f403001d440 con 0x7f403c1953c0 2024-09-13T15:48:49.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.648+0000 7f4038ff9640 1 --2- 172.21.15.193:0/1378017723 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4024038b90 0x7f402403b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:48:49.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.648+0000 7f4038ff9640 1 -- 172.21.15.193:0/1378017723 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f403004a8f0 con 0x7f403c1953c0 2024-09-13T15:48:49.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.648+0000 7f404207f640 1 -- 172.21.15.193:0/1378017723 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f403c18e5c0 con 0x7f403c1953c0 2024-09-13T15:48:49.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.649+0000 7f403b7fe640 1 --2- 172.21.15.193:0/1378017723 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4024038b90 0x7f402403b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:48:49.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.649+0000 7f403b7fe640 1 --2- 172.21.15.193:0/1378017723 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4024038b90 0x7f402403b050 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f402c000c00 tx=0x7f402c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:48:49.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.653+0000 7f4038ff9640 1 -- 172.21.15.193:0/1378017723 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4030012930 con 0x7f403c1953c0 2024-09-13T15:48:49.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:49 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:49.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:49 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:49.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:49 smithi193 ceph-mon[35248]: Reconfiguring mon.b (monmap changed)... 2024-09-13T15:48:49.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:49 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T15:48:49.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:49 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T15:48:49.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:49 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:49.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:49 smithi193 ceph-mon[35248]: Reconfiguring daemon mon.b on smithi189 2024-09-13T15:48:49.808 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:49 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:49.808 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:49 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:49.808 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:49 smithi189 ceph-mon[34790]: Reconfiguring mon.b (monmap changed)... 2024-09-13T15:48:49.808 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:49 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T15:48:49.808 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:49 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T15:48:49.808 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:49 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:49.808 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:49 smithi189 ceph-mon[34790]: Reconfiguring daemon mon.b on smithi189 2024-09-13T15:48:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.828+0000 7f404207f640 1 -- 172.21.15.193:0/1378017723 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi189=y;smithi193=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f403c02c450 con 0x7f4024038b90 2024-09-13T15:48:49.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.835+0000 7f4038ff9640 1 -- 172.21.15.193:0/1378017723 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f403c02c450 con 0x7f4024038b90 2024-09-13T15:48:49.836 INFO:teuthology.orchestra.run.smithi193.stdout:Scheduled mgr update... 2024-09-13T15:48:49.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.837+0000 7f404207f640 1 -- 172.21.15.193:0/1378017723 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4024038b90 msgr2=0x7f402403b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:49.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.837+0000 7f404207f640 1 --2- 172.21.15.193:0/1378017723 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4024038b90 0x7f402403b050 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f402c000c00 tx=0x7f402c0314a0 comp rx=0 tx=0).stop 2024-09-13T15:48:49.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.837+0000 7f404207f640 1 -- 172.21.15.193:0/1378017723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f403c1953c0 msgr2=0x7f403c19a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:48:49.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.837+0000 7f404207f640 1 --2- 172.21.15.193:0/1378017723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f403c1953c0 0x7f403c19a430 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f403000bb00 tx=0x7f4030009f70 comp rx=0 tx=0).stop 2024-09-13T15:48:49.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.837+0000 7f404207f640 1 -- 172.21.15.193:0/1378017723 shutdown_connections 2024-09-13T15:48:49.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.837+0000 7f404207f640 1 --2- 172.21.15.193:0/1378017723 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4024038b90 0x7f402403b050 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:49.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.837+0000 7f404207f640 1 --2- 172.21.15.193:0/1378017723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f403c195840 0x7f403c19c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:49.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.837+0000 7f404207f640 1 --2- 172.21.15.193:0/1378017723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f403c1953c0 0x7f403c19a430 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:49.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.837+0000 7f404207f640 1 --2- 172.21.15.193:0/1378017723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f403c100400 0x7f403c194e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:48:49.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.837+0000 7f404207f640 1 -- 172.21.15.193:0/1378017723 >> 172.21.15.193:0/1378017723 conn(0x7f403c0f9fa0 msgr2=0x7f403c0fab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:48:49.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.837+0000 7f404207f640 1 -- 172.21.15.193:0/1378017723 shutdown_connections 2024-09-13T15:48:49.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:48:49.837+0000 7f404207f640 1 -- 172.21.15.193:0/1378017723 wait complete. 2024-09-13T15:48:50.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:49 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:50.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:49 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:50.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:49 smithi017 ceph-mon[30494]: Reconfiguring mon.b (monmap changed)... 2024-09-13T15:48:50.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:49 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T15:48:50.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:49 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T15:48:50.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:49 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:50.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:49 smithi017 ceph-mon[30494]: Reconfiguring daemon mon.b on smithi189 2024-09-13T15:48:51.096 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:50 smithi193 ceph-mon[35248]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi189=y;smithi193=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:48:51.096 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:50 smithi193 ceph-mon[35248]: Saving service mgr spec with placement smithi017=x;smithi189=y;smithi193=z;count:3 2024-09-13T15:48:51.096 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:50 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:51.096 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:50 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:51.096 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:50 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:51.096 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:50 smithi193 ceph-mon[35248]: Reconfiguring mon.c (monmap changed)... 2024-09-13T15:48:51.096 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:50 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T15:48:51.096 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:50 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T15:48:51.096 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:50 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:51.096 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:50 smithi193 ceph-mon[35248]: Reconfiguring daemon mon.c on smithi193 2024-09-13T15:48:51.096 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:50 smithi193 ceph-mon[35248]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:51.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:50 smithi189 ceph-mon[34790]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi189=y;smithi193=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:48:51.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:50 smithi189 ceph-mon[34790]: Saving service mgr spec with placement smithi017=x;smithi189=y;smithi193=z;count:3 2024-09-13T15:48:51.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:50 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:51.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:50 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:51.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:50 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:51.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:50 smithi189 ceph-mon[34790]: Reconfiguring mon.c (monmap changed)... 2024-09-13T15:48:51.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:50 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T15:48:51.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:50 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T15:48:51.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:50 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:51.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:50 smithi189 ceph-mon[34790]: Reconfiguring daemon mon.c on smithi193 2024-09-13T15:48:51.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:50 smithi189 ceph-mon[34790]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:51.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:50 smithi017 ceph-mon[30494]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi189=y;smithi193=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:48:51.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:50 smithi017 ceph-mon[30494]: Saving service mgr spec with placement smithi017=x;smithi189=y;smithi193=z;count:3 2024-09-13T15:48:51.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:50 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:51.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:50 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:51.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:50 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:51.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:50 smithi017 ceph-mon[30494]: Reconfiguring mon.c (monmap changed)... 2024-09-13T15:48:51.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:50 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T15:48:51.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:50 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T15:48:51.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:50 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:51.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:50 smithi017 ceph-mon[30494]: Reconfiguring daemon mon.c on smithi193 2024-09-13T15:48:51.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:50 smithi017 ceph-mon[30494]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:51.530 DEBUG:teuthology.orchestra.run.smithi189:mgr.y> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mgr.y.service 2024-09-13T15:48:51.532 DEBUG:teuthology.orchestra.run.smithi193:mgr.z> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mgr.z.service 2024-09-13T15:48:51.535 INFO:tasks.cephadm:Deploying OSDs... 2024-09-13T15:48:51.535 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T15:48:51.535 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T15:48:51.570 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T15:48:51.571 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_1 2024-09-13T15:48:51.645 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T15:48:51.645 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:48:51.645 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-09-13T15:48:51.646 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:48:51.646 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T15:48:51.646 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-13 15:47:56.347719118 +0000 2024-09-13T15:48:51.646 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-13 15:43:20.764101772 +0000 2024-09-13T15:48:51.646 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-13 15:43:20.764101772 +0000 2024-09-13T15:48:51.646 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-13 15:43:20.764101772 +0000 2024-09-13T15:48:51.646 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T15:48:51.740 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-13T15:48:51.741 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-13T15:48:51.741 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.00018198 s, 2.8 MB/s 2024-09-13T15:48:51.743 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T15:48:51.782 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_2 2024-09-13T15:48:51.858 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T15:48:51.858 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:48:51.858 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-09-13T15:48:51.858 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:48:51.859 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T15:48:51.859 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-13 15:47:56.394718636 +0000 2024-09-13T15:48:51.859 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-13 15:43:21.222097152 +0000 2024-09-13T15:48:51.859 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-13 15:43:21.222097152 +0000 2024-09-13T15:48:51.859 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-13 15:43:21.222097152 +0000 2024-09-13T15:48:51.859 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T15:48:51.952 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-13T15:48:51.952 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-13T15:48:51.952 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000183561 s, 2.8 MB/s 2024-09-13T15:48:51.954 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T15:48:51.991 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_3 2024-09-13T15:48:52.067 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T15:48:52.067 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:48:52.067 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-09-13T15:48:52.067 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:48:52.067 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T15:48:52.067 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-13 15:47:56.436718206 +0000 2024-09-13T15:48:52.067 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-13 15:43:21.688092453 +0000 2024-09-13T15:48:52.067 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-13 15:43:21.688092453 +0000 2024-09-13T15:48:52.067 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-13 15:43:21.688092453 +0000 2024-09-13T15:48:52.068 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T15:48:52.161 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-13T15:48:52.161 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-13T15:48:52.161 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000181976 s, 2.8 MB/s 2024-09-13T15:48:52.163 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T15:48:52.200 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_4 2024-09-13T15:48:52.275 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T15:48:52.276 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:48:52.276 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-09-13T15:48:52.276 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:48:52.276 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T15:48:52.276 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-13 15:47:56.477717785 +0000 2024-09-13T15:48:52.276 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-13 15:43:22.144087854 +0000 2024-09-13T15:48:52.276 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-13 15:43:22.144087854 +0000 2024-09-13T15:48:52.276 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-13 15:43:22.144087854 +0000 2024-09-13T15:48:52.276 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T15:48:52.369 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-13T15:48:52.369 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-13T15:48:52.369 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000182402 s, 2.8 MB/s 2024-09-13T15:48:52.372 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T15:48:52.408 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-13T15:48:52.408 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T15:48:52.428 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T15:48:52.428 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_1 2024-09-13T15:48:52.434 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:52.434 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:52.434 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:48:52.434 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:52.434 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:48:52.434 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:52.434 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T15:48:52.434 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T15:48:52.435 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T15:48:52.435 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:52.487 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T15:48:52.487 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:48:52.487 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-13T15:48:52.487 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:48:52.487 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T15:48:52.487 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-13 15:48:38.088901013 +0000 2024-09-13T15:48:52.487 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-13 15:42:42.451925090 +0000 2024-09-13T15:48:52.487 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-13 15:42:42.451925090 +0000 2024-09-13T15:48:52.487 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-13 15:42:42.451925090 +0000 2024-09-13T15:48:52.488 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T15:48:52.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:52.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:52.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:48:52.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:52.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:48:52.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:52.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T15:48:52.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T15:48:52.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T15:48:52.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:52.552 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:52.552 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:52.552 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:48:52.553 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:52.553 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:48:52.553 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:52.553 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T15:48:52.553 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T15:48:52.553 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T15:48:52.553 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:52.555 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-13T15:48:52.555 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-13T15:48:52.555 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000227994 s, 2.2 MB/s 2024-09-13T15:48:52.556 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T15:48:52.614 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_2 2024-09-13T15:48:52.671 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T15:48:52.671 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:48:52.671 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-13T15:48:52.672 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:48:52.672 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T15:48:52.672 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-13 15:48:38.088901013 +0000 2024-09-13T15:48:52.672 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-13 15:42:42.791918572 +0000 2024-09-13T15:48:52.672 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-13 15:42:42.792918553 +0000 2024-09-13T15:48:52.672 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-13 15:42:42.791918572 +0000 2024-09-13T15:48:52.672 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T15:48:52.736 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-13T15:48:52.737 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-13T15:48:52.737 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.00020706 s, 2.5 MB/s 2024-09-13T15:48:52.738 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T15:48:52.796 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_3 2024-09-13T15:48:52.852 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T15:48:52.853 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:48:52.853 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-13T15:48:52.853 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:48:52.853 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T15:48:52.853 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-13 15:48:38.089900994 +0000 2024-09-13T15:48:52.853 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-13 15:42:43.118912304 +0000 2024-09-13T15:48:52.853 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-13 15:42:43.118912304 +0000 2024-09-13T15:48:52.853 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-13 15:42:43.118912304 +0000 2024-09-13T15:48:52.853 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T15:48:52.917 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-13T15:48:52.918 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-13T15:48:52.918 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000205596 s, 2.5 MB/s 2024-09-13T15:48:52.919 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T15:48:52.976 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_4 2024-09-13T15:48:53.032 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T15:48:53.032 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:48:53.032 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-13T15:48:53.032 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:48:53.032 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T15:48:53.032 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-13 15:48:38.089900994 +0000 2024-09-13T15:48:53.032 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-13 15:42:43.461905728 +0000 2024-09-13T15:48:53.033 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-13 15:42:43.461905728 +0000 2024-09-13T15:48:53.033 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-13 15:42:43.461905728 +0000 2024-09-13T15:48:53.033 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T15:48:53.096 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-13T15:48:53.096 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-13T15:48:53.097 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000218043 s, 2.3 MB/s 2024-09-13T15:48:53.097 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T15:48:53.154 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-13T15:48:53.154 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T15:48:53.178 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T15:48:53.178 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_1 2024-09-13T15:48:53.233 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T15:48:53.234 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:48:53.234 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-13T15:48:53.234 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:48:53.234 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T15:48:53.234 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-13 15:48:29.240453705 +0000 2024-09-13T15:48:53.234 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-13 15:42:47.698301021 +0000 2024-09-13T15:48:53.235 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-13 15:42:47.698301021 +0000 2024-09-13T15:48:53.235 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-09-13 15:42:47.698301021 +0000 2024-09-13T15:48:53.235 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T15:48:53.296 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:53 smithi193 ceph-mon[35248]: Deploying daemon mgr.z on smithi193 2024-09-13T15:48:53.297 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:53 smithi193 ceph-mon[35248]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:53.303 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-13T15:48:53.303 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-13T15:48:53.303 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.00024976 s, 2.0 MB/s 2024-09-13T15:48:53.304 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T15:48:53.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:53 smithi189 ceph-mon[34790]: Deploying daemon mgr.z on smithi193 2024-09-13T15:48:53.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:53 smithi189 ceph-mon[34790]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:53.367 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_2 2024-09-13T15:48:53.422 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T15:48:53.423 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:48:53.423 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-13T15:48:53.423 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:48:53.423 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T15:48:53.423 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-13 15:48:53.239076015 +0000 2024-09-13T15:48:53.423 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-13 15:42:48.016296045 +0000 2024-09-13T15:48:53.424 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-13 15:42:48.016296045 +0000 2024-09-13T15:48:53.424 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-09-13 15:42:48.016296045 +0000 2024-09-13T15:48:53.424 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T15:48:53.493 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-13T15:48:53.494 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-13T15:48:53.494 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.00019656 s, 2.6 MB/s 2024-09-13T15:48:53.495 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T15:48:53.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:53 smithi017 ceph-mon[30494]: Deploying daemon mgr.z on smithi193 2024-09-13T15:48:53.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:53 smithi017 ceph-mon[30494]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:53.552 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_3 2024-09-13T15:48:53.608 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T15:48:53.609 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:48:53.609 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-13T15:48:53.609 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:48:53.609 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T15:48:53.609 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-13 15:48:53.425073088 +0000 2024-09-13T15:48:53.609 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-13 15:42:48.348290850 +0000 2024-09-13T15:48:53.609 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-13 15:42:48.348290850 +0000 2024-09-13T15:48:53.609 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-09-13 15:42:48.348290850 +0000 2024-09-13T15:48:53.609 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T15:48:53.674 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-13T15:48:53.675 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-13T15:48:53.675 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000239777 s, 2.1 MB/s 2024-09-13T15:48:53.676 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T15:48:53.733 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_4 2024-09-13T15:48:53.788 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T15:48:53.788 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:48:53.789 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-13T15:48:53.789 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:48:53.789 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T15:48:53.789 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-13 15:48:53.426073073 +0000 2024-09-13T15:48:53.789 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-13 15:42:48.676285717 +0000 2024-09-13T15:48:53.789 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-13 15:42:48.676285717 +0000 2024-09-13T15:48:53.789 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-09-13 15:42:48.676285717 +0000 2024-09-13T15:48:53.789 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T15:48:53.865 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-13T15:48:53.865 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-13T15:48:53.865 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000197532 s, 2.6 MB/s 2024-09-13T15:48:53.866 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T15:48:53.922 INFO:tasks.cephadm:Deploying osd.0 on smithi017 with /dev/vg_nvme/lv_4... 2024-09-13T15:48:53.922 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-13T15:48:53.935 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:53 smithi193 podman[36952]: 2024-09-13 15:48:53.910999259 +0000 UTC m=+0.321237954 container start 6190eecc54c947d685a48f675a496487e4b4ca947e188903231200d046252fcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T15:48:54.249 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:53 smithi193 ceph-mgr[37061]: -- 172.21.15.193:0/1533992961 <== mon.1 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5624a4b64d00 con 0x5624a4b38800 2024-09-13T15:48:54.249 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:54 smithi193 bash[36952]: 6190eecc54c947d685a48f675a496487e4b4ca947e188903231200d046252fcc 2024-09-13T15:48:54.249 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:54 smithi193 systemd[1]: Started Ceph mgr.z for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T15:48:54.249 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:54 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:54.031+0000 7f665d6d2040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T15:48:54.249 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:54 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:54.093+0000 7f665d6d2040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T15:48:54.249 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:54 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:54.247+0000 7f665d6d2040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T15:48:54.250 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:48:54.504 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:54 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:54.317+0000 7f665d6d2040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T15:48:54.504 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:54 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:54.468+0000 7f665d6d2040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T15:48:54.934 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:54 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:54.614+0000 7f665d6d2040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T15:48:54.934 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:54 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:54.933+0000 7f665d6d2040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T15:48:55.254 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:54 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:54.994+0000 7f665d6d2040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T15:48:55.254 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:55 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:55.182+0000 7f665d6d2040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T15:48:55.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:55 smithi193 ceph-mon[35248]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:55.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:55 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:55.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:55 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:55.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:55 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:55.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:55 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T15:48:55.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:55 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T15:48:55.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:55 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T15:48:55.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:55 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:55.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:55 smithi193 ceph-mon[35248]: Deploying daemon mgr.y on smithi189 2024-09-13T15:48:55.347 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:55 smithi189 ceph-mon[34790]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:55.347 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:55 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:55.347 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:55 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:55.347 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:55 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:55.347 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:55 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T15:48:55.347 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:55 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T15:48:55.347 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:55 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T15:48:55.347 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:55 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:55.347 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:55 smithi189 ceph-mon[34790]: Deploying daemon mgr.y on smithi189 2024-09-13T15:48:55.429 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:55 smithi017 ceph-mon[30494]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:55.429 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:55 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:55.429 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:55 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:55.429 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:55 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:55.429 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:55 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T15:48:55.429 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:55 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T15:48:55.430 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:55 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T15:48:55.430 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:55 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:55.430 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:55 smithi017 ceph-mon[30494]: Deploying daemon mgr.y on smithi189 2024-09-13T15:48:56.007 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:55 smithi189 systemd[1]: Starting Ceph mgr.y for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T15:48:56.315 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-13T15:48:56.322 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:56 smithi189 podman[36150]: 2024-09-13 15:48:55.908609555 +0000 UTC m=+0.015833677 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T15:48:56.323 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:56 smithi189 podman[36150]: 2024-09-13 15:48:56.006965669 +0000 UTC m=+0.114189779 container create 7de588e4c513418a210aa618801c98cde3cc3d0b0b2e43c2c0f799141915d87f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-13T15:48:56.323 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:56 smithi189 podman[36150]: 2024-09-13 15:48:56.184518584 +0000 UTC m=+0.291742694 container init 7de588e4c513418a210aa618801c98cde3cc3d0b0b2e43c2c0f799141915d87f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-13T15:48:56.323 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:56 smithi189 podman[36150]: 2024-09-13 15:48:56.188244174 +0000 UTC m=+0.295468293 container start 7de588e4c513418a210aa618801c98cde3cc3d0b0b2e43c2c0f799141915d87f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T15:48:56.323 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:56 smithi189 ceph-mgr[36170]: -- 172.21.15.189:0/4100348772 <== mon.2 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557754276d00 con 0x55775424b400 2024-09-13T15:48:56.323 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:56 smithi189 bash[36150]: 7de588e4c513418a210aa618801c98cde3cc3d0b0b2e43c2c0f799141915d87f 2024-09-13T15:48:56.323 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:56 smithi189 systemd[1]: Started Ceph mgr.y for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T15:48:56.443 INFO:teuthology.orchestra.run.smithi017.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-13T15:48:56.478 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10+0 records in 2024-09-13T15:48:56.478 INFO:teuthology.orchestra.run.smithi017.stderr:10+0 records out 2024-09-13T15:48:56.478 INFO:teuthology.orchestra.run.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0286837 s, 366 MB/s 2024-09-13T15:48:56.478 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 2024-09-13T15:48:56.478 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping successful for: 2024-09-13T15:48:56.504 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:56 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:56.048+0000 7f665d6d2040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T15:48:56.504 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:56 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:56.113+0000 7f665d6d2040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T15:48:56.583 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:56 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:48:56.321+0000 7f033c64d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T15:48:56.583 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:56 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:48:56.381+0000 7f033c64d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T15:48:56.584 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:56 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:48:56.540+0000 7f033c64d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T15:48:56.856 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:56 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:48:56.611+0000 7f033c64d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T15:48:56.856 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:56 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:48:56.781+0000 7f033c64d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T15:48:57.117 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:56 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:56.861+0000 7f665d6d2040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T15:48:57.117 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:56 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:56.975+0000 7f665d6d2040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T15:48:57.117 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:57 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:57.115+0000 7f665d6d2040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T15:48:57.117 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:57 smithi193 ceph-mon[35248]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:57.117 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:57 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:57.117 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:57 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:57.118 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:57 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:57.118 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:57 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:57.118 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:57 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:48:57.174 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi017:vg_nvme/lv_4 2024-09-13T15:48:57.238 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:56 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:48:56.930+0000 7f033c64d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T15:48:57.238 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:57 smithi189 ceph-mon[34790]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:57.238 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:57 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:57.238 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:57 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:57.238 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:57 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:57.238 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:57 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:57.238 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:57 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:48:57.403 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:57 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:57.179+0000 7f665d6d2040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T15:48:57.403 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:57 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:57.332+0000 7f665d6d2040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T15:48:57.403 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:57 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:57.401+0000 7f665d6d2040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T15:48:57.492 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:48:57.503 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:57 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:48:57.251+0000 7f033c64d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T15:48:57.503 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:57 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:48:57.313+0000 7f033c64d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T15:48:57.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:57 smithi017 ceph-mon[30494]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:57.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:57 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:57.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:57 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:57.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:57 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:57.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:57 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:57.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:57 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:48:57.690 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:57 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:57.461+0000 7f665d6d2040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T15:48:57.690 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:57 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:57.624+0000 7f665d6d2040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T15:48:57.690 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:57 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:57.688+0000 7f665d6d2040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T15:48:57.856 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:57 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:48:57.501+0000 7f033c64d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T15:48:57.955 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:57 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:57.757+0000 7f665d6d2040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T15:48:57.955 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:57 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:57.839+0000 7f665d6d2040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T15:48:57.956 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:57 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:57.897+0000 7f665d6d2040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T15:48:57.956 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:57 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:57.954+0000 7f665d6d2040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T15:48:58.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:58 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:58.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:58 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:58.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:58 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:58.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:58 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:58.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:58 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:58.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:58 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:58.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:58 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:48:58.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:58 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:58.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:58 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T15:48:58.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:58 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T15:48:58.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:58 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:58.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:58 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:58.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:58 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:58.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:58 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:58.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:58 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:58.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:58 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:58.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:58 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:58.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:58 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:48:58.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:58 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:58.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:58 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T15:48:58.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:58 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T15:48:58.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:58 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:58.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:58 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:58.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:58 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:58.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:58 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:58.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:58 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:58.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:58 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:58.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:58 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:58.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:58 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:48:58.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:58 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:48:58.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:58 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T15:48:58.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:58 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T15:48:58.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:58 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:48:58.856 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:58 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:48:58.383+0000 7f033c64d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T15:48:58.856 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:58 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:48:58.447+0000 7f033c64d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T15:48:59.004 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 15:48:58 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z[37035]: 2024-09-13T15:48:58.722+0000 7f665d6d2040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T15:48:59.266 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:59 smithi017 ceph-mon[30494]: Reconfiguring mgr.x (unknown last config time)... 2024-09-13T15:48:59.266 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:59 smithi017 ceph-mon[30494]: Reconfiguring daemon mgr.x on smithi017 2024-09-13T15:48:59.266 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:59 smithi017 ceph-mon[30494]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:59.266 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:59 smithi017 ceph-mon[30494]: Standby manager daemon z started 2024-09-13T15:48:59.266 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:59 smithi017 ceph-mon[30494]: from='mgr.? 172.21.15.193:0/64655152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-13T15:48:59.266 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:59 smithi017 ceph-mon[30494]: from='mgr.? 172.21.15.193:0/64655152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T15:48:59.266 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:59 smithi017 ceph-mon[30494]: from='mgr.? 172.21.15.193:0/64655152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-13T15:48:59.266 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:48:59 smithi017 ceph-mon[30494]: from='mgr.? 172.21.15.193:0/64655152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T15:48:59.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:59 smithi189 ceph-mon[34790]: Reconfiguring mgr.x (unknown last config time)... 2024-09-13T15:48:59.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:59 smithi189 ceph-mon[34790]: Reconfiguring daemon mgr.x on smithi017 2024-09-13T15:48:59.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:59 smithi189 ceph-mon[34790]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:59.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:59 smithi189 ceph-mon[34790]: Standby manager daemon z started 2024-09-13T15:48:59.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:59 smithi189 ceph-mon[34790]: from='mgr.? 172.21.15.193:0/64655152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-13T15:48:59.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:59 smithi189 ceph-mon[34790]: from='mgr.? 172.21.15.193:0/64655152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T15:48:59.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:59 smithi189 ceph-mon[34790]: from='mgr.? 172.21.15.193:0/64655152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-13T15:48:59.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:48:59 smithi189 ceph-mon[34790]: from='mgr.? 172.21.15.193:0/64655152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T15:48:59.357 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:59 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:48:59.161+0000 7f033c64d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T15:48:59.357 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:59 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:48:59.275+0000 7f033c64d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T15:48:59.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:59 smithi193 ceph-mon[35248]: Reconfiguring mgr.x (unknown last config time)... 2024-09-13T15:48:59.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:59 smithi193 ceph-mon[35248]: Reconfiguring daemon mgr.x on smithi017 2024-09-13T15:48:59.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:59 smithi193 ceph-mon[35248]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:48:59.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:59 smithi193 ceph-mon[35248]: Standby manager daemon z started 2024-09-13T15:48:59.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:59 smithi193 ceph-mon[35248]: from='mgr.? 172.21.15.193:0/64655152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-13T15:48:59.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:59 smithi193 ceph-mon[35248]: from='mgr.? 172.21.15.193:0/64655152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T15:48:59.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:59 smithi193 ceph-mon[35248]: from='mgr.? 172.21.15.193:0/64655152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-13T15:48:59.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:48:59 smithi193 ceph-mon[35248]: from='mgr.? 172.21.15.193:0/64655152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T15:48:59.694 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:59 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:48:59.416+0000 7f033c64d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T15:48:59.694 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:59 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:48:59.477+0000 7f033c64d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T15:48:59.694 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:59 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:48:59.624+0000 7f033c64d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T15:48:59.694 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:59 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:48:59.692+0000 7f033c64d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T15:48:59.973 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:59 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:48:59.751+0000 7f033c64d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T15:48:59.973 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:59 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:48:59.907+0000 7f033c64d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T15:48:59.973 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:48:59 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:48:59.972+0000 7f033c64d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T15:49:00.240 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:49:00 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:49:00.038+0000 7f033c64d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T15:49:00.240 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:49:00 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:49:00.120+0000 7f033c64d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T15:49:00.240 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:49:00 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:49:00.180+0000 7f033c64d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T15:49:00.240 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:49:00 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:49:00.238+0000 7f033c64d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T15:49:00.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.310+0000 7fd8b3600640 1 -- 172.21.15.17:0/3746398603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8ac103200 msgr2=0x7fd8ac103680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:49:00.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.310+0000 7fd8b3600640 1 --2- 172.21.15.17:0/3746398603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8ac103200 0x7fd8ac103680 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd894009900 tx=0x7fd89402a410 comp rx=0 tx=0).stop 2024-09-13T15:49:00.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.310+0000 7fd8b3600640 1 -- 172.21.15.17:0/3746398603 shutdown_connections 2024-09-13T15:49:00.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.310+0000 7fd8b3600640 1 --2- 172.21.15.17:0/3746398603 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8ac103bc0 0x7fd8ac10a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:00.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.310+0000 7fd8b3600640 1 --2- 172.21.15.17:0/3746398603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8ac103200 0x7fd8ac103680 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:00.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.310+0000 7fd8b3600640 1 --2- 172.21.15.17:0/3746398603 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd8ac102000 0x7fd8ac102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:00.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.310+0000 7fd8b3600640 1 -- 172.21.15.17:0/3746398603 >> 172.21.15.17:0/3746398603 conn(0x7fd8ac0fd790 msgr2=0x7fd8ac0ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:49:00.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.310+0000 7fd8b3600640 1 -- 172.21.15.17:0/3746398603 shutdown_connections 2024-09-13T15:49:00.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.310+0000 7fd8b3600640 1 -- 172.21.15.17:0/3746398603 wait complete. 2024-09-13T15:49:00.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.311+0000 7fd8b3600640 1 Processor -- start 2024-09-13T15:49:00.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.312+0000 7fd8b3600640 1 -- start start 2024-09-13T15:49:00.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.312+0000 7fd8b3600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8ac102000 0x7fd8ac197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:49:00.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.312+0000 7fd8b3600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8ac103200 0x7fd8ac198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:49:00.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.312+0000 7fd8b3600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd8ac103bc0 0x7fd8ac19f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:49:00.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.312+0000 7fd8b3600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac19fa80 con 0x7fd8ac103200 2024-09-13T15:49:00.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.312+0000 7fd8b3600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac19fbf0 con 0x7fd8ac102000 2024-09-13T15:49:00.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.312+0000 7fd8b3600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac19fdb0 con 0x7fd8ac103bc0 2024-09-13T15:49:00.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.312+0000 7fd8b0c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8ac102000 0x7fd8ac197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:49:00.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.312+0000 7fd8b0c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8ac102000 0x7fd8ac197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:45820/0 (socket says 172.21.15.17:45820) 2024-09-13T15:49:00.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.312+0000 7fd8b0c00640 1 -- 172.21.15.17:0/2580416616 learned_addr learned my addr 172.21.15.17:0/2580416616 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:49:00.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.312+0000 7fd8a3e00640 1 --2- 172.21.15.17:0/2580416616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8ac103200 0x7fd8ac198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:49:00.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.312+0000 7fd8b1600640 1 --2- 172.21.15.17:0/2580416616 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd8ac103bc0 0x7fd8ac19f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:49:00.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.313+0000 7fd8b0c00640 1 -- 172.21.15.17:0/2580416616 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd8ac103bc0 msgr2=0x7fd8ac19f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:49:00.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.313+0000 7fd8b0c00640 1 --2- 172.21.15.17:0/2580416616 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd8ac103bc0 0x7fd8ac19f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:00.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.313+0000 7fd8b0c00640 1 -- 172.21.15.17:0/2580416616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8ac103200 msgr2=0x7fd8ac198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:49:00.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.313+0000 7fd8b0c00640 1 --2- 172.21.15.17:0/2580416616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8ac103200 0x7fd8ac198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:00.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.313+0000 7fd8b0c00640 1 -- 172.21.15.17:0/2580416616 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd894009560 con 0x7fd8ac102000 2024-09-13T15:49:00.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.313+0000 7fd8b0c00640 1 --2- 172.21.15.17:0/2580416616 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8ac102000 0x7fd8ac197fd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00e9c0 tx=0x7fd89c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:49:00.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.313+0000 7fd8aa000640 1 -- 172.21.15.17:0/2580416616 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c0096e0 con 0x7fd8ac102000 2024-09-13T15:49:00.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.313+0000 7fd8aa000640 1 -- 172.21.15.17:0/2580416616 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd89c0044f0 con 0x7fd8ac102000 2024-09-13T15:49:00.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.313+0000 7fd8aa000640 1 -- 172.21.15.17:0/2580416616 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c010430 con 0x7fd8ac102000 2024-09-13T15:49:00.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.313+0000 7fd8b3600640 1 -- 172.21.15.17:0/2580416616 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8ac1a0090 con 0x7fd8ac102000 2024-09-13T15:49:00.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.314+0000 7fd8b3600640 1 -- 172.21.15.17:0/2580416616 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8ac1a0510 con 0x7fd8ac102000 2024-09-13T15:49:00.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.315+0000 7fd8b3600640 1 -- 172.21.15.17:0/2580416616 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8ac102400 con 0x7fd8ac102000 2024-09-13T15:49:00.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.316+0000 7fd8aa000640 1 -- 172.21.15.17:0/2580416616 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 14) v1 ==== 90707+0+0 (secure 0 0 0) 0x7fd89c0035f0 con 0x7fd8ac102000 2024-09-13T15:49:00.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.317+0000 7fd8aa000640 1 --2- 172.21.15.17:0/2580416616 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd89006ccc0 0x7fd89006f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:49:00.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.317+0000 7fd8aa000640 1 -- 172.21.15.17:0/2580416616 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd89c014070 con 0x7fd8ac102000 2024-09-13T15:49:00.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.317+0000 7fd8a3e00640 1 --2- 172.21.15.17:0/2580416616 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd89006ccc0 0x7fd89006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:49:00.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.317+0000 7fd8a3e00640 1 --2- 172.21.15.17:0/2580416616 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd89006ccc0 0x7fd89006f180 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd89402aa00 tx=0x7fd8940314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:49:00.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.321+0000 7fd8aa000640 1 -- 172.21.15.17:0/2580416616 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd89c056870 con 0x7fd8ac102000 2024-09-13T15:49:00.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:00.512+0000 7fd8b3600640 1 -- 172.21.15.17:0/2580416616 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8ac02c430 con 0x7fd89006ccc0 2024-09-13T15:49:00.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:00 smithi189 ceph-mon[34790]: mgrmap e14: x(active, since 77s), standbys: z 2024-09-13T15:49:00.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-13T15:49:00.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:00 smithi189 ceph-mon[34790]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:00.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:00.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:00.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:49:00.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:00.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:49:00.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:00.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:49:00.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:49:00.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:01.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:00 smithi193 ceph-mon[35248]: mgrmap e14: x(active, since 77s), standbys: z 2024-09-13T15:49:01.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-13T15:49:01.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:00 smithi193 ceph-mon[35248]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:01.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:01.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:01.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:49:01.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:01.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:49:01.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:01.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:49:01.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:49:01.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:01.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:00 smithi017 ceph-mon[30494]: mgrmap e14: x(active, since 77s), standbys: z 2024-09-13T15:49:01.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-13T15:49:01.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:00 smithi017 ceph-mon[30494]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:01.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:01.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:01.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:49:01.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:01.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:49:01.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:01.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:49:01.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:49:01.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:01.356 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 15:49:01 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y[36165]: 2024-09-13T15:49:01.013+0000 7f033c64d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T15:49:01.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:01.604+0000 7fd8aa000640 1 -- 172.21.15.17:0/2580416616 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7fd89c056c40 con 0x7fd8ac102000 2024-09-13T15:49:01.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:01 smithi189 ceph-mon[34790]: from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:49:01.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:01 smithi189 ceph-mon[34790]: Standby manager daemon y started 2024-09-13T15:49:01.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:01 smithi189 ceph-mon[34790]: from='mgr.? 172.21.15.189:0/1385103354' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-13T15:49:01.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:01 smithi189 ceph-mon[34790]: from='mgr.? 172.21.15.189:0/1385103354' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T15:49:01.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:01 smithi189 ceph-mon[34790]: from='mgr.? 172.21.15.189:0/1385103354' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-13T15:49:01.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:01 smithi189 ceph-mon[34790]: from='mgr.? 172.21.15.189:0/1385103354' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T15:49:02.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:01 smithi193 ceph-mon[35248]: from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:49:02.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:01 smithi193 ceph-mon[35248]: Standby manager daemon y started 2024-09-13T15:49:02.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:01 smithi193 ceph-mon[35248]: from='mgr.? 172.21.15.189:0/1385103354' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-13T15:49:02.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:01 smithi193 ceph-mon[35248]: from='mgr.? 172.21.15.189:0/1385103354' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T15:49:02.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:01 smithi193 ceph-mon[35248]: from='mgr.? 172.21.15.189:0/1385103354' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-13T15:49:02.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:01 smithi193 ceph-mon[35248]: from='mgr.? 172.21.15.189:0/1385103354' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T15:49:02.010 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:01 smithi017 ceph-mon[30494]: from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:49:02.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:01 smithi017 ceph-mon[30494]: Standby manager daemon y started 2024-09-13T15:49:02.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:01 smithi017 ceph-mon[30494]: from='mgr.? 172.21.15.189:0/1385103354' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-13T15:49:02.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:01 smithi017 ceph-mon[30494]: from='mgr.? 172.21.15.189:0/1385103354' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T15:49:02.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:01 smithi017 ceph-mon[30494]: from='mgr.? 172.21.15.189:0/1385103354' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-13T15:49:02.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:01 smithi017 ceph-mon[30494]: from='mgr.? 172.21.15.189:0/1385103354' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T15:49:02.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:02 smithi189 ceph-mon[34790]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-09-13T15:49:02.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:02 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-13T15:49:02.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:02 smithi189 ceph-mon[34790]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:02.905 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:02 smithi017 ceph-mon[30494]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-09-13T15:49:02.905 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:02 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-13T15:49:02.905 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:02 smithi017 ceph-mon[30494]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:03.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:02 smithi193 ceph-mon[35248]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-09-13T15:49:03.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:02 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-13T15:49:03.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:02 smithi193 ceph-mon[35248]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:03.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:03 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1575592832' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d39d6af-15e6-463b-b9ff-a9a5dd94e839"}]: dispatch 2024-09-13T15:49:03.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:03 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1575592832' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d39d6af-15e6-463b-b9ff-a9a5dd94e839"}]': finished 2024-09-13T15:49:03.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:03 smithi017 ceph-mon[30494]: osdmap e5: 1 total, 0 up, 1 in 2024-09-13T15:49:03.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:03 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T15:49:04.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:03 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1575592832' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d39d6af-15e6-463b-b9ff-a9a5dd94e839"}]: dispatch 2024-09-13T15:49:04.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:03 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1575592832' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d39d6af-15e6-463b-b9ff-a9a5dd94e839"}]': finished 2024-09-13T15:49:04.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:03 smithi193 ceph-mon[35248]: osdmap e5: 1 total, 0 up, 1 in 2024-09-13T15:49:04.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:03 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T15:49:04.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:03 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1575592832' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d39d6af-15e6-463b-b9ff-a9a5dd94e839"}]: dispatch 2024-09-13T15:49:04.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:03 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1575592832' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d39d6af-15e6-463b-b9ff-a9a5dd94e839"}]': finished 2024-09-13T15:49:04.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:03 smithi189 ceph-mon[34790]: osdmap e5: 1 total, 0 up, 1 in 2024-09-13T15:49:04.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:03 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T15:49:05.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:04 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1393457504' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:49:05.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:04 smithi193 ceph-mon[35248]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:05.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:04 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1393457504' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:49:05.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:04 smithi017 ceph-mon[30494]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:05.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:04 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1393457504' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:49:05.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:04 smithi189 ceph-mon[34790]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:07.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:07 smithi017 ceph-mon[30494]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:07.457 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:07 smithi189 ceph-mon[34790]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:07.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:07 smithi193 ceph-mon[35248]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:09.317 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:09 smithi017 ceph-mon[30494]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:09.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:09 smithi193 ceph-mon[35248]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:09.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:09 smithi189 ceph-mon[34790]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:11.455 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:11 smithi017 ceph-mon[30494]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:11.455 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:11 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T15:49:11.455 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:11 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:11.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:11 smithi193 ceph-mon[35248]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:11.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:11 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T15:49:11.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:11 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:11.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:11 smithi189 ceph-mon[34790]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:11.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:11 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T15:49:11.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:11 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:12.504 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:12 smithi017 ceph-mon[30494]: Deploying daemon osd.0 on smithi017 2024-09-13T15:49:12.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:12 smithi193 ceph-mon[35248]: Deploying daemon osd.0 on smithi017 2024-09-13T15:49:12.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:12 smithi189 ceph-mon[34790]: Deploying daemon osd.0 on smithi017 2024-09-13T15:49:13.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:13 smithi193 ceph-mon[35248]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:13 smithi017 ceph-mon[30494]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:13.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:13 smithi189 ceph-mon[34790]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:15.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:15 smithi017 ceph-mon[30494]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:15.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:15 smithi193 ceph-mon[35248]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:15.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:15 smithi189 ceph-mon[34790]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:17.370 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:17 smithi017 ceph-mon[30494]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:17.370 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:17 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:49:17.370 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:17 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:17.370 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:17 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:17.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:17 smithi193 ceph-mon[35248]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:17.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:17 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:49:17.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:17 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:17.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:17 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:17.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:17 smithi189 ceph-mon[34790]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:17.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:17 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:49:17.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:17 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:17.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:17 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:19.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:19 smithi193 ceph-mon[35248]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:19.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:19 smithi017 ceph-mon[30494]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:19.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:19 smithi189 ceph-mon[34790]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:21.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:21.016+0000 7fd8aa000640 1 -- 172.21.15.17:0/2580416616 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd8ac02c430 con 0x7fd89006ccc0 2024-09-13T15:49:21.018 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 0 on host 'smithi017' 2024-09-13T15:49:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:21.019+0000 7fd8b3600640 1 -- 172.21.15.17:0/2580416616 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd89006ccc0 msgr2=0x7fd89006f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:49:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:21.019+0000 7fd8b3600640 1 --2- 172.21.15.17:0/2580416616 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd89006ccc0 0x7fd89006f180 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd89402aa00 tx=0x7fd8940314a0 comp rx=0 tx=0).stop 2024-09-13T15:49:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:21.019+0000 7fd8b3600640 1 -- 172.21.15.17:0/2580416616 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8ac102000 msgr2=0x7fd8ac197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:49:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:21.019+0000 7fd8b3600640 1 --2- 172.21.15.17:0/2580416616 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8ac102000 0x7fd8ac197fd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00e9c0 tx=0x7fd89c00ee80 comp rx=0 tx=0).stop 2024-09-13T15:49:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:21.019+0000 7fd8b3600640 1 -- 172.21.15.17:0/2580416616 shutdown_connections 2024-09-13T15:49:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:21.019+0000 7fd8b3600640 1 --2- 172.21.15.17:0/2580416616 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd89006ccc0 0x7fd89006f180 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:21.019+0000 7fd8b3600640 1 --2- 172.21.15.17:0/2580416616 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd8ac103bc0 0x7fd8ac19f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:21.019+0000 7fd8b3600640 1 --2- 172.21.15.17:0/2580416616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8ac103200 0x7fd8ac198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:21.019+0000 7fd8b3600640 1 --2- 172.21.15.17:0/2580416616 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8ac102000 0x7fd8ac197fd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:21.019+0000 7fd8b3600640 1 -- 172.21.15.17:0/2580416616 >> 172.21.15.17:0/2580416616 conn(0x7fd8ac0fd790 msgr2=0x7fd8ac106660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:49:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:21.019+0000 7fd8b3600640 1 -- 172.21.15.17:0/2580416616 shutdown_connections 2024-09-13T15:49:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:49:21.019+0000 7fd8b3600640 1 -- 172.21.15.17:0/2580416616 wait complete. 2024-09-13T15:49:21.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:20 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:21.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:20 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:21.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:20 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:21.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:20 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:49:21.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:20 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:21.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:20 smithi193 ceph-mon[35248]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:21.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:20 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:21.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:20 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:21.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:20 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:21.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:20 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:49:21.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:20 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:21.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:20 smithi017 ceph-mon[30494]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:21.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:20 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:21.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:20 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:21.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:20 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:21.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:20 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:49:21.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:20 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:21.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:20 smithi189 ceph-mon[34790]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:21.707 DEBUG:teuthology.orchestra.run.smithi017:osd.0> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.0.service 2024-09-13T15:49:21.711 INFO:tasks.cephadm:Deploying osd.1 on smithi189 with /dev/vg_nvme/lv_4... 2024-09-13T15:49:21.711 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-13T15:49:21.917 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T15:49:22.037 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:21 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:49:22.037 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:21 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:22.037 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:21 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:22.037 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:21 smithi189 ceph-mon[34790]: from='osd.0 [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T15:49:22.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:21 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:49:22.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:21 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:22.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:21 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:22.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:21 smithi193 ceph-mon[35248]: from='osd.0 [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T15:49:22.254 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:21 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:49:22.255 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:21 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:22.255 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:21 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:22.255 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:21 smithi017 ceph-mon[30494]: from='osd.0 [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T15:49:23.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:23 smithi189 ceph-mon[34790]: from='osd.0 [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T15:49:23.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:23 smithi189 ceph-mon[34790]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T15:49:23.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:23 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T15:49:23.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:23 smithi189 ceph-mon[34790]: from='osd.0 [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-13T15:49:23.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:23 smithi189 ceph-mon[34790]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:23.182 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:23 smithi017 ceph-mon[30494]: from='osd.0 [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T15:49:23.183 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:23 smithi017 ceph-mon[30494]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T15:49:23.183 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:23 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T15:49:23.183 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:23 smithi017 ceph-mon[30494]: from='osd.0 [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-13T15:49:23.183 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:23 smithi017 ceph-mon[30494]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:23.183 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 15:49:23 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-0[44912]: 2024-09-13T15:49:23.043+0000 7f8372e00640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T15:49:23.183 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 15:49:23 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-0[44912]: 2024-09-13T15:49:23.047+0000 7f836d400640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:49:23.414 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:23 smithi193 ceph-mon[35248]: from='osd.0 [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T15:49:23.414 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:23 smithi193 ceph-mon[35248]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T15:49:23.414 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:23 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T15:49:23.415 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:23 smithi193 ceph-mon[35248]: from='osd.0 [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-13T15:49:23.415 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:23 smithi193 ceph-mon[35248]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T15:49:23.737 INFO:teuthology.orchestra.run.smithi189.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-13T15:49:23.823 INFO:teuthology.orchestra.run.smithi189.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-13T15:49:23.838 INFO:teuthology.orchestra.run.smithi189.stderr: stderr: 10+0 records in 2024-09-13T15:49:23.838 INFO:teuthology.orchestra.run.smithi189.stderr:10+0 records out 2024-09-13T15:49:23.838 INFO:teuthology.orchestra.run.smithi189.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.013187 s, 795 MB/s 2024-09-13T15:49:23.838 INFO:teuthology.orchestra.run.smithi189.stderr:--> Zapping successful for: 2024-09-13T15:49:24.297 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:24 smithi189 ceph-mon[34790]: from='osd.0 [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-13T15:49:24.297 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:24 smithi189 ceph-mon[34790]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T15:49:24.297 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:24 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T15:49:24.297 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:24 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T15:49:24.347 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:24 smithi193 ceph-mon[35248]: from='osd.0 [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-13T15:49:24.348 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:24 smithi193 ceph-mon[35248]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T15:49:24.348 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:24 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T15:49:24.348 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:24 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T15:49:24.430 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_4 2024-09-13T15:49:24.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:24 smithi017 ceph-mon[30494]: from='osd.0 [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-13T15:49:24.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:24 smithi017 ceph-mon[30494]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T15:49:24.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:24 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T15:49:24.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:24 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T15:49:24.633 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T15:49:25.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:25 smithi189 ceph-mon[34790]: purged_snaps scrub starts 2024-09-13T15:49:25.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:25 smithi189 ceph-mon[34790]: purged_snaps scrub ok 2024-09-13T15:49:25.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:25 smithi189 ceph-mon[34790]: osd.0 [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212] boot 2024-09-13T15:49:25.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:25 smithi189 ceph-mon[34790]: osdmap e8: 1 total, 1 up, 1 in 2024-09-13T15:49:25.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:25 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T15:49:25.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:25 smithi189 ceph-mon[34790]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:25.415 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:25 smithi017 ceph-mon[30494]: purged_snaps scrub starts 2024-09-13T15:49:25.415 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:25 smithi017 ceph-mon[30494]: purged_snaps scrub ok 2024-09-13T15:49:25.415 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:25 smithi017 ceph-mon[30494]: osd.0 [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212] boot 2024-09-13T15:49:25.415 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:25 smithi017 ceph-mon[30494]: osdmap e8: 1 total, 1 up, 1 in 2024-09-13T15:49:25.415 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:25 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T15:49:25.415 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:25 smithi017 ceph-mon[30494]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:25.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:25 smithi193 ceph-mon[35248]: purged_snaps scrub starts 2024-09-13T15:49:25.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:25 smithi193 ceph-mon[35248]: purged_snaps scrub ok 2024-09-13T15:49:25.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:25 smithi193 ceph-mon[35248]: osd.0 [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212] boot 2024-09-13T15:49:25.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:25 smithi193 ceph-mon[35248]: osdmap e8: 1 total, 1 up, 1 in 2024-09-13T15:49:25.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:25 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T15:49:25.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:25 smithi193 ceph-mon[35248]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:26.151 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.148+0000 7f45fc1a5640 1 -- 172.21.15.189:0/606592539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f4100f60 msgr2=0x7f45f41013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:49:26.152 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.148+0000 7f45fc1a5640 1 --2- 172.21.15.189:0/606592539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f4100f60 0x7f45f41013e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009900 tx=0x7f45f002a410 comp rx=0 tx=0).stop 2024-09-13T15:49:26.152 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.148+0000 7f45fc1a5640 1 -- 172.21.15.189:0/606592539 shutdown_connections 2024-09-13T15:49:26.152 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.148+0000 7f45fc1a5640 1 --2- 172.21.15.189:0/606592539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45f4101920 0x7f45f4108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:26.152 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.148+0000 7f45fc1a5640 1 --2- 172.21.15.189:0/606592539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f4100f60 0x7f45f41013e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:26.152 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.148+0000 7f45fc1a5640 1 --2- 172.21.15.189:0/606592539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45f40ffe00 0x7f45f4100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:26.152 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.148+0000 7f45fc1a5640 1 -- 172.21.15.189:0/606592539 >> 172.21.15.189:0/606592539 conn(0x7f45f40fb5d0 msgr2=0x7f45f40fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:49:26.152 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.148+0000 7f45fc1a5640 1 -- 172.21.15.189:0/606592539 shutdown_connections 2024-09-13T15:49:26.152 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.148+0000 7f45fc1a5640 1 -- 172.21.15.189:0/606592539 wait complete. 2024-09-13T15:49:26.152 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.149+0000 7f45fc1a5640 1 Processor -- start 2024-09-13T15:49:26.152 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.149+0000 7f45fc1a5640 1 -- start start 2024-09-13T15:49:26.152 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.149+0000 7f45fc1a5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45f40ffe00 0x7f45f4195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:49:26.152 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.149+0000 7f45fc1a5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f4100f60 0x7f45f41962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:49:26.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.149+0000 7f45fc1a5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45f4101920 0x7f45f419d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:49:26.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.149+0000 7f45fc1a5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f419d860 con 0x7f45f4101920 2024-09-13T15:49:26.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.149+0000 7f45fc1a5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f419d9d0 con 0x7f45f4100f60 2024-09-13T15:49:26.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.149+0000 7f45fc1a5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f419db90 con 0x7f45f40ffe00 2024-09-13T15:49:26.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.149+0000 7f45f9740640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f4100f60 0x7f45f41962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:49:26.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.149+0000 7f45f9740640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f4100f60 0x7f45f41962f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:37532/0 (socket says 172.21.15.189:37532) 2024-09-13T15:49:26.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.149+0000 7f45f9f41640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45f40ffe00 0x7f45f4195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:49:26.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.149+0000 7f45f9740640 1 -- 172.21.15.189:0/1153630546 learned_addr learned my addr 172.21.15.189:0/1153630546 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-13T15:49:26.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.150+0000 7f45fa742640 1 --2- 172.21.15.189:0/1153630546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45f4101920 0x7f45f419d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:49:26.154 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.150+0000 7f45fa742640 1 -- 172.21.15.189:0/1153630546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45f40ffe00 msgr2=0x7f45f4195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:49:26.154 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.150+0000 7f45fa742640 1 --2- 172.21.15.189:0/1153630546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45f40ffe00 0x7f45f4195db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:26.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.150+0000 7f45fa742640 1 -- 172.21.15.189:0/1153630546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f4100f60 msgr2=0x7f45f41962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:49:26.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.150+0000 7f45fa742640 1 --2- 172.21.15.189:0/1153630546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f4100f60 0x7f45f41962f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:26.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.150+0000 7f45fa742640 1 -- 172.21.15.189:0/1153630546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f0009560 con 0x7f45f4101920 2024-09-13T15:49:26.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.150+0000 7f45f9740640 1 --2- 172.21.15.189:0/1153630546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f4100f60 0x7f45f41962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:49:26.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.151+0000 7f45fa742640 1 --2- 172.21.15.189:0/1153630546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45f4101920 0x7f45f419d320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00cab0 tx=0x7f45ec00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:49:26.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.151+0000 7f45e6ffd640 1 -- 172.21.15.189:0/1153630546 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec00ae20 con 0x7f45f4101920 2024-09-13T15:49:26.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.151+0000 7f45e6ffd640 1 -- 172.21.15.189:0/1153630546 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45ec00f910 con 0x7f45f4101920 2024-09-13T15:49:26.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.151+0000 7f45e6ffd640 1 -- 172.21.15.189:0/1153630546 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec0189b0 con 0x7f45f4101920 2024-09-13T15:49:26.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.151+0000 7f45fc1a5640 1 -- 172.21.15.189:0/1153630546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f419de70 con 0x7f45f4101920 2024-09-13T15:49:26.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.151+0000 7f45fc1a5640 1 -- 172.21.15.189:0/1153630546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f419e290 con 0x7f45f4101920 2024-09-13T15:49:26.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.152+0000 7f45fc1a5640 1 -- 172.21.15.189:0/1153630546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f4107290 con 0x7f45f4101920 2024-09-13T15:49:26.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.153+0000 7f45e6ffd640 1 -- 172.21.15.189:0/1153630546 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7f45ec018b50 con 0x7f45f4101920 2024-09-13T15:49:26.156 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.154+0000 7f45e6ffd640 1 --2- 172.21.15.189:0/1153630546 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f45e00a10a0 0x7f45e00a3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:49:26.156 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.154+0000 7f45e6ffd640 1 -- 172.21.15.189:0/1153630546 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f45ec0cb840 con 0x7f45f4101920 2024-09-13T15:49:26.156 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.154+0000 7f45f9f41640 1 --2- 172.21.15.189:0/1153630546 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f45e00a10a0 0x7f45e00a3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:49:26.156 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.155+0000 7f45f9f41640 1 --2- 172.21.15.189:0/1153630546 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f45e00a10a0 0x7f45e00a3560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f45e8005fd0 tx=0x7f45e800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:49:26.159 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.158+0000 7f45e6ffd640 1 -- 172.21.15.189:0/1153630546 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f45ec096a20 con 0x7f45f4101920 2024-09-13T15:49:26.330 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:26.328+0000 7f45fc1a5640 1 -- 172.21.15.189:0/1153630546 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f45f402c550 con 0x7f45e00a10a0 2024-09-13T15:49:26.330 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:26 smithi189 ceph-mon[34790]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T15:49:26.330 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:26 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:26.330 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:26 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:26.330 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:26 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:49:26.330 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:26 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:26.330 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:26 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:26.330 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:26 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:49:26.330 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:26 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:26.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:26 smithi193 ceph-mon[35248]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T15:49:26.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:26 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:26.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:26 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:26.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:26 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:49:26.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:26 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:26.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:26 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:26.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:26 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:49:26.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:26 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:26.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:26 smithi017 ceph-mon[30494]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T15:49:26.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:26 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:26.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:26 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:26.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:26 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:49:26.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:26 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:26.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:26 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:26.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:26 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:49:26.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:26 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:27.332 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:27 smithi189 ceph-mon[34790]: Detected new or changed devices on smithi017 2024-09-13T15:49:27.332 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:27 smithi189 ceph-mon[34790]: Adjusting osd_memory_target on smithi017 to 17094M 2024-09-13T15:49:27.332 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:27 smithi189 ceph-mon[34790]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:27.332 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:27 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:49:27.332 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:27 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:49:27.332 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:27 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:27.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:27 smithi193 ceph-mon[35248]: Detected new or changed devices on smithi017 2024-09-13T15:49:27.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:27 smithi193 ceph-mon[35248]: Adjusting osd_memory_target on smithi017 to 17094M 2024-09-13T15:49:27.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:27 smithi193 ceph-mon[35248]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:27.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:27 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:49:27.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:27 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:49:27.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:27 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:27.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:27 smithi017 ceph-mon[30494]: Detected new or changed devices on smithi017 2024-09-13T15:49:27.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:27 smithi017 ceph-mon[30494]: Adjusting osd_memory_target on smithi017 to 17094M 2024-09-13T15:49:27.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:27 smithi017 ceph-mon[30494]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:27.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:27 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:49:27.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:27 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:49:27.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:27 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:28.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:28 smithi189 ceph-mon[34790]: from='client.14247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:49:28.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:28 smithi193 ceph-mon[35248]: from='client.14247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:49:28.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:28 smithi017 ceph-mon[30494]: from='client.14247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:49:29.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:29 smithi189 ceph-mon[34790]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:29.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:29 smithi189 ceph-mon[34790]: from='client.? 172.21.15.189:0/118340597' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0da621c7-645b-44ae-ba7c-a573861c3aae"}]: dispatch 2024-09-13T15:49:29.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:29 smithi189 ceph-mon[34790]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0da621c7-645b-44ae-ba7c-a573861c3aae"}]: dispatch 2024-09-13T15:49:29.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:29 smithi189 ceph-mon[34790]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0da621c7-645b-44ae-ba7c-a573861c3aae"}]': finished 2024-09-13T15:49:29.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:29 smithi189 ceph-mon[34790]: osdmap e10: 2 total, 1 up, 2 in 2024-09-13T15:49:29.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:29 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T15:49:29.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:29 smithi193 ceph-mon[35248]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:29.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:29 smithi193 ceph-mon[35248]: from='client.? 172.21.15.189:0/118340597' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0da621c7-645b-44ae-ba7c-a573861c3aae"}]: dispatch 2024-09-13T15:49:29.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:29 smithi193 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0da621c7-645b-44ae-ba7c-a573861c3aae"}]: dispatch 2024-09-13T15:49:29.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:29 smithi193 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0da621c7-645b-44ae-ba7c-a573861c3aae"}]': finished 2024-09-13T15:49:29.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:29 smithi193 ceph-mon[35248]: osdmap e10: 2 total, 1 up, 2 in 2024-09-13T15:49:29.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:29 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T15:49:29.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:29 smithi017 ceph-mon[30494]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:29.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:29 smithi017 ceph-mon[30494]: from='client.? 172.21.15.189:0/118340597' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0da621c7-645b-44ae-ba7c-a573861c3aae"}]: dispatch 2024-09-13T15:49:29.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:29 smithi017 ceph-mon[30494]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0da621c7-645b-44ae-ba7c-a573861c3aae"}]: dispatch 2024-09-13T15:49:29.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:29 smithi017 ceph-mon[30494]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0da621c7-645b-44ae-ba7c-a573861c3aae"}]': finished 2024-09-13T15:49:29.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:29 smithi017 ceph-mon[30494]: osdmap e10: 2 total, 1 up, 2 in 2024-09-13T15:49:29.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:29 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T15:49:30.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:30 smithi189 ceph-mon[34790]: from='client.? 172.21.15.189:0/4209711334' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:49:30.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:30 smithi193 ceph-mon[35248]: from='client.? 172.21.15.189:0/4209711334' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:49:30.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:30 smithi017 ceph-mon[30494]: from='client.? 172.21.15.189:0/4209711334' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:49:31.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:31 smithi189 ceph-mon[34790]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:31.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:31 smithi193 ceph-mon[35248]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:31.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:31 smithi017 ceph-mon[30494]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:33.235 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:33 smithi189 ceph-mon[34790]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:33.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:33 smithi193 ceph-mon[35248]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:33.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:33 smithi017 ceph-mon[30494]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:35.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:35 smithi189 ceph-mon[34790]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:35.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:35 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T15:49:35.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:35 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:35.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:35 smithi193 ceph-mon[35248]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:35.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:35 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T15:49:35.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:35 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:35.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:35 smithi017 ceph-mon[30494]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:35.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:35 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T15:49:35.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:35 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:36.387 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:36 smithi189 ceph-mon[34790]: Deploying daemon osd.1 on smithi189 2024-09-13T15:49:36.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:36 smithi193 ceph-mon[35248]: Deploying daemon osd.1 on smithi189 2024-09-13T15:49:36.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:36 smithi017 ceph-mon[30494]: Deploying daemon osd.1 on smithi189 2024-09-13T15:49:37.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:37 smithi189 ceph-mon[34790]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:37.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:37 smithi193 ceph-mon[35248]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:37.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:37 smithi017 ceph-mon[30494]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:39.339 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:39 smithi189 ceph-mon[34790]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:39.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:39 smithi193 ceph-mon[35248]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:39.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:39 smithi017 ceph-mon[30494]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:40.442 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:40 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:49:40.443 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:40 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:40.443 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:40 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:40.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:40 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:49:40.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:40 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:40.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:40 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:40.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:40 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:49:40.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:40 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:40.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:40 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:41.266 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:41 smithi189 ceph-mon[34790]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:41.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:41 smithi193 ceph-mon[35248]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:41.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:41 smithi017 ceph-mon[30494]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:43.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:43.153+0000 7f45e6ffd640 1 -- 172.21.15.189:0/1153630546 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f45f402c550 con 0x7f45e00a10a0 2024-09-13T15:49:43.156 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 1 on host 'smithi189' 2024-09-13T15:49:43.158 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:43.156+0000 7f45fc1a5640 1 -- 172.21.15.189:0/1153630546 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f45e00a10a0 msgr2=0x7f45e00a3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:49:43.158 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:43.156+0000 7f45fc1a5640 1 --2- 172.21.15.189:0/1153630546 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f45e00a10a0 0x7f45e00a3560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f45e8005fd0 tx=0x7f45e800b390 comp rx=0 tx=0).stop 2024-09-13T15:49:43.158 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:43.156+0000 7f45fc1a5640 1 -- 172.21.15.189:0/1153630546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45f4101920 msgr2=0x7f45f419d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:49:43.158 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:43.156+0000 7f45fc1a5640 1 --2- 172.21.15.189:0/1153630546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45f4101920 0x7f45f419d320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00cab0 tx=0x7f45ec00cf70 comp rx=0 tx=0).stop 2024-09-13T15:49:43.158 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:43.156+0000 7f45fc1a5640 1 -- 172.21.15.189:0/1153630546 shutdown_connections 2024-09-13T15:49:43.158 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:43.156+0000 7f45fc1a5640 1 --2- 172.21.15.189:0/1153630546 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f45e00a10a0 0x7f45e00a3560 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:43.158 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:43.156+0000 7f45fc1a5640 1 --2- 172.21.15.189:0/1153630546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45f4101920 0x7f45f419d320 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:43.158 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:43.156+0000 7f45fc1a5640 1 --2- 172.21.15.189:0/1153630546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f4100f60 0x7f45f41962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:43.158 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:43.156+0000 7f45fc1a5640 1 --2- 172.21.15.189:0/1153630546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45f40ffe00 0x7f45f4195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:43.158 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:43.156+0000 7f45fc1a5640 1 -- 172.21.15.189:0/1153630546 >> 172.21.15.189:0/1153630546 conn(0x7f45f40fb5d0 msgr2=0x7f45f4104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:49:43.158 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:43.156+0000 7f45fc1a5640 1 -- 172.21.15.189:0/1153630546 shutdown_connections 2024-09-13T15:49:43.158 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:49:43.156+0000 7f45fc1a5640 1 -- 172.21.15.189:0/1153630546 wait complete. 2024-09-13T15:49:43.496 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:43 smithi189 ceph-mon[34790]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:43.496 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:43.496 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:43.496 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:43.496 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:49:43.497 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:43.497 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:49:43.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:43 smithi193 ceph-mon[35248]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:43.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:43.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:43.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:43.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:49:43.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:43.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:49:43.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:43 smithi017 ceph-mon[30494]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:43.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:43.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:43.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:43.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:49:43.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:43.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:49:43.753 DEBUG:teuthology.orchestra.run.smithi189:osd.1> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.1.service 2024-09-13T15:49:43.756 INFO:tasks.cephadm:Deploying osd.2 on smithi193 with /dev/vg_nvme/lv_4... 2024-09-13T15:49:43.756 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-13T15:49:43.960 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T15:49:44.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:44 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:44.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:44 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:44.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:44 smithi189 ceph-mon[34790]: from='osd.1 [v2:172.21.15.189:6800/964319421,v1:172.21.15.189:6801/964319421]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T15:49:44.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:44 smithi189 ceph-mon[34790]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T15:49:44.394 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:44 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:44.394 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:44 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:44.394 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:44 smithi193 ceph-mon[35248]: from='osd.1 [v2:172.21.15.189:6800/964319421,v1:172.21.15.189:6801/964319421]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T15:49:44.394 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:44 smithi193 ceph-mon[35248]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T15:49:44.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:44 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:44.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:44 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:44.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:44 smithi017 ceph-mon[30494]: from='osd.1 [v2:172.21.15.189:6800/964319421,v1:172.21.15.189:6801/964319421]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T15:49:44.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:44 smithi017 ceph-mon[30494]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T15:49:45.305 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:45 smithi193 ceph-mon[35248]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:45.305 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:45 smithi193 ceph-mon[35248]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T15:49:45.305 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:45 smithi193 ceph-mon[35248]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T15:49:45.305 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:45 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T15:49:45.306 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:45 smithi193 ceph-mon[35248]: from='osd.1 [v2:172.21.15.189:6800/964319421,v1:172.21.15.189:6801/964319421]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:49:45.306 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:45 smithi193 ceph-mon[35248]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:49:45.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:45 smithi017 ceph-mon[30494]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:45.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:45 smithi017 ceph-mon[30494]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T15:49:45.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:45 smithi017 ceph-mon[30494]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T15:49:45.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:45 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T15:49:45.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:45 smithi017 ceph-mon[30494]: from='osd.1 [v2:172.21.15.189:6800/964319421,v1:172.21.15.189:6801/964319421]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:49:45.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:45 smithi017 ceph-mon[30494]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:49:45.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:45 smithi189 ceph-mon[34790]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:45.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:45 smithi189 ceph-mon[34790]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T15:49:45.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:45 smithi189 ceph-mon[34790]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T15:49:45.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T15:49:45.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:45 smithi189 ceph-mon[34790]: from='osd.1 [v2:172.21.15.189:6800/964319421,v1:172.21.15.189:6801/964319421]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:49:45.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:45 smithi189 ceph-mon[34790]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:49:45.607 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 15:49:45 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-1[39283]: 2024-09-13T15:49:45.166+0000 7f74ef335640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T15:49:45.607 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 15:49:45 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-1[39283]: 2024-09-13T15:49:45.169+0000 7f74eb15e640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:49:45.649 INFO:teuthology.orchestra.run.smithi193.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-13T15:49:45.740 INFO:teuthology.orchestra.run.smithi193.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-13T15:49:45.756 INFO:teuthology.orchestra.run.smithi193.stderr: stderr: 10+0 records in 2024-09-13T15:49:45.756 INFO:teuthology.orchestra.run.smithi193.stderr:10+0 records out 2024-09-13T15:49:45.756 INFO:teuthology.orchestra.run.smithi193.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0133271 s, 787 MB/s 2024-09-13T15:49:45.756 INFO:teuthology.orchestra.run.smithi193.stderr:--> Zapping successful for: 2024-09-13T15:49:46.350 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi193:vg_nvme/lv_4 2024-09-13T15:49:46.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:46 smithi189 ceph-mon[34790]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-13T15:49:46.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:46 smithi189 ceph-mon[34790]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T15:49:46.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:46 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T15:49:46.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:46 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T15:49:46.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:46 smithi189 ceph-mon[34790]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:46.363 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:46 smithi193 ceph-mon[35248]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-13T15:49:46.363 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:46 smithi193 ceph-mon[35248]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T15:49:46.363 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:46 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T15:49:46.363 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:46 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T15:49:46.363 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:46 smithi193 ceph-mon[35248]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:46.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:46 smithi017 ceph-mon[30494]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-13T15:49:46.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:46 smithi017 ceph-mon[30494]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T15:49:46.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T15:49:46.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T15:49:46.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:46 smithi017 ceph-mon[30494]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T15:49:46.557 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T15:49:47.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:47 smithi193 ceph-mon[35248]: purged_snaps scrub starts 2024-09-13T15:49:47.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:47 smithi193 ceph-mon[35248]: purged_snaps scrub ok 2024-09-13T15:49:47.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:47 smithi193 ceph-mon[35248]: osd.1 [v2:172.21.15.189:6800/964319421,v1:172.21.15.189:6801/964319421] boot 2024-09-13T15:49:47.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:47 smithi193 ceph-mon[35248]: osdmap e13: 2 total, 2 up, 2 in 2024-09-13T15:49:47.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:47 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T15:49:47.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:47 smithi193 ceph-mon[35248]: Detected new or changed devices on smithi189 2024-09-13T15:49:47.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:47 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:47.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:47 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:47.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:47 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:49:47.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:47 smithi193 ceph-mon[35248]: Adjusting osd_memory_target on smithi189 to 17088M 2024-09-13T15:49:47.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:47 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:47.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:47 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:47.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:47 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:49:47.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:47 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:47.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:47 smithi017 ceph-mon[30494]: purged_snaps scrub starts 2024-09-13T15:49:47.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:47 smithi017 ceph-mon[30494]: purged_snaps scrub ok 2024-09-13T15:49:47.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:47 smithi017 ceph-mon[30494]: osd.1 [v2:172.21.15.189:6800/964319421,v1:172.21.15.189:6801/964319421] boot 2024-09-13T15:49:47.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:47 smithi017 ceph-mon[30494]: osdmap e13: 2 total, 2 up, 2 in 2024-09-13T15:49:47.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:47 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T15:49:47.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:47 smithi017 ceph-mon[30494]: Detected new or changed devices on smithi189 2024-09-13T15:49:47.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:47 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:47.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:47 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:47.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:47 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:49:47.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:47 smithi017 ceph-mon[30494]: Adjusting osd_memory_target on smithi189 to 17088M 2024-09-13T15:49:47.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:47 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:47.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:47 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:47.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:47 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:49:47.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:47 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:47.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:47 smithi189 ceph-mon[34790]: purged_snaps scrub starts 2024-09-13T15:49:47.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:47 smithi189 ceph-mon[34790]: purged_snaps scrub ok 2024-09-13T15:49:47.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:47 smithi189 ceph-mon[34790]: osd.1 [v2:172.21.15.189:6800/964319421,v1:172.21.15.189:6801/964319421] boot 2024-09-13T15:49:47.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:47 smithi189 ceph-mon[34790]: osdmap e13: 2 total, 2 up, 2 in 2024-09-13T15:49:47.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:47 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T15:49:47.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:47 smithi189 ceph-mon[34790]: Detected new or changed devices on smithi189 2024-09-13T15:49:47.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:47 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:47.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:47 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:47.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:47 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:49:47.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:47 smithi189 ceph-mon[34790]: Adjusting osd_memory_target on smithi189 to 17088M 2024-09-13T15:49:47.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:47 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:47.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:47 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:47.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:47 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:49:47.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:47 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:49:47.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.967+0000 7fc215c18640 1 -- 172.21.15.193:0/727143433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc210103240 msgr2=0x7fc210105630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:49:47.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.967+0000 7fc215c18640 1 --2- 172.21.15.193:0/727143433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc210103240 0x7fc210105630 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc204009900 tx=0x7fc20402a410 comp rx=0 tx=0).stop 2024-09-13T15:49:47.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.967+0000 7fc215c18640 1 -- 172.21.15.193:0/727143433 shutdown_connections 2024-09-13T15:49:47.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.967+0000 7fc215c18640 1 --2- 172.21.15.193:0/727143433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc210105b70 0x7fc210107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:47.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.967+0000 7fc215c18640 1 --2- 172.21.15.193:0/727143433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc210103240 0x7fc210105630 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:47.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.967+0000 7fc215c18640 1 --2- 172.21.15.193:0/727143433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc210100910 0x7fc210102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:47.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.967+0000 7fc215c18640 1 -- 172.21.15.193:0/727143433 >> 172.21.15.193:0/727143433 conn(0x7fc2100fa490 msgr2=0x7fc2100fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:49:47.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.967+0000 7fc215c18640 1 -- 172.21.15.193:0/727143433 shutdown_connections 2024-09-13T15:49:47.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.967+0000 7fc215c18640 1 -- 172.21.15.193:0/727143433 wait complete. 2024-09-13T15:49:47.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.967+0000 7fc215c18640 1 Processor -- start 2024-09-13T15:49:47.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.967+0000 7fc215c18640 1 -- start start 2024-09-13T15:49:47.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.968+0000 7fc215c18640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc210100910 0x7fc210100270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:49:47.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.968+0000 7fc215c18640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc210103240 0x7fc2100fe8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:49:47.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.968+0000 7fc215c18640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc210105b70 0x7fc2100fee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:49:47.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.968+0000 7fc215c18640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2100ff590 con 0x7fc210103240 2024-09-13T15:49:47.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.968+0000 7fc215c18640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2100ff700 con 0x7fc210105b70 2024-09-13T15:49:47.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.968+0000 7fc215c18640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21019fec0 con 0x7fc210100910 2024-09-13T15:49:47.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.968+0000 7fc20f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc210100910 0x7fc210100270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:49:47.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.968+0000 7fc20f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc210100910 0x7fc210100270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:36984/0 (socket says 172.21.15.193:36984) 2024-09-13T15:49:47.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.968+0000 7fc20f7fe640 1 -- 172.21.15.193:0/2873278525 learned_addr learned my addr 172.21.15.193:0/2873278525 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-13T15:49:47.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.968+0000 7fc20ffff640 1 --2- 172.21.15.193:0/2873278525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc210105b70 0x7fc2100fee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:49:47.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.968+0000 7fc20f7fe640 1 -- 172.21.15.193:0/2873278525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc210105b70 msgr2=0x7fc2100fee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:49:47.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.968+0000 7fc20f7fe640 1 --2- 172.21.15.193:0/2873278525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc210105b70 0x7fc2100fee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:47.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.968+0000 7fc20f7fe640 1 -- 172.21.15.193:0/2873278525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc210103240 msgr2=0x7fc2100fe8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:49:47.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.968+0000 7fc20f7fe640 1 --2- 172.21.15.193:0/2873278525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc210103240 0x7fc2100fe8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:49:47.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.968+0000 7fc20f7fe640 1 -- 172.21.15.193:0/2873278525 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc204009560 con 0x7fc210100910 2024-09-13T15:49:47.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.968+0000 7fc20ffff640 1 --2- 172.21.15.193:0/2873278525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc210105b70 0x7fc2100fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:49:47.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.968+0000 7fc20f7fe640 1 --2- 172.21.15.193:0/2873278525 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc210100910 0x7fc210100270 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc20000eab0 tx=0x7fc20000ef70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:49:47.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.968+0000 7fc20cff9640 1 -- 172.21.15.193:0/2873278525 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20000ce40 con 0x7fc210100910 2024-09-13T15:49:47.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.968+0000 7fc20cff9640 1 -- 172.21.15.193:0/2873278525 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc200005020 con 0x7fc210100910 2024-09-13T15:49:47.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.969+0000 7fc215c18640 1 -- 172.21.15.193:0/2873278525 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2101a0170 con 0x7fc210100910 2024-09-13T15:49:47.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.969+0000 7fc20cff9640 1 -- 172.21.15.193:0/2873278525 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2000116b0 con 0x7fc210100910 2024-09-13T15:49:47.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.969+0000 7fc215c18640 1 -- 172.21.15.193:0/2873278525 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2101a0620 con 0x7fc210100910 2024-09-13T15:49:47.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.970+0000 7fc215c18640 1 -- 172.21.15.193:0/2873278525 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2100fbf80 con 0x7fc210100910 2024-09-13T15:49:47.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.971+0000 7fc20cff9640 1 -- 172.21.15.193:0/2873278525 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7fc200005190 con 0x7fc210100910 2024-09-13T15:49:47.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.971+0000 7fc20cff9640 1 --2- 172.21.15.193:0/2873278525 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1f80a0ff0 0x7fc1f80a34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:49:47.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.972+0000 7fc20cff9640 1 -- 172.21.15.193:0/2873278525 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2309+0+0 (secure 0 0 0) 0x7fc2000cb390 con 0x7fc210100910 2024-09-13T15:49:47.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.972+0000 7fc20effd640 1 --2- 172.21.15.193:0/2873278525 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1f80a0ff0 0x7fc1f80a34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:49:47.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.973+0000 7fc20effd640 1 --2- 172.21.15.193:0/2873278525 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1f80a0ff0 0x7fc1f80a34b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc20402aa00 tx=0x7fc204000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:49:47.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:47.976+0000 7fc20cff9640 1 -- 172.21.15.193:0/2873278525 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc200096370 con 0x7fc210100910 2024-09-13T15:49:48.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:49:48.146+0000 7fc215c18640 1 -- 172.21.15.193:0/2873278525 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2100608f0 con 0x7fc1f80a0ff0 2024-09-13T15:49:48.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:48 smithi193 ceph-mon[35248]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T15:49:48.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:48 smithi193 ceph-mon[35248]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:49:48.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:48 smithi193 ceph-mon[35248]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:49:48.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:48 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:49:48.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:48 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:49:48.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:48 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:48.759 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:48 smithi017 ceph-mon[30494]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T15:49:48.759 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:48 smithi017 ceph-mon[30494]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:49:48.759 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:48 smithi017 ceph-mon[30494]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:49:48.759 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:48 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:49:48.759 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:48 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:49:48.759 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:48 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:48.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:48 smithi189 ceph-mon[34790]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T15:49:48.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:48 smithi189 ceph-mon[34790]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:49:48.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:48 smithi189 ceph-mon[34790]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:49:48.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:48 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:49:48.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:48 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:49:48.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:48 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:51.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:51 smithi193 ceph-mon[35248]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:49:51.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:51 smithi193 ceph-mon[35248]: from='client.? 172.21.15.193:0/2743532068' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa95af60-1486-4a29-8c79-8a73a4146552"}]: dispatch 2024-09-13T15:49:51.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:51 smithi193 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa95af60-1486-4a29-8c79-8a73a4146552"}]: dispatch 2024-09-13T15:49:51.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:51 smithi193 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa95af60-1486-4a29-8c79-8a73a4146552"}]': finished 2024-09-13T15:49:51.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:51 smithi193 ceph-mon[35248]: osdmap e15: 3 total, 2 up, 3 in 2024-09-13T15:49:51.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:51 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T15:49:51.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:51 smithi193 ceph-mon[35248]: from='client.? 172.21.15.193:0/3055515696' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:49:51.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:51 smithi017 ceph-mon[30494]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:49:51.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:51 smithi017 ceph-mon[30494]: from='client.? 172.21.15.193:0/2743532068' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa95af60-1486-4a29-8c79-8a73a4146552"}]: dispatch 2024-09-13T15:49:51.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:51 smithi017 ceph-mon[30494]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa95af60-1486-4a29-8c79-8a73a4146552"}]: dispatch 2024-09-13T15:49:51.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:51 smithi017 ceph-mon[30494]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa95af60-1486-4a29-8c79-8a73a4146552"}]': finished 2024-09-13T15:49:51.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:51 smithi017 ceph-mon[30494]: osdmap e15: 3 total, 2 up, 3 in 2024-09-13T15:49:51.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:51 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T15:49:51.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:51 smithi017 ceph-mon[30494]: from='client.? 172.21.15.193:0/3055515696' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:49:51.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:51 smithi189 ceph-mon[34790]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:49:51.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:51 smithi189 ceph-mon[34790]: from='client.? 172.21.15.193:0/2743532068' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa95af60-1486-4a29-8c79-8a73a4146552"}]: dispatch 2024-09-13T15:49:51.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:51 smithi189 ceph-mon[34790]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa95af60-1486-4a29-8c79-8a73a4146552"}]: dispatch 2024-09-13T15:49:51.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:51 smithi189 ceph-mon[34790]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa95af60-1486-4a29-8c79-8a73a4146552"}]': finished 2024-09-13T15:49:51.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:51 smithi189 ceph-mon[34790]: osdmap e15: 3 total, 2 up, 3 in 2024-09-13T15:49:51.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:51 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T15:49:51.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:51 smithi189 ceph-mon[34790]: from='client.? 172.21.15.193:0/3055515696' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:49:53.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:53 smithi193 ceph-mon[35248]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:49:53.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:53 smithi017 ceph-mon[30494]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:49:53.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:53 smithi189 ceph-mon[34790]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:49:55.408 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:55 smithi189 ceph-mon[34790]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:49:55.476 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:55 smithi193 ceph-mon[35248]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:49:55.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:55 smithi017 ceph-mon[30494]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:49:57.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:57 smithi193 ceph-mon[35248]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:49:57.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:57 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T15:49:57.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:57 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:57.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:57 smithi017 ceph-mon[30494]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:49:57.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:57 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T15:49:57.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:57 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:57.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:57 smithi189 ceph-mon[34790]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:49:57.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:57 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T15:49:57.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:57 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:49:58.462 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:58 smithi193 ceph-mon[35248]: Deploying daemon osd.2 on smithi193 2024-09-13T15:49:58.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:58 smithi017 ceph-mon[30494]: Deploying daemon osd.2 on smithi193 2024-09-13T15:49:58.609 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:58 smithi189 ceph-mon[34790]: Deploying daemon osd.2 on smithi193 2024-09-13T15:49:59.405 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:49:59 smithi017 ceph-mon[30494]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:49:59.467 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:49:59 smithi193 ceph-mon[35248]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:49:59.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:49:59 smithi189 ceph-mon[34790]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:50:00.381 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:00 smithi193 ceph-mon[35248]: overall HEALTH_OK 2024-09-13T15:50:00.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:00 smithi017 ceph-mon[30494]: overall HEALTH_OK 2024-09-13T15:50:00.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:00 smithi189 ceph-mon[34790]: overall HEALTH_OK 2024-09-13T15:50:01.184 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:01 smithi193 ceph-mon[35248]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:50:01.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:01 smithi017 ceph-mon[30494]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:50:01.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:01 smithi189 ceph-mon[34790]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:50:02.407 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:02 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:50:02.408 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:02 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:02.408 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:02 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:02.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:02 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:50:02.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:02 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:02.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:02 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:02.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:02 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:50:02.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:02 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:02.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:02 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:03.429 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:03 smithi193 ceph-mon[35248]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:50:03.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:03 smithi017 ceph-mon[30494]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:50:03.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:03 smithi189 ceph-mon[34790]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:50:04.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:50:04.993+0000 7fc20cff9640 1 -- 172.21.15.193:0/2873278525 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc2100608f0 con 0x7fc1f80a0ff0 2024-09-13T15:50:04.997 INFO:teuthology.orchestra.run.smithi193.stdout:Created osd(s) 2 on host 'smithi193' 2024-09-13T15:50:04.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:50:04.995+0000 7fc215c18640 1 -- 172.21.15.193:0/2873278525 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1f80a0ff0 msgr2=0x7fc1f80a34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:04.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:50:04.995+0000 7fc215c18640 1 --2- 172.21.15.193:0/2873278525 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1f80a0ff0 0x7fc1f80a34b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc20402aa00 tx=0x7fc204000bc0 comp rx=0 tx=0).stop 2024-09-13T15:50:04.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:50:04.995+0000 7fc215c18640 1 -- 172.21.15.193:0/2873278525 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc210100910 msgr2=0x7fc210100270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:04.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:50:04.996+0000 7fc215c18640 1 --2- 172.21.15.193:0/2873278525 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc210100910 0x7fc210100270 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc20000eab0 tx=0x7fc20000ef70 comp rx=0 tx=0).stop 2024-09-13T15:50:04.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:50:04.996+0000 7fc215c18640 1 -- 172.21.15.193:0/2873278525 shutdown_connections 2024-09-13T15:50:04.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:50:04.996+0000 7fc215c18640 1 --2- 172.21.15.193:0/2873278525 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1f80a0ff0 0x7fc1f80a34b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:04.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:50:04.996+0000 7fc215c18640 1 --2- 172.21.15.193:0/2873278525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc210105b70 0x7fc2100fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:04.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:50:04.996+0000 7fc215c18640 1 --2- 172.21.15.193:0/2873278525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc210103240 0x7fc2100fe8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:04.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:50:04.996+0000 7fc215c18640 1 --2- 172.21.15.193:0/2873278525 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc210100910 0x7fc210100270 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:04.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:50:04.996+0000 7fc215c18640 1 -- 172.21.15.193:0/2873278525 >> 172.21.15.193:0/2873278525 conn(0x7fc2100fa490 msgr2=0x7fc2101013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:04.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:50:04.996+0000 7fc215c18640 1 -- 172.21.15.193:0/2873278525 shutdown_connections 2024-09-13T15:50:04.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:50:04.996+0000 7fc215c18640 1 -- 172.21.15.193:0/2873278525 wait complete. 2024-09-13T15:50:05.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:05 smithi193 ceph-mon[35248]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:50:05.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:05 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:05.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:05 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:05.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:05 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:05.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:05 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:50:05.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:05 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:05.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:05 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:50:05.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:05 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:05.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:05 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:05.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:05 smithi017 ceph-mon[30494]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:50:05.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:05 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:05.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:05 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:05.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:05 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:05.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:05 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:50:05.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:05 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:05.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:05 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:50:05.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:05 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:05.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:05 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:05.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:05 smithi189 ceph-mon[34790]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:50:05.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:05 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:05.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:05 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:05.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:05 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:05.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:05 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:50:05.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:05 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:05.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:05 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:50:05.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:05 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:05.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:05 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:05.640 DEBUG:teuthology.orchestra.run.smithi193:osd.2> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.2.service 2024-09-13T15:50:05.682 INFO:tasks.cephadm:Deploying osd.3 on smithi017 with /dev/vg_nvme/lv_3... 2024-09-13T15:50:05.683 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-13T15:50:06.003 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:50:06.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:06 smithi193 ceph-mon[35248]: from='osd.2 [v2:172.21.15.193:6800/138468002,v1:172.21.15.193:6801/138468002]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T15:50:06.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:06 smithi193 ceph-mon[35248]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T15:50:06.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:06 smithi017 ceph-mon[30494]: from='osd.2 [v2:172.21.15.193:6800/138468002,v1:172.21.15.193:6801/138468002]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T15:50:06.433 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:06 smithi017 ceph-mon[30494]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T15:50:06.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:06 smithi189 ceph-mon[34790]: from='osd.2 [v2:172.21.15.193:6800/138468002,v1:172.21.15.193:6801/138468002]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T15:50:06.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:06 smithi189 ceph-mon[34790]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T15:50:07.193 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:07 smithi017 ceph-mon[30494]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:50:07.193 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:07 smithi017 ceph-mon[30494]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T15:50:07.193 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:07 smithi017 ceph-mon[30494]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T15:50:07.193 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:07 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T15:50:07.193 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:07 smithi017 ceph-mon[30494]: from='osd.2 [v2:172.21.15.193:6800/138468002,v1:172.21.15.193:6801/138468002]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:50:07.193 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:07 smithi017 ceph-mon[30494]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:50:07.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:07 smithi193 ceph-mon[35248]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:50:07.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:07 smithi193 ceph-mon[35248]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T15:50:07.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:07 smithi193 ceph-mon[35248]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T15:50:07.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:07 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T15:50:07.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:07 smithi193 ceph-mon[35248]: from='osd.2 [v2:172.21.15.193:6800/138468002,v1:172.21.15.193:6801/138468002]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:50:07.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:07 smithi193 ceph-mon[35248]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:50:07.505 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 15:50:07 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-2[40266]: 2024-09-13T15:50:07.172+0000 7f28224e3640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T15:50:07.505 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 15:50:07 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-2[40266]: 2024-09-13T15:50:07.176+0000 7f281e30c640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:50:07.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:07 smithi189 ceph-mon[34790]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:50:07.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:07 smithi189 ceph-mon[34790]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T15:50:07.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:07 smithi189 ceph-mon[34790]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T15:50:07.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:07 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T15:50:07.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:07 smithi189 ceph-mon[34790]: from='osd.2 [v2:172.21.15.193:6800/138468002,v1:172.21.15.193:6801/138468002]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:50:07.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:07 smithi189 ceph-mon[34790]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:50:08.151 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-13T15:50:08.290 INFO:teuthology.orchestra.run.smithi017.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-13T15:50:08.323 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10+0 records in 2024-09-13T15:50:08.323 INFO:teuthology.orchestra.run.smithi017.stderr:10+0 records out 2024-09-13T15:50:08.323 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0270714 s, 387 MB/s 2024-09-13T15:50:08.323 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping successful for: 2024-09-13T15:50:08.386 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:08 smithi193 ceph-mon[35248]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-13T15:50:08.386 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:08 smithi193 ceph-mon[35248]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T15:50:08.386 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:08 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T15:50:08.386 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:08 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T15:50:08.386 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:08 smithi193 ceph-mon[35248]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:50:08.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:08 smithi017 ceph-mon[30494]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-13T15:50:08.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:08 smithi017 ceph-mon[30494]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T15:50:08.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:08 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T15:50:08.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:08 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T15:50:08.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:08 smithi017 ceph-mon[30494]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:50:08.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:08 smithi189 ceph-mon[34790]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-13T15:50:08.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:08 smithi189 ceph-mon[34790]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T15:50:08.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:08 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T15:50:08.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:08 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T15:50:08.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:08 smithi189 ceph-mon[34790]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T15:50:09.038 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi017:vg_nvme/lv_3 2024-09-13T15:50:09.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:09 smithi017 ceph-mon[30494]: purged_snaps scrub starts 2024-09-13T15:50:09.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:09 smithi017 ceph-mon[30494]: purged_snaps scrub ok 2024-09-13T15:50:09.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:09 smithi017 ceph-mon[30494]: osd.2 [v2:172.21.15.193:6800/138468002,v1:172.21.15.193:6801/138468002] boot 2024-09-13T15:50:09.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:09 smithi017 ceph-mon[30494]: osdmap e18: 3 total, 3 up, 3 in 2024-09-13T15:50:09.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:09 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T15:50:09.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:09 smithi017 ceph-mon[30494]: Detected new or changed devices on smithi193 2024-09-13T15:50:09.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:09 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:09.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:09 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:09.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:09 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:50:09.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:09 smithi017 ceph-mon[30494]: Adjusting osd_memory_target on smithi193 to 17088M 2024-09-13T15:50:09.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:09 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:09.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:09 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:09.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:09 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:50:09.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:09 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:09.361 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:50:09.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:09 smithi193 ceph-mon[35248]: purged_snaps scrub starts 2024-09-13T15:50:09.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:09 smithi193 ceph-mon[35248]: purged_snaps scrub ok 2024-09-13T15:50:09.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:09 smithi193 ceph-mon[35248]: osd.2 [v2:172.21.15.193:6800/138468002,v1:172.21.15.193:6801/138468002] boot 2024-09-13T15:50:09.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:09 smithi193 ceph-mon[35248]: osdmap e18: 3 total, 3 up, 3 in 2024-09-13T15:50:09.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:09 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T15:50:09.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:09 smithi193 ceph-mon[35248]: Detected new or changed devices on smithi193 2024-09-13T15:50:09.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:09 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:09.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:09 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:09.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:09 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:50:09.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:09 smithi193 ceph-mon[35248]: Adjusting osd_memory_target on smithi193 to 17088M 2024-09-13T15:50:09.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:09 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:09.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:09 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:09.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:09 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:50:09.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:09 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:09.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:09 smithi189 ceph-mon[34790]: purged_snaps scrub starts 2024-09-13T15:50:09.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:09 smithi189 ceph-mon[34790]: purged_snaps scrub ok 2024-09-13T15:50:09.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:09 smithi189 ceph-mon[34790]: osd.2 [v2:172.21.15.193:6800/138468002,v1:172.21.15.193:6801/138468002] boot 2024-09-13T15:50:09.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:09 smithi189 ceph-mon[34790]: osdmap e18: 3 total, 3 up, 3 in 2024-09-13T15:50:09.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:09 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T15:50:09.608 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:09 smithi189 ceph-mon[34790]: Detected new or changed devices on smithi193 2024-09-13T15:50:09.608 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:09 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:09.608 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:09 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:09.608 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:09 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:50:09.608 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:09 smithi189 ceph-mon[34790]: Adjusting osd_memory_target on smithi193 to 17088M 2024-09-13T15:50:09.609 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:09 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:09.609 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:09 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:09.609 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:09 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:50:09.609 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:09 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:10.843 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:10 smithi017 ceph-mon[30494]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T15:50:10.843 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:10 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T15:50:11.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:10 smithi193 ceph-mon[35248]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T15:50:11.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:10 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T15:50:11.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:10 smithi189 ceph-mon[34790]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T15:50:11.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:10 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T15:50:11.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.233+0000 7fec90800640 1 -- 172.21.15.17:0/2971670021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec88101a40 msgr2=0x7fec881082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:11.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.233+0000 7fec90800640 1 --2- 172.21.15.17:0/2971670021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec88101a40 0x7fec881082d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fec84009ca0 tx=0x7fec8402a8c0 comp rx=0 tx=0).stop 2024-09-13T15:50:11.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.233+0000 7fec90800640 1 -- 172.21.15.17:0/2971670021 shutdown_connections 2024-09-13T15:50:11.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.233+0000 7fec90800640 1 --2- 172.21.15.17:0/2971670021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec88101a40 0x7fec881082d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:11.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.233+0000 7fec90800640 1 --2- 172.21.15.17:0/2971670021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec88101080 0x7fec88101500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:11.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.233+0000 7fec90800640 1 --2- 172.21.15.17:0/2971670021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec880fe0a0 0x7fec880fe4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:11.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.233+0000 7fec90800640 1 -- 172.21.15.17:0/2971670021 >> 172.21.15.17:0/2971670021 conn(0x7fec880f9c10 msgr2=0x7fec880fc030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:11.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.233+0000 7fec90800640 1 -- 172.21.15.17:0/2971670021 shutdown_connections 2024-09-13T15:50:11.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.233+0000 7fec90800640 1 -- 172.21.15.17:0/2971670021 wait complete. 2024-09-13T15:50:11.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.235+0000 7fec90800640 1 Processor -- start 2024-09-13T15:50:11.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.235+0000 7fec90800640 1 -- start start 2024-09-13T15:50:11.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.235+0000 7fec90800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec880fe0a0 0x7fec881009e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:11.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.235+0000 7fec90800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec88101080 0x7fec880ff030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:11.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.235+0000 7fec90800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec88101a40 0x7fec880ff570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:11.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.235+0000 7fec90800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec880ffd00 con 0x7fec880fe0a0 2024-09-13T15:50:11.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.235+0000 7fec90800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec880ffe70 con 0x7fec88101080 2024-09-13T15:50:11.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.235+0000 7fec90800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8819fd40 con 0x7fec88101a40 2024-09-13T15:50:11.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.236+0000 7fec8de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec880fe0a0 0x7fec881009e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:11.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.236+0000 7fec8de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec880fe0a0 0x7fec881009e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39456/0 (socket says 172.21.15.17:39456) 2024-09-13T15:50:11.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.236+0000 7fec8de00640 1 -- 172.21.15.17:0/3430013149 learned_addr learned my addr 172.21.15.17:0/3430013149 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:50:11.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.236+0000 7fec8d400640 1 --2- 172.21.15.17:0/3430013149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec88101080 0x7fec880ff030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:11.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.236+0000 7fec8e800640 1 --2- 172.21.15.17:0/3430013149 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec88101a40 0x7fec880ff570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:11.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.236+0000 7fec8de00640 1 -- 172.21.15.17:0/3430013149 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec88101a40 msgr2=0x7fec880ff570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:11.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.236+0000 7fec8de00640 1 --2- 172.21.15.17:0/3430013149 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec88101a40 0x7fec880ff570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:11.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.236+0000 7fec8de00640 1 -- 172.21.15.17:0/3430013149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec88101080 msgr2=0x7fec880ff030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:11.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.236+0000 7fec8de00640 1 --2- 172.21.15.17:0/3430013149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec88101080 0x7fec880ff030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:11.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.236+0000 7fec8de00640 1 -- 172.21.15.17:0/3430013149 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec84009900 con 0x7fec880fe0a0 2024-09-13T15:50:11.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.236+0000 7fec8d400640 1 --2- 172.21.15.17:0/3430013149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec88101080 0x7fec880ff030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:50:11.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.236+0000 7fec8de00640 1 --2- 172.21.15.17:0/3430013149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec880fe0a0 0x7fec881009e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00d9b0 tx=0x7fec7c00de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:11.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.237+0000 7fec82a00640 1 -- 172.21.15.17:0/3430013149 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c009bd0 con 0x7fec880fe0a0 2024-09-13T15:50:11.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.237+0000 7fec82a00640 1 -- 172.21.15.17:0/3430013149 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec7c009d30 con 0x7fec880fe0a0 2024-09-13T15:50:11.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.237+0000 7fec82a00640 1 -- 172.21.15.17:0/3430013149 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c00f720 con 0x7fec880fe0a0 2024-09-13T15:50:11.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.237+0000 7fec90800640 1 -- 172.21.15.17:0/3430013149 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8819fff0 con 0x7fec880fe0a0 2024-09-13T15:50:11.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.237+0000 7fec90800640 1 -- 172.21.15.17:0/3430013149 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec881a03b0 con 0x7fec880fe0a0 2024-09-13T15:50:11.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.238+0000 7fec90800640 1 -- 172.21.15.17:0/3430013149 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec880fe510 con 0x7fec880fe0a0 2024-09-13T15:50:11.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.240+0000 7fec82a00640 1 -- 172.21.15.17:0/3430013149 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7fec7c00f880 con 0x7fec880fe0a0 2024-09-13T15:50:11.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.241+0000 7fec82a00640 1 --2- 172.21.15.17:0/3430013149 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fec700a10f0 0x7fec700a35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:11.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.241+0000 7fec82a00640 1 -- 172.21.15.17:0/3430013149 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3226+0+0 (secure 0 0 0) 0x7fec7c0cb8a0 con 0x7fec880fe0a0 2024-09-13T15:50:11.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.242+0000 7fec8d400640 1 --2- 172.21.15.17:0/3430013149 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fec700a10f0 0x7fec700a35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:11.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.242+0000 7fec8d400640 1 --2- 172.21.15.17:0/3430013149 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fec700a10f0 0x7fec700a35b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fec88100760 tx=0x7fec7800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:11.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.244+0000 7fec82a00640 1 -- 172.21.15.17:0/3430013149 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fec7c0964d0 con 0x7fec880fe0a0 2024-09-13T15:50:11.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:11.435+0000 7fec90800640 1 -- 172.21.15.17:0/3430013149 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fec880fe4a0 con 0x7fec700a10f0 2024-09-13T15:50:11.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:11 smithi017 ceph-mon[30494]: pgmap v83: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:11.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:11 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T15:50:11.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:11 smithi017 ceph-mon[30494]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T15:50:11.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:11 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T15:50:11.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:11 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:50:11.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:11 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:50:11.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:11 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:12.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:11 smithi193 ceph-mon[35248]: pgmap v83: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:12.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:11 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T15:50:12.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:11 smithi193 ceph-mon[35248]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T15:50:12.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:11 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T15:50:12.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:11 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:50:12.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:11 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:50:12.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:11 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:12.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:11 smithi189 ceph-mon[34790]: pgmap v83: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:12.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:11 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T15:50:12.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:11 smithi189 ceph-mon[34790]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T15:50:12.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:11 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T15:50:12.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:11 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:50:12.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:11 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:50:12.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:11 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:12.673 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 15:50:12 smithi017 sudo[49660]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T15:50:12.673 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 15:50:12 smithi017 sudo[49660]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T15:50:12.673 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 15:50:12 smithi017 sudo[49660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T15:50:12.673 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 15:50:12 smithi017 sudo[49660]: pam_unix(sudo:session): session closed for user root 2024-09-13T15:50:12.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:12.723+0000 7fec82a00640 1 -- 172.21.15.17:0/3430013149 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fec7c0968a0 con 0x7fec880fe0a0 2024-09-13T15:50:12.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:12 smithi017 ceph-mon[30494]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:50:12.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:12 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T15:50:12.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:12 smithi017 ceph-mon[30494]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T15:50:12.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:12 smithi017 ceph-mon[30494]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:13.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:12 smithi193 ceph-mon[35248]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:50:13.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:12 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T15:50:13.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:12 smithi193 ceph-mon[35248]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T15:50:13.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:12 smithi193 ceph-mon[35248]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:13.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:12 smithi189 ceph-mon[34790]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:50:13.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:12 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T15:50:13.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:12 smithi189 ceph-mon[34790]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T15:50:13.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:12 smithi189 ceph-mon[34790]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:13.261 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 15:50:12 smithi017 sudo[49667]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T15:50:13.261 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 15:50:12 smithi017 sudo[49667]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T15:50:13.261 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 15:50:12 smithi017 sudo[49667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T15:50:13.261 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 15:50:12 smithi017 sudo[49667]: pam_unix(sudo:session): session closed for user root 2024-09-13T15:50:13.471 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 15:50:13 smithi189 sudo[43257]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T15:50:13.471 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 15:50:13 smithi189 sudo[43257]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T15:50:13.471 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 15:50:13 smithi189 sudo[43257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T15:50:13.471 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 15:50:13 smithi189 sudo[43257]: pam_unix(sudo:session): session closed for user root 2024-09-13T15:50:13.856 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 15:50:13 smithi189 sudo[43260]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T15:50:13.856 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 15:50:13 smithi189 sudo[43260]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T15:50:13.856 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 15:50:13 smithi189 sudo[43260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T15:50:13.856 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 15:50:13 smithi189 sudo[43260]: pam_unix(sudo:session): session closed for user root 2024-09-13T15:50:13.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:13 smithi189 ceph-mon[34790]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-13T15:50:13.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:13 smithi189 ceph-mon[34790]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T15:50:13.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:13 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:13.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:13 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:13.925 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:13 smithi017 ceph-mon[30494]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-13T15:50:13.925 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:13 smithi017 ceph-mon[30494]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T15:50:13.925 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:13 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:13.925 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:13 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:13.996 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:13 smithi193 ceph-mon[35248]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-13T15:50:13.996 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:13 smithi193 ceph-mon[35248]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T15:50:13.996 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:13 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:13.996 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:13 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:13.997 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 15:50:13 smithi193 sudo[43997]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T15:50:13.997 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 15:50:13 smithi193 sudo[43997]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T15:50:13.997 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 15:50:13 smithi193 sudo[43997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T15:50:13.997 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 15:50:13 smithi193 sudo[43997]: pam_unix(sudo:session): session closed for user root 2024-09-13T15:50:13.997 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 15:50:13 smithi193 sudo[44000]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T15:50:14.254 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 15:50:13 smithi193 sudo[44000]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T15:50:14.254 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 15:50:13 smithi193 sudo[44000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T15:50:14.254 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 15:50:13 smithi193 sudo[44000]: pam_unix(sudo:session): session closed for user root 2024-09-13T15:50:15.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:14 smithi017 sudo[49738]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T15:50:15.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:14 smithi017 sudo[49738]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T15:50:15.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:14 smithi017 sudo[49738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T15:50:15.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:14 smithi017 sudo[49738]: pam_unix(sudo:session): session closed for user root 2024-09-13T15:50:15.408 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:15 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:15.408 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:15 smithi193 ceph-mon[35248]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T15:50:15.408 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:15 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/2624407881' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "90428e5f-dfd4-4cda-b240-fdb9079bcb7f"}]: dispatch 2024-09-13T15:50:15.409 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:15 smithi193 ceph-mon[35248]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T15:50:15.409 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:15 smithi193 sudo[44003]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T15:50:15.409 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:15 smithi193 sudo[44003]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T15:50:15.409 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:15 smithi193 sudo[44003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T15:50:15.409 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:15 smithi193 sudo[44003]: pam_unix(sudo:session): session closed for user root 2024-09-13T15:50:15.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:15 smithi017 sudo[49741]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T15:50:15.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:15 smithi017 sudo[49741]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T15:50:15.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:15 smithi017 sudo[49741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T15:50:15.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:15 smithi017 sudo[49741]: pam_unix(sudo:session): session closed for user root 2024-09-13T15:50:15.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:15 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:15.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:15 smithi017 ceph-mon[30494]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T15:50:15.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:15 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/2624407881' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "90428e5f-dfd4-4cda-b240-fdb9079bcb7f"}]: dispatch 2024-09-13T15:50:15.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:15 smithi017 ceph-mon[30494]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T15:50:15.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:15 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:15.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:15 smithi189 ceph-mon[34790]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T15:50:15.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:15 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/2624407881' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "90428e5f-dfd4-4cda-b240-fdb9079bcb7f"}]: dispatch 2024-09-13T15:50:15.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:15 smithi189 ceph-mon[34790]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T15:50:15.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:15 smithi193 sudo[44006]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T15:50:15.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:15 smithi193 sudo[44006]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T15:50:15.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:15 smithi193 sudo[44006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T15:50:15.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:15 smithi193 sudo[44006]: pam_unix(sudo:session): session closed for user root 2024-09-13T15:50:16.148 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:15 smithi189 sudo[43263]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T15:50:16.148 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:15 smithi189 sudo[43263]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T15:50:16.148 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:15 smithi189 sudo[43263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T15:50:16.148 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:15 smithi189 sudo[43263]: pam_unix(sudo:session): session closed for user root 2024-09-13T15:50:16.159 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:16 smithi017 ceph-mon[30494]: pgmap v88: 1 pgs: 1 active+clean; 449 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:16.160 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T15:50:16.160 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:16 smithi017 ceph-mon[30494]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "90428e5f-dfd4-4cda-b240-fdb9079bcb7f"}]: dispatch 2024-09-13T15:50:16.160 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:50:16.160 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:50:16.160 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:16 smithi017 ceph-mon[30494]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "90428e5f-dfd4-4cda-b240-fdb9079bcb7f"}]': finished 2024-09-13T15:50:16.160 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:16 smithi017 ceph-mon[30494]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T15:50:16.160 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T15:50:16.160 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:16 smithi017 ceph-mon[30494]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T15:50:16.160 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T15:50:16.160 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:50:16.160 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:50:16.160 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:16 smithi017 ceph-mon[30494]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T15:50:16.160 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T15:50:16.161 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:50:16.161 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:50:16.161 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:16 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3994244458' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:50:16.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:16 smithi193 ceph-mon[35248]: pgmap v88: 1 pgs: 1 active+clean; 449 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:16.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:16 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T15:50:16.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:16 smithi193 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "90428e5f-dfd4-4cda-b240-fdb9079bcb7f"}]: dispatch 2024-09-13T15:50:16.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:16 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:50:16.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:16 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:50:16.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:16 smithi193 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "90428e5f-dfd4-4cda-b240-fdb9079bcb7f"}]': finished 2024-09-13T15:50:16.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:16 smithi193 ceph-mon[35248]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T15:50:16.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:16 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T15:50:16.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:16 smithi193 ceph-mon[35248]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T15:50:16.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:16 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T15:50:16.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:16 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:50:16.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:16 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:50:16.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:16 smithi193 ceph-mon[35248]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T15:50:16.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:16 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T15:50:16.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:16 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:50:16.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:16 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:50:16.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:16 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3994244458' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:50:16.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:16 smithi189 sudo[43266]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T15:50:16.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:16 smithi189 sudo[43266]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T15:50:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:16 smithi189 sudo[43266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T15:50:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:16 smithi189 sudo[43266]: pam_unix(sudo:session): session closed for user root 2024-09-13T15:50:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:16 smithi189 ceph-mon[34790]: pgmap v88: 1 pgs: 1 active+clean; 449 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:16 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T15:50:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:16 smithi189 ceph-mon[34790]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "90428e5f-dfd4-4cda-b240-fdb9079bcb7f"}]: dispatch 2024-09-13T15:50:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:16 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:50:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:16 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:50:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:16 smithi189 ceph-mon[34790]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "90428e5f-dfd4-4cda-b240-fdb9079bcb7f"}]': finished 2024-09-13T15:50:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:16 smithi189 ceph-mon[34790]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T15:50:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:16 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T15:50:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:16 smithi189 ceph-mon[34790]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T15:50:16.608 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:16 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T15:50:16.608 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:16 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:50:16.608 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:16 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:50:16.608 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:16 smithi189 ceph-mon[34790]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T15:50:16.608 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:16 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T15:50:16.608 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:16 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T15:50:16.608 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:16 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T15:50:16.608 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:16 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3994244458' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:50:17.412 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:17 smithi017 ceph-mon[30494]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T15:50:17.413 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:17 smithi017 ceph-mon[30494]: pgmap v90: 1 pgs: 1 active+clean; 449 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:17.413 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:17 smithi017 ceph-mon[30494]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T15:50:17.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:17 smithi193 ceph-mon[35248]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T15:50:17.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:17 smithi193 ceph-mon[35248]: pgmap v90: 1 pgs: 1 active+clean; 449 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:17.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:17 smithi193 ceph-mon[35248]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T15:50:17.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:17 smithi189 ceph-mon[34790]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T15:50:17.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:17 smithi189 ceph-mon[34790]: pgmap v90: 1 pgs: 1 active+clean; 449 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:17.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:17 smithi189 ceph-mon[34790]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T15:50:19.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:19 smithi017 ceph-mon[30494]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 341 KiB/s wr, 22 op/s 2024-09-13T15:50:19.516 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:19 smithi193 ceph-mon[35248]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 341 KiB/s wr, 22 op/s 2024-09-13T15:50:19.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:19 smithi189 ceph-mon[34790]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 341 KiB/s wr, 22 op/s 2024-09-13T15:50:21.325 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:21 smithi017 ceph-mon[30494]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 248 KiB/s wr, 16 op/s 2024-09-13T15:50:21.469 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:21 smithi193 ceph-mon[35248]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 248 KiB/s wr, 16 op/s 2024-09-13T15:50:21.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:21 smithi189 ceph-mon[34790]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 248 KiB/s wr, 16 op/s 2024-09-13T15:50:22.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:22 smithi017 ceph-mon[30494]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 195 KiB/s wr, 13 op/s 2024-09-13T15:50:22.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:22 smithi193 ceph-mon[35248]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 195 KiB/s wr, 13 op/s 2024-09-13T15:50:22.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:22 smithi189 ceph-mon[34790]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 195 KiB/s wr, 13 op/s 2024-09-13T15:50:23.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:23 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T15:50:23.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:23 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:23.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:23 smithi193 ceph-mon[35248]: Deploying daemon osd.3 on smithi017 2024-09-13T15:50:23.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:23 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T15:50:23.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:23 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:23.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:23 smithi017 ceph-mon[30494]: Deploying daemon osd.3 on smithi017 2024-09-13T15:50:23.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:23 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T15:50:23.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:23 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:23.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:23 smithi189 ceph-mon[34790]: Deploying daemon osd.3 on smithi017 2024-09-13T15:50:24.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:24 smithi193 ceph-mon[35248]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2024-09-13T15:50:24.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:24 smithi017 ceph-mon[30494]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2024-09-13T15:50:24.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:24 smithi189 ceph-mon[34790]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2024-09-13T15:50:27.467 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:27 smithi017 ceph-mon[30494]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 167 KiB/s wr, 11 op/s 2024-09-13T15:50:27.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:27 smithi193 ceph-mon[35248]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 167 KiB/s wr, 11 op/s 2024-09-13T15:50:27.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:27 smithi189 ceph-mon[34790]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 167 KiB/s wr, 11 op/s 2024-09-13T15:50:29.315 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:29 smithi017 ceph-mon[30494]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2024-09-13T15:50:29.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:29 smithi193 ceph-mon[35248]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2024-09-13T15:50:29.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:29 smithi189 ceph-mon[34790]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2024-09-13T15:50:30.180 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:30 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:50:30.180 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:30 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:30.180 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:30 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:30.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:30 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:50:30.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:30 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:30.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:30 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:30.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:30 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:50:30.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:30 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:30.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:30 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:31.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:31 smithi193 ceph-mon[35248]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:31.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:31 smithi017 ceph-mon[30494]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:31.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:31 smithi189 ceph-mon[34790]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:33.414 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:33 smithi017 ceph-mon[30494]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:33.414 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:33 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:33.414 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:33 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:33.414 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:33 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:33.414 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:33 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:50:33.414 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:33 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:33.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:33 smithi193 ceph-mon[35248]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:33.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:33 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:33.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:33 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:33.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:33 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:33.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:33 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:50:33.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:33 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:33.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:33 smithi189 ceph-mon[34790]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:33.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:33 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:33.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:33 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:33.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:33 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:33.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:33 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:50:33.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:33 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:33.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:33.768+0000 7fec82a00640 1 -- 172.21.15.17:0/3430013149 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fec880fe4a0 con 0x7fec700a10f0 2024-09-13T15:50:33.769 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 3 on host 'smithi017' 2024-09-13T15:50:33.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:33.771+0000 7fec90800640 1 -- 172.21.15.17:0/3430013149 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fec700a10f0 msgr2=0x7fec700a35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:33.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:33.771+0000 7fec90800640 1 --2- 172.21.15.17:0/3430013149 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fec700a10f0 0x7fec700a35b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fec88100760 tx=0x7fec7800b390 comp rx=0 tx=0).stop 2024-09-13T15:50:33.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:33.771+0000 7fec90800640 1 -- 172.21.15.17:0/3430013149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec880fe0a0 msgr2=0x7fec881009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:33.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:33.771+0000 7fec90800640 1 --2- 172.21.15.17:0/3430013149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec880fe0a0 0x7fec881009e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00d9b0 tx=0x7fec7c00de70 comp rx=0 tx=0).stop 2024-09-13T15:50:33.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:33.771+0000 7fec90800640 1 -- 172.21.15.17:0/3430013149 shutdown_connections 2024-09-13T15:50:33.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:33.771+0000 7fec90800640 1 --2- 172.21.15.17:0/3430013149 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fec700a10f0 0x7fec700a35b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:33.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:33.771+0000 7fec90800640 1 --2- 172.21.15.17:0/3430013149 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec88101a40 0x7fec880ff570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:33.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:33.771+0000 7fec90800640 1 --2- 172.21.15.17:0/3430013149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec88101080 0x7fec880ff030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:33.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:33.771+0000 7fec90800640 1 --2- 172.21.15.17:0/3430013149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec880fe0a0 0x7fec881009e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:33.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:33.771+0000 7fec90800640 1 -- 172.21.15.17:0/3430013149 >> 172.21.15.17:0/3430013149 conn(0x7fec880f9c10 msgr2=0x7fec881044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:33.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:33.772+0000 7fec90800640 1 -- 172.21.15.17:0/3430013149 shutdown_connections 2024-09-13T15:50:33.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:50:33.772+0000 7fec90800640 1 -- 172.21.15.17:0/3430013149 wait complete. 2024-09-13T15:50:34.477 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:34 smithi017 ceph-mon[30494]: from='osd.3 [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T15:50:34.477 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:50:34.477 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:34.477 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:34.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:34 smithi193 ceph-mon[35248]: from='osd.3 [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T15:50:34.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:50:34.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:34.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:34.506 DEBUG:teuthology.orchestra.run.smithi017:osd.3> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.3.service 2024-09-13T15:50:34.510 INFO:tasks.cephadm:Deploying osd.4 on smithi189 with /dev/vg_nvme/lv_3... 2024-09-13T15:50:34.510 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-13T15:50:34.539 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:34 smithi189 ceph-mon[34790]: from='osd.3 [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T15:50:34.539 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:34 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:50:34.539 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:34 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:34.539 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:34 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:34.716 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T15:50:35.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:35 smithi193 ceph-mon[35248]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:35.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:35 smithi193 ceph-mon[35248]: from='osd.3 [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T15:50:35.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:35 smithi193 ceph-mon[35248]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T15:50:35.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:35 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T15:50:35.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:35 smithi193 ceph-mon[35248]: from='osd.3 [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-13T15:50:35.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:35 smithi017 ceph-mon[30494]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:35.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:35 smithi017 ceph-mon[30494]: from='osd.3 [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T15:50:35.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:35 smithi017 ceph-mon[30494]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T15:50:35.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:35 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T15:50:35.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:35 smithi017 ceph-mon[30494]: from='osd.3 [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-13T15:50:35.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:35 smithi189 ceph-mon[34790]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:35.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:35 smithi189 ceph-mon[34790]: from='osd.3 [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T15:50:35.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:35 smithi189 ceph-mon[34790]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T15:50:35.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:35 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T15:50:35.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:35 smithi189 ceph-mon[34790]: from='osd.3 [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-13T15:50:35.859 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 13 15:50:35 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-3[51777]: 2024-09-13T15:50:35.747+0000 7feb19800640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T15:50:35.859 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 13 15:50:35 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-3[51777]: 2024-09-13T15:50:35.767+0000 7feb0f800640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:50:36.405 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:36 smithi017 ceph-mon[30494]: from='osd.3 [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-13T15:50:36.405 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:36 smithi017 ceph-mon[30494]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T15:50:36.405 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:36 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T15:50:36.405 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:36 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T15:50:36.405 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:36 smithi017 ceph-mon[30494]: from='osd.3 [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803]' entity='osd.3' 2024-09-13T15:50:36.499 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:36 smithi189 ceph-mon[34790]: from='osd.3 [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-13T15:50:36.500 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:36 smithi189 ceph-mon[34790]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T15:50:36.500 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:36 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T15:50:36.500 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:36 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T15:50:36.500 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:36 smithi189 ceph-mon[34790]: from='osd.3 [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803]' entity='osd.3' 2024-09-13T15:50:36.500 INFO:teuthology.orchestra.run.smithi189.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-13T15:50:36.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:36 smithi193 ceph-mon[35248]: from='osd.3 [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-13T15:50:36.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:36 smithi193 ceph-mon[35248]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T15:50:36.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:36 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T15:50:36.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:36 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T15:50:36.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:36 smithi193 ceph-mon[35248]: from='osd.3 [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803]' entity='osd.3' 2024-09-13T15:50:36.583 INFO:teuthology.orchestra.run.smithi189.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-13T15:50:36.596 INFO:teuthology.orchestra.run.smithi189.stderr: stderr: 10+0 records in 2024-09-13T15:50:36.597 INFO:teuthology.orchestra.run.smithi189.stderr:10+0 records out 2024-09-13T15:50:36.597 INFO:teuthology.orchestra.run.smithi189.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115122 s, 911 MB/s 2024-09-13T15:50:36.597 INFO:teuthology.orchestra.run.smithi189.stderr:--> Zapping successful for: 2024-09-13T15:50:37.228 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_3 2024-09-13T15:50:37.413 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:37 smithi017 ceph-mon[30494]: purged_snaps scrub starts 2024-09-13T15:50:37.413 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:37 smithi017 ceph-mon[30494]: purged_snaps scrub ok 2024-09-13T15:50:37.413 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:37 smithi017 ceph-mon[30494]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:37.413 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:37 smithi017 ceph-mon[30494]: osd.3 [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803] boot 2024-09-13T15:50:37.413 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:37 smithi017 ceph-mon[30494]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T15:50:37.413 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:37 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T15:50:37.414 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:37 smithi017 ceph-mon[30494]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T15:50:37.467 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T15:50:37.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:37 smithi193 ceph-mon[35248]: purged_snaps scrub starts 2024-09-13T15:50:37.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:37 smithi193 ceph-mon[35248]: purged_snaps scrub ok 2024-09-13T15:50:37.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:37 smithi193 ceph-mon[35248]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:37.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:37 smithi193 ceph-mon[35248]: osd.3 [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803] boot 2024-09-13T15:50:37.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:37 smithi193 ceph-mon[35248]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T15:50:37.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:37 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T15:50:37.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:37 smithi193 ceph-mon[35248]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T15:50:37.511 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:37 smithi189 ceph-mon[34790]: purged_snaps scrub starts 2024-09-13T15:50:37.512 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:37 smithi189 ceph-mon[34790]: purged_snaps scrub ok 2024-09-13T15:50:37.512 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:37 smithi189 ceph-mon[34790]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-13T15:50:37.512 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:37 smithi189 ceph-mon[34790]: osd.3 [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803] boot 2024-09-13T15:50:37.512 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:37 smithi189 ceph-mon[34790]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T15:50:37.512 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:37 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T15:50:37.512 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:37 smithi189 ceph-mon[34790]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T15:50:38.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:38 smithi189 ceph-mon[34790]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T15:50:38.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:38 smithi189 ceph-mon[34790]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 509 MiB used, 357 GiB / 358 GiB avail 2024-09-13T15:50:38.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:38 smithi189 ceph-mon[34790]: Detected new or changed devices on smithi017 2024-09-13T15:50:38.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:38 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:38.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:38 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:38.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:38 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:50:38.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:38 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:50:38.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:38 smithi189 ceph-mon[34790]: Adjusting osd_memory_target on smithi017 to 8547M 2024-09-13T15:50:38.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:38 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:38.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:38 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:38.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:38 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:50:38.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:38 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:38.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:38 smithi193 ceph-mon[35248]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T15:50:38.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:38 smithi193 ceph-mon[35248]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 509 MiB used, 357 GiB / 358 GiB avail 2024-09-13T15:50:38.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:38 smithi193 ceph-mon[35248]: Detected new or changed devices on smithi017 2024-09-13T15:50:38.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:38 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:38.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:38 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:38.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:38 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:50:38.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:38 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:50:38.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:38 smithi193 ceph-mon[35248]: Adjusting osd_memory_target on smithi017 to 8547M 2024-09-13T15:50:38.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:38 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:38.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:38 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:38.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:38 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:50:38.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:38 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:38.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:38 smithi017 ceph-mon[30494]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T15:50:38.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:38 smithi017 ceph-mon[30494]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 509 MiB used, 357 GiB / 358 GiB avail 2024-09-13T15:50:38.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:38 smithi017 ceph-mon[30494]: Detected new or changed devices on smithi017 2024-09-13T15:50:38.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:38 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:38.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:38 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:38.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:38 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:50:38.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:38 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:50:38.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:38 smithi017 ceph-mon[30494]: Adjusting osd_memory_target on smithi017 to 8547M 2024-09-13T15:50:38.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:38 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:38.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:38 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:38.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:38 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:50:38.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:38 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:39.191 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.172+0000 7f7ed1da4640 1 -- 172.21.15.189:0/2265138670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ecc0fe460 msgr2=0x7f7ecc0fe860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:39.192 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.172+0000 7f7ed1da4640 1 --2- 172.21.15.189:0/2265138670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ecc0fe460 0x7f7ecc0fe860 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc009900 tx=0x7f7ebc02a410 comp rx=0 tx=0).stop 2024-09-13T15:50:39.192 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.173+0000 7f7ed1da4640 1 -- 172.21.15.189:0/2265138670 shutdown_connections 2024-09-13T15:50:39.192 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.173+0000 7f7ed1da4640 1 --2- 172.21.15.189:0/2265138670 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ecc100020 0x7f7ecc1068b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:39.192 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.173+0000 7f7ed1da4640 1 --2- 172.21.15.189:0/2265138670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ecc0ff660 0x7f7ecc0ffae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:39.192 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.173+0000 7f7ed1da4640 1 --2- 172.21.15.189:0/2265138670 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ecc0fe460 0x7f7ecc0fe860 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:39.192 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.173+0000 7f7ed1da4640 1 -- 172.21.15.189:0/2265138670 >> 172.21.15.189:0/2265138670 conn(0x7f7ecc0f9c10 msgr2=0x7f7ecc0fc030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:39.192 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.173+0000 7f7ed1da4640 1 -- 172.21.15.189:0/2265138670 shutdown_connections 2024-09-13T15:50:39.192 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.173+0000 7f7ed1da4640 1 -- 172.21.15.189:0/2265138670 wait complete. 2024-09-13T15:50:39.192 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.173+0000 7f7ed1da4640 1 Processor -- start 2024-09-13T15:50:39.192 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.173+0000 7f7ed1da4640 1 -- start start 2024-09-13T15:50:39.192 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.174+0000 7f7ed1da4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ecc0fe460 0x7f7ecc109bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:39.193 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.174+0000 7f7ed1da4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ecc0ff660 0x7f7ecc108200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:39.193 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.174+0000 7f7ed1da4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ecc100020 0x7f7ecc108740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:39.193 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.174+0000 7f7ed1da4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc108ed0 con 0x7f7ecc100020 2024-09-13T15:50:39.193 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.174+0000 7f7ed1da4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc109040 con 0x7f7ecc0ff660 2024-09-13T15:50:39.193 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.174+0000 7f7ed1da4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc19fe70 con 0x7f7ecc0fe460 2024-09-13T15:50:39.193 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.174+0000 7f7ecaffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ecc0ff660 0x7f7ecc108200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:39.193 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.174+0000 7f7ecaffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ecc0ff660 0x7f7ecc108200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:38318/0 (socket says 172.21.15.189:38318) 2024-09-13T15:50:39.193 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.174+0000 7f7ecaffd640 1 -- 172.21.15.189:0/3392737843 learned_addr learned my addr 172.21.15.189:0/3392737843 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-13T15:50:39.193 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.174+0000 7f7ecb7fe640 1 --2- 172.21.15.189:0/3392737843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ecc0fe460 0x7f7ecc109bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:39.193 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.174+0000 7f7ecaffd640 1 -- 172.21.15.189:0/3392737843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ecc0fe460 msgr2=0x7f7ecc109bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:39.193 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.174+0000 7f7ecaffd640 1 --2- 172.21.15.189:0/3392737843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ecc0fe460 0x7f7ecc109bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:39.193 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.174+0000 7f7ecaffd640 1 -- 172.21.15.189:0/3392737843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ecc100020 msgr2=0x7f7ecc108740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:39.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.174+0000 7f7ecaffd640 1 --2- 172.21.15.189:0/3392737843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ecc100020 0x7f7ecc108740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:39.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.174+0000 7f7ecaffd640 1 -- 172.21.15.189:0/3392737843 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ebc009560 con 0x7f7ecc0ff660 2024-09-13T15:50:39.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.174+0000 7f7ecaffd640 1 --2- 172.21.15.189:0/3392737843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ecc0ff660 0x7f7ecc108200 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000b4d0 tx=0x7f7ec000b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:39.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.174+0000 7f7ec8ff9640 1 -- 172.21.15.189:0/3392737843 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0010870 con 0x7f7ecc0ff660 2024-09-13T15:50:39.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.174+0000 7f7ec8ff9640 1 -- 172.21.15.189:0/3392737843 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ec0010e90 con 0x7f7ecc0ff660 2024-09-13T15:50:39.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.174+0000 7f7ed1da4640 1 -- 172.21.15.189:0/3392737843 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ecc1a0120 con 0x7f7ecc0ff660 2024-09-13T15:50:39.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.174+0000 7f7ec8ff9640 1 -- 172.21.15.189:0/3392737843 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0017360 con 0x7f7ecc0ff660 2024-09-13T15:50:39.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.174+0000 7f7ed1da4640 1 -- 172.21.15.189:0/3392737843 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ecc1a06f0 con 0x7f7ecc0ff660 2024-09-13T15:50:39.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.176+0000 7f7ed1da4640 1 -- 172.21.15.189:0/3392737843 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ecc1058a0 con 0x7f7ecc0ff660 2024-09-13T15:50:39.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.176+0000 7f7ec8ff9640 1 -- 172.21.15.189:0/3392737843 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7ec000f5e0 con 0x7f7ecc0ff660 2024-09-13T15:50:39.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.177+0000 7f7ec8ff9640 1 --2- 172.21.15.189:0/3392737843 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7eb40a1100 0x7f7eb40a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:39.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.177+0000 7f7ec8ff9640 1 -- 172.21.15.189:0/3392737843 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3669+0+0 (secure 0 0 0) 0x7f7ec00cafd0 con 0x7f7ecc0ff660 2024-09-13T15:50:39.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.177+0000 7f7ecb7fe640 1 --2- 172.21.15.189:0/3392737843 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7eb40a1100 0x7f7eb40a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:39.195 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.178+0000 7f7ecb7fe640 1 --2- 172.21.15.189:0/3392737843 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7eb40a1100 0x7f7eb40a35c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc005ab0 tx=0x7f7ebc0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:39.195 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.182+0000 7f7ec8ff9640 1 -- 172.21.15.189:0/3392737843 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7ec0095980 con 0x7f7ecc0ff660 2024-09-13T15:50:39.354 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:39.353+0000 7f7ed1da4640 1 -- 172.21.15.189:0/3392737843 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ecc0608f0 con 0x7f7eb40a1100 2024-09-13T15:50:39.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:39 smithi189 ceph-mon[34790]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T15:50:39.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:39 smithi017 ceph-mon[30494]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T15:50:39.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:39 smithi193 ceph-mon[35248]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T15:50:40.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:40 smithi189 ceph-mon[34790]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T15:50:40.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:40 smithi189 ceph-mon[34790]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:50:40.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:40 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:50:40.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:40 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:50:40.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:40 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:40.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:40 smithi189 ceph-mon[34790]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 508 MiB used, 357 GiB / 358 GiB avail 2024-09-13T15:50:40.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:40 smithi193 ceph-mon[35248]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T15:50:40.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:40 smithi193 ceph-mon[35248]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:50:40.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:40 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:50:40.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:40 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:50:40.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:40 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:40.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:40 smithi193 ceph-mon[35248]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 508 MiB used, 357 GiB / 358 GiB avail 2024-09-13T15:50:40.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:40 smithi017 ceph-mon[30494]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T15:50:40.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:40 smithi017 ceph-mon[30494]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:50:40.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:40 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:50:40.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:40 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:50:40.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:40 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:40.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:40 smithi017 ceph-mon[30494]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 508 MiB used, 357 GiB / 358 GiB avail 2024-09-13T15:50:42.105 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:41 smithi189 ceph-mon[34790]: from='client.? 172.21.15.189:0/906166041' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1c537b6-98d2-4b66-b15a-65fe70b0ce25"}]: dispatch 2024-09-13T15:50:42.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:41 smithi189 ceph-mon[34790]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1c537b6-98d2-4b66-b15a-65fe70b0ce25"}]: dispatch 2024-09-13T15:50:42.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:41 smithi189 ceph-mon[34790]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e1c537b6-98d2-4b66-b15a-65fe70b0ce25"}]': finished 2024-09-13T15:50:42.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:41 smithi189 ceph-mon[34790]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T15:50:42.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:41 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T15:50:42.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:41 smithi193 ceph-mon[35248]: from='client.? 172.21.15.189:0/906166041' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1c537b6-98d2-4b66-b15a-65fe70b0ce25"}]: dispatch 2024-09-13T15:50:42.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:41 smithi193 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1c537b6-98d2-4b66-b15a-65fe70b0ce25"}]: dispatch 2024-09-13T15:50:42.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:41 smithi193 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e1c537b6-98d2-4b66-b15a-65fe70b0ce25"}]': finished 2024-09-13T15:50:42.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:41 smithi193 ceph-mon[35248]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T15:50:42.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:41 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T15:50:42.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:41 smithi017 ceph-mon[30494]: from='client.? 172.21.15.189:0/906166041' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1c537b6-98d2-4b66-b15a-65fe70b0ce25"}]: dispatch 2024-09-13T15:50:42.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:41 smithi017 ceph-mon[30494]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1c537b6-98d2-4b66-b15a-65fe70b0ce25"}]: dispatch 2024-09-13T15:50:42.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:41 smithi017 ceph-mon[30494]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e1c537b6-98d2-4b66-b15a-65fe70b0ce25"}]': finished 2024-09-13T15:50:42.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:41 smithi017 ceph-mon[30494]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T15:50:42.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:41 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T15:50:43.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:42 smithi189 ceph-mon[34790]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-09-13T15:50:43.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:42 smithi189 ceph-mon[34790]: from='client.? 172.21.15.189:0/4082171829' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:50:43.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:42 smithi193 ceph-mon[35248]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-09-13T15:50:43.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:42 smithi193 ceph-mon[35248]: from='client.? 172.21.15.189:0/4082171829' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:50:43.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:42 smithi017 ceph-mon[30494]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-09-13T15:50:43.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:42 smithi017 ceph-mon[30494]: from='client.? 172.21.15.189:0/4082171829' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:50:45.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:45 smithi193 ceph-mon[35248]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T15:50:45.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:45 smithi017 ceph-mon[30494]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T15:50:45.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:45 smithi189 ceph-mon[34790]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T15:50:47.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:47 smithi189 ceph-mon[34790]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-13T15:50:47.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:47 smithi193 ceph-mon[35248]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-13T15:50:47.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:47 smithi017 ceph-mon[30494]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-13T15:50:49.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:49 smithi189 ceph-mon[34790]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-13T15:50:49.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:49 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T15:50:49.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:49 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:49.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:49 smithi193 ceph-mon[35248]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-13T15:50:49.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:49 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T15:50:49.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:49 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:49.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:49 smithi017 ceph-mon[30494]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-13T15:50:49.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:49 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T15:50:49.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:49 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:50.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:50 smithi189 ceph-mon[34790]: Deploying daemon osd.4 on smithi189 2024-09-13T15:50:50.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:50 smithi193 ceph-mon[35248]: Deploying daemon osd.4 on smithi189 2024-09-13T15:50:50.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:50 smithi017 ceph-mon[30494]: Deploying daemon osd.4 on smithi189 2024-09-13T15:50:51.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:51 smithi189 ceph-mon[34790]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T15:50:51.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:51 smithi193 ceph-mon[35248]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T15:50:51.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:51 smithi017 ceph-mon[30494]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T15:50:53.276 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:53 smithi189 ceph-mon[34790]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-13T15:50:53.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:53 smithi193 ceph-mon[35248]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-13T15:50:53.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:53 smithi017 ceph-mon[30494]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-13T15:50:54.415 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:54 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:50:54.415 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:54 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:54.415 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:54 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:54.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:54 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:50:54.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:54 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:54.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:54 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:54.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:54 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:50:54.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:54 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:54.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:54 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:55.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:55 smithi189 ceph-mon[34790]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-13T15:50:55.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:55 smithi193 ceph-mon[35248]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-13T15:50:55.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:55 smithi017 ceph-mon[30494]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-13T15:50:57.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:57 smithi189 ceph-mon[34790]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T15:50:57.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:57 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:57.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:57 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:57.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:57 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:57.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:57 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:50:57.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:57 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:57.398 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 4 on host 'smithi189' 2024-09-13T15:50:57.398 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:57.396+0000 7f7ec8ff9640 1 -- 172.21.15.189:0/3392737843 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7ecc0608f0 con 0x7f7eb40a1100 2024-09-13T15:50:57.400 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:57.398+0000 7f7ed1da4640 1 -- 172.21.15.189:0/3392737843 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7eb40a1100 msgr2=0x7f7eb40a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:57.400 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:57.398+0000 7f7ed1da4640 1 --2- 172.21.15.189:0/3392737843 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7eb40a1100 0x7f7eb40a35c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc005ab0 tx=0x7f7ebc0314a0 comp rx=0 tx=0).stop 2024-09-13T15:50:57.400 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:57.399+0000 7f7ed1da4640 1 -- 172.21.15.189:0/3392737843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ecc0ff660 msgr2=0x7f7ecc108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:57.400 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:57.399+0000 7f7ed1da4640 1 --2- 172.21.15.189:0/3392737843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ecc0ff660 0x7f7ecc108200 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000b4d0 tx=0x7f7ec000b990 comp rx=0 tx=0).stop 2024-09-13T15:50:57.400 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:57.399+0000 7f7ed1da4640 1 -- 172.21.15.189:0/3392737843 shutdown_connections 2024-09-13T15:50:57.400 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:57.399+0000 7f7ed1da4640 1 --2- 172.21.15.189:0/3392737843 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7eb40a1100 0x7f7eb40a35c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:57.400 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:57.399+0000 7f7ed1da4640 1 --2- 172.21.15.189:0/3392737843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ecc100020 0x7f7ecc108740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:57.401 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:57.399+0000 7f7ed1da4640 1 --2- 172.21.15.189:0/3392737843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ecc0ff660 0x7f7ecc108200 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:57.401 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:57.399+0000 7f7ed1da4640 1 --2- 172.21.15.189:0/3392737843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ecc0fe460 0x7f7ecc109bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:57.401 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:57.399+0000 7f7ed1da4640 1 -- 172.21.15.189:0/3392737843 >> 172.21.15.189:0/3392737843 conn(0x7f7ecc0f9c10 msgr2=0x7f7ecc102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:57.401 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:57.399+0000 7f7ed1da4640 1 -- 172.21.15.189:0/3392737843 shutdown_connections 2024-09-13T15:50:57.401 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:50:57.399+0000 7f7ed1da4640 1 -- 172.21.15.189:0/3392737843 wait complete. 2024-09-13T15:50:57.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:57 smithi193 ceph-mon[35248]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T15:50:57.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:57 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:57.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:57 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:57.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:57 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:57.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:57 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:50:57.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:57 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:57.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:57 smithi017 ceph-mon[30494]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T15:50:57.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:57 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:57.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:57 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:57.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:57 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:50:57.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:57 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:50:57.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:57 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:58.105 DEBUG:teuthology.orchestra.run.smithi189:osd.4> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.4.service 2024-09-13T15:50:58.107 INFO:tasks.cephadm:Deploying osd.5 on smithi193 with /dev/vg_nvme/lv_3... 2024-09-13T15:50:58.107 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-13T15:50:58.314 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T15:50:58.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:58 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:50:58.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:58 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:58.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:58 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:58.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:58 smithi189 ceph-mon[34790]: from='osd.4 [v2:172.21.15.189:6808/2310375565,v1:172.21.15.189:6809/2310375565]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T15:50:58.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:58 smithi189 ceph-mon[34790]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T15:50:58.435 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:58 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:50:58.435 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:58 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:58.436 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:58 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:58.436 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:58 smithi193 ceph-mon[35248]: from='osd.4 [v2:172.21.15.189:6808/2310375565,v1:172.21.15.189:6809/2310375565]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T15:50:58.436 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:58 smithi193 ceph-mon[35248]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T15:50:58.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:58 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:50:58.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:58 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:58.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:58 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:50:58.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:58 smithi017 ceph-mon[30494]: from='osd.4 [v2:172.21.15.189:6808/2310375565,v1:172.21.15.189:6809/2310375565]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T15:50:58.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:58 smithi017 ceph-mon[30494]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T15:50:59.299 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:59 smithi189 ceph-mon[34790]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T15:50:59.299 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:59 smithi189 ceph-mon[34790]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T15:50:59.300 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:59 smithi189 ceph-mon[34790]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T15:50:59.300 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:59 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T15:50:59.300 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:59 smithi189 ceph-mon[34790]: from='osd.4 [v2:172.21.15.189:6808/2310375565,v1:172.21.15.189:6809/2310375565]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:50:59.300 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:50:59 smithi189 ceph-mon[34790]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:50:59.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:59 smithi193 ceph-mon[35248]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T15:50:59.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:59 smithi193 ceph-mon[35248]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T15:50:59.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:59 smithi193 ceph-mon[35248]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T15:50:59.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:59 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T15:50:59.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:59 smithi193 ceph-mon[35248]: from='osd.4 [v2:172.21.15.189:6808/2310375565,v1:172.21.15.189:6809/2310375565]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:50:59.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:50:59 smithi193 ceph-mon[35248]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:50:59.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:59 smithi017 ceph-mon[30494]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T15:50:59.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:59 smithi017 ceph-mon[30494]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T15:50:59.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:59 smithi017 ceph-mon[30494]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T15:50:59.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:59 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T15:50:59.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:59 smithi017 ceph-mon[30494]: from='osd.4 [v2:172.21.15.189:6808/2310375565,v1:172.21.15.189:6809/2310375565]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:50:59.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:50:59 smithi017 ceph-mon[30494]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:50:59.559 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 13 15:50:59 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-4[46014]: 2024-09-13T15:50:59.411+0000 7fb7ba9f2640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T15:50:59.560 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 13 15:50:59 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-4[46014]: 2024-09-13T15:50:59.417+0000 7fb7b681b640 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:51:00.332 INFO:teuthology.orchestra.run.smithi193.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-13T15:51:00.429 INFO:teuthology.orchestra.run.smithi193.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-13T15:51:00.446 INFO:teuthology.orchestra.run.smithi193.stderr: stderr: 10+0 records in 2024-09-13T15:51:00.446 INFO:teuthology.orchestra.run.smithi193.stderr:10+0 records out 2024-09-13T15:51:00.446 INFO:teuthology.orchestra.run.smithi193.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0151048 s, 694 MB/s 2024-09-13T15:51:00.446 INFO:teuthology.orchestra.run.smithi193.stderr:--> Zapping successful for: 2024-09-13T15:51:00.527 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:00 smithi193 ceph-mon[35248]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-13T15:51:00.527 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:00 smithi193 ceph-mon[35248]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T15:51:00.527 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T15:51:00.527 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T15:51:00.528 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:00 smithi193 ceph-mon[35248]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T15:51:00.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:00 smithi189 ceph-mon[34790]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-13T15:51:00.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:00 smithi189 ceph-mon[34790]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T15:51:00.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T15:51:00.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T15:51:00.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:00 smithi189 ceph-mon[34790]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T15:51:00.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:00 smithi017 ceph-mon[30494]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-13T15:51:00.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:00 smithi017 ceph-mon[30494]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T15:51:00.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T15:51:00.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T15:51:00.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:00 smithi017 ceph-mon[30494]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T15:51:01.196 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi193:vg_nvme/lv_3 2024-09-13T15:51:01.402 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T15:51:01.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:01 smithi193 ceph-mon[35248]: purged_snaps scrub starts 2024-09-13T15:51:01.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:01 smithi193 ceph-mon[35248]: purged_snaps scrub ok 2024-09-13T15:51:01.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:01 smithi193 ceph-mon[35248]: osd.4 [v2:172.21.15.189:6808/2310375565,v1:172.21.15.189:6809/2310375565] boot 2024-09-13T15:51:01.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:01 smithi193 ceph-mon[35248]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T15:51:01.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:01 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T15:51:01.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:01 smithi193 ceph-mon[35248]: Detected new or changed devices on smithi189 2024-09-13T15:51:01.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:01 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:01.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:01 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:01.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:01 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:51:01.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:01 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:51:01.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:01 smithi193 ceph-mon[35248]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-13T15:51:01.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:01 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:01.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:01 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:01.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:01 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:51:01.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:01 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:01.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:01 smithi017 ceph-mon[30494]: purged_snaps scrub starts 2024-09-13T15:51:01.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:01 smithi017 ceph-mon[30494]: purged_snaps scrub ok 2024-09-13T15:51:01.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:01 smithi017 ceph-mon[30494]: osd.4 [v2:172.21.15.189:6808/2310375565,v1:172.21.15.189:6809/2310375565] boot 2024-09-13T15:51:01.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:01 smithi017 ceph-mon[30494]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T15:51:01.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:01 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T15:51:01.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:01 smithi017 ceph-mon[30494]: Detected new or changed devices on smithi189 2024-09-13T15:51:01.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:01 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:01.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:01 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:01.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:01 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:51:01.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:01 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:51:01.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:01 smithi017 ceph-mon[30494]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-13T15:51:01.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:01 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:01.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:01 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:01.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:01 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:51:01.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:01 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:01.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:01 smithi189 ceph-mon[34790]: purged_snaps scrub starts 2024-09-13T15:51:01.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:01 smithi189 ceph-mon[34790]: purged_snaps scrub ok 2024-09-13T15:51:01.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:01 smithi189 ceph-mon[34790]: osd.4 [v2:172.21.15.189:6808/2310375565,v1:172.21.15.189:6809/2310375565] boot 2024-09-13T15:51:01.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:01 smithi189 ceph-mon[34790]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T15:51:01.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:01 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T15:51:01.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:01 smithi189 ceph-mon[34790]: Detected new or changed devices on smithi189 2024-09-13T15:51:01.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:01 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:01.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:01 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:01.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:01 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:51:01.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:01 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:51:01.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:01 smithi189 ceph-mon[34790]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-13T15:51:01.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:01 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:01.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:01 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:01.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:01 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:51:01.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:01 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:02.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:02 smithi193 ceph-mon[35248]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T15:51:02.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:02 smithi193 ceph-mon[35248]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:02.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:02 smithi017 ceph-mon[30494]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T15:51:02.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:02 smithi017 ceph-mon[30494]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:02.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:02 smithi189 ceph-mon[34790]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T15:51:02.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:02 smithi189 ceph-mon[34790]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:02.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.979+0000 7f793a4b1640 1 -- 172.21.15.193:0/3692473292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79340fece0 msgr2=0x7f79340ff0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:02.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.979+0000 7f793a4b1640 1 --2- 172.21.15.193:0/3692473292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79340fece0 0x7f79340ff0e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7924009900 tx=0x7f792402a410 comp rx=0 tx=0).stop 2024-09-13T15:51:02.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.979+0000 7f793a4b1640 1 -- 172.21.15.193:0/3692473292 shutdown_connections 2024-09-13T15:51:02.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.979+0000 7f793a4b1640 1 --2- 172.21.15.193:0/3692473292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79341008a0 0x7f7934107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:02.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.979+0000 7f793a4b1640 1 --2- 172.21.15.193:0/3692473292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79340ffee0 0x7f7934100360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:02.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.979+0000 7f793a4b1640 1 --2- 172.21.15.193:0/3692473292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79340fece0 0x7f79340ff0e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:02.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.979+0000 7f793a4b1640 1 -- 172.21.15.193:0/3692473292 >> 172.21.15.193:0/3692473292 conn(0x7f79340fa490 msgr2=0x7f79340fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:02.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.979+0000 7f793a4b1640 1 -- 172.21.15.193:0/3692473292 shutdown_connections 2024-09-13T15:51:02.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.979+0000 7f793a4b1640 1 -- 172.21.15.193:0/3692473292 wait complete. 2024-09-13T15:51:02.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.980+0000 7f793a4b1640 1 Processor -- start 2024-09-13T15:51:02.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.980+0000 7f793a4b1640 1 -- start start 2024-09-13T15:51:02.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.980+0000 7f793a4b1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79340fece0 0x7f7934102c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:02.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.980+0000 7f793a4b1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79340ffee0 0x7f79341012c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:02.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.980+0000 7f793a4b1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79341008a0 0x7f7934101800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:02.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.980+0000 7f793a4b1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7934101f90 con 0x7f79340ffee0 2024-09-13T15:51:02.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.980+0000 7f793a4b1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7934102100 con 0x7f79340fece0 2024-09-13T15:51:02.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.980+0000 7f793a4b1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793419ff20 con 0x7f79341008a0 2024-09-13T15:51:02.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.980+0000 7f7938a4e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79341008a0 0x7f7934101800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:02.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.980+0000 7f7938a4e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79341008a0 0x7f7934101800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:36502/0 (socket says 172.21.15.193:36502) 2024-09-13T15:51:02.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.980+0000 7f7938a4e640 1 -- 172.21.15.193:0/973609892 learned_addr learned my addr 172.21.15.193:0/973609892 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-13T15:51:02.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.980+0000 7f7933fff640 1 --2- 172.21.15.193:0/973609892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79340fece0 0x7f7934102c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:02.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.980+0000 7f79337fe640 1 --2- 172.21.15.193:0/973609892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79340ffee0 0x7f79341012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:02.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.980+0000 7f7938a4e640 1 -- 172.21.15.193:0/973609892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79340fece0 msgr2=0x7f7934102c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:02.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.980+0000 7f7938a4e640 1 --2- 172.21.15.193:0/973609892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79340fece0 0x7f7934102c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:02.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.980+0000 7f7938a4e640 1 -- 172.21.15.193:0/973609892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79340ffee0 msgr2=0x7f79341012c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:02.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.980+0000 7f7938a4e640 1 --2- 172.21.15.193:0/973609892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79340ffee0 0x7f79341012c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:02.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.980+0000 7f7938a4e640 1 -- 172.21.15.193:0/973609892 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7924009560 con 0x7f79341008a0 2024-09-13T15:51:02.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.980+0000 7f79337fe640 1 --2- 172.21.15.193:0/973609892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79340ffee0 0x7f79341012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:51:02.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.981+0000 7f7938a4e640 1 --2- 172.21.15.193:0/973609892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79341008a0 0x7f7934101800 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f792c00cb00 tx=0x7f792c00a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:02.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.981+0000 7f79317fa640 1 -- 172.21.15.193:0/973609892 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c00ae90 con 0x7f79341008a0 2024-09-13T15:51:02.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.981+0000 7f793a4b1640 1 -- 172.21.15.193:0/973609892 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79341a01d0 con 0x7f79341008a0 2024-09-13T15:51:02.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.981+0000 7f79317fa640 1 -- 172.21.15.193:0/973609892 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f792c005020 con 0x7f79341008a0 2024-09-13T15:51:02.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.981+0000 7f79317fa640 1 -- 172.21.15.193:0/973609892 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c00f6b0 con 0x7f79341008a0 2024-09-13T15:51:02.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.981+0000 7f793a4b1640 1 -- 172.21.15.193:0/973609892 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79341a0750 con 0x7f79341008a0 2024-09-13T15:51:02.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.982+0000 7f793a4b1640 1 -- 172.21.15.193:0/973609892 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f793410a620 con 0x7f79341008a0 2024-09-13T15:51:02.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.983+0000 7f79317fa640 1 -- 172.21.15.193:0/973609892 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f792c005190 con 0x7f79341008a0 2024-09-13T15:51:02.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.984+0000 7f79317fa640 1 --2- 172.21.15.193:0/973609892 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f791c0a1080 0x7f791c0a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:02.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.984+0000 7f79317fa640 1 -- 172.21.15.193:0/973609892 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f792c0cb8e0 con 0x7f79341008a0 2024-09-13T15:51:02.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.984+0000 7f7933fff640 1 --2- 172.21.15.193:0/973609892 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f791c0a1080 0x7f791c0a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:02.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.984+0000 7f7933fff640 1 --2- 172.21.15.193:0/973609892 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f791c0a1080 0x7f791c0a3540 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7924006010 tx=0x7f7924000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:02.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:02.988+0000 7f79317fa640 1 -- 172.21.15.193:0/973609892 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f792c0960e0 con 0x7f79341008a0 2024-09-13T15:51:03.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:03.157+0000 7f793a4b1640 1 -- 172.21.15.193:0/973609892 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f79340686a0 con 0x7f791c0a1080 2024-09-13T15:51:03.686 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:03 smithi193 ceph-mon[35248]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:51:03.686 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:03 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:51:03.686 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:03 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:51:03.686 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:03 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:03.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:03 smithi017 ceph-mon[30494]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:51:03.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:03 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:51:03.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:03 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:51:03.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:03 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:03.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:03 smithi189 ceph-mon[34790]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:51:03.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:03 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:51:03.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:03 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:51:03.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:03 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:04.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:04 smithi193 ceph-mon[35248]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:04.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:04 smithi017 ceph-mon[30494]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:04.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:04 smithi189 ceph-mon[34790]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:05.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:05 smithi193 ceph-mon[35248]: from='client.? 172.21.15.193:0/1659805855' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "48522fd7-d781-4447-873f-174dabd1e33a"}]: dispatch 2024-09-13T15:51:05.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:05 smithi193 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "48522fd7-d781-4447-873f-174dabd1e33a"}]: dispatch 2024-09-13T15:51:05.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:05 smithi193 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "48522fd7-d781-4447-873f-174dabd1e33a"}]': finished 2024-09-13T15:51:05.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:05 smithi193 ceph-mon[35248]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T15:51:05.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:05 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T15:51:05.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:05 smithi017 ceph-mon[30494]: from='client.? 172.21.15.193:0/1659805855' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "48522fd7-d781-4447-873f-174dabd1e33a"}]: dispatch 2024-09-13T15:51:05.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:05 smithi017 ceph-mon[30494]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "48522fd7-d781-4447-873f-174dabd1e33a"}]: dispatch 2024-09-13T15:51:05.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:05 smithi017 ceph-mon[30494]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "48522fd7-d781-4447-873f-174dabd1e33a"}]': finished 2024-09-13T15:51:05.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:05 smithi017 ceph-mon[30494]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T15:51:05.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:05 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T15:51:05.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:05 smithi189 ceph-mon[34790]: from='client.? 172.21.15.193:0/1659805855' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "48522fd7-d781-4447-873f-174dabd1e33a"}]: dispatch 2024-09-13T15:51:05.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:05 smithi189 ceph-mon[34790]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "48522fd7-d781-4447-873f-174dabd1e33a"}]: dispatch 2024-09-13T15:51:05.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:05 smithi189 ceph-mon[34790]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "48522fd7-d781-4447-873f-174dabd1e33a"}]': finished 2024-09-13T15:51:05.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:05 smithi189 ceph-mon[34790]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T15:51:05.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:05 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T15:51:06.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:06 smithi193 ceph-mon[35248]: from='client.? 172.21.15.193:0/2991046605' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:51:06.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:06 smithi193 ceph-mon[35248]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:06.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:06 smithi017 ceph-mon[30494]: from='client.? 172.21.15.193:0/2991046605' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:51:06.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:06 smithi017 ceph-mon[30494]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:06.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:06 smithi189 ceph-mon[34790]: from='client.? 172.21.15.193:0/2991046605' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:51:06.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:06 smithi189 ceph-mon[34790]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:09.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:09 smithi193 ceph-mon[35248]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:09.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:09 smithi017 ceph-mon[30494]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:09.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:09 smithi189 ceph-mon[34790]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:11.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:11 smithi193 ceph-mon[35248]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:11.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:11 smithi017 ceph-mon[30494]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:11.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:11 smithi189 ceph-mon[34790]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:13.429 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:13 smithi193 ceph-mon[35248]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:13.430 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:13 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T15:51:13.430 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:13 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:13 smithi017 ceph-mon[30494]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:13 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T15:51:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:13 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:13.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:13 smithi189 ceph-mon[34790]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:13.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:13 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T15:51:13.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:13 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:14.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:14 smithi193 ceph-mon[35248]: Deploying daemon osd.5 on smithi193 2024-09-13T15:51:14.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:14 smithi017 ceph-mon[30494]: Deploying daemon osd.5 on smithi193 2024-09-13T15:51:14.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:14 smithi189 ceph-mon[34790]: Deploying daemon osd.5 on smithi193 2024-09-13T15:51:15.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:15 smithi193 ceph-mon[35248]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:15.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:15 smithi017 ceph-mon[30494]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:15.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:15 smithi189 ceph-mon[34790]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:17.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:17 smithi193 ceph-mon[35248]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:17.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:17 smithi017 ceph-mon[30494]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:17.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:17 smithi189 ceph-mon[34790]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:18.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:18 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:51:18.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:18 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:18.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:18 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:18.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:18 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:51:18.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:18 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:18.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:18 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:18.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:18 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:51:18.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:18 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:18.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:18 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:19.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:19 smithi193 ceph-mon[35248]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:19.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:19 smithi017 ceph-mon[30494]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:19.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:19 smithi189 ceph-mon[34790]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:20.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:20.707+0000 7f79317fa640 1 -- 172.21.15.193:0/973609892 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f79340686a0 con 0x7f791c0a1080 2024-09-13T15:51:20.708 INFO:teuthology.orchestra.run.smithi193.stdout:Created osd(s) 5 on host 'smithi193' 2024-09-13T15:51:20.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:20.709+0000 7f793a4b1640 1 -- 172.21.15.193:0/973609892 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f791c0a1080 msgr2=0x7f791c0a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:20.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:20.709+0000 7f793a4b1640 1 --2- 172.21.15.193:0/973609892 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f791c0a1080 0x7f791c0a3540 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7924006010 tx=0x7f7924000bc0 comp rx=0 tx=0).stop 2024-09-13T15:51:20.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:20.709+0000 7f793a4b1640 1 -- 172.21.15.193:0/973609892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79341008a0 msgr2=0x7f7934101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:20.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:20.709+0000 7f793a4b1640 1 --2- 172.21.15.193:0/973609892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79341008a0 0x7f7934101800 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f792c00cb00 tx=0x7f792c00a250 comp rx=0 tx=0).stop 2024-09-13T15:51:20.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:20.709+0000 7f793a4b1640 1 -- 172.21.15.193:0/973609892 shutdown_connections 2024-09-13T15:51:20.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:20.709+0000 7f793a4b1640 1 --2- 172.21.15.193:0/973609892 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f791c0a1080 0x7f791c0a3540 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:20.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:20.709+0000 7f793a4b1640 1 --2- 172.21.15.193:0/973609892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79341008a0 0x7f7934101800 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:20.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:20.709+0000 7f793a4b1640 1 --2- 172.21.15.193:0/973609892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79340ffee0 0x7f79341012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:20.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:20.709+0000 7f793a4b1640 1 --2- 172.21.15.193:0/973609892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79340fece0 0x7f7934102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:20.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:20.709+0000 7f793a4b1640 1 -- 172.21.15.193:0/973609892 >> 172.21.15.193:0/973609892 conn(0x7f79340fa490 msgr2=0x7f7934067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:20.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:20.710+0000 7f793a4b1640 1 -- 172.21.15.193:0/973609892 shutdown_connections 2024-09-13T15:51:20.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:51:20.710+0000 7f793a4b1640 1 -- 172.21.15.193:0/973609892 wait complete. 2024-09-13T15:51:21.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:20 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:21.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:20 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:21.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:20 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:21.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:20 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:51:21.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:20 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:21.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:20 smithi193 ceph-mon[35248]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:21.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:20 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:51:21.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:20 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:21.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:20 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:21.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:20 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:21.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:20 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:21.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:20 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:21.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:20 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:51:21.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:20 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:21.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:20 smithi017 ceph-mon[30494]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:21.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:20 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:51:21.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:20 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:21.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:20 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:21.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:20 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:21.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:20 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:21.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:20 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:21.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:20 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:51:21.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:20 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:21.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:20 smithi189 ceph-mon[34790]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:21.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:20 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:51:21.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:20 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:21.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:20 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:21.389 DEBUG:teuthology.orchestra.run.smithi193:osd.5> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.5.service 2024-09-13T15:51:21.392 INFO:tasks.cephadm:Deploying osd.6 on smithi017 with /dev/vg_nvme/lv_2... 2024-09-13T15:51:21.392 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-13T15:51:21.715 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:51:22.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:21 smithi193 ceph-mon[35248]: from='osd.5 [v2:172.21.15.193:6808/1330877824,v1:172.21.15.193:6809/1330877824]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T15:51:22.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:21 smithi193 ceph-mon[35248]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T15:51:22.218 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:21 smithi017 ceph-mon[30494]: from='osd.5 [v2:172.21.15.193:6808/1330877824,v1:172.21.15.193:6809/1330877824]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T15:51:22.218 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:21 smithi017 ceph-mon[30494]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T15:51:22.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:21 smithi189 ceph-mon[34790]: from='osd.5 [v2:172.21.15.193:6808/1330877824,v1:172.21.15.193:6809/1330877824]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T15:51:22.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:21 smithi189 ceph-mon[34790]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T15:51:23.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:22 smithi017 ceph-mon[30494]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T15:51:23.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:22 smithi017 ceph-mon[30494]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T15:51:23.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:22 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T15:51:23.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:22 smithi017 ceph-mon[30494]: from='osd.5 [v2:172.21.15.193:6808/1330877824,v1:172.21.15.193:6809/1330877824]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:51:23.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:22 smithi017 ceph-mon[30494]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:51:23.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:22 smithi017 ceph-mon[30494]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:23.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:22 smithi193 ceph-mon[35248]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T15:51:23.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:22 smithi193 ceph-mon[35248]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T15:51:23.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:22 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T15:51:23.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:22 smithi193 ceph-mon[35248]: from='osd.5 [v2:172.21.15.193:6808/1330877824,v1:172.21.15.193:6809/1330877824]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:51:23.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:22 smithi193 ceph-mon[35248]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:51:23.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:22 smithi193 ceph-mon[35248]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:23.255 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 15:51:22 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T15:51:22.890+0000 7f4fd05ab640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T15:51:23.255 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 15:51:22 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T15:51:22.897+0000 7f4fcc3d4640 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:51:23.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:22 smithi189 ceph-mon[34790]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T15:51:23.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:22 smithi189 ceph-mon[34790]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T15:51:23.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:22 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T15:51:23.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:22 smithi189 ceph-mon[34790]: from='osd.5 [v2:172.21.15.193:6808/1330877824,v1:172.21.15.193:6809/1330877824]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:51:23.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:22 smithi189 ceph-mon[34790]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:51:23.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:22 smithi189 ceph-mon[34790]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-13T15:51:24.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:23 smithi017 ceph-mon[30494]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-13T15:51:24.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:23 smithi017 ceph-mon[30494]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T15:51:24.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:23 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T15:51:24.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:23 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T15:51:24.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:23 smithi017 ceph-mon[30494]: osd.5 [v2:172.21.15.193:6808/1330877824,v1:172.21.15.193:6809/1330877824] boot 2024-09-13T15:51:24.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:23 smithi017 ceph-mon[30494]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T15:51:24.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:23 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T15:51:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-13T15:51:24.174 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:23 smithi193 ceph-mon[35248]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-13T15:51:24.174 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:23 smithi193 ceph-mon[35248]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T15:51:24.174 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:23 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T15:51:24.175 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:23 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T15:51:24.175 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:23 smithi193 ceph-mon[35248]: osd.5 [v2:172.21.15.193:6808/1330877824,v1:172.21.15.193:6809/1330877824] boot 2024-09-13T15:51:24.175 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:23 smithi193 ceph-mon[35248]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T15:51:24.175 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:23 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T15:51:24.293 INFO:teuthology.orchestra.run.smithi017.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-13T15:51:24.327 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10+0 records in 2024-09-13T15:51:24.327 INFO:teuthology.orchestra.run.smithi017.stderr:10+0 records out 2024-09-13T15:51:24.327 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0282282 s, 371 MB/s 2024-09-13T15:51:24.327 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping successful for: 2024-09-13T15:51:24.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:23 smithi189 ceph-mon[34790]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-13T15:51:24.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:23 smithi189 ceph-mon[34790]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T15:51:24.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:23 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T15:51:24.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:23 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T15:51:24.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:23 smithi189 ceph-mon[34790]: osd.5 [v2:172.21.15.193:6808/1330877824,v1:172.21.15.193:6809/1330877824] boot 2024-09-13T15:51:24.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:23 smithi189 ceph-mon[34790]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T15:51:24.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:23 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T15:51:25.083 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi017:vg_nvme/lv_2 2024-09-13T15:51:25.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:24 smithi193 ceph-mon[35248]: purged_snaps scrub starts 2024-09-13T15:51:25.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:24 smithi193 ceph-mon[35248]: purged_snaps scrub ok 2024-09-13T15:51:25.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:24 smithi193 ceph-mon[35248]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:25.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:24 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:25.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:24 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:25.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:24 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:51:25.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:24 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:51:25.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:24 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:25.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:24 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:25.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:24 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:51:25.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:24 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:25.257 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:24 smithi189 ceph-mon[34790]: purged_snaps scrub starts 2024-09-13T15:51:25.258 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:24 smithi189 ceph-mon[34790]: purged_snaps scrub ok 2024-09-13T15:51:25.258 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:24 smithi189 ceph-mon[34790]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:25.258 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:24 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:25.258 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:24 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:25.258 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:24 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:51:25.258 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:24 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:51:25.258 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:24 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:25.258 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:24 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:25.258 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:24 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:51:25.258 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:24 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:25.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:24 smithi017 ceph-mon[30494]: purged_snaps scrub starts 2024-09-13T15:51:25.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:24 smithi017 ceph-mon[30494]: purged_snaps scrub ok 2024-09-13T15:51:25.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:24 smithi017 ceph-mon[30494]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:25.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:24 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:25.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:24 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:25.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:24 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:51:25.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:24 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:51:25.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:24 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:25.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:24 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:25.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:24 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:51:25.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:24 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:25.422 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:51:26.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:25 smithi193 ceph-mon[35248]: Detected new or changed devices on smithi193 2024-09-13T15:51:26.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:25 smithi193 ceph-mon[35248]: Adjusting osd_memory_target on smithi193 to 8544M 2024-09-13T15:51:26.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:25 smithi193 ceph-mon[35248]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T15:51:26.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:25 smithi017 ceph-mon[30494]: Detected new or changed devices on smithi193 2024-09-13T15:51:26.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:25 smithi017 ceph-mon[30494]: Adjusting osd_memory_target on smithi193 to 8544M 2024-09-13T15:51:26.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:25 smithi017 ceph-mon[30494]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T15:51:26.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:25 smithi189 ceph-mon[34790]: Detected new or changed devices on smithi193 2024-09-13T15:51:26.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:25 smithi189 ceph-mon[34790]: Adjusting osd_memory_target on smithi193 to 8544M 2024-09-13T15:51:26.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:25 smithi189 ceph-mon[34790]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T15:51:26.975 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:26 smithi017 ceph-mon[30494]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T15:51:26.975 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:26 smithi017 ceph-mon[30494]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:26.975 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:26 smithi017 ceph-mon[30494]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T15:51:27.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:26 smithi193 ceph-mon[35248]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T15:51:27.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:26 smithi193 ceph-mon[35248]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:27.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:26 smithi193 ceph-mon[35248]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T15:51:27.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:26 smithi189 ceph-mon[34790]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T15:51:27.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:26 smithi189 ceph-mon[34790]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:27.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:26 smithi189 ceph-mon[34790]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T15:51:27.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.628+0000 7f4fbf600640 1 -- 172.21.15.17:0/2621344537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fb80ffde0 msgr2=0x7f4fb81001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:27.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.628+0000 7f4fbf600640 1 --2- 172.21.15.17:0/2621344537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fb80ffde0 0x7f4fb81001e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4fac009900 tx=0x7f4fac02a3f0 comp rx=0 tx=0).stop 2024-09-13T15:51:27.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.628+0000 7f4fbf600640 1 -- 172.21.15.17:0/2621344537 shutdown_connections 2024-09-13T15:51:27.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.628+0000 7f4fbf600640 1 --2- 172.21.15.17:0/2621344537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fb81019a0 0x7f4fb8108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:27.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.628+0000 7f4fbf600640 1 --2- 172.21.15.17:0/2621344537 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4fb8100fe0 0x7f4fb8101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:27.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.628+0000 7f4fbf600640 1 --2- 172.21.15.17:0/2621344537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fb80ffde0 0x7f4fb81001e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:27.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.628+0000 7f4fbf600640 1 -- 172.21.15.17:0/2621344537 >> 172.21.15.17:0/2621344537 conn(0x7f4fb80fb590 msgr2=0x7f4fb80fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:27.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.628+0000 7f4fbf600640 1 -- 172.21.15.17:0/2621344537 shutdown_connections 2024-09-13T15:51:27.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.628+0000 7f4fbf600640 1 -- 172.21.15.17:0/2621344537 wait complete. 2024-09-13T15:51:27.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.629+0000 7f4fbf600640 1 Processor -- start 2024-09-13T15:51:27.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.629+0000 7f4fbf600640 1 -- start start 2024-09-13T15:51:27.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.630+0000 7f4fbf600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fb80ffde0 0x7f4fb8198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:27.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.630+0000 7f4fbf600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fb8100fe0 0x7f4fb8198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:27.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.630+0000 7f4fbf600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4fb81019a0 0x7f4fb819f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:27.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.630+0000 7f4fbf600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb819fb20 con 0x7f4fb8100fe0 2024-09-13T15:51:27.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.630+0000 7f4fbf600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb819fc90 con 0x7f4fb80ffde0 2024-09-13T15:51:27.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.630+0000 7f4fbf600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb819fe50 con 0x7f4fb81019a0 2024-09-13T15:51:27.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.630+0000 7f4fb7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fb8100fe0 0x7f4fb8198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:27.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.630+0000 7f4fb7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fb8100fe0 0x7f4fb8198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50578/0 (socket says 172.21.15.17:50578) 2024-09-13T15:51:27.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.630+0000 7f4fb7e00640 1 -- 172.21.15.17:0/4097446004 learned_addr learned my addr 172.21.15.17:0/4097446004 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:51:27.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.630+0000 7f4fbcc00640 1 --2- 172.21.15.17:0/4097446004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fb80ffde0 0x7f4fb8198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:27.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.630+0000 7f4fbd600640 1 --2- 172.21.15.17:0/4097446004 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4fb81019a0 0x7f4fb819f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:27.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.630+0000 7f4fb7e00640 1 -- 172.21.15.17:0/4097446004 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4fb81019a0 msgr2=0x7f4fb819f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:27.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.630+0000 7f4fb7e00640 1 --2- 172.21.15.17:0/4097446004 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4fb81019a0 0x7f4fb819f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:27.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.630+0000 7f4fb7e00640 1 -- 172.21.15.17:0/4097446004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fb80ffde0 msgr2=0x7f4fb8198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:27.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.630+0000 7f4fb7e00640 1 --2- 172.21.15.17:0/4097446004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fb80ffde0 0x7f4fb8198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:27.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.630+0000 7f4fb7e00640 1 -- 172.21.15.17:0/4097446004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac009560 con 0x7f4fb8100fe0 2024-09-13T15:51:27.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.630+0000 7f4fbd600640 1 --2- 172.21.15.17:0/4097446004 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4fb81019a0 0x7f4fb819f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:51:27.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.631+0000 7f4fb7e00640 1 --2- 172.21.15.17:0/4097446004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fb8100fe0 0x7f4fb8198560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400d950 tx=0x7f4fa400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:27.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.631+0000 7f4fb5600640 1 -- 172.21.15.17:0/4097446004 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4009c30 con 0x7f4fb8100fe0 2024-09-13T15:51:27.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.631+0000 7f4fbf600640 1 -- 172.21.15.17:0/4097446004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb81a0130 con 0x7f4fb8100fe0 2024-09-13T15:51:27.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.631+0000 7f4fb5600640 1 -- 172.21.15.17:0/4097446004 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fa4009d90 con 0x7f4fb8100fe0 2024-09-13T15:51:27.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.631+0000 7f4fb5600640 1 -- 172.21.15.17:0/4097446004 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa400f740 con 0x7f4fb8100fe0 2024-09-13T15:51:27.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.631+0000 7f4fbf600640 1 -- 172.21.15.17:0/4097446004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb81a0680 con 0x7f4fb8100fe0 2024-09-13T15:51:27.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.632+0000 7f4fbf600640 1 -- 172.21.15.17:0/4097446004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb810b6d0 con 0x7f4fb8100fe0 2024-09-13T15:51:27.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.634+0000 7f4fb5600640 1 -- 172.21.15.17:0/4097446004 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4fa4010a20 con 0x7f4fb8100fe0 2024-09-13T15:51:27.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.635+0000 7f4fb5600640 1 --2- 172.21.15.17:0/4097446004 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4fa00a1130 0x7f4fa00a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:27.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.636+0000 7f4fb5600640 1 -- 172.21.15.17:0/4097446004 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4533+0+0 (secure 0 0 0) 0x7f4fa40cb650 con 0x7f4fb8100fe0 2024-09-13T15:51:27.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.636+0000 7f4fbcc00640 1 --2- 172.21.15.17:0/4097446004 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4fa00a1130 0x7f4fa00a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:27.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.637+0000 7f4fbcc00640 1 --2- 172.21.15.17:0/4097446004 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4fa00a1130 0x7f4fa00a35f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4fac031500 tx=0x7f4fac005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:27.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.640+0000 7f4fb5600640 1 -- 172.21.15.17:0/4097446004 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4fa4095c00 con 0x7f4fb8100fe0 2024-09-13T15:51:27.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:27.827+0000 7f4fbf600640 1 -- 172.21.15.17:0/4097446004 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fb8107f70 con 0x7f4fa00a1130 2024-09-13T15:51:28.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:28 smithi017 ceph-mon[30494]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T15:51:28.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:28 smithi017 ceph-mon[30494]: from='client.14310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:51:28.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:28 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:51:28.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:28 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:51:28.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:28 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:28.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:28 smithi017 ceph-mon[30494]: pgmap v146: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T15:51:28.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:28 smithi189 ceph-mon[34790]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T15:51:28.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:28 smithi189 ceph-mon[34790]: from='client.14310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:51:28.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:28 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:51:28.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:28 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:51:28.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:28 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:28.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:28 smithi189 ceph-mon[34790]: pgmap v146: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T15:51:28.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:28 smithi193 ceph-mon[35248]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T15:51:28.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:28 smithi193 ceph-mon[35248]: from='client.14310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:51:28.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:28 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:51:28.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:28 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:51:28.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:28 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:28.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:28 smithi193 ceph-mon[35248]: pgmap v146: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T15:51:31.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:31 smithi193 ceph-mon[35248]: pgmap v147: 1 pgs: 1 peering; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-13T15:51:31.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:31 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3312052167' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47bea191-fb53-40a7-8563-8ebf17dd5bf7"}]: dispatch 2024-09-13T15:51:31.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:31 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3312052167' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47bea191-fb53-40a7-8563-8ebf17dd5bf7"}]': finished 2024-09-13T15:51:31.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:31 smithi193 ceph-mon[35248]: osdmap e44: 7 total, 6 up, 7 in 2024-09-13T15:51:31.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:31 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T15:51:31.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:31 smithi017 ceph-mon[30494]: pgmap v147: 1 pgs: 1 peering; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-13T15:51:31.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:31 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3312052167' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47bea191-fb53-40a7-8563-8ebf17dd5bf7"}]: dispatch 2024-09-13T15:51:31.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:31 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3312052167' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47bea191-fb53-40a7-8563-8ebf17dd5bf7"}]': finished 2024-09-13T15:51:31.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:31 smithi017 ceph-mon[30494]: osdmap e44: 7 total, 6 up, 7 in 2024-09-13T15:51:31.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:31 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T15:51:31.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:31 smithi189 ceph-mon[34790]: pgmap v147: 1 pgs: 1 peering; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-13T15:51:31.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:31 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3312052167' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47bea191-fb53-40a7-8563-8ebf17dd5bf7"}]: dispatch 2024-09-13T15:51:31.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:31 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3312052167' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47bea191-fb53-40a7-8563-8ebf17dd5bf7"}]': finished 2024-09-13T15:51:31.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:31 smithi189 ceph-mon[34790]: osdmap e44: 7 total, 6 up, 7 in 2024-09-13T15:51:31.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:31 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T15:51:32.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:32 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/4167227171' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:51:32.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:32 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/4167227171' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:51:32.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:32 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/4167227171' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:51:33.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:33 smithi193 ceph-mon[35248]: pgmap v149: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T15:51:33.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:33 smithi017 ceph-mon[30494]: pgmap v149: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T15:51:33.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:33 smithi189 ceph-mon[34790]: pgmap v149: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T15:51:35.494 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:35 smithi017 ceph-mon[30494]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-13T15:51:35.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:35 smithi193 ceph-mon[35248]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-13T15:51:35.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:35 smithi189 ceph-mon[34790]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-13T15:51:37.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:37 smithi017 ceph-mon[30494]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:37.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:37 smithi193 ceph-mon[35248]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:37.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:37 smithi189 ceph-mon[34790]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:39.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:39 smithi193 ceph-mon[35248]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:39.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:39 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-13T15:51:39.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:39 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:39.507 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:39 smithi017 ceph-mon[30494]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:39.507 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:39 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-13T15:51:39.507 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:39 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:39.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:39 smithi189 ceph-mon[34790]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:39.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:39 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-13T15:51:39.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:39 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:40.372 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:40 smithi017 ceph-mon[30494]: Deploying daemon osd.6 on smithi017 2024-09-13T15:51:40.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:40 smithi193 ceph-mon[35248]: Deploying daemon osd.6 on smithi017 2024-09-13T15:51:40.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:40 smithi189 ceph-mon[34790]: Deploying daemon osd.6 on smithi017 2024-09-13T15:51:41.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:41 smithi193 ceph-mon[35248]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:41.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:41 smithi017 ceph-mon[30494]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:41.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:41 smithi189 ceph-mon[34790]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:43.419 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:43 smithi017 ceph-mon[30494]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:43.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:43 smithi193 ceph-mon[35248]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:43.608 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:43 smithi189 ceph-mon[34790]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:45.243 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:45 smithi017 ceph-mon[30494]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:45.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:45 smithi193 ceph-mon[35248]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:45.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:45 smithi189 ceph-mon[34790]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:46.313 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:51:46.314 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:46.314 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:46.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:46 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:51:46.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:46 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:46.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:46 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:46.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:46 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:51:46.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:46 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:46.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:46 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:47.502 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:47 smithi017 ceph-mon[30494]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:47.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:47 smithi193 ceph-mon[35248]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:47.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:47 smithi189 ceph-mon[34790]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:48.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:48 smithi193 ceph-mon[35248]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:48.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:48 smithi017 ceph-mon[30494]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:48.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:48 smithi189 ceph-mon[34790]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:49.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:49.544+0000 7f4fb5600640 1 -- 172.21.15.17:0/4097446004 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4fb8107f70 con 0x7f4fa00a1130 2024-09-13T15:51:49.546 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 6 on host 'smithi017' 2024-09-13T15:51:49.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:49.546+0000 7f4fbf600640 1 -- 172.21.15.17:0/4097446004 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4fa00a1130 msgr2=0x7f4fa00a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:49.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:49.546+0000 7f4fbf600640 1 --2- 172.21.15.17:0/4097446004 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4fa00a1130 0x7f4fa00a35f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4fac031500 tx=0x7f4fac005780 comp rx=0 tx=0).stop 2024-09-13T15:51:49.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:49.546+0000 7f4fbf600640 1 -- 172.21.15.17:0/4097446004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fb8100fe0 msgr2=0x7f4fb8198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:49.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:49.546+0000 7f4fbf600640 1 --2- 172.21.15.17:0/4097446004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fb8100fe0 0x7f4fb8198560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400d950 tx=0x7f4fa400de10 comp rx=0 tx=0).stop 2024-09-13T15:51:49.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:49.547+0000 7f4fbf600640 1 -- 172.21.15.17:0/4097446004 shutdown_connections 2024-09-13T15:51:49.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:49.547+0000 7f4fbf600640 1 --2- 172.21.15.17:0/4097446004 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4fa00a1130 0x7f4fa00a35f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:49.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:49.547+0000 7f4fbf600640 1 --2- 172.21.15.17:0/4097446004 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4fb81019a0 0x7f4fb819f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:49.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:49.547+0000 7f4fbf600640 1 --2- 172.21.15.17:0/4097446004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fb8100fe0 0x7f4fb8198560 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:49.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:49.547+0000 7f4fbf600640 1 --2- 172.21.15.17:0/4097446004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fb80ffde0 0x7f4fb8198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:49.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:49.547+0000 7f4fbf600640 1 -- 172.21.15.17:0/4097446004 >> 172.21.15.17:0/4097446004 conn(0x7f4fb80fb590 msgr2=0x7f4fb8106850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:49.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:49.547+0000 7f4fbf600640 1 -- 172.21.15.17:0/4097446004 shutdown_connections 2024-09-13T15:51:49.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:51:49.547+0000 7f4fbf600640 1 -- 172.21.15.17:0/4097446004 wait complete. 2024-09-13T15:51:49.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:49 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:49.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:49 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:49.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:49 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:49.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:49 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:51:49.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:49 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:49.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:49 smithi017 ceph-mon[30494]: from='osd.6 [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-13T15:51:49.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:49 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:49.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:49 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:49.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:49 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:49.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:49 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:51:49.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:49 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:49.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:49 smithi189 ceph-mon[34790]: from='osd.6 [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-13T15:51:50.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:49 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:50.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:49 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:50.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:49 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:50.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:49 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:51:50.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:49 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:50.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:49 smithi193 ceph-mon[35248]: from='osd.6 [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-13T15:51:50.322 DEBUG:teuthology.orchestra.run.smithi017:osd.6> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.6.service 2024-09-13T15:51:50.326 INFO:tasks.cephadm:Deploying osd.7 on smithi189 with /dev/vg_nvme/lv_2... 2024-09-13T15:51:50.326 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-13T15:51:50.534 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T15:51:50.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:50 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:51:50.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:50 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:50.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:50 smithi017 ceph-mon[30494]: from='osd.6 [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-13T15:51:50.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:50 smithi017 ceph-mon[30494]: osdmap e45: 7 total, 6 up, 7 in 2024-09-13T15:51:50.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:50 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T15:51:50.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:50 smithi017 ceph-mon[30494]: from='osd.6 [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-13T15:51:50.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:50 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:50.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:50 smithi017 ceph-mon[30494]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:50.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:50 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:51:50.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:50 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:50.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:50 smithi189 ceph-mon[34790]: from='osd.6 [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-13T15:51:50.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:50 smithi189 ceph-mon[34790]: osdmap e45: 7 total, 6 up, 7 in 2024-09-13T15:51:50.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:50 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T15:51:50.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:50 smithi189 ceph-mon[34790]: from='osd.6 [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-13T15:51:50.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:50 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:50.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:50 smithi189 ceph-mon[34790]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:51.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:50 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:51:51.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:50 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:51.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:50 smithi193 ceph-mon[35248]: from='osd.6 [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-13T15:51:51.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:50 smithi193 ceph-mon[35248]: osdmap e45: 7 total, 6 up, 7 in 2024-09-13T15:51:51.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:50 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T15:51:51.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:50 smithi193 ceph-mon[35248]: from='osd.6 [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-13T15:51:51.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:50 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:51.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:50 smithi193 ceph-mon[35248]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:51.512 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 15:51:51 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T15:51:51.161+0000 7f4b94800640 -1 osd.6 0 waiting for initial osdmap 2024-09-13T15:51:51.512 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 15:51:51 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T15:51:51.182+0000 7f4b8a800640 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:51:51.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:51 smithi189 ceph-mon[34790]: from='osd.6 [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-13T15:51:51.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:51 smithi189 ceph-mon[34790]: osdmap e46: 7 total, 6 up, 7 in 2024-09-13T15:51:51.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:51 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T15:51:51.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:51 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T15:51:51.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:51 smithi189 ceph-mon[34790]: from='osd.6 [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382]' entity='osd.6' 2024-09-13T15:51:52.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:51 smithi193 ceph-mon[35248]: from='osd.6 [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-13T15:51:52.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:51 smithi193 ceph-mon[35248]: osdmap e46: 7 total, 6 up, 7 in 2024-09-13T15:51:52.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:51 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T15:51:52.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:51 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T15:51:52.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:51 smithi193 ceph-mon[35248]: from='osd.6 [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382]' entity='osd.6' 2024-09-13T15:51:52.008 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:51 smithi017 ceph-mon[30494]: from='osd.6 [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-13T15:51:52.008 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:51 smithi017 ceph-mon[30494]: osdmap e46: 7 total, 6 up, 7 in 2024-09-13T15:51:52.008 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:51 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T15:51:52.008 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:51 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T15:51:52.008 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:51 smithi017 ceph-mon[30494]: from='osd.6 [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382]' entity='osd.6' 2024-09-13T15:51:52.440 INFO:teuthology.orchestra.run.smithi189.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-13T15:51:52.528 INFO:teuthology.orchestra.run.smithi189.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-13T15:51:52.542 INFO:teuthology.orchestra.run.smithi189.stderr: stderr: 10+0 records in 2024-09-13T15:51:52.542 INFO:teuthology.orchestra.run.smithi189.stderr:10+0 records out 2024-09-13T15:51:52.542 INFO:teuthology.orchestra.run.smithi189.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0117589 s, 892 MB/s 2024-09-13T15:51:52.542 INFO:teuthology.orchestra.run.smithi189.stderr:--> Zapping successful for: 2024-09-13T15:51:52.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:52 smithi017 ceph-mon[30494]: purged_snaps scrub starts 2024-09-13T15:51:52.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:52 smithi017 ceph-mon[30494]: purged_snaps scrub ok 2024-09-13T15:51:52.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T15:51:52.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:52 smithi017 ceph-mon[30494]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:52.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:52 smithi017 ceph-mon[30494]: osd.6 [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382] boot 2024-09-13T15:51:52.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:52 smithi017 ceph-mon[30494]: osdmap e47: 7 total, 7 up, 7 in 2024-09-13T15:51:52.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T15:51:52.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:52 smithi189 ceph-mon[34790]: purged_snaps scrub starts 2024-09-13T15:51:52.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:52 smithi189 ceph-mon[34790]: purged_snaps scrub ok 2024-09-13T15:51:52.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T15:51:52.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:52 smithi189 ceph-mon[34790]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:52.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:52 smithi189 ceph-mon[34790]: osd.6 [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382] boot 2024-09-13T15:51:52.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:52 smithi189 ceph-mon[34790]: osdmap e47: 7 total, 7 up, 7 in 2024-09-13T15:51:52.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T15:51:53.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:52 smithi193 ceph-mon[35248]: purged_snaps scrub starts 2024-09-13T15:51:53.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:52 smithi193 ceph-mon[35248]: purged_snaps scrub ok 2024-09-13T15:51:53.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T15:51:53.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:52 smithi193 ceph-mon[35248]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-13T15:51:53.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:52 smithi193 ceph-mon[35248]: osd.6 [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382] boot 2024-09-13T15:51:53.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:52 smithi193 ceph-mon[35248]: osdmap e47: 7 total, 7 up, 7 in 2024-09-13T15:51:53.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T15:51:53.217 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_2 2024-09-13T15:51:53.420 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T15:51:54.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:54 smithi193 ceph-mon[35248]: osdmap e48: 7 total, 7 up, 7 in 2024-09-13T15:51:54.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:54 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:54.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:54 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:54.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:54 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:51:54.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:54 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:51:54.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:54 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:51:54.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:54 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:54.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:54 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:54.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:54 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:51:54.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:54 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:54.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:54 smithi017 ceph-mon[30494]: osdmap e48: 7 total, 7 up, 7 in 2024-09-13T15:51:54.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:54 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:54.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:54 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:54.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:54 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:51:54.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:54 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:51:54.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:54 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:51:54.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:54 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:54.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:54 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:54.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:54 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:51:54.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:54 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:54.543 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:54 smithi189 ceph-mon[34790]: osdmap e48: 7 total, 7 up, 7 in 2024-09-13T15:51:54.543 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:54 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:54.543 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:54 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:54.543 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:54 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:51:54.543 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:54 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:51:54.543 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:54 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:51:54.543 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:54 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:54.543 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:54 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:54.544 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:54 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:51:54.544 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:54 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:51:55.096 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.079+0000 7f90ebade640 1 -- 172.21.15.189:0/1674302237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90e41008a0 msgr2=0x7f90e4102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:55.097 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.079+0000 7f90ebade640 1 --2- 172.21.15.189:0/1674302237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90e41008a0 0x7f90e4102c90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009900 tx=0x7f90e002a410 comp rx=0 tx=0).stop 2024-09-13T15:51:55.097 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.079+0000 7f90ebade640 1 -- 172.21.15.189:0/1674302237 shutdown_connections 2024-09-13T15:51:55.097 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.079+0000 7f90ebade640 1 --2- 172.21.15.189:0/1674302237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90e4105b00 0x7f90e4107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:55.097 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.079+0000 7f90ebade640 1 --2- 172.21.15.189:0/1674302237 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90e41031d0 0x7f90e41055c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:55.097 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.079+0000 7f90ebade640 1 --2- 172.21.15.189:0/1674302237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90e41008a0 0x7f90e4102c90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:55.097 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.079+0000 7f90ebade640 1 -- 172.21.15.189:0/1674302237 >> 172.21.15.189:0/1674302237 conn(0x7f90e40fa4c0 msgr2=0x7f90e40fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:55.097 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.079+0000 7f90ebade640 1 -- 172.21.15.189:0/1674302237 shutdown_connections 2024-09-13T15:51:55.097 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.079+0000 7f90ebade640 1 -- 172.21.15.189:0/1674302237 wait complete. 2024-09-13T15:51:55.097 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.080+0000 7f90ebade640 1 Processor -- start 2024-09-13T15:51:55.098 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.080+0000 7f90ebade640 1 -- start start 2024-09-13T15:51:55.098 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.080+0000 7f90ebade640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90e41008a0 0x7f90e4100200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:55.098 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.080+0000 7f90ebade640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90e41031d0 0x7f90e40fe850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:55.098 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.080+0000 7f90ebade640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90e4105b00 0x7f90e40fed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:55.098 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.080+0000 7f90ebade640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e40ff520 con 0x7f90e41031d0 2024-09-13T15:51:55.098 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.080+0000 7f90ebade640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e40ff690 con 0x7f90e4105b00 2024-09-13T15:51:55.098 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.080+0000 7f90ebade640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e419fe40 con 0x7f90e41008a0 2024-09-13T15:51:55.098 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.080+0000 7f90ea07b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90e4105b00 0x7f90e40fed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:55.098 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.080+0000 7f90ea07b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90e4105b00 0x7f90e40fed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:37752/0 (socket says 172.21.15.189:37752) 2024-09-13T15:51:55.098 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.080+0000 7f90ea07b640 1 -- 172.21.15.189:0/1421151791 learned_addr learned my addr 172.21.15.189:0/1421151791 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-13T15:51:55.098 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.080+0000 7f90e987a640 1 --2- 172.21.15.189:0/1421151791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90e41008a0 0x7f90e4100200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:55.098 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.080+0000 7f90e9079640 1 --2- 172.21.15.189:0/1421151791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90e41031d0 0x7f90e40fe850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:55.098 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.080+0000 7f90ea07b640 1 -- 172.21.15.189:0/1421151791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90e41008a0 msgr2=0x7f90e4100200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:55.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.080+0000 7f90ea07b640 1 --2- 172.21.15.189:0/1421151791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90e41008a0 0x7f90e4100200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:55.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.080+0000 7f90ea07b640 1 -- 172.21.15.189:0/1421151791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90e41031d0 msgr2=0x7f90e40fe850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:55.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.080+0000 7f90ea07b640 1 --2- 172.21.15.189:0/1421151791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90e41031d0 0x7f90e40fe850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:55.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.080+0000 7f90ea07b640 1 -- 172.21.15.189:0/1421151791 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e0009560 con 0x7f90e4105b00 2024-09-13T15:51:55.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.080+0000 7f90e9079640 1 --2- 172.21.15.189:0/1421151791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90e41031d0 0x7f90e40fe850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:51:55.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.080+0000 7f90ea07b640 1 --2- 172.21.15.189:0/1421151791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90e4105b00 0x7f90e40fed90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00b9a0 tx=0x7f90dc00be60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:55.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.081+0000 7f90daffd640 1 -- 172.21.15.189:0/1421151791 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc00cba0 con 0x7f90e4105b00 2024-09-13T15:51:55.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.081+0000 7f90ebade640 1 -- 172.21.15.189:0/1421151791 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e41a00f0 con 0x7f90e4105b00 2024-09-13T15:51:55.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.081+0000 7f90daffd640 1 -- 172.21.15.189:0/1421151791 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90dc00cd00 con 0x7f90e4105b00 2024-09-13T15:51:55.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.081+0000 7f90daffd640 1 -- 172.21.15.189:0/1421151791 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc007640 con 0x7f90e4105b00 2024-09-13T15:51:55.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.081+0000 7f90ebade640 1 -- 172.21.15.189:0/1421151791 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e41a05f0 con 0x7f90e4105b00 2024-09-13T15:51:55.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.082+0000 7f90ebade640 1 -- 172.21.15.189:0/1421151791 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e40fbfb0 con 0x7f90e4105b00 2024-09-13T15:51:55.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.083+0000 7f90daffd640 1 -- 172.21.15.189:0/1421151791 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f90dc007880 con 0x7f90e4105b00 2024-09-13T15:51:55.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.083+0000 7f90daffd640 1 --2- 172.21.15.189:0/1421151791 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f90d00a1100 0x7f90d00a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:55.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.084+0000 7f90daffd640 1 -- 172.21.15.189:0/1421151791 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4965+0+0 (secure 0 0 0) 0x7f90dc0cb900 con 0x7f90e4105b00 2024-09-13T15:51:55.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.084+0000 7f90e987a640 1 --2- 172.21.15.189:0/1421151791 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f90d00a1100 0x7f90d00a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:55.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.085+0000 7f90e987a640 1 --2- 172.21.15.189:0/1421151791 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f90d00a1100 0x7f90d00a35c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f90e002aa00 tx=0x7f90e00314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:55.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.087+0000 7f90daffd640 1 -- 172.21.15.189:0/1421151791 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f90dc095e50 con 0x7f90e4105b00 2024-09-13T15:51:55.264 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:51:55.262+0000 7f90ebade640 1 -- 172.21.15.189:0/1421151791 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f90e402c4f0 con 0x7f90d00a1100 2024-09-13T15:51:55.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:55 smithi193 ceph-mon[35248]: Detected new or changed devices on smithi017 2024-09-13T15:51:55.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:55 smithi193 ceph-mon[35248]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:51:55.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:55 smithi193 ceph-mon[35248]: Adjusting osd_memory_target on smithi017 to 5698M 2024-09-13T15:51:55.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:55 smithi017 ceph-mon[30494]: Detected new or changed devices on smithi017 2024-09-13T15:51:55.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:55 smithi017 ceph-mon[30494]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:51:55.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:55 smithi017 ceph-mon[30494]: Adjusting osd_memory_target on smithi017 to 5698M 2024-09-13T15:51:55.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:55 smithi189 ceph-mon[34790]: Detected new or changed devices on smithi017 2024-09-13T15:51:55.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:55 smithi189 ceph-mon[34790]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:51:55.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:55 smithi189 ceph-mon[34790]: Adjusting osd_memory_target on smithi017 to 5698M 2024-09-13T15:51:56.336 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:56 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:51:56.336 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:56 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:51:56.336 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:56 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:56.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:56 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:51:56.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:56 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:51:56.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:56 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:56.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:56 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:51:56.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:56 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:51:56.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:56 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:51:57.329 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:57 smithi189 ceph-mon[34790]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:51:57.329 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:57 smithi189 ceph-mon[34790]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:51:57.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:57 smithi193 ceph-mon[35248]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:51:57.507 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:57 smithi193 ceph-mon[35248]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:51:57.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:57 smithi017 ceph-mon[30494]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:51:57.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:57 smithi017 ceph-mon[30494]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:51:58.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:58 smithi193 ceph-mon[35248]: from='client.? 172.21.15.189:0/10010885' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a98f36f9-0a19-4c9a-8ed1-615c4a6e7658"}]: dispatch 2024-09-13T15:51:58.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:58 smithi193 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a98f36f9-0a19-4c9a-8ed1-615c4a6e7658"}]: dispatch 2024-09-13T15:51:58.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:58 smithi193 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a98f36f9-0a19-4c9a-8ed1-615c4a6e7658"}]': finished 2024-09-13T15:51:58.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:58 smithi193 ceph-mon[35248]: osdmap e49: 8 total, 7 up, 8 in 2024-09-13T15:51:58.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:58 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T15:51:58.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:58 smithi017 ceph-mon[30494]: from='client.? 172.21.15.189:0/10010885' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a98f36f9-0a19-4c9a-8ed1-615c4a6e7658"}]: dispatch 2024-09-13T15:51:58.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:58 smithi017 ceph-mon[30494]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a98f36f9-0a19-4c9a-8ed1-615c4a6e7658"}]: dispatch 2024-09-13T15:51:58.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:58 smithi017 ceph-mon[30494]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a98f36f9-0a19-4c9a-8ed1-615c4a6e7658"}]': finished 2024-09-13T15:51:58.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:58 smithi017 ceph-mon[30494]: osdmap e49: 8 total, 7 up, 8 in 2024-09-13T15:51:58.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:58 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T15:51:58.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:58 smithi189 ceph-mon[34790]: from='client.? 172.21.15.189:0/10010885' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a98f36f9-0a19-4c9a-8ed1-615c4a6e7658"}]: dispatch 2024-09-13T15:51:58.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:58 smithi189 ceph-mon[34790]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a98f36f9-0a19-4c9a-8ed1-615c4a6e7658"}]: dispatch 2024-09-13T15:51:58.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:58 smithi189 ceph-mon[34790]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a98f36f9-0a19-4c9a-8ed1-615c4a6e7658"}]': finished 2024-09-13T15:51:58.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:58 smithi189 ceph-mon[34790]: osdmap e49: 8 total, 7 up, 8 in 2024-09-13T15:51:58.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:58 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T15:51:59.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:59 smithi193 ceph-mon[35248]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:51:59.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:51:59 smithi193 ceph-mon[35248]: from='client.? 172.21.15.189:0/1499577305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:51:59.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:59 smithi017 ceph-mon[30494]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:51:59.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:51:59 smithi017 ceph-mon[30494]: from='client.? 172.21.15.189:0/1499577305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:51:59.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:59 smithi189 ceph-mon[34790]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:51:59.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:51:59 smithi189 ceph-mon[34790]: from='client.? 172.21.15.189:0/1499577305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:52:00.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:00 smithi193 ceph-mon[35248]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:00.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:00 smithi017 ceph-mon[30494]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:00.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:00 smithi189 ceph-mon[34790]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:03.211 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:03 smithi189 ceph-mon[34790]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:03.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:03 smithi193 ceph-mon[35248]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:03.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:03 smithi017 ceph-mon[30494]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:05.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:05 smithi193 ceph-mon[35248]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:05.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:05 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-13T15:52:05.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:05 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:05.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:05 smithi017 ceph-mon[30494]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:05.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:05 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-13T15:52:05.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:05 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:05.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:05 smithi189 ceph-mon[34790]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:05.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:05 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-13T15:52:05.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:05 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:06.429 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:06 smithi189 ceph-mon[34790]: Deploying daemon osd.7 on smithi189 2024-09-13T15:52:06.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:06 smithi193 ceph-mon[35248]: Deploying daemon osd.7 on smithi189 2024-09-13T15:52:06.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:06 smithi017 ceph-mon[30494]: Deploying daemon osd.7 on smithi189 2024-09-13T15:52:07.449 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:07 smithi189 ceph-mon[34790]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:07.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:07 smithi193 ceph-mon[35248]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:07.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:07 smithi017 ceph-mon[30494]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:09.402 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:09 smithi189 ceph-mon[34790]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:09.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:09 smithi193 ceph-mon[35248]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:09.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:09 smithi017 ceph-mon[30494]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:10.450 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:10 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:52:10.450 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:10 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:10.450 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:10 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:10.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:10 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:52:10.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:10 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:10.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:10 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:10.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:10 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:52:10.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:10 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:10.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:10 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:11.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:11 smithi189 ceph-mon[34790]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:11.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:11 smithi193 ceph-mon[35248]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:11.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:11 smithi017 ceph-mon[30494]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:13.349 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:13 smithi189 ceph-mon[34790]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:13.349 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:13 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:13.349 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:13 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:13.349 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:13 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:13.349 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:13 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:52:13.349 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:13 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:13.384 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 7 on host 'smithi189' 2024-09-13T15:52:13.384 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:52:13.382+0000 7f90daffd640 1 -- 172.21.15.189:0/1421151791 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f90e402c4f0 con 0x7f90d00a1100 2024-09-13T15:52:13.386 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:52:13.384+0000 7f90ebade640 1 -- 172.21.15.189:0/1421151791 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f90d00a1100 msgr2=0x7f90d00a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:52:13.386 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:52:13.384+0000 7f90ebade640 1 --2- 172.21.15.189:0/1421151791 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f90d00a1100 0x7f90d00a35c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f90e002aa00 tx=0x7f90e00314a0 comp rx=0 tx=0).stop 2024-09-13T15:52:13.386 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:52:13.384+0000 7f90ebade640 1 -- 172.21.15.189:0/1421151791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90e4105b00 msgr2=0x7f90e40fed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:52:13.386 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:52:13.384+0000 7f90ebade640 1 --2- 172.21.15.189:0/1421151791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90e4105b00 0x7f90e40fed90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00b9a0 tx=0x7f90dc00be60 comp rx=0 tx=0).stop 2024-09-13T15:52:13.386 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:52:13.384+0000 7f90ebade640 1 -- 172.21.15.189:0/1421151791 shutdown_connections 2024-09-13T15:52:13.386 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:52:13.384+0000 7f90ebade640 1 --2- 172.21.15.189:0/1421151791 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f90d00a1100 0x7f90d00a35c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:13.387 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:52:13.384+0000 7f90ebade640 1 --2- 172.21.15.189:0/1421151791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90e4105b00 0x7f90e40fed90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:13.387 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:52:13.384+0000 7f90ebade640 1 --2- 172.21.15.189:0/1421151791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90e41031d0 0x7f90e40fe850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:13.387 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:52:13.384+0000 7f90ebade640 1 --2- 172.21.15.189:0/1421151791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90e41008a0 0x7f90e4100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:13.387 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:52:13.384+0000 7f90ebade640 1 -- 172.21.15.189:0/1421151791 >> 172.21.15.189:0/1421151791 conn(0x7f90e40fa4c0 msgr2=0x7f90e41013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:52:13.387 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:52:13.385+0000 7f90ebade640 1 -- 172.21.15.189:0/1421151791 shutdown_connections 2024-09-13T15:52:13.387 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:52:13.385+0000 7f90ebade640 1 -- 172.21.15.189:0/1421151791 wait complete. 2024-09-13T15:52:13.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:13 smithi193 ceph-mon[35248]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:13.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:13 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:13.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:13 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:13.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:13 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:13.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:13 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:52:13.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:13 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:13 smithi017 ceph-mon[30494]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:13 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:13 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:13 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:13 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:52:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:13 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:14.083 DEBUG:teuthology.orchestra.run.smithi189:osd.7> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.7.service 2024-09-13T15:52:14.085 INFO:tasks.cephadm:Deploying osd.8 on smithi193 with /dev/vg_nvme/lv_2... 2024-09-13T15:52:14.085 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-13T15:52:14.293 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T15:52:14.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:14 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:52:14.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:14 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:14.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:14 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:14.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:14 smithi189 ceph-mon[34790]: from='osd.7 [v2:172.21.15.189:6816/3691677495,v1:172.21.15.189:6817/3691677495]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T15:52:14.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:14 smithi189 ceph-mon[34790]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T15:52:14.413 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:14 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:52:14.414 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:14 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:14.414 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:14 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:14.414 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:14 smithi193 ceph-mon[35248]: from='osd.7 [v2:172.21.15.189:6816/3691677495,v1:172.21.15.189:6817/3691677495]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T15:52:14.414 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:14 smithi193 ceph-mon[35248]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T15:52:14.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:14 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:52:14.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:14 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:14.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:14 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:14.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:14 smithi017 ceph-mon[30494]: from='osd.7 [v2:172.21.15.189:6816/3691677495,v1:172.21.15.189:6817/3691677495]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T15:52:14.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:14 smithi017 ceph-mon[30494]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T15:52:15.244 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:15 smithi189 ceph-mon[34790]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:15.244 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:15 smithi189 ceph-mon[34790]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-13T15:52:15.244 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:15 smithi189 ceph-mon[34790]: osdmap e50: 8 total, 7 up, 8 in 2024-09-13T15:52:15.244 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:15 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T15:52:15.244 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:15 smithi189 ceph-mon[34790]: from='osd.7 [v2:172.21.15.189:6816/3691677495,v1:172.21.15.189:6817/3691677495]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:52:15.244 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:15 smithi189 ceph-mon[34790]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:52:15.457 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:15 smithi193 ceph-mon[35248]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:15.457 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:15 smithi193 ceph-mon[35248]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-13T15:52:15.457 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:15 smithi193 ceph-mon[35248]: osdmap e50: 8 total, 7 up, 8 in 2024-09-13T15:52:15.457 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:15 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T15:52:15.457 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:15 smithi193 ceph-mon[35248]: from='osd.7 [v2:172.21.15.189:6816/3691677495,v1:172.21.15.189:6817/3691677495]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:52:15.457 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:15 smithi193 ceph-mon[35248]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:52:15.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:15 smithi017 ceph-mon[30494]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:15.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:15 smithi017 ceph-mon[30494]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-13T15:52:15.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:15 smithi017 ceph-mon[30494]: osdmap e50: 8 total, 7 up, 8 in 2024-09-13T15:52:15.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:15 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T15:52:15.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:15 smithi017 ceph-mon[30494]: from='osd.7 [v2:172.21.15.189:6816/3691677495,v1:172.21.15.189:6817/3691677495]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:52:15.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:15 smithi017 ceph-mon[30494]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:52:16.223 INFO:teuthology.orchestra.run.smithi193.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-13T15:52:16.322 INFO:teuthology.orchestra.run.smithi193.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-13T15:52:16.336 INFO:teuthology.orchestra.run.smithi193.stderr: stderr: 10+0 records in 2024-09-13T15:52:16.336 INFO:teuthology.orchestra.run.smithi193.stderr:10+0 records out 2024-09-13T15:52:16.336 INFO:teuthology.orchestra.run.smithi193.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011453 s, 916 MB/s 2024-09-13T15:52:16.336 INFO:teuthology.orchestra.run.smithi193.stderr:--> Zapping successful for: 2024-09-13T15:52:16.338 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 15:52:16 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T15:52:16.070+0000 7f66f8aeb640 -1 osd.7 0 waiting for initial osdmap 2024-09-13T15:52:16.338 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 15:52:16 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T15:52:16.081+0000 7f66f00f5640 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:52:16.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:16 smithi189 ceph-mon[34790]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-13T15:52:16.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:16 smithi189 ceph-mon[34790]: osdmap e51: 8 total, 7 up, 8 in 2024-09-13T15:52:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:16 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T15:52:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:16 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T15:52:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:16 smithi189 ceph-mon[34790]: from='osd.7 ' entity='osd.7' 2024-09-13T15:52:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:16 smithi189 ceph-mon[34790]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:16 smithi189 ceph-mon[34790]: osd.7 [v2:172.21.15.189:6816/3691677495,v1:172.21.15.189:6817/3691677495] boot 2024-09-13T15:52:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:16 smithi189 ceph-mon[34790]: osdmap e52: 8 total, 8 up, 8 in 2024-09-13T15:52:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:16 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T15:52:16.633 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:16 smithi193 ceph-mon[35248]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-13T15:52:16.633 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:16 smithi193 ceph-mon[35248]: osdmap e51: 8 total, 7 up, 8 in 2024-09-13T15:52:16.633 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:16 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T15:52:16.633 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:16 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T15:52:16.633 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:16 smithi193 ceph-mon[35248]: from='osd.7 ' entity='osd.7' 2024-09-13T15:52:16.633 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:16 smithi193 ceph-mon[35248]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:16.633 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:16 smithi193 ceph-mon[35248]: osd.7 [v2:172.21.15.189:6816/3691677495,v1:172.21.15.189:6817/3691677495] boot 2024-09-13T15:52:16.633 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:16 smithi193 ceph-mon[35248]: osdmap e52: 8 total, 8 up, 8 in 2024-09-13T15:52:16.633 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:16 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T15:52:16.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:16 smithi017 ceph-mon[30494]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-13T15:52:16.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:16 smithi017 ceph-mon[30494]: osdmap e51: 8 total, 7 up, 8 in 2024-09-13T15:52:16.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T15:52:16.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T15:52:16.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:16 smithi017 ceph-mon[30494]: from='osd.7 ' entity='osd.7' 2024-09-13T15:52:16.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:16 smithi017 ceph-mon[30494]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-13T15:52:16.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:16 smithi017 ceph-mon[30494]: osd.7 [v2:172.21.15.189:6816/3691677495,v1:172.21.15.189:6817/3691677495] boot 2024-09-13T15:52:16.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:16 smithi017 ceph-mon[30494]: osdmap e52: 8 total, 8 up, 8 in 2024-09-13T15:52:16.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T15:52:16.957 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi193:vg_nvme/lv_2 2024-09-13T15:52:17.156 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T15:52:17.570 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:17 smithi193 ceph-mon[35248]: purged_snaps scrub starts 2024-09-13T15:52:17.570 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:17 smithi193 ceph-mon[35248]: purged_snaps scrub ok 2024-09-13T15:52:17.570 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:17 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:17.570 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:17 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:17.570 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:17 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:52:17.570 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:17 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:52:17.570 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:17 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:52:17.571 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:17 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:17.571 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:17 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:17.571 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:17 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:52:17.571 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:17 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:17.571 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:17 smithi193 ceph-mon[35248]: osdmap e53: 8 total, 8 up, 8 in 2024-09-13T15:52:17.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:17 smithi189 ceph-mon[34790]: purged_snaps scrub starts 2024-09-13T15:52:17.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:17 smithi189 ceph-mon[34790]: purged_snaps scrub ok 2024-09-13T15:52:17.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:17 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:17.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:17 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:17.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:17 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:52:17.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:17 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:52:17.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:17 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:52:17.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:17 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:17.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:17 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:17.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:17 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:52:17.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:17 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:17.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:17 smithi189 ceph-mon[34790]: osdmap e53: 8 total, 8 up, 8 in 2024-09-13T15:52:17.663 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:17 smithi017 ceph-mon[30494]: purged_snaps scrub starts 2024-09-13T15:52:17.663 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:17 smithi017 ceph-mon[30494]: purged_snaps scrub ok 2024-09-13T15:52:17.663 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:17 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:17.663 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:17 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:17.663 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:17 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:52:17.663 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:17 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:52:17.663 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:17 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:52:17.663 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:17 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:17.663 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:17 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:17.663 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:17 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:52:17.663 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:17 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:17.663 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:17 smithi017 ceph-mon[30494]: osdmap e53: 8 total, 8 up, 8 in 2024-09-13T15:52:18.620 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:18 smithi193 ceph-mon[35248]: Detected new or changed devices on smithi189 2024-09-13T15:52:18.620 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:18 smithi193 ceph-mon[35248]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-13T15:52:18.620 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:18 smithi193 ceph-mon[35248]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:18.620 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:18 smithi193 ceph-mon[35248]: osdmap e54: 8 total, 8 up, 8 in 2024-09-13T15:52:18.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:18 smithi017 ceph-mon[30494]: Detected new or changed devices on smithi189 2024-09-13T15:52:18.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:18 smithi017 ceph-mon[30494]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-13T15:52:18.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:18 smithi017 ceph-mon[30494]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:18.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:18 smithi017 ceph-mon[30494]: osdmap e54: 8 total, 8 up, 8 in 2024-09-13T15:52:18.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.832+0000 7fb8dfc2e640 1 -- 172.21.15.193:0/1137899743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8d8101920 msgr2=0x7fb8d8108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:52:18.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.832+0000 7fb8dfc2e640 1 --2- 172.21.15.193:0/1137899743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8d8101920 0x7fb8d8108240 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009ca0 tx=0x7fb8cc02a8c0 comp rx=0 tx=0).stop 2024-09-13T15:52:18.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.832+0000 7fb8dfc2e640 1 -- 172.21.15.193:0/1137899743 shutdown_connections 2024-09-13T15:52:18.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.832+0000 7fb8dfc2e640 1 --2- 172.21.15.193:0/1137899743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8d8101920 0x7fb8d8108240 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:18.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.832+0000 7fb8dfc2e640 1 --2- 172.21.15.193:0/1137899743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8d8100f60 0x7fb8d81013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:18.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.832+0000 7fb8dfc2e640 1 --2- 172.21.15.193:0/1137899743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8d80ffe00 0x7fb8d8100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:18.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.832+0000 7fb8dfc2e640 1 -- 172.21.15.193:0/1137899743 >> 172.21.15.193:0/1137899743 conn(0x7fb8d80fb5d0 msgr2=0x7fb8d80fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:52:18.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.832+0000 7fb8dfc2e640 1 -- 172.21.15.193:0/1137899743 shutdown_connections 2024-09-13T15:52:18.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.832+0000 7fb8dfc2e640 1 -- 172.21.15.193:0/1137899743 wait complete. 2024-09-13T15:52:18.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.833+0000 7fb8dfc2e640 1 Processor -- start 2024-09-13T15:52:18.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.833+0000 7fb8dfc2e640 1 -- start start 2024-09-13T15:52:18.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.833+0000 7fb8dfc2e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8d80ffe00 0x7fb8d8074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:52:18.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.833+0000 7fb8dfc2e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8d8100f60 0x7fb8d80728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:52:18.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.833+0000 7fb8dfc2e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8d8101920 0x7fb8d8072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:52:18.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.833+0000 7fb8dfc2e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d80734e0 con 0x7fb8d8100f60 2024-09-13T15:52:18.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.833+0000 7fb8dfc2e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d8073650 con 0x7fb8d8101920 2024-09-13T15:52:18.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.833+0000 7fb8dfc2e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d819fe50 con 0x7fb8d80ffe00 2024-09-13T15:52:18.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.833+0000 7fb8dd9ca640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8d80ffe00 0x7fb8d8074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:52:18.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.833+0000 7fb8dd9ca640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8d80ffe00 0x7fb8d8074200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:57966/0 (socket says 172.21.15.193:57966) 2024-09-13T15:52:18.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.833+0000 7fb8dd9ca640 1 -- 172.21.15.193:0/862276052 learned_addr learned my addr 172.21.15.193:0/862276052 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-13T15:52:18.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.833+0000 7fb8dd1c9640 1 --2- 172.21.15.193:0/862276052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8d8100f60 0x7fb8d80728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:52:18.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.834+0000 7fb8de1cb640 1 --2- 172.21.15.193:0/862276052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8d8101920 0x7fb8d8072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:52:18.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.834+0000 7fb8dd9ca640 1 -- 172.21.15.193:0/862276052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8d8101920 msgr2=0x7fb8d8072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:52:18.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.834+0000 7fb8dd9ca640 1 --2- 172.21.15.193:0/862276052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8d8101920 0x7fb8d8072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:18.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.834+0000 7fb8dd9ca640 1 -- 172.21.15.193:0/862276052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8d8100f60 msgr2=0x7fb8d80728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:52:18.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.834+0000 7fb8dd9ca640 1 --2- 172.21.15.193:0/862276052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8d8100f60 0x7fb8d80728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:18.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.834+0000 7fb8dd9ca640 1 -- 172.21.15.193:0/862276052 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc009900 con 0x7fb8d80ffe00 2024-09-13T15:52:18.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.834+0000 7fb8dd9ca640 1 --2- 172.21.15.193:0/862276052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8d80ffe00 0x7fb8d8074200 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000b4a0 tx=0x7fb8d000b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:52:18.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.834+0000 7fb8caffd640 1 -- 172.21.15.193:0/862276052 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0010610 con 0x7fb8d80ffe00 2024-09-13T15:52:18.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.834+0000 7fb8caffd640 1 -- 172.21.15.193:0/862276052 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb8d0010c30 con 0x7fb8d80ffe00 2024-09-13T15:52:18.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.834+0000 7fb8dfc2e640 1 -- 172.21.15.193:0/862276052 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d81a00b0 con 0x7fb8d80ffe00 2024-09-13T15:52:18.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.834+0000 7fb8caffd640 1 -- 172.21.15.193:0/862276052 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0017dd0 con 0x7fb8d80ffe00 2024-09-13T15:52:18.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.834+0000 7fb8dfc2e640 1 -- 172.21.15.193:0/862276052 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d81a0630 con 0x7fb8d80ffe00 2024-09-13T15:52:18.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.835+0000 7fb8dfc2e640 1 -- 172.21.15.193:0/862276052 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d81071c0 con 0x7fb8d80ffe00 2024-09-13T15:52:18.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.836+0000 7fb8caffd640 1 -- 172.21.15.193:0/862276052 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb8d00173f0 con 0x7fb8d80ffe00 2024-09-13T15:52:18.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.837+0000 7fb8caffd640 1 --2- 172.21.15.193:0/862276052 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb8c40a1080 0x7fb8c40a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:52:18.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.837+0000 7fb8caffd640 1 -- 172.21.15.193:0/862276052 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5426+0+0 (secure 0 0 0) 0x7fb8d00cb710 con 0x7fb8d80ffe00 2024-09-13T15:52:18.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.837+0000 7fb8dd1c9640 1 --2- 172.21.15.193:0/862276052 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb8c40a1080 0x7fb8c40a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:52:18.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.838+0000 7fb8dd1c9640 1 --2- 172.21.15.193:0/862276052 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb8c40a1080 0x7fb8c40a3540 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8073f80 tx=0x7fb8d400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:52:18.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:18.841+0000 7fb8caffd640 1 -- 172.21.15.193:0/862276052 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb8d0095a90 con 0x7fb8d80ffe00 2024-09-13T15:52:18.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:18 smithi189 ceph-mon[34790]: Detected new or changed devices on smithi189 2024-09-13T15:52:18.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:18 smithi189 ceph-mon[34790]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-13T15:52:18.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:18 smithi189 ceph-mon[34790]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:18.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:18 smithi189 ceph-mon[34790]: osdmap e54: 8 total, 8 up, 8 in 2024-09-13T15:52:19.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:19.013+0000 7fb8dfc2e640 1 -- 172.21.15.193:0/862276052 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8d802c450 con 0x7fb8c40a1080 2024-09-13T15:52:19.629 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:19 smithi193 ceph-mon[35248]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:52:19.629 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:19 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:52:19.630 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:19 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:52:19.630 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:19 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:19.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:19 smithi017 ceph-mon[30494]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:52:19.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:19 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:52:19.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:19 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:52:19.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:19 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:19.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:19 smithi189 ceph-mon[34790]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:52:19.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:19 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:52:19.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:19 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:52:19.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:19 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:20.705 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:20 smithi193 ceph-mon[35248]: osdmap e55: 8 total, 8 up, 8 in 2024-09-13T15:52:20.705 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:20 smithi193 ceph-mon[35248]: pgmap v184: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:20.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:20 smithi017 ceph-mon[30494]: osdmap e55: 8 total, 8 up, 8 in 2024-09-13T15:52:20.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:20 smithi017 ceph-mon[30494]: pgmap v184: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:20.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:20 smithi189 ceph-mon[34790]: osdmap e55: 8 total, 8 up, 8 in 2024-09-13T15:52:20.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:20 smithi189 ceph-mon[34790]: pgmap v184: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:21.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:21 smithi193 ceph-mon[35248]: osdmap e56: 8 total, 8 up, 8 in 2024-09-13T15:52:21.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:21 smithi017 ceph-mon[30494]: osdmap e56: 8 total, 8 up, 8 in 2024-09-13T15:52:21.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:21 smithi189 ceph-mon[34790]: osdmap e56: 8 total, 8 up, 8 in 2024-09-13T15:52:22.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:22 smithi193 ceph-mon[35248]: from='client.? 172.21.15.193:0/3811108042' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a372d9f-c40f-4ead-87da-2f3a570c1373"}]: dispatch 2024-09-13T15:52:22.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:22 smithi193 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a372d9f-c40f-4ead-87da-2f3a570c1373"}]: dispatch 2024-09-13T15:52:22.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:22 smithi193 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a372d9f-c40f-4ead-87da-2f3a570c1373"}]': finished 2024-09-13T15:52:22.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:22 smithi193 ceph-mon[35248]: osdmap e57: 9 total, 8 up, 9 in 2024-09-13T15:52:22.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:22 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T15:52:22.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:22 smithi193 ceph-mon[35248]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:22.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:22 smithi193 ceph-mon[35248]: from='client.? 172.21.15.193:0/2640920496' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:52:22.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:22 smithi017 ceph-mon[30494]: from='client.? 172.21.15.193:0/3811108042' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a372d9f-c40f-4ead-87da-2f3a570c1373"}]: dispatch 2024-09-13T15:52:22.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:22 smithi017 ceph-mon[30494]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a372d9f-c40f-4ead-87da-2f3a570c1373"}]: dispatch 2024-09-13T15:52:22.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:22 smithi017 ceph-mon[30494]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a372d9f-c40f-4ead-87da-2f3a570c1373"}]': finished 2024-09-13T15:52:22.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:22 smithi017 ceph-mon[30494]: osdmap e57: 9 total, 8 up, 9 in 2024-09-13T15:52:22.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:22 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T15:52:22.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:22 smithi017 ceph-mon[30494]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:22.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:22 smithi017 ceph-mon[30494]: from='client.? 172.21.15.193:0/2640920496' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:52:22.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:22 smithi189 ceph-mon[34790]: from='client.? 172.21.15.193:0/3811108042' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a372d9f-c40f-4ead-87da-2f3a570c1373"}]: dispatch 2024-09-13T15:52:22.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:22 smithi189 ceph-mon[34790]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a372d9f-c40f-4ead-87da-2f3a570c1373"}]: dispatch 2024-09-13T15:52:22.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:22 smithi189 ceph-mon[34790]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a372d9f-c40f-4ead-87da-2f3a570c1373"}]': finished 2024-09-13T15:52:22.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:22 smithi189 ceph-mon[34790]: osdmap e57: 9 total, 8 up, 9 in 2024-09-13T15:52:22.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:22 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T15:52:22.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:22 smithi189 ceph-mon[34790]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:22.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:22 smithi189 ceph-mon[34790]: from='client.? 172.21.15.193:0/2640920496' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:52:25.425 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:25 smithi193 ceph-mon[35248]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:25.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:25 smithi017 ceph-mon[30494]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:25.559 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:25 smithi189 ceph-mon[34790]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:27.450 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:27 smithi193 ceph-mon[35248]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:27.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:27 smithi017 ceph-mon[30494]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:27.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:27 smithi189 ceph-mon[34790]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:29.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:29 smithi193 ceph-mon[35248]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:29.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:29 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-13T15:52:29.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:29 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:29.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:29 smithi017 ceph-mon[30494]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:29.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:29 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-13T15:52:29.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:29 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:29.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:29 smithi189 ceph-mon[34790]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:29.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:29 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-13T15:52:29.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:29 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:30.420 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:30 smithi193 ceph-mon[35248]: Deploying daemon osd.8 on smithi193 2024-09-13T15:52:30.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:30 smithi017 ceph-mon[30494]: Deploying daemon osd.8 on smithi193 2024-09-13T15:52:30.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:30 smithi189 ceph-mon[34790]: Deploying daemon osd.8 on smithi193 2024-09-13T15:52:31.459 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:31 smithi193 ceph-mon[35248]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:31.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:31 smithi017 ceph-mon[30494]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:31.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:31 smithi189 ceph-mon[34790]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:33.436 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:33 smithi193 ceph-mon[35248]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:33.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:33 smithi017 ceph-mon[30494]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:33.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:33 smithi189 ceph-mon[34790]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:34.454 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:52:34.455 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:34.455 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:34.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:52:34.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:34.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:34.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:34 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:52:34.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:34 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:34.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:34 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:35.462 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:35 smithi193 ceph-mon[35248]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:35.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:35 smithi017 ceph-mon[30494]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:35.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:35 smithi189 ceph-mon[34790]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:37.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:37.161+0000 7fb8caffd640 1 -- 172.21.15.193:0/862276052 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb8d802c450 con 0x7fb8c40a1080 2024-09-13T15:52:37.163 INFO:teuthology.orchestra.run.smithi193.stdout:Created osd(s) 8 on host 'smithi193' 2024-09-13T15:52:37.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:37.163+0000 7fb8dfc2e640 1 -- 172.21.15.193:0/862276052 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb8c40a1080 msgr2=0x7fb8c40a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:52:37.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:37.163+0000 7fb8dfc2e640 1 --2- 172.21.15.193:0/862276052 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb8c40a1080 0x7fb8c40a3540 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8073f80 tx=0x7fb8d400a2d0 comp rx=0 tx=0).stop 2024-09-13T15:52:37.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:37.163+0000 7fb8dfc2e640 1 -- 172.21.15.193:0/862276052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8d80ffe00 msgr2=0x7fb8d8074200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:52:37.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:37.163+0000 7fb8dfc2e640 1 --2- 172.21.15.193:0/862276052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8d80ffe00 0x7fb8d8074200 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000b4a0 tx=0x7fb8d000b960 comp rx=0 tx=0).stop 2024-09-13T15:52:37.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:37.163+0000 7fb8dfc2e640 1 -- 172.21.15.193:0/862276052 shutdown_connections 2024-09-13T15:52:37.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:37.163+0000 7fb8dfc2e640 1 --2- 172.21.15.193:0/862276052 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb8c40a1080 0x7fb8c40a3540 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:37.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:37.163+0000 7fb8dfc2e640 1 --2- 172.21.15.193:0/862276052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8d8101920 0x7fb8d8072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:37.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:37.163+0000 7fb8dfc2e640 1 --2- 172.21.15.193:0/862276052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8d8100f60 0x7fb8d80728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:37.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:37.163+0000 7fb8dfc2e640 1 --2- 172.21.15.193:0/862276052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8d80ffe00 0x7fb8d8074200 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:37.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:37.163+0000 7fb8dfc2e640 1 -- 172.21.15.193:0/862276052 >> 172.21.15.193:0/862276052 conn(0x7fb8d80fb5d0 msgr2=0x7fb8d8104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:52:37.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:37.163+0000 7fb8dfc2e640 1 -- 172.21.15.193:0/862276052 shutdown_connections 2024-09-13T15:52:37.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:52:37.163+0000 7fb8dfc2e640 1 -- 172.21.15.193:0/862276052 wait complete. 2024-09-13T15:52:37.380 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:37 smithi193 ceph-mon[35248]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:37.380 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:37 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:37.381 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:37 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:37.381 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:37 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:37.381 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:37 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:52:37.381 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:37 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:37.381 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:37 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:52:37.381 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:37 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:37.381 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:37 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:37.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:37 smithi017 ceph-mon[30494]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:37.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:37 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:37.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:37 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:37.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:37 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:37.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:37 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:52:37.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:37 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:37.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:37 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:52:37.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:37 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:37.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:37 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:37.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:37 smithi189 ceph-mon[34790]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:37.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:37 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:37.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:37 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:37.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:37 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:37.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:37 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:52:37.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:37 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:37.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:37 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:52:37.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:37 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:37.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:37 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:37.810 DEBUG:teuthology.orchestra.run.smithi193:osd.8> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.8.service 2024-09-13T15:52:37.812 INFO:tasks.cephadm:Deploying osd.9 on smithi017 with /dev/vg_nvme/lv_1... 2024-09-13T15:52:37.812 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-09-13T15:52:38.137 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:52:38.375 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:38 smithi193 ceph-mon[35248]: from='osd.8 [v2:172.21.15.193:6816/4112907498,v1:172.21.15.193:6817/4112907498]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T15:52:38.375 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:38 smithi193 ceph-mon[35248]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T15:52:38.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:38 smithi017 ceph-mon[30494]: from='osd.8 [v2:172.21.15.193:6816/4112907498,v1:172.21.15.193:6817/4112907498]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T15:52:38.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:38 smithi017 ceph-mon[30494]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T15:52:38.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:38 smithi189 ceph-mon[34790]: from='osd.8 [v2:172.21.15.193:6816/4112907498,v1:172.21.15.193:6817/4112907498]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T15:52:38.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:38 smithi189 ceph-mon[34790]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T15:52:39.284 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:39 smithi193 ceph-mon[35248]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:39.284 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:39 smithi193 ceph-mon[35248]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-13T15:52:39.284 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:39 smithi193 ceph-mon[35248]: osdmap e58: 9 total, 8 up, 9 in 2024-09-13T15:52:39.285 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:39 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T15:52:39.285 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:39 smithi193 ceph-mon[35248]: from='osd.8 [v2:172.21.15.193:6816/4112907498,v1:172.21.15.193:6817/4112907498]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:52:39.285 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:39 smithi193 ceph-mon[35248]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:52:39.285 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 15:52:39 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T15:52:39.202+0000 7fe493648640 -1 osd.8 0 waiting for initial osdmap 2024-09-13T15:52:39.285 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 15:52:39 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T15:52:39.212+0000 7fe48f471640 -1 osd.8 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:52:39.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:39 smithi017 ceph-mon[30494]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:39.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:39 smithi017 ceph-mon[30494]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-13T15:52:39.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:39 smithi017 ceph-mon[30494]: osdmap e58: 9 total, 8 up, 9 in 2024-09-13T15:52:39.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:39 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T15:52:39.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:39 smithi017 ceph-mon[30494]: from='osd.8 [v2:172.21.15.193:6816/4112907498,v1:172.21.15.193:6817/4112907498]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:52:39.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:39 smithi017 ceph-mon[30494]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:52:39.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:39 smithi189 ceph-mon[34790]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:39.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:39 smithi189 ceph-mon[34790]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-13T15:52:39.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:39 smithi189 ceph-mon[34790]: osdmap e58: 9 total, 8 up, 9 in 2024-09-13T15:52:39.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:39 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T15:52:39.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:39 smithi189 ceph-mon[34790]: from='osd.8 [v2:172.21.15.193:6816/4112907498,v1:172.21.15.193:6817/4112907498]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:52:39.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:39 smithi189 ceph-mon[34790]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:52:40.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:40 smithi193 ceph-mon[35248]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-13T15:52:40.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:40 smithi193 ceph-mon[35248]: osdmap e59: 9 total, 8 up, 9 in 2024-09-13T15:52:40.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:40 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T15:52:40.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:40 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T15:52:40.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:40 smithi193 ceph-mon[35248]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:40.468 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:40 smithi017 ceph-mon[30494]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-13T15:52:40.468 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:40 smithi017 ceph-mon[30494]: osdmap e59: 9 total, 8 up, 9 in 2024-09-13T15:52:40.468 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:40 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T15:52:40.468 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:40 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T15:52:40.468 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:40 smithi017 ceph-mon[30494]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:40.468 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-09-13T15:52:40.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:40 smithi189 ceph-mon[34790]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-13T15:52:40.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:40 smithi189 ceph-mon[34790]: osdmap e59: 9 total, 8 up, 9 in 2024-09-13T15:52:40.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:40 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T15:52:40.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:40 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T15:52:40.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:40 smithi189 ceph-mon[34790]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-13T15:52:40.611 INFO:teuthology.orchestra.run.smithi017.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-09-13T15:52:40.669 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10+0 records in 2024-09-13T15:52:40.669 INFO:teuthology.orchestra.run.smithi017.stderr:10+0 records out 2024-09-13T15:52:40.669 INFO:teuthology.orchestra.run.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0518624 s, 202 MB/s 2024-09-13T15:52:40.669 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping successful for: 2024-09-13T15:52:41.408 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:41 smithi017 ceph-mon[30494]: purged_snaps scrub starts 2024-09-13T15:52:41.408 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:41 smithi017 ceph-mon[30494]: purged_snaps scrub ok 2024-09-13T15:52:41.408 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:41 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T15:52:41.409 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:41 smithi017 ceph-mon[30494]: osd.8 [v2:172.21.15.193:6816/4112907498,v1:172.21.15.193:6817/4112907498] boot 2024-09-13T15:52:41.409 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:41 smithi017 ceph-mon[30494]: osdmap e60: 9 total, 9 up, 9 in 2024-09-13T15:52:41.409 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:41 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T15:52:41.409 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:41 smithi017 ceph-mon[30494]: Detected new or changed devices on smithi193 2024-09-13T15:52:41.409 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:41 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:41.409 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:41 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:41.409 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:41 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:52:41.409 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:41 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:52:41.409 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:41 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:52:41.409 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:41 smithi017 ceph-mon[30494]: Adjusting osd_memory_target on smithi193 to 5696M 2024-09-13T15:52:41.409 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:41 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:41.409 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:41 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:41.409 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:41 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:52:41.410 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:41 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:41.441 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi017:vg_nvme/lv_1 2024-09-13T15:52:41.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:41 smithi193 ceph-mon[35248]: purged_snaps scrub starts 2024-09-13T15:52:41.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:41 smithi193 ceph-mon[35248]: purged_snaps scrub ok 2024-09-13T15:52:41.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:41 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T15:52:41.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:41 smithi193 ceph-mon[35248]: osd.8 [v2:172.21.15.193:6816/4112907498,v1:172.21.15.193:6817/4112907498] boot 2024-09-13T15:52:41.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:41 smithi193 ceph-mon[35248]: osdmap e60: 9 total, 9 up, 9 in 2024-09-13T15:52:41.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:41 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T15:52:41.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:41 smithi193 ceph-mon[35248]: Detected new or changed devices on smithi193 2024-09-13T15:52:41.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:41 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:41.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:41 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:41.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:41 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:52:41.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:41 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:52:41.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:41 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:52:41.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:41 smithi193 ceph-mon[35248]: Adjusting osd_memory_target on smithi193 to 5696M 2024-09-13T15:52:41.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:41 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:41.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:41 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:41.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:41 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:52:41.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:41 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:41.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:41 smithi189 ceph-mon[34790]: purged_snaps scrub starts 2024-09-13T15:52:41.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:41 smithi189 ceph-mon[34790]: purged_snaps scrub ok 2024-09-13T15:52:41.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:41 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T15:52:41.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:41 smithi189 ceph-mon[34790]: osd.8 [v2:172.21.15.193:6816/4112907498,v1:172.21.15.193:6817/4112907498] boot 2024-09-13T15:52:41.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:41 smithi189 ceph-mon[34790]: osdmap e60: 9 total, 9 up, 9 in 2024-09-13T15:52:41.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:41 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T15:52:41.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:41 smithi189 ceph-mon[34790]: Detected new or changed devices on smithi193 2024-09-13T15:52:41.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:41 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:41.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:41 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:41.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:41 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:52:41.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:41 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:52:41.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:41 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:52:41.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:41 smithi189 ceph-mon[34790]: Adjusting osd_memory_target on smithi193 to 5696M 2024-09-13T15:52:41.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:41 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:41.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:41 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:41.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:41 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:52:41.608 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:41 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:52:41.761 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:52:42.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:42 smithi193 ceph-mon[35248]: osdmap e61: 9 total, 9 up, 9 in 2024-09-13T15:52:42.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:42 smithi193 ceph-mon[35248]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:52:42.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:42 smithi017 ceph-mon[30494]: osdmap e61: 9 total, 9 up, 9 in 2024-09-13T15:52:42.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:42 smithi017 ceph-mon[30494]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:52:42.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:42 smithi189 ceph-mon[34790]: osdmap e61: 9 total, 9 up, 9 in 2024-09-13T15:52:42.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:42 smithi189 ceph-mon[34790]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:52:43.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:43 smithi017 ceph-mon[30494]: osdmap e62: 9 total, 9 up, 9 in 2024-09-13T15:52:43.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:43 smithi193 ceph-mon[35248]: osdmap e62: 9 total, 9 up, 9 in 2024-09-13T15:52:43.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:43 smithi189 ceph-mon[34790]: osdmap e62: 9 total, 9 up, 9 in 2024-09-13T15:52:43.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.716+0000 7f026e600640 1 -- 172.21.15.17:0/4022759315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0268103970 msgr2=0x7f026810a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:52:43.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.716+0000 7f026e600640 1 --2- 172.21.15.17:0/4022759315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0268103970 0x7f026810a290 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0260009ca0 tx=0x7f026002a8c0 comp rx=0 tx=0).stop 2024-09-13T15:52:43.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.716+0000 7f026e600640 1 -- 172.21.15.17:0/4022759315 shutdown_connections 2024-09-13T15:52:43.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.716+0000 7f026e600640 1 --2- 172.21.15.17:0/4022759315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0268103970 0x7f026810a290 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:43.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.716+0000 7f026e600640 1 --2- 172.21.15.17:0/4022759315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0268102fb0 0x7f0268103430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:43.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.716+0000 7f026e600640 1 --2- 172.21.15.17:0/4022759315 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0268101e50 0x7f0268102250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:43.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.716+0000 7f026e600640 1 -- 172.21.15.17:0/4022759315 >> 172.21.15.17:0/4022759315 conn(0x7f02680fd5e0 msgr2=0x7f02680ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:52:43.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.716+0000 7f026e600640 1 -- 172.21.15.17:0/4022759315 shutdown_connections 2024-09-13T15:52:43.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.716+0000 7f026e600640 1 -- 172.21.15.17:0/4022759315 wait complete. 2024-09-13T15:52:43.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.717+0000 7f026e600640 1 Processor -- start 2024-09-13T15:52:43.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.717+0000 7f026e600640 1 -- start start 2024-09-13T15:52:43.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.717+0000 7f026e600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0268101e50 0x7f0268197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:52:43.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.718+0000 7f026e600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0268102fb0 0x7f02681982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:52:43.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.718+0000 7f026e600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0268103970 0x7f026819f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:52:43.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.718+0000 7f026e600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026819f8a0 con 0x7f0268103970 2024-09-13T15:52:43.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.718+0000 7f026e600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026819fa10 con 0x7f0268102fb0 2024-09-13T15:52:43.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.718+0000 7f026e600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026819fbd0 con 0x7f0268101e50 2024-09-13T15:52:43.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.718+0000 7f026dc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0268103970 0x7f026819f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:52:43.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.718+0000 7f026dc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0268103970 0x7f026819f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41064/0 (socket says 172.21.15.17:41064) 2024-09-13T15:52:43.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.718+0000 7f026dc00640 1 -- 172.21.15.17:0/1078776451 learned_addr learned my addr 172.21.15.17:0/1078776451 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:52:43.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.718+0000 7f026d200640 1 --2- 172.21.15.17:0/1078776451 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0268101e50 0x7f0268197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:52:43.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.718+0000 7f0267e00640 1 --2- 172.21.15.17:0/1078776451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0268102fb0 0x7f02681982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:52:43.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.718+0000 7f026dc00640 1 -- 172.21.15.17:0/1078776451 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0268101e50 msgr2=0x7f0268197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:52:43.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.718+0000 7f026dc00640 1 --2- 172.21.15.17:0/1078776451 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0268101e50 0x7f0268197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:43.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.718+0000 7f026dc00640 1 -- 172.21.15.17:0/1078776451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0268102fb0 msgr2=0x7f02681982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:52:43.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.718+0000 7f026dc00640 1 --2- 172.21.15.17:0/1078776451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0268102fb0 0x7f02681982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:43.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.718+0000 7f026dc00640 1 -- 172.21.15.17:0/1078776451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0260009900 con 0x7f0268103970 2024-09-13T15:52:43.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.719+0000 7f026dc00640 1 --2- 172.21.15.17:0/1078776451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0268103970 0x7f026819f360 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0260009430 tx=0x7f0260032f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:52:43.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.719+0000 7f0265600640 1 -- 172.21.15.17:0/1078776451 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0260003b70 con 0x7f0268103970 2024-09-13T15:52:43.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.719+0000 7f0265600640 1 -- 172.21.15.17:0/1078776451 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0260040070 con 0x7f0268103970 2024-09-13T15:52:43.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.719+0000 7f0265600640 1 -- 172.21.15.17:0/1078776451 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0260004570 con 0x7f0268103970 2024-09-13T15:52:43.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.719+0000 7f026e600640 1 -- 172.21.15.17:0/1078776451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026819fe50 con 0x7f0268103970 2024-09-13T15:52:43.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.719+0000 7f026e600640 1 -- 172.21.15.17:0/1078776451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02681a0270 con 0x7f0268103970 2024-09-13T15:52:43.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.720+0000 7f026e600640 1 -- 172.21.15.17:0/1078776451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0268109260 con 0x7f0268103970 2024-09-13T15:52:43.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.722+0000 7f0265600640 1 -- 172.21.15.17:0/1078776451 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0260042030 con 0x7f0268103970 2024-09-13T15:52:43.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.723+0000 7f0265600640 1 --2- 172.21.15.17:0/1078776451 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f02500a1120 0x7f02500a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:52:43.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.723+0000 7f0265600640 1 -- 172.21.15.17:0/1078776451 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5829+0+0 (secure 0 0 0) 0x7f02600ed500 con 0x7f0268103970 2024-09-13T15:52:43.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.724+0000 7f026d200640 1 --2- 172.21.15.17:0/1078776451 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f02500a1120 0x7f02500a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:52:43.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.724+0000 7f026d200640 1 --2- 172.21.15.17:0/1078776451 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f02500a1120 0x7f02500a35e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f025c00bbe0 tx=0x7f025c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:52:43.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.727+0000 7f0265600640 1 -- 172.21.15.17:0/1078776451 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f02600b75a0 con 0x7f0268103970 2024-09-13T15:52:43.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:52:43.918+0000 7f026e600640 1 -- 172.21.15.17:0/1078776451 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f026802c550 con 0x7f02500a1120 2024-09-13T15:52:44.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:44 smithi193 ceph-mon[35248]: osdmap e63: 9 total, 9 up, 9 in 2024-09-13T15:52:44.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:44 smithi193 ceph-mon[35248]: from='client.14349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:52:44.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:44 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:52:44.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:44 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:52:44.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:44 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:44.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:44 smithi193 ceph-mon[35248]: pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:52:44.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:44 smithi017 ceph-mon[30494]: osdmap e63: 9 total, 9 up, 9 in 2024-09-13T15:52:44.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:44 smithi017 ceph-mon[30494]: from='client.14349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:52:44.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:44 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:52:44.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:44 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:52:44.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:44 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:44.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:44 smithi017 ceph-mon[30494]: pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:52:44.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:44 smithi189 ceph-mon[34790]: osdmap e63: 9 total, 9 up, 9 in 2024-09-13T15:52:44.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:44 smithi189 ceph-mon[34790]: from='client.14349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:52:44.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:44 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:52:44.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:44 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:52:44.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:44 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:44.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:44 smithi189 ceph-mon[34790]: pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:52:45.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:45 smithi193 ceph-mon[35248]: osdmap e64: 9 total, 9 up, 9 in 2024-09-13T15:52:45.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:45 smithi017 ceph-mon[30494]: osdmap e64: 9 total, 9 up, 9 in 2024-09-13T15:52:45.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:45 smithi189 ceph-mon[34790]: osdmap e64: 9 total, 9 up, 9 in 2024-09-13T15:52:46.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:46 smithi017 ceph-mon[30494]: pgmap v206: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:52:46.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:46 smithi193 ceph-mon[35248]: pgmap v206: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:52:46.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:46 smithi189 ceph-mon[34790]: pgmap v206: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:52:47.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:47 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/2596411657' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac3d983c-c5e7-456b-8271-7c4e6169de61"}]: dispatch 2024-09-13T15:52:47.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:47 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/2596411657' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac3d983c-c5e7-456b-8271-7c4e6169de61"}]': finished 2024-09-13T15:52:47.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:47 smithi193 ceph-mon[35248]: osdmap e65: 10 total, 9 up, 10 in 2024-09-13T15:52:47.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:47 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T15:52:47.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:47 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/2596411657' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac3d983c-c5e7-456b-8271-7c4e6169de61"}]: dispatch 2024-09-13T15:52:47.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:47 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/2596411657' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac3d983c-c5e7-456b-8271-7c4e6169de61"}]': finished 2024-09-13T15:52:47.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:47 smithi017 ceph-mon[30494]: osdmap e65: 10 total, 9 up, 10 in 2024-09-13T15:52:47.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:47 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T15:52:47.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:47 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/2596411657' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac3d983c-c5e7-456b-8271-7c4e6169de61"}]: dispatch 2024-09-13T15:52:47.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:47 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/2596411657' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac3d983c-c5e7-456b-8271-7c4e6169de61"}]': finished 2024-09-13T15:52:47.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:47 smithi189 ceph-mon[34790]: osdmap e65: 10 total, 9 up, 10 in 2024-09-13T15:52:47.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:47 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T15:52:48.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:48 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3161137105' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:52:48.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:48 smithi193 ceph-mon[35248]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-13T15:52:48.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:48 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3161137105' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:52:48.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:48 smithi017 ceph-mon[30494]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-13T15:52:48.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:48 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3161137105' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:52:48.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:48 smithi189 ceph-mon[34790]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-13T15:52:51.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:51 smithi193 ceph-mon[35248]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-13T15:52:51.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:51 smithi017 ceph-mon[30494]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-13T15:52:51.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:51 smithi189 ceph-mon[34790]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-13T15:52:53.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:53 smithi193 ceph-mon[35248]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T15:52:53.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:53 smithi017 ceph-mon[30494]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T15:52:53.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:53 smithi189 ceph-mon[34790]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T15:52:55.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:55 smithi193 ceph-mon[35248]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T15:52:55.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:55 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-13T15:52:55.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:55 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:55.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:55 smithi017 ceph-mon[30494]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T15:52:55.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:55 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-13T15:52:55.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:55 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:55.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:55 smithi189 ceph-mon[34790]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T15:52:55.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:55 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-13T15:52:55.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:55 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:52:56.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:56 smithi017 ceph-mon[30494]: Deploying daemon osd.9 on smithi017 2024-09-13T15:52:56.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:56 smithi193 ceph-mon[35248]: Deploying daemon osd.9 on smithi017 2024-09-13T15:52:56.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:56 smithi189 ceph-mon[34790]: Deploying daemon osd.9 on smithi017 2024-09-13T15:52:57.249 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:57 smithi017 ceph-mon[30494]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T15:52:57.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:57 smithi193 ceph-mon[35248]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T15:52:57.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:57 smithi189 ceph-mon[34790]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T15:52:59.372 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:52:59 smithi017 ceph-mon[30494]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:52:59.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:52:59 smithi193 ceph-mon[35248]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:52:59.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:52:59 smithi189 ceph-mon[34790]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:53:01.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:01 smithi193 ceph-mon[35248]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:53:01.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:01 smithi017 ceph-mon[30494]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:53:01.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:01 smithi189 ceph-mon[34790]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:53:03.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:03 smithi017 ceph-mon[30494]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:53:03.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:03 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:53:03.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:03 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:03.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:03 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:03.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:03 smithi193 ceph-mon[35248]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:53:03.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:03 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:53:03.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:03 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:03.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:03 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:03.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:03 smithi189 ceph-mon[34790]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:53:03.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:03 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:53:03.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:03 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:03.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:03 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:05.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:05 smithi193 ceph-mon[35248]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:53:05.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:05 smithi017 ceph-mon[30494]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:53:05.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:05 smithi189 ceph-mon[34790]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:53:06.480 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 9 on host 'smithi017' 2024-09-13T15:53:06.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:06.477+0000 7f0265600640 1 -- 172.21.15.17:0/1078776451 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f026802c550 con 0x7f02500a1120 2024-09-13T15:53:06.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:06.479+0000 7f026e600640 1 -- 172.21.15.17:0/1078776451 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f02500a1120 msgr2=0x7f02500a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:06.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:06.480+0000 7f026e600640 1 --2- 172.21.15.17:0/1078776451 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f02500a1120 0x7f02500a35e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f025c00bbe0 tx=0x7f025c00b390 comp rx=0 tx=0).stop 2024-09-13T15:53:06.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:06.480+0000 7f026e600640 1 -- 172.21.15.17:0/1078776451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0268103970 msgr2=0x7f026819f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:06.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:06.480+0000 7f026e600640 1 --2- 172.21.15.17:0/1078776451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0268103970 0x7f026819f360 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0260009430 tx=0x7f0260032f00 comp rx=0 tx=0).stop 2024-09-13T15:53:06.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:06.480+0000 7f026e600640 1 -- 172.21.15.17:0/1078776451 shutdown_connections 2024-09-13T15:53:06.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:06.480+0000 7f026e600640 1 --2- 172.21.15.17:0/1078776451 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f02500a1120 0x7f02500a35e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:06.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:06.480+0000 7f026e600640 1 --2- 172.21.15.17:0/1078776451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0268103970 0x7f026819f360 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:06.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:06.480+0000 7f026e600640 1 --2- 172.21.15.17:0/1078776451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0268102fb0 0x7f02681982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:06.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:06.480+0000 7f026e600640 1 --2- 172.21.15.17:0/1078776451 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0268101e50 0x7f0268197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:06.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:06.480+0000 7f026e600640 1 -- 172.21.15.17:0/1078776451 >> 172.21.15.17:0/1078776451 conn(0x7f02680fd5e0 msgr2=0x7f0268106430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:06.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:06.480+0000 7f026e600640 1 -- 172.21.15.17:0/1078776451 shutdown_connections 2024-09-13T15:53:06.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:06.480+0000 7f026e600640 1 -- 172.21.15.17:0/1078776451 wait complete. 2024-09-13T15:53:06.600 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:06 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:06.600 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:06 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:06.600 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:06 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:06.600 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:06 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:53:06.601 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:06 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:06.601 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:06 smithi193 ceph-mon[35248]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:53:06.601 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:06 smithi193 ceph-mon[35248]: from='osd.9 [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-13T15:53:06.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:06 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:06.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:06 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:06.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:06 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:06.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:06 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:53:06.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:06 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:06.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:06 smithi189 ceph-mon[34790]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:53:06.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:06 smithi189 ceph-mon[34790]: from='osd.9 [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-13T15:53:06.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:06 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:06.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:06 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:06.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:06 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:06.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:06 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:53:06.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:06 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:06.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:06 smithi017 ceph-mon[30494]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:53:06.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:06 smithi017 ceph-mon[30494]: from='osd.9 [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-13T15:53:07.181 DEBUG:teuthology.orchestra.run.smithi017:osd.9> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.9.service 2024-09-13T15:53:07.185 INFO:tasks.cephadm:Deploying osd.10 on smithi189 with /dev/vg_nvme/lv_1... 2024-09-13T15:53:07.185 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-09-13T15:53:07.394 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T15:53:07.431 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:07 smithi017 ceph-mon[30494]: from='osd.9 [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-13T15:53:07.431 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:07 smithi017 ceph-mon[30494]: osdmap e66: 10 total, 9 up, 10 in 2024-09-13T15:53:07.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:07 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T15:53:07.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:07 smithi017 ceph-mon[30494]: from='osd.9 [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-13T15:53:07.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:07 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:53:07.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:07 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:07.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:07 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:07.432 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 15:53:07 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T15:53:07.332+0000 7f57d5600640 -1 osd.9 0 waiting for initial osdmap 2024-09-13T15:53:07.432 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 15:53:07 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T15:53:07.353+0000 7f57d0600640 -1 osd.9 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:53:07.515 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:07 smithi189 ceph-mon[34790]: from='osd.9 [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-13T15:53:07.516 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:07 smithi189 ceph-mon[34790]: osdmap e66: 10 total, 9 up, 10 in 2024-09-13T15:53:07.516 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:07 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T15:53:07.516 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:07 smithi189 ceph-mon[34790]: from='osd.9 [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-13T15:53:07.516 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:07 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:53:07.516 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:07 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:07.516 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:07 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:07.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:07 smithi193 ceph-mon[35248]: from='osd.9 [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-13T15:53:07.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:07 smithi193 ceph-mon[35248]: osdmap e66: 10 total, 9 up, 10 in 2024-09-13T15:53:07.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:07 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T15:53:07.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:07 smithi193 ceph-mon[35248]: from='osd.9 [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-13T15:53:07.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:07 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:53:07.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:07 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:07.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:07 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:08.481 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:08 smithi017 ceph-mon[30494]: from='osd.9 [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-13T15:53:08.481 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:08 smithi017 ceph-mon[30494]: osdmap e67: 10 total, 9 up, 10 in 2024-09-13T15:53:08.481 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:08 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T15:53:08.481 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:08 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T15:53:08.482 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:08 smithi017 ceph-mon[30494]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:53:08.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:08 smithi189 ceph-mon[34790]: from='osd.9 [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-13T15:53:08.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:08 smithi189 ceph-mon[34790]: osdmap e67: 10 total, 9 up, 10 in 2024-09-13T15:53:08.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:08 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T15:53:08.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:08 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T15:53:08.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:08 smithi189 ceph-mon[34790]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:53:08.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:08 smithi193 ceph-mon[35248]: from='osd.9 [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-13T15:53:08.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:08 smithi193 ceph-mon[35248]: osdmap e67: 10 total, 9 up, 10 in 2024-09-13T15:53:08.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:08 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T15:53:08.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:08 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T15:53:08.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:08 smithi193 ceph-mon[35248]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-13T15:53:09.439 INFO:teuthology.orchestra.run.smithi189.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-09-13T15:53:09.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:09 smithi017 ceph-mon[30494]: purged_snaps scrub starts 2024-09-13T15:53:09.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:09 smithi017 ceph-mon[30494]: purged_snaps scrub ok 2024-09-13T15:53:09.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:09 smithi017 ceph-mon[30494]: osd.9 [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274] boot 2024-09-13T15:53:09.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:09 smithi017 ceph-mon[30494]: osdmap e68: 10 total, 10 up, 10 in 2024-09-13T15:53:09.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:09 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T15:53:09.533 INFO:teuthology.orchestra.run.smithi189.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-09-13T15:53:09.546 INFO:teuthology.orchestra.run.smithi189.stderr: stderr: 10+0 records in 2024-09-13T15:53:09.546 INFO:teuthology.orchestra.run.smithi189.stderr:10+0 records out 2024-09-13T15:53:09.546 INFO:teuthology.orchestra.run.smithi189.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0116756 s, 898 MB/s 2024-09-13T15:53:09.546 INFO:teuthology.orchestra.run.smithi189.stderr:--> Zapping successful for: 2024-09-13T15:53:09.592 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:09 smithi189 ceph-mon[34790]: purged_snaps scrub starts 2024-09-13T15:53:09.592 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:09 smithi189 ceph-mon[34790]: purged_snaps scrub ok 2024-09-13T15:53:09.592 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:09 smithi189 ceph-mon[34790]: osd.9 [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274] boot 2024-09-13T15:53:09.592 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:09 smithi189 ceph-mon[34790]: osdmap e68: 10 total, 10 up, 10 in 2024-09-13T15:53:09.592 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:09 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T15:53:09.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:09 smithi193 ceph-mon[35248]: purged_snaps scrub starts 2024-09-13T15:53:09.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:09 smithi193 ceph-mon[35248]: purged_snaps scrub ok 2024-09-13T15:53:09.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:09 smithi193 ceph-mon[35248]: osd.9 [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274] boot 2024-09-13T15:53:09.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:09 smithi193 ceph-mon[35248]: osdmap e68: 10 total, 10 up, 10 in 2024-09-13T15:53:09.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:09 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T15:53:10.356 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_1 2024-09-13T15:53:10.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:10 smithi017 ceph-mon[30494]: osdmap e69: 10 total, 10 up, 10 in 2024-09-13T15:53:10.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:10 smithi017 ceph-mon[30494]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:10.554 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T15:53:10.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:10 smithi189 ceph-mon[34790]: osdmap e69: 10 total, 10 up, 10 in 2024-09-13T15:53:10.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:10 smithi189 ceph-mon[34790]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:10.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:10 smithi193 ceph-mon[35248]: osdmap e69: 10 total, 10 up, 10 in 2024-09-13T15:53:10.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:10 smithi193 ceph-mon[35248]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:12.347 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.309+0000 7fc1cc415640 1 -- 172.21.15.189:0/487106818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1c4105b50 msgr2=0x7fc1c4107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:12.347 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.309+0000 7fc1cc415640 1 --2- 172.21.15.189:0/487106818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1c4105b50 0x7fc1c4107f40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc009ca0 tx=0x7fc1bc02a8c0 comp rx=0 tx=0).stop 2024-09-13T15:53:12.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.309+0000 7fc1cc415640 1 -- 172.21.15.189:0/487106818 shutdown_connections 2024-09-13T15:53:12.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.309+0000 7fc1cc415640 1 --2- 172.21.15.189:0/487106818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1c4105b50 0x7fc1c4107f40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:12.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.309+0000 7fc1cc415640 1 --2- 172.21.15.189:0/487106818 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1c4103220 0x7fc1c4105610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:12.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.309+0000 7fc1cc415640 1 --2- 172.21.15.189:0/487106818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c41008f0 0x7fc1c4102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:12.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.309+0000 7fc1cc415640 1 -- 172.21.15.189:0/487106818 >> 172.21.15.189:0/487106818 conn(0x7fc1c40fa490 msgr2=0x7fc1c40fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:12.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.309+0000 7fc1cc415640 1 -- 172.21.15.189:0/487106818 shutdown_connections 2024-09-13T15:53:12.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.309+0000 7fc1cc415640 1 -- 172.21.15.189:0/487106818 wait complete. 2024-09-13T15:53:12.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.310+0000 7fc1cc415640 1 Processor -- start 2024-09-13T15:53:12.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.310+0000 7fc1cc415640 1 -- start start 2024-09-13T15:53:12.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.310+0000 7fc1cc415640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1c41008f0 0x7fc1c4195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:12.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.310+0000 7fc1cc415640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1c4103220 0x7fc1c4196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:12.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.310+0000 7fc1cc415640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4105b50 0x7fc1c419d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:12.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.310+0000 7fc1cc415640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c419d8c0 con 0x7fc1c4105b50 2024-09-13T15:53:12.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.310+0000 7fc1cc415640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c419da30 con 0x7fc1c4103220 2024-09-13T15:53:12.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.310+0000 7fc1cc415640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c419dbf0 con 0x7fc1c41008f0 2024-09-13T15:53:12.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.310+0000 7fc1c99b0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1c4103220 0x7fc1c4196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:12.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.310+0000 7fc1c99b0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1c4103220 0x7fc1c4196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:37986/0 (socket says 172.21.15.189:37986) 2024-09-13T15:53:12.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.310+0000 7fc1c99b0640 1 -- 172.21.15.189:0/2867788805 learned_addr learned my addr 172.21.15.189:0/2867788805 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-13T15:53:12.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.310+0000 7fc1ca1b1640 1 --2- 172.21.15.189:0/2867788805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1c41008f0 0x7fc1c4195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:12.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.311+0000 7fc1ca9b2640 1 --2- 172.21.15.189:0/2867788805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4105b50 0x7fc1c419d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:12.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.311+0000 7fc1c99b0640 1 -- 172.21.15.189:0/2867788805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1c41008f0 msgr2=0x7fc1c4195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:12.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.311+0000 7fc1c99b0640 1 --2- 172.21.15.189:0/2867788805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1c41008f0 0x7fc1c4195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:12.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.311+0000 7fc1c99b0640 1 -- 172.21.15.189:0/2867788805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4105b50 msgr2=0x7fc1c419d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:12.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.311+0000 7fc1c99b0640 1 --2- 172.21.15.189:0/2867788805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4105b50 0x7fc1c419d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:12.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.311+0000 7fc1c99b0640 1 -- 172.21.15.189:0/2867788805 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1bc009900 con 0x7fc1c4103220 2024-09-13T15:53:12.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.311+0000 7fc1ca1b1640 1 --2- 172.21.15.189:0/2867788805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1c41008f0 0x7fc1c4195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:53:12.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.311+0000 7fc1ca9b2640 1 --2- 172.21.15.189:0/2867788805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4105b50 0x7fc1c419d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:53:12.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.311+0000 7fc1c99b0640 1 --2- 172.21.15.189:0/2867788805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1c4103220 0x7fc1c4196300 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400c970 tx=0x7fc1b400ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:12.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.311+0000 7fc1bb7fe640 1 -- 172.21.15.189:0/2867788805 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4007bb0 con 0x7fc1c4103220 2024-09-13T15:53:12.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.311+0000 7fc1bb7fe640 1 -- 172.21.15.189:0/2867788805 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc1b4007d10 con 0x7fc1c4103220 2024-09-13T15:53:12.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.311+0000 7fc1bb7fe640 1 -- 172.21.15.189:0/2867788805 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4004e20 con 0x7fc1c4103220 2024-09-13T15:53:12.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.311+0000 7fc1cc415640 1 -- 172.21.15.189:0/2867788805 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c419ded0 con 0x7fc1c4103220 2024-09-13T15:53:12.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.311+0000 7fc1cc415640 1 -- 172.21.15.189:0/2867788805 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c419e370 con 0x7fc1c4103220 2024-09-13T15:53:12.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.312+0000 7fc1cc415640 1 -- 172.21.15.189:0/2867788805 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c40fbf80 con 0x7fc1c4103220 2024-09-13T15:53:12.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.313+0000 7fc1bb7fe640 1 -- 172.21.15.189:0/2867788805 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc1b4004f80 con 0x7fc1c4103220 2024-09-13T15:53:12.351 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.313+0000 7fc1bb7fe640 1 --2- 172.21.15.189:0/2867788805 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1b00a10b0 0x7fc1b00a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:12.351 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.314+0000 7fc1bb7fe640 1 -- 172.21.15.189:0/2867788805 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6261+0+0 (secure 0 0 0) 0x7fc1b40cbde0 con 0x7fc1c4103220 2024-09-13T15:53:12.351 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.314+0000 7fc1ca1b1640 1 --2- 172.21.15.189:0/2867788805 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1b00a10b0 0x7fc1b00a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:12.351 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.314+0000 7fc1ca1b1640 1 --2- 172.21.15.189:0/2867788805 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1b00a10b0 0x7fc1b00a3570 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009930 tx=0x7fc1c0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:12.351 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.318+0000 7fc1bb7fe640 1 -- 172.21.15.189:0/2867788805 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc1b4095d70 con 0x7fc1c4103220 2024-09-13T15:53:12.351 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:12 smithi189 ceph-mon[34790]: Detected new or changed devices on smithi017 2024-09-13T15:53:12.351 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:12 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:12.351 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:12 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:12.351 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:12 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:12.351 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:12 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:12.351 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:12 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:12.352 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:12 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:12.352 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:12 smithi189 ceph-mon[34790]: Adjusting osd_memory_target on smithi017 to 4273M 2024-09-13T15:53:12.352 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:12 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:12.352 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:12 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:12.352 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:12 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:53:12.352 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:12 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:12.493 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:12.491+0000 7fc1cc415640 1 -- 172.21.15.189:0/2867788805 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1c402c520 con 0x7fc1b00a10b0 2024-09-13T15:53:12.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:12 smithi193 ceph-mon[35248]: Detected new or changed devices on smithi017 2024-09-13T15:53:12.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:12 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:12.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:12 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:12.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:12 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:12.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:12 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:12.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:12 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:12.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:12 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:12.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:12 smithi193 ceph-mon[35248]: Adjusting osd_memory_target on smithi017 to 4273M 2024-09-13T15:53:12.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:12 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:12.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:12 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:12.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:12 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:53:12.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:12 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:12.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:12 smithi017 ceph-mon[30494]: Detected new or changed devices on smithi017 2024-09-13T15:53:12.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:12 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:12.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:12 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:12.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:12 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:12.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:12 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:12.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:12 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:12.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:12 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:12.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:12 smithi017 ceph-mon[30494]: Adjusting osd_memory_target on smithi017 to 4273M 2024-09-13T15:53:12.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:12 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:12.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:12 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:12.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:12 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:53:12.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:12 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:13.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:13 smithi193 ceph-mon[35248]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:13.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:13 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:53:13.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:13 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:53:13.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:13 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:13 smithi017 ceph-mon[30494]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:13 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:53:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:13 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:53:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:13 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:13.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:13 smithi189 ceph-mon[34790]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:13.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:13 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:53:13.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:13 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:53:13.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:13 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:14.291 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:14 smithi189 ceph-mon[34790]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:53:14.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:14 smithi193 ceph-mon[35248]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:53:14.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:14 smithi017 ceph-mon[30494]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:53:15.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:15 smithi193 ceph-mon[35248]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:15.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:15 smithi193 ceph-mon[35248]: from='client.? 172.21.15.189:0/3155760205' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08dcae02-6c79-4a06-ae88-6eb6e6941cc0"}]: dispatch 2024-09-13T15:53:15.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:15 smithi193 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08dcae02-6c79-4a06-ae88-6eb6e6941cc0"}]: dispatch 2024-09-13T15:53:15.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:15 smithi193 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "08dcae02-6c79-4a06-ae88-6eb6e6941cc0"}]': finished 2024-09-13T15:53:15.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:15 smithi193 ceph-mon[35248]: osdmap e70: 11 total, 10 up, 11 in 2024-09-13T15:53:15.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:15 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T15:53:15.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:15 smithi017 ceph-mon[30494]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:15.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:15 smithi017 ceph-mon[30494]: from='client.? 172.21.15.189:0/3155760205' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08dcae02-6c79-4a06-ae88-6eb6e6941cc0"}]: dispatch 2024-09-13T15:53:15.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:15 smithi017 ceph-mon[30494]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08dcae02-6c79-4a06-ae88-6eb6e6941cc0"}]: dispatch 2024-09-13T15:53:15.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:15 smithi017 ceph-mon[30494]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "08dcae02-6c79-4a06-ae88-6eb6e6941cc0"}]': finished 2024-09-13T15:53:15.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:15 smithi017 ceph-mon[30494]: osdmap e70: 11 total, 10 up, 11 in 2024-09-13T15:53:15.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:15 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T15:53:15.549 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:15 smithi189 ceph-mon[34790]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:15.550 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:15 smithi189 ceph-mon[34790]: from='client.? 172.21.15.189:0/3155760205' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08dcae02-6c79-4a06-ae88-6eb6e6941cc0"}]: dispatch 2024-09-13T15:53:15.550 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:15 smithi189 ceph-mon[34790]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08dcae02-6c79-4a06-ae88-6eb6e6941cc0"}]: dispatch 2024-09-13T15:53:15.550 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:15 smithi189 ceph-mon[34790]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "08dcae02-6c79-4a06-ae88-6eb6e6941cc0"}]': finished 2024-09-13T15:53:15.550 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:15 smithi189 ceph-mon[34790]: osdmap e70: 11 total, 10 up, 11 in 2024-09-13T15:53:15.550 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:15 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T15:53:16.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:16 smithi193 ceph-mon[35248]: from='client.? 172.21.15.189:0/88131924' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:53:16.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:16 smithi193 ceph-mon[35248]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:16.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:16 smithi017 ceph-mon[30494]: from='client.? 172.21.15.189:0/88131924' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:53:16.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:16 smithi017 ceph-mon[30494]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:16.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:16 smithi189 ceph-mon[34790]: from='client.? 172.21.15.189:0/88131924' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:53:16.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:16 smithi189 ceph-mon[34790]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:19.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:19 smithi193 ceph-mon[35248]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:19.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:19 smithi017 ceph-mon[30494]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:19.602 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:19 smithi189 ceph-mon[34790]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:21.302 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:21 smithi189 ceph-mon[34790]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:21.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:21 smithi193 ceph-mon[35248]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:21.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:21 smithi017 ceph-mon[30494]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:22.458 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:22 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-13T15:53:22.459 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:22 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:22.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:22 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-13T15:53:22.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:22 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:22.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:22 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-13T15:53:22.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:22 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:23.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:23 smithi193 ceph-mon[35248]: Deploying daemon osd.10 on smithi189 2024-09-13T15:53:23.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:23 smithi193 ceph-mon[35248]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:23.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:23 smithi017 ceph-mon[30494]: Deploying daemon osd.10 on smithi189 2024-09-13T15:53:23.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:23 smithi017 ceph-mon[30494]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:23.562 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:23 smithi189 ceph-mon[34790]: Deploying daemon osd.10 on smithi189 2024-09-13T15:53:23.562 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:23 smithi189 ceph-mon[34790]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:25.495 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:25 smithi189 ceph-mon[34790]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:25.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:25 smithi193 ceph-mon[35248]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:25.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:25 smithi017 ceph-mon[30494]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:27.387 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:27 smithi189 ceph-mon[34790]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:27.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:27 smithi193 ceph-mon[35248]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:27.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:27 smithi017 ceph-mon[30494]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:28.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:28 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:53:28.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:28 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:28.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:28 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:28.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:28 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:53:28.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:28 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:28.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:28 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:28.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:28 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:53:28.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:28 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:28.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:28 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:29.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:29 smithi189 ceph-mon[34790]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:29.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:29 smithi193 ceph-mon[35248]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:29.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:29 smithi017 ceph-mon[30494]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:31.059 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:31.057+0000 7fc1bb7fe640 1 -- 172.21.15.189:0/2867788805 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fc1c402c520 con 0x7fc1b00a10b0 2024-09-13T15:53:31.059 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 10 on host 'smithi189' 2024-09-13T15:53:31.061 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:31.059+0000 7fc1cc415640 1 -- 172.21.15.189:0/2867788805 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1b00a10b0 msgr2=0x7fc1b00a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:31.061 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:31.059+0000 7fc1cc415640 1 --2- 172.21.15.189:0/2867788805 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1b00a10b0 0x7fc1b00a3570 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009930 tx=0x7fc1c0008040 comp rx=0 tx=0).stop 2024-09-13T15:53:31.061 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:31.059+0000 7fc1cc415640 1 -- 172.21.15.189:0/2867788805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1c4103220 msgr2=0x7fc1c4196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:31.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:31.059+0000 7fc1cc415640 1 --2- 172.21.15.189:0/2867788805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1c4103220 0x7fc1c4196300 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400c970 tx=0x7fc1b400ce30 comp rx=0 tx=0).stop 2024-09-13T15:53:31.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:31.059+0000 7fc1cc415640 1 -- 172.21.15.189:0/2867788805 shutdown_connections 2024-09-13T15:53:31.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:31.059+0000 7fc1cc415640 1 --2- 172.21.15.189:0/2867788805 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1b00a10b0 0x7fc1b00a3570 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:31.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:31.059+0000 7fc1cc415640 1 --2- 172.21.15.189:0/2867788805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4105b50 0x7fc1c419d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:31.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:31.059+0000 7fc1cc415640 1 --2- 172.21.15.189:0/2867788805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1c4103220 0x7fc1c4196300 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:31.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:31.059+0000 7fc1cc415640 1 --2- 172.21.15.189:0/2867788805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1c41008f0 0x7fc1c4195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:31.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:31.059+0000 7fc1cc415640 1 -- 172.21.15.189:0/2867788805 >> 172.21.15.189:0/2867788805 conn(0x7fc1c40fa490 msgr2=0x7fc1c4101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:31.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:31.060+0000 7fc1cc415640 1 -- 172.21.15.189:0/2867788805 shutdown_connections 2024-09-13T15:53:31.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-13T15:53:31.060+0000 7fc1cc415640 1 -- 172.21.15.189:0/2867788805 wait complete. 2024-09-13T15:53:31.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:31 smithi193 ceph-mon[35248]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:31.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:31 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:31.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:31 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:31.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:31 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:31.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:31 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:53:31.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:31 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:31.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:31 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:53:31.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:31 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:31.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:31 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:31.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:31 smithi017 ceph-mon[30494]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:31.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:31 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:31.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:31 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:31.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:31 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:31.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:31 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:53:31.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:31 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:31.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:31 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:53:31.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:31 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:31.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:31 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:31.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:31 smithi189 ceph-mon[34790]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:31.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:31 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:31.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:31 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:31.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:31 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:31.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:31 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:53:31.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:31 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:31.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:31 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:53:31.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:31 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:31.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:31 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:31.750 DEBUG:teuthology.orchestra.run.smithi189:osd.10> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.10.service 2024-09-13T15:53:31.752 INFO:tasks.cephadm:Deploying osd.11 on smithi193 with /dev/vg_nvme/lv_1... 2024-09-13T15:53:31.752 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-09-13T15:53:31.961 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T15:53:32.334 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:32 smithi193 ceph-mon[35248]: from='osd.10 [v2:172.21.15.189:6824/3153990375,v1:172.21.15.189:6825/3153990375]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T15:53:32.334 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:32 smithi193 ceph-mon[35248]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T15:53:32.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:32 smithi189 ceph-mon[34790]: from='osd.10 [v2:172.21.15.189:6824/3153990375,v1:172.21.15.189:6825/3153990375]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T15:53:32.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:32 smithi189 ceph-mon[34790]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T15:53:32.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:32 smithi017 ceph-mon[30494]: from='osd.10 [v2:172.21.15.189:6824/3153990375,v1:172.21.15.189:6825/3153990375]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T15:53:32.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:32 smithi017 ceph-mon[30494]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T15:53:33.363 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:33 smithi193 ceph-mon[35248]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:33.363 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:33 smithi193 ceph-mon[35248]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-13T15:53:33.363 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:33 smithi193 ceph-mon[35248]: osdmap e71: 11 total, 10 up, 11 in 2024-09-13T15:53:33.363 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:33 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T15:53:33.363 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:33 smithi193 ceph-mon[35248]: from='osd.10 [v2:172.21.15.189:6824/3153990375,v1:172.21.15.189:6825/3153990375]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:53:33.363 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:33 smithi193 ceph-mon[35248]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:53:33.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:33 smithi017 ceph-mon[30494]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:33.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:33 smithi017 ceph-mon[30494]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-13T15:53:33.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:33 smithi017 ceph-mon[30494]: osdmap e71: 11 total, 10 up, 11 in 2024-09-13T15:53:33.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:33 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T15:53:33.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:33 smithi017 ceph-mon[30494]: from='osd.10 [v2:172.21.15.189:6824/3153990375,v1:172.21.15.189:6825/3153990375]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:53:33.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:33 smithi017 ceph-mon[30494]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:53:33.515 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:33 smithi189 ceph-mon[34790]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:33.516 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:33 smithi189 ceph-mon[34790]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-13T15:53:33.516 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:33 smithi189 ceph-mon[34790]: osdmap e71: 11 total, 10 up, 11 in 2024-09-13T15:53:33.516 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:33 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T15:53:33.516 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:33 smithi189 ceph-mon[34790]: from='osd.10 [v2:172.21.15.189:6824/3153990375,v1:172.21.15.189:6825/3153990375]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:53:33.516 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:33 smithi189 ceph-mon[34790]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-13T15:53:33.516 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 15:53:33 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T15:53:33.210+0000 7f2d5f3fa640 -1 osd.10 0 waiting for initial osdmap 2024-09-13T15:53:33.516 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 15:53:33 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T15:53:33.223+0000 7f2d5b223640 -1 osd.10 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:53:33.877 INFO:teuthology.orchestra.run.smithi193.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-09-13T15:53:33.968 INFO:teuthology.orchestra.run.smithi193.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-09-13T15:53:33.981 INFO:teuthology.orchestra.run.smithi193.stderr: stderr: 10+0 records in 2024-09-13T15:53:33.981 INFO:teuthology.orchestra.run.smithi193.stderr:10+0 records out 2024-09-13T15:53:33.981 INFO:teuthology.orchestra.run.smithi193.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113222 s, 926 MB/s 2024-09-13T15:53:33.981 INFO:teuthology.orchestra.run.smithi193.stderr:--> Zapping successful for: 2024-09-13T15:53:34.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:34 smithi193 ceph-mon[35248]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-13T15:53:34.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:34 smithi193 ceph-mon[35248]: osdmap e72: 11 total, 10 up, 11 in 2024-09-13T15:53:34.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T15:53:34.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T15:53:34.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:34 smithi193 ceph-mon[35248]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:34.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:34 smithi189 ceph-mon[34790]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-13T15:53:34.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:34 smithi189 ceph-mon[34790]: osdmap e72: 11 total, 10 up, 11 in 2024-09-13T15:53:34.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:34 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T15:53:34.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:34 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T15:53:34.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:34 smithi189 ceph-mon[34790]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:34.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:34 smithi017 ceph-mon[30494]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-13T15:53:34.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:34 smithi017 ceph-mon[30494]: osdmap e72: 11 total, 10 up, 11 in 2024-09-13T15:53:34.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T15:53:34.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T15:53:34.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:34 smithi017 ceph-mon[30494]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-09-13T15:53:34.600 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi193:vg_nvme/lv_1 2024-09-13T15:53:34.798 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T15:53:35.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:35 smithi193 ceph-mon[35248]: purged_snaps scrub starts 2024-09-13T15:53:35.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:35 smithi193 ceph-mon[35248]: purged_snaps scrub ok 2024-09-13T15:53:35.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:35 smithi193 ceph-mon[35248]: osd.10 [v2:172.21.15.189:6824/3153990375,v1:172.21.15.189:6825/3153990375] boot 2024-09-13T15:53:35.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:35 smithi193 ceph-mon[35248]: osdmap e73: 11 total, 11 up, 11 in 2024-09-13T15:53:35.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:35 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T15:53:35.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:35 smithi193 ceph-mon[35248]: Detected new or changed devices on smithi189 2024-09-13T15:53:35.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:35 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:35.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:35 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:35.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:35 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:35.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:35 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:35.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:35 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:35.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:35 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:35.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:35 smithi193 ceph-mon[35248]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-13T15:53:35.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:35 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:35.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:35 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:35.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:35 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:53:35.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:35 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:35.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:35 smithi017 ceph-mon[30494]: purged_snaps scrub starts 2024-09-13T15:53:35.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:35 smithi017 ceph-mon[30494]: purged_snaps scrub ok 2024-09-13T15:53:35.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:35 smithi017 ceph-mon[30494]: osd.10 [v2:172.21.15.189:6824/3153990375,v1:172.21.15.189:6825/3153990375] boot 2024-09-13T15:53:35.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:35 smithi017 ceph-mon[30494]: osdmap e73: 11 total, 11 up, 11 in 2024-09-13T15:53:35.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:35 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T15:53:35.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:35 smithi017 ceph-mon[30494]: Detected new or changed devices on smithi189 2024-09-13T15:53:35.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:35 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:35.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:35 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:35.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:35 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:35.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:35 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:35.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:35 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:35.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:35 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:35.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:35 smithi017 ceph-mon[30494]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-13T15:53:35.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:35 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:35.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:35 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:35.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:35 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:53:35.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:35 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:35.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:35 smithi189 ceph-mon[34790]: purged_snaps scrub starts 2024-09-13T15:53:35.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:35 smithi189 ceph-mon[34790]: purged_snaps scrub ok 2024-09-13T15:53:35.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:35 smithi189 ceph-mon[34790]: osd.10 [v2:172.21.15.189:6824/3153990375,v1:172.21.15.189:6825/3153990375] boot 2024-09-13T15:53:35.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:35 smithi189 ceph-mon[34790]: osdmap e73: 11 total, 11 up, 11 in 2024-09-13T15:53:35.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:35 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T15:53:35.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:35 smithi189 ceph-mon[34790]: Detected new or changed devices on smithi189 2024-09-13T15:53:35.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:35 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:35.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:35 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:35.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:35 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:35.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:35 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:35.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:35 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:35.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:35 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:53:35.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:35 smithi189 ceph-mon[34790]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-13T15:53:35.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:35 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:35.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:35 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:35.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:35 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:53:35.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:35 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:36.352 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:36 smithi193 ceph-mon[35248]: osdmap e74: 11 total, 11 up, 11 in 2024-09-13T15:53:36.352 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:36 smithi193 ceph-mon[35248]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:36.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:36 smithi017 ceph-mon[30494]: osdmap e74: 11 total, 11 up, 11 in 2024-09-13T15:53:36.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:36 smithi017 ceph-mon[30494]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:36.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.561+0000 7f2aa0e11640 1 -- 172.21.15.193:0/2647763067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a9c0fe3f0 msgr2=0x7f2a9c105580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:36.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.561+0000 7f2aa0e11640 1 --2- 172.21.15.193:0/2647763067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a9c0fe3f0 0x7f2a9c105580 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2a84009900 tx=0x7f2a8402a410 comp rx=0 tx=0).stop 2024-09-13T15:53:36.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.561+0000 7f2aa0e11640 1 -- 172.21.15.193:0/2647763067 shutdown_connections 2024-09-13T15:53:36.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.561+0000 7f2aa0e11640 1 --2- 172.21.15.193:0/2647763067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a9c105ac0 0x7f2a9c107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:36.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.561+0000 7f2aa0e11640 1 --2- 172.21.15.193:0/2647763067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a9c0fe3f0 0x7f2a9c105580 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:36.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.561+0000 7f2aa0e11640 1 --2- 172.21.15.193:0/2647763067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a9c0fda40 0x7f2a9c0fde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:36.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.561+0000 7f2aa0e11640 1 -- 172.21.15.193:0/2647763067 >> 172.21.15.193:0/2647763067 conn(0x7f2a9c0f97c0 msgr2=0x7f2a9c0fbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:36.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.561+0000 7f2aa0e11640 1 -- 172.21.15.193:0/2647763067 shutdown_connections 2024-09-13T15:53:36.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.561+0000 7f2aa0e11640 1 -- 172.21.15.193:0/2647763067 wait complete. 2024-09-13T15:53:36.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.562+0000 7f2aa0e11640 1 Processor -- start 2024-09-13T15:53:36.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.562+0000 7f2aa0e11640 1 -- start start 2024-09-13T15:53:36.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.562+0000 7f2aa0e11640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a9c0fda40 0x7f2a9c195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:36.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.562+0000 7f2aa0e11640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a9c0fe3f0 0x7f2a9c1963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:36.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.562+0000 7f2aa0e11640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a9c105ac0 0x7f2a9c19d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:36.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.562+0000 7f2aa0e11640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9c19d960 con 0x7f2a9c0fe3f0 2024-09-13T15:53:36.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.562+0000 7f2aa0e11640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9c19dad0 con 0x7f2a9c105ac0 2024-09-13T15:53:36.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.562+0000 7f2aa0e11640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9c19dc90 con 0x7f2a9c0fda40 2024-09-13T15:53:36.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.562+0000 7f2a9a59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a9c0fda40 0x7f2a9c195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:36.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.562+0000 7f2a9a59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a9c0fda40 0x7f2a9c195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:60380/0 (socket says 172.21.15.193:60380) 2024-09-13T15:53:36.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.562+0000 7f2a9a59c640 1 -- 172.21.15.193:0/5507259 learned_addr learned my addr 172.21.15.193:0/5507259 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-13T15:53:36.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.562+0000 7f2a9ad9d640 1 --2- 172.21.15.193:0/5507259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a9c105ac0 0x7f2a9c19d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:36.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.563+0000 7f2a9a59c640 1 -- 172.21.15.193:0/5507259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a9c105ac0 msgr2=0x7f2a9c19d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:36.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.563+0000 7f2a9a59c640 1 --2- 172.21.15.193:0/5507259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a9c105ac0 0x7f2a9c19d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:36.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.563+0000 7f2a93fff640 1 --2- 172.21.15.193:0/5507259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a9c0fe3f0 0x7f2a9c1963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:36.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.563+0000 7f2a9a59c640 1 -- 172.21.15.193:0/5507259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a9c0fe3f0 msgr2=0x7f2a9c1963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:36.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.563+0000 7f2a9a59c640 1 --2- 172.21.15.193:0/5507259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a9c0fe3f0 0x7f2a9c1963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:36.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.563+0000 7f2a9a59c640 1 -- 172.21.15.193:0/5507259 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a84009560 con 0x7f2a9c0fda40 2024-09-13T15:53:36.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.563+0000 7f2a9a59c640 1 --2- 172.21.15.193:0/5507259 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a9c0fda40 0x7f2a9c195e60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00b450 tx=0x7f2a8c00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:36.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.563+0000 7f2a937fe640 1 -- 172.21.15.193:0/5507259 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c011890 con 0x7f2a9c0fda40 2024-09-13T15:53:36.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.563+0000 7f2a937fe640 1 -- 172.21.15.193:0/5507259 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a8c0103e0 con 0x7f2a9c0fda40 2024-09-13T15:53:36.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.563+0000 7f2aa0e11640 1 -- 172.21.15.193:0/5507259 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a9c19df70 con 0x7f2a9c0fda40 2024-09-13T15:53:36.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.563+0000 7f2a937fe640 1 -- 172.21.15.193:0/5507259 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c00f5a0 con 0x7f2a9c0fda40 2024-09-13T15:53:36.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.563+0000 7f2aa0e11640 1 -- 172.21.15.193:0/5507259 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a9c19e400 con 0x7f2a9c0fda40 2024-09-13T15:53:36.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.564+0000 7f2aa0e11640 1 -- 172.21.15.193:0/5507259 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a9c0fde90 con 0x7f2a9c0fda40 2024-09-13T15:53:36.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.565+0000 7f2a937fe640 1 -- 172.21.15.193:0/5507259 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2a8c010850 con 0x7f2a9c0fda40 2024-09-13T15:53:36.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.566+0000 7f2a937fe640 1 --2- 172.21.15.193:0/5507259 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2a880a10b0 0x7f2a880a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:36.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.566+0000 7f2a937fe640 1 -- 172.21.15.193:0/5507259 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6694+0+0 (secure 0 0 0) 0x7f2a8c0cc050 con 0x7f2a9c0fda40 2024-09-13T15:53:36.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.566+0000 7f2a93fff640 1 --2- 172.21.15.193:0/5507259 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2a880a10b0 0x7f2a880a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:36.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.567+0000 7f2a93fff640 1 --2- 172.21.15.193:0/5507259 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2a880a10b0 0x7f2a880a3570 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2a8402a930 tx=0x7f2a84005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:36.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.570+0000 7f2a937fe640 1 -- 172.21.15.193:0/5507259 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2a9c0fde90 con 0x7f2a9c0fda40 2024-09-13T15:53:36.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:36 smithi189 ceph-mon[34790]: osdmap e74: 11 total, 11 up, 11 in 2024-09-13T15:53:36.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:36 smithi189 ceph-mon[34790]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:36.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:36.740+0000 7f2aa0e11640 1 -- 172.21.15.193:0/5507259 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a9c0fde20 con 0x7f2a880a10b0 2024-09-13T15:53:37.375 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:37 smithi193 ceph-mon[35248]: osdmap e75: 11 total, 11 up, 11 in 2024-09-13T15:53:37.375 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:37 smithi193 ceph-mon[35248]: osdmap e76: 11 total, 11 up, 11 in 2024-09-13T15:53:37.375 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:37 smithi193 ceph-mon[35248]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:53:37.375 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:37 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:53:37.375 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:37 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:53:37.375 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:37 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:37.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:37 smithi017 ceph-mon[30494]: osdmap e75: 11 total, 11 up, 11 in 2024-09-13T15:53:37.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:37 smithi017 ceph-mon[30494]: osdmap e76: 11 total, 11 up, 11 in 2024-09-13T15:53:37.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:37 smithi017 ceph-mon[30494]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:53:37.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:37 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:53:37.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:37 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:53:37.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:37 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:37.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:37 smithi189 ceph-mon[34790]: osdmap e75: 11 total, 11 up, 11 in 2024-09-13T15:53:37.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:37 smithi189 ceph-mon[34790]: osdmap e76: 11 total, 11 up, 11 in 2024-09-13T15:53:37.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:37 smithi189 ceph-mon[34790]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:53:37.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:37 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T15:53:37.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:37 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T15:53:37.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:37 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:38.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:38 smithi193 ceph-mon[35248]: osdmap e77: 11 total, 11 up, 11 in 2024-09-13T15:53:38.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:38 smithi193 ceph-mon[35248]: pgmap v245: 1 pgs: 1 peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-09-13T15:53:38.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:38 smithi189 ceph-mon[34790]: osdmap e77: 11 total, 11 up, 11 in 2024-09-13T15:53:38.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:38 smithi189 ceph-mon[34790]: pgmap v245: 1 pgs: 1 peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-09-13T15:53:38.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:38 smithi017 ceph-mon[30494]: osdmap e77: 11 total, 11 up, 11 in 2024-09-13T15:53:38.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:38 smithi017 ceph-mon[30494]: pgmap v245: 1 pgs: 1 peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-09-13T15:53:39.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:39 smithi193 ceph-mon[35248]: from='client.? 172.21.15.193:0/4226604817' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4ebcf41-d805-4d44-b112-13ae84d51868"}]: dispatch 2024-09-13T15:53:39.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:39 smithi193 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4ebcf41-d805-4d44-b112-13ae84d51868"}]: dispatch 2024-09-13T15:53:39.578 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:39 smithi193 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4ebcf41-d805-4d44-b112-13ae84d51868"}]': finished 2024-09-13T15:53:39.579 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:39 smithi193 ceph-mon[35248]: osdmap e78: 12 total, 11 up, 12 in 2024-09-13T15:53:39.579 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:39 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T15:53:39.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:39 smithi189 ceph-mon[34790]: from='client.? 172.21.15.193:0/4226604817' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4ebcf41-d805-4d44-b112-13ae84d51868"}]: dispatch 2024-09-13T15:53:39.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:39 smithi189 ceph-mon[34790]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4ebcf41-d805-4d44-b112-13ae84d51868"}]: dispatch 2024-09-13T15:53:39.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:39 smithi189 ceph-mon[34790]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4ebcf41-d805-4d44-b112-13ae84d51868"}]': finished 2024-09-13T15:53:39.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:39 smithi189 ceph-mon[34790]: osdmap e78: 12 total, 11 up, 12 in 2024-09-13T15:53:39.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:39 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T15:53:39.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:39 smithi017 ceph-mon[30494]: from='client.? 172.21.15.193:0/4226604817' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4ebcf41-d805-4d44-b112-13ae84d51868"}]: dispatch 2024-09-13T15:53:39.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:39 smithi017 ceph-mon[30494]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4ebcf41-d805-4d44-b112-13ae84d51868"}]: dispatch 2024-09-13T15:53:39.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:39 smithi017 ceph-mon[30494]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4ebcf41-d805-4d44-b112-13ae84d51868"}]': finished 2024-09-13T15:53:39.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:39 smithi017 ceph-mon[30494]: osdmap e78: 12 total, 11 up, 12 in 2024-09-13T15:53:39.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:39 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T15:53:40.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:40 smithi189 ceph-mon[34790]: from='client.? 172.21.15.193:0/4101967763' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:53:40.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:40 smithi189 ceph-mon[34790]: pgmap v247: 1 pgs: 1 peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T15:53:40.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:40 smithi193 ceph-mon[35248]: from='client.? 172.21.15.193:0/4101967763' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:53:40.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:40 smithi193 ceph-mon[35248]: pgmap v247: 1 pgs: 1 peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T15:53:40.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:40 smithi017 ceph-mon[30494]: from='client.? 172.21.15.193:0/4101967763' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T15:53:40.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:40 smithi017 ceph-mon[30494]: pgmap v247: 1 pgs: 1 peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T15:53:43.511 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:43 smithi193 ceph-mon[35248]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-13T15:53:43.518 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:43 smithi017 ceph-mon[30494]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-13T15:53:43.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:43 smithi189 ceph-mon[34790]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-13T15:53:45.349 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:45 smithi193 ceph-mon[35248]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-13T15:53:45.876 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:45 smithi189 ceph-mon[34790]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-13T15:53:45.877 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:45 smithi017 ceph-mon[30494]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-13T15:53:47.459 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:47 smithi193 ceph-mon[35248]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:47.459 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:47 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-13T15:53:47.459 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:47 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:47.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:47 smithi017 ceph-mon[30494]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:47.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:47 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-13T15:53:47.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:47 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:47.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:47 smithi189 ceph-mon[34790]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:47.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:47 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-13T15:53:47.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:47 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:53:48.353 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:48 smithi193 ceph-mon[35248]: Deploying daemon osd.11 on smithi193 2024-09-13T15:53:48.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:48 smithi017 ceph-mon[30494]: Deploying daemon osd.11 on smithi193 2024-09-13T15:53:48.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:48 smithi189 ceph-mon[34790]: Deploying daemon osd.11 on smithi193 2024-09-13T15:53:49.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:49 smithi193 ceph-mon[35248]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:49.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:49 smithi017 ceph-mon[30494]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:49.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:49 smithi189 ceph-mon[34790]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:51.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:51 smithi193 ceph-mon[35248]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:51.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:51 smithi017 ceph-mon[30494]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:51.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:51 smithi189 ceph-mon[34790]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:52.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:53:52.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:52.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:52.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:53:52.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:52.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:52.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:53:52.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:52.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:53.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:53 smithi193 ceph-mon[35248]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:53.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:53 smithi017 ceph-mon[30494]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:53.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:53 smithi189 ceph-mon[34790]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:55.363 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:55 smithi193 ceph-mon[35248]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:55.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:55.397+0000 7f2a937fe640 1 -- 172.21.15.193:0/5507259 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f2a9c0fde20 con 0x7f2a880a10b0 2024-09-13T15:53:55.398 INFO:teuthology.orchestra.run.smithi193.stdout:Created osd(s) 11 on host 'smithi193' 2024-09-13T15:53:55.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:55.399+0000 7f2aa0e11640 1 -- 172.21.15.193:0/5507259 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2a880a10b0 msgr2=0x7f2a880a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:55.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:55.399+0000 7f2aa0e11640 1 --2- 172.21.15.193:0/5507259 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2a880a10b0 0x7f2a880a3570 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2a8402a930 tx=0x7f2a84005fd0 comp rx=0 tx=0).stop 2024-09-13T15:53:55.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:55.399+0000 7f2aa0e11640 1 -- 172.21.15.193:0/5507259 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a9c0fda40 msgr2=0x7f2a9c195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:55.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:55.399+0000 7f2aa0e11640 1 --2- 172.21.15.193:0/5507259 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a9c0fda40 0x7f2a9c195e60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00b450 tx=0x7f2a8c00b910 comp rx=0 tx=0).stop 2024-09-13T15:53:55.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:55.399+0000 7f2aa0e11640 1 -- 172.21.15.193:0/5507259 shutdown_connections 2024-09-13T15:53:55.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:55.399+0000 7f2aa0e11640 1 --2- 172.21.15.193:0/5507259 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2a880a10b0 0x7f2a880a3570 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:55.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:55.399+0000 7f2aa0e11640 1 --2- 172.21.15.193:0/5507259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a9c105ac0 0x7f2a9c19d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:55.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:55.399+0000 7f2aa0e11640 1 --2- 172.21.15.193:0/5507259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a9c0fe3f0 0x7f2a9c1963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:55.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:55.399+0000 7f2aa0e11640 1 --2- 172.21.15.193:0/5507259 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a9c0fda40 0x7f2a9c195e60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:55.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:55.399+0000 7f2aa0e11640 1 -- 172.21.15.193:0/5507259 >> 172.21.15.193:0/5507259 conn(0x7f2a9c0f97c0 msgr2=0x7f2a9c101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:55.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:55.399+0000 7f2aa0e11640 1 -- 172.21.15.193:0/5507259 shutdown_connections 2024-09-13T15:53:55.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:53:55.399+0000 7f2aa0e11640 1 -- 172.21.15.193:0/5507259 wait complete. 2024-09-13T15:53:55.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:55 smithi017 ceph-mon[30494]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:55.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:55 smithi189 ceph-mon[34790]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:56.046 DEBUG:teuthology.orchestra.run.smithi193:osd.11> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.11.service 2024-09-13T15:53:56.048 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-13T15:53:56.048 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T15:53:56.378 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:53:56.593 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:56 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:56.593 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:56 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:56.593 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:56 smithi193 ceph-mon[35248]: from='osd.11 [v2:172.21.15.193:6824/4088053907,v1:172.21.15.193:6825/4088053907]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T15:53:56.593 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:56 smithi193 ceph-mon[35248]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T15:53:56.593 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:56 smithi193 ceph-mon[35248]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:56.594 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:56 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:56.594 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:56 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:56.671 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:56 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:56.671 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:56 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:56.671 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:56 smithi189 ceph-mon[34790]: from='osd.11 [v2:172.21.15.193:6824/4088053907,v1:172.21.15.193:6825/4088053907]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T15:53:56.671 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:56 smithi189 ceph-mon[34790]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T15:53:56.671 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:56 smithi189 ceph-mon[34790]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:56.671 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:56 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:56.672 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:56 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:56.676 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:56 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:56.676 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:56 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:56.676 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:56 smithi017 ceph-mon[30494]: from='osd.11 [v2:172.21.15.193:6824/4088053907,v1:172.21.15.193:6825/4088053907]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T15:53:56.676 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:56 smithi017 ceph-mon[30494]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T15:53:56.676 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:56 smithi017 ceph-mon[30494]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:56.676 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:56 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:56.676 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:56 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:53:57.633 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:57 smithi193 ceph-mon[35248]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-13T15:53:57.633 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:57 smithi193 ceph-mon[35248]: osdmap e79: 12 total, 11 up, 12 in 2024-09-13T15:53:57.634 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:57 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T15:53:57.634 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:57 smithi193 ceph-mon[35248]: from='osd.11 [v2:172.21.15.193:6824/4088053907,v1:172.21.15.193:6825/4088053907]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:53:57.634 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:57 smithi193 ceph-mon[35248]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:53:57.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:57 smithi017 ceph-mon[30494]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-13T15:53:57.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:57 smithi017 ceph-mon[30494]: osdmap e79: 12 total, 11 up, 12 in 2024-09-13T15:53:57.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:57 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T15:53:57.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:57 smithi017 ceph-mon[30494]: from='osd.11 [v2:172.21.15.193:6824/4088053907,v1:172.21.15.193:6825/4088053907]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:53:57.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:57 smithi017 ceph-mon[30494]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:53:57.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:57 smithi189 ceph-mon[34790]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-13T15:53:57.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:57 smithi189 ceph-mon[34790]: osdmap e79: 12 total, 11 up, 12 in 2024-09-13T15:53:57.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:57 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T15:53:57.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:57 smithi189 ceph-mon[34790]: from='osd.11 [v2:172.21.15.193:6824/4088053907,v1:172.21.15.193:6825/4088053907]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:53:57.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:57 smithi189 ceph-mon[34790]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-13T15:53:58.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 15:53:58 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T15:53:58.136+0000 7fb69df87640 -1 osd.11 0 waiting for initial osdmap 2024-09-13T15:53:58.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 15:53:58 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T15:53:58.150+0000 7fb695da8640 -1 osd.11 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:53:58.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.528+0000 7f1fc7a00640 1 -- 172.21.15.17:0/2511490399 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1fc00ffe00 msgr2=0x7f1fc0100200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:58.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.528+0000 7f1fc7a00640 1 --2- 172.21.15.17:0/2511490399 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1fc00ffe00 0x7f1fc0100200 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009860 tx=0x7f1fb002a340 comp rx=0 tx=0).stop 2024-09-13T15:53:58.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.528+0000 7f1fc7a00640 1 -- 172.21.15.17:0/2511490399 shutdown_connections 2024-09-13T15:53:58.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.528+0000 7f1fc7a00640 1 --2- 172.21.15.17:0/2511490399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fc0101920 0x7f1fc0108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:58.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.528+0000 7f1fc7a00640 1 --2- 172.21.15.17:0/2511490399 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fc0100f60 0x7f1fc01013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:58.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.528+0000 7f1fc7a00640 1 --2- 172.21.15.17:0/2511490399 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1fc00ffe00 0x7f1fc0100200 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:58.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.528+0000 7f1fc7a00640 1 -- 172.21.15.17:0/2511490399 >> 172.21.15.17:0/2511490399 conn(0x7f1fc00fb590 msgr2=0x7f1fc00fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:58.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.528+0000 7f1fc7a00640 1 -- 172.21.15.17:0/2511490399 shutdown_connections 2024-09-13T15:53:58.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.528+0000 7f1fc7a00640 1 -- 172.21.15.17:0/2511490399 wait complete. 2024-09-13T15:53:58.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.529+0000 7f1fc7a00640 1 Processor -- start 2024-09-13T15:53:58.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.529+0000 7f1fc7a00640 1 -- start start 2024-09-13T15:53:58.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.529+0000 7f1fc7a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fc00ffe00 0x7f1fc0197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:58.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.529+0000 7f1fc7a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fc0100f60 0x7f1fc01984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:58.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.529+0000 7f1fc7a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1fc0101920 0x7f1fc019f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:58.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.529+0000 7f1fc7a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc019fab0 con 0x7f1fc0100f60 2024-09-13T15:53:58.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.529+0000 7f1fc7a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc019fc20 con 0x7f1fc00ffe00 2024-09-13T15:53:58.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.529+0000 7f1fc7a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc019fde0 con 0x7f1fc0101920 2024-09-13T15:53:58.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.530+0000 7f1fb7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fc0100f60 0x7f1fc01984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:58.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.530+0000 7f1fc5a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1fc0101920 0x7f1fc019f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:58.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.530+0000 7f1fb7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fc0100f60 0x7f1fc01984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43316/0 (socket says 172.21.15.17:43316) 2024-09-13T15:53:58.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.530+0000 7f1fb7e00640 1 -- 172.21.15.17:0/1320524022 learned_addr learned my addr 172.21.15.17:0/1320524022 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:53:58.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.530+0000 7f1fc5000640 1 --2- 172.21.15.17:0/1320524022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fc00ffe00 0x7f1fc0197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:58.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.530+0000 7f1fb7e00640 1 -- 172.21.15.17:0/1320524022 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1fc0101920 msgr2=0x7f1fc019f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:58.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.530+0000 7f1fb7e00640 1 --2- 172.21.15.17:0/1320524022 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1fc0101920 0x7f1fc019f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:58.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.530+0000 7f1fb7e00640 1 -- 172.21.15.17:0/1320524022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fc00ffe00 msgr2=0x7f1fc0197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:58.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.530+0000 7f1fb7e00640 1 --2- 172.21.15.17:0/1320524022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fc00ffe00 0x7f1fc0197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:58.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.530+0000 7f1fb7e00640 1 -- 172.21.15.17:0/1320524022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb0009490 con 0x7f1fc0100f60 2024-09-13T15:53:58.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.530+0000 7f1fb7e00640 1 --2- 172.21.15.17:0/1320524022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fc0100f60 0x7f1fc01984f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800e9c0 tx=0x7f1fa800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:58.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.531+0000 7f1fbe000640 1 -- 172.21.15.17:0/1320524022 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa80096e0 con 0x7f1fc0100f60 2024-09-13T15:53:58.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.531+0000 7f1fc7a00640 1 -- 172.21.15.17:0/1320524022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc01a00c0 con 0x7f1fc0100f60 2024-09-13T15:53:58.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.531+0000 7f1fbe000640 1 -- 172.21.15.17:0/1320524022 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1fa80044f0 con 0x7f1fc0100f60 2024-09-13T15:53:58.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.531+0000 7f1fbe000640 1 -- 172.21.15.17:0/1320524022 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8010430 con 0x7f1fc0100f60 2024-09-13T15:53:58.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.531+0000 7f1fc7a00640 1 -- 172.21.15.17:0/1320524022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc01a0570 con 0x7f1fc0100f60 2024-09-13T15:53:58.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.532+0000 7f1fc7a00640 1 -- 172.21.15.17:0/1320524022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc010b6f0 con 0x7f1fc0100f60 2024-09-13T15:53:58.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.534+0000 7f1fbe000640 1 -- 172.21.15.17:0/1320524022 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1fa80035f0 con 0x7f1fc0100f60 2024-09-13T15:53:58.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.535+0000 7f1fbe000640 1 --2- 172.21.15.17:0/1320524022 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1fa40a10b0 0x7f1fa40a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:58.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.535+0000 7f1fbe000640 1 -- 172.21.15.17:0/1320524022 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f1fa8014070 con 0x7f1fc0100f60 2024-09-13T15:53:58.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.536+0000 7f1fc5000640 1 --2- 172.21.15.17:0/1320524022 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1fa40a10b0 0x7f1fa40a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:58.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.536+0000 7f1fc5000640 1 --2- 172.21.15.17:0/1320524022 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1fa40a10b0 0x7f1fa40a3570 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009830 tx=0x7f1fb00305a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:58.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.538+0000 7f1fbe000640 1 -- 172.21.15.17:0/1320524022 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1fa8096460 con 0x7f1fc0100f60 2024-09-13T15:53:58.684 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:58 smithi193 ceph-mon[35248]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-13T15:53:58.685 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:58 smithi193 ceph-mon[35248]: osdmap e80: 12 total, 11 up, 12 in 2024-09-13T15:53:58.685 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:58 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T15:53:58.685 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:58 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T15:53:58.685 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:58 smithi193 ceph-mon[35248]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:58.685 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:58 smithi193 ceph-mon[35248]: from='osd.11 ' entity='osd.11' 2024-09-13T15:53:58.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.718+0000 7f1fc7a00640 1 -- 172.21.15.17:0/1320524022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f1fc010b880 con 0x7f1fc0100f60 2024-09-13T15:53:58.721 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:58 smithi017 ceph-mon[30494]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-13T15:53:58.721 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:58 smithi017 ceph-mon[30494]: osdmap e80: 12 total, 11 up, 12 in 2024-09-13T15:53:58.721 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:58 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T15:53:58.721 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:58 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T15:53:58.721 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:58 smithi017 ceph-mon[30494]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:58.721 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:58 smithi017 ceph-mon[30494]: from='osd.11 ' entity='osd.11' 2024-09-13T15:53:58.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.719+0000 7f1fbe000640 1 -- 172.21.15.17:0/1320524022 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) v1 ==== 74+0+133 (secure 0 0 0) 0x7f1fa8099a80 con 0x7f1fc0100f60 2024-09-13T15:53:58.721 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:53:58.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.721+0000 7f1fc7a00640 1 -- 172.21.15.17:0/1320524022 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1fa40a10b0 msgr2=0x7f1fa40a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:58.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.722+0000 7f1fc7a00640 1 --2- 172.21.15.17:0/1320524022 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1fa40a10b0 0x7f1fa40a3570 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009830 tx=0x7f1fb00305a0 comp rx=0 tx=0).stop 2024-09-13T15:53:58.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.722+0000 7f1fc7a00640 1 -- 172.21.15.17:0/1320524022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fc0100f60 msgr2=0x7f1fc01984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:58.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.722+0000 7f1fc7a00640 1 --2- 172.21.15.17:0/1320524022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fc0100f60 0x7f1fc01984f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800e9c0 tx=0x7f1fa800ee80 comp rx=0 tx=0).stop 2024-09-13T15:53:58.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.722+0000 7f1fc7a00640 1 -- 172.21.15.17:0/1320524022 shutdown_connections 2024-09-13T15:53:58.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.722+0000 7f1fc7a00640 1 --2- 172.21.15.17:0/1320524022 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1fa40a10b0 0x7f1fa40a3570 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:58.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.722+0000 7f1fc7a00640 1 --2- 172.21.15.17:0/1320524022 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1fc0101920 0x7f1fc019f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:58.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.722+0000 7f1fc7a00640 1 --2- 172.21.15.17:0/1320524022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fc0100f60 0x7f1fc01984f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:58.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.722+0000 7f1fc7a00640 1 --2- 172.21.15.17:0/1320524022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fc00ffe00 0x7f1fc0197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:58.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.722+0000 7f1fc7a00640 1 -- 172.21.15.17:0/1320524022 >> 172.21.15.17:0/1320524022 conn(0x7f1fc00fb590 msgr2=0x7f1fc0106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:58.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.722+0000 7f1fc7a00640 1 -- 172.21.15.17:0/1320524022 shutdown_connections 2024-09-13T15:53:58.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:53:58.722+0000 7f1fc7a00640 1 -- 172.21.15.17:0/1320524022 wait complete. 2024-09-13T15:53:58.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:58 smithi189 ceph-mon[34790]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-13T15:53:58.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:58 smithi189 ceph-mon[34790]: osdmap e80: 12 total, 11 up, 12 in 2024-09-13T15:53:58.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:58 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T15:53:58.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:58 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T15:53:58.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:58 smithi189 ceph-mon[34790]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-13T15:53:58.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:58 smithi189 ceph-mon[34790]: from='osd.11 ' entity='osd.11' 2024-09-13T15:53:59.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:59 smithi193 ceph-mon[35248]: purged_snaps scrub starts 2024-09-13T15:53:59.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:59 smithi193 ceph-mon[35248]: purged_snaps scrub ok 2024-09-13T15:53:59.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:59 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T15:53:59.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:59 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1320524022' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T15:53:59.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:59 smithi193 ceph-mon[35248]: osd.11 [v2:172.21.15.193:6824/4088053907,v1:172.21.15.193:6825/4088053907] boot 2024-09-13T15:53:59.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:59 smithi193 ceph-mon[35248]: osdmap e81: 12 total, 12 up, 12 in 2024-09-13T15:53:59.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:53:59 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T15:53:59.553 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":80,"num_osds":12,"num_up_osds":11,"osd_up_since":1726242814,"num_in_osds":12,"osd_in_since":1726242819,"num_remapped_pgs":0} 2024-09-13T15:53:59.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:59 smithi017 ceph-mon[30494]: purged_snaps scrub starts 2024-09-13T15:53:59.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:59 smithi017 ceph-mon[30494]: purged_snaps scrub ok 2024-09-13T15:53:59.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:59 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T15:53:59.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:59 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1320524022' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T15:53:59.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:59 smithi017 ceph-mon[30494]: osd.11 [v2:172.21.15.193:6824/4088053907,v1:172.21.15.193:6825/4088053907] boot 2024-09-13T15:53:59.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:59 smithi017 ceph-mon[30494]: osdmap e81: 12 total, 12 up, 12 in 2024-09-13T15:53:59.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:53:59 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T15:53:59.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:59 smithi189 ceph-mon[34790]: purged_snaps scrub starts 2024-09-13T15:53:59.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:59 smithi189 ceph-mon[34790]: purged_snaps scrub ok 2024-09-13T15:53:59.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:59 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T15:53:59.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:59 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1320524022' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T15:53:59.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:59 smithi189 ceph-mon[34790]: osd.11 [v2:172.21.15.193:6824/4088053907,v1:172.21.15.193:6825/4088053907] boot 2024-09-13T15:53:59.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:59 smithi189 ceph-mon[34790]: osdmap e81: 12 total, 12 up, 12 in 2024-09-13T15:53:59.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:53:59 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T15:54:00.555 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T15:54:00.876 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:54:01.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:00 smithi017 ceph-mon[30494]: Detected new or changed devices on smithi193 2024-09-13T15:54:01.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:01.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:01.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:54:01.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:54:01.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:54:01.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:54:01.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:00 smithi017 ceph-mon[30494]: Adjusting osd_memory_target on smithi193 to 4272M 2024-09-13T15:54:01.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:01.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:01.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:54:01.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:01.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:54:01.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:01.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:54:01.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:00 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:01.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:00 smithi017 ceph-mon[30494]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:01.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:00 smithi017 ceph-mon[30494]: osdmap e82: 12 total, 12 up, 12 in 2024-09-13T15:54:01.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:00 smithi189 ceph-mon[34790]: Detected new or changed devices on smithi193 2024-09-13T15:54:01.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:01.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:01.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:54:01.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:54:01.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:54:01.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:54:01.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:00 smithi189 ceph-mon[34790]: Adjusting osd_memory_target on smithi193 to 4272M 2024-09-13T15:54:01.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:01.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:01.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:54:01.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:01.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:54:01.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:01.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:54:01.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:00 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:01.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:00 smithi189 ceph-mon[34790]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:01.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:00 smithi189 ceph-mon[34790]: osdmap e82: 12 total, 12 up, 12 in 2024-09-13T15:54:01.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:00 smithi193 ceph-mon[35248]: Detected new or changed devices on smithi193 2024-09-13T15:54:01.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:01.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:01.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:54:01.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:54:01.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:54:01.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T15:54:01.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:00 smithi193 ceph-mon[35248]: Adjusting osd_memory_target on smithi193 to 4272M 2024-09-13T15:54:01.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:01.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:01.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:54:01.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:01.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:54:01.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:01.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:54:01.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:00 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:01.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:00 smithi193 ceph-mon[35248]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:01.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:00 smithi193 ceph-mon[35248]: osdmap e82: 12 total, 12 up, 12 in 2024-09-13T15:54:02.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.996+0000 7f64bfe00640 1 -- 172.21.15.17:0/2484835435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b8103bd0 msgr2=0x7f64b810a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:02.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.996+0000 7f64bfe00640 1 --2- 172.21.15.17:0/2484835435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b8103bd0 0x7f64b810a460 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f64b0009ca0 tx=0x7f64b002a8c0 comp rx=0 tx=0).stop 2024-09-13T15:54:02.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.996+0000 7f64bfe00640 1 -- 172.21.15.17:0/2484835435 shutdown_connections 2024-09-13T15:54:03.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.996+0000 7f64bfe00640 1 --2- 172.21.15.17:0/2484835435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b8103bd0 0x7f64b810a460 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:03.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.996+0000 7f64bfe00640 1 --2- 172.21.15.17:0/2484835435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64b8103210 0x7f64b8103690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:03.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.996+0000 7f64bfe00640 1 --2- 172.21.15.17:0/2484835435 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64b8102010 0x7f64b8102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:03.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.996+0000 7f64bfe00640 1 -- 172.21.15.17:0/2484835435 >> 172.21.15.17:0/2484835435 conn(0x7f64b80fd7a0 msgr2=0x7f64b80ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:03.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.996+0000 7f64bfe00640 1 -- 172.21.15.17:0/2484835435 shutdown_connections 2024-09-13T15:54:03.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.996+0000 7f64bfe00640 1 -- 172.21.15.17:0/2484835435 wait complete. 2024-09-13T15:54:03.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.997+0000 7f64bfe00640 1 Processor -- start 2024-09-13T15:54:03.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.997+0000 7f64bfe00640 1 -- start start 2024-09-13T15:54:03.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.997+0000 7f64bfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b8102010 0x7f64b8197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:03.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.997+0000 7f64bfe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64b8103210 0x7f64b8198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:03.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.997+0000 7f64bfe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64b8103bd0 0x7f64b819f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:03.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.997+0000 7f64bfe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b819f9e0 con 0x7f64b8102010 2024-09-13T15:54:03.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.997+0000 7f64bfe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b819fb50 con 0x7f64b8103bd0 2024-09-13T15:54:03.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.997+0000 7f64bfe00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b819fd10 con 0x7f64b8103210 2024-09-13T15:54:03.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.997+0000 7f64bd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b8102010 0x7f64b8197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:03.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.997+0000 7f64bd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b8102010 0x7f64b8197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48908/0 (socket says 172.21.15.17:48908) 2024-09-13T15:54:03.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.997+0000 7f64bd400640 1 -- 172.21.15.17:0/4083458779 learned_addr learned my addr 172.21.15.17:0/4083458779 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:03.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.998+0000 7f64bde00640 1 --2- 172.21.15.17:0/4083458779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64b8103bd0 0x7f64b819f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:03.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.998+0000 7f64bca00640 1 --2- 172.21.15.17:0/4083458779 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64b8103210 0x7f64b8198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:03.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.998+0000 7f64bd400640 1 -- 172.21.15.17:0/4083458779 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64b8103210 msgr2=0x7f64b8198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:03.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.998+0000 7f64bd400640 1 --2- 172.21.15.17:0/4083458779 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64b8103210 0x7f64b8198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:03.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.998+0000 7f64bd400640 1 -- 172.21.15.17:0/4083458779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64b8103bd0 msgr2=0x7f64b819f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:03.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.998+0000 7f64bd400640 1 --2- 172.21.15.17:0/4083458779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64b8103bd0 0x7f64b819f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:03.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.998+0000 7f64bd400640 1 -- 172.21.15.17:0/4083458779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a4009490 con 0x7f64b8102010 2024-09-13T15:54:03.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.998+0000 7f64bd400640 1 --2- 172.21.15.17:0/4083458779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b8102010 0x7f64b8197ee0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f64ac00e9c0 tx=0x7f64ac00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:03.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.998+0000 7f64b6000640 1 -- 172.21.15.17:0/4083458779 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac0096e0 con 0x7f64b8102010 2024-09-13T15:54:03.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.998+0000 7f64b6000640 1 -- 172.21.15.17:0/4083458779 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f64ac0044f0 con 0x7f64b8102010 2024-09-13T15:54:03.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.998+0000 7f64bfe00640 1 -- 172.21.15.17:0/4083458779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b0009900 con 0x7f64b8102010 2024-09-13T15:54:03.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.999+0000 7f64b6000640 1 -- 172.21.15.17:0/4083458779 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac010430 con 0x7f64b8102010 2024-09-13T15:54:03.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:02.999+0000 7f64bfe00640 1 -- 172.21.15.17:0/4083458779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b81a0220 con 0x7f64b8102010 2024-09-13T15:54:03.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:03.000+0000 7f64bfe00640 1 -- 172.21.15.17:0/4083458779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b8102410 con 0x7f64b8102010 2024-09-13T15:54:03.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:03.003+0000 7f64b6000640 1 -- 172.21.15.17:0/4083458779 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f64ac0035f0 con 0x7f64b8102010 2024-09-13T15:54:03.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:03.005+0000 7f64b6000640 1 --2- 172.21.15.17:0/4083458779 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f64a00a10b0 0x7f64a00a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:03.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:03.005+0000 7f64b6000640 1 -- 172.21.15.17:0/4083458779 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f64ac014070 con 0x7f64b8102010 2024-09-13T15:54:03.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:03.005+0000 7f64bca00640 1 --2- 172.21.15.17:0/4083458779 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f64a00a10b0 0x7f64a00a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:03.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:03.005+0000 7f64bca00640 1 --2- 172.21.15.17:0/4083458779 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f64a00a10b0 0x7f64a00a3570 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f64b8199400 tx=0x7f64a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:03.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:03.007+0000 7f64b6000640 1 -- 172.21.15.17:0/4083458779 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f64ac096420 con 0x7f64b8102010 2024-09-13T15:54:03.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:03.190+0000 7f64bfe00640 1 -- 172.21.15.17:0/4083458779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f64b81094b0 con 0x7f64b8102010 2024-09-13T15:54:03.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:03.190+0000 7f64b6000640 1 -- 172.21.15.17:0/4083458779 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v82) v1 ==== 74+0+133 (secure 0 0 0) 0x7f64ac099a40 con 0x7f64b8102010 2024-09-13T15:54:03.193 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:03.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:03.193+0000 7f64bfe00640 1 -- 172.21.15.17:0/4083458779 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f64a00a10b0 msgr2=0x7f64a00a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:03.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:03.193+0000 7f64bfe00640 1 --2- 172.21.15.17:0/4083458779 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f64a00a10b0 0x7f64a00a3570 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f64b8199400 tx=0x7f64a4005f90 comp rx=0 tx=0).stop 2024-09-13T15:54:03.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:03.193+0000 7f64bfe00640 1 -- 172.21.15.17:0/4083458779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b8102010 msgr2=0x7f64b8197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:03.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:03.193+0000 7f64bfe00640 1 --2- 172.21.15.17:0/4083458779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b8102010 0x7f64b8197ee0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f64ac00e9c0 tx=0x7f64ac00ee80 comp rx=0 tx=0).stop 2024-09-13T15:54:03.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:03.193+0000 7f64bfe00640 1 -- 172.21.15.17:0/4083458779 shutdown_connections 2024-09-13T15:54:03.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:03.193+0000 7f64bfe00640 1 --2- 172.21.15.17:0/4083458779 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f64a00a10b0 0x7f64a00a3570 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:03.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:03.193+0000 7f64bfe00640 1 --2- 172.21.15.17:0/4083458779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64b8103bd0 0x7f64b819f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:03.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:03.193+0000 7f64bfe00640 1 --2- 172.21.15.17:0/4083458779 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64b8103210 0x7f64b8198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:03.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:03.193+0000 7f64bfe00640 1 --2- 172.21.15.17:0/4083458779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b8102010 0x7f64b8197ee0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:03.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:03.193+0000 7f64bfe00640 1 -- 172.21.15.17:0/4083458779 >> 172.21.15.17:0/4083458779 conn(0x7f64b80fd7a0 msgr2=0x7f64b8106680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:03.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:03.193+0000 7f64bfe00640 1 -- 172.21.15.17:0/4083458779 shutdown_connections 2024-09-13T15:54:03.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:03.193+0000 7f64bfe00640 1 -- 172.21.15.17:0/4083458779 wait complete. 2024-09-13T15:54:03.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:03 smithi193 ceph-mon[35248]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:03.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:03 smithi017 ceph-mon[30494]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:03.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:03 smithi189 ceph-mon[34790]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:04.025 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":82,"num_osds":12,"num_up_osds":12,"osd_up_since":1726242839,"num_in_osds":12,"osd_in_since":1726242819,"num_remapped_pgs":0} 2024-09-13T15:54:04.026 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T15:54:04.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:04 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/4083458779' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T15:54:04.344 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:54:04.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:04 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/4083458779' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T15:54:04.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:04 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/4083458779' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T15:54:05.445 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:05 smithi017 ceph-mon[30494]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:05.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:05 smithi193 ceph-mon[35248]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:05.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:05 smithi189 ceph-mon[34790]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:06.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.364+0000 7f5d2ac00640 1 -- 172.21.15.17:0/3478479667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d241009a0 msgr2=0x7f5d241049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:06.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.364+0000 7f5d2ac00640 1 --2- 172.21.15.17:0/3478479667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d241009a0 0x7f5d241049f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c009930 tx=0x7f5d0c02a420 comp rx=0 tx=0).stop 2024-09-13T15:54:06.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.364+0000 7f5d2ac00640 1 -- 172.21.15.17:0/3478479667 shutdown_connections 2024-09-13T15:54:06.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.364+0000 7f5d2ac00640 1 --2- 172.21.15.17:0/3478479667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d24105120 0x7f5d2410cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:06.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.364+0000 7f5d2ac00640 1 --2- 172.21.15.17:0/3478479667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d241009a0 0x7f5d241049f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:06.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.364+0000 7f5d2ac00640 1 --2- 172.21.15.17:0/3478479667 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d240ffff0 0x7f5d241003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:06.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.364+0000 7f5d2ac00640 1 -- 172.21.15.17:0/3478479667 >> 172.21.15.17:0/3478479667 conn(0x7f5d240fba90 msgr2=0x7f5d240fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:06.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.364+0000 7f5d2ac00640 1 -- 172.21.15.17:0/3478479667 shutdown_connections 2024-09-13T15:54:06.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.364+0000 7f5d2ac00640 1 -- 172.21.15.17:0/3478479667 wait complete. 2024-09-13T15:54:06.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.365+0000 7f5d2ac00640 1 Processor -- start 2024-09-13T15:54:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.365+0000 7f5d2ac00640 1 -- start start 2024-09-13T15:54:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.365+0000 7f5d2ac00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d240ffff0 0x7f5d24198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.366+0000 7f5d2ac00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d241009a0 0x7f5d241989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.366+0000 7f5d2ac00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d24105120 0x7f5d2419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.366+0000 7f5d2ac00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2419d330 con 0x7f5d24105120 2024-09-13T15:54:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.366+0000 7f5d2ac00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2419d4a0 con 0x7f5d241009a0 2024-09-13T15:54:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.366+0000 7f5d2ac00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2419d610 con 0x7f5d240ffff0 2024-09-13T15:54:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.366+0000 7f5d28c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d24105120 0x7f5d2419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.366+0000 7f5d23e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d240ffff0 0x7f5d24198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.366+0000 7f5d1b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d241009a0 0x7f5d241989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.366+0000 7f5d28c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d24105120 0x7f5d2419cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48916/0 (socket says 172.21.15.17:48916) 2024-09-13T15:54:06.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.366+0000 7f5d23e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d240ffff0 0x7f5d24198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:38552/0 (socket says 172.21.15.17:38552) 2024-09-13T15:54:06.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.366+0000 7f5d28c00640 1 -- 172.21.15.17:0/425904120 learned_addr learned my addr 172.21.15.17:0/425904120 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:06.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.366+0000 7f5d23e00640 1 -- 172.21.15.17:0/425904120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d241009a0 msgr2=0x7f5d241989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:06.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.366+0000 7f5d23e00640 1 --2- 172.21.15.17:0/425904120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d241009a0 0x7f5d241989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:06.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.366+0000 7f5d23e00640 1 -- 172.21.15.17:0/425904120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d24105120 msgr2=0x7f5d2419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:06.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.366+0000 7f5d23e00640 1 --2- 172.21.15.17:0/425904120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d24105120 0x7f5d2419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:06.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.366+0000 7f5d23e00640 1 -- 172.21.15.17:0/425904120 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0c009560 con 0x7f5d240ffff0 2024-09-13T15:54:06.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.366+0000 7f5d28c00640 1 --2- 172.21.15.17:0/425904120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d24105120 0x7f5d2419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:54:06.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.367+0000 7f5d23e00640 1 --2- 172.21.15.17:0/425904120 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d240ffff0 0x7f5d24198460 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5d1400d6d0 tx=0x7f5d1400db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:06.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.367+0000 7f5d21600640 1 -- 172.21.15.17:0/425904120 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d14005220 con 0x7f5d240ffff0 2024-09-13T15:54:06.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.367+0000 7f5d21600640 1 -- 172.21.15.17:0/425904120 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d14009ce0 con 0x7f5d240ffff0 2024-09-13T15:54:06.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.367+0000 7f5d2ac00640 1 -- 172.21.15.17:0/425904120 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d2419d8f0 con 0x7f5d240ffff0 2024-09-13T15:54:06.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.367+0000 7f5d21600640 1 -- 172.21.15.17:0/425904120 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d14004d90 con 0x7f5d240ffff0 2024-09-13T15:54:06.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.367+0000 7f5d2ac00640 1 -- 172.21.15.17:0/425904120 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d241a51b0 con 0x7f5d240ffff0 2024-09-13T15:54:06.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.368+0000 7f5d2ac00640 1 -- 172.21.15.17:0/425904120 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d241014d0 con 0x7f5d240ffff0 2024-09-13T15:54:06.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.370+0000 7f5d21600640 1 -- 172.21.15.17:0/425904120 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5d14005480 con 0x7f5d240ffff0 2024-09-13T15:54:06.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.371+0000 7f5d21600640 1 --2- 172.21.15.17:0/425904120 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5d080a1080 0x7f5d080a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:06.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.371+0000 7f5d21600640 1 -- 172.21.15.17:0/425904120 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5d140cbf40 con 0x7f5d240ffff0 2024-09-13T15:54:06.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.372+0000 7f5d1b400640 1 --2- 172.21.15.17:0/425904120 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5d080a1080 0x7f5d080a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:06.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.372+0000 7f5d1b400640 1 --2- 172.21.15.17:0/425904120 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5d080a1080 0x7f5d080a3540 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c005940 tx=0x7f5d0c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:06.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.373+0000 7f5d21600640 1 -- 172.21.15.17:0/425904120 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5d14095b80 con 0x7f5d240ffff0 2024-09-13T15:54:06.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.554+0000 7f5d2ac00640 1 -- 172.21.15.17:0/425904120 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d241003d0 con 0x7f5d240ffff0 2024-09-13T15:54:06.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.556+0000 7f5d21600640 1 -- 172.21.15.17:0/425904120 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18397 (secure 0 0 0) 0x7f5d14020090 con 0x7f5d240ffff0 2024-09-13T15:54:06.558 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:06.559 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":82,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","created":"2024-09-13T15:46:50.475750+0000","modified":"2024-09-13T15:54:00.415572+0000","last_up_change":"2024-09-13T15:53:59.138985+0000","last_in_change":"2024-09-13T15:53:39.220264+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:50:10.657011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5d39d6af-15e6-463b-b9ff-a9a5dd94e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6803","nonce":158651212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6805","nonce":158651212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6809","nonce":158651212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6807","nonce":158651212}]},"public_addr":"172.21.15.17:6803/158651212","cluster_addr":"172.21.15.17:6805/158651212","heartbeat_back_addr":"172.21.15.17:6809/158651212","heartbeat_front_addr":"172.21.15.17:6807/158651212","state":["exists","up"]},{"osd":1,"uuid":"0da621c7-645b-44ae-ba7c-a573861c3aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6801","nonce":964319421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6803","nonce":964319421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6807","nonce":964319421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6805","nonce":964319421}]},"public_addr":"172.21.15.189:6801/964319421","cluster_addr":"172.21.15.189:6803/964319421","heartbeat_back_addr":"172.21.15.189:6807/964319421","heartbeat_front_addr":"172.21.15.189:6805/964319421","state":["exists","up"]},{"osd":2,"uuid":"fa95af60-1486-4a29-8c79-8a73a4146552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6801","nonce":138468002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6803","nonce":138468002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6807","nonce":138468002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6805","nonce":138468002}]},"public_addr":"172.21.15.193:6801/138468002","cluster_addr":"172.21.15.193:6803/138468002","heartbeat_back_addr":"172.21.15.193:6807/138468002","heartbeat_front_addr":"172.21.15.193:6805/138468002","state":["exists","up"]},{"osd":3,"uuid":"90428e5f-dfd4-4cda-b240-fdb9079bcb7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6811","nonce":919913803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6813","nonce":919913803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6817","nonce":919913803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6815","nonce":919913803}]},"public_addr":"172.21.15.17:6811/919913803","cluster_addr":"172.21.15.17:6813/919913803","heartbeat_back_addr":"172.21.15.17:6817/919913803","heartbeat_front_addr":"172.21.15.17:6815/919913803","state":["exists","up"]},{"osd":4,"uuid":"e1c537b6-98d2-4b66-b15a-65fe70b0ce25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6809","nonce":2310375565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6811","nonce":2310375565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6815","nonce":2310375565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6813","nonce":2310375565}]},"public_addr":"172.21.15.189:6809/2310375565","cluster_addr":"172.21.15.189:6811/2310375565","heartbeat_back_addr":"172.21.15.189:6815/2310375565","heartbeat_front_addr":"172.21.15.189:6813/2310375565","state":["exists","up"]},{"osd":5,"uuid":"48522fd7-d781-4447-873f-174dabd1e33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6809","nonce":1330877824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6811","nonce":1330877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6815","nonce":1330877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6813","nonce":1330877824}]},"public_addr":"172.21.15.193:6809/1330877824","cluster_addr":"172.21.15.193:6811/1330877824","heartbeat_back_addr":"172.21.15.193:6815/1330877824","heartbeat_front_addr":"172.21.15.193:6813/1330877824","state":["exists","up"]},{"osd":6,"uuid":"47bea191-fb53-40a7-8563-8ebf17dd5bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6819","nonce":3930545382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6821","nonce":3930545382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6825","nonce":3930545382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6823","nonce":3930545382}]},"public_addr":"172.21.15.17:6819/3930545382","cluster_addr":"172.21.15.17:6821/3930545382","heartbeat_back_addr":"172.21.15.17:6825/3930545382","heartbeat_front_addr":"172.21.15.17:6823/3930545382","state":["exists","up"]},{"osd":7,"uuid":"a98f36f9-0a19-4c9a-8ed1-615c4a6e7658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6817","nonce":3691677495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6819","nonce":3691677495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6823","nonce":3691677495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6821","nonce":3691677495}]},"public_addr":"172.21.15.189:6817/3691677495","cluster_addr":"172.21.15.189:6819/3691677495","heartbeat_back_addr":"172.21.15.189:6823/3691677495","heartbeat_front_addr":"172.21.15.189:6821/3691677495","state":["exists","up"]},{"osd":8,"uuid":"7a372d9f-c40f-4ead-87da-2f3a570c1373","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6817","nonce":4112907498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6819","nonce":4112907498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6823","nonce":4112907498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6821","nonce":4112907498}]},"public_addr":"172.21.15.193:6817/4112907498","cluster_addr":"172.21.15.193:6819/4112907498","heartbeat_back_addr":"172.21.15.193:6823/4112907498","heartbeat_front_addr":"172.21.15.193:6821/4112907498","state":["exists","up"]},{"osd":9,"uuid":"ac3d983c-c5e7-456b-8271-7c4e6169de61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6827","nonce":663424274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6829","nonce":663424274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6833","nonce":663424274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6831","nonce":663424274}]},"public_addr":"172.21.15.17:6827/663424274","cluster_addr":"172.21.15.17:6829/663424274","heartbeat_back_addr":"172.21.15.17:6833/663424274","heartbeat_front_addr":"172.21.15.17:6831/663424274","state":["exists","up"]},{"osd":10,"uuid":"08dcae02-6c79-4a06-ae88-6eb6e6941cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6825","nonce":3153990375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6827","nonce":3153990375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6831","nonce":3153990375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6829","nonce":3153990375}]},"public_addr":"172.21.15.189:6825/3153990375","cluster_addr":"172.21.15.189:6827/3153990375","heartbeat_back_addr":"172.21.15.189:6831/3153990375","heartbeat_front_addr":"172.21.15.189:6829/3153990375","state":["exists","up"]},{"osd":11,"uuid":"a4ebcf41-d805-4d44-b112-13ae84d51868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6825","nonce":4088053907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6827","nonce":4088053907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6831","nonce":4088053907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6829","nonce":4088053907}]},"public_addr":"172.21.15.193:6825/4088053907","cluster_addr":"172.21.15.193:6827/4088053907","heartbeat_back_addr":"172.21.15.193:6831/4088053907","heartbeat_front_addr":"172.21.15.193:6829/4088053907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:22.172370+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:44.802224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:06.641435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:34.536515+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:58.789324+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:22.189862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:50.382257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:14.678047+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:38.581105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:07.258150+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:32.261383+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:56.739338+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/1550067038":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/3360683829":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/634066188":"2024-09-14T15:47:42.048005+0000","172.21.15.17:6801/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1945536687":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/2214214377":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1224386591":"2024-09-14T15:47:14.996424+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:54:06.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.558+0000 7f5d2ac00640 1 -- 172.21.15.17:0/425904120 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5d080a1080 msgr2=0x7f5d080a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:06.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.558+0000 7f5d2ac00640 1 --2- 172.21.15.17:0/425904120 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5d080a1080 0x7f5d080a3540 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c005940 tx=0x7f5d0c0058d0 comp rx=0 tx=0).stop 2024-09-13T15:54:06.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.558+0000 7f5d2ac00640 1 -- 172.21.15.17:0/425904120 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d240ffff0 msgr2=0x7f5d24198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:06.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.558+0000 7f5d2ac00640 1 --2- 172.21.15.17:0/425904120 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d240ffff0 0x7f5d24198460 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5d1400d6d0 tx=0x7f5d1400db90 comp rx=0 tx=0).stop 2024-09-13T15:54:06.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.558+0000 7f5d2ac00640 1 -- 172.21.15.17:0/425904120 shutdown_connections 2024-09-13T15:54:06.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.558+0000 7f5d2ac00640 1 --2- 172.21.15.17:0/425904120 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5d080a1080 0x7f5d080a3540 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:06.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.558+0000 7f5d2ac00640 1 --2- 172.21.15.17:0/425904120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d24105120 0x7f5d2419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:06.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.558+0000 7f5d2ac00640 1 --2- 172.21.15.17:0/425904120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d241009a0 0x7f5d241989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:06.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.558+0000 7f5d2ac00640 1 --2- 172.21.15.17:0/425904120 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d240ffff0 0x7f5d24198460 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:06.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.558+0000 7f5d2ac00640 1 -- 172.21.15.17:0/425904120 >> 172.21.15.17:0/425904120 conn(0x7f5d240fba90 msgr2=0x7f5d240fbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:06.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.558+0000 7f5d2ac00640 1 -- 172.21.15.17:0/425904120 shutdown_connections 2024-09-13T15:54:06.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:06.558+0000 7f5d2ac00640 1 -- 172.21.15.17:0/425904120 wait complete. 2024-09-13T15:54:07.381 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:50:10.657011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:54:07.382 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-13T15:54:07.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:07 smithi193 ceph-mon[35248]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:07.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:07 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/425904120' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:54:07.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:07 smithi017 ceph-mon[30494]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:07.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:07 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/425904120' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:54:07.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:07 smithi189 ceph-mon[34790]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:07.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:07 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/425904120' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:54:07.695 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:54:09.468 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:09 smithi017 ceph-mon[30494]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:09.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:09 smithi193 ceph-mon[35248]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:09.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:09 smithi189 ceph-mon[34790]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:09.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.726+0000 7ff6e6e00640 1 -- 172.21.15.17:0/744454997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6e0102bb0 msgr2=0x7ff6e0106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:09.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.726+0000 7ff6e6e00640 1 --2- 172.21.15.17:0/744454997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6e0102bb0 0x7ff6e0106c00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009930 tx=0x7ff6cc02a420 comp rx=0 tx=0).stop 2024-09-13T15:54:09.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.726+0000 7ff6e6e00640 1 -- 172.21.15.17:0/744454997 shutdown_connections 2024-09-13T15:54:09.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.726+0000 7ff6e6e00640 1 --2- 172.21.15.17:0/744454997 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6e0107330 0x7ff6e010eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:09.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.726+0000 7ff6e6e00640 1 --2- 172.21.15.17:0/744454997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6e0102bb0 0x7ff6e0106c00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:09.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.726+0000 7ff6e6e00640 1 --2- 172.21.15.17:0/744454997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6e0102200 0x7ff6e01025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:09.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.726+0000 7ff6e6e00640 1 -- 172.21.15.17:0/744454997 >> 172.21.15.17:0/744454997 conn(0x7ff6e00fdc60 msgr2=0x7ff6e0100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:09.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.726+0000 7ff6e6e00640 1 -- 172.21.15.17:0/744454997 shutdown_connections 2024-09-13T15:54:09.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.726+0000 7ff6e6e00640 1 -- 172.21.15.17:0/744454997 wait complete. 2024-09-13T15:54:09.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.727+0000 7ff6e6e00640 1 Processor -- start 2024-09-13T15:54:09.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.727+0000 7ff6e6e00640 1 -- start start 2024-09-13T15:54:09.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.728+0000 7ff6e6e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6e0102200 0x7ff6e0198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:09.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.728+0000 7ff6e6e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6e0102bb0 0x7ff6e0198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:09.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.728+0000 7ff6e6e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6e0107330 0x7ff6e019ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:09.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.728+0000 7ff6e6e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e019d440 con 0x7ff6e0107330 2024-09-13T15:54:09.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.728+0000 7ff6e6e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e019d5b0 con 0x7ff6e0102bb0 2024-09-13T15:54:09.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.728+0000 7ff6e6e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e019d720 con 0x7ff6e0102200 2024-09-13T15:54:09.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.728+0000 7ff6df400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6e0102bb0 0x7ff6e0198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:09.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.728+0000 7ff6e4e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6e0107330 0x7ff6e019ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:09.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.728+0000 7ff6df400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6e0102bb0 0x7ff6e0198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:49372/0 (socket says 172.21.15.17:49372) 2024-09-13T15:54:09.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.728+0000 7ff6df400640 1 -- 172.21.15.17:0/3341976233 learned_addr learned my addr 172.21.15.17:0/3341976233 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:09.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.728+0000 7ff6dfe00640 1 --2- 172.21.15.17:0/3341976233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6e0102200 0x7ff6e0198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:09.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.729+0000 7ff6df400640 1 -- 172.21.15.17:0/3341976233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6e0102200 msgr2=0x7ff6e0198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:09.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.729+0000 7ff6df400640 1 --2- 172.21.15.17:0/3341976233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6e0102200 0x7ff6e0198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:09.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.729+0000 7ff6df400640 1 -- 172.21.15.17:0/3341976233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6e0107330 msgr2=0x7ff6e019ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:09.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.729+0000 7ff6df400640 1 --2- 172.21.15.17:0/3341976233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6e0107330 0x7ff6e019ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:09.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.729+0000 7ff6df400640 1 -- 172.21.15.17:0/3341976233 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc009560 con 0x7ff6e0102bb0 2024-09-13T15:54:09.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.729+0000 7ff6df400640 1 --2- 172.21.15.17:0/3341976233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6e0102bb0 0x7ff6e0198a40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc005ab0 tx=0x7ff6cc003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:09.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.729+0000 7ff6dcc00640 1 -- 172.21.15.17:0/3341976233 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc005d50 con 0x7ff6e0102bb0 2024-09-13T15:54:09.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.729+0000 7ff6e6e00640 1 -- 172.21.15.17:0/3341976233 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e019d9a0 con 0x7ff6e0102bb0 2024-09-13T15:54:09.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.729+0000 7ff6dcc00640 1 -- 172.21.15.17:0/3341976233 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6cc003e00 con 0x7ff6e0102bb0 2024-09-13T15:54:09.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.729+0000 7ff6dcc00640 1 -- 172.21.15.17:0/3341976233 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc03bac0 con 0x7ff6e0102bb0 2024-09-13T15:54:09.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.730+0000 7ff6e6e00640 1 -- 172.21.15.17:0/3341976233 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e019dcc0 con 0x7ff6e0102bb0 2024-09-13T15:54:09.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.731+0000 7ff6e6e00640 1 -- 172.21.15.17:0/3341976233 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e01036e0 con 0x7ff6e0102bb0 2024-09-13T15:54:09.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.733+0000 7ff6dcc00640 1 -- 172.21.15.17:0/3341976233 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff6cc03bc40 con 0x7ff6e0102bb0 2024-09-13T15:54:09.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.734+0000 7ff6dcc00640 1 --2- 172.21.15.17:0/3341976233 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff6c40a1100 0x7ff6c40a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:09.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.734+0000 7ff6dcc00640 1 -- 172.21.15.17:0/3341976233 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff6cc0ecbd0 con 0x7ff6e0102bb0 2024-09-13T15:54:09.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.734+0000 7ff6dfe00640 1 --2- 172.21.15.17:0/3341976233 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff6c40a1100 0x7ff6c40a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:09.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.735+0000 7ff6dfe00640 1 --2- 172.21.15.17:0/3341976233 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff6c40a1100 0x7ff6c40a35c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009bd0 tx=0x7ff6d0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:09.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.736+0000 7ff6dcc00640 1 -- 172.21.15.17:0/3341976233 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff6cc0b6810 con 0x7ff6e0102bb0 2024-09-13T15:54:09.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.918+0000 7ff6e6e00640 1 -- 172.21.15.17:0/3341976233 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff6e0199860 con 0x7ff6e0102bb0 2024-09-13T15:54:09.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.919+0000 7ff6dcc00640 1 -- 172.21.15.17:0/3341976233 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6cc035020 con 0x7ff6e0102bb0 2024-09-13T15:54:09.921 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-13T15:54:09.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.921+0000 7ff6e6e00640 1 -- 172.21.15.17:0/3341976233 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff6c40a1100 msgr2=0x7ff6c40a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:09.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.921+0000 7ff6e6e00640 1 --2- 172.21.15.17:0/3341976233 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff6c40a1100 0x7ff6c40a35c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009bd0 tx=0x7ff6d0005f90 comp rx=0 tx=0).stop 2024-09-13T15:54:09.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.921+0000 7ff6e6e00640 1 -- 172.21.15.17:0/3341976233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6e0102bb0 msgr2=0x7ff6e0198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:09.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.921+0000 7ff6e6e00640 1 --2- 172.21.15.17:0/3341976233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6e0102bb0 0x7ff6e0198a40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc005ab0 tx=0x7ff6cc003c10 comp rx=0 tx=0).stop 2024-09-13T15:54:09.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.921+0000 7ff6e6e00640 1 -- 172.21.15.17:0/3341976233 shutdown_connections 2024-09-13T15:54:09.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.921+0000 7ff6e6e00640 1 --2- 172.21.15.17:0/3341976233 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff6c40a1100 0x7ff6c40a35c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:09.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.921+0000 7ff6e6e00640 1 --2- 172.21.15.17:0/3341976233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6e0107330 0x7ff6e019ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:09.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.921+0000 7ff6e6e00640 1 --2- 172.21.15.17:0/3341976233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6e0102bb0 0x7ff6e0198a40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:09.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.921+0000 7ff6e6e00640 1 --2- 172.21.15.17:0/3341976233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6e0102200 0x7ff6e0198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:09.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.921+0000 7ff6e6e00640 1 -- 172.21.15.17:0/3341976233 >> 172.21.15.17:0/3341976233 conn(0x7ff6e00fdc60 msgr2=0x7ff6e00ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:09.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.921+0000 7ff6e6e00640 1 -- 172.21.15.17:0/3341976233 shutdown_connections 2024-09-13T15:54:09.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:09.921+0000 7ff6e6e00640 1 -- 172.21.15.17:0/3341976233 wait complete. 2024-09-13T15:54:10.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:10 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3341976233' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:54:10.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:10 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3341976233' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:54:10.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:10 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3341976233' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:54:10.816 INFO:tasks.cephadm:Adding mds.a on smithi017 2024-09-13T15:54:10.816 INFO:tasks.cephadm:Adding mds.d on smithi017 2024-09-13T15:54:10.816 INFO:tasks.cephadm:Adding mds.g on smithi017 2024-09-13T15:54:10.816 INFO:tasks.cephadm:Adding mds.j on smithi017 2024-09-13T15:54:10.816 INFO:tasks.cephadm:Adding mds.b on smithi189 2024-09-13T15:54:10.816 INFO:tasks.cephadm:Adding mds.e on smithi189 2024-09-13T15:54:10.816 INFO:tasks.cephadm:Adding mds.h on smithi189 2024-09-13T15:54:10.816 INFO:tasks.cephadm:Adding mds.k on smithi189 2024-09-13T15:54:10.816 INFO:tasks.cephadm:Adding mds.c on smithi193 2024-09-13T15:54:10.816 INFO:tasks.cephadm:Adding mds.f on smithi193 2024-09-13T15:54:10.816 INFO:tasks.cephadm:Adding mds.i on smithi193 2024-09-13T15:54:10.817 INFO:tasks.cephadm:Adding mds.l on smithi193 2024-09-13T15:54:10.817 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi189=b;smithi189=e;smithi189=h;smithi189=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l' 2024-09-13T15:54:11.030 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T15:54:11.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:11 smithi193 ceph-mon[35248]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:11.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:11 smithi017 ceph-mon[30494]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:11.610 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:11 smithi189 ceph-mon[34790]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:12.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.723+0000 7fb30d793640 1 -- 172.21.15.193:0/1343556263 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb3080fecf0 msgr2=0x7fb3080ff0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:12.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.723+0000 7fb30d793640 1 --2- 172.21.15.193:0/1343556263 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb3080fecf0 0x7fb3080ff0f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8009900 tx=0x7fb2f802a410 comp rx=0 tx=0).stop 2024-09-13T15:54:12.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.723+0000 7fb30d793640 1 -- 172.21.15.193:0/1343556263 shutdown_connections 2024-09-13T15:54:12.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.723+0000 7fb30d793640 1 --2- 172.21.15.193:0/1343556263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3081008b0 0x7fb308107140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:12.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.723+0000 7fb30d793640 1 --2- 172.21.15.193:0/1343556263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3080ffef0 0x7fb308100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:12.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.723+0000 7fb30d793640 1 --2- 172.21.15.193:0/1343556263 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb3080fecf0 0x7fb3080ff0f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:12.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.723+0000 7fb30d793640 1 -- 172.21.15.193:0/1343556263 >> 172.21.15.193:0/1343556263 conn(0x7fb3080fa480 msgr2=0x7fb3080fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:12.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.723+0000 7fb30d793640 1 -- 172.21.15.193:0/1343556263 shutdown_connections 2024-09-13T15:54:12.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.723+0000 7fb30d793640 1 -- 172.21.15.193:0/1343556263 wait complete. 2024-09-13T15:54:12.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.724+0000 7fb30d793640 1 Processor -- start 2024-09-13T15:54:12.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.724+0000 7fb30d793640 1 -- start start 2024-09-13T15:54:12.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.724+0000 7fb30d793640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb3080fecf0 0x7fb308069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:12.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.724+0000 7fb30d793640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3080ffef0 0x7fb30819ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:12.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.724+0000 7fb30d793640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3081008b0 0x7fb30819d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:12.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.724+0000 7fb30d793640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30819da00 con 0x7fb3080ffef0 2024-09-13T15:54:12.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.724+0000 7fb30d793640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30819db70 con 0x7fb3081008b0 2024-09-13T15:54:12.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.724+0000 7fb30d793640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30819dd30 con 0x7fb3080fecf0 2024-09-13T15:54:12.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.724+0000 7fb306ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb3080fecf0 0x7fb308069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:12.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.724+0000 7fb306ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb3080fecf0 0x7fb308069280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:57894/0 (socket says 172.21.15.193:57894) 2024-09-13T15:54:12.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.724+0000 7fb306ffd640 1 -- 172.21.15.193:0/982769849 learned_addr learned my addr 172.21.15.193:0/982769849 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-13T15:54:12.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.724+0000 7fb3077fe640 1 --2- 172.21.15.193:0/982769849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3081008b0 0x7fb30819d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:12.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.725+0000 7fb306ffd640 1 -- 172.21.15.193:0/982769849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3081008b0 msgr2=0x7fb30819d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:12.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.725+0000 7fb306ffd640 1 --2- 172.21.15.193:0/982769849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3081008b0 0x7fb30819d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:12.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.725+0000 7fb306ffd640 1 -- 172.21.15.193:0/982769849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3080ffef0 msgr2=0x7fb30819ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:12.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.725+0000 7fb306ffd640 1 --2- 172.21.15.193:0/982769849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3080ffef0 0x7fb30819ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:12.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.725+0000 7fb306ffd640 1 -- 172.21.15.193:0/982769849 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f8009560 con 0x7fb3080fecf0 2024-09-13T15:54:12.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.725+0000 7fb306ffd640 1 --2- 172.21.15.193:0/982769849 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb3080fecf0 0x7fb308069280 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8005ec0 tx=0x7fb2f8004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:12.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.725+0000 7fb2fffff640 1 -- 172.21.15.193:0/982769849 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8004d40 con 0x7fb3080fecf0 2024-09-13T15:54:12.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.725+0000 7fb2fffff640 1 -- 172.21.15.193:0/982769849 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb2f8003ab0 con 0x7fb3080fecf0 2024-09-13T15:54:12.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.725+0000 7fb30d793640 1 -- 172.21.15.193:0/982769849 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30819df50 con 0x7fb3080fecf0 2024-09-13T15:54:12.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.725+0000 7fb2fffff640 1 -- 172.21.15.193:0/982769849 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8031c80 con 0x7fb3080fecf0 2024-09-13T15:54:12.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.725+0000 7fb30d793640 1 -- 172.21.15.193:0/982769849 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30819e440 con 0x7fb3080fecf0 2024-09-13T15:54:12.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.726+0000 7fb30d793640 1 -- 172.21.15.193:0/982769849 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3081061b0 con 0x7fb3080fecf0 2024-09-13T15:54:12.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.727+0000 7fb2fffff640 1 -- 172.21.15.193:0/982769849 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb2f8003c20 con 0x7fb3080fecf0 2024-09-13T15:54:12.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.728+0000 7fb2fffff640 1 --2- 172.21.15.193:0/982769849 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb2f40a1100 0x7fb2f40a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:12.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.728+0000 7fb2fffff640 1 -- 172.21.15.193:0/982769849 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb2f80ed570 con 0x7fb3080fecf0 2024-09-13T15:54:12.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.729+0000 7fb3067fc640 1 --2- 172.21.15.193:0/982769849 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb2f40a1100 0x7fb2f40a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:12.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.729+0000 7fb3067fc640 1 --2- 172.21.15.193:0/982769849 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb2f40a1100 0x7fb2f40a35c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb308069800 tx=0x7fb2f0005bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:12.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.732+0000 7fb2fffff640 1 -- 172.21.15.193:0/982769849 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb2f80b71a0 con 0x7fb3080fecf0 2024-09-13T15:54:12.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.903+0000 7fb30d793640 1 -- 172.21.15.193:0/982769849 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi189=b;smithi189=e;smithi189=h;smithi189=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l", "target": ["mon-mgr", ""]}) v1 -- 0x7fb30802c580 con 0x7fb2f40a1100 2024-09-13T15:54:12.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.912+0000 7fb2fffff640 1 -- 172.21.15.193:0/982769849 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fb30802c580 con 0x7fb2f40a1100 2024-09-13T15:54:12.913 INFO:teuthology.orchestra.run.smithi193.stdout:Scheduled mds.all update... 2024-09-13T15:54:12.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.914+0000 7fb30d793640 1 -- 172.21.15.193:0/982769849 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb2f40a1100 msgr2=0x7fb2f40a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:12.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.914+0000 7fb30d793640 1 --2- 172.21.15.193:0/982769849 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb2f40a1100 0x7fb2f40a35c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb308069800 tx=0x7fb2f0005bf0 comp rx=0 tx=0).stop 2024-09-13T15:54:12.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.914+0000 7fb30d793640 1 -- 172.21.15.193:0/982769849 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb3080fecf0 msgr2=0x7fb308069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:12.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.914+0000 7fb30d793640 1 --2- 172.21.15.193:0/982769849 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb3080fecf0 0x7fb308069280 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8005ec0 tx=0x7fb2f8004740 comp rx=0 tx=0).stop 2024-09-13T15:54:12.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.914+0000 7fb30d793640 1 -- 172.21.15.193:0/982769849 shutdown_connections 2024-09-13T15:54:12.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.914+0000 7fb30d793640 1 --2- 172.21.15.193:0/982769849 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb2f40a1100 0x7fb2f40a35c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:12.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.914+0000 7fb30d793640 1 --2- 172.21.15.193:0/982769849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3081008b0 0x7fb30819d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:12.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.914+0000 7fb30d793640 1 --2- 172.21.15.193:0/982769849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3080ffef0 0x7fb30819ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:12.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.914+0000 7fb30d793640 1 --2- 172.21.15.193:0/982769849 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb3080fecf0 0x7fb308069280 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:12.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.914+0000 7fb30d793640 1 -- 172.21.15.193:0/982769849 >> 172.21.15.193:0/982769849 conn(0x7fb3080fa480 msgr2=0x7fb308103380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:12.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.914+0000 7fb30d793640 1 -- 172.21.15.193:0/982769849 shutdown_connections 2024-09-13T15:54:12.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-13T15:54:12.914+0000 7fb30d793640 1 -- 172.21.15.193:0/982769849 wait complete. 2024-09-13T15:54:13.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:13 smithi193 ceph-mon[35248]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:13.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:13 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:13.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:13 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:54:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:13 smithi017 ceph-mon[30494]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:13 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:13 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:54:13.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:13 smithi189 ceph-mon[34790]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:13.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:13 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:13.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:13 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:54:13.694 DEBUG:teuthology.orchestra.run.smithi017:mds.a> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.a.service 2024-09-13T15:54:13.699 DEBUG:teuthology.orchestra.run.smithi017:mds.d> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.d.service 2024-09-13T15:54:13.745 DEBUG:teuthology.orchestra.run.smithi017:mds.g> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.g.service 2024-09-13T15:54:13.790 DEBUG:teuthology.orchestra.run.smithi017:mds.j> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.j.service 2024-09-13T15:54:13.836 DEBUG:teuthology.orchestra.run.smithi189:mds.b> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.b.service 2024-09-13T15:54:13.839 DEBUG:teuthology.orchestra.run.smithi189:mds.e> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.e.service 2024-09-13T15:54:13.884 DEBUG:teuthology.orchestra.run.smithi189:mds.h> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.h.service 2024-09-13T15:54:13.929 DEBUG:teuthology.orchestra.run.smithi189:mds.k> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.k.service 2024-09-13T15:54:13.972 DEBUG:teuthology.orchestra.run.smithi193:mds.c> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.c.service 2024-09-13T15:54:13.975 DEBUG:teuthology.orchestra.run.smithi193:mds.f> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.f.service 2024-09-13T15:54:14.018 DEBUG:teuthology.orchestra.run.smithi193:mds.i> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.i.service 2024-09-13T15:54:14.063 DEBUG:teuthology.orchestra.run.smithi193:mds.l> sudo journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.l.service 2024-09-13T15:54:14.106 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-13T15:54:14.106 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:54:14.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.275+0000 7f6a37200640 1 -- 172.21.15.17:0/1039645590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a30103190 msgr2=0x7f6a30103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:14.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.275+0000 7f6a37200640 1 --2- 172.21.15.17:0/1039645590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a30103190 0x7f6a30103610 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6a18009860 tx=0x7f6a1802a340 comp rx=0 tx=0).stop 2024-09-13T15:54:14.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.275+0000 7f6a37200640 1 -- 172.21.15.17:0/1039645590 shutdown_connections 2024-09-13T15:54:14.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.275+0000 7f6a37200640 1 --2- 172.21.15.17:0/1039645590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a30103b50 0x7f6a3010a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:14.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.275+0000 7f6a37200640 1 --2- 172.21.15.17:0/1039645590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a30103190 0x7f6a30103610 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:14.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.275+0000 7f6a37200640 1 --2- 172.21.15.17:0/1039645590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a30101fa0 0x7f6a301023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:14.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.275+0000 7f6a37200640 1 -- 172.21.15.17:0/1039645590 >> 172.21.15.17:0/1039645590 conn(0x7f6a300fd700 msgr2=0x7f6a300ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:14.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.275+0000 7f6a37200640 1 -- 172.21.15.17:0/1039645590 shutdown_connections 2024-09-13T15:54:14.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.275+0000 7f6a37200640 1 -- 172.21.15.17:0/1039645590 wait complete. 2024-09-13T15:54:14.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.276+0000 7f6a37200640 1 Processor -- start 2024-09-13T15:54:14.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.276+0000 7f6a37200640 1 -- start start 2024-09-13T15:54:14.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.276+0000 7f6a37200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a30101fa0 0x7f6a30197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:14.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.276+0000 7f6a37200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a30103190 0x7f6a301984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:14.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.276+0000 7f6a37200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a30103b50 0x7f6a3019f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:14.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.277+0000 7f6a37200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3019fa60 con 0x7f6a30103190 2024-09-13T15:54:14.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.277+0000 7f6a37200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3019fbd0 con 0x7f6a30101fa0 2024-09-13T15:54:14.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.277+0000 7f6a37200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3019fd90 con 0x7f6a30103b50 2024-09-13T15:54:14.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.277+0000 7f6a2fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a30101fa0 0x7f6a30197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:14.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.277+0000 7f6a2fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a30101fa0 0x7f6a30197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:49392/0 (socket says 172.21.15.17:49392) 2024-09-13T15:54:14.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.277+0000 7f6a2fe00640 1 -- 172.21.15.17:0/3198429441 learned_addr learned my addr 172.21.15.17:0/3198429441 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:14.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.277+0000 7f6a27400640 1 --2- 172.21.15.17:0/3198429441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a30103190 0x7f6a301984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:14.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.277+0000 7f6a35200640 1 --2- 172.21.15.17:0/3198429441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a30103b50 0x7f6a3019f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:14.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.277+0000 7f6a2fe00640 1 -- 172.21.15.17:0/3198429441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a30103b50 msgr2=0x7f6a3019f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:14.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.277+0000 7f6a2fe00640 1 --2- 172.21.15.17:0/3198429441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a30103b50 0x7f6a3019f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:14.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.277+0000 7f6a2fe00640 1 -- 172.21.15.17:0/3198429441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a30103190 msgr2=0x7f6a301984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:14.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.277+0000 7f6a2fe00640 1 --2- 172.21.15.17:0/3198429441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a30103190 0x7f6a301984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:14.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.277+0000 7f6a2fe00640 1 -- 172.21.15.17:0/3198429441 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a18009490 con 0x7f6a30101fa0 2024-09-13T15:54:14.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.277+0000 7f6a2fe00640 1 --2- 172.21.15.17:0/3198429441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a30101fa0 0x7f6a30197f70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000ebc0 tx=0x7f6a2000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:14.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.278+0000 7f6a2d600640 1 -- 172.21.15.17:0/3198429441 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20003970 con 0x7f6a30101fa0 2024-09-13T15:54:14.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.278+0000 7f6a37200640 1 -- 172.21.15.17:0/3198429441 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a301a0070 con 0x7f6a30101fa0 2024-09-13T15:54:14.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.278+0000 7f6a2d600640 1 -- 172.21.15.17:0/3198429441 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a20004030 con 0x7f6a30101fa0 2024-09-13T15:54:14.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.278+0000 7f6a2d600640 1 -- 172.21.15.17:0/3198429441 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a200196e0 con 0x7f6a30101fa0 2024-09-13T15:54:14.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.278+0000 7f6a37200640 1 -- 172.21.15.17:0/3198429441 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a301a05a0 con 0x7f6a30101fa0 2024-09-13T15:54:14.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.279+0000 7f6a37200640 1 -- 172.21.15.17:0/3198429441 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a301094d0 con 0x7f6a30101fa0 2024-09-13T15:54:14.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.281+0000 7f6a2d600640 1 -- 172.21.15.17:0/3198429441 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6a200043f0 con 0x7f6a30101fa0 2024-09-13T15:54:14.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.282+0000 7f6a2d600640 1 --2- 172.21.15.17:0/3198429441 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6a140a1110 0x7f6a140a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:14.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.282+0000 7f6a2d600640 1 -- 172.21.15.17:0/3198429441 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6a20014070 con 0x7f6a30101fa0 2024-09-13T15:54:14.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.282+0000 7f6a27400640 1 --2- 172.21.15.17:0/3198429441 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6a140a1110 0x7f6a140a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:14.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.283+0000 7f6a27400640 1 --2- 172.21.15.17:0/3198429441 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6a140a1110 0x7f6a140a35d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6a18030410 tx=0x7f6a18030580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:14.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.286+0000 7f6a2d600640 1 -- 172.21.15.17:0/3198429441 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6a200968d0 con 0x7f6a30101fa0 2024-09-13T15:54:14.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.467+0000 7f6a37200640 1 -- 172.21.15.17:0/3198429441 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a3010d860 con 0x7f6a30101fa0 2024-09-13T15:54:14.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.468+0000 7f6a2d600640 1 -- 172.21.15.17:0/3198429441 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18397 (secure 0 0 0) 0x7f6a20099ef0 con 0x7f6a30101fa0 2024-09-13T15:54:14.470 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:14.470 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":82,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","created":"2024-09-13T15:46:50.475750+0000","modified":"2024-09-13T15:54:00.415572+0000","last_up_change":"2024-09-13T15:53:59.138985+0000","last_in_change":"2024-09-13T15:53:39.220264+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:50:10.657011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5d39d6af-15e6-463b-b9ff-a9a5dd94e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6803","nonce":158651212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6805","nonce":158651212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6809","nonce":158651212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6807","nonce":158651212}]},"public_addr":"172.21.15.17:6803/158651212","cluster_addr":"172.21.15.17:6805/158651212","heartbeat_back_addr":"172.21.15.17:6809/158651212","heartbeat_front_addr":"172.21.15.17:6807/158651212","state":["exists","up"]},{"osd":1,"uuid":"0da621c7-645b-44ae-ba7c-a573861c3aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6801","nonce":964319421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6803","nonce":964319421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6807","nonce":964319421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6805","nonce":964319421}]},"public_addr":"172.21.15.189:6801/964319421","cluster_addr":"172.21.15.189:6803/964319421","heartbeat_back_addr":"172.21.15.189:6807/964319421","heartbeat_front_addr":"172.21.15.189:6805/964319421","state":["exists","up"]},{"osd":2,"uuid":"fa95af60-1486-4a29-8c79-8a73a4146552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6801","nonce":138468002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6803","nonce":138468002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6807","nonce":138468002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6805","nonce":138468002}]},"public_addr":"172.21.15.193:6801/138468002","cluster_addr":"172.21.15.193:6803/138468002","heartbeat_back_addr":"172.21.15.193:6807/138468002","heartbeat_front_addr":"172.21.15.193:6805/138468002","state":["exists","up"]},{"osd":3,"uuid":"90428e5f-dfd4-4cda-b240-fdb9079bcb7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6811","nonce":919913803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6813","nonce":919913803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6817","nonce":919913803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6815","nonce":919913803}]},"public_addr":"172.21.15.17:6811/919913803","cluster_addr":"172.21.15.17:6813/919913803","heartbeat_back_addr":"172.21.15.17:6817/919913803","heartbeat_front_addr":"172.21.15.17:6815/919913803","state":["exists","up"]},{"osd":4,"uuid":"e1c537b6-98d2-4b66-b15a-65fe70b0ce25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6809","nonce":2310375565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6811","nonce":2310375565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6815","nonce":2310375565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6813","nonce":2310375565}]},"public_addr":"172.21.15.189:6809/2310375565","cluster_addr":"172.21.15.189:6811/2310375565","heartbeat_back_addr":"172.21.15.189:6815/2310375565","heartbeat_front_addr":"172.21.15.189:6813/2310375565","state":["exists","up"]},{"osd":5,"uuid":"48522fd7-d781-4447-873f-174dabd1e33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6809","nonce":1330877824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6811","nonce":1330877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6815","nonce":1330877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6813","nonce":1330877824}]},"public_addr":"172.21.15.193:6809/1330877824","cluster_addr":"172.21.15.193:6811/1330877824","heartbeat_back_addr":"172.21.15.193:6815/1330877824","heartbeat_front_addr":"172.21.15.193:6813/1330877824","state":["exists","up"]},{"osd":6,"uuid":"47bea191-fb53-40a7-8563-8ebf17dd5bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6819","nonce":3930545382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6821","nonce":3930545382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6825","nonce":3930545382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6823","nonce":3930545382}]},"public_addr":"172.21.15.17:6819/3930545382","cluster_addr":"172.21.15.17:6821/3930545382","heartbeat_back_addr":"172.21.15.17:6825/3930545382","heartbeat_front_addr":"172.21.15.17:6823/3930545382","state":["exists","up"]},{"osd":7,"uuid":"a98f36f9-0a19-4c9a-8ed1-615c4a6e7658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6817","nonce":3691677495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6819","nonce":3691677495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6823","nonce":3691677495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6821","nonce":3691677495}]},"public_addr":"172.21.15.189:6817/3691677495","cluster_addr":"172.21.15.189:6819/3691677495","heartbeat_back_addr":"172.21.15.189:6823/3691677495","heartbeat_front_addr":"172.21.15.189:6821/3691677495","state":["exists","up"]},{"osd":8,"uuid":"7a372d9f-c40f-4ead-87da-2f3a570c1373","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6817","nonce":4112907498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6819","nonce":4112907498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6823","nonce":4112907498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6821","nonce":4112907498}]},"public_addr":"172.21.15.193:6817/4112907498","cluster_addr":"172.21.15.193:6819/4112907498","heartbeat_back_addr":"172.21.15.193:6823/4112907498","heartbeat_front_addr":"172.21.15.193:6821/4112907498","state":["exists","up"]},{"osd":9,"uuid":"ac3d983c-c5e7-456b-8271-7c4e6169de61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6827","nonce":663424274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6829","nonce":663424274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6833","nonce":663424274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6831","nonce":663424274}]},"public_addr":"172.21.15.17:6827/663424274","cluster_addr":"172.21.15.17:6829/663424274","heartbeat_back_addr":"172.21.15.17:6833/663424274","heartbeat_front_addr":"172.21.15.17:6831/663424274","state":["exists","up"]},{"osd":10,"uuid":"08dcae02-6c79-4a06-ae88-6eb6e6941cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6825","nonce":3153990375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6827","nonce":3153990375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6831","nonce":3153990375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6829","nonce":3153990375}]},"public_addr":"172.21.15.189:6825/3153990375","cluster_addr":"172.21.15.189:6827/3153990375","heartbeat_back_addr":"172.21.15.189:6831/3153990375","heartbeat_front_addr":"172.21.15.189:6829/3153990375","state":["exists","up"]},{"osd":11,"uuid":"a4ebcf41-d805-4d44-b112-13ae84d51868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6825","nonce":4088053907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6827","nonce":4088053907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6831","nonce":4088053907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6829","nonce":4088053907}]},"public_addr":"172.21.15.193:6825/4088053907","cluster_addr":"172.21.15.193:6827/4088053907","heartbeat_back_addr":"172.21.15.193:6831/4088053907","heartbeat_front_addr":"172.21.15.193:6829/4088053907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:22.172370+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:44.802224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:06.641435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:34.536515+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:58.789324+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:22.189862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:50.382257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:14.678047+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:38.581105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:07.258150+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:32.261383+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:56.739338+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/1550067038":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/3360683829":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/634066188":"2024-09-14T15:47:42.048005+0000","172.21.15.17:6801/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1945536687":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/2214214377":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1224386591":"2024-09-14T15:47:14.996424+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:54:14.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.470+0000 7f6a37200640 1 -- 172.21.15.17:0/3198429441 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6a140a1110 msgr2=0x7f6a140a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:14.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.470+0000 7f6a37200640 1 --2- 172.21.15.17:0/3198429441 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6a140a1110 0x7f6a140a35d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6a18030410 tx=0x7f6a18030580 comp rx=0 tx=0).stop 2024-09-13T15:54:14.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.470+0000 7f6a37200640 1 -- 172.21.15.17:0/3198429441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a30101fa0 msgr2=0x7f6a30197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:14.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.470+0000 7f6a37200640 1 --2- 172.21.15.17:0/3198429441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a30101fa0 0x7f6a30197f70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000ebc0 tx=0x7f6a2000c2d0 comp rx=0 tx=0).stop 2024-09-13T15:54:14.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.470+0000 7f6a37200640 1 -- 172.21.15.17:0/3198429441 shutdown_connections 2024-09-13T15:54:14.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.470+0000 7f6a37200640 1 --2- 172.21.15.17:0/3198429441 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6a140a1110 0x7f6a140a35d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:14.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.470+0000 7f6a37200640 1 --2- 172.21.15.17:0/3198429441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a30103b50 0x7f6a3019f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:14.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.470+0000 7f6a37200640 1 --2- 172.21.15.17:0/3198429441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a30103190 0x7f6a301984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:14.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.470+0000 7f6a37200640 1 --2- 172.21.15.17:0/3198429441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a30101fa0 0x7f6a30197f70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:14.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.470+0000 7f6a37200640 1 -- 172.21.15.17:0/3198429441 >> 172.21.15.17:0/3198429441 conn(0x7f6a300fd700 msgr2=0x7f6a301066a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:14.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.471+0000 7f6a37200640 1 -- 172.21.15.17:0/3198429441 shutdown_connections 2024-09-13T15:54:14.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.471+0000 7f6a37200640 1 -- 172.21.15.17:0/3198429441 wait complete. 2024-09-13T15:54:14.487 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:14 smithi017 ceph-mon[30494]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi189=b;smithi189=e;smithi189=h;smithi189=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:54:14.488 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:14 smithi017 ceph-mon[30494]: Saving service mds.all spec with placement smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi189=b;smithi189=e;smithi189=h;smithi189=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l;count:12 2024-09-13T15:54:14.488 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:14 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:14.488 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:14 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:54:14.488 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:14 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:14.488 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:14 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:14.488 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:14 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:14.488 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:14 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:14.490 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:50:10.657011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:54:14.490 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:54:14.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:14 smithi193 ceph-mon[35248]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi189=b;smithi189=e;smithi189=h;smithi189=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:54:14.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:14 smithi193 ceph-mon[35248]: Saving service mds.all spec with placement smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi189=b;smithi189=e;smithi189=h;smithi189=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l;count:12 2024-09-13T15:54:14.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:14 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:14.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:14 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:54:14.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:14 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:14.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:14 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:14.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:14 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:14.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:14 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:14.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:14 smithi189 ceph-mon[34790]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi189=b;smithi189=e;smithi189=h;smithi189=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:54:14.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:14 smithi189 ceph-mon[34790]: Saving service mds.all spec with placement smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi189=b;smithi189=e;smithi189=h;smithi189=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l;count:12 2024-09-13T15:54:14.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:14 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:14.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:14 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:54:14.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:14 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:14.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:14 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:14.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:14 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:14.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:14 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:14.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.648+0000 7ff9bfe00640 1 -- 172.21.15.17:0/393032649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9b8101f80 msgr2=0x7ff9b8102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:14.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.648+0000 7ff9bfe00640 1 --2- 172.21.15.17:0/393032649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9b8101f80 0x7ff9b8102380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009900 tx=0x7ff9ac02a3f0 comp rx=0 tx=0).stop 2024-09-13T15:54:14.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.648+0000 7ff9bfe00640 1 -- 172.21.15.17:0/393032649 shutdown_connections 2024-09-13T15:54:14.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.648+0000 7ff9bfe00640 1 --2- 172.21.15.17:0/393032649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9b8103b30 0x7ff9b810a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:14.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.648+0000 7ff9bfe00640 1 --2- 172.21.15.17:0/393032649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b8103170 0x7ff9b81035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:14.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.648+0000 7ff9bfe00640 1 --2- 172.21.15.17:0/393032649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9b8101f80 0x7ff9b8102380 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:14.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.648+0000 7ff9bfe00640 1 -- 172.21.15.17:0/393032649 >> 172.21.15.17:0/393032649 conn(0x7ff9b80fd700 msgr2=0x7ff9b80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:14.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.648+0000 7ff9bfe00640 1 -- 172.21.15.17:0/393032649 shutdown_connections 2024-09-13T15:54:14.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.648+0000 7ff9bfe00640 1 -- 172.21.15.17:0/393032649 wait complete. 2024-09-13T15:54:14.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.649+0000 7ff9bfe00640 1 Processor -- start 2024-09-13T15:54:14.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.649+0000 7ff9bfe00640 1 -- start start 2024-09-13T15:54:14.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.649+0000 7ff9bfe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9b8101f80 0x7ff9b8197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:14.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.649+0000 7ff9bfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b8103170 0x7ff9b8198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:14.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.649+0000 7ff9bfe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9b8103b30 0x7ff9b819f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:14.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.650+0000 7ff9bfe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b819fa40 con 0x7ff9b8103170 2024-09-13T15:54:14.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.650+0000 7ff9bfe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b819fbb0 con 0x7ff9b8101f80 2024-09-13T15:54:14.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.650+0000 7ff9bfe00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b819fd70 con 0x7ff9b8103b30 2024-09-13T15:54:14.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.650+0000 7ff9bca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b8103170 0x7ff9b8198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:14.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.650+0000 7ff9bca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b8103170 0x7ff9b8198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55684/0 (socket says 172.21.15.17:55684) 2024-09-13T15:54:14.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.650+0000 7ff9bca00640 1 -- 172.21.15.17:0/1772987504 learned_addr learned my addr 172.21.15.17:0/1772987504 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:14.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.650+0000 7ff9bd400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9b8101f80 0x7ff9b8197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:14.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.650+0000 7ff9bde00640 1 --2- 172.21.15.17:0/1772987504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9b8103b30 0x7ff9b819f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:14.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.650+0000 7ff9bd400640 1 -- 172.21.15.17:0/1772987504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9b8103b30 msgr2=0x7ff9b819f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:14.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.650+0000 7ff9bd400640 1 --2- 172.21.15.17:0/1772987504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9b8103b30 0x7ff9b819f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:14.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.650+0000 7ff9bd400640 1 -- 172.21.15.17:0/1772987504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b8103170 msgr2=0x7ff9b8198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:14.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.650+0000 7ff9bd400640 1 --2- 172.21.15.17:0/1772987504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b8103170 0x7ff9b8198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:14.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.650+0000 7ff9bd400640 1 -- 172.21.15.17:0/1772987504 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac009560 con 0x7ff9b8101f80 2024-09-13T15:54:14.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.650+0000 7ff9bca00640 1 --2- 172.21.15.17:0/1772987504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b8103170 0x7ff9b8198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:54:14.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.651+0000 7ff9bd400640 1 --2- 172.21.15.17:0/1772987504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9b8101f80 0x7ff9b8197f50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009230 tx=0x7ff9ac005620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:14.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.651+0000 7ff9b6000640 1 -- 172.21.15.17:0/1772987504 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac004b50 con 0x7ff9b8101f80 2024-09-13T15:54:14.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.651+0000 7ff9bfe00640 1 -- 172.21.15.17:0/1772987504 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b819fff0 con 0x7ff9b8101f80 2024-09-13T15:54:14.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.651+0000 7ff9b6000640 1 -- 172.21.15.17:0/1772987504 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9ac004cb0 con 0x7ff9b8101f80 2024-09-13T15:54:14.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.651+0000 7ff9b6000640 1 -- 172.21.15.17:0/1772987504 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac031a20 con 0x7ff9b8101f80 2024-09-13T15:54:14.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.651+0000 7ff9bfe00640 1 -- 172.21.15.17:0/1772987504 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b81a0410 con 0x7ff9b8101f80 2024-09-13T15:54:14.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.652+0000 7ff9bfe00640 1 -- 172.21.15.17:0/1772987504 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b8109400 con 0x7ff9b8101f80 2024-09-13T15:54:14.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.654+0000 7ff9b6000640 1 -- 172.21.15.17:0/1772987504 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff9ac031b80 con 0x7ff9b8101f80 2024-09-13T15:54:14.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.655+0000 7ff9b6000640 1 --2- 172.21.15.17:0/1772987504 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff9a00a1090 0x7ff9a00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:14.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.655+0000 7ff9b6000640 1 -- 172.21.15.17:0/1772987504 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff9ac0ed300 con 0x7ff9b8101f80 2024-09-13T15:54:14.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.655+0000 7ff9bca00640 1 --2- 172.21.15.17:0/1772987504 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff9a00a1090 0x7ff9a00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:14.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.656+0000 7ff9bca00640 1 --2- 172.21.15.17:0/1772987504 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff9a00a1090 0x7ff9a00a3550 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8199460 tx=0x7ff9a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:14.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.657+0000 7ff9b6000640 1 -- 172.21.15.17:0/1772987504 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff9ac0b7060 con 0x7ff9b8101f80 2024-09-13T15:54:14.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.836+0000 7ff9bfe00640 1 -- 172.21.15.17:0/1772987504 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff9b802c3e0 con 0x7ff9b8101f80 2024-09-13T15:54:14.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.837+0000 7ff9b6000640 1 -- 172.21.15.17:0/1772987504 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff9ac0ba680 con 0x7ff9b8101f80 2024-09-13T15:54:14.839 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-13T15:54:14.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.839+0000 7ff9bfe00640 1 -- 172.21.15.17:0/1772987504 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff9a00a1090 msgr2=0x7ff9a00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:14.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.839+0000 7ff9bfe00640 1 --2- 172.21.15.17:0/1772987504 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff9a00a1090 0x7ff9a00a3550 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8199460 tx=0x7ff9a4005f90 comp rx=0 tx=0).stop 2024-09-13T15:54:14.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.839+0000 7ff9bfe00640 1 -- 172.21.15.17:0/1772987504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9b8101f80 msgr2=0x7ff9b8197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:14.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.839+0000 7ff9bfe00640 1 --2- 172.21.15.17:0/1772987504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9b8101f80 0x7ff9b8197f50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009230 tx=0x7ff9ac005620 comp rx=0 tx=0).stop 2024-09-13T15:54:14.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.839+0000 7ff9bfe00640 1 -- 172.21.15.17:0/1772987504 shutdown_connections 2024-09-13T15:54:14.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.839+0000 7ff9bfe00640 1 --2- 172.21.15.17:0/1772987504 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff9a00a1090 0x7ff9a00a3550 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:14.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.839+0000 7ff9bfe00640 1 --2- 172.21.15.17:0/1772987504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9b8103b30 0x7ff9b819f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:14.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.839+0000 7ff9bfe00640 1 --2- 172.21.15.17:0/1772987504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b8103170 0x7ff9b8198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:14.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.839+0000 7ff9bfe00640 1 --2- 172.21.15.17:0/1772987504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9b8101f80 0x7ff9b8197f50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:14.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.839+0000 7ff9bfe00640 1 -- 172.21.15.17:0/1772987504 >> 172.21.15.17:0/1772987504 conn(0x7ff9b80fd700 msgr2=0x7ff9b81065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:14.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.840+0000 7ff9bfe00640 1 -- 172.21.15.17:0/1772987504 shutdown_connections 2024-09-13T15:54:14.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:14.840+0000 7ff9bfe00640 1 -- 172.21.15.17:0/1772987504 wait complete. 2024-09-13T15:54:14.857 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:54:15.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.013+0000 7f9d17600640 1 -- 172.21.15.17:0/978429478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d10103b60 msgr2=0x7f9d1010a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:15.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.013+0000 7f9d17600640 1 --2- 172.21.15.17:0/978429478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d10103b60 0x7f9d1010a3f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009ca0 tx=0x7f9d0802a8c0 comp rx=0 tx=0).stop 2024-09-13T15:54:15.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.013+0000 7f9d17600640 1 -- 172.21.15.17:0/978429478 shutdown_connections 2024-09-13T15:54:15.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.013+0000 7f9d17600640 1 --2- 172.21.15.17:0/978429478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d10103b60 0x7f9d1010a3f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:15.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.013+0000 7f9d17600640 1 --2- 172.21.15.17:0/978429478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9d101031a0 0x7f9d10103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:15.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.013+0000 7f9d17600640 1 --2- 172.21.15.17:0/978429478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d10101fb0 0x7f9d101023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:15.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.013+0000 7f9d17600640 1 -- 172.21.15.17:0/978429478 >> 172.21.15.17:0/978429478 conn(0x7f9d100fd730 msgr2=0x7f9d100ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:15.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.013+0000 7f9d17600640 1 -- 172.21.15.17:0/978429478 shutdown_connections 2024-09-13T15:54:15.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.013+0000 7f9d17600640 1 -- 172.21.15.17:0/978429478 wait complete. 2024-09-13T15:54:15.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.014+0000 7f9d17600640 1 Processor -- start 2024-09-13T15:54:15.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.014+0000 7f9d17600640 1 -- start start 2024-09-13T15:54:15.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.015+0000 7f9d17600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9d10101fb0 0x7f9d10197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:15.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.015+0000 7f9d17600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d101031a0 0x7f9d10198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:15.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.015+0000 7f9d17600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d10103b60 0x7f9d1019f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:15.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.015+0000 7f9d17600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1019fa30 con 0x7f9d101031a0 2024-09-13T15:54:15.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.015+0000 7f9d17600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1019fba0 con 0x7f9d10103b60 2024-09-13T15:54:15.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.015+0000 7f9d17600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1019fd60 con 0x7f9d10101fb0 2024-09-13T15:54:15.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.015+0000 7f9d0fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d101031a0 0x7f9d10198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:15.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.015+0000 7f9d0fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d101031a0 0x7f9d10198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55696/0 (socket says 172.21.15.17:55696) 2024-09-13T15:54:15.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.015+0000 7f9d14c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9d10101fb0 0x7f9d10197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:15.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.015+0000 7f9d0fe00640 1 -- 172.21.15.17:0/2461958986 learned_addr learned my addr 172.21.15.17:0/2461958986 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:15.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.015+0000 7f9d15600640 1 --2- 172.21.15.17:0/2461958986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d10103b60 0x7f9d1019f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:15.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.015+0000 7f9d0fe00640 1 -- 172.21.15.17:0/2461958986 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9d10101fb0 msgr2=0x7f9d10197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:15.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.015+0000 7f9d0fe00640 1 --2- 172.21.15.17:0/2461958986 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9d10101fb0 0x7f9d10197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:15.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.015+0000 7f9d0fe00640 1 -- 172.21.15.17:0/2461958986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d10103b60 msgr2=0x7f9d1019f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:15.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.015+0000 7f9d0fe00640 1 --2- 172.21.15.17:0/2461958986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d10103b60 0x7f9d1019f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:15.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.015+0000 7f9d0fe00640 1 -- 172.21.15.17:0/2461958986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d08009900 con 0x7f9d101031a0 2024-09-13T15:54:15.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.015+0000 7f9d15600640 1 --2- 172.21.15.17:0/2461958986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d10103b60 0x7f9d1019f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:54:15.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.015+0000 7f9d0fe00640 1 --2- 172.21.15.17:0/2461958986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d101031a0 0x7f9d10198480 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00e9f0 tx=0x7f9cfc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:15.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.016+0000 7f9d0d600640 1 -- 172.21.15.17:0/2461958986 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc009720 con 0x7f9d101031a0 2024-09-13T15:54:15.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.016+0000 7f9d0d600640 1 -- 172.21.15.17:0/2461958986 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9cfc00cd80 con 0x7f9d101031a0 2024-09-13T15:54:15.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.016+0000 7f9d17600640 1 -- 172.21.15.17:0/2461958986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1019ffe0 con 0x7f9d101031a0 2024-09-13T15:54:15.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.016+0000 7f9d0d600640 1 -- 172.21.15.17:0/2461958986 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc010430 con 0x7f9d101031a0 2024-09-13T15:54:15.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.016+0000 7f9d17600640 1 -- 172.21.15.17:0/2461958986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d101a04c0 con 0x7f9d101031a0 2024-09-13T15:54:15.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.017+0000 7f9d17600640 1 -- 172.21.15.17:0/2461958986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d101093f0 con 0x7f9d101031a0 2024-09-13T15:54:15.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.019+0000 7f9d0d600640 1 -- 172.21.15.17:0/2461958986 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9cfc005020 con 0x7f9d101031a0 2024-09-13T15:54:15.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.020+0000 7f9d0d600640 1 --2- 172.21.15.17:0/2461958986 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9cf80a1110 0x7f9cf80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:15.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.020+0000 7f9d0d600640 1 -- 172.21.15.17:0/2461958986 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9cfc014070 con 0x7f9d101031a0 2024-09-13T15:54:15.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.020+0000 7f9d14c00640 1 --2- 172.21.15.17:0/2461958986 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9cf80a1110 0x7f9cf80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:15.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.021+0000 7f9d14c00640 1 --2- 172.21.15.17:0/2461958986 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9cf80a1110 0x7f9cf80a35d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9d10103000 tx=0x7f9d04005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:15.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.024+0000 7f9d0d600640 1 -- 172.21.15.17:0/2461958986 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9cfc096430 con 0x7f9d101031a0 2024-09-13T15:54:15.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.244+0000 7f9d17600640 1 -- 172.21.15.17:0/2461958986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d1002c410 con 0x7f9d101031a0 2024-09-13T15:54:15.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.244+0000 7f9d0d600640 1 -- 172.21.15.17:0/2461958986 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7f9cfc099a50 con 0x7f9d101031a0 2024-09-13T15:54:15.246 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:15.246 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-13T15:54:15.246 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 1 2024-09-13T15:54:15.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.246+0000 7f9d17600640 1 -- 172.21.15.17:0/2461958986 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9cf80a1110 msgr2=0x7f9cf80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:15.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.246+0000 7f9d17600640 1 --2- 172.21.15.17:0/2461958986 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9cf80a1110 0x7f9cf80a35d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9d10103000 tx=0x7f9d04005f90 comp rx=0 tx=0).stop 2024-09-13T15:54:15.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.246+0000 7f9d17600640 1 -- 172.21.15.17:0/2461958986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d101031a0 msgr2=0x7f9d10198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:15.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.246+0000 7f9d17600640 1 --2- 172.21.15.17:0/2461958986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d101031a0 0x7f9d10198480 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00e9f0 tx=0x7f9cfc00edf0 comp rx=0 tx=0).stop 2024-09-13T15:54:15.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.247+0000 7f9d17600640 1 -- 172.21.15.17:0/2461958986 shutdown_connections 2024-09-13T15:54:15.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.247+0000 7f9d17600640 1 --2- 172.21.15.17:0/2461958986 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9cf80a1110 0x7f9cf80a35d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:15.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.247+0000 7f9d17600640 1 --2- 172.21.15.17:0/2461958986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d10103b60 0x7f9d1019f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:15.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.247+0000 7f9d17600640 1 --2- 172.21.15.17:0/2461958986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d101031a0 0x7f9d10198480 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:15.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.247+0000 7f9d17600640 1 --2- 172.21.15.17:0/2461958986 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9d10101fb0 0x7f9d10197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:15.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.247+0000 7f9d17600640 1 -- 172.21.15.17:0/2461958986 >> 172.21.15.17:0/2461958986 conn(0x7f9d100fd730 msgr2=0x7f9d101065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:15.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.247+0000 7f9d17600640 1 -- 172.21.15.17:0/2461958986 shutdown_connections 2024-09-13T15:54:15.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:15.247+0000 7f9d17600640 1 -- 172.21.15.17:0/2461958986 wait complete. 2024-09-13T15:54:15.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:15 smithi193 ceph-mon[35248]: Deploying daemon mds.l on smithi193 2024-09-13T15:54:15.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:15 smithi193 ceph-mon[35248]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:15.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:15 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3198429441' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:54:15.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:15 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1772987504' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:54:15.505 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 13 15:54:15 smithi193 systemd[1]: Starting Ceph mds.l for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T15:54:15.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:15 smithi017 ceph-mon[30494]: Deploying daemon mds.l on smithi193 2024-09-13T15:54:15.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:15 smithi017 ceph-mon[30494]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:15.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:15 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3198429441' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:54:15.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:15 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1772987504' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:54:15.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:15 smithi189 ceph-mon[34790]: Deploying daemon mds.l on smithi193 2024-09-13T15:54:15.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:15 smithi189 ceph-mon[34790]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:15.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:15 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3198429441' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:54:15.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:15 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1772987504' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:54:15.892 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 13 15:54:15 smithi193 podman[64862]: 2024-09-13 15:54:15.502393273 +0000 UTC m=+0.015870378 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T15:54:15.892 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 13 15:54:15 smithi193 podman[64862]: 2024-09-13 15:54:15.621461731 +0000 UTC m=+0.134938825 container create 83eb180d4af28dcb3ebcaae17d24a5dff1eefca9a14590086342229ff3f136cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-l, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2) 2024-09-13T15:54:15.892 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 13 15:54:15 smithi193 podman[64862]: 2024-09-13 15:54:15.891028113 +0000 UTC m=+0.404505220 container init 83eb180d4af28dcb3ebcaae17d24a5dff1eefca9a14590086342229ff3f136cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-l, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T15:54:16.210 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 13 15:54:15 smithi193 podman[64862]: 2024-09-13 15:54:15.894077787 +0000 UTC m=+0.407554888 container start 83eb180d4af28dcb3ebcaae17d24a5dff1eefca9a14590086342229ff3f136cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-l, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T15:54:16.210 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 13 15:54:15 smithi193 ceph-mds[64881]: -- 172.21.15.193:0/2538486079 <== mon.1 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56171724ed00 con 0x561717223400 2024-09-13T15:54:16.211 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 13 15:54:15 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-l[64877]: starting mds.l at 2024-09-13T15:54:16.211 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 13 15:54:15 smithi193 bash[64862]: 83eb180d4af28dcb3ebcaae17d24a5dff1eefca9a14590086342229ff3f136cf 2024-09-13T15:54:16.211 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 13 15:54:15 smithi193 systemd[1]: Started Ceph mds.l for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T15:54:16.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:16 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/2461958986' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:16.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:16 smithi193 ceph-mon[35248]: mds.? [v2:172.21.15.193:6832/2264195842,v1:172.21.15.193:6833/2264195842] up:boot 2024-09-13T15:54:16.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:16 smithi193 ceph-mon[35248]: fsmap 1 up:standby 2024-09-13T15:54:16.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:16 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T15:54:16.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:16 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:16.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:16 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:16.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:16 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:16.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:16 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:16.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:16 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:16.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:16 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:16.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:16 smithi193 ceph-mon[35248]: Deploying daemon mds.k on smithi189 2024-09-13T15:54:16.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:16 smithi193 ceph-mon[35248]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:16.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:16 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/2461958986' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:16.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:16 smithi017 ceph-mon[30494]: mds.? [v2:172.21.15.193:6832/2264195842,v1:172.21.15.193:6833/2264195842] up:boot 2024-09-13T15:54:16.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:16 smithi017 ceph-mon[30494]: fsmap 1 up:standby 2024-09-13T15:54:16.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T15:54:16.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:16.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:16.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:16.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:16.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:16.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:16 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:16.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:16 smithi017 ceph-mon[30494]: Deploying daemon mds.k on smithi189 2024-09-13T15:54:16.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:16 smithi017 ceph-mon[30494]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:16.588 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:16 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/2461958986' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:16.588 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:16 smithi189 ceph-mon[34790]: mds.? [v2:172.21.15.193:6832/2264195842,v1:172.21.15.193:6833/2264195842] up:boot 2024-09-13T15:54:16.588 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:16 smithi189 ceph-mon[34790]: fsmap 1 up:standby 2024-09-13T15:54:16.588 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:16 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T15:54:16.588 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:16 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:16.588 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:16 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:16.588 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:16 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:16.588 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:16 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:16.588 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:16 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:16.589 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:16 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:16.589 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:16 smithi189 ceph-mon[34790]: Deploying daemon mds.k on smithi189 2024-09-13T15:54:16.589 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:16 smithi189 ceph-mon[34790]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:17.265 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:54:17.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.432+0000 7f359d200640 1 -- 172.21.15.17:0/520759572 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3598100db0 msgr2=0x7f3598101230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:17.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.432+0000 7f359d200640 1 --2- 172.21.15.17:0/520759572 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3598100db0 0x7f3598101230 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3580009860 tx=0x7f358002a340 comp rx=0 tx=0).stop 2024-09-13T15:54:17.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.432+0000 7f359d200640 1 -- 172.21.15.17:0/520759572 shutdown_connections 2024-09-13T15:54:17.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.432+0000 7f359d200640 1 --2- 172.21.15.17:0/520759572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3598101770 0x7f3598108000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:17.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.432+0000 7f359d200640 1 --2- 172.21.15.17:0/520759572 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3598100db0 0x7f3598101230 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:17.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.432+0000 7f359d200640 1 --2- 172.21.15.17:0/520759572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f35980ffbc0 0x7f35980fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:17.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.432+0000 7f359d200640 1 -- 172.21.15.17:0/520759572 >> 172.21.15.17:0/520759572 conn(0x7f35980fb360 msgr2=0x7f35980fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:17.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.432+0000 7f359d200640 1 -- 172.21.15.17:0/520759572 shutdown_connections 2024-09-13T15:54:17.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.432+0000 7f359d200640 1 -- 172.21.15.17:0/520759572 wait complete. 2024-09-13T15:54:17.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.433+0000 7f359d200640 1 Processor -- start 2024-09-13T15:54:17.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.433+0000 7f359d200640 1 -- start start 2024-09-13T15:54:17.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.433+0000 7f359d200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f35980ffbc0 0x7f3598197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:17.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.433+0000 7f359d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3598100db0 0x7f3598198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:17.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.433+0000 7f359d200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3598101770 0x7f359819f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:17.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.434+0000 7f359d200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359819f8e0 con 0x7f3598100db0 2024-09-13T15:54:17.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.434+0000 7f359d200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359819fa50 con 0x7f3598101770 2024-09-13T15:54:17.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.434+0000 7f359d200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359819fc10 con 0x7f35980ffbc0 2024-09-13T15:54:17.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.434+0000 7f358fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3598100db0 0x7f3598198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:17.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.434+0000 7f358fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3598100db0 0x7f3598198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55712/0 (socket says 172.21.15.17:55712) 2024-09-13T15:54:17.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.434+0000 7f358fe00640 1 -- 172.21.15.17:0/3599176071 learned_addr learned my addr 172.21.15.17:0/3599176071 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:17.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.434+0000 7f3597e00640 1 --2- 172.21.15.17:0/3599176071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3598101770 0x7f359819f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:17.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.434+0000 7f3597400640 1 --2- 172.21.15.17:0/3599176071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f35980ffbc0 0x7f3598197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:17.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.434+0000 7f358fe00640 1 -- 172.21.15.17:0/3599176071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f35980ffbc0 msgr2=0x7f3598197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:17.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.434+0000 7f358fe00640 1 --2- 172.21.15.17:0/3599176071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f35980ffbc0 0x7f3598197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:17.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.434+0000 7f358fe00640 1 -- 172.21.15.17:0/3599176071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3598101770 msgr2=0x7f359819f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:17.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.434+0000 7f358fe00640 1 --2- 172.21.15.17:0/3599176071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3598101770 0x7f359819f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:17.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.434+0000 7f358fe00640 1 -- 172.21.15.17:0/3599176071 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3588009560 con 0x7f3598100db0 2024-09-13T15:54:17.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.435+0000 7f358fe00640 1 --2- 172.21.15.17:0/3599176071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3598100db0 0x7f3598198330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f35800305e0 tx=0x7f3580032d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:17.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.435+0000 7f3594c00640 1 -- 172.21.15.17:0/3599176071 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3580004040 con 0x7f3598100db0 2024-09-13T15:54:17.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.435+0000 7f3594c00640 1 -- 172.21.15.17:0/3599176071 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f35800035f0 con 0x7f3598100db0 2024-09-13T15:54:17.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.435+0000 7f359d200640 1 -- 172.21.15.17:0/3599176071 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3580009490 con 0x7f3598100db0 2024-09-13T15:54:17.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.435+0000 7f3594c00640 1 -- 172.21.15.17:0/3599176071 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358003e690 con 0x7f3598100db0 2024-09-13T15:54:17.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.435+0000 7f359d200640 1 -- 172.21.15.17:0/3599176071 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35981a01b0 con 0x7f3598100db0 2024-09-13T15:54:17.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.436+0000 7f359d200640 1 -- 172.21.15.17:0/3599176071 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35981923d0 con 0x7f3598100db0 2024-09-13T15:54:17.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.438+0000 7f3594c00640 1 -- 172.21.15.17:0/3599176071 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f35800039b0 con 0x7f3598100db0 2024-09-13T15:54:17.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.439+0000 7f3594c00640 1 --2- 172.21.15.17:0/3599176071 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f357c0a1090 0x7f357c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:17.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.439+0000 7f3594c00640 1 -- 172.21.15.17:0/3599176071 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f35800ecff0 con 0x7f3598100db0 2024-09-13T15:54:17.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.439+0000 7f3597400640 1 --2- 172.21.15.17:0/3599176071 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f357c0a1090 0x7f357c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:17.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.440+0000 7f3597400640 1 --2- 172.21.15.17:0/3599176071 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f357c0a1090 0x7f357c0a3550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3588009530 tx=0x7f3588009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:17.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.443+0000 7f3594c00640 1 -- 172.21.15.17:0/3599176071 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f35800b6b80 con 0x7f3598100db0 2024-09-13T15:54:17.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.658+0000 7f359d200640 1 -- 172.21.15.17:0/3599176071 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f359810b460 con 0x7f3598100db0 2024-09-13T15:54:17.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.658+0000 7f3594c00640 1 -- 172.21.15.17:0/3599176071 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1260 (secure 0 0 0) 0x7f35800ba1a0 con 0x7f3598100db0 2024-09-13T15:54:17.660 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:17.660 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T15:54:17.660 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 2 2024-09-13T15:54:17.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.660+0000 7f359d200640 1 -- 172.21.15.17:0/3599176071 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f357c0a1090 msgr2=0x7f357c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:17.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.660+0000 7f359d200640 1 --2- 172.21.15.17:0/3599176071 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f357c0a1090 0x7f357c0a3550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3588009530 tx=0x7f3588009260 comp rx=0 tx=0).stop 2024-09-13T15:54:17.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.660+0000 7f359d200640 1 -- 172.21.15.17:0/3599176071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3598100db0 msgr2=0x7f3598198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:17.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.660+0000 7f359d200640 1 --2- 172.21.15.17:0/3599176071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3598100db0 0x7f3598198330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f35800305e0 tx=0x7f3580032d20 comp rx=0 tx=0).stop 2024-09-13T15:54:17.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.660+0000 7f359d200640 1 -- 172.21.15.17:0/3599176071 shutdown_connections 2024-09-13T15:54:17.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.660+0000 7f359d200640 1 --2- 172.21.15.17:0/3599176071 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f357c0a1090 0x7f357c0a3550 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:17.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.660+0000 7f359d200640 1 --2- 172.21.15.17:0/3599176071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3598101770 0x7f359819f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:17.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.660+0000 7f359d200640 1 --2- 172.21.15.17:0/3599176071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3598100db0 0x7f3598198330 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:17.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.660+0000 7f359d200640 1 --2- 172.21.15.17:0/3599176071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f35980ffbc0 0x7f3598197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:17.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.660+0000 7f359d200640 1 -- 172.21.15.17:0/3599176071 >> 172.21.15.17:0/3599176071 conn(0x7f35980fb360 msgr2=0x7f3598106690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:17.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.660+0000 7f359d200640 1 -- 172.21.15.17:0/3599176071 shutdown_connections 2024-09-13T15:54:17.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:17.660+0000 7f359d200640 1 -- 172.21.15.17:0/3599176071 wait complete. 2024-09-13T15:54:18.271 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:18 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3599176071' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:18.271 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 13 15:54:18 smithi189 systemd[1]: Starting Ceph mds.k for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T15:54:18.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:18 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3599176071' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:18.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:18 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3599176071' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:18.574 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 13 15:54:18 smithi189 podman[64073]: 2024-09-13 15:54:18.172580974 +0000 UTC m=+0.015762834 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T15:54:18.574 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 13 15:54:18 smithi189 podman[64073]: 2024-09-13 15:54:18.308923527 +0000 UTC m=+0.152105394 container create 6f78886a39d7c9306395bb2fb722b58dcb90ea7c2b0337e604313a87f190c6c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-13T15:54:18.574 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 13 15:54:18 smithi189 podman[64073]: 2024-09-13 15:54:18.57330794 +0000 UTC m=+0.416489796 container init 6f78886a39d7c9306395bb2fb722b58dcb90ea7c2b0337e604313a87f190c6c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-k, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T15:54:18.856 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 13 15:54:18 smithi189 podman[64073]: 2024-09-13 15:54:18.577224145 +0000 UTC m=+0.420406005 container start 6f78886a39d7c9306395bb2fb722b58dcb90ea7c2b0337e604313a87f190c6c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-k, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-13T15:54:18.856 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 13 15:54:18 smithi189 ceph-mds[64092]: -- 172.21.15.189:0/1027032856 <== mon.2 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ce37f8ed00 con 0x55ce37f63000 2024-09-13T15:54:18.856 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 13 15:54:18 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-k[64088]: starting mds.k at 2024-09-13T15:54:18.857 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 13 15:54:18 smithi189 bash[64073]: 6f78886a39d7c9306395bb2fb722b58dcb90ea7c2b0337e604313a87f190c6c1 2024-09-13T15:54:18.857 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 13 15:54:18 smithi189 systemd[1]: Started Ceph mds.k for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T15:54:19.336 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:19 smithi017 ceph-mon[30494]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:19.336 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:19 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:19.336 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:19 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:19.336 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:19 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:19.336 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:19 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:19.336 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:19 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:19.336 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:19 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:19.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:19 smithi189 ceph-mon[34790]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:19.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:19 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:19.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:19 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:19.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:19 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:19.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:19 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:19.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:19 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:19.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:19 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:19.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:19 smithi193 ceph-mon[35248]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:19.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:19 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:19.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:19 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:19.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:19 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:19.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:19 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:19.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:19 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:19.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:19 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:19.679 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:54:19.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.849+0000 7f4c7e200640 1 -- 172.21.15.17:0/3863244351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c78102f40 msgr2=0x7f4c78105330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:19.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.849+0000 7f4c7e200640 1 --2- 172.21.15.17:0/3863244351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c78102f40 0x7f4c78105330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4c64009900 tx=0x7f4c6402a410 comp rx=0 tx=0).stop 2024-09-13T15:54:19.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.849+0000 7f4c7e200640 1 -- 172.21.15.17:0/3863244351 shutdown_connections 2024-09-13T15:54:19.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.849+0000 7f4c7e200640 1 --2- 172.21.15.17:0/3863244351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c78105870 0x7f4c78107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:19.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.849+0000 7f4c7e200640 1 --2- 172.21.15.17:0/3863244351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c78102f40 0x7f4c78105330 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:19.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.849+0000 7f4c7e200640 1 --2- 172.21.15.17:0/3863244351 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c78100610 0x7f4c78102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:19.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.849+0000 7f4c7e200640 1 -- 172.21.15.17:0/3863244351 >> 172.21.15.17:0/3863244351 conn(0x7f4c780fa1f0 msgr2=0x7f4c780fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:19.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.849+0000 7f4c7e200640 1 -- 172.21.15.17:0/3863244351 shutdown_connections 2024-09-13T15:54:19.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.849+0000 7f4c7e200640 1 -- 172.21.15.17:0/3863244351 wait complete. 2024-09-13T15:54:19.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.851+0000 7f4c7e200640 1 Processor -- start 2024-09-13T15:54:19.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.851+0000 7f4c7e200640 1 -- start start 2024-09-13T15:54:19.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.851+0000 7f4c7e200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c78100610 0x7f4c78195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:19.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.851+0000 7f4c7e200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c78102f40 0x7f4c78196130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:19.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.851+0000 7f4c7e200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c78105870 0x7f4c7819d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:19.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.851+0000 7f4c7e200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7819d6e0 con 0x7f4c78102f40 2024-09-13T15:54:19.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.851+0000 7f4c7e200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7819d850 con 0x7f4c78100610 2024-09-13T15:54:19.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.851+0000 7f4c7e200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7819da10 con 0x7f4c78105870 2024-09-13T15:54:19.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.852+0000 7f4c7ce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c78100610 0x7f4c78195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:19.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.852+0000 7f4c77e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c78102f40 0x7f4c78196130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:19.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.852+0000 7f4c7ce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c78100610 0x7f4c78195bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:44020/0 (socket says 172.21.15.17:44020) 2024-09-13T15:54:19.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.852+0000 7f4c77e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c78102f40 0x7f4c78196130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55752/0 (socket says 172.21.15.17:55752) 2024-09-13T15:54:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.852+0000 7f4c7ce00640 1 -- 172.21.15.17:0/2729540061 learned_addr learned my addr 172.21.15.17:0/2729540061 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.852+0000 7f4c7d800640 1 --2- 172.21.15.17:0/2729540061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c78105870 0x7f4c7819d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.852+0000 7f4c77e00640 1 -- 172.21.15.17:0/2729540061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c78105870 msgr2=0x7f4c7819d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.852+0000 7f4c77e00640 1 --2- 172.21.15.17:0/2729540061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c78105870 0x7f4c7819d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.852+0000 7f4c77e00640 1 -- 172.21.15.17:0/2729540061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c78100610 msgr2=0x7f4c78195bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.852+0000 7f4c77e00640 1 --2- 172.21.15.17:0/2729540061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c78100610 0x7f4c78195bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.852+0000 7f4c77e00640 1 -- 172.21.15.17:0/2729540061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c64009560 con 0x7f4c78102f40 2024-09-13T15:54:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.852+0000 7f4c7ce00640 1 --2- 172.21.15.17:0/2729540061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c78100610 0x7f4c78195bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:54:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.853+0000 7f4c77e00640 1 --2- 172.21.15.17:0/2729540061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c78102f40 0x7f4c78196130 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4c64009230 tx=0x7f4c64005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.853+0000 7f4c75600640 1 -- 172.21.15.17:0/2729540061 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c64004b50 con 0x7f4c78102f40 2024-09-13T15:54:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.853+0000 7f4c75600640 1 -- 172.21.15.17:0/2729540061 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c64004cb0 con 0x7f4c78102f40 2024-09-13T15:54:19.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.853+0000 7f4c75600640 1 -- 172.21.15.17:0/2729540061 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c64031a20 con 0x7f4c78102f40 2024-09-13T15:54:19.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.853+0000 7f4c7e200640 1 -- 172.21.15.17:0/2729540061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7819dc90 con 0x7f4c78102f40 2024-09-13T15:54:19.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.853+0000 7f4c7e200640 1 -- 172.21.15.17:0/2729540061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7819e0c0 con 0x7f4c78102f40 2024-09-13T15:54:19.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.854+0000 7f4c7e200640 1 -- 172.21.15.17:0/2729540061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c780fbce0 con 0x7f4c78102f40 2024-09-13T15:54:19.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.856+0000 7f4c75600640 1 -- 172.21.15.17:0/2729540061 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4c64031b80 con 0x7f4c78102f40 2024-09-13T15:54:19.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.857+0000 7f4c75600640 1 --2- 172.21.15.17:0/2729540061 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4c600a1090 0x7f4c600a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:19.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.857+0000 7f4c75600640 1 -- 172.21.15.17:0/2729540061 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4c640ed2c0 con 0x7f4c78102f40 2024-09-13T15:54:19.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.857+0000 7f4c7ce00640 1 --2- 172.21.15.17:0/2729540061 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4c600a1090 0x7f4c600a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:19.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.858+0000 7f4c7ce00640 1 --2- 172.21.15.17:0/2729540061 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4c600a1090 0x7f4c600a3550 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0049d0 tx=0x7f4c6c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:19.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:19.861+0000 7f4c75600640 1 -- 172.21.15.17:0/2729540061 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4c640b6f00 con 0x7f4c78102f40 2024-09-13T15:54:20.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:20.083+0000 7f4c7e200640 1 -- 172.21.15.17:0/2729540061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c7810b480 con 0x7f4c78102f40 2024-09-13T15:54:20.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:20.084+0000 7f4c75600640 1 -- 172.21.15.17:0/2729540061 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2020 (secure 0 0 0) 0x7f4c640ba520 con 0x7f4c78102f40 2024-09-13T15:54:20.085 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:20.086 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T15:54:20.086 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 3 2024-09-13T15:54:20.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:20.088+0000 7f4c7e200640 1 -- 172.21.15.17:0/2729540061 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4c600a1090 msgr2=0x7f4c600a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:20.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:20.088+0000 7f4c7e200640 1 --2- 172.21.15.17:0/2729540061 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4c600a1090 0x7f4c600a3550 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0049d0 tx=0x7f4c6c009500 comp rx=0 tx=0).stop 2024-09-13T15:54:20.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:20.088+0000 7f4c7e200640 1 -- 172.21.15.17:0/2729540061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c78102f40 msgr2=0x7f4c78196130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:20.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:20.088+0000 7f4c7e200640 1 --2- 172.21.15.17:0/2729540061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c78102f40 0x7f4c78196130 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4c64009230 tx=0x7f4c64005620 comp rx=0 tx=0).stop 2024-09-13T15:54:20.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:20.088+0000 7f4c7e200640 1 -- 172.21.15.17:0/2729540061 shutdown_connections 2024-09-13T15:54:20.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:20.088+0000 7f4c7e200640 1 --2- 172.21.15.17:0/2729540061 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4c600a1090 0x7f4c600a3550 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:20.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:20.088+0000 7f4c7e200640 1 --2- 172.21.15.17:0/2729540061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c78105870 0x7f4c7819d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:20.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:20.088+0000 7f4c7e200640 1 --2- 172.21.15.17:0/2729540061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c78102f40 0x7f4c78196130 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:20.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:20.088+0000 7f4c7e200640 1 --2- 172.21.15.17:0/2729540061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c78100610 0x7f4c78195bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:20.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:20.088+0000 7f4c7e200640 1 -- 172.21.15.17:0/2729540061 >> 172.21.15.17:0/2729540061 conn(0x7f4c780fa1f0 msgr2=0x7f4c78100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:20.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:20.088+0000 7f4c7e200640 1 -- 172.21.15.17:0/2729540061 shutdown_connections 2024-09-13T15:54:20.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:20.088+0000 7f4c7e200640 1 -- 172.21.15.17:0/2729540061 wait complete. 2024-09-13T15:54:20.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:20 smithi017 ceph-mon[30494]: Deploying daemon mds.j on smithi017 2024-09-13T15:54:20.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:20 smithi017 ceph-mon[30494]: mds.? [v2:172.21.15.189:6832/3777024343,v1:172.21.15.189:6833/3777024343] up:boot 2024-09-13T15:54:20.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:20 smithi017 ceph-mon[30494]: fsmap 2 up:standby 2024-09-13T15:54:20.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:20 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T15:54:20.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:20 smithi189 ceph-mon[34790]: Deploying daemon mds.j on smithi017 2024-09-13T15:54:20.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:20 smithi189 ceph-mon[34790]: mds.? [v2:172.21.15.189:6832/3777024343,v1:172.21.15.189:6833/3777024343] up:boot 2024-09-13T15:54:20.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:20 smithi189 ceph-mon[34790]: fsmap 2 up:standby 2024-09-13T15:54:20.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:20 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T15:54:20.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:20 smithi193 ceph-mon[35248]: Deploying daemon mds.j on smithi017 2024-09-13T15:54:20.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:20 smithi193 ceph-mon[35248]: mds.? [v2:172.21.15.189:6832/3777024343,v1:172.21.15.189:6833/3777024343] up:boot 2024-09-13T15:54:20.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:20 smithi193 ceph-mon[35248]: fsmap 2 up:standby 2024-09-13T15:54:20.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:20 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T15:54:21.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:21 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/2729540061' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:21.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:21 smithi189 ceph-mon[34790]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:21.376 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:21 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/2729540061' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:21.376 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:21 smithi017 ceph-mon[30494]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:21.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:21 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/2729540061' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:21.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:21 smithi193 ceph-mon[35248]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:21.689 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 13 15:54:21 smithi017 systemd[1]: Starting Ceph mds.j for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T15:54:21.960 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 13 15:54:21 smithi017 podman[71145]: 2024-09-13 15:54:21.592813455 +0000 UTC m=+0.027398676 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T15:54:21.960 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 13 15:54:21 smithi017 podman[71145]: 2024-09-13 15:54:21.697461095 +0000 UTC m=+0.132046316 container create ff6c25f0daf619c8f6a2b69909cbdf38761d640699294dc777e9810284c4b138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T15:54:21.960 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 13 15:54:21 smithi017 podman[71145]: 2024-09-13 15:54:21.95900848 +0000 UTC m=+0.393593701 container init ff6c25f0daf619c8f6a2b69909cbdf38761d640699294dc777e9810284c4b138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T15:54:22.107 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:54:22.261 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 13 15:54:21 smithi017 podman[71145]: 2024-09-13 15:54:21.965216831 +0000 UTC m=+0.399802053 container start ff6c25f0daf619c8f6a2b69909cbdf38761d640699294dc777e9810284c4b138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-13T15:54:22.261 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 13 15:54:22 smithi017 ceph-mds[71164]: -- 172.21.15.17:0/746220134 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555aa97ecd00 con 0x555aa97c1000 2024-09-13T15:54:22.261 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 13 15:54:22 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-j[71160]: starting mds.j at 2024-09-13T15:54:22.261 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 13 15:54:22 smithi017 bash[71145]: ff6c25f0daf619c8f6a2b69909cbdf38761d640699294dc777e9810284c4b138 2024-09-13T15:54:22.261 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 13 15:54:22 smithi017 systemd[1]: Started Ceph mds.j for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T15:54:22.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.279+0000 7fcf2c200640 1 -- 172.21.15.17:0/2952185226 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf240ffda0 msgr2=0x7fcf241001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:22.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.279+0000 7fcf2c200640 1 --2- 172.21.15.17:0/2952185226 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf240ffda0 0x7fcf241001a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcf18009860 tx=0x7fcf1802a340 comp rx=0 tx=0).stop 2024-09-13T15:54:22.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.280+0000 7fcf2c200640 1 -- 172.21.15.17:0/2952185226 shutdown_connections 2024-09-13T15:54:22.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.280+0000 7fcf2c200640 1 --2- 172.21.15.17:0/2952185226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf24101950 0x7fcf241081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:22.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.280+0000 7fcf2c200640 1 --2- 172.21.15.17:0/2952185226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf24100f90 0x7fcf24101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:22.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.280+0000 7fcf2c200640 1 --2- 172.21.15.17:0/2952185226 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf240ffda0 0x7fcf241001a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:22.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.280+0000 7fcf2c200640 1 -- 172.21.15.17:0/2952185226 >> 172.21.15.17:0/2952185226 conn(0x7fcf240fb520 msgr2=0x7fcf240fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:22.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.280+0000 7fcf2c200640 1 -- 172.21.15.17:0/2952185226 shutdown_connections 2024-09-13T15:54:22.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.280+0000 7fcf2c200640 1 -- 172.21.15.17:0/2952185226 wait complete. 2024-09-13T15:54:22.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.281+0000 7fcf2c200640 1 Processor -- start 2024-09-13T15:54:22.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.281+0000 7fcf2c200640 1 -- start start 2024-09-13T15:54:22.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.281+0000 7fcf2c200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf240ffda0 0x7fcf24198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:22.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.281+0000 7fcf2c200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf24100f90 0x7fcf24198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:22.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.281+0000 7fcf2c200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf24101950 0x7fcf2419f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:22.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.281+0000 7fcf2c200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2419fb20 con 0x7fcf24101950 2024-09-13T15:54:22.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.281+0000 7fcf2c200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2419fc90 con 0x7fcf24100f90 2024-09-13T15:54:22.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.281+0000 7fcf2c200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2419fe50 con 0x7fcf240ffda0 2024-09-13T15:54:22.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.281+0000 7fcf29800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf240ffda0 0x7fcf24198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:22.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.281+0000 7fcf29800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf240ffda0 0x7fcf24198030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:38234/0 (socket says 172.21.15.17:38234) 2024-09-13T15:54:22.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.281+0000 7fcf2a200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf24101950 0x7fcf2419f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:22.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.281+0000 7fcf29800640 1 -- 172.21.15.17:0/724808061 learned_addr learned my addr 172.21.15.17:0/724808061 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:22.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.281+0000 7fcf28e00640 1 --2- 172.21.15.17:0/724808061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf24100f90 0x7fcf24198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:22.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.282+0000 7fcf29800640 1 -- 172.21.15.17:0/724808061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf24100f90 msgr2=0x7fcf24198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:22.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.282+0000 7fcf29800640 1 --2- 172.21.15.17:0/724808061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf24100f90 0x7fcf24198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:22.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.282+0000 7fcf29800640 1 -- 172.21.15.17:0/724808061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf24101950 msgr2=0x7fcf2419f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:22.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.282+0000 7fcf29800640 1 --2- 172.21.15.17:0/724808061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf24101950 0x7fcf2419f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:22.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.282+0000 7fcf29800640 1 -- 172.21.15.17:0/724808061 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c009840 con 0x7fcf240ffda0 2024-09-13T15:54:22.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.282+0000 7fcf2a200640 1 --2- 172.21.15.17:0/724808061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf24101950 0x7fcf2419f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:54:22.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.282+0000 7fcf29800640 1 --2- 172.21.15.17:0/724808061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf240ffda0 0x7fcf24198030 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcf180304b0 tx=0x7fcf18032d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:22.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.283+0000 7fcf22000640 1 -- 172.21.15.17:0/724808061 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf18032750 con 0x7fcf240ffda0 2024-09-13T15:54:22.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.283+0000 7fcf2c200640 1 -- 172.21.15.17:0/724808061 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf18009490 con 0x7fcf240ffda0 2024-09-13T15:54:22.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.283+0000 7fcf22000640 1 -- 172.21.15.17:0/724808061 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf18004510 con 0x7fcf240ffda0 2024-09-13T15:54:22.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.283+0000 7fcf2c200640 1 -- 172.21.15.17:0/724808061 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf241a0440 con 0x7fcf240ffda0 2024-09-13T15:54:22.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.283+0000 7fcf22000640 1 -- 172.21.15.17:0/724808061 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf18004920 con 0x7fcf240ffda0 2024-09-13T15:54:22.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.284+0000 7fcf2c200640 1 -- 172.21.15.17:0/724808061 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2410b640 con 0x7fcf240ffda0 2024-09-13T15:54:22.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.285+0000 7fcf22000640 1 -- 172.21.15.17:0/724808061 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fcf18004050 con 0x7fcf240ffda0 2024-09-13T15:54:22.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.287+0000 7fcf22000640 1 --2- 172.21.15.17:0/724808061 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcf0c0a1110 0x7fcf0c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:22.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.288+0000 7fcf22000640 1 -- 172.21.15.17:0/724808061 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fcf180ec8c0 con 0x7fcf240ffda0 2024-09-13T15:54:22.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.288+0000 7fcf28e00640 1 --2- 172.21.15.17:0/724808061 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcf0c0a1110 0x7fcf0c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:22.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.289+0000 7fcf28e00640 1 --2- 172.21.15.17:0/724808061 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcf0c0a1110 0x7fcf0c0a35d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcf24199540 tx=0x7fcf10009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:22.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.291+0000 7fcf22000640 1 -- 172.21.15.17:0/724808061 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcf180b6450 con 0x7fcf240ffda0 2024-09-13T15:54:22.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.512+0000 7fcf2c200640 1 -- 172.21.15.17:0/724808061 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf2410b7d0 con 0x7fcf240ffda0 2024-09-13T15:54:22.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.512+0000 7fcf22000640 1 -- 172.21.15.17:0/724808061 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2777 (secure 0 0 0) 0x7fcf180b9a70 con 0x7fcf240ffda0 2024-09-13T15:54:22.514 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:22.514 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2888593680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2888593680},{"type":"v1","addr":"172.21.15.17:6835","nonce":2888593680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4}],"filesystems":[]} 2024-09-13T15:54:22.514 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 4 2024-09-13T15:54:22.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.514+0000 7fcf2c200640 1 -- 172.21.15.17:0/724808061 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcf0c0a1110 msgr2=0x7fcf0c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:22.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.514+0000 7fcf2c200640 1 --2- 172.21.15.17:0/724808061 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcf0c0a1110 0x7fcf0c0a35d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcf24199540 tx=0x7fcf10009260 comp rx=0 tx=0).stop 2024-09-13T15:54:22.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.514+0000 7fcf2c200640 1 -- 172.21.15.17:0/724808061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf240ffda0 msgr2=0x7fcf24198030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:22.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.514+0000 7fcf2c200640 1 --2- 172.21.15.17:0/724808061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf240ffda0 0x7fcf24198030 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcf180304b0 tx=0x7fcf18032d20 comp rx=0 tx=0).stop 2024-09-13T15:54:22.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.515+0000 7fcf2c200640 1 -- 172.21.15.17:0/724808061 shutdown_connections 2024-09-13T15:54:22.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.515+0000 7fcf2c200640 1 --2- 172.21.15.17:0/724808061 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcf0c0a1110 0x7fcf0c0a35d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:22.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.515+0000 7fcf2c200640 1 --2- 172.21.15.17:0/724808061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf24101950 0x7fcf2419f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:22.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.515+0000 7fcf2c200640 1 --2- 172.21.15.17:0/724808061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf24100f90 0x7fcf24198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:22.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.515+0000 7fcf2c200640 1 --2- 172.21.15.17:0/724808061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf240ffda0 0x7fcf24198030 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:22.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.515+0000 7fcf2c200640 1 -- 172.21.15.17:0/724808061 >> 172.21.15.17:0/724808061 conn(0x7fcf240fb520 msgr2=0x7fcf241067f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:22.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.515+0000 7fcf2c200640 1 -- 172.21.15.17:0/724808061 shutdown_connections 2024-09-13T15:54:22.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:22.515+0000 7fcf2c200640 1 -- 172.21.15.17:0/724808061 wait complete. 2024-09-13T15:54:23.172 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:23 smithi017 ceph-mon[30494]: mds.? [v2:172.21.15.17:6834/2888593680,v1:172.21.15.17:6835/2888593680] up:boot 2024-09-13T15:54:23.173 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:23 smithi017 ceph-mon[30494]: fsmap 3 up:standby 2024-09-13T15:54:23.173 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:23 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T15:54:23.173 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:23 smithi017 ceph-mon[30494]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:23.173 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:23 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:23.173 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:23 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:23.173 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:23 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:23.173 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:23 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:23.173 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:23 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:23.173 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:23 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:23.173 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:23 smithi017 ceph-mon[30494]: Deploying daemon mds.d on smithi017 2024-09-13T15:54:23.173 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:23 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/724808061' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:23.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:23 smithi189 ceph-mon[34790]: mds.? [v2:172.21.15.17:6834/2888593680,v1:172.21.15.17:6835/2888593680] up:boot 2024-09-13T15:54:23.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:23 smithi189 ceph-mon[34790]: fsmap 3 up:standby 2024-09-13T15:54:23.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:23 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T15:54:23.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:23 smithi189 ceph-mon[34790]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:23.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:23 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:23.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:23 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:23.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:23 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:23.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:23 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:23.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:23 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:23.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:23 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:23.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:23 smithi189 ceph-mon[34790]: Deploying daemon mds.d on smithi017 2024-09-13T15:54:23.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:23 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/724808061' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:23.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:23 smithi193 ceph-mon[35248]: mds.? [v2:172.21.15.17:6834/2888593680,v1:172.21.15.17:6835/2888593680] up:boot 2024-09-13T15:54:23.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:23 smithi193 ceph-mon[35248]: fsmap 3 up:standby 2024-09-13T15:54:23.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:23 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T15:54:23.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:23 smithi193 ceph-mon[35248]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:23.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:23 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:23.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:23 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:23.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:23 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:23.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:23 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:23.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:23 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:23.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:23 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:23.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:23 smithi193 ceph-mon[35248]: Deploying daemon mds.d on smithi017 2024-09-13T15:54:23.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:23 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/724808061' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:24.536 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:54:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.743+0000 7f3084e00640 1 -- 172.21.15.17:0/1606875842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3080102fb0 msgr2=0x7f3080103430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.743+0000 7f3084e00640 1 --2- 172.21.15.17:0/1606875842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3080102fb0 0x7f3080103430 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3068009900 tx=0x7f306802a410 comp rx=0 tx=0).stop 2024-09-13T15:54:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.743+0000 7f3084e00640 1 -- 172.21.15.17:0/1606875842 shutdown_connections 2024-09-13T15:54:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.743+0000 7f3084e00640 1 --2- 172.21.15.17:0/1606875842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3080103970 0x7f308010a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.743+0000 7f3084e00640 1 --2- 172.21.15.17:0/1606875842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3080102fb0 0x7f3080103430 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.743+0000 7f3084e00640 1 --2- 172.21.15.17:0/1606875842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3080101dc0 0x7f30801021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.743+0000 7f3084e00640 1 -- 172.21.15.17:0/1606875842 >> 172.21.15.17:0/1606875842 conn(0x7f30800fd540 msgr2=0x7f30800ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.743+0000 7f3084e00640 1 -- 172.21.15.17:0/1606875842 shutdown_connections 2024-09-13T15:54:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.743+0000 7f3084e00640 1 -- 172.21.15.17:0/1606875842 wait complete. 2024-09-13T15:54:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.744+0000 7f3084e00640 1 Processor -- start 2024-09-13T15:54:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.745+0000 7f3084e00640 1 -- start start 2024-09-13T15:54:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.745+0000 7f3084e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3080101dc0 0x7f3080197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.745+0000 7f3084e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3080102fb0 0x7f30801982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.745+0000 7f3084e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3080103970 0x7f308019f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.745+0000 7f3084e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308019f8a0 con 0x7f3080102fb0 2024-09-13T15:54:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.745+0000 7f3084e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308019fa10 con 0x7f3080103970 2024-09-13T15:54:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.745+0000 7f3084e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308019fbd0 con 0x7f3080101dc0 2024-09-13T15:54:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.745+0000 7f3076a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3080102fb0 0x7f30801982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.745+0000 7f3076a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3080102fb0 0x7f30801982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55808/0 (socket says 172.21.15.17:55808) 2024-09-13T15:54:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.745+0000 7f3076a00640 1 -- 172.21.15.17:0/3840116040 learned_addr learned my addr 172.21.15.17:0/3840116040 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.745+0000 7f307f400640 1 --2- 172.21.15.17:0/3840116040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3080101dc0 0x7f3080197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.745+0000 7f307fe00640 1 --2- 172.21.15.17:0/3840116040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3080103970 0x7f308019f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.746+0000 7f3076a00640 1 -- 172.21.15.17:0/3840116040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3080101dc0 msgr2=0x7f3080197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.746+0000 7f3076a00640 1 --2- 172.21.15.17:0/3840116040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3080101dc0 0x7f3080197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.746+0000 7f3076a00640 1 -- 172.21.15.17:0/3840116040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3080103970 msgr2=0x7f308019f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.746+0000 7f3076a00640 1 --2- 172.21.15.17:0/3840116040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3080103970 0x7f308019f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.746+0000 7f3076a00640 1 -- 172.21.15.17:0/3840116040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3068009560 con 0x7f3080102fb0 2024-09-13T15:54:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.746+0000 7f307f400640 1 --2- 172.21.15.17:0/3840116040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3080101dc0 0x7f3080197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:54:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.746+0000 7f3076a00640 1 --2- 172.21.15.17:0/3840116040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3080102fb0 0x7f30801982f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3068009a20 tx=0x7f30680055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.746+0000 7f307cc00640 1 -- 172.21.15.17:0/3840116040 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068004c90 con 0x7f3080102fb0 2024-09-13T15:54:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.746+0000 7f307cc00640 1 -- 172.21.15.17:0/3840116040 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3068004df0 con 0x7f3080102fb0 2024-09-13T15:54:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.746+0000 7f307cc00640 1 -- 172.21.15.17:0/3840116040 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068031b40 con 0x7f3080102fb0 2024-09-13T15:54:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.746+0000 7f3084e00640 1 -- 172.21.15.17:0/3840116040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f308019fe50 con 0x7f3080102fb0 2024-09-13T15:54:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.747+0000 7f3084e00640 1 -- 172.21.15.17:0/3840116040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30801a0220 con 0x7f3080102fb0 2024-09-13T15:54:24.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.748+0000 7f3084e00640 1 -- 172.21.15.17:0/3840116040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30801091f0 con 0x7f3080102fb0 2024-09-13T15:54:24.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.751+0000 7f307cc00640 1 -- 172.21.15.17:0/3840116040 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3068031ca0 con 0x7f3080102fb0 2024-09-13T15:54:24.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.753+0000 7f307cc00640 1 --2- 172.21.15.17:0/3840116040 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30640a1110 0x7f30640a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:24.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.753+0000 7f307cc00640 1 -- 172.21.15.17:0/3840116040 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f30680ed7a0 con 0x7f3080102fb0 2024-09-13T15:54:24.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.753+0000 7f307f400640 1 --2- 172.21.15.17:0/3840116040 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30640a1110 0x7f30640a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:24.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.754+0000 7f307f400640 1 --2- 172.21.15.17:0/3840116040 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30640a1110 0x7f30640a35d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3080102e10 tx=0x7f3070009720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:24.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.755+0000 7f307cc00640 1 -- 172.21.15.17:0/3840116040 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f30680b7480 con 0x7f3080102fb0 2024-09-13T15:54:24.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.976+0000 7f3084e00640 1 -- 172.21.15.17:0/3840116040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f308010d680 con 0x7f3080102fb0 2024-09-13T15:54:24.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.977+0000 7f307cc00640 1 -- 172.21.15.17:0/3840116040 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2777 (secure 0 0 0) 0x7f30680baaa0 con 0x7f3080102fb0 2024-09-13T15:54:24.979 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 13 15:54:24 smithi017 systemd[1]: Starting Ceph mds.d for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T15:54:24.979 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:24.979 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2888593680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2888593680},{"type":"v1","addr":"172.21.15.17:6835","nonce":2888593680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4}],"filesystems":[]} 2024-09-13T15:54:24.979 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 4 2024-09-13T15:54:24.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.979+0000 7f3084e00640 1 -- 172.21.15.17:0/3840116040 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30640a1110 msgr2=0x7f30640a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:24.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.979+0000 7f3084e00640 1 --2- 172.21.15.17:0/3840116040 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30640a1110 0x7f30640a35d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3080102e10 tx=0x7f3070009720 comp rx=0 tx=0).stop 2024-09-13T15:54:24.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.979+0000 7f3084e00640 1 -- 172.21.15.17:0/3840116040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3080102fb0 msgr2=0x7f30801982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:24.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.979+0000 7f3084e00640 1 --2- 172.21.15.17:0/3840116040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3080102fb0 0x7f30801982f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3068009a20 tx=0x7f30680055a0 comp rx=0 tx=0).stop 2024-09-13T15:54:24.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.979+0000 7f3084e00640 1 -- 172.21.15.17:0/3840116040 shutdown_connections 2024-09-13T15:54:24.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.979+0000 7f3084e00640 1 --2- 172.21.15.17:0/3840116040 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30640a1110 0x7f30640a35d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:24.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.979+0000 7f3084e00640 1 --2- 172.21.15.17:0/3840116040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3080103970 0x7f308019f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:24.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.979+0000 7f3084e00640 1 --2- 172.21.15.17:0/3840116040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3080102fb0 0x7f30801982f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:24.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.979+0000 7f3084e00640 1 --2- 172.21.15.17:0/3840116040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3080101dc0 0x7f3080197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:24.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.979+0000 7f3084e00640 1 -- 172.21.15.17:0/3840116040 >> 172.21.15.17:0/3840116040 conn(0x7f30800fd540 msgr2=0x7f30801063c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:24.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.979+0000 7f3084e00640 1 -- 172.21.15.17:0/3840116040 shutdown_connections 2024-09-13T15:54:24.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:24.979+0000 7f3084e00640 1 -- 172.21.15.17:0/3840116040 wait complete. 2024-09-13T15:54:25.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:25 smithi017 ceph-mon[30494]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:25.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:25 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3840116040' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:25.262 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 13 15:54:24 smithi017 podman[71524]: 2024-09-13 15:54:24.882746848 +0000 UTC m=+0.028180545 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T15:54:25.262 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 13 15:54:25 smithi017 podman[71524]: 2024-09-13 15:54:25.021223728 +0000 UTC m=+0.166657429 container create b08731d97bbba29542f4a7be35a264de371efd70494f8ff3f819e31435e7b1ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T15:54:25.267 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:25 smithi193 ceph-mon[35248]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:25.267 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:25 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3840116040' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:25.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:25 smithi189 ceph-mon[34790]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:25.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:25 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3840116040' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:25.761 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 13 15:54:25 smithi017 podman[71524]: 2024-09-13 15:54:25.266126571 +0000 UTC m=+0.411560294 container init b08731d97bbba29542f4a7be35a264de371efd70494f8ff3f819e31435e7b1ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-13T15:54:25.761 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 13 15:54:25 smithi017 podman[71524]: 2024-09-13 15:54:25.272275962 +0000 UTC m=+0.417709659 container start b08731d97bbba29542f4a7be35a264de371efd70494f8ff3f819e31435e7b1ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-d, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-13T15:54:25.762 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 13 15:54:25 smithi017 ceph-mds[71545]: -- 172.21.15.17:0/2481564772 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f985caad00 con 0x55f985c7e800 2024-09-13T15:54:25.762 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 13 15:54:25 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-d[71541]: starting mds.d at 2024-09-13T15:54:25.762 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 13 15:54:25 smithi017 bash[71524]: b08731d97bbba29542f4a7be35a264de371efd70494f8ff3f819e31435e7b1ed 2024-09-13T15:54:25.762 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 13 15:54:25 smithi017 systemd[1]: Started Ceph mds.d for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T15:54:26.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:26 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:26.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:26 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:26.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:26 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:26.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:26 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:26.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:26 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:26.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:26 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:26.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:26 smithi193 ceph-mon[35248]: Deploying daemon mds.e on smithi189 2024-09-13T15:54:26.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:26 smithi193 ceph-mon[35248]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:26.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:26 smithi193 ceph-mon[35248]: mds.? [v2:172.21.15.17:6836/1730156534,v1:172.21.15.17:6837/1730156534] up:boot 2024-09-13T15:54:26.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:26 smithi193 ceph-mon[35248]: fsmap 4 up:standby 2024-09-13T15:54:26.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:26 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-13T15:54:26.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:26 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:26.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:26 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:26.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:26 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:26.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:26 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:26.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:26 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:26.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:26 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:26.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:26 smithi017 ceph-mon[30494]: Deploying daemon mds.e on smithi189 2024-09-13T15:54:26.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:26 smithi017 ceph-mon[30494]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:26.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:26 smithi017 ceph-mon[30494]: mds.? [v2:172.21.15.17:6836/1730156534,v1:172.21.15.17:6837/1730156534] up:boot 2024-09-13T15:54:26.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:26 smithi017 ceph-mon[30494]: fsmap 4 up:standby 2024-09-13T15:54:26.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:26 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-13T15:54:26.828 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:26 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:26.829 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:26 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:26.829 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:26 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:26.829 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:26 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:26.829 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:26 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:26.829 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:26 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:26.829 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:26 smithi189 ceph-mon[34790]: Deploying daemon mds.e on smithi189 2024-09-13T15:54:26.829 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:26 smithi189 ceph-mon[34790]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:26.829 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:26 smithi189 ceph-mon[34790]: mds.? [v2:172.21.15.17:6836/1730156534,v1:172.21.15.17:6837/1730156534] up:boot 2024-09-13T15:54:26.829 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:26 smithi189 ceph-mon[34790]: fsmap 4 up:standby 2024-09-13T15:54:26.829 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:26 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-13T15:54:26.998 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:54:27.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.165+0000 7f879b200640 1 -- 172.21.15.17:0/4011828787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f879c102fb0 msgr2=0x7f879c103430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:27.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.165+0000 7f879b200640 1 --2- 172.21.15.17:0/4011828787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f879c102fb0 0x7f879c103430 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8784009900 tx=0x7f878402a410 comp rx=0 tx=0).stop 2024-09-13T15:54:27.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.165+0000 7f879b200640 1 -- 172.21.15.17:0/4011828787 shutdown_connections 2024-09-13T15:54:27.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.165+0000 7f879b200640 1 --2- 172.21.15.17:0/4011828787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f879c103970 0x7f879c10a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:27.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.165+0000 7f879b200640 1 --2- 172.21.15.17:0/4011828787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f879c102fb0 0x7f879c103430 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:27.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.165+0000 7f879b200640 1 --2- 172.21.15.17:0/4011828787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f879c101dc0 0x7f879c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:27.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.165+0000 7f879b200640 1 -- 172.21.15.17:0/4011828787 >> 172.21.15.17:0/4011828787 conn(0x7f879c0fd540 msgr2=0x7f879c0ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:27.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.165+0000 7f879b200640 1 -- 172.21.15.17:0/4011828787 shutdown_connections 2024-09-13T15:54:27.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.165+0000 7f879b200640 1 -- 172.21.15.17:0/4011828787 wait complete. 2024-09-13T15:54:27.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.166+0000 7f879b200640 1 Processor -- start 2024-09-13T15:54:27.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.166+0000 7f879b200640 1 -- start start 2024-09-13T15:54:27.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.166+0000 7f879b200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f879c101dc0 0x7f879c197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:27.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.166+0000 7f879b200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f879c102fb0 0x7f879c198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:27.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.166+0000 7f879b200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f879c103970 0x7f879c19f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:27.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.166+0000 7f879b200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c19f8c0 con 0x7f879c101dc0 2024-09-13T15:54:27.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.166+0000 7f879b200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c19fa30 con 0x7f879c103970 2024-09-13T15:54:27.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.166+0000 7f879b200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c19fbf0 con 0x7f879c102fb0 2024-09-13T15:54:27.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.167+0000 7f8799e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f879c101dc0 0x7f879c197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:27.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.167+0000 7f879a800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f879c103970 0x7f879c19f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:27.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.167+0000 7f8799e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f879c101dc0 0x7f879c197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55844/0 (socket says 172.21.15.17:55844) 2024-09-13T15:54:27.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.167+0000 7f879a800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f879c103970 0x7f879c19f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:44116/0 (socket says 172.21.15.17:44116) 2024-09-13T15:54:27.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.167+0000 7f8799e00640 1 -- 172.21.15.17:0/1987771787 learned_addr learned my addr 172.21.15.17:0/1987771787 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:27.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.167+0000 7f8793e00640 1 --2- 172.21.15.17:0/1987771787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f879c102fb0 0x7f879c198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:27.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.167+0000 7f879a800640 1 -- 172.21.15.17:0/1987771787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f879c102fb0 msgr2=0x7f879c198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:27.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.167+0000 7f879a800640 1 --2- 172.21.15.17:0/1987771787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f879c102fb0 0x7f879c198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:27.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.167+0000 7f879a800640 1 -- 172.21.15.17:0/1987771787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f879c101dc0 msgr2=0x7f879c197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:27.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.167+0000 7f879a800640 1 --2- 172.21.15.17:0/1987771787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f879c101dc0 0x7f879c197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:27.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.167+0000 7f879a800640 1 -- 172.21.15.17:0/1987771787 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8784009560 con 0x7f879c103970 2024-09-13T15:54:27.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.167+0000 7f879a800640 1 --2- 172.21.15.17:0/1987771787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f879c103970 0x7f879c19f380 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8794009fd0 tx=0x7f879400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:27.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.167+0000 7f8792a00640 1 -- 172.21.15.17:0/1987771787 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879400ce20 con 0x7f879c103970 2024-09-13T15:54:27.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.167+0000 7f8792a00640 1 -- 172.21.15.17:0/1987771787 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8794005020 con 0x7f879c103970 2024-09-13T15:54:27.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.167+0000 7f8792a00640 1 -- 172.21.15.17:0/1987771787 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8794010670 con 0x7f879c103970 2024-09-13T15:54:27.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.167+0000 7f879b200640 1 -- 172.21.15.17:0/1987771787 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879c19fed0 con 0x7f879c103970 2024-09-13T15:54:27.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.168+0000 7f879b200640 1 -- 172.21.15.17:0/1987771787 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879c1a0350 con 0x7f879c103970 2024-09-13T15:54:27.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.169+0000 7f879b200640 1 -- 172.21.15.17:0/1987771787 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879c1092f0 con 0x7f879c103970 2024-09-13T15:54:27.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.170+0000 7f8792a00640 1 -- 172.21.15.17:0/1987771787 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8794005450 con 0x7f879c103970 2024-09-13T15:54:27.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.172+0000 7f8792a00640 1 --2- 172.21.15.17:0/1987771787 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f87800a1110 0x7f87800a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:27.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.172+0000 7f8792a00640 1 -- 172.21.15.17:0/1987771787 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8794014070 con 0x7f879c103970 2024-09-13T15:54:27.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.172+0000 7f8799e00640 1 --2- 172.21.15.17:0/1987771787 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f87800a1110 0x7f87800a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:27.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.173+0000 7f8799e00640 1 --2- 172.21.15.17:0/1987771787 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f87800a1110 0x7f87800a35d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f878c0058c0 tx=0x7f878c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:27.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.174+0000 7f8792a00640 1 -- 172.21.15.17:0/1987771787 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8794096660 con 0x7f879c103970 2024-09-13T15:54:27.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.392+0000 7f879b200640 1 -- 172.21.15.17:0/1987771787 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f879c10d6d0 con 0x7f879c103970 2024-09-13T15:54:27.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.393+0000 7f8792a00640 1 -- 172.21.15.17:0/1987771787 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3534 (secure 0 0 0) 0x7f8794099c80 con 0x7f879c103970 2024-09-13T15:54:27.397 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:27.397 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1730156534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1730156534},{"type":"v1","addr":"172.21.15.17:6837","nonce":1730156534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2888593680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2888593680},{"type":"v1","addr":"172.21.15.17:6835","nonce":2888593680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4}],"filesystems":[]} 2024-09-13T15:54:27.398 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 5 2024-09-13T15:54:27.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.395+0000 7f879b200640 1 -- 172.21.15.17:0/1987771787 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f87800a1110 msgr2=0x7f87800a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:27.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.395+0000 7f879b200640 1 --2- 172.21.15.17:0/1987771787 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f87800a1110 0x7f87800a35d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f878c0058c0 tx=0x7f878c005f90 comp rx=0 tx=0).stop 2024-09-13T15:54:27.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.395+0000 7f879b200640 1 -- 172.21.15.17:0/1987771787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f879c103970 msgr2=0x7f879c19f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:27.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.395+0000 7f879b200640 1 --2- 172.21.15.17:0/1987771787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f879c103970 0x7f879c19f380 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8794009fd0 tx=0x7f879400ef10 comp rx=0 tx=0).stop 2024-09-13T15:54:27.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.395+0000 7f879b200640 1 -- 172.21.15.17:0/1987771787 shutdown_connections 2024-09-13T15:54:27.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.395+0000 7f879b200640 1 --2- 172.21.15.17:0/1987771787 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f87800a1110 0x7f87800a35d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:27.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.395+0000 7f879b200640 1 --2- 172.21.15.17:0/1987771787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f879c103970 0x7f879c19f380 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:27.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.395+0000 7f879b200640 1 --2- 172.21.15.17:0/1987771787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f879c102fb0 0x7f879c198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:27.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.395+0000 7f879b200640 1 --2- 172.21.15.17:0/1987771787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f879c101dc0 0x7f879c197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:27.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.395+0000 7f879b200640 1 -- 172.21.15.17:0/1987771787 >> 172.21.15.17:0/1987771787 conn(0x7f879c0fd540 msgr2=0x7f879c1064c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:27.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.396+0000 7f879b200640 1 -- 172.21.15.17:0/1987771787 shutdown_connections 2024-09-13T15:54:27.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:27.396+0000 7f879b200640 1 -- 172.21.15.17:0/1987771787 wait complete. 2024-09-13T15:54:27.702 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:27 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1987771787' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:27.702 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 13 15:54:27 smithi189 podman[64388]: 2024-09-13 15:54:27.579974775 +0000 UTC m=+0.016235780 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T15:54:27.702 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 13 15:54:27 smithi189 podman[64388]: 2024-09-13 15:54:27.701708971 +0000 UTC m=+0.137969968 container create cd9adcd13e9cd4b61eec86f62a7b89ad2068706c25aa9b54b8f5ae6ca919225f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T15:54:27.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:27 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1987771787' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:27.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:27 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1987771787' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:27.956 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 13 15:54:27 smithi189 podman[64388]: 2024-09-13 15:54:27.929175355 +0000 UTC m=+0.365436354 container init cd9adcd13e9cd4b61eec86f62a7b89ad2068706c25aa9b54b8f5ae6ca919225f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD) 2024-09-13T15:54:27.956 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 13 15:54:27 smithi189 podman[64388]: 2024-09-13 15:54:27.932025928 +0000 UTC m=+0.368286934 container start cd9adcd13e9cd4b61eec86f62a7b89ad2068706c25aa9b54b8f5ae6ca919225f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-e, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-13T15:54:28.356 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 13 15:54:27 smithi189 ceph-mds[64408]: -- 172.21.15.189:0/3778651286 <== mon.2 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5562d0694d00 con 0x5562d0669400 2024-09-13T15:54:28.356 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 13 15:54:27 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-e[64404]: starting mds.e at 2024-09-13T15:54:28.356 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 13 15:54:28 smithi189 bash[64388]: cd9adcd13e9cd4b61eec86f62a7b89ad2068706c25aa9b54b8f5ae6ca919225f 2024-09-13T15:54:28.356 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 13 15:54:28 smithi189 systemd[1]: Started Ceph mds.e for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T15:54:29.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:29 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:29.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:29 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:29.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:29 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:29.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:29 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:29.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:29 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:29.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:29 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:29.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:29 smithi189 ceph-mon[34790]: Deploying daemon mds.f on smithi193 2024-09-13T15:54:29.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:29 smithi189 ceph-mon[34790]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:29.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:29 smithi189 ceph-mon[34790]: mds.? [v2:172.21.15.189:6834/4135454212,v1:172.21.15.189:6835/4135454212] up:boot 2024-09-13T15:54:29.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:29 smithi189 ceph-mon[34790]: fsmap 5 up:standby 2024-09-13T15:54:29.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:29 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T15:54:29.414 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:54:29.469 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:29 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:29.469 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:29 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:29.469 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:29 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:29.469 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:29 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:29.469 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:29 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:29.469 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:29 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:29.469 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:29 smithi017 ceph-mon[30494]: Deploying daemon mds.f on smithi193 2024-09-13T15:54:29.470 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:29 smithi017 ceph-mon[30494]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:29.470 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:29 smithi017 ceph-mon[30494]: mds.? [v2:172.21.15.189:6834/4135454212,v1:172.21.15.189:6835/4135454212] up:boot 2024-09-13T15:54:29.470 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:29 smithi017 ceph-mon[30494]: fsmap 5 up:standby 2024-09-13T15:54:29.470 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:29 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T15:54:29.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:29 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:29.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:29 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:29.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:29 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:29.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:29 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:29.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:29 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:29.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:29 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:29.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:29 smithi193 ceph-mon[35248]: Deploying daemon mds.f on smithi193 2024-09-13T15:54:29.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:29 smithi193 ceph-mon[35248]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:29.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:29 smithi193 ceph-mon[35248]: mds.? [v2:172.21.15.189:6834/4135454212,v1:172.21.15.189:6835/4135454212] up:boot 2024-09-13T15:54:29.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:29 smithi193 ceph-mon[35248]: fsmap 5 up:standby 2024-09-13T15:54:29.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:29 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T15:54:29.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.581+0000 7f3e82400640 1 -- 172.21.15.17:0/1195239198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e7c101fa0 msgr2=0x7f3e7c1023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:29.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.581+0000 7f3e82400640 1 --2- 172.21.15.17:0/1195239198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e7c101fa0 0x7f3e7c1023a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c009900 tx=0x7f3e6c02a3f0 comp rx=0 tx=0).stop 2024-09-13T15:54:29.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.581+0000 7f3e82400640 1 -- 172.21.15.17:0/1195239198 shutdown_connections 2024-09-13T15:54:29.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.581+0000 7f3e82400640 1 --2- 172.21.15.17:0/1195239198 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3e7c103b50 0x7f3e7c10a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:29.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.581+0000 7f3e82400640 1 --2- 172.21.15.17:0/1195239198 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e7c103190 0x7f3e7c103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:29.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.581+0000 7f3e82400640 1 --2- 172.21.15.17:0/1195239198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e7c101fa0 0x7f3e7c1023a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:29.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.581+0000 7f3e82400640 1 -- 172.21.15.17:0/1195239198 >> 172.21.15.17:0/1195239198 conn(0x7f3e7c0fd700 msgr2=0x7f3e7c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:29.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.582+0000 7f3e82400640 1 -- 172.21.15.17:0/1195239198 shutdown_connections 2024-09-13T15:54:29.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.582+0000 7f3e82400640 1 -- 172.21.15.17:0/1195239198 wait complete. 2024-09-13T15:54:29.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.582+0000 7f3e82400640 1 Processor -- start 2024-09-13T15:54:29.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.583+0000 7f3e82400640 1 -- start start 2024-09-13T15:54:29.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.583+0000 7f3e82400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e7c101fa0 0x7f3e7c197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:29.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.583+0000 7f3e82400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3e7c103190 0x7f3e7c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:29.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.583+0000 7f3e82400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e7c103b50 0x7f3e7c19f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:29.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.583+0000 7f3e82400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c19faa0 con 0x7f3e7c103b50 2024-09-13T15:54:29.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.583+0000 7f3e82400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c19fc10 con 0x7f3e7c101fa0 2024-09-13T15:54:29.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.583+0000 7f3e82400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c19fdd0 con 0x7f3e7c103190 2024-09-13T15:54:29.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.583+0000 7f3e73e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3e7c103190 0x7f3e7c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:29.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.583+0000 7f3e7be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e7c103b50 0x7f3e7c19f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:29.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.583+0000 7f3e73e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3e7c103190 0x7f3e7c1984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:45998/0 (socket says 172.21.15.17:45998) 2024-09-13T15:54:29.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.583+0000 7f3e73e00640 1 -- 172.21.15.17:0/3803818851 learned_addr learned my addr 172.21.15.17:0/3803818851 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:29.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.583+0000 7f3e7b400640 1 --2- 172.21.15.17:0/3803818851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e7c101fa0 0x7f3e7c197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:29.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.584+0000 7f3e73e00640 1 -- 172.21.15.17:0/3803818851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e7c101fa0 msgr2=0x7f3e7c197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:29.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.584+0000 7f3e73e00640 1 --2- 172.21.15.17:0/3803818851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e7c101fa0 0x7f3e7c197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:29.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.584+0000 7f3e73e00640 1 -- 172.21.15.17:0/3803818851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e7c103b50 msgr2=0x7f3e7c19f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:29.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.584+0000 7f3e73e00640 1 --2- 172.21.15.17:0/3803818851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e7c103b50 0x7f3e7c19f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:29.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.584+0000 7f3e73e00640 1 -- 172.21.15.17:0/3803818851 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c009560 con 0x7f3e7c103190 2024-09-13T15:54:29.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.584+0000 7f3e7be00640 1 --2- 172.21.15.17:0/3803818851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e7c103b50 0x7f3e7c19f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:54:29.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.584+0000 7f3e73e00640 1 --2- 172.21.15.17:0/3803818851 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3e7c103190 0x7f3e7c1984f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400e9f0 tx=0x7f3e6400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:29.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.584+0000 7f3e78c00640 1 -- 172.21.15.17:0/3803818851 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e64009700 con 0x7f3e7c103190 2024-09-13T15:54:29.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.584+0000 7f3e82400640 1 -- 172.21.15.17:0/3803818851 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7c1a00b0 con 0x7f3e7c103190 2024-09-13T15:54:29.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.584+0000 7f3e78c00640 1 -- 172.21.15.17:0/3803818851 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e6400cd80 con 0x7f3e7c103190 2024-09-13T15:54:29.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.584+0000 7f3e78c00640 1 -- 172.21.15.17:0/3803818851 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e64018860 con 0x7f3e7c103190 2024-09-13T15:54:29.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.584+0000 7f3e82400640 1 -- 172.21.15.17:0/3803818851 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7c1a0610 con 0x7f3e7c103190 2024-09-13T15:54:29.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.585+0000 7f3e82400640 1 -- 172.21.15.17:0/3803818851 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e7c109430 con 0x7f3e7c103190 2024-09-13T15:54:29.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.588+0000 7f3e78c00640 1 -- 172.21.15.17:0/3803818851 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3e640189c0 con 0x7f3e7c103190 2024-09-13T15:54:29.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.589+0000 7f3e78c00640 1 --2- 172.21.15.17:0/3803818851 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3e600a1090 0x7f3e600a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:29.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.589+0000 7f3e78c00640 1 -- 172.21.15.17:0/3803818851 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3e64014070 con 0x7f3e7c103190 2024-09-13T15:54:29.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.590+0000 7f3e7b400640 1 --2- 172.21.15.17:0/3803818851 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3e600a1090 0x7f3e600a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:29.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.590+0000 7f3e7b400640 1 --2- 172.21.15.17:0/3803818851 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3e600a1090 0x7f3e600a3550 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c031500 tx=0x7f3e6c005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:29.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.591+0000 7f3e78c00640 1 -- 172.21.15.17:0/3803818851 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3e640968b0 con 0x7f3e7c103190 2024-09-13T15:54:29.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.809+0000 7f3e82400640 1 -- 172.21.15.17:0/3803818851 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e7c1a0240 con 0x7f3e7c103190 2024-09-13T15:54:29.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.809+0000 7f3e78c00640 1 -- 172.21.15.17:0/3803818851 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4294 (secure 0 0 0) 0x7f3e7c1a0240 con 0x7f3e7c103190 2024-09-13T15:54:29.811 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:29.811 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1730156534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1730156534},{"type":"v1","addr":"172.21.15.17:6837","nonce":1730156534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2888593680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2888593680},{"type":"v1","addr":"172.21.15.17:6835","nonce":2888593680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4135454212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4135454212},{"type":"v1","addr":"172.21.15.189:6835","nonce":4135454212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2024-09-13T15:54:29.811 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 6 2024-09-13T15:54:29.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.812+0000 7f3e82400640 1 -- 172.21.15.17:0/3803818851 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3e600a1090 msgr2=0x7f3e600a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:29.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.812+0000 7f3e82400640 1 --2- 172.21.15.17:0/3803818851 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3e600a1090 0x7f3e600a3550 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c031500 tx=0x7f3e6c005780 comp rx=0 tx=0).stop 2024-09-13T15:54:29.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.812+0000 7f3e82400640 1 -- 172.21.15.17:0/3803818851 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3e7c103190 msgr2=0x7f3e7c1984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:29.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.812+0000 7f3e82400640 1 --2- 172.21.15.17:0/3803818851 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3e7c103190 0x7f3e7c1984f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400e9f0 tx=0x7f3e6400eeb0 comp rx=0 tx=0).stop 2024-09-13T15:54:29.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.812+0000 7f3e82400640 1 -- 172.21.15.17:0/3803818851 shutdown_connections 2024-09-13T15:54:29.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.812+0000 7f3e82400640 1 --2- 172.21.15.17:0/3803818851 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3e600a1090 0x7f3e600a3550 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:29.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.812+0000 7f3e82400640 1 --2- 172.21.15.17:0/3803818851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e7c103b50 0x7f3e7c19f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:29.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.812+0000 7f3e82400640 1 --2- 172.21.15.17:0/3803818851 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3e7c103190 0x7f3e7c1984f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:29.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.812+0000 7f3e82400640 1 --2- 172.21.15.17:0/3803818851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e7c101fa0 0x7f3e7c197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:29.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.812+0000 7f3e82400640 1 -- 172.21.15.17:0/3803818851 >> 172.21.15.17:0/3803818851 conn(0x7f3e7c0fd700 msgr2=0x7f3e7c106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:29.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.812+0000 7f3e82400640 1 -- 172.21.15.17:0/3803818851 shutdown_connections 2024-09-13T15:54:29.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:29.812+0000 7f3e82400640 1 -- 172.21.15.17:0/3803818851 wait complete. 2024-09-13T15:54:30.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:30 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3803818851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:30.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:30 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3803818851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:30.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:30 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3803818851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:31.004 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 13 15:54:30 smithi193 systemd[1]: Started Ceph mds.f for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T15:54:31.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:31 smithi189 ceph-mon[34790]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:31.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:31 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:31.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:31 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:31.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:31 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:31.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:31 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:31.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:31 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:31.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:31 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:31.421 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:31 smithi193 ceph-mon[35248]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:31.421 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:31 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:31.421 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:31 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:31.422 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:31 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:31.422 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:31 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:31.422 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:31 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:31.422 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:31 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:31.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:31 smithi017 ceph-mon[30494]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:31.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:31 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:31.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:31 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:31.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:31 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:31.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:31 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:31.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:31 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:31.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:31 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:31.830 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:54:32.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:31.998+0000 7f6c4f800640 1 -- 172.21.15.17:0/3589708530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c48101fb0 msgr2=0x7f6c481023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:32.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:31.998+0000 7f6c4f800640 1 --2- 172.21.15.17:0/3589708530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c48101fb0 0x7f6c481023b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c009900 tx=0x7f6c3c02a3f0 comp rx=0 tx=0).stop 2024-09-13T15:54:32.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:31.999+0000 7f6c4f800640 1 -- 172.21.15.17:0/3589708530 shutdown_connections 2024-09-13T15:54:32.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:31.999+0000 7f6c4f800640 1 --2- 172.21.15.17:0/3589708530 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c48103b60 0x7f6c4810a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:32.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:31.999+0000 7f6c4f800640 1 --2- 172.21.15.17:0/3589708530 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c481031a0 0x7f6c48103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:32.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:31.999+0000 7f6c4f800640 1 --2- 172.21.15.17:0/3589708530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c48101fb0 0x7f6c481023b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:32.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:31.999+0000 7f6c4f800640 1 -- 172.21.15.17:0/3589708530 >> 172.21.15.17:0/3589708530 conn(0x7f6c480fd730 msgr2=0x7f6c480ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:32.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:31.999+0000 7f6c4f800640 1 -- 172.21.15.17:0/3589708530 shutdown_connections 2024-09-13T15:54:32.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:31.999+0000 7f6c4f800640 1 -- 172.21.15.17:0/3589708530 wait complete. 2024-09-13T15:54:32.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:31.999+0000 7f6c4f800640 1 Processor -- start 2024-09-13T15:54:32.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.000+0000 7f6c4f800640 1 -- start start 2024-09-13T15:54:32.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.000+0000 7f6c4f800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c48101fb0 0x7f6c48198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:32.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.000+0000 7f6c4f800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c481031a0 0x7f6c48198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:32.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.000+0000 7f6c4f800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c48103b60 0x7f6c4819f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:32.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.000+0000 7f6c4f800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4819faf0 con 0x7f6c48103b60 2024-09-13T15:54:32.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.000+0000 7f6c4f800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4819fc60 con 0x7f6c48101fb0 2024-09-13T15:54:32.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.000+0000 7f6c4f800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4819fe20 con 0x7f6c481031a0 2024-09-13T15:54:32.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.000+0000 7f6c4d800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c48103b60 0x7f6c4819f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:32.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.000+0000 7f6c4d800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c48103b60 0x7f6c4819f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38152/0 (socket says 172.21.15.17:38152) 2024-09-13T15:54:32.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.000+0000 7f6c4d800640 1 -- 172.21.15.17:0/2330557826 learned_addr learned my addr 172.21.15.17:0/2330557826 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:32.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.000+0000 7f6c47e00640 1 --2- 172.21.15.17:0/2330557826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c481031a0 0x7f6c48198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:32.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.000+0000 7f6c4ce00640 1 --2- 172.21.15.17:0/2330557826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c48101fb0 0x7f6c48198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:32.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.001+0000 7f6c47e00640 1 -- 172.21.15.17:0/2330557826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c48101fb0 msgr2=0x7f6c48198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:32.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.001+0000 7f6c47e00640 1 --2- 172.21.15.17:0/2330557826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c48101fb0 0x7f6c48198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:32.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.001+0000 7f6c47e00640 1 -- 172.21.15.17:0/2330557826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c48103b60 msgr2=0x7f6c4819f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:32.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.001+0000 7f6c47e00640 1 --2- 172.21.15.17:0/2330557826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c48103b60 0x7f6c4819f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:32.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.001+0000 7f6c47e00640 1 -- 172.21.15.17:0/2330557826 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c40009840 con 0x7f6c481031a0 2024-09-13T15:54:32.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.001+0000 7f6c4d800640 1 --2- 172.21.15.17:0/2330557826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c48103b60 0x7f6c4819f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:54:32.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.001+0000 7f6c47e00640 1 --2- 172.21.15.17:0/2330557826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c481031a0 0x7f6c48198540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400e9f0 tx=0x7f6c3400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.001+0000 7f6c45600640 1 -- 172.21.15.17:0/2330557826 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3400ccc0 con 0x7f6c481031a0 2024-09-13T15:54:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.001+0000 7f6c4f800640 1 -- 172.21.15.17:0/2330557826 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3c009560 con 0x7f6c481031a0 2024-09-13T15:54:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.001+0000 7f6c45600640 1 -- 172.21.15.17:0/2330557826 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c3400ce20 con 0x7f6c481031a0 2024-09-13T15:54:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.001+0000 7f6c45600640 1 -- 172.21.15.17:0/2330557826 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c34004a00 con 0x7f6c481031a0 2024-09-13T15:54:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.001+0000 7f6c4f800640 1 -- 172.21.15.17:0/2330557826 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c481a0480 con 0x7f6c481031a0 2024-09-13T15:54:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.002+0000 7f6c4f800640 1 -- 172.21.15.17:0/2330557826 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c48109460 con 0x7f6c481031a0 2024-09-13T15:54:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.004+0000 7f6c45600640 1 -- 172.21.15.17:0/2330557826 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6c34005020 con 0x7f6c481031a0 2024-09-13T15:54:32.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.006+0000 7f6c45600640 1 --2- 172.21.15.17:0/2330557826 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6c300a1110 0x7f6c300a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:32.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.006+0000 7f6c45600640 1 -- 172.21.15.17:0/2330557826 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6c34014070 con 0x7f6c481031a0 2024-09-13T15:54:32.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.006+0000 7f6c4ce00640 1 --2- 172.21.15.17:0/2330557826 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6c300a1110 0x7f6c300a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:32.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.006+0000 7f6c4ce00640 1 --2- 172.21.15.17:0/2330557826 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6c300a1110 0x7f6c300a35d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c031500 tx=0x7f6c3c005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:32.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.007+0000 7f6c45600640 1 -- 172.21.15.17:0/2330557826 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6c34096660 con 0x7f6c481031a0 2024-09-13T15:54:32.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.230+0000 7f6c4f800640 1 -- 172.21.15.17:0/2330557826 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c4810d8c0 con 0x7f6c481031a0 2024-09-13T15:54:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.231+0000 7f6c45600640 1 -- 172.21.15.17:0/2330557826 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5054 (secure 0 0 0) 0x7f6c34099c80 con 0x7f6c481031a0 2024-09-13T15:54:32.233 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:32.233 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1730156534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1730156534},{"type":"v1","addr":"172.21.15.17:6837","nonce":1730156534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2888593680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2888593680},{"type":"v1","addr":"172.21.15.17:6835","nonce":2888593680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4135454212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4135454212},{"type":"v1","addr":"172.21.15.189:6835","nonce":4135454212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24520,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/4049465204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":4049465204},{"type":"v1","addr":"172.21.15.193:6835","nonce":4049465204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[]} 2024-09-13T15:54:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2024-09-13T15:54:32.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.234+0000 7f6c4f800640 1 -- 172.21.15.17:0/2330557826 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6c300a1110 msgr2=0x7f6c300a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:32.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.234+0000 7f6c4f800640 1 --2- 172.21.15.17:0/2330557826 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6c300a1110 0x7f6c300a35d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c031500 tx=0x7f6c3c005780 comp rx=0 tx=0).stop 2024-09-13T15:54:32.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.234+0000 7f6c4f800640 1 -- 172.21.15.17:0/2330557826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c481031a0 msgr2=0x7f6c48198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:32.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.234+0000 7f6c4f800640 1 --2- 172.21.15.17:0/2330557826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c481031a0 0x7f6c48198540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400e9f0 tx=0x7f6c3400eeb0 comp rx=0 tx=0).stop 2024-09-13T15:54:32.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.234+0000 7f6c4f800640 1 -- 172.21.15.17:0/2330557826 shutdown_connections 2024-09-13T15:54:32.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.234+0000 7f6c4f800640 1 --2- 172.21.15.17:0/2330557826 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6c300a1110 0x7f6c300a35d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:32.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.234+0000 7f6c4f800640 1 --2- 172.21.15.17:0/2330557826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c48103b60 0x7f6c4819f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:32.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.234+0000 7f6c4f800640 1 --2- 172.21.15.17:0/2330557826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c481031a0 0x7f6c48198540 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:32.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.234+0000 7f6c4f800640 1 --2- 172.21.15.17:0/2330557826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c48101fb0 0x7f6c48198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:32.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.234+0000 7f6c4f800640 1 -- 172.21.15.17:0/2330557826 >> 172.21.15.17:0/2330557826 conn(0x7f6c480fd730 msgr2=0x7f6c48106630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:32.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.234+0000 7f6c4f800640 1 -- 172.21.15.17:0/2330557826 shutdown_connections 2024-09-13T15:54:32.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:32.234+0000 7f6c4f800640 1 -- 172.21.15.17:0/2330557826 wait complete. 2024-09-13T15:54:32.249 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:32 smithi017 ceph-mon[30494]: Deploying daemon mds.c on smithi193 2024-09-13T15:54:32.249 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:32 smithi017 ceph-mon[30494]: mds.? [v2:172.21.15.193:6834/4049465204,v1:172.21.15.193:6835/4049465204] up:boot 2024-09-13T15:54:32.249 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:32 smithi017 ceph-mon[30494]: fsmap 6 up:standby 2024-09-13T15:54:32.249 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:32 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T15:54:32.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:32 smithi189 ceph-mon[34790]: Deploying daemon mds.c on smithi193 2024-09-13T15:54:32.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:32 smithi189 ceph-mon[34790]: mds.? [v2:172.21.15.193:6834/4049465204,v1:172.21.15.193:6835/4049465204] up:boot 2024-09-13T15:54:32.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:32 smithi189 ceph-mon[34790]: fsmap 6 up:standby 2024-09-13T15:54:32.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:32 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T15:54:32.388 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:32 smithi193 ceph-mon[35248]: Deploying daemon mds.c on smithi193 2024-09-13T15:54:32.388 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:32 smithi193 ceph-mon[35248]: mds.? [v2:172.21.15.193:6834/4049465204,v1:172.21.15.193:6835/4049465204] up:boot 2024-09-13T15:54:32.388 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:32 smithi193 ceph-mon[35248]: fsmap 6 up:standby 2024-09-13T15:54:32.388 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:32 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T15:54:32.754 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 13 15:54:32 smithi193 systemd[1]: Starting Ceph mds.c for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T15:54:33.088 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 13 15:54:32 smithi193 podman[65477]: 2024-09-13 15:54:32.693899188 +0000 UTC m=+0.015913886 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T15:54:33.088 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 13 15:54:32 smithi193 podman[65477]: 2024-09-13 15:54:32.809837192 +0000 UTC m=+0.131851915 container create b39c8b57f39f5194be55c1122fe1e49ab1e15a1e23e895b480dfa342252b8548 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-c, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-13T15:54:33.088 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 13 15:54:33 smithi193 podman[65477]: 2024-09-13 15:54:33.087495989 +0000 UTC m=+0.409510679 container init b39c8b57f39f5194be55c1122fe1e49ab1e15a1e23e895b480dfa342252b8548 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-c, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-13T15:54:33.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:33 smithi189 ceph-mon[34790]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:33.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:33 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/2330557826' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:33.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:33 smithi193 ceph-mon[35248]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:33.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:33 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/2330557826' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:33.504 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 13 15:54:33 smithi193 podman[65477]: 2024-09-13 15:54:33.090444315 +0000 UTC m=+0.412459005 container start b39c8b57f39f5194be55c1122fe1e49ab1e15a1e23e895b480dfa342252b8548 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-c, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-13T15:54:33.505 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 13 15:54:33 smithi193 ceph-mds[65496]: -- 172.21.15.193:0/3599233765 <== mon.1 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559094462d00 con 0x559094436800 2024-09-13T15:54:33.505 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 13 15:54:33 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-c[65492]: starting mds.c at 2024-09-13T15:54:33.505 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 13 15:54:33 smithi193 bash[65477]: b39c8b57f39f5194be55c1122fe1e49ab1e15a1e23e895b480dfa342252b8548 2024-09-13T15:54:33.505 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 13 15:54:33 smithi193 systemd[1]: Started Ceph mds.c for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T15:54:33.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:33 smithi017 ceph-mon[30494]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:33.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:33 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/2330557826' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:34.252 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:54:34.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.420+0000 7f0338c00640 1 -- 172.21.15.17:0/3292479218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0334101db0 msgr2=0x7f03341021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:34.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.420+0000 7f0338c00640 1 --2- 172.21.15.17:0/3292479218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0334101db0 0x7f03341021b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0324009900 tx=0x7f032402a410 comp rx=0 tx=0).stop 2024-09-13T15:54:34.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.420+0000 7f0338c00640 1 -- 172.21.15.17:0/3292479218 shutdown_connections 2024-09-13T15:54:34.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.420+0000 7f0338c00640 1 --2- 172.21.15.17:0/3292479218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0334103960 0x7f033410a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:34.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.420+0000 7f0338c00640 1 --2- 172.21.15.17:0/3292479218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0334102fa0 0x7f0334103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:34.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.420+0000 7f0338c00640 1 --2- 172.21.15.17:0/3292479218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0334101db0 0x7f03341021b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:34.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.420+0000 7f0338c00640 1 -- 172.21.15.17:0/3292479218 >> 172.21.15.17:0/3292479218 conn(0x7f03340fd530 msgr2=0x7f03340ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:34.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.420+0000 7f0338c00640 1 -- 172.21.15.17:0/3292479218 shutdown_connections 2024-09-13T15:54:34.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.420+0000 7f0338c00640 1 -- 172.21.15.17:0/3292479218 wait complete. 2024-09-13T15:54:34.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.421+0000 7f0338c00640 1 Processor -- start 2024-09-13T15:54:34.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.421+0000 7f0338c00640 1 -- start start 2024-09-13T15:54:34.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.421+0000 7f0338c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0334101db0 0x7f0334197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:34.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.421+0000 7f0338c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0334102fa0 0x7f0334198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:34.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.421+0000 7f0338c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0334103960 0x7f033419f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:34.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.421+0000 7f0338c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033419f830 con 0x7f0334102fa0 2024-09-13T15:54:34.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.421+0000 7f0338c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033419f9a0 con 0x7f0334101db0 2024-09-13T15:54:34.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.421+0000 7f0338c00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033419fb60 con 0x7f0334103960 2024-09-13T15:54:34.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.421+0000 7f032aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0334102fa0 0x7f0334198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:34.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.421+0000 7f0333400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0334101db0 0x7f0334197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:34.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.421+0000 7f0333400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0334101db0 0x7f0334197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:55176/0 (socket says 172.21.15.17:55176) 2024-09-13T15:54:34.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.421+0000 7f032aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0334102fa0 0x7f0334198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38172/0 (socket says 172.21.15.17:38172) 2024-09-13T15:54:34.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.421+0000 7f0333400640 1 -- 172.21.15.17:0/7003397 learned_addr learned my addr 172.21.15.17:0/7003397 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:34.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.422+0000 7f0333e00640 1 --2- 172.21.15.17:0/7003397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0334103960 0x7f033419f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:34.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.422+0000 7f0333400640 1 -- 172.21.15.17:0/7003397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0334103960 msgr2=0x7f033419f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:34.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.422+0000 7f0333400640 1 --2- 172.21.15.17:0/7003397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0334103960 0x7f033419f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:34.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.422+0000 7f0333400640 1 -- 172.21.15.17:0/7003397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0334102fa0 msgr2=0x7f0334198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:34.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.422+0000 7f0333400640 1 --2- 172.21.15.17:0/7003397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0334102fa0 0x7f0334198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:34.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.422+0000 7f0333400640 1 -- 172.21.15.17:0/7003397 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031c009490 con 0x7f0334101db0 2024-09-13T15:54:34.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.422+0000 7f032aa00640 1 --2- 172.21.15.17:0/7003397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0334102fa0 0x7f0334198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:54:34.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.422+0000 7f0333400640 1 --2- 172.21.15.17:0/7003397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0334101db0 0x7f0334197d50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f03240057c0 tx=0x7f03240055a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:34.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.422+0000 7f0330c00640 1 -- 172.21.15.17:0/7003397 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324004bd0 con 0x7f0334101db0 2024-09-13T15:54:34.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.422+0000 7f0338c00640 1 -- 172.21.15.17:0/7003397 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0324009560 con 0x7f0334101db0 2024-09-13T15:54:34.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.422+0000 7f0330c00640 1 -- 172.21.15.17:0/7003397 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0324004d30 con 0x7f0334101db0 2024-09-13T15:54:34.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.422+0000 7f0330c00640 1 -- 172.21.15.17:0/7003397 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324031b60 con 0x7f0334101db0 2024-09-13T15:54:34.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.423+0000 7f0338c00640 1 -- 172.21.15.17:0/7003397 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03341a0100 con 0x7f0334101db0 2024-09-13T15:54:34.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.423+0000 7f0338c00640 1 -- 172.21.15.17:0/7003397 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f033410d670 con 0x7f0334101db0 2024-09-13T15:54:34.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.425+0000 7f0330c00640 1 -- 172.21.15.17:0/7003397 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0324003cb0 con 0x7f0334101db0 2024-09-13T15:54:34.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.427+0000 7f0330c00640 1 --2- 172.21.15.17:0/7003397 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f03180a1090 0x7f03180a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:34.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.427+0000 7f0330c00640 1 -- 172.21.15.17:0/7003397 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f03240ed6e0 con 0x7f0334101db0 2024-09-13T15:54:34.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.427+0000 7f032aa00640 1 --2- 172.21.15.17:0/7003397 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f03180a1090 0x7f03180a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:34.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.428+0000 7f032aa00640 1 --2- 172.21.15.17:0/7003397 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f03180a1090 0x7f03180a3550 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f031c011630 tx=0x7f031c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:34.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.429+0000 7f0330c00640 1 -- 172.21.15.17:0/7003397 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f03240b7290 con 0x7f0334101db0 2024-09-13T15:54:34.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:34.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:34.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:34.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:34.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:34.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:34.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:34 smithi193 ceph-mon[35248]: Deploying daemon mds.h on smithi189 2024-09-13T15:54:34.507 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:34 smithi193 ceph-mon[35248]: mds.? [v2:172.21.15.193:6836/792056943,v1:172.21.15.193:6837/792056943] up:boot 2024-09-13T15:54:34.507 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:34 smithi193 ceph-mon[35248]: fsmap 7 up:standby 2024-09-13T15:54:34.507 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T15:54:34.507 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:34 smithi193 ceph-mon[35248]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:34.519 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:34.519 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:34.519 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:34.520 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:34.520 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:34.520 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:34.520 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:34 smithi017 ceph-mon[30494]: Deploying daemon mds.h on smithi189 2024-09-13T15:54:34.520 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:34 smithi017 ceph-mon[30494]: mds.? [v2:172.21.15.193:6836/792056943,v1:172.21.15.193:6837/792056943] up:boot 2024-09-13T15:54:34.520 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:34 smithi017 ceph-mon[30494]: fsmap 7 up:standby 2024-09-13T15:54:34.520 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T15:54:34.520 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:34 smithi017 ceph-mon[30494]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:34.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:34 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:34.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:34 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:34.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:34 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:34.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:34 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:34.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:34 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:34.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:34 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:34.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:34 smithi189 ceph-mon[34790]: Deploying daemon mds.h on smithi189 2024-09-13T15:54:34.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:34 smithi189 ceph-mon[34790]: mds.? [v2:172.21.15.193:6836/792056943,v1:172.21.15.193:6837/792056943] up:boot 2024-09-13T15:54:34.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:34 smithi189 ceph-mon[34790]: fsmap 7 up:standby 2024-09-13T15:54:34.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:34 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T15:54:34.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:34 smithi189 ceph-mon[34790]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:34.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.645+0000 7f0338c00640 1 -- 172.21.15.17:0/7003397 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f033410d880 con 0x7f0334101db0 2024-09-13T15:54:34.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.646+0000 7f0330c00640 1 -- 172.21.15.17:0/7003397 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5811 (secure 0 0 0) 0x7f03240b91c0 con 0x7f0334101db0 2024-09-13T15:54:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:34.648 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1730156534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1730156534},{"type":"v1","addr":"172.21.15.17:6837","nonce":1730156534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2888593680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2888593680},{"type":"v1","addr":"172.21.15.17:6835","nonce":2888593680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4135454212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4135454212},{"type":"v1","addr":"172.21.15.189:6835","nonce":4135454212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24520,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/4049465204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":4049465204},{"type":"v1","addr":"172.21.15.193:6835","nonce":4049465204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/792056943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":792056943},{"type":"v1","addr":"172.21.15.193:6837","nonce":792056943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2024-09-13T15:54:34.648 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 8 2024-09-13T15:54:34.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.648+0000 7f0338c00640 1 -- 172.21.15.17:0/7003397 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f03180a1090 msgr2=0x7f03180a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:34.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.648+0000 7f0338c00640 1 --2- 172.21.15.17:0/7003397 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f03180a1090 0x7f03180a3550 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f031c011630 tx=0x7f031c005f90 comp rx=0 tx=0).stop 2024-09-13T15:54:34.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.648+0000 7f0338c00640 1 -- 172.21.15.17:0/7003397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0334101db0 msgr2=0x7f0334197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:34.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.648+0000 7f0338c00640 1 --2- 172.21.15.17:0/7003397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0334101db0 0x7f0334197d50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f03240057c0 tx=0x7f03240055a0 comp rx=0 tx=0).stop 2024-09-13T15:54:34.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.648+0000 7f0338c00640 1 -- 172.21.15.17:0/7003397 shutdown_connections 2024-09-13T15:54:34.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.648+0000 7f0338c00640 1 --2- 172.21.15.17:0/7003397 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f03180a1090 0x7f03180a3550 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:34.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.648+0000 7f0338c00640 1 --2- 172.21.15.17:0/7003397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0334103960 0x7f033419f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:34.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.648+0000 7f0338c00640 1 --2- 172.21.15.17:0/7003397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0334102fa0 0x7f0334198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:34.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.648+0000 7f0338c00640 1 --2- 172.21.15.17:0/7003397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0334101db0 0x7f0334197d50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:34.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.648+0000 7f0338c00640 1 -- 172.21.15.17:0/7003397 >> 172.21.15.17:0/7003397 conn(0x7f03340fd530 msgr2=0x7f03340ff760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:34.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.648+0000 7f0338c00640 1 -- 172.21.15.17:0/7003397 shutdown_connections 2024-09-13T15:54:34.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:34.648+0000 7f0338c00640 1 -- 172.21.15.17:0/7003397 wait complete. 2024-09-13T15:54:35.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:35 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/7003397' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:35.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:35 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/7003397' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:35.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:35 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/7003397' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:36.106 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 13 15:54:35 smithi189 systemd[1]: Started Ceph mds.h for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T15:54:36.667 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:54:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.834+0000 7f30a2400640 1 -- 172.21.15.17:0/3088271506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f309c103150 msgr2=0x7f309c105540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.834+0000 7f30a2400640 1 --2- 172.21.15.17:0/3088271506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f309c103150 0x7f309c105540 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3088009900 tx=0x7f308802a410 comp rx=0 tx=0).stop 2024-09-13T15:54:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.834+0000 7f30a2400640 1 -- 172.21.15.17:0/3088271506 shutdown_connections 2024-09-13T15:54:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.834+0000 7f30a2400640 1 --2- 172.21.15.17:0/3088271506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f309c105a80 0x7f309c107ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.834+0000 7f30a2400640 1 --2- 172.21.15.17:0/3088271506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f309c103150 0x7f309c105540 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.834+0000 7f30a2400640 1 --2- 172.21.15.17:0/3088271506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f309c100820 0x7f309c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:36.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.834+0000 7f30a2400640 1 -- 172.21.15.17:0/3088271506 >> 172.21.15.17:0/3088271506 conn(0x7f309c0fa420 msgr2=0x7f309c0fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:36.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.834+0000 7f30a2400640 1 -- 172.21.15.17:0/3088271506 shutdown_connections 2024-09-13T15:54:36.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.834+0000 7f30a2400640 1 -- 172.21.15.17:0/3088271506 wait complete. 2024-09-13T15:54:36.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.835+0000 7f30a2400640 1 Processor -- start 2024-09-13T15:54:36.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.835+0000 7f30a2400640 1 -- start start 2024-09-13T15:54:36.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.835+0000 7f30a2400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f309c100820 0x7f309c195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:36.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.835+0000 7f30a2400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f309c103150 0x7f309c1963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:36.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.835+0000 7f30a2400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f309c105a80 0x7f309c19d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:36.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.836+0000 7f30a2400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c19d960 con 0x7f309c100820 2024-09-13T15:54:36.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.836+0000 7f30a2400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c19dad0 con 0x7f309c103150 2024-09-13T15:54:36.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.836+0000 7f30a2400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c19dc90 con 0x7f309c105a80 2024-09-13T15:54:36.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.836+0000 7f309b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f309c100820 0x7f309c195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:36.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.836+0000 7f309b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f309c100820 0x7f309c195e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38192/0 (socket says 172.21.15.17:38192) 2024-09-13T15:54:36.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.836+0000 7f309b400640 1 -- 172.21.15.17:0/59341934 learned_addr learned my addr 172.21.15.17:0/59341934 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:36.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.836+0000 7f309aa00640 1 --2- 172.21.15.17:0/59341934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f309c103150 0x7f309c1963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:36.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.836+0000 7f309be00640 1 --2- 172.21.15.17:0/59341934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f309c105a80 0x7f309c19d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:36.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.836+0000 7f309b400640 1 -- 172.21.15.17:0/59341934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f309c105a80 msgr2=0x7f309c19d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:36.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.836+0000 7f309b400640 1 --2- 172.21.15.17:0/59341934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f309c105a80 0x7f309c19d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:36.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.836+0000 7f309b400640 1 -- 172.21.15.17:0/59341934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f309c103150 msgr2=0x7f309c1963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:36.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.836+0000 7f309b400640 1 --2- 172.21.15.17:0/59341934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f309c103150 0x7f309c1963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:36.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.836+0000 7f309b400640 1 -- 172.21.15.17:0/59341934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3088009560 con 0x7f309c100820 2024-09-13T15:54:36.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.836+0000 7f309b400640 1 --2- 172.21.15.17:0/59341934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f309c100820 0x7f309c195e70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f308c00e9f0 tx=0x7f308c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:36.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.837+0000 7f3093e00640 1 -- 172.21.15.17:0/59341934 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c009700 con 0x7f309c100820 2024-09-13T15:54:36.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.837+0000 7f3093e00640 1 -- 172.21.15.17:0/59341934 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f308c00cd80 con 0x7f309c100820 2024-09-13T15:54:36.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.837+0000 7f30a2400640 1 -- 172.21.15.17:0/59341934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309c19df70 con 0x7f309c100820 2024-09-13T15:54:36.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.837+0000 7f3093e00640 1 -- 172.21.15.17:0/59341934 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c018860 con 0x7f309c100820 2024-09-13T15:54:36.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.837+0000 7f30a2400640 1 -- 172.21.15.17:0/59341934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309c19e390 con 0x7f309c100820 2024-09-13T15:54:36.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.838+0000 7f30a2400640 1 -- 172.21.15.17:0/59341934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f309c0fbf10 con 0x7f309c100820 2024-09-13T15:54:36.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.840+0000 7f3093e00640 1 -- 172.21.15.17:0/59341934 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f308c0189c0 con 0x7f309c100820 2024-09-13T15:54:36.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.841+0000 7f3093e00640 1 --2- 172.21.15.17:0/59341934 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30800a1090 0x7f30800a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:36.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.842+0000 7f3093e00640 1 -- 172.21.15.17:0/59341934 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f308c014070 con 0x7f309c100820 2024-09-13T15:54:36.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.842+0000 7f309aa00640 1 --2- 172.21.15.17:0/59341934 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30800a1090 0x7f30800a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:36.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.842+0000 7f309aa00640 1 --2- 172.21.15.17:0/59341934 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30800a1090 0x7f30800a3550 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3088031500 tx=0x7f30880058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:36.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:36.846+0000 7f3093e00640 1 -- 172.21.15.17:0/59341934 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f308c052e20 con 0x7f309c100820 2024-09-13T15:54:37.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:36 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:37.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:36 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:37.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:36 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:37.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:36 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:37.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:36 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:37.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:36 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:37.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:36 smithi017 ceph-mon[30494]: Deploying daemon mds.i on smithi193 2024-09-13T15:54:37.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:36 smithi017 ceph-mon[30494]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:37.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:36 smithi017 ceph-mon[30494]: mds.? [v2:172.21.15.189:6836/2079181485,v1:172.21.15.189:6837/2079181485] up:boot 2024-09-13T15:54:37.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:36 smithi017 ceph-mon[30494]: fsmap 8 up:standby 2024-09-13T15:54:37.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:36 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T15:54:37.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:37.063+0000 7f30a2400640 1 -- 172.21.15.17:0/59341934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f309c10b6a0 con 0x7f309c100820 2024-09-13T15:54:37.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:37.063+0000 7f3093e00640 1 -- 172.21.15.17:0/59341934 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6571 (secure 0 0 0) 0x7f309c10b6a0 con 0x7f309c100820 2024-09-13T15:54:37.065 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:37.066 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1730156534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1730156534},{"type":"v1","addr":"172.21.15.17:6837","nonce":1730156534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2888593680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2888593680},{"type":"v1","addr":"172.21.15.17:6835","nonce":2888593680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4135454212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4135454212},{"type":"v1","addr":"172.21.15.189:6835","nonce":4135454212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24520,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/4049465204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":4049465204},{"type":"v1","addr":"172.21.15.193:6835","nonce":4049465204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24524,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/2079181485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2079181485},{"type":"v1","addr":"172.21.15.189:6837","nonce":2079181485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/792056943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":792056943},{"type":"v1","addr":"172.21.15.193:6837","nonce":792056943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2024-09-13T15:54:37.066 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 9 2024-09-13T15:54:37.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:37.065+0000 7f30a2400640 1 -- 172.21.15.17:0/59341934 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30800a1090 msgr2=0x7f30800a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:37.065+0000 7f30a2400640 1 --2- 172.21.15.17:0/59341934 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30800a1090 0x7f30800a3550 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3088031500 tx=0x7f30880058d0 comp rx=0 tx=0).stop 2024-09-13T15:54:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:37.065+0000 7f30a2400640 1 -- 172.21.15.17:0/59341934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f309c100820 msgr2=0x7f309c195e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:37.065+0000 7f30a2400640 1 --2- 172.21.15.17:0/59341934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f309c100820 0x7f309c195e70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f308c00e9f0 tx=0x7f308c00eeb0 comp rx=0 tx=0).stop 2024-09-13T15:54:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:37.066+0000 7f30a2400640 1 -- 172.21.15.17:0/59341934 shutdown_connections 2024-09-13T15:54:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:37.066+0000 7f30a2400640 1 --2- 172.21.15.17:0/59341934 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30800a1090 0x7f30800a3550 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:37.066+0000 7f30a2400640 1 --2- 172.21.15.17:0/59341934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f309c105a80 0x7f309c19d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:37.066+0000 7f30a2400640 1 --2- 172.21.15.17:0/59341934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f309c103150 0x7f309c1963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:37.066+0000 7f30a2400640 1 --2- 172.21.15.17:0/59341934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f309c100820 0x7f309c195e70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:37.066+0000 7f30a2400640 1 -- 172.21.15.17:0/59341934 >> 172.21.15.17:0/59341934 conn(0x7f309c0fa420 msgr2=0x7f309c101140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:37.066+0000 7f30a2400640 1 -- 172.21.15.17:0/59341934 shutdown_connections 2024-09-13T15:54:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:37.066+0000 7f30a2400640 1 -- 172.21.15.17:0/59341934 wait complete. 2024-09-13T15:54:37.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:36 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:37.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:36 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:37.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:36 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:37.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:36 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:37.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:36 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:37.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:36 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:37.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:36 smithi193 ceph-mon[35248]: Deploying daemon mds.i on smithi193 2024-09-13T15:54:37.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:36 smithi193 ceph-mon[35248]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:37.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:36 smithi193 ceph-mon[35248]: mds.? [v2:172.21.15.189:6836/2079181485,v1:172.21.15.189:6837/2079181485] up:boot 2024-09-13T15:54:37.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:36 smithi193 ceph-mon[35248]: fsmap 8 up:standby 2024-09-13T15:54:37.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:36 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T15:54:37.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:36 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:37.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:36 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:37.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:36 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:37.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:36 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:37.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:36 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:37.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:36 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:37.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:36 smithi189 ceph-mon[34790]: Deploying daemon mds.i on smithi193 2024-09-13T15:54:37.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:36 smithi189 ceph-mon[34790]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:37.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:36 smithi189 ceph-mon[34790]: mds.? [v2:172.21.15.189:6836/2079181485,v1:172.21.15.189:6837/2079181485] up:boot 2024-09-13T15:54:37.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:36 smithi189 ceph-mon[34790]: fsmap 8 up:standby 2024-09-13T15:54:37.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:36 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T15:54:37.898 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 13 15:54:37 smithi193 systemd[1]: Starting Ceph mds.i for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T15:54:38.155 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:37 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/59341934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:38.155 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 13 15:54:38 smithi193 podman[65783]: 2024-09-13 15:54:37.912256129 +0000 UTC m=+0.016304535 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T15:54:38.155 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 13 15:54:38 smithi193 podman[65783]: 2024-09-13 15:54:38.032214191 +0000 UTC m=+0.136262625 container create 47a924b6838ef815fee5fdc87404b9b4e4bc82b4e656a03204f312137c99072b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T15:54:38.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:37 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/59341934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:38.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:37 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/59341934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:38.754 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 13 15:54:38 smithi193 podman[65783]: 2024-09-13 15:54:38.293235127 +0000 UTC m=+0.397283519 container init 47a924b6838ef815fee5fdc87404b9b4e4bc82b4e656a03204f312137c99072b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-i, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-13T15:54:38.754 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 13 15:54:38 smithi193 podman[65783]: 2024-09-13 15:54:38.295968577 +0000 UTC m=+0.400016969 container start 47a924b6838ef815fee5fdc87404b9b4e4bc82b4e656a03204f312137c99072b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-i, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-13T15:54:38.754 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 13 15:54:38 smithi193 ceph-mds[65802]: -- 172.21.15.193:0/2529119557 <== mon.1 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c040066d00 con 0x55c04003a800 2024-09-13T15:54:38.754 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 13 15:54:38 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-i[65798]: starting mds.i at 2024-09-13T15:54:38.754 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 13 15:54:38 smithi193 bash[65783]: 47a924b6838ef815fee5fdc87404b9b4e4bc82b4e656a03204f312137c99072b 2024-09-13T15:54:38.754 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 13 15:54:38 smithi193 systemd[1]: Started Ceph mds.i for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T15:54:39.085 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:54:39.173 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:38 smithi017 ceph-mon[30494]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:39.173 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:38 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:39.173 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:38 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:39.173 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:38 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:39.173 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:38 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:39.173 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:38 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:39.173 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:38 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:39.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.246+0000 7fbb24200640 1 -- 172.21.15.17:0/1490322380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb1c1031a0 msgr2=0x7fbb1c103620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:39.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.246+0000 7fbb24200640 1 --2- 172.21.15.17:0/1490322380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb1c1031a0 0x7fbb1c103620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009860 tx=0x7fbb0802a340 comp rx=0 tx=0).stop 2024-09-13T15:54:39.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.246+0000 7fbb24200640 1 -- 172.21.15.17:0/1490322380 shutdown_connections 2024-09-13T15:54:39.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.246+0000 7fbb24200640 1 --2- 172.21.15.17:0/1490322380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb1c103b60 0x7fbb1c10a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:39.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.246+0000 7fbb24200640 1 --2- 172.21.15.17:0/1490322380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb1c1031a0 0x7fbb1c103620 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:39.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.246+0000 7fbb24200640 1 --2- 172.21.15.17:0/1490322380 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb1c101fb0 0x7fbb1c1023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:39.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.246+0000 7fbb24200640 1 -- 172.21.15.17:0/1490322380 >> 172.21.15.17:0/1490322380 conn(0x7fbb1c0fd730 msgr2=0x7fbb1c0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:39.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.246+0000 7fbb24200640 1 -- 172.21.15.17:0/1490322380 shutdown_connections 2024-09-13T15:54:39.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.246+0000 7fbb24200640 1 -- 172.21.15.17:0/1490322380 wait complete. 2024-09-13T15:54:39.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.247+0000 7fbb24200640 1 Processor -- start 2024-09-13T15:54:39.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.247+0000 7fbb24200640 1 -- start start 2024-09-13T15:54:39.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.248+0000 7fbb24200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb1c101fb0 0x7fbb1c198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:39.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.248+0000 7fbb24200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb1c1031a0 0x7fbb1c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:39.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.248+0000 7fbb24200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb1c103b60 0x7fbb1c19f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:39.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.248+0000 7fbb24200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c19faf0 con 0x7fbb1c103b60 2024-09-13T15:54:39.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.248+0000 7fbb24200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c19fc60 con 0x7fbb1c101fb0 2024-09-13T15:54:39.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.248+0000 7fbb24200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c19fe20 con 0x7fbb1c1031a0 2024-09-13T15:54:39.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.248+0000 7fbb22200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb1c103b60 0x7fbb1c19f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:39.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.248+0000 7fbb21800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb1c101fb0 0x7fbb1c198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:39.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.248+0000 7fbb21800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb1c101fb0 0x7fbb1c198000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:35046/0 (socket says 172.21.15.17:35046) 2024-09-13T15:54:39.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.248+0000 7fbb21800640 1 -- 172.21.15.17:0/4119854405 learned_addr learned my addr 172.21.15.17:0/4119854405 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:39.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.248+0000 7fbb22200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb1c103b60 0x7fbb1c19f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55570/0 (socket says 172.21.15.17:55570) 2024-09-13T15:54:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.248+0000 7fbb20e00640 1 --2- 172.21.15.17:0/4119854405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb1c1031a0 0x7fbb1c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.248+0000 7fbb21800640 1 -- 172.21.15.17:0/4119854405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb1c1031a0 msgr2=0x7fbb1c198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.248+0000 7fbb21800640 1 --2- 172.21.15.17:0/4119854405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb1c1031a0 0x7fbb1c198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.248+0000 7fbb21800640 1 -- 172.21.15.17:0/4119854405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb1c103b60 msgr2=0x7fbb1c19f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.248+0000 7fbb21800640 1 --2- 172.21.15.17:0/4119854405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb1c103b60 0x7fbb1c19f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.248+0000 7fbb21800640 1 -- 172.21.15.17:0/4119854405 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb08009490 con 0x7fbb1c101fb0 2024-09-13T15:54:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.248+0000 7fbb22200640 1 --2- 172.21.15.17:0/4119854405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb1c103b60 0x7fbb1c19f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:54:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.249+0000 7fbb21800640 1 --2- 172.21.15.17:0/4119854405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb1c101fb0 0x7fbb1c198000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000e9f0 tx=0x7fbb1000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.249+0000 7fbb1a000640 1 -- 172.21.15.17:0/4119854405 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1000ccc0 con 0x7fbb1c101fb0 2024-09-13T15:54:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.249+0000 7fbb1a000640 1 -- 172.21.15.17:0/4119854405 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb100044f0 con 0x7fbb1c101fb0 2024-09-13T15:54:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.249+0000 7fbb24200640 1 -- 172.21.15.17:0/4119854405 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1c1a0100 con 0x7fbb1c101fb0 2024-09-13T15:54:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.249+0000 7fbb1a000640 1 -- 172.21.15.17:0/4119854405 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb10010430 con 0x7fbb1c101fb0 2024-09-13T15:54:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.249+0000 7fbb24200640 1 -- 172.21.15.17:0/4119854405 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1c1a0590 con 0x7fbb1c101fb0 2024-09-13T15:54:39.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.250+0000 7fbb24200640 1 -- 172.21.15.17:0/4119854405 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1c1094e0 con 0x7fbb1c101fb0 2024-09-13T15:54:39.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.252+0000 7fbb1a000640 1 -- 172.21.15.17:0/4119854405 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fbb10003ed0 con 0x7fbb1c101fb0 2024-09-13T15:54:39.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:38 smithi193 ceph-mon[35248]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:39.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:38 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:39.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:38 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:39.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:38 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:39.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:38 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:39.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:38 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:39.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:38 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:39.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.253+0000 7fbb1a000640 1 --2- 172.21.15.17:0/4119854405 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbb040a1090 0x7fbb040a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:39.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.253+0000 7fbb1a000640 1 -- 172.21.15.17:0/4119854405 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fbb10014070 con 0x7fbb1c101fb0 2024-09-13T15:54:39.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.254+0000 7fbb20e00640 1 --2- 172.21.15.17:0/4119854405 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbb040a1090 0x7fbb040a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:39.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.254+0000 7fbb20e00640 1 --2- 172.21.15.17:0/4119854405 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbb040a1090 0x7fbb040a3550 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009830 tx=0x7fbb080305a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:39.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.258+0000 7fbb1a000640 1 -- 172.21.15.17:0/4119854405 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbb10096350 con 0x7fbb1c101fb0 2024-09-13T15:54:39.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:38 smithi189 ceph-mon[34790]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:39.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:38 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:39.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:38 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:39.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:38 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:39.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:38 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:39.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:38 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:39.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:38 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:39.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.480+0000 7fbb24200640 1 -- 172.21.15.17:0/4119854405 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb1c10d870 con 0x7fbb1c101fb0 2024-09-13T15:54:39.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.481+0000 7fbb1a000640 1 -- 172.21.15.17:0/4119854405 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7333 (secure 0 0 0) 0x7fbb10099970 con 0x7fbb1c101fb0 2024-09-13T15:54:39.485 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:39.486 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1730156534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1730156534},{"type":"v1","addr":"172.21.15.17:6837","nonce":1730156534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2888593680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2888593680},{"type":"v1","addr":"172.21.15.17:6835","nonce":2888593680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4135454212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4135454212},{"type":"v1","addr":"172.21.15.189:6835","nonce":4135454212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24520,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/4049465204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":4049465204},{"type":"v1","addr":"172.21.15.193:6835","nonce":4049465204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24524,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/2079181485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2079181485},{"type":"v1","addr":"172.21.15.189:6837","nonce":2079181485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/792056943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":792056943},{"type":"v1","addr":"172.21.15.193:6837","nonce":792056943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24553,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6839/3012199875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":3012199875},{"type":"v1","addr":"172.21.15.193:6839","nonce":3012199875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-09-13T15:54:39.487 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 10 2024-09-13T15:54:39.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.483+0000 7fbb24200640 1 -- 172.21.15.17:0/4119854405 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbb040a1090 msgr2=0x7fbb040a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:39.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.483+0000 7fbb24200640 1 --2- 172.21.15.17:0/4119854405 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbb040a1090 0x7fbb040a3550 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009830 tx=0x7fbb080305a0 comp rx=0 tx=0).stop 2024-09-13T15:54:39.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.483+0000 7fbb24200640 1 -- 172.21.15.17:0/4119854405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb1c101fb0 msgr2=0x7fbb1c198000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:39.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.483+0000 7fbb24200640 1 --2- 172.21.15.17:0/4119854405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb1c101fb0 0x7fbb1c198000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000e9f0 tx=0x7fbb1000eeb0 comp rx=0 tx=0).stop 2024-09-13T15:54:39.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.483+0000 7fbb24200640 1 -- 172.21.15.17:0/4119854405 shutdown_connections 2024-09-13T15:54:39.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.483+0000 7fbb24200640 1 --2- 172.21.15.17:0/4119854405 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbb040a1090 0x7fbb040a3550 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:39.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.483+0000 7fbb24200640 1 --2- 172.21.15.17:0/4119854405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb1c103b60 0x7fbb1c19f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:39.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.483+0000 7fbb24200640 1 --2- 172.21.15.17:0/4119854405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb1c1031a0 0x7fbb1c198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:39.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.483+0000 7fbb24200640 1 --2- 172.21.15.17:0/4119854405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb1c101fb0 0x7fbb1c198000 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.483+0000 7fbb24200640 1 -- 172.21.15.17:0/4119854405 >> 172.21.15.17:0/4119854405 conn(0x7fbb1c0fd730 msgr2=0x7fbb1c1066b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.483+0000 7fbb24200640 1 -- 172.21.15.17:0/4119854405 shutdown_connections 2024-09-13T15:54:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:39.483+0000 7fbb24200640 1 -- 172.21.15.17:0/4119854405 wait complete. 2024-09-13T15:54:40.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:39 smithi193 ceph-mon[35248]: Deploying daemon mds.g on smithi017 2024-09-13T15:54:40.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:39 smithi193 ceph-mon[35248]: mds.? [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] up:boot 2024-09-13T15:54:40.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:39 smithi193 ceph-mon[35248]: fsmap 9 up:standby 2024-09-13T15:54:40.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:39 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T15:54:40.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:39 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/4119854405' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:40.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:39 smithi017 ceph-mon[30494]: Deploying daemon mds.g on smithi017 2024-09-13T15:54:40.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:39 smithi017 ceph-mon[30494]: mds.? [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] up:boot 2024-09-13T15:54:40.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:39 smithi017 ceph-mon[30494]: fsmap 9 up:standby 2024-09-13T15:54:40.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:39 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T15:54:40.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:39 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/4119854405' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:40.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:39 smithi189 ceph-mon[34790]: Deploying daemon mds.g on smithi017 2024-09-13T15:54:40.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:39 smithi189 ceph-mon[34790]: mds.? [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] up:boot 2024-09-13T15:54:40.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:39 smithi189 ceph-mon[34790]: fsmap 9 up:standby 2024-09-13T15:54:40.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:39 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T15:54:40.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:39 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/4119854405' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:40.977 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:40 smithi017 ceph-mon[30494]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:41.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:40 smithi193 ceph-mon[35248]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:41.261 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 13 15:54:40 smithi017 systemd[1]: Starting Ceph mds.g for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T15:54:41.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:40 smithi189 ceph-mon[34790]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:41.502 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:54:41.553 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 13 15:54:41 smithi017 podman[72074]: 2024-09-13 15:54:41.19435723 +0000 UTC m=+0.027176409 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T15:54:41.554 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 13 15:54:41 smithi017 podman[72074]: 2024-09-13 15:54:41.303811923 +0000 UTC m=+0.136631082 container create 7d5f25adab6e60603219a0c3b01bc5485b205afa4af5f2f5f9faf3bdc4af9ff9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-13T15:54:41.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.668+0000 7efd0c400640 1 -- 172.21.15.17:0/2527589440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd04101fb0 msgr2=0x7efd041023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:41.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.668+0000 7efd0c400640 1 --2- 172.21.15.17:0/2527589440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd04101fb0 0x7efd041023b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009860 tx=0x7efcf802a340 comp rx=0 tx=0).stop 2024-09-13T15:54:41.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.668+0000 7efd0c400640 1 -- 172.21.15.17:0/2527589440 shutdown_connections 2024-09-13T15:54:41.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.668+0000 7efd0c400640 1 --2- 172.21.15.17:0/2527589440 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd04103b60 0x7efd0410a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:41.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.668+0000 7efd0c400640 1 --2- 172.21.15.17:0/2527589440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd041031a0 0x7efd04103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:41.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.668+0000 7efd0c400640 1 --2- 172.21.15.17:0/2527589440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd04101fb0 0x7efd041023b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:41.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.668+0000 7efd0c400640 1 -- 172.21.15.17:0/2527589440 >> 172.21.15.17:0/2527589440 conn(0x7efd040fd730 msgr2=0x7efd040ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:41.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.669+0000 7efd0c400640 1 -- 172.21.15.17:0/2527589440 shutdown_connections 2024-09-13T15:54:41.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.669+0000 7efd0c400640 1 -- 172.21.15.17:0/2527589440 wait complete. 2024-09-13T15:54:41.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.670+0000 7efd0c400640 1 Processor -- start 2024-09-13T15:54:41.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.670+0000 7efd0c400640 1 -- start start 2024-09-13T15:54:41.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.671+0000 7efd0c400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd04101fb0 0x7efd04197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:41.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.671+0000 7efd0c400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd041031a0 0x7efd041984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:41.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.671+0000 7efd0c400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd04103b60 0x7efd0419f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:41.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.671+0000 7efd0c400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0419faa0 con 0x7efd041031a0 2024-09-13T15:54:41.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.671+0000 7efd0c400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0419fc10 con 0x7efd04101fb0 2024-09-13T15:54:41.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.671+0000 7efd0c400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0419fdd0 con 0x7efd04103b60 2024-09-13T15:54:41.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.671+0000 7efd09a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd04101fb0 0x7efd04197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:41.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.671+0000 7efd09000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd041031a0 0x7efd041984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:41.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.671+0000 7efd09a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd04101fb0 0x7efd04197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:35080/0 (socket says 172.21.15.17:35080) 2024-09-13T15:54:41.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.671+0000 7efd09a00640 1 -- 172.21.15.17:0/3504500869 learned_addr learned my addr 172.21.15.17:0/3504500869 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:41.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.671+0000 7efd0a400640 1 --2- 172.21.15.17:0/3504500869 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd04103b60 0x7efd0419f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:41.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.671+0000 7efd09a00640 1 -- 172.21.15.17:0/3504500869 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd04103b60 msgr2=0x7efd0419f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:41.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.671+0000 7efd09a00640 1 --2- 172.21.15.17:0/3504500869 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd04103b60 0x7efd0419f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:41.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.671+0000 7efd09a00640 1 -- 172.21.15.17:0/3504500869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd041031a0 msgr2=0x7efd041984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:41.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.671+0000 7efd09a00640 1 --2- 172.21.15.17:0/3504500869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd041031a0 0x7efd041984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:41.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.671+0000 7efd09a00640 1 -- 172.21.15.17:0/3504500869 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf0009560 con 0x7efd04101fb0 2024-09-13T15:54:41.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.671+0000 7efd0a400640 1 --2- 172.21.15.17:0/3504500869 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd04103b60 0x7efd0419f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:54:41.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.672+0000 7efd09a00640 1 --2- 172.21.15.17:0/3504500869 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd04101fb0 0x7efd04197fb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efcf80304b0 tx=0x7efcf8032d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:41.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.672+0000 7efd02000640 1 -- 172.21.15.17:0/3504500869 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf8004040 con 0x7efd04101fb0 2024-09-13T15:54:41.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.672+0000 7efd0c400640 1 -- 172.21.15.17:0/3504500869 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf8009490 con 0x7efd04101fb0 2024-09-13T15:54:41.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.672+0000 7efd02000640 1 -- 172.21.15.17:0/3504500869 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efcf8005050 con 0x7efd04101fb0 2024-09-13T15:54:41.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.672+0000 7efd02000640 1 -- 172.21.15.17:0/3504500869 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf8004920 con 0x7efd04101fb0 2024-09-13T15:54:41.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.672+0000 7efd0c400640 1 -- 172.21.15.17:0/3504500869 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd041a03c0 con 0x7efd04101fb0 2024-09-13T15:54:41.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.673+0000 7efd0c400640 1 -- 172.21.15.17:0/3504500869 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd041094e0 con 0x7efd04101fb0 2024-09-13T15:54:41.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.675+0000 7efd02000640 1 -- 172.21.15.17:0/3504500869 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7efcf80041a0 con 0x7efd04101fb0 2024-09-13T15:54:41.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.676+0000 7efd02000640 1 --2- 172.21.15.17:0/3504500869 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efcec0a1110 0x7efcec0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:41.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.677+0000 7efd02000640 1 -- 172.21.15.17:0/3504500869 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7efcf80ed510 con 0x7efd04101fb0 2024-09-13T15:54:41.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.677+0000 7efd09000640 1 --2- 172.21.15.17:0/3504500869 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efcec0a1110 0x7efcec0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:41.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.677+0000 7efd09000640 1 --2- 172.21.15.17:0/3504500869 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efcec0a1110 0x7efcec0a35d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efd041994c0 tx=0x7efcf0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:41.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.678+0000 7efd02000640 1 -- 172.21.15.17:0/3504500869 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efcf80b70a0 con 0x7efd04101fb0 2024-09-13T15:54:41.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.900+0000 7efd0c400640 1 -- 172.21.15.17:0/3504500869 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd0410d870 con 0x7efd04101fb0 2024-09-13T15:54:41.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.901+0000 7efd02000640 1 -- 172.21.15.17:0/3504500869 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7333 (secure 0 0 0) 0x7efcf80ba6c0 con 0x7efd04101fb0 2024-09-13T15:54:41.903 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:41.903 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1730156534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1730156534},{"type":"v1","addr":"172.21.15.17:6837","nonce":1730156534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2888593680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2888593680},{"type":"v1","addr":"172.21.15.17:6835","nonce":2888593680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4135454212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4135454212},{"type":"v1","addr":"172.21.15.189:6835","nonce":4135454212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24520,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/4049465204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":4049465204},{"type":"v1","addr":"172.21.15.193:6835","nonce":4049465204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24524,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/2079181485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2079181485},{"type":"v1","addr":"172.21.15.189:6837","nonce":2079181485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/792056943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":792056943},{"type":"v1","addr":"172.21.15.193:6837","nonce":792056943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24553,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6839/3012199875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":3012199875},{"type":"v1","addr":"172.21.15.193:6839","nonce":3012199875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-09-13T15:54:41.903 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 10 2024-09-13T15:54:41.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.903+0000 7efd0c400640 1 -- 172.21.15.17:0/3504500869 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efcec0a1110 msgr2=0x7efcec0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:41.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.903+0000 7efd0c400640 1 --2- 172.21.15.17:0/3504500869 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efcec0a1110 0x7efcec0a35d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efd041994c0 tx=0x7efcf0009260 comp rx=0 tx=0).stop 2024-09-13T15:54:41.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.903+0000 7efd0c400640 1 -- 172.21.15.17:0/3504500869 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd04101fb0 msgr2=0x7efd04197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:41.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.903+0000 7efd0c400640 1 --2- 172.21.15.17:0/3504500869 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd04101fb0 0x7efd04197fb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efcf80304b0 tx=0x7efcf8032d20 comp rx=0 tx=0).stop 2024-09-13T15:54:41.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.904+0000 7efd0c400640 1 -- 172.21.15.17:0/3504500869 shutdown_connections 2024-09-13T15:54:41.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.904+0000 7efd0c400640 1 --2- 172.21.15.17:0/3504500869 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efcec0a1110 0x7efcec0a35d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:41.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.904+0000 7efd0c400640 1 --2- 172.21.15.17:0/3504500869 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd04103b60 0x7efd0419f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:41.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.904+0000 7efd0c400640 1 --2- 172.21.15.17:0/3504500869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd041031a0 0x7efd041984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:41.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.904+0000 7efd0c400640 1 --2- 172.21.15.17:0/3504500869 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd04101fb0 0x7efd04197fb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:41.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.904+0000 7efd0c400640 1 -- 172.21.15.17:0/3504500869 >> 172.21.15.17:0/3504500869 conn(0x7efd040fd730 msgr2=0x7efd041066b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:41.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.904+0000 7efd0c400640 1 -- 172.21.15.17:0/3504500869 shutdown_connections 2024-09-13T15:54:41.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:41.904+0000 7efd0c400640 1 -- 172.21.15.17:0/3504500869 wait complete. 2024-09-13T15:54:41.924 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 13 15:54:41 smithi017 podman[72074]: 2024-09-13 15:54:41.582028374 +0000 UTC m=+0.414847532 container init 7d5f25adab6e60603219a0c3b01bc5485b205afa4af5f2f5f9faf3bdc4af9ff9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-g, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-13T15:54:41.924 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 13 15:54:41 smithi017 podman[72074]: 2024-09-13 15:54:41.588843465 +0000 UTC m=+0.421662620 container start 7d5f25adab6e60603219a0c3b01bc5485b205afa4af5f2f5f9faf3bdc4af9ff9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-g, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-13T15:54:41.924 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 13 15:54:41 smithi017 ceph-mds[72114]: -- 172.21.15.17:0/2202659201 <== mon.1 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563f83b6cd00 con 0x563f83b41000 2024-09-13T15:54:41.924 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 13 15:54:41 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-g[72089]: starting mds.g at 2024-09-13T15:54:41.924 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 13 15:54:41 smithi017 bash[72074]: 7d5f25adab6e60603219a0c3b01bc5485b205afa4af5f2f5f9faf3bdc4af9ff9 2024-09-13T15:54:41.925 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 13 15:54:41 smithi017 systemd[1]: Started Ceph mds.g for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T15:54:43.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:43.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:43.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:43.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:43.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:43.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:43.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:42 smithi017 ceph-mon[30494]: Deploying daemon mds.a on smithi017 2024-09-13T15:54:43.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:42 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3504500869' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:43.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:42 smithi017 ceph-mon[30494]: mds.? [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] up:boot 2024-09-13T15:54:43.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:42 smithi017 ceph-mon[30494]: fsmap 10 up:standby 2024-09-13T15:54:43.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T15:54:43.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:42 smithi017 ceph-mon[30494]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:43.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:42 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:43.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:42 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:43.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:42 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:43.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:42 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:43.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:42 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:43.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:42 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:43.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:42 smithi189 ceph-mon[34790]: Deploying daemon mds.a on smithi017 2024-09-13T15:54:43.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:42 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3504500869' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:43.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:42 smithi189 ceph-mon[34790]: mds.? [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] up:boot 2024-09-13T15:54:43.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:42 smithi189 ceph-mon[34790]: fsmap 10 up:standby 2024-09-13T15:54:43.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:42 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T15:54:43.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:42 smithi189 ceph-mon[34790]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:43.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:42 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:43.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:42 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:43.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:42 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:43.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:42 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:43.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:42 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:43.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:42 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:43.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:42 smithi193 ceph-mon[35248]: Deploying daemon mds.a on smithi017 2024-09-13T15:54:43.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:42 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3504500869' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:43.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:42 smithi193 ceph-mon[35248]: mds.? [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] up:boot 2024-09-13T15:54:43.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:42 smithi193 ceph-mon[35248]: fsmap 10 up:standby 2024-09-13T15:54:43.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:42 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T15:54:43.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:42 smithi193 ceph-mon[35248]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:43.927 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:54:44.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.214+0000 7fddf7200640 1 -- 172.21.15.17:0/4136828536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf8100610 msgr2=0x7fddf8102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:44.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.214+0000 7fddf7200640 1 --2- 172.21.15.17:0/4136828536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf8100610 0x7fddf8102a00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009900 tx=0x7fdde802a410 comp rx=0 tx=0).stop 2024-09-13T15:54:44.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.214+0000 7fddf7200640 1 -- 172.21.15.17:0/4136828536 shutdown_connections 2024-09-13T15:54:44.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.214+0000 7fddf7200640 1 --2- 172.21.15.17:0/4136828536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddf8105870 0x7fddf8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:44.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.214+0000 7fddf7200640 1 --2- 172.21.15.17:0/4136828536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddf8102f40 0x7fddf8105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:44.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.214+0000 7fddf7200640 1 --2- 172.21.15.17:0/4136828536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf8100610 0x7fddf8102a00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:44.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.214+0000 7fddf7200640 1 -- 172.21.15.17:0/4136828536 >> 172.21.15.17:0/4136828536 conn(0x7fddf80fa1f0 msgr2=0x7fddf80fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:44.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.214+0000 7fddf7200640 1 -- 172.21.15.17:0/4136828536 shutdown_connections 2024-09-13T15:54:44.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.215+0000 7fddf7200640 1 -- 172.21.15.17:0/4136828536 wait complete. 2024-09-13T15:54:44.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.216+0000 7fddf7200640 1 Processor -- start 2024-09-13T15:54:44.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.216+0000 7fddf7200640 1 -- start start 2024-09-13T15:54:44.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.216+0000 7fddf7200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddf8100610 0x7fddf8197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:44.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.216+0000 7fddf7200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf8102f40 0x7fddf8198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:44.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.216+0000 7fddf7200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddf8105870 0x7fddf819f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:44.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.216+0000 7fddf7200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf819f8d0 con 0x7fddf8102f40 2024-09-13T15:54:44.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.216+0000 7fddf7200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf819fa40 con 0x7fddf8105870 2024-09-13T15:54:44.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.216+0000 7fddf7200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf819fc00 con 0x7fddf8100610 2024-09-13T15:54:44.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.217+0000 7fddf5e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddf8100610 0x7fddf8197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:44.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.217+0000 7fddf5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf8102f40 0x7fddf8198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:44.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.217+0000 7fddf5e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddf8100610 0x7fddf8197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:51292/0 (socket says 172.21.15.17:51292) 2024-09-13T15:54:44.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.217+0000 7fddf5e00640 1 -- 172.21.15.17:0/3694106648 learned_addr learned my addr 172.21.15.17:0/3694106648 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:44.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.217+0000 7fddf6800640 1 --2- 172.21.15.17:0/3694106648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddf8105870 0x7fddf819f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.217+0000 7fddf5e00640 1 -- 172.21.15.17:0/3694106648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddf8105870 msgr2=0x7fddf819f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.217+0000 7fddf5e00640 1 --2- 172.21.15.17:0/3694106648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddf8105870 0x7fddf819f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.217+0000 7fddf5e00640 1 -- 172.21.15.17:0/3694106648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf8102f40 msgr2=0x7fddf8198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:44.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.217+0000 7fddf5e00640 1 --2- 172.21.15.17:0/3694106648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf8102f40 0x7fddf8198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:44.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.217+0000 7fddf5e00640 1 -- 172.21.15.17:0/3694106648 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde8009560 con 0x7fddf8100610 2024-09-13T15:54:44.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.217+0000 7fddf5400640 1 --2- 172.21.15.17:0/3694106648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf8102f40 0x7fddf8198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:54:44.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.217+0000 7fddf5e00640 1 --2- 172.21.15.17:0/3694106648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddf8100610 0x7fddf8197de0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009a20 tx=0x7fdde80055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:44.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.218+0000 7fddeea00640 1 -- 172.21.15.17:0/3694106648 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8004c90 con 0x7fddf8100610 2024-09-13T15:54:44.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.218+0000 7fddeea00640 1 -- 172.21.15.17:0/3694106648 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdde8004df0 con 0x7fddf8100610 2024-09-13T15:54:44.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.218+0000 7fddf7200640 1 -- 172.21.15.17:0/3694106648 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf819fe80 con 0x7fddf8100610 2024-09-13T15:54:44.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.218+0000 7fddeea00640 1 -- 172.21.15.17:0/3694106648 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8031b40 con 0x7fddf8100610 2024-09-13T15:54:44.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.218+0000 7fddf7200640 1 -- 172.21.15.17:0/3694106648 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf81a0250 con 0x7fddf8100610 2024-09-13T15:54:44.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.219+0000 7fddf7200640 1 -- 172.21.15.17:0/3694106648 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf81073e0 con 0x7fddf8100610 2024-09-13T15:54:44.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.221+0000 7fddeea00640 1 -- 172.21.15.17:0/3694106648 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fdde8031ca0 con 0x7fddf8100610 2024-09-13T15:54:44.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.223+0000 7fddeea00640 1 --2- 172.21.15.17:0/3694106648 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdddc0a1090 0x7fdddc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:44.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.223+0000 7fddeea00640 1 -- 172.21.15.17:0/3694106648 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fdde80ed4f0 con 0x7fddf8100610 2024-09-13T15:54:44.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.223+0000 7fddf5400640 1 --2- 172.21.15.17:0/3694106648 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdddc0a1090 0x7fdddc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:44.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.224+0000 7fddf5400640 1 --2- 172.21.15.17:0/3694106648 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdddc0a1090 0x7fdddc0a3550 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fddf81992f0 tx=0x7fdde400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:44.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.224+0000 7fddeea00640 1 -- 172.21.15.17:0/3694106648 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdde80b7130 con 0x7fddf8100610 2024-09-13T15:54:44.471 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 13 15:54:44 smithi017 systemd[1]: Starting Ceph mds.a for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T15:54:44.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.474+0000 7fddf7200640 1 -- 172.21.15.17:0/3694106648 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddf810b4c0 con 0x7fddf8100610 2024-09-13T15:54:44.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.475+0000 7fddeea00640 1 -- 172.21.15.17:0/3694106648 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8091 (secure 0 0 0) 0x7fdde80ba750 con 0x7fddf8100610 2024-09-13T15:54:44.477 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:44.477 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1730156534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1730156534},{"type":"v1","addr":"172.21.15.17:6837","nonce":1730156534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2888593680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2888593680},{"type":"v1","addr":"172.21.15.17:6835","nonce":2888593680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4135454212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4135454212},{"type":"v1","addr":"172.21.15.189:6835","nonce":4135454212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24520,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/4049465204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":4049465204},{"type":"v1","addr":"172.21.15.193:6835","nonce":4049465204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24524,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/2079181485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2079181485},{"type":"v1","addr":"172.21.15.189:6837","nonce":2079181485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/792056943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":792056943},{"type":"v1","addr":"172.21.15.193:6837","nonce":792056943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24553,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6839/3012199875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":3012199875},{"type":"v1","addr":"172.21.15.193:6839","nonce":3012199875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3750040765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3750040765},{"type":"v1","addr":"172.21.15.17:6839","nonce":3750040765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[]} 2024-09-13T15:54:44.478 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 11 2024-09-13T15:54:44.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.478+0000 7fddf7200640 1 -- 172.21.15.17:0/3694106648 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdddc0a1090 msgr2=0x7fdddc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:44.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.478+0000 7fddf7200640 1 --2- 172.21.15.17:0/3694106648 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdddc0a1090 0x7fdddc0a3550 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fddf81992f0 tx=0x7fdde400b410 comp rx=0 tx=0).stop 2024-09-13T15:54:44.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.478+0000 7fddf7200640 1 -- 172.21.15.17:0/3694106648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddf8100610 msgr2=0x7fddf8197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:44.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.478+0000 7fddf7200640 1 --2- 172.21.15.17:0/3694106648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddf8100610 0x7fddf8197de0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009a20 tx=0x7fdde80055a0 comp rx=0 tx=0).stop 2024-09-13T15:54:44.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.478+0000 7fddf7200640 1 -- 172.21.15.17:0/3694106648 shutdown_connections 2024-09-13T15:54:44.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.478+0000 7fddf7200640 1 --2- 172.21.15.17:0/3694106648 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdddc0a1090 0x7fdddc0a3550 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:44.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.478+0000 7fddf7200640 1 --2- 172.21.15.17:0/3694106648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddf8105870 0x7fddf819f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:44.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.478+0000 7fddf7200640 1 --2- 172.21.15.17:0/3694106648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf8102f40 0x7fddf8198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:44.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.478+0000 7fddf7200640 1 --2- 172.21.15.17:0/3694106648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddf8100610 0x7fddf8197de0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:44.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.478+0000 7fddf7200640 1 -- 172.21.15.17:0/3694106648 >> 172.21.15.17:0/3694106648 conn(0x7fddf80fa1f0 msgr2=0x7fddf80ffdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:44.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.478+0000 7fddf7200640 1 -- 172.21.15.17:0/3694106648 shutdown_connections 2024-09-13T15:54:44.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:44.478+0000 7fddf7200640 1 -- 172.21.15.17:0/3694106648 wait complete. 2024-09-13T15:54:44.740 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 13 15:54:44 smithi017 podman[72467]: 2024-09-13 15:54:44.37504806 +0000 UTC m=+0.034726025 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T15:54:44.740 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 13 15:54:44 smithi017 podman[72467]: 2024-09-13 15:54:44.502055128 +0000 UTC m=+0.161733079 container create bd97b9a2c4b3cb30141b9307d111070497611d3338dd7e65d5aa0c1b8d31e2f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-13T15:54:44.740 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 13 15:54:44 smithi017 podman[72467]: 2024-09-13 15:54:44.738877612 +0000 UTC m=+0.398555571 container init bd97b9a2c4b3cb30141b9307d111070497611d3338dd7e65d5aa0c1b8d31e2f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T15:54:45.011 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 13 15:54:44 smithi017 podman[72467]: 2024-09-13 15:54:44.745172194 +0000 UTC m=+0.404850146 container start bd97b9a2c4b3cb30141b9307d111070497611d3338dd7e65d5aa0c1b8d31e2f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-13T15:54:45.011 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 13 15:54:44 smithi017 ceph-mds[72488]: -- 172.21.15.17:0/2573850109 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c08956ed00 con 0x55c089542800 2024-09-13T15:54:45.011 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 13 15:54:44 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-a[72484]: starting mds.a at 2024-09-13T15:54:45.012 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 13 15:54:44 smithi017 bash[72467]: bd97b9a2c4b3cb30141b9307d111070497611d3338dd7e65d5aa0c1b8d31e2f6 2024-09-13T15:54:45.012 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 13 15:54:44 smithi017 systemd[1]: Started Ceph mds.a for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T15:54:45.472 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:45 smithi189 ceph-mon[34790]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:45.472 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:45 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3694106648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:45.472 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:45.472 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:45.472 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:45.472 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:45.472 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:45.472 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:45.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:45 smithi193 ceph-mon[35248]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:45.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:45 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3694106648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:45.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:45 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:45.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:45 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:45.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:45 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:45.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:45 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:45.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:45 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:45.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:45 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:45.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:45 smithi017 ceph-mon[30494]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:45.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:45 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3694106648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:45.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:45 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:45.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:45 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:45.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:45 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:45.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:45 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T15:54:45.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:45 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T15:54:45.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:45 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:46.497 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:54:46.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:46 smithi193 ceph-mon[35248]: Deploying daemon mds.b on smithi189 2024-09-13T15:54:46.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:46 smithi193 ceph-mon[35248]: mds.? [v2:172.21.15.17:6840/1295854211,v1:172.21.15.17:6841/1295854211] up:boot 2024-09-13T15:54:46.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:46 smithi193 ceph-mon[35248]: fsmap 11 up:standby 2024-09-13T15:54:46.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:46 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T15:54:46.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:46 smithi017 ceph-mon[30494]: Deploying daemon mds.b on smithi189 2024-09-13T15:54:46.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:46 smithi017 ceph-mon[30494]: mds.? [v2:172.21.15.17:6840/1295854211,v1:172.21.15.17:6841/1295854211] up:boot 2024-09-13T15:54:46.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:46 smithi017 ceph-mon[30494]: fsmap 11 up:standby 2024-09-13T15:54:46.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T15:54:46.586 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:46 smithi189 ceph-mon[34790]: Deploying daemon mds.b on smithi189 2024-09-13T15:54:46.587 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:46 smithi189 ceph-mon[34790]: mds.? [v2:172.21.15.17:6840/1295854211,v1:172.21.15.17:6841/1295854211] up:boot 2024-09-13T15:54:46.587 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:46 smithi189 ceph-mon[34790]: fsmap 11 up:standby 2024-09-13T15:54:46.587 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:46 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T15:54:46.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.666+0000 7fe91fe00640 1 -- 172.21.15.17:0/3156185336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe920102fe0 msgr2=0x7fe920103460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:46.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.666+0000 7fe91fe00640 1 --2- 172.21.15.17:0/3156185336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe920102fe0 0x7fe920103460 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe908009900 tx=0x7fe90802a3f0 comp rx=0 tx=0).stop 2024-09-13T15:54:46.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.666+0000 7fe91fe00640 1 -- 172.21.15.17:0/3156185336 shutdown_connections 2024-09-13T15:54:46.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.666+0000 7fe91fe00640 1 --2- 172.21.15.17:0/3156185336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9201039a0 0x7fe92010a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:46.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.666+0000 7fe91fe00640 1 --2- 172.21.15.17:0/3156185336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe920102fe0 0x7fe920103460 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:46.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.666+0000 7fe91fe00640 1 --2- 172.21.15.17:0/3156185336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe920101df0 0x7fe9201021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:46.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.666+0000 7fe91fe00640 1 -- 172.21.15.17:0/3156185336 >> 172.21.15.17:0/3156185336 conn(0x7fe9200fd570 msgr2=0x7fe9200ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:46.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.666+0000 7fe91fe00640 1 -- 172.21.15.17:0/3156185336 shutdown_connections 2024-09-13T15:54:46.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.666+0000 7fe91fe00640 1 -- 172.21.15.17:0/3156185336 wait complete. 2024-09-13T15:54:46.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.667+0000 7fe91fe00640 1 Processor -- start 2024-09-13T15:54:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.667+0000 7fe91fe00640 1 -- start start 2024-09-13T15:54:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.667+0000 7fe91fe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe920101df0 0x7fe920197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.667+0000 7fe91fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe920102fe0 0x7fe920198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.668+0000 7fe91fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9201039a0 0x7fe92019f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.668+0000 7fe91fe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92019f900 con 0x7fe9201039a0 2024-09-13T15:54:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.668+0000 7fe91fe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92019fa70 con 0x7fe920102fe0 2024-09-13T15:54:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.668+0000 7fe91fe00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92019fc30 con 0x7fe920101df0 2024-09-13T15:54:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.668+0000 7fe91f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9201039a0 0x7fe92019f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.668+0000 7fe917e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe920102fe0 0x7fe920198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.668+0000 7fe91ea00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe920101df0 0x7fe920197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.668+0000 7fe917e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe920102fe0 0x7fe920198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:35134/0 (socket says 172.21.15.17:35134) 2024-09-13T15:54:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.668+0000 7fe917e00640 1 -- 172.21.15.17:0/3635900101 learned_addr learned my addr 172.21.15.17:0/3635900101 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.668+0000 7fe91f400640 1 -- 172.21.15.17:0/3635900101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe920101df0 msgr2=0x7fe920197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.668+0000 7fe91f400640 1 --2- 172.21.15.17:0/3635900101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe920101df0 0x7fe920197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.668+0000 7fe91f400640 1 -- 172.21.15.17:0/3635900101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe920102fe0 msgr2=0x7fe920198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.668+0000 7fe91f400640 1 --2- 172.21.15.17:0/3635900101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe920102fe0 0x7fe920198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.668+0000 7fe91f400640 1 -- 172.21.15.17:0/3635900101 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe918009840 con 0x7fe9201039a0 2024-09-13T15:54:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.669+0000 7fe91f400640 1 --2- 172.21.15.17:0/3635900101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9201039a0 0x7fe92019f3c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe91800ec50 tx=0x7fe91800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.669+0000 7fe917400640 1 -- 172.21.15.17:0/3635900101 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe918003b70 con 0x7fe9201039a0 2024-09-13T15:54:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.669+0000 7fe917400640 1 -- 172.21.15.17:0/3635900101 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe91800ce70 con 0x7fe9201039a0 2024-09-13T15:54:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.669+0000 7fe917400640 1 -- 172.21.15.17:0/3635900101 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe918010690 con 0x7fe9201039a0 2024-09-13T15:54:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.669+0000 7fe91fe00640 1 -- 172.21.15.17:0/3635900101 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe908009560 con 0x7fe9201039a0 2024-09-13T15:54:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.669+0000 7fe91fe00640 1 -- 172.21.15.17:0/3635900101 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9201a01e0 con 0x7fe9201039a0 2024-09-13T15:54:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.670+0000 7fe91fe00640 1 -- 172.21.15.17:0/3635900101 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9201092f0 con 0x7fe9201039a0 2024-09-13T15:54:46.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.672+0000 7fe917400640 1 -- 172.21.15.17:0/3635900101 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe918004020 con 0x7fe9201039a0 2024-09-13T15:54:46.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.673+0000 7fe917400640 1 --2- 172.21.15.17:0/3635900101 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe9040a1110 0x7fe9040a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:46.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.673+0000 7fe917400640 1 -- 172.21.15.17:0/3635900101 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe918014070 con 0x7fe9201039a0 2024-09-13T15:54:46.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.673+0000 7fe91ea00640 1 --2- 172.21.15.17:0/3635900101 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe9040a1110 0x7fe9040a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:46.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.674+0000 7fe91ea00640 1 --2- 172.21.15.17:0/3635900101 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe9040a1110 0x7fe9040a35d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe920102e40 tx=0x7fe910005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:46.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.677+0000 7fe917400640 1 -- 172.21.15.17:0/3635900101 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe918096720 con 0x7fe9201039a0 2024-09-13T15:54:46.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.892+0000 7fe91fe00640 1 -- 172.21.15.17:0/3635900101 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe92010d6b0 con 0x7fe9201039a0 2024-09-13T15:54:46.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.893+0000 7fe917400640 1 -- 172.21.15.17:0/3635900101 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8849 (secure 0 0 0) 0x7fe918099d40 con 0x7fe9201039a0 2024-09-13T15:54:46.895 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:46.895 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1730156534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1730156534},{"type":"v1","addr":"172.21.15.17:6837","nonce":1730156534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/1295854211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1295854211},{"type":"v1","addr":"172.21.15.17:6841","nonce":1295854211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2888593680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2888593680},{"type":"v1","addr":"172.21.15.17:6835","nonce":2888593680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4135454212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4135454212},{"type":"v1","addr":"172.21.15.189:6835","nonce":4135454212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24520,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/4049465204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":4049465204},{"type":"v1","addr":"172.21.15.193:6835","nonce":4049465204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24524,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/2079181485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2079181485},{"type":"v1","addr":"172.21.15.189:6837","nonce":2079181485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/792056943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":792056943},{"type":"v1","addr":"172.21.15.193:6837","nonce":792056943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24553,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6839/3012199875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":3012199875},{"type":"v1","addr":"172.21.15.193:6839","nonce":3012199875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3750040765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3750040765},{"type":"v1","addr":"172.21.15.17:6839","nonce":3750040765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[]} 2024-09-13T15:54:46.895 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 12 2024-09-13T15:54:46.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.895+0000 7fe91fe00640 1 -- 172.21.15.17:0/3635900101 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe9040a1110 msgr2=0x7fe9040a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:46.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.895+0000 7fe91fe00640 1 --2- 172.21.15.17:0/3635900101 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe9040a1110 0x7fe9040a35d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe920102e40 tx=0x7fe910005f90 comp rx=0 tx=0).stop 2024-09-13T15:54:46.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.895+0000 7fe91fe00640 1 -- 172.21.15.17:0/3635900101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9201039a0 msgr2=0x7fe92019f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:46.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.895+0000 7fe91fe00640 1 --2- 172.21.15.17:0/3635900101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9201039a0 0x7fe92019f3c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe91800ec50 tx=0x7fe91800c6a0 comp rx=0 tx=0).stop 2024-09-13T15:54:46.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.895+0000 7fe91fe00640 1 -- 172.21.15.17:0/3635900101 shutdown_connections 2024-09-13T15:54:46.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.895+0000 7fe91fe00640 1 --2- 172.21.15.17:0/3635900101 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe9040a1110 0x7fe9040a35d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:46.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.895+0000 7fe91fe00640 1 --2- 172.21.15.17:0/3635900101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9201039a0 0x7fe92019f3c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:46.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.895+0000 7fe91fe00640 1 --2- 172.21.15.17:0/3635900101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe920102fe0 0x7fe920198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:46.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.895+0000 7fe91fe00640 1 --2- 172.21.15.17:0/3635900101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe920101df0 0x7fe920197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:46.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.895+0000 7fe91fe00640 1 -- 172.21.15.17:0/3635900101 >> 172.21.15.17:0/3635900101 conn(0x7fe9200fd570 msgr2=0x7fe9201064c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:46.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.895+0000 7fe91fe00640 1 -- 172.21.15.17:0/3635900101 shutdown_connections 2024-09-13T15:54:46.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:46.895+0000 7fe91fe00640 1 -- 172.21.15.17:0/3635900101 wait complete. 2024-09-13T15:54:47.203 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:47 smithi189 ceph-mon[34790]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:47.203 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:47 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3635900101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:47.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:47 smithi193 ceph-mon[35248]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:47.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:47 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3635900101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:47.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:47 smithi017 ceph-mon[30494]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:47.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:47 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3635900101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:47.856 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 13 15:54:47 smithi189 systemd[1]: Started Ceph mds.b for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T15:54:48.914 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:54:48.964 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:48 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:48.965 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:48 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:48.965 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:48 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:48.965 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:48 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:48.965 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:48 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:48.965 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:48 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:54:48.966 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:48 smithi017 ceph-mon[30494]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:48.966 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:48 smithi017 ceph-mon[30494]: mds.? [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] up:boot 2024-09-13T15:54:48.966 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:48 smithi017 ceph-mon[30494]: fsmap 12 up:standby 2024-09-13T15:54:48.966 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:48 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T15:54:49.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:48 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:49.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:48 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:49.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:48 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:49.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:48 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:49.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:48 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:49.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:48 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:54:49.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:48 smithi193 ceph-mon[35248]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:49.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:48 smithi193 ceph-mon[35248]: mds.? [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] up:boot 2024-09-13T15:54:49.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:48 smithi193 ceph-mon[35248]: fsmap 12 up:standby 2024-09-13T15:54:49.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:48 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T15:54:49.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.072+0000 7fc02d800640 1 -- 172.21.15.17:0/296298352 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc028103190 msgr2=0x7fc028103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:49.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.072+0000 7fc02d800640 1 --2- 172.21.15.17:0/296298352 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc028103190 0x7fc028103610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc010009900 tx=0x7fc01002a410 comp rx=0 tx=0).stop 2024-09-13T15:54:49.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.072+0000 7fc02d800640 1 -- 172.21.15.17:0/296298352 shutdown_connections 2024-09-13T15:54:49.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.072+0000 7fc02d800640 1 --2- 172.21.15.17:0/296298352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc028103b50 0x7fc02810a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.072+0000 7fc02d800640 1 --2- 172.21.15.17:0/296298352 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc028103190 0x7fc028103610 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.072+0000 7fc02d800640 1 --2- 172.21.15.17:0/296298352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc028101fa0 0x7fc0281023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.072+0000 7fc02d800640 1 -- 172.21.15.17:0/296298352 >> 172.21.15.17:0/296298352 conn(0x7fc0280fd700 msgr2=0x7fc0280ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:49.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.072+0000 7fc02d800640 1 -- 172.21.15.17:0/296298352 shutdown_connections 2024-09-13T15:54:49.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.072+0000 7fc02d800640 1 -- 172.21.15.17:0/296298352 wait complete. 2024-09-13T15:54:49.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.073+0000 7fc02d800640 1 Processor -- start 2024-09-13T15:54:49.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.073+0000 7fc02d800640 1 -- start start 2024-09-13T15:54:49.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.074+0000 7fc02d800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc028101fa0 0x7fc028197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:49.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.074+0000 7fc02d800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc028103190 0x7fc028198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:49.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.074+0000 7fc02d800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc028103b50 0x7fc02819f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:49.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.074+0000 7fc02d800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02819fad0 con 0x7fc028103190 2024-09-13T15:54:49.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.074+0000 7fc02d800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02819fc40 con 0x7fc028101fa0 2024-09-13T15:54:49.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.074+0000 7fc02d800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02819fe00 con 0x7fc028103b50 2024-09-13T15:54:49.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.074+0000 7fc026a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc028101fa0 0x7fc028197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:49.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.074+0000 7fc026a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc028101fa0 0x7fc028197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:44958/0 (socket says 172.21.15.17:44958) 2024-09-13T15:54:49.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.074+0000 7fc026a00640 1 -- 172.21.15.17:0/847692402 learned_addr learned my addr 172.21.15.17:0/847692402 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:49.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.074+0000 7fc01fe00640 1 --2- 172.21.15.17:0/847692402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc028103190 0x7fc028198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:49.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.074+0000 7fc027400640 1 --2- 172.21.15.17:0/847692402 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc028103b50 0x7fc02819f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:49.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.074+0000 7fc026a00640 1 -- 172.21.15.17:0/847692402 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc028103b50 msgr2=0x7fc02819f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:49.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.074+0000 7fc026a00640 1 --2- 172.21.15.17:0/847692402 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc028103b50 0x7fc02819f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.074+0000 7fc026a00640 1 -- 172.21.15.17:0/847692402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc028103190 msgr2=0x7fc028198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:49.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.074+0000 7fc026a00640 1 --2- 172.21.15.17:0/847692402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc028103190 0x7fc028198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.074+0000 7fc026a00640 1 -- 172.21.15.17:0/847692402 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc020009840 con 0x7fc028101fa0 2024-09-13T15:54:49.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.075+0000 7fc026a00640 1 --2- 172.21.15.17:0/847692402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc028101fa0 0x7fc028197fe0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc01800e9c0 tx=0x7fc01800edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:49.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.075+0000 7fc01f400640 1 -- 172.21.15.17:0/847692402 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0180096e0 con 0x7fc028101fa0 2024-09-13T15:54:49.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.075+0000 7fc01f400640 1 -- 172.21.15.17:0/847692402 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc0180044f0 con 0x7fc028101fa0 2024-09-13T15:54:49.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.075+0000 7fc02d800640 1 -- 172.21.15.17:0/847692402 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc010009560 con 0x7fc028101fa0 2024-09-13T15:54:49.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.075+0000 7fc01f400640 1 -- 172.21.15.17:0/847692402 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc018003e50 con 0x7fc028101fa0 2024-09-13T15:54:49.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.075+0000 7fc02d800640 1 -- 172.21.15.17:0/847692402 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0281a0430 con 0x7fc028101fa0 2024-09-13T15:54:49.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.076+0000 7fc02d800640 1 -- 172.21.15.17:0/847692402 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0281094d0 con 0x7fc028101fa0 2024-09-13T15:54:49.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.078+0000 7fc01f400640 1 -- 172.21.15.17:0/847692402 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc018004000 con 0x7fc028101fa0 2024-09-13T15:54:49.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.079+0000 7fc01f400640 1 --2- 172.21.15.17:0/847692402 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc00c0a11e0 0x7fc00c0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:49.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.080+0000 7fc01f400640 1 -- 172.21.15.17:0/847692402 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc018014070 con 0x7fc028101fa0 2024-09-13T15:54:49.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.080+0000 7fc01fe00640 1 --2- 172.21.15.17:0/847692402 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc00c0a11e0 0x7fc00c0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:49.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.080+0000 7fc01fe00640 1 --2- 172.21.15.17:0/847692402 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc00c0a11e0 0x7fc00c0a36a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc010005ab0 tx=0x7fc010005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:49.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.083+0000 7fc01f400640 1 -- 172.21.15.17:0/847692402 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc018096370 con 0x7fc028101fa0 2024-09-13T15:54:49.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:48 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:49.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:48 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:49.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:48 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:49.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:48 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:49.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:48 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:49.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:48 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:54:49.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:48 smithi189 ceph-mon[34790]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:49.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:48 smithi189 ceph-mon[34790]: mds.? [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] up:boot 2024-09-13T15:54:49.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:48 smithi189 ceph-mon[34790]: fsmap 12 up:standby 2024-09-13T15:54:49.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:48 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T15:54:49.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.314+0000 7fc02d800640 1 -- 172.21.15.17:0/847692402 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc02810d8b0 con 0x7fc028101fa0 2024-09-13T15:54:49.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.315+0000 7fc01f400640 1 -- 172.21.15.17:0/847692402 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9610 (secure 0 0 0) 0x7fc018099990 con 0x7fc028101fa0 2024-09-13T15:54:49.317 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:49.317 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1730156534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1730156534},{"type":"v1","addr":"172.21.15.17:6837","nonce":1730156534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/1295854211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1295854211},{"type":"v1","addr":"172.21.15.17:6841","nonce":1295854211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2888593680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2888593680},{"type":"v1","addr":"172.21.15.17:6835","nonce":2888593680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4135454212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4135454212},{"type":"v1","addr":"172.21.15.189:6835","nonce":4135454212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24520,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/4049465204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":4049465204},{"type":"v1","addr":"172.21.15.193:6835","nonce":4049465204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24524,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/2079181485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2079181485},{"type":"v1","addr":"172.21.15.189:6837","nonce":2079181485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/792056943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":792056943},{"type":"v1","addr":"172.21.15.193:6837","nonce":792056943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24553,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6839/3012199875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":3012199875},{"type":"v1","addr":"172.21.15.193:6839","nonce":3012199875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3750040765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3750040765},{"type":"v1","addr":"172.21.15.17:6839","nonce":3750040765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24578,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/2624723395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2624723395},{"type":"v1","addr":"172.21.15.189:6839","nonce":2624723395}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2024-09-13T15:54:49.317 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 13 2024-09-13T15:54:49.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.317+0000 7fc02d800640 1 -- 172.21.15.17:0/847692402 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc00c0a11e0 msgr2=0x7fc00c0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:49.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.318+0000 7fc02d800640 1 --2- 172.21.15.17:0/847692402 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc00c0a11e0 0x7fc00c0a36a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc010005ab0 tx=0x7fc010005780 comp rx=0 tx=0).stop 2024-09-13T15:54:49.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.318+0000 7fc02d800640 1 -- 172.21.15.17:0/847692402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc028101fa0 msgr2=0x7fc028197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:49.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.318+0000 7fc02d800640 1 --2- 172.21.15.17:0/847692402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc028101fa0 0x7fc028197fe0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc01800e9c0 tx=0x7fc01800edc0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.318+0000 7fc02d800640 1 -- 172.21.15.17:0/847692402 shutdown_connections 2024-09-13T15:54:49.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.318+0000 7fc02d800640 1 --2- 172.21.15.17:0/847692402 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc00c0a11e0 0x7fc00c0a36a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.318+0000 7fc02d800640 1 --2- 172.21.15.17:0/847692402 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc028103b50 0x7fc02819f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.318+0000 7fc02d800640 1 --2- 172.21.15.17:0/847692402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc028103190 0x7fc028198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.318+0000 7fc02d800640 1 --2- 172.21.15.17:0/847692402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc028101fa0 0x7fc028197fe0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.318+0000 7fc02d800640 1 -- 172.21.15.17:0/847692402 >> 172.21.15.17:0/847692402 conn(0x7fc0280fd700 msgr2=0x7fc0281066a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:49.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.318+0000 7fc02d800640 1 -- 172.21.15.17:0/847692402 shutdown_connections 2024-09-13T15:54:49.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.318+0000 7fc02d800640 1 -- 172.21.15.17:0/847692402 wait complete. 2024-09-13T15:54:49.339 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:54:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.505+0000 7fb5a2200640 1 -- 172.21.15.17:0/2944684391 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb59c103b60 msgr2=0x7fb59c10a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.505+0000 7fb5a2200640 1 --2- 172.21.15.17:0/2944684391 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb59c103b60 0x7fb59c10a3f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb594009ca0 tx=0x7fb59402a8c0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.505+0000 7fb5a2200640 1 -- 172.21.15.17:0/2944684391 shutdown_connections 2024-09-13T15:54:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.505+0000 7fb5a2200640 1 --2- 172.21.15.17:0/2944684391 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb59c103b60 0x7fb59c10a3f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.505+0000 7fb5a2200640 1 --2- 172.21.15.17:0/2944684391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb59c1031a0 0x7fb59c103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.505+0000 7fb5a2200640 1 --2- 172.21.15.17:0/2944684391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb59c101fb0 0x7fb59c1023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.505+0000 7fb5a2200640 1 -- 172.21.15.17:0/2944684391 >> 172.21.15.17:0/2944684391 conn(0x7fb59c0fd730 msgr2=0x7fb59c0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.505+0000 7fb5a2200640 1 -- 172.21.15.17:0/2944684391 shutdown_connections 2024-09-13T15:54:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.505+0000 7fb5a2200640 1 -- 172.21.15.17:0/2944684391 wait complete. 2024-09-13T15:54:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.506+0000 7fb5a2200640 1 Processor -- start 2024-09-13T15:54:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.506+0000 7fb5a2200640 1 -- start start 2024-09-13T15:54:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.506+0000 7fb5a2200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb59c101fb0 0x7fb59c197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.506+0000 7fb5a2200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb59c1031a0 0x7fb59c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.506+0000 7fb5a2200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb59c103b60 0x7fb59c19f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.506+0000 7fb5a2200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c19f9f0 con 0x7fb59c1031a0 2024-09-13T15:54:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.506+0000 7fb5a2200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c19fb60 con 0x7fb59c103b60 2024-09-13T15:54:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.506+0000 7fb5a2200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c19fd20 con 0x7fb59c101fb0 2024-09-13T15:54:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.507+0000 7fb59be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb59c103b60 0x7fb59c19f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.507+0000 7fb59aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb59c1031a0 0x7fb59c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.507+0000 7fb59be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb59c103b60 0x7fb59c19f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:44982/0 (socket says 172.21.15.17:44982) 2024-09-13T15:54:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.507+0000 7fb59be00640 1 -- 172.21.15.17:0/3249206240 learned_addr learned my addr 172.21.15.17:0/3249206240 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:49.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.507+0000 7fb59b400640 1 --2- 172.21.15.17:0/3249206240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb59c101fb0 0x7fb59c197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:49.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.507+0000 7fb59b400640 1 -- 172.21.15.17:0/3249206240 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb59c103b60 msgr2=0x7fb59c19f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:49.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.507+0000 7fb59b400640 1 --2- 172.21.15.17:0/3249206240 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb59c103b60 0x7fb59c19f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.507+0000 7fb59b400640 1 -- 172.21.15.17:0/3249206240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb59c1031a0 msgr2=0x7fb59c198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:49.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.507+0000 7fb59b400640 1 --2- 172.21.15.17:0/3249206240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb59c1031a0 0x7fb59c198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.507+0000 7fb59b400640 1 -- 172.21.15.17:0/3249206240 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb594009900 con 0x7fb59c101fb0 2024-09-13T15:54:49.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.507+0000 7fb59b400640 1 --2- 172.21.15.17:0/3249206240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb59c101fb0 0x7fb59c197f00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb58c00e9c0 tx=0x7fb58c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.508+0000 7fb593e00640 1 -- 172.21.15.17:0/3249206240 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c00ccc0 con 0x7fb59c101fb0 2024-09-13T15:54:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.508+0000 7fb5a2200640 1 -- 172.21.15.17:0/3249206240 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb59c19ffa0 con 0x7fb59c101fb0 2024-09-13T15:54:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.508+0000 7fb593e00640 1 -- 172.21.15.17:0/3249206240 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb58c0044f0 con 0x7fb59c101fb0 2024-09-13T15:54:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.508+0000 7fb593e00640 1 -- 172.21.15.17:0/3249206240 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c003ea0 con 0x7fb59c101fb0 2024-09-13T15:54:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.508+0000 7fb5a2200640 1 -- 172.21.15.17:0/3249206240 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb59c1a0420 con 0x7fb59c101fb0 2024-09-13T15:54:49.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.509+0000 7fb5a2200640 1 -- 172.21.15.17:0/3249206240 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb59c1093a0 con 0x7fb59c101fb0 2024-09-13T15:54:49.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.511+0000 7fb593e00640 1 -- 172.21.15.17:0/3249206240 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb58c0035f0 con 0x7fb59c101fb0 2024-09-13T15:54:49.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.512+0000 7fb593e00640 1 --2- 172.21.15.17:0/3249206240 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb5800a1110 0x7fb5800a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:49.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.512+0000 7fb593e00640 1 -- 172.21.15.17:0/3249206240 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb58c014070 con 0x7fb59c101fb0 2024-09-13T15:54:49.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.512+0000 7fb59aa00640 1 --2- 172.21.15.17:0/3249206240 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb5800a1110 0x7fb5800a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:49.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.513+0000 7fb59aa00640 1 --2- 172.21.15.17:0/3249206240 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb5800a1110 0x7fb5800a35d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb59c199410 tx=0x7fb588005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:49.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.516+0000 7fb593e00640 1 -- 172.21.15.17:0/3249206240 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb58c096330 con 0x7fb59c101fb0 2024-09-13T15:54:49.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.712+0000 7fb5a2200640 1 -- 172.21.15.17:0/3249206240 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb59c02c480 con 0x7fb59c101fb0 2024-09-13T15:54:49.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.713+0000 7fb593e00640 1 -- 172.21.15.17:0/3249206240 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18397 (secure 0 0 0) 0x7fb58c099950 con 0x7fb59c101fb0 2024-09-13T15:54:49.715 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:49.715 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":82,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","created":"2024-09-13T15:46:50.475750+0000","modified":"2024-09-13T15:54:00.415572+0000","last_up_change":"2024-09-13T15:53:59.138985+0000","last_in_change":"2024-09-13T15:53:39.220264+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:50:10.657011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5d39d6af-15e6-463b-b9ff-a9a5dd94e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6803","nonce":158651212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6805","nonce":158651212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6809","nonce":158651212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6807","nonce":158651212}]},"public_addr":"172.21.15.17:6803/158651212","cluster_addr":"172.21.15.17:6805/158651212","heartbeat_back_addr":"172.21.15.17:6809/158651212","heartbeat_front_addr":"172.21.15.17:6807/158651212","state":["exists","up"]},{"osd":1,"uuid":"0da621c7-645b-44ae-ba7c-a573861c3aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6801","nonce":964319421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6803","nonce":964319421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6807","nonce":964319421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6805","nonce":964319421}]},"public_addr":"172.21.15.189:6801/964319421","cluster_addr":"172.21.15.189:6803/964319421","heartbeat_back_addr":"172.21.15.189:6807/964319421","heartbeat_front_addr":"172.21.15.189:6805/964319421","state":["exists","up"]},{"osd":2,"uuid":"fa95af60-1486-4a29-8c79-8a73a4146552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6801","nonce":138468002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6803","nonce":138468002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6807","nonce":138468002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6805","nonce":138468002}]},"public_addr":"172.21.15.193:6801/138468002","cluster_addr":"172.21.15.193:6803/138468002","heartbeat_back_addr":"172.21.15.193:6807/138468002","heartbeat_front_addr":"172.21.15.193:6805/138468002","state":["exists","up"]},{"osd":3,"uuid":"90428e5f-dfd4-4cda-b240-fdb9079bcb7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6811","nonce":919913803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6813","nonce":919913803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6817","nonce":919913803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6815","nonce":919913803}]},"public_addr":"172.21.15.17:6811/919913803","cluster_addr":"172.21.15.17:6813/919913803","heartbeat_back_addr":"172.21.15.17:6817/919913803","heartbeat_front_addr":"172.21.15.17:6815/919913803","state":["exists","up"]},{"osd":4,"uuid":"e1c537b6-98d2-4b66-b15a-65fe70b0ce25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6809","nonce":2310375565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6811","nonce":2310375565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6815","nonce":2310375565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6813","nonce":2310375565}]},"public_addr":"172.21.15.189:6809/2310375565","cluster_addr":"172.21.15.189:6811/2310375565","heartbeat_back_addr":"172.21.15.189:6815/2310375565","heartbeat_front_addr":"172.21.15.189:6813/2310375565","state":["exists","up"]},{"osd":5,"uuid":"48522fd7-d781-4447-873f-174dabd1e33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6809","nonce":1330877824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6811","nonce":1330877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6815","nonce":1330877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6813","nonce":1330877824}]},"public_addr":"172.21.15.193:6809/1330877824","cluster_addr":"172.21.15.193:6811/1330877824","heartbeat_back_addr":"172.21.15.193:6815/1330877824","heartbeat_front_addr":"172.21.15.193:6813/1330877824","state":["exists","up"]},{"osd":6,"uuid":"47bea191-fb53-40a7-8563-8ebf17dd5bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6819","nonce":3930545382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6821","nonce":3930545382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6825","nonce":3930545382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6823","nonce":3930545382}]},"public_addr":"172.21.15.17:6819/3930545382","cluster_addr":"172.21.15.17:6821/3930545382","heartbeat_back_addr":"172.21.15.17:6825/3930545382","heartbeat_front_addr":"172.21.15.17:6823/3930545382","state":["exists","up"]},{"osd":7,"uuid":"a98f36f9-0a19-4c9a-8ed1-615c4a6e7658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6817","nonce":3691677495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6819","nonce":3691677495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6823","nonce":3691677495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6821","nonce":3691677495}]},"public_addr":"172.21.15.189:6817/3691677495","cluster_addr":"172.21.15.189:6819/3691677495","heartbeat_back_addr":"172.21.15.189:6823/3691677495","heartbeat_front_addr":"172.21.15.189:6821/3691677495","state":["exists","up"]},{"osd":8,"uuid":"7a372d9f-c40f-4ead-87da-2f3a570c1373","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6817","nonce":4112907498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6819","nonce":4112907498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6823","nonce":4112907498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6821","nonce":4112907498}]},"public_addr":"172.21.15.193:6817/4112907498","cluster_addr":"172.21.15.193:6819/4112907498","heartbeat_back_addr":"172.21.15.193:6823/4112907498","heartbeat_front_addr":"172.21.15.193:6821/4112907498","state":["exists","up"]},{"osd":9,"uuid":"ac3d983c-c5e7-456b-8271-7c4e6169de61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6827","nonce":663424274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6829","nonce":663424274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6833","nonce":663424274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6831","nonce":663424274}]},"public_addr":"172.21.15.17:6827/663424274","cluster_addr":"172.21.15.17:6829/663424274","heartbeat_back_addr":"172.21.15.17:6833/663424274","heartbeat_front_addr":"172.21.15.17:6831/663424274","state":["exists","up"]},{"osd":10,"uuid":"08dcae02-6c79-4a06-ae88-6eb6e6941cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6825","nonce":3153990375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6827","nonce":3153990375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6831","nonce":3153990375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6829","nonce":3153990375}]},"public_addr":"172.21.15.189:6825/3153990375","cluster_addr":"172.21.15.189:6827/3153990375","heartbeat_back_addr":"172.21.15.189:6831/3153990375","heartbeat_front_addr":"172.21.15.189:6829/3153990375","state":["exists","up"]},{"osd":11,"uuid":"a4ebcf41-d805-4d44-b112-13ae84d51868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6825","nonce":4088053907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6827","nonce":4088053907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6831","nonce":4088053907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6829","nonce":4088053907}]},"public_addr":"172.21.15.193:6825/4088053907","cluster_addr":"172.21.15.193:6827/4088053907","heartbeat_back_addr":"172.21.15.193:6831/4088053907","heartbeat_front_addr":"172.21.15.193:6829/4088053907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:22.172370+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:44.802224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:06.641435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:34.536515+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:58.789324+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:22.189862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:50.382257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:14.678047+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:38.581105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:07.258150+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:32.261383+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:56.739338+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/1550067038":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/3360683829":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/634066188":"2024-09-14T15:47:42.048005+0000","172.21.15.17:6801/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1945536687":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/2214214377":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1224386591":"2024-09-14T15:47:14.996424+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:54:49.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.715+0000 7fb5a2200640 1 -- 172.21.15.17:0/3249206240 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb5800a1110 msgr2=0x7fb5800a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:49.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.715+0000 7fb5a2200640 1 --2- 172.21.15.17:0/3249206240 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb5800a1110 0x7fb5800a35d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb59c199410 tx=0x7fb588005f90 comp rx=0 tx=0).stop 2024-09-13T15:54:49.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.715+0000 7fb5a2200640 1 -- 172.21.15.17:0/3249206240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb59c101fb0 msgr2=0x7fb59c197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:49.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.715+0000 7fb5a2200640 1 --2- 172.21.15.17:0/3249206240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb59c101fb0 0x7fb59c197f00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb58c00e9c0 tx=0x7fb58c00ee80 comp rx=0 tx=0).stop 2024-09-13T15:54:49.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.715+0000 7fb5a2200640 1 -- 172.21.15.17:0/3249206240 shutdown_connections 2024-09-13T15:54:49.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.715+0000 7fb5a2200640 1 --2- 172.21.15.17:0/3249206240 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb5800a1110 0x7fb5800a35d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.715+0000 7fb5a2200640 1 --2- 172.21.15.17:0/3249206240 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb59c103b60 0x7fb59c19f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.715+0000 7fb5a2200640 1 --2- 172.21.15.17:0/3249206240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb59c1031a0 0x7fb59c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.715+0000 7fb5a2200640 1 --2- 172.21.15.17:0/3249206240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb59c101fb0 0x7fb59c197f00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.715+0000 7fb5a2200640 1 -- 172.21.15.17:0/3249206240 >> 172.21.15.17:0/3249206240 conn(0x7fb59c0fd730 msgr2=0x7fb59c106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:49.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.715+0000 7fb5a2200640 1 -- 172.21.15.17:0/3249206240 shutdown_connections 2024-09-13T15:54:49.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.716+0000 7fb5a2200640 1 -- 172.21.15.17:0/3249206240 wait complete. 2024-09-13T15:54:49.735 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:50:10.657011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:54:49.735 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:54:49.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.902+0000 7f3fa8000640 1 -- 172.21.15.17:0/1297527384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fa0103b50 msgr2=0x7f3fa010a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:49.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.902+0000 7f3fa8000640 1 --2- 172.21.15.17:0/1297527384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fa0103b50 0x7f3fa010a3e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3f98009ca0 tx=0x7f3f9802a8c0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.902+0000 7f3fa8000640 1 -- 172.21.15.17:0/1297527384 shutdown_connections 2024-09-13T15:54:49.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.902+0000 7f3fa8000640 1 --2- 172.21.15.17:0/1297527384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fa0103b50 0x7f3fa010a3e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.902+0000 7f3fa8000640 1 --2- 172.21.15.17:0/1297527384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3fa0103190 0x7f3fa0103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.902+0000 7f3fa8000640 1 --2- 172.21.15.17:0/1297527384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fa0101fa0 0x7f3fa01023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.902+0000 7f3fa8000640 1 -- 172.21.15.17:0/1297527384 >> 172.21.15.17:0/1297527384 conn(0x7f3fa00fd700 msgr2=0x7f3fa00ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:49.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.902+0000 7f3fa8000640 1 -- 172.21.15.17:0/1297527384 shutdown_connections 2024-09-13T15:54:49.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.902+0000 7f3fa8000640 1 -- 172.21.15.17:0/1297527384 wait complete. 2024-09-13T15:54:49.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.903+0000 7f3fa8000640 1 Processor -- start 2024-09-13T15:54:49.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.903+0000 7f3fa8000640 1 -- start start 2024-09-13T15:54:49.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.903+0000 7f3fa8000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fa0101fa0 0x7f3fa0197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:49.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.903+0000 7f3fa8000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fa0103190 0x7f3fa0198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:49.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.903+0000 7f3fa8000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3fa0103b50 0x7f3fa019f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:49.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.903+0000 7f3fa8000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa019f9d0 con 0x7f3fa0103190 2024-09-13T15:54:49.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.903+0000 7f3fa8000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa019fb40 con 0x7f3fa0101fa0 2024-09-13T15:54:49.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.903+0000 7f3fa8000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa019fd00 con 0x7f3fa0103b50 2024-09-13T15:54:49.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.904+0000 7f3fa4c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fa0103190 0x7f3fa0198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:49.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.904+0000 7f3fa4c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fa0103190 0x7f3fa0198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41132/0 (socket says 172.21.15.17:41132) 2024-09-13T15:54:49.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.904+0000 7f3fa4c00640 1 -- 172.21.15.17:0/1621267146 learned_addr learned my addr 172.21.15.17:0/1621267146 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:49.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.904+0000 7f3fa6000640 1 --2- 172.21.15.17:0/1621267146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3fa0103b50 0x7f3fa019f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:49.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.904+0000 7f3fa5600640 1 --2- 172.21.15.17:0/1621267146 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fa0101fa0 0x7f3fa0197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:49.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.904+0000 7f3fa4c00640 1 -- 172.21.15.17:0/1621267146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3fa0103b50 msgr2=0x7f3fa019f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:49.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.904+0000 7f3fa4c00640 1 --2- 172.21.15.17:0/1621267146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3fa0103b50 0x7f3fa019f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.904+0000 7f3fa4c00640 1 -- 172.21.15.17:0/1621267146 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fa0101fa0 msgr2=0x7f3fa0197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:49.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.904+0000 7f3fa4c00640 1 --2- 172.21.15.17:0/1621267146 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fa0101fa0 0x7f3fa0197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:49.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.904+0000 7f3fa4c00640 1 -- 172.21.15.17:0/1621267146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f94009490 con 0x7f3fa0103190 2024-09-13T15:54:49.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.904+0000 7f3fa5600640 1 --2- 172.21.15.17:0/1621267146 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fa0101fa0 0x7f3fa0197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:54:49.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.905+0000 7f3fa4c00640 1 --2- 172.21.15.17:0/1621267146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fa0103190 0x7f3fa0198420 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00e9f0 tx=0x7f3f8c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:49.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.905+0000 7f3f9e000640 1 -- 172.21.15.17:0/1621267146 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c009720 con 0x7f3fa0103190 2024-09-13T15:54:49.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.905+0000 7f3fa8000640 1 -- 172.21.15.17:0/1621267146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f98009900 con 0x7f3fa0103190 2024-09-13T15:54:49.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.905+0000 7f3f9e000640 1 -- 172.21.15.17:0/1621267146 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f8c00cd80 con 0x7f3fa0103190 2024-09-13T15:54:49.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.905+0000 7f3f9e000640 1 -- 172.21.15.17:0/1621267146 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c010430 con 0x7f3fa0103190 2024-09-13T15:54:49.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.905+0000 7f3fa8000640 1 -- 172.21.15.17:0/1621267146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa01a0280 con 0x7f3fa0103190 2024-09-13T15:54:49.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.907+0000 7f3fa8000640 1 -- 172.21.15.17:0/1621267146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa01023a0 con 0x7f3fa0103190 2024-09-13T15:54:49.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.908+0000 7f3f9e000640 1 -- 172.21.15.17:0/1621267146 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3f8c005020 con 0x7f3fa0103190 2024-09-13T15:54:49.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.910+0000 7f3f9e000640 1 --2- 172.21.15.17:0/1621267146 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3f880a1090 0x7f3f880a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:49.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.910+0000 7f3f9e000640 1 -- 172.21.15.17:0/1621267146 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3f8c014070 con 0x7f3fa0103190 2024-09-13T15:54:49.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.910+0000 7f3fa5600640 1 --2- 172.21.15.17:0/1621267146 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3f880a1090 0x7f3f880a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:49.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.911+0000 7f3fa5600640 1 --2- 172.21.15.17:0/1621267146 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3f880a1090 0x7f3f880a3550 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0102ff0 tx=0x7f3f94005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:49.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:49.914+0000 7f3f9e000640 1 -- 172.21.15.17:0/1621267146 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3f8c096480 con 0x7f3fa0103190 2024-09-13T15:54:50.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:49 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/847692402' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:50.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:49 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:50.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:49 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:50.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:49 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:50.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:49 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:50.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:49 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3249206240' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:54:50.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:49 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/847692402' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:50.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:49 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:50.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:49 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:50.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:49 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:50.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:49 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:50.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:49 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3249206240' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:54:50.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.103+0000 7f3fa8000640 1 -- 172.21.15.17:0/1621267146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3fa010da10 con 0x7f3fa0103190 2024-09-13T15:54:50.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.104+0000 7f3f9e000640 1 -- 172.21.15.17:0/1621267146 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3f8c099aa0 con 0x7f3fa0103190 2024-09-13T15:54:50.106 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-13T15:54:50.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:49 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/847692402' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:50.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:49 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:50.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:49 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:50.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:49 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:50.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:49 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:50.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:49 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3249206240' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:54:50.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.106+0000 7f3fa8000640 1 -- 172.21.15.17:0/1621267146 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3f880a1090 msgr2=0x7f3f880a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:50.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.106+0000 7f3fa8000640 1 --2- 172.21.15.17:0/1621267146 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3f880a1090 0x7f3f880a3550 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0102ff0 tx=0x7f3f94005f90 comp rx=0 tx=0).stop 2024-09-13T15:54:50.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.106+0000 7f3fa8000640 1 -- 172.21.15.17:0/1621267146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fa0103190 msgr2=0x7f3fa0198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:50.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.106+0000 7f3fa8000640 1 --2- 172.21.15.17:0/1621267146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fa0103190 0x7f3fa0198420 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00e9f0 tx=0x7f3f8c00edf0 comp rx=0 tx=0).stop 2024-09-13T15:54:50.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.106+0000 7f3fa8000640 1 -- 172.21.15.17:0/1621267146 shutdown_connections 2024-09-13T15:54:50.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.106+0000 7f3fa8000640 1 --2- 172.21.15.17:0/1621267146 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3f880a1090 0x7f3f880a3550 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:50.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.106+0000 7f3fa8000640 1 --2- 172.21.15.17:0/1621267146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3fa0103b50 0x7f3fa019f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:50.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.106+0000 7f3fa8000640 1 --2- 172.21.15.17:0/1621267146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fa0103190 0x7f3fa0198420 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:50.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.106+0000 7f3fa8000640 1 --2- 172.21.15.17:0/1621267146 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fa0101fa0 0x7f3fa0197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:50.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.107+0000 7f3fa8000640 1 -- 172.21.15.17:0/1621267146 >> 172.21.15.17:0/1621267146 conn(0x7f3fa00fd700 msgr2=0x7f3fa01065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:50.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.107+0000 7f3fa8000640 1 -- 172.21.15.17:0/1621267146 shutdown_connections 2024-09-13T15:54:50.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.107+0000 7f3fa8000640 1 -- 172.21.15.17:0/1621267146 wait complete. 2024-09-13T15:54:50.128 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T15:54:50.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.287+0000 7faaaa000640 1 -- 172.21.15.17:0/4227426085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faaa4103180 msgr2=0x7faaa4103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:50.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.287+0000 7faaaa000640 1 --2- 172.21.15.17:0/4227426085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faaa4103180 0x7faaa4103600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faa90009860 tx=0x7faa9002a340 comp rx=0 tx=0).stop 2024-09-13T15:54:50.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.287+0000 7faaaa000640 1 -- 172.21.15.17:0/4227426085 shutdown_connections 2024-09-13T15:54:50.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.287+0000 7faaaa000640 1 --2- 172.21.15.17:0/4227426085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa4103b40 0x7faaa410a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:50.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.287+0000 7faaaa000640 1 --2- 172.21.15.17:0/4227426085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faaa4103180 0x7faaa4103600 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:50.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.287+0000 7faaaa000640 1 --2- 172.21.15.17:0/4227426085 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faaa4101f90 0x7faaa4102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:50.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.287+0000 7faaaa000640 1 -- 172.21.15.17:0/4227426085 >> 172.21.15.17:0/4227426085 conn(0x7faaa40fd6f0 msgr2=0x7faaa40ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:50.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.287+0000 7faaaa000640 1 -- 172.21.15.17:0/4227426085 shutdown_connections 2024-09-13T15:54:50.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.287+0000 7faaaa000640 1 -- 172.21.15.17:0/4227426085 wait complete. 2024-09-13T15:54:50.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.288+0000 7faaaa000640 1 Processor -- start 2024-09-13T15:54:50.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.288+0000 7faaaa000640 1 -- start start 2024-09-13T15:54:50.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.288+0000 7faaaa000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faaa4101f90 0x7faaa4198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:50.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.288+0000 7faaaa000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa4103180 0x7faaa4198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:50.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.288+0000 7faaaa000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faaa4103b40 0x7faaa419f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:50.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.288+0000 7faaaa000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa419fa90 con 0x7faaa4103180 2024-09-13T15:54:50.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.288+0000 7faaaa000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa419fc00 con 0x7faaa4101f90 2024-09-13T15:54:50.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.288+0000 7faaaa000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa419fdc0 con 0x7faaa4103b40 2024-09-13T15:54:50.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.289+0000 7faaa3400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faaa4101f90 0x7faaa4198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:50.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.289+0000 7faaa2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa4103180 0x7faaa4198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:50.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.289+0000 7faaa3400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faaa4101f90 0x7faaa4198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:45028/0 (socket says 172.21.15.17:45028) 2024-09-13T15:54:50.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.289+0000 7faaa3400640 1 -- 172.21.15.17:0/890390302 learned_addr learned my addr 172.21.15.17:0/890390302 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:50.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.289+0000 7faaa3e00640 1 --2- 172.21.15.17:0/890390302 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faaa4103b40 0x7faaa419f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:50.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.289+0000 7faaa3400640 1 -- 172.21.15.17:0/890390302 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faaa4103b40 msgr2=0x7faaa419f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:50.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.289+0000 7faaa3400640 1 --2- 172.21.15.17:0/890390302 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faaa4103b40 0x7faaa419f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:50.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.289+0000 7faaa3400640 1 -- 172.21.15.17:0/890390302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa4103180 msgr2=0x7faaa4198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:50.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.289+0000 7faaa3400640 1 --2- 172.21.15.17:0/890390302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa4103180 0x7faaa4198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:50.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.289+0000 7faaa3400640 1 -- 172.21.15.17:0/890390302 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa90009490 con 0x7faaa4101f90 2024-09-13T15:54:50.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.289+0000 7faaa2a00640 1 --2- 172.21.15.17:0/890390302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa4103180 0x7faaa4198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:54:50.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.289+0000 7faaa3400640 1 --2- 172.21.15.17:0/890390302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faaa4101f90 0x7faaa4198040 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faa9400e9f0 tx=0x7faa9400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:50.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.290+0000 7faa9be00640 1 -- 172.21.15.17:0/890390302 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9400ccc0 con 0x7faaa4101f90 2024-09-13T15:54:50.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.290+0000 7faa9be00640 1 -- 172.21.15.17:0/890390302 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa940044f0 con 0x7faaa4101f90 2024-09-13T15:54:50.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.290+0000 7faaaa000640 1 -- 172.21.15.17:0/890390302 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa41a00a0 con 0x7faaa4101f90 2024-09-13T15:54:50.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.290+0000 7faa9be00640 1 -- 172.21.15.17:0/890390302 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa94010430 con 0x7faaa4101f90 2024-09-13T15:54:50.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.290+0000 7faaaa000640 1 -- 172.21.15.17:0/890390302 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa41a0530 con 0x7faaa4101f90 2024-09-13T15:54:50.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.291+0000 7faaaa000640 1 -- 172.21.15.17:0/890390302 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa4109420 con 0x7faaa4101f90 2024-09-13T15:54:50.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.293+0000 7faa9be00640 1 -- 172.21.15.17:0/890390302 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7faa94003ed0 con 0x7faaa4101f90 2024-09-13T15:54:50.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.294+0000 7faa9be00640 1 --2- 172.21.15.17:0/890390302 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7faa880a1090 0x7faa880a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:50.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.294+0000 7faa9be00640 1 -- 172.21.15.17:0/890390302 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7faa94014070 con 0x7faaa4101f90 2024-09-13T15:54:50.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.294+0000 7faaa2a00640 1 --2- 172.21.15.17:0/890390302 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7faa880a1090 0x7faa880a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:50.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.295+0000 7faaa2a00640 1 --2- 172.21.15.17:0/890390302 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7faa880a1090 0x7faa880a3550 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faa90030410 tx=0x7faa90030580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:50.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.298+0000 7faa9be00640 1 -- 172.21.15.17:0/890390302 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7faa94096350 con 0x7faaa4101f90 2024-09-13T15:54:50.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.486+0000 7faaaa000640 1 -- 172.21.15.17:0/890390302 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7faaa410d850 con 0x7faaa4101f90 2024-09-13T15:54:50.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.487+0000 7faa9be00640 1 -- 172.21.15.17:0/890390302 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) v1 ==== 84+0+65 (secure 0 0 0) 0x7faa94099970 con 0x7faaa4101f90 2024-09-13T15:54:50.488 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:50.489 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-13T15:54:50.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T15:54:50.489 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-09-13T15:54:50.489 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-09-13T15:54:50.489 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T15:54:50.489 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-13T15:54:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.489+0000 7faaaa000640 1 -- 172.21.15.17:0/890390302 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7faa880a1090 msgr2=0x7faa880a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.489+0000 7faaaa000640 1 --2- 172.21.15.17:0/890390302 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7faa880a1090 0x7faa880a3550 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faa90030410 tx=0x7faa90030580 comp rx=0 tx=0).stop 2024-09-13T15:54:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.489+0000 7faaaa000640 1 -- 172.21.15.17:0/890390302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faaa4101f90 msgr2=0x7faaa4198040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.489+0000 7faaaa000640 1 --2- 172.21.15.17:0/890390302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faaa4101f90 0x7faaa4198040 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faa9400e9f0 tx=0x7faa9400eeb0 comp rx=0 tx=0).stop 2024-09-13T15:54:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.489+0000 7faaaa000640 1 -- 172.21.15.17:0/890390302 shutdown_connections 2024-09-13T15:54:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.489+0000 7faaaa000640 1 --2- 172.21.15.17:0/890390302 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7faa880a1090 0x7faa880a3550 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:50.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.489+0000 7faaaa000640 1 --2- 172.21.15.17:0/890390302 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faaa4103b40 0x7faaa419f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:50.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.489+0000 7faaaa000640 1 --2- 172.21.15.17:0/890390302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa4103180 0x7faaa4198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:50.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.489+0000 7faaaa000640 1 --2- 172.21.15.17:0/890390302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faaa4101f90 0x7faaa4198040 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:50.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.489+0000 7faaaa000640 1 -- 172.21.15.17:0/890390302 >> 172.21.15.17:0/890390302 conn(0x7faaa40fd6f0 msgr2=0x7faaa41065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:50.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.490+0000 7faaaa000640 1 -- 172.21.15.17:0/890390302 shutdown_connections 2024-09-13T15:54:50.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.490+0000 7faaaa000640 1 -- 172.21.15.17:0/890390302 wait complete. 2024-09-13T15:54:50.508 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T15:54:50.508 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T15:54:50.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.692+0000 7f2d92800640 1 -- 172.21.15.17:0/2093483236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d8c103090 msgr2=0x7f2d8c103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:50.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.692+0000 7f2d92800640 1 --2- 172.21.15.17:0/2093483236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d8c103090 0x7f2d8c103510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2d78009900 tx=0x7f2d7802a3f0 comp rx=0 tx=0).stop 2024-09-13T15:54:50.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.692+0000 7f2d92800640 1 -- 172.21.15.17:0/2093483236 shutdown_connections 2024-09-13T15:54:50.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.692+0000 7f2d92800640 1 --2- 172.21.15.17:0/2093483236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d8c103a50 0x7f2d8c10a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:50.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.692+0000 7f2d92800640 1 --2- 172.21.15.17:0/2093483236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d8c103090 0x7f2d8c103510 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:50.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.692+0000 7f2d92800640 1 --2- 172.21.15.17:0/2093483236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d8c101eb0 0x7f2d8c1022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:50.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.692+0000 7f2d92800640 1 -- 172.21.15.17:0/2093483236 >> 172.21.15.17:0/2093483236 conn(0x7f2d8c0fd660 msgr2=0x7f2d8c0ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:50.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.692+0000 7f2d92800640 1 -- 172.21.15.17:0/2093483236 shutdown_connections 2024-09-13T15:54:50.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.692+0000 7f2d92800640 1 -- 172.21.15.17:0/2093483236 wait complete. 2024-09-13T15:54:50.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.693+0000 7f2d92800640 1 Processor -- start 2024-09-13T15:54:50.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.693+0000 7f2d92800640 1 -- start start 2024-09-13T15:54:50.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.693+0000 7f2d92800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d8c101eb0 0x7f2d8c197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:50.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.693+0000 7f2d92800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d8c103090 0x7f2d8c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:50.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.693+0000 7f2d92800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d8c103a50 0x7f2d8c19f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:50.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.693+0000 7f2d92800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c19f9c0 con 0x7f2d8c103090 2024-09-13T15:54:50.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.693+0000 7f2d92800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c19fb30 con 0x7f2d8c101eb0 2024-09-13T15:54:50.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.693+0000 7f2d92800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c19fcf0 con 0x7f2d8c103a50 2024-09-13T15:54:50.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.694+0000 7f2d90a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d8c103090 0x7f2d8c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:50.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.694+0000 7f2d91400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d8c101eb0 0x7f2d8c197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:50.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.694+0000 7f2d91400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d8c101eb0 0x7f2d8c197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:45054/0 (socket says 172.21.15.17:45054) 2024-09-13T15:54:50.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.694+0000 7f2d91400640 1 -- 172.21.15.17:0/1628745089 learned_addr learned my addr 172.21.15.17:0/1628745089 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:50.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.694+0000 7f2d91e00640 1 --2- 172.21.15.17:0/1628745089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d8c103a50 0x7f2d8c19f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:50.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.694+0000 7f2d91400640 1 -- 172.21.15.17:0/1628745089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d8c103a50 msgr2=0x7f2d8c19f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:50.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.694+0000 7f2d91400640 1 --2- 172.21.15.17:0/1628745089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d8c103a50 0x7f2d8c19f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:50.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.694+0000 7f2d91400640 1 -- 172.21.15.17:0/1628745089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d8c103090 msgr2=0x7f2d8c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:50.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.694+0000 7f2d91400640 1 --2- 172.21.15.17:0/1628745089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d8c103090 0x7f2d8c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:50.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.694+0000 7f2d91400640 1 -- 172.21.15.17:0/1628745089 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d78009560 con 0x7f2d8c101eb0 2024-09-13T15:54:50.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.695+0000 7f2d91e00640 1 --2- 172.21.15.17:0/1628745089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d8c103a50 0x7f2d8c19f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:54:50.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.695+0000 7f2d91400640 1 --2- 172.21.15.17:0/1628745089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d8c101eb0 0x7f2d8c197ed0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000e9c0 tx=0x7f2d8000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:50.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.695+0000 7f2d8a000640 1 -- 172.21.15.17:0/1628745089 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80009700 con 0x7f2d8c101eb0 2024-09-13T15:54:50.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.695+0000 7f2d8a000640 1 -- 172.21.15.17:0/1628745089 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d800044e0 con 0x7f2d8c101eb0 2024-09-13T15:54:50.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.695+0000 7f2d92800640 1 -- 172.21.15.17:0/1628745089 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8c19ffd0 con 0x7f2d8c101eb0 2024-09-13T15:54:50.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.695+0000 7f2d8a000640 1 -- 172.21.15.17:0/1628745089 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80010430 con 0x7f2d8c101eb0 2024-09-13T15:54:50.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.695+0000 7f2d92800640 1 -- 172.21.15.17:0/1628745089 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d8c1a03f0 con 0x7f2d8c101eb0 2024-09-13T15:54:50.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.696+0000 7f2d92800640 1 -- 172.21.15.17:0/1628745089 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8c109360 con 0x7f2d8c101eb0 2024-09-13T15:54:50.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.698+0000 7f2d8a000640 1 -- 172.21.15.17:0/1628745089 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2d80003f50 con 0x7f2d8c101eb0 2024-09-13T15:54:50.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.699+0000 7f2d8a000640 1 --2- 172.21.15.17:0/1628745089 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2d740a1090 0x7f2d740a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:50.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.699+0000 7f2d8a000640 1 -- 172.21.15.17:0/1628745089 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2d80014070 con 0x7f2d8c101eb0 2024-09-13T15:54:50.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.700+0000 7f2d90a00640 1 --2- 172.21.15.17:0/1628745089 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2d740a1090 0x7f2d740a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:50.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.700+0000 7f2d90a00640 1 --2- 172.21.15.17:0/1628745089 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2d740a1090 0x7f2d740a3550 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2d78005ab0 tx=0x7f2d78005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:50.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.705+0000 7f2d8a000640 1 -- 172.21.15.17:0/1628745089 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2d800965c0 con 0x7f2d8c101eb0 2024-09-13T15:54:50.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:50.887+0000 7f2d92800640 1 -- 172.21.15.17:0/1628745089 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2d8c10d830 con 0x7f2d8c101eb0 2024-09-13T15:54:51.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.491+0000 7f2d8a000640 1 -- 172.21.15.17:0/1628745089 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2d80099be0 con 0x7f2d8c101eb0 2024-09-13T15:54:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-09-13T15:54:51.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.495+0000 7f2d92800640 1 -- 172.21.15.17:0/1628745089 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2d740a1090 msgr2=0x7f2d740a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:51.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.495+0000 7f2d92800640 1 --2- 172.21.15.17:0/1628745089 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2d740a1090 0x7f2d740a3550 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2d78005ab0 tx=0x7f2d78005780 comp rx=0 tx=0).stop 2024-09-13T15:54:51.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.495+0000 7f2d92800640 1 -- 172.21.15.17:0/1628745089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d8c101eb0 msgr2=0x7f2d8c197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:51.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.495+0000 7f2d92800640 1 --2- 172.21.15.17:0/1628745089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d8c101eb0 0x7f2d8c197ed0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000e9c0 tx=0x7f2d8000ee80 comp rx=0 tx=0).stop 2024-09-13T15:54:51.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.495+0000 7f2d92800640 1 -- 172.21.15.17:0/1628745089 shutdown_connections 2024-09-13T15:54:51.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.495+0000 7f2d92800640 1 --2- 172.21.15.17:0/1628745089 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2d740a1090 0x7f2d740a3550 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:51.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.495+0000 7f2d92800640 1 --2- 172.21.15.17:0/1628745089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d8c103a50 0x7f2d8c19f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:51.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.495+0000 7f2d92800640 1 --2- 172.21.15.17:0/1628745089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d8c103090 0x7f2d8c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:51.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.495+0000 7f2d92800640 1 --2- 172.21.15.17:0/1628745089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d8c101eb0 0x7f2d8c197ed0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:51.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.495+0000 7f2d92800640 1 -- 172.21.15.17:0/1628745089 >> 172.21.15.17:0/1628745089 conn(0x7f2d8c0fd660 msgr2=0x7f2d8c106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:51.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.496+0000 7f2d92800640 1 -- 172.21.15.17:0/1628745089 shutdown_connections 2024-09-13T15:54:51.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.496+0000 7f2d92800640 1 -- 172.21.15.17:0/1628745089 wait complete. 2024-09-13T15:54:51.518 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-13T15:54:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.690+0000 7f713f200640 1 -- 172.21.15.17:0/244226015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71400ffce0 msgr2=0x7f71401000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.690+0000 7f713f200640 1 --2- 172.21.15.17:0/244226015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71400ffce0 0x7f71401000e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7130009860 tx=0x7f713002a340 comp rx=0 tx=0).stop 2024-09-13T15:54:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.690+0000 7f713f200640 1 -- 172.21.15.17:0/244226015 shutdown_connections 2024-09-13T15:54:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.690+0000 7f713f200640 1 --2- 172.21.15.17:0/244226015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7140101890 0x7f7140108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.690+0000 7f713f200640 1 --2- 172.21.15.17:0/244226015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7140100ed0 0x7f7140101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.690+0000 7f713f200640 1 --2- 172.21.15.17:0/244226015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71400ffce0 0x7f71401000e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.690+0000 7f713f200640 1 -- 172.21.15.17:0/244226015 >> 172.21.15.17:0/244226015 conn(0x7f71400fb440 msgr2=0x7f71400fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.690+0000 7f713f200640 1 -- 172.21.15.17:0/244226015 shutdown_connections 2024-09-13T15:54:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.690+0000 7f713f200640 1 -- 172.21.15.17:0/244226015 wait complete. 2024-09-13T15:54:51.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.691+0000 7f713f200640 1 Processor -- start 2024-09-13T15:54:51.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.691+0000 7f713f200640 1 -- start start 2024-09-13T15:54:51.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.692+0000 7f713f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71400ffce0 0x7f7140197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:51.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.692+0000 7f713f200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7140100ed0 0x7f7140198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:51.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.692+0000 7f713f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7140101890 0x7f714019f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:51.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.692+0000 7f713f200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714019fa00 con 0x7f7140101890 2024-09-13T15:54:51.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.692+0000 7f713f200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714019fb70 con 0x7f71400ffce0 2024-09-13T15:54:51.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.692+0000 7f713f200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714019fd30 con 0x7f7140100ed0 2024-09-13T15:54:51.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.692+0000 7f713de00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71400ffce0 0x7f7140197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:51.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.692+0000 7f713de00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71400ffce0 0x7f7140197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:45078/0 (socket says 172.21.15.17:45078) 2024-09-13T15:54:51.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.692+0000 7f713de00640 1 -- 172.21.15.17:0/518130626 learned_addr learned my addr 172.21.15.17:0/518130626 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:51.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.692+0000 7f7137e00640 1 --2- 172.21.15.17:0/518130626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7140100ed0 0x7f7140198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:51.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.692+0000 7f713e800640 1 --2- 172.21.15.17:0/518130626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7140101890 0x7f714019f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:51.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.692+0000 7f7137e00640 1 -- 172.21.15.17:0/518130626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71400ffce0 msgr2=0x7f7140197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:51.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.692+0000 7f7137e00640 1 --2- 172.21.15.17:0/518130626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71400ffce0 0x7f7140197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:51.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.692+0000 7f7137e00640 1 -- 172.21.15.17:0/518130626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7140101890 msgr2=0x7f714019f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:51.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.692+0000 7f7137e00640 1 --2- 172.21.15.17:0/518130626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7140101890 0x7f714019f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:51.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.692+0000 7f7137e00640 1 -- 172.21.15.17:0/518130626 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7130009490 con 0x7f7140100ed0 2024-09-13T15:54:51.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.693+0000 7f7137e00640 1 --2- 172.21.15.17:0/518130626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7140100ed0 0x7f7140198450 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f712800e9f0 tx=0x7f712800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:51.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.693+0000 7f7136a00640 1 -- 172.21.15.17:0/518130626 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712800ccc0 con 0x7f7140100ed0 2024-09-13T15:54:51.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.693+0000 7f713f200640 1 -- 172.21.15.17:0/518130626 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714019ffb0 con 0x7f7140100ed0 2024-09-13T15:54:51.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.693+0000 7f7136a00640 1 -- 172.21.15.17:0/518130626 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f712800ce20 con 0x7f7140100ed0 2024-09-13T15:54:51.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.693+0000 7f7136a00640 1 -- 172.21.15.17:0/518130626 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71280187c0 con 0x7f7140100ed0 2024-09-13T15:54:51.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.693+0000 7f713f200640 1 -- 172.21.15.17:0/518130626 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71401a04e0 con 0x7f7140100ed0 2024-09-13T15:54:51.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.694+0000 7f713f200640 1 -- 172.21.15.17:0/518130626 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71401000e0 con 0x7f7140100ed0 2024-09-13T15:54:51.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.696+0000 7f7136a00640 1 -- 172.21.15.17:0/518130626 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7128010430 con 0x7f7140100ed0 2024-09-13T15:54:51.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.697+0000 7f7136a00640 1 --2- 172.21.15.17:0/518130626 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f71240a1110 0x7f71240a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:51.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.697+0000 7f7136a00640 1 -- 172.21.15.17:0/518130626 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f7128014070 con 0x7f7140100ed0 2024-09-13T15:54:51.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.697+0000 7f713de00640 1 --2- 172.21.15.17:0/518130626 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f71240a1110 0x7f71240a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:51.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.698+0000 7f713de00640 1 --2- 172.21.15.17:0/518130626 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f71240a1110 0x7f71240a35d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7130000c00 tx=0x7f71300305a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:51.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.701+0000 7f7136a00640 1 -- 172.21.15.17:0/518130626 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7128052e20 con 0x7f7140100ed0 2024-09-13T15:54:51.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:51 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:51.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:51 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:51.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:51 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:51.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:51 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:54:51.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:51 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:51.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:51 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1621267146' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:54:51.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:51 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:54:51.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:51 smithi193 ceph-mon[35248]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:51.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:51 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/890390302' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-13T15:54:51.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:51 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:51.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:51 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:51.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:51 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:51.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:51 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:54:51.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:51 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:51.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:51 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1621267146' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:54:51.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:51 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:54:51.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:51 smithi017 ceph-mon[30494]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:51.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:51 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/890390302' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-13T15:54:51.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:51 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:51.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:51 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:51.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:51 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:51.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:51 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:54:51.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:51 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:51.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:51 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1621267146' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:54:51.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:51 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:54:51.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:51 smithi189 ceph-mon[34790]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:51.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:51 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/890390302' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-13T15:54:51.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:51.889+0000 7f713f200640 1 -- 172.21.15.17:0/518130626 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f71401a0770 con 0x7f7140100ed0 2024-09-13T15:54:52.505 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-09-13T15:54:52.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.502+0000 7f7136a00640 1 -- 172.21.15.17:0/518130626 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v84) v1 ==== 171+0+0 (secure 0 0 0) 0x7f7128099dd0 con 0x7f7140100ed0 2024-09-13T15:54:52.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.506+0000 7f713f200640 1 -- 172.21.15.17:0/518130626 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f71240a1110 msgr2=0x7f71240a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:52.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.506+0000 7f713f200640 1 --2- 172.21.15.17:0/518130626 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f71240a1110 0x7f71240a35d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7130000c00 tx=0x7f71300305a0 comp rx=0 tx=0).stop 2024-09-13T15:54:52.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.506+0000 7f713f200640 1 -- 172.21.15.17:0/518130626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7140100ed0 msgr2=0x7f7140198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:52.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.506+0000 7f713f200640 1 --2- 172.21.15.17:0/518130626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7140100ed0 0x7f7140198450 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f712800e9f0 tx=0x7f712800eeb0 comp rx=0 tx=0).stop 2024-09-13T15:54:52.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.507+0000 7f713f200640 1 -- 172.21.15.17:0/518130626 shutdown_connections 2024-09-13T15:54:52.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.507+0000 7f713f200640 1 --2- 172.21.15.17:0/518130626 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f71240a1110 0x7f71240a35d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:52.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.507+0000 7f713f200640 1 --2- 172.21.15.17:0/518130626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7140101890 0x7f714019f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:52.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.507+0000 7f713f200640 1 --2- 172.21.15.17:0/518130626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7140100ed0 0x7f7140198450 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:52.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.507+0000 7f713f200640 1 --2- 172.21.15.17:0/518130626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71400ffce0 0x7f7140197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:52.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.507+0000 7f713f200640 1 -- 172.21.15.17:0/518130626 >> 172.21.15.17:0/518130626 conn(0x7f71400fb440 msgr2=0x7f7140106760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:52.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.509+0000 7f713f200640 1 -- 172.21.15.17:0/518130626 shutdown_connections 2024-09-13T15:54:52.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.509+0000 7f713f200640 1 -- 172.21.15.17:0/518130626 wait complete. 2024-09-13T15:54:52.535 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T15:54:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.699+0000 7f40b2a00640 1 -- 172.21.15.17:0/4176692744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40ac101f80 msgr2=0x7f40ac102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.699+0000 7f40b2a00640 1 --2- 172.21.15.17:0/4176692744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40ac101f80 0x7f40ac102380 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f409c009900 tx=0x7f409c02a410 comp rx=0 tx=0).stop 2024-09-13T15:54:52.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.699+0000 7f40b2a00640 1 -- 172.21.15.17:0/4176692744 shutdown_connections 2024-09-13T15:54:52.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.699+0000 7f40b2a00640 1 --2- 172.21.15.17:0/4176692744 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40ac103b30 0x7f40ac10a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:52.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.699+0000 7f40b2a00640 1 --2- 172.21.15.17:0/4176692744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40ac103170 0x7f40ac1035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:52.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.699+0000 7f40b2a00640 1 --2- 172.21.15.17:0/4176692744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40ac101f80 0x7f40ac102380 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:52.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.699+0000 7f40b2a00640 1 -- 172.21.15.17:0/4176692744 >> 172.21.15.17:0/4176692744 conn(0x7f40ac0fd700 msgr2=0x7f40ac0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:52.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.699+0000 7f40b2a00640 1 -- 172.21.15.17:0/4176692744 shutdown_connections 2024-09-13T15:54:52.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.699+0000 7f40b2a00640 1 -- 172.21.15.17:0/4176692744 wait complete. 2024-09-13T15:54:52.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.700+0000 7f40b2a00640 1 Processor -- start 2024-09-13T15:54:52.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.700+0000 7f40b2a00640 1 -- start start 2024-09-13T15:54:52.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.701+0000 7f40b2a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40ac101f80 0x7f40ac197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:52.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.701+0000 7f40b2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40ac103170 0x7f40ac198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:52.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.701+0000 7f40b2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40ac103b30 0x7f40ac19f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:52.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.701+0000 7f40b2a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac19fa90 con 0x7f40ac103b30 2024-09-13T15:54:52.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.701+0000 7f40b2a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac19fc00 con 0x7f40ac103170 2024-09-13T15:54:52.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.701+0000 7f40b2a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac19fdc0 con 0x7f40ac101f80 2024-09-13T15:54:52.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.701+0000 7f40b0a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40ac103b30 0x7f40ac19f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:52.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.701+0000 7f40ab400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40ac103170 0x7f40ac198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:52.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.701+0000 7f40ab400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40ac103170 0x7f40ac198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:45098/0 (socket says 172.21.15.17:45098) 2024-09-13T15:54:52.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.701+0000 7f40ab400640 1 -- 172.21.15.17:0/441732241 learned_addr learned my addr 172.21.15.17:0/441732241 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:52.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.701+0000 7f40abe00640 1 --2- 172.21.15.17:0/441732241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40ac101f80 0x7f40ac197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:52.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.701+0000 7f40ab400640 1 -- 172.21.15.17:0/441732241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40ac101f80 msgr2=0x7f40ac197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:52.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.701+0000 7f40ab400640 1 --2- 172.21.15.17:0/441732241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40ac101f80 0x7f40ac197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:52.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.701+0000 7f40ab400640 1 -- 172.21.15.17:0/441732241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40ac103b30 msgr2=0x7f40ac19f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:52.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.701+0000 7f40ab400640 1 --2- 172.21.15.17:0/441732241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40ac103b30 0x7f40ac19f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:52.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.701+0000 7f40ab400640 1 -- 172.21.15.17:0/441732241 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4098009490 con 0x7f40ac103170 2024-09-13T15:54:52.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.702+0000 7f40ab400640 1 --2- 172.21.15.17:0/441732241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40ac103170 0x7f40ac198530 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f409800ea60 tx=0x7f409800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:52.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.702+0000 7f40a8c00640 1 -- 172.21.15.17:0/441732241 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409800cde0 con 0x7f40ac103170 2024-09-13T15:54:52.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.702+0000 7f40a8c00640 1 -- 172.21.15.17:0/441732241 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f40980035f0 con 0x7f40ac103170 2024-09-13T15:54:52.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.702+0000 7f40b2a00640 1 -- 172.21.15.17:0/441732241 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f409c009560 con 0x7f40ac103170 2024-09-13T15:54:52.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.702+0000 7f40a8c00640 1 -- 172.21.15.17:0/441732241 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40980044e0 con 0x7f40ac103170 2024-09-13T15:54:52.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.702+0000 7f40b2a00640 1 -- 172.21.15.17:0/441732241 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ac1a0470 con 0x7f40ac103170 2024-09-13T15:54:52.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.703+0000 7f40b2a00640 1 -- 172.21.15.17:0/441732241 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ac109410 con 0x7f40ac103170 2024-09-13T15:54:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.705+0000 7f40a8c00640 1 -- 172.21.15.17:0/441732241 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4098003a60 con 0x7f40ac103170 2024-09-13T15:54:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.706+0000 7f40a8c00640 1 --2- 172.21.15.17:0/441732241 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f40900a1110 0x7f40900a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.706+0000 7f40a8c00640 1 -- 172.21.15.17:0/441732241 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f4098014070 con 0x7f40ac103170 2024-09-13T15:54:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.706+0000 7f40abe00640 1 --2- 172.21.15.17:0/441732241 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f40900a1110 0x7f40900a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.707+0000 7f40abe00640 1 --2- 172.21.15.17:0/441732241 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f40900a1110 0x7f40900a35d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f409c031500 tx=0x7f409c005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.708+0000 7f40a8c00640 1 -- 172.21.15.17:0/441732241 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4098096bb0 con 0x7f40ac103170 2024-09-13T15:54:52.756 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:52 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1628745089' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T15:54:52.757 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:52 smithi193 ceph-mon[35248]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T15:54:52.757 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:52.757 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:52.757 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:52 smithi193 ceph-mon[35248]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-13T15:54:52.757 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:52 smithi193 ceph-mon[35248]: osdmap e83: 12 total, 12 up, 12 in 2024-09-13T15:54:52.757 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:52.757 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:52.757 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:52 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/518130626' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-13T15:54:52.757 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:52 smithi193 ceph-mon[35248]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-13T15:54:52.757 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:52 smithi193 ceph-mon[35248]: pgmap v288: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:52.757 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:52.757 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:52.758 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:52.758 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:52 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:52.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:52 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1628745089' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T15:54:52.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:52 smithi017 ceph-mon[30494]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T15:54:52.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:52.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:52.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:52 smithi017 ceph-mon[30494]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-13T15:54:52.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:52 smithi017 ceph-mon[30494]: osdmap e83: 12 total, 12 up, 12 in 2024-09-13T15:54:52.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:52.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:52.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:52 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/518130626' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-13T15:54:52.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:52 smithi017 ceph-mon[30494]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-13T15:54:52.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:52 smithi017 ceph-mon[30494]: pgmap v288: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:52.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:52.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:52.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:52.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:52 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:52.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:52 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1628745089' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T15:54:52.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:52 smithi189 ceph-mon[34790]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T15:54:52.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:52.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:52.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:52 smithi189 ceph-mon[34790]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-13T15:54:52.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:52 smithi189 ceph-mon[34790]: osdmap e83: 12 total, 12 up, 12 in 2024-09-13T15:54:52.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:52.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:52.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:52 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/518130626' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-13T15:54:52.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:52 smithi189 ceph-mon[34790]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-13T15:54:52.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:52 smithi189 ceph-mon[34790]: pgmap v288: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T15:54:52.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:52.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:52.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:52.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:52 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:54:52.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.927+0000 7f40b2a00640 1 -- 172.21.15.17:0/441732241 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f40ac10d890 con 0x7f40ac103170 2024-09-13T15:54:52.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.939+0000 7f40a8c00640 1 -- 172.21.15.17:0/441732241 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f40980b8e60 con 0x7f40ac103170 2024-09-13T15:54:52.944 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T15:54:52.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.945+0000 7f40b2a00640 1 -- 172.21.15.17:0/441732241 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f40900a1110 msgr2=0x7f40900a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:52.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.945+0000 7f40b2a00640 1 --2- 172.21.15.17:0/441732241 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f40900a1110 0x7f40900a35d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f409c031500 tx=0x7f409c005780 comp rx=0 tx=0).stop 2024-09-13T15:54:52.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.945+0000 7f40b2a00640 1 -- 172.21.15.17:0/441732241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40ac103170 msgr2=0x7f40ac198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:52.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.945+0000 7f40b2a00640 1 --2- 172.21.15.17:0/441732241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40ac103170 0x7f40ac198530 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f409800ea60 tx=0x7f409800ef20 comp rx=0 tx=0).stop 2024-09-13T15:54:52.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.945+0000 7f40b2a00640 1 -- 172.21.15.17:0/441732241 shutdown_connections 2024-09-13T15:54:52.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.945+0000 7f40b2a00640 1 --2- 172.21.15.17:0/441732241 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f40900a1110 0x7f40900a35d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:52.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.945+0000 7f40b2a00640 1 --2- 172.21.15.17:0/441732241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40ac103b30 0x7f40ac19f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:52.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.945+0000 7f40b2a00640 1 --2- 172.21.15.17:0/441732241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40ac103170 0x7f40ac198530 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:52.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.945+0000 7f40b2a00640 1 --2- 172.21.15.17:0/441732241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40ac101f80 0x7f40ac197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:52.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.945+0000 7f40b2a00640 1 -- 172.21.15.17:0/441732241 >> 172.21.15.17:0/441732241 conn(0x7f40ac0fd700 msgr2=0x7f40ac1065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:52.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.946+0000 7f40b2a00640 1 -- 172.21.15.17:0/441732241 shutdown_connections 2024-09-13T15:54:52.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:52.946+0000 7f40b2a00640 1 -- 172.21.15.17:0/441732241 wait complete. 2024-09-13T15:54:52.973 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-13T15:54:52.974 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-13T15:54:53.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.134+0000 7efe3be00640 1 -- 172.21.15.17:0/4176170895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe3c101ea0 msgr2=0x7efe3c1022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:53.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.134+0000 7efe3be00640 1 --2- 172.21.15.17:0/4176170895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe3c101ea0 0x7efe3c1022a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009900 tx=0x7efe2c02a3f0 comp rx=0 tx=0).stop 2024-09-13T15:54:53.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.134+0000 7efe3be00640 1 -- 172.21.15.17:0/4176170895 shutdown_connections 2024-09-13T15:54:53.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.134+0000 7efe3be00640 1 --2- 172.21.15.17:0/4176170895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe3c103a40 0x7efe3c10a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.134+0000 7efe3be00640 1 --2- 172.21.15.17:0/4176170895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe3c103080 0x7efe3c103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.134+0000 7efe3be00640 1 --2- 172.21.15.17:0/4176170895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe3c101ea0 0x7efe3c1022a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.134+0000 7efe3be00640 1 -- 172.21.15.17:0/4176170895 >> 172.21.15.17:0/4176170895 conn(0x7efe3c0fd670 msgr2=0x7efe3c0ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.134+0000 7efe3be00640 1 -- 172.21.15.17:0/4176170895 shutdown_connections 2024-09-13T15:54:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.135+0000 7efe3be00640 1 -- 172.21.15.17:0/4176170895 wait complete. 2024-09-13T15:54:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.135+0000 7efe3be00640 1 Processor -- start 2024-09-13T15:54:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.135+0000 7efe3be00640 1 -- start start 2024-09-13T15:54:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.136+0000 7efe3be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe3c101ea0 0x7efe3c078260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.136+0000 7efe3be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe3c103080 0x7efe3c0787a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.136+0000 7efe3be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe3c103a40 0x7efe3c074dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.136+0000 7efe3be00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c075560 con 0x7efe3c101ea0 2024-09-13T15:54:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.136+0000 7efe3be00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c0756d0 con 0x7efe3c103a40 2024-09-13T15:54:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.136+0000 7efe3be00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c075890 con 0x7efe3c103080 2024-09-13T15:54:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.136+0000 7efe3aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe3c101ea0 0x7efe3c078260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.136+0000 7efe3aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe3c101ea0 0x7efe3c078260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41210/0 (socket says 172.21.15.17:41210) 2024-09-13T15:54:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.136+0000 7efe3aa00640 1 -- 172.21.15.17:0/1364884747 learned_addr learned my addr 172.21.15.17:0/1364884747 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.136+0000 7efe32000640 1 --2- 172.21.15.17:0/1364884747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe3c103080 0x7efe3c0787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.136+0000 7efe3b400640 1 --2- 172.21.15.17:0/1364884747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe3c103a40 0x7efe3c074dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.136+0000 7efe3aa00640 1 -- 172.21.15.17:0/1364884747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe3c103080 msgr2=0x7efe3c0787a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.136+0000 7efe3aa00640 1 --2- 172.21.15.17:0/1364884747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe3c103080 0x7efe3c0787a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.136+0000 7efe3aa00640 1 -- 172.21.15.17:0/1364884747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe3c103a40 msgr2=0x7efe3c074dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.136+0000 7efe3aa00640 1 --2- 172.21.15.17:0/1364884747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe3c103a40 0x7efe3c074dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.136+0000 7efe3aa00640 1 -- 172.21.15.17:0/1364884747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c009560 con 0x7efe3c101ea0 2024-09-13T15:54:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.137+0000 7efe3aa00640 1 --2- 172.21.15.17:0/1364884747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe3c101ea0 0x7efe3c078260 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0057c0 tx=0x7efe2c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.137+0000 7efe33e00640 1 -- 172.21.15.17:0/1364884747 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c004bd0 con 0x7efe3c101ea0 2024-09-13T15:54:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.137+0000 7efe33e00640 1 -- 172.21.15.17:0/1364884747 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe2c004d30 con 0x7efe3c101ea0 2024-09-13T15:54:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.137+0000 7efe33e00640 1 -- 172.21.15.17:0/1364884747 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c031b60 con 0x7efe3c101ea0 2024-09-13T15:54:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.137+0000 7efe3be00640 1 -- 172.21.15.17:0/1364884747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c1a4350 con 0x7efe3c101ea0 2024-09-13T15:54:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.137+0000 7efe3be00640 1 -- 172.21.15.17:0/1364884747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c1a4810 con 0x7efe3c101ea0 2024-09-13T15:54:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.138+0000 7efe3be00640 1 -- 172.21.15.17:0/1364884747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c1093b0 con 0x7efe3c101ea0 2024-09-13T15:54:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.140+0000 7efe33e00640 1 -- 172.21.15.17:0/1364884747 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7efe2c031cc0 con 0x7efe3c101ea0 2024-09-13T15:54:53.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.141+0000 7efe33e00640 1 --2- 172.21.15.17:0/1364884747 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efe200a1110 0x7efe200a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:53.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.142+0000 7efe33e00640 1 -- 172.21.15.17:0/1364884747 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7efe2c0eddf0 con 0x7efe3c101ea0 2024-09-13T15:54:53.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.142+0000 7efe32000640 1 --2- 172.21.15.17:0/1364884747 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efe200a1110 0x7efe200a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:53.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.142+0000 7efe32000640 1 --2- 172.21.15.17:0/1364884747 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efe200a1110 0x7efe200a35d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efe3c0761e0 tx=0x7efe24005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:53.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.144+0000 7efe33e00640 1 -- 172.21.15.17:0/1364884747 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efe2c0b7630 con 0x7efe3c101ea0 2024-09-13T15:54:53.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.336+0000 7efe3be00640 1 -- 172.21.15.17:0/1364884747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7efe3c10d7b0 con 0x7efe3c101ea0 2024-09-13T15:54:53.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:53 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:54:53.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:53 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:53.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:53 smithi193 ceph-mon[35248]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-13T15:54:53.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:53 smithi193 ceph-mon[35248]: osdmap e84: 12 total, 12 up, 12 in 2024-09-13T15:54:53.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:53 smithi193 ceph-mon[35248]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T15:54:53.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:53 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/441732241' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T15:54:53.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:53 smithi193 ceph-mon[35248]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T15:54:53.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:53 smithi193 ceph-mon[35248]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-13T15:54:53.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:53 smithi193 ceph-mon[35248]: osdmap e85: 12 total, 12 up, 12 in 2024-09-13T15:54:53.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:53 smithi193 ceph-mon[35248]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-13T15:54:53.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:53 smithi193 ceph-mon[35248]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-13T15:54:53.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:53 smithi193 ceph-mon[35248]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-13T15:54:53.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:53 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1364884747' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-13T15:54:53.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:53 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:54:53.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:53 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:53.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:53 smithi017 ceph-mon[30494]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-13T15:54:53.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:53 smithi017 ceph-mon[30494]: osdmap e84: 12 total, 12 up, 12 in 2024-09-13T15:54:53.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:53 smithi017 ceph-mon[30494]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T15:54:53.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:53 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/441732241' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T15:54:53.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:53 smithi017 ceph-mon[30494]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T15:54:53.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:53 smithi017 ceph-mon[30494]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-13T15:54:53.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:53 smithi017 ceph-mon[30494]: osdmap e85: 12 total, 12 up, 12 in 2024-09-13T15:54:53.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:53 smithi017 ceph-mon[30494]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-13T15:54:53.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:53 smithi017 ceph-mon[30494]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-13T15:54:53.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:53 smithi017 ceph-mon[30494]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-13T15:54:53.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:53 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1364884747' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-13T15:54:53.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:53 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:54:53.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:53 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:54:53.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:53 smithi189 ceph-mon[34790]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-13T15:54:53.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:53 smithi189 ceph-mon[34790]: osdmap e84: 12 total, 12 up, 12 in 2024-09-13T15:54:53.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:53 smithi189 ceph-mon[34790]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T15:54:53.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:53 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/441732241' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T15:54:53.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:53 smithi189 ceph-mon[34790]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T15:54:53.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:53 smithi189 ceph-mon[34790]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-13T15:54:53.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:53 smithi189 ceph-mon[34790]: osdmap e85: 12 total, 12 up, 12 in 2024-09-13T15:54:53.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:53 smithi189 ceph-mon[34790]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-13T15:54:53.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:53 smithi189 ceph-mon[34790]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-13T15:54:53.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:53 smithi189 ceph-mon[34790]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-13T15:54:53.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:53 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1364884747' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-13T15:54:53.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.939+0000 7efe33e00640 1 -- 172.21.15.17:0/1364884747 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v86) v1 ==== 157+0+0 (secure 0 0 0) 0x7efe2c0bac50 con 0x7efe3c101ea0 2024-09-13T15:54:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.942+0000 7efe3be00640 1 -- 172.21.15.17:0/1364884747 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efe200a1110 msgr2=0x7efe200a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.942+0000 7efe3be00640 1 --2- 172.21.15.17:0/1364884747 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efe200a1110 0x7efe200a35d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efe3c0761e0 tx=0x7efe24005f90 comp rx=0 tx=0).stop 2024-09-13T15:54:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.942+0000 7efe3be00640 1 -- 172.21.15.17:0/1364884747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe3c101ea0 msgr2=0x7efe3c078260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.942+0000 7efe3be00640 1 --2- 172.21.15.17:0/1364884747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe3c101ea0 0x7efe3c078260 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0057c0 tx=0x7efe2c0055a0 comp rx=0 tx=0).stop 2024-09-13T15:54:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.942+0000 7efe3be00640 1 -- 172.21.15.17:0/1364884747 shutdown_connections 2024-09-13T15:54:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.942+0000 7efe3be00640 1 --2- 172.21.15.17:0/1364884747 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efe200a1110 0x7efe200a35d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.942+0000 7efe3be00640 1 --2- 172.21.15.17:0/1364884747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe3c103a40 0x7efe3c074dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.942+0000 7efe3be00640 1 --2- 172.21.15.17:0/1364884747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe3c103080 0x7efe3c0787a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.942+0000 7efe3be00640 1 --2- 172.21.15.17:0/1364884747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe3c101ea0 0x7efe3c078260 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.942+0000 7efe3be00640 1 -- 172.21.15.17:0/1364884747 >> 172.21.15.17:0/1364884747 conn(0x7efe3c0fd670 msgr2=0x7efe3c106580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.942+0000 7efe3be00640 1 -- 172.21.15.17:0/1364884747 shutdown_connections 2024-09-13T15:54:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:53.942+0000 7efe3be00640 1 -- 172.21.15.17:0/1364884747 wait complete. 2024-09-13T15:54:53.961 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T15:54:54.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.128+0000 7f95ff200640 1 -- 172.21.15.17:0/4238339143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95f8101fa0 msgr2=0x7f95f81023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:54.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.128+0000 7f95ff200640 1 --2- 172.21.15.17:0/4238339143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95f8101fa0 0x7f95f81023a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009ca0 tx=0x7f95e802a8c0 comp rx=0 tx=0).stop 2024-09-13T15:54:54.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.128+0000 7f95ff200640 1 -- 172.21.15.17:0/4238339143 shutdown_connections 2024-09-13T15:54:54.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.128+0000 7f95ff200640 1 --2- 172.21.15.17:0/4238339143 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95f8103b50 0x7f95f810a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:54.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.128+0000 7f95ff200640 1 --2- 172.21.15.17:0/4238339143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95f8103190 0x7f95f8103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:54.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.128+0000 7f95ff200640 1 --2- 172.21.15.17:0/4238339143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95f8101fa0 0x7f95f81023a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:54.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.128+0000 7f95ff200640 1 -- 172.21.15.17:0/4238339143 >> 172.21.15.17:0/4238339143 conn(0x7f95f80fd700 msgr2=0x7f95f80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:54.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.128+0000 7f95ff200640 1 -- 172.21.15.17:0/4238339143 shutdown_connections 2024-09-13T15:54:54.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.128+0000 7f95ff200640 1 -- 172.21.15.17:0/4238339143 wait complete. 2024-09-13T15:54:54.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.129+0000 7f95ff200640 1 Processor -- start 2024-09-13T15:54:54.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.129+0000 7f95ff200640 1 -- start start 2024-09-13T15:54:54.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.129+0000 7f95ff200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95f8101fa0 0x7f95f8197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:54.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.129+0000 7f95ff200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95f8103190 0x7f95f81984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:54.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.129+0000 7f95ff200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95f8103b50 0x7f95f819f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:54.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.129+0000 7f95ff200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f819fa90 con 0x7f95f8103190 2024-09-13T15:54:54.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.129+0000 7f95ff200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f819fc00 con 0x7f95f8101fa0 2024-09-13T15:54:54.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.129+0000 7f95ff200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f819fdc0 con 0x7f95f8103b50 2024-09-13T15:54:54.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.130+0000 7f95ef400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95f8103190 0x7f95f81984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:54.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.130+0000 7f95f7e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95f8101fa0 0x7f95f8197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:54.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.130+0000 7f95ef400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95f8103190 0x7f95f81984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41224/0 (socket says 172.21.15.17:41224) 2024-09-13T15:54:54.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.130+0000 7f95ef400640 1 -- 172.21.15.17:0/1350017438 learned_addr learned my addr 172.21.15.17:0/1350017438 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:54.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.130+0000 7f95fd200640 1 --2- 172.21.15.17:0/1350017438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95f8103b50 0x7f95f819f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:54.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.130+0000 7f95ef400640 1 -- 172.21.15.17:0/1350017438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95f8103b50 msgr2=0x7f95f819f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:54.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.130+0000 7f95ef400640 1 --2- 172.21.15.17:0/1350017438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95f8103b50 0x7f95f819f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:54.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.130+0000 7f95ef400640 1 -- 172.21.15.17:0/1350017438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95f8101fa0 msgr2=0x7f95f8197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:54.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.130+0000 7f95ef400640 1 --2- 172.21.15.17:0/1350017438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95f8101fa0 0x7f95f8197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:54.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.130+0000 7f95ef400640 1 -- 172.21.15.17:0/1350017438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e8009900 con 0x7f95f8103190 2024-09-13T15:54:54.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.130+0000 7f95ef400640 1 --2- 172.21.15.17:0/1350017438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95f8103190 0x7f95f81984e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f95e000d950 tx=0x7f95e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:54.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.130+0000 7f95f5600640 1 -- 172.21.15.17:0/1350017438 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0009a30 con 0x7f95f8103190 2024-09-13T15:54:54.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.131+0000 7f95f5600640 1 -- 172.21.15.17:0/1350017438 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f95e0009b90 con 0x7f95f8103190 2024-09-13T15:54:54.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.131+0000 7f95ff200640 1 -- 172.21.15.17:0/1350017438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f81a00a0 con 0x7f95f8103190 2024-09-13T15:54:54.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.131+0000 7f95f5600640 1 -- 172.21.15.17:0/1350017438 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e00047a0 con 0x7f95f8103190 2024-09-13T15:54:54.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.131+0000 7f95ff200640 1 -- 172.21.15.17:0/1350017438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f81a05b0 con 0x7f95f8103190 2024-09-13T15:54:54.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.132+0000 7f95ff200640 1 -- 172.21.15.17:0/1350017438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f8109450 con 0x7f95f8103190 2024-09-13T15:54:54.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.133+0000 7f95f5600640 1 -- 172.21.15.17:0/1350017438 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f95e0009d00 con 0x7f95f8103190 2024-09-13T15:54:54.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.135+0000 7f95f5600640 1 --2- 172.21.15.17:0/1350017438 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f95dc0a1090 0x7f95dc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:54.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.135+0000 7f95f5600640 1 -- 172.21.15.17:0/1350017438 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8205+0+0 (secure 0 0 0) 0x7f95e00cc3e0 con 0x7f95f8103190 2024-09-13T15:54:54.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.135+0000 7f95f7e00640 1 --2- 172.21.15.17:0/1350017438 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f95dc0a1090 0x7f95dc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:54.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.136+0000 7f95f7e00640 1 --2- 172.21.15.17:0/1350017438 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f95dc0a1090 0x7f95dc0a3550 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f95e8000f80 tx=0x7f95e80093a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:54.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.139+0000 7f95f5600640 1 -- 172.21.15.17:0/1350017438 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f95e0095b30 con 0x7f95f8103190 2024-09-13T15:54:54.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:54.320+0000 7f95ff200640 1 -- 172.21.15.17:0/1350017438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f95f810d890 con 0x7f95f8103190 2024-09-13T15:54:55.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:54 smithi193 ceph-mon[35248]: mds.? [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] up:active 2024-09-13T15:54:55.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:54 smithi193 ceph-mon[35248]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T15:54:55.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:54 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1364884747' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-13T15:54:55.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:54 smithi193 ceph-mon[35248]: osdmap e86: 12 total, 12 up, 12 in 2024-09-13T15:54:55.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:54 smithi193 ceph-mon[35248]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T15:54:55.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:54 smithi193 ceph-mon[35248]: pgmap v292: 97 pgs: 7 creating+peering, 61 unknown, 29 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 1 op/s 2024-09-13T15:54:55.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:54 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1350017438' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-13T15:54:55.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:54 smithi017 ceph-mon[30494]: mds.? [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] up:active 2024-09-13T15:54:55.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:54 smithi017 ceph-mon[30494]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T15:54:55.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:54 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1364884747' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-13T15:54:55.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:54 smithi017 ceph-mon[30494]: osdmap e86: 12 total, 12 up, 12 in 2024-09-13T15:54:55.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:54 smithi017 ceph-mon[30494]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T15:54:55.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:54 smithi017 ceph-mon[30494]: pgmap v292: 97 pgs: 7 creating+peering, 61 unknown, 29 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 1 op/s 2024-09-13T15:54:55.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:54 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1350017438' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-13T15:54:55.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:54 smithi189 ceph-mon[34790]: mds.? [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] up:active 2024-09-13T15:54:55.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:54 smithi189 ceph-mon[34790]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T15:54:55.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:54 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1364884747' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-13T15:54:55.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:54 smithi189 ceph-mon[34790]: osdmap e86: 12 total, 12 up, 12 in 2024-09-13T15:54:55.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:54 smithi189 ceph-mon[34790]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T15:54:55.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:54 smithi189 ceph-mon[34790]: pgmap v292: 97 pgs: 7 creating+peering, 61 unknown, 29 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 1 op/s 2024-09-13T15:54:55.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:54 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1350017438' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-13T15:54:55.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:55.947+0000 7f95f5600640 1 -- 172.21.15.17:0/1350017438 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v88) v1 ==== 228+0+0 (secure 0 0 0) 0x7f95e0099150 con 0x7f95f8103190 2024-09-13T15:54:55.949 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data_ec' created 2024-09-13T15:54:55.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:55.952+0000 7f95ff200640 1 -- 172.21.15.17:0/1350017438 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f95dc0a1090 msgr2=0x7f95dc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:55.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:55.952+0000 7f95ff200640 1 --2- 172.21.15.17:0/1350017438 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f95dc0a1090 0x7f95dc0a3550 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f95e8000f80 tx=0x7f95e80093a0 comp rx=0 tx=0).stop 2024-09-13T15:54:55.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:55.952+0000 7f95ff200640 1 -- 172.21.15.17:0/1350017438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95f8103190 msgr2=0x7f95f81984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:55.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:55.952+0000 7f95ff200640 1 --2- 172.21.15.17:0/1350017438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95f8103190 0x7f95f81984e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f95e000d950 tx=0x7f95e000de10 comp rx=0 tx=0).stop 2024-09-13T15:54:55.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:55.952+0000 7f95ff200640 1 -- 172.21.15.17:0/1350017438 shutdown_connections 2024-09-13T15:54:55.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:55.952+0000 7f95ff200640 1 --2- 172.21.15.17:0/1350017438 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f95dc0a1090 0x7f95dc0a3550 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:55.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:55.952+0000 7f95ff200640 1 --2- 172.21.15.17:0/1350017438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95f8103b50 0x7f95f819f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:55.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:55.952+0000 7f95ff200640 1 --2- 172.21.15.17:0/1350017438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95f8103190 0x7f95f81984e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:55.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:55.952+0000 7f95ff200640 1 --2- 172.21.15.17:0/1350017438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95f8101fa0 0x7f95f8197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:55.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:55.952+0000 7f95ff200640 1 -- 172.21.15.17:0/1350017438 >> 172.21.15.17:0/1350017438 conn(0x7f95f80fd700 msgr2=0x7f95f8106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:55.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:55.953+0000 7f95ff200640 1 -- 172.21.15.17:0/1350017438 shutdown_connections 2024-09-13T15:54:55.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:55.953+0000 7f95ff200640 1 -- 172.21.15.17:0/1350017438 wait complete. 2024-09-13T15:54:55.975 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-13T15:54:56.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.135+0000 7f78faa00640 1 -- 172.21.15.17:0/656828633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78f4101fa0 msgr2=0x7f78f41023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:56.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.135+0000 7f78faa00640 1 --2- 172.21.15.17:0/656828633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78f4101fa0 0x7f78f41023a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f78e4009900 tx=0x7f78e402a410 comp rx=0 tx=0).stop 2024-09-13T15:54:56.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.135+0000 7f78faa00640 1 -- 172.21.15.17:0/656828633 shutdown_connections 2024-09-13T15:54:56.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.135+0000 7f78faa00640 1 --2- 172.21.15.17:0/656828633 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78f4103b50 0x7f78f410a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:56.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.135+0000 7f78faa00640 1 --2- 172.21.15.17:0/656828633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78f4103190 0x7f78f4103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:56.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.135+0000 7f78faa00640 1 --2- 172.21.15.17:0/656828633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78f4101fa0 0x7f78f41023a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:56.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.135+0000 7f78faa00640 1 -- 172.21.15.17:0/656828633 >> 172.21.15.17:0/656828633 conn(0x7f78f40fd700 msgr2=0x7f78f40ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:56.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.136+0000 7f78faa00640 1 -- 172.21.15.17:0/656828633 shutdown_connections 2024-09-13T15:54:56.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.136+0000 7f78faa00640 1 -- 172.21.15.17:0/656828633 wait complete. 2024-09-13T15:54:56.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.136+0000 7f78faa00640 1 Processor -- start 2024-09-13T15:54:56.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.137+0000 7f78faa00640 1 -- start start 2024-09-13T15:54:56.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.137+0000 7f78faa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78f4101fa0 0x7f78f4197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:56.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.137+0000 7f78faa00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78f4103190 0x7f78f4198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:56.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.137+0000 7f78faa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78f4103b50 0x7f78f419f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:56.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.137+0000 7f78faa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f419fab0 con 0x7f78f4101fa0 2024-09-13T15:54:56.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.137+0000 7f78faa00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f419fc20 con 0x7f78f4103b50 2024-09-13T15:54:56.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.137+0000 7f78faa00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f419fde0 con 0x7f78f4103190 2024-09-13T15:54:56.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.137+0000 7f78f8a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78f4103b50 0x7f78f419f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:56.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.137+0000 7f78f3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78f4101fa0 0x7f78f4197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:56.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.137+0000 7f78eb400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78f4103190 0x7f78f4198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:56.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.137+0000 7f78f8a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78f4103b50 0x7f78f419f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:45150/0 (socket says 172.21.15.17:45150) 2024-09-13T15:54:56.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.137+0000 7f78f3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78f4101fa0 0x7f78f4197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41256/0 (socket says 172.21.15.17:41256) 2024-09-13T15:54:56.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.137+0000 7f78f8a00640 1 -- 172.21.15.17:0/2762552448 learned_addr learned my addr 172.21.15.17:0/2762552448 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:56.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.137+0000 7f78f8a00640 1 -- 172.21.15.17:0/2762552448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78f4103190 msgr2=0x7f78f4198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:56.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.137+0000 7f78f8a00640 1 --2- 172.21.15.17:0/2762552448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78f4103190 0x7f78f4198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:56.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.138+0000 7f78f8a00640 1 -- 172.21.15.17:0/2762552448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78f4101fa0 msgr2=0x7f78f4197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:56.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.138+0000 7f78f8a00640 1 --2- 172.21.15.17:0/2762552448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78f4101fa0 0x7f78f4197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:56.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.138+0000 7f78f8a00640 1 -- 172.21.15.17:0/2762552448 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78dc009490 con 0x7f78f4103b50 2024-09-13T15:54:56.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.138+0000 7f78f8a00640 1 --2- 172.21.15.17:0/2762552448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78f4103b50 0x7f78f419f570 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00eb10 tx=0x7f78ec00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:56.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.138+0000 7f78f1600640 1 -- 172.21.15.17:0/2762552448 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec004b20 con 0x7f78f4103b50 2024-09-13T15:54:56.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.138+0000 7f78faa00640 1 -- 172.21.15.17:0/2762552448 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e4009560 con 0x7f78f4103b50 2024-09-13T15:54:56.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.138+0000 7f78f1600640 1 -- 172.21.15.17:0/2762552448 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78ec004c80 con 0x7f78f4103b50 2024-09-13T15:54:56.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.138+0000 7f78f1600640 1 -- 172.21.15.17:0/2762552448 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec010690 con 0x7f78f4103b50 2024-09-13T15:54:56.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.138+0000 7f78faa00640 1 -- 172.21.15.17:0/2762552448 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f41a0490 con 0x7f78f4103b50 2024-09-13T15:54:56.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.139+0000 7f78faa00640 1 -- 172.21.15.17:0/2762552448 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f4109450 con 0x7f78f4103b50 2024-09-13T15:54:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.141+0000 7f78f1600640 1 -- 172.21.15.17:0/2762552448 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f78ec005020 con 0x7f78f4103b50 2024-09-13T15:54:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.142+0000 7f78f1600640 1 --2- 172.21.15.17:0/2762552448 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f78d80a1090 0x7f78d80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.142+0000 7f78f1600640 1 -- 172.21.15.17:0/2762552448 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8698+0+0 (secure 0 0 0) 0x7f78ec014070 con 0x7f78f4103b50 2024-09-13T15:54:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.143+0000 7f78f3e00640 1 --2- 172.21.15.17:0/2762552448 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f78d80a1090 0x7f78d80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:56.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.143+0000 7f78f3e00640 1 --2- 172.21.15.17:0/2762552448 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f78d80a1090 0x7f78d80a3550 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f78e4031500 tx=0x7f78e4005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:56.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.144+0000 7f78f1600640 1 -- 172.21.15.17:0/2762552448 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f78ec096d70 con 0x7f78f4103b50 2024-09-13T15:54:56.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:55 smithi193 ceph-mon[35248]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T15:54:56.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:55 smithi193 ceph-mon[35248]: Cluster is now healthy 2024-09-13T15:54:56.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:55 smithi193 ceph-mon[35248]: osdmap e87: 12 total, 12 up, 12 in 2024-09-13T15:54:56.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:55 smithi017 ceph-mon[30494]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T15:54:56.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:55 smithi017 ceph-mon[30494]: Cluster is now healthy 2024-09-13T15:54:56.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:55 smithi017 ceph-mon[30494]: osdmap e87: 12 total, 12 up, 12 in 2024-09-13T15:54:56.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.325+0000 7f78faa00640 1 -- 172.21.15.17:0/2762552448 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f78f410d8b0 con 0x7f78f4103b50 2024-09-13T15:54:56.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:55 smithi189 ceph-mon[34790]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T15:54:56.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:55 smithi189 ceph-mon[34790]: Cluster is now healthy 2024-09-13T15:54:56.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:55 smithi189 ceph-mon[34790]: osdmap e87: 12 total, 12 up, 12 in 2024-09-13T15:54:56.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.954+0000 7f78f1600640 1 -- 172.21.15.17:0/2762552448 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v89) v1 ==== 169+0+0 (secure 0 0 0) 0x7f78ec09a390 con 0x7f78f4103b50 2024-09-13T15:54:56.957 INFO:teuthology.orchestra.run.smithi017.stderr:set pool 4 allow_ec_overwrites to true 2024-09-13T15:54:56.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.959+0000 7f78faa00640 1 -- 172.21.15.17:0/2762552448 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f78d80a1090 msgr2=0x7f78d80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:56.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.959+0000 7f78faa00640 1 --2- 172.21.15.17:0/2762552448 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f78d80a1090 0x7f78d80a3550 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f78e4031500 tx=0x7f78e4005780 comp rx=0 tx=0).stop 2024-09-13T15:54:56.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.959+0000 7f78faa00640 1 -- 172.21.15.17:0/2762552448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78f4103b50 msgr2=0x7f78f419f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:56.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.959+0000 7f78faa00640 1 --2- 172.21.15.17:0/2762552448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78f4103b50 0x7f78f419f570 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00eb10 tx=0x7f78ec00c2d0 comp rx=0 tx=0).stop 2024-09-13T15:54:56.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.959+0000 7f78faa00640 1 -- 172.21.15.17:0/2762552448 shutdown_connections 2024-09-13T15:54:56.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.959+0000 7f78faa00640 1 --2- 172.21.15.17:0/2762552448 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f78d80a1090 0x7f78d80a3550 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:56.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.959+0000 7f78faa00640 1 --2- 172.21.15.17:0/2762552448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78f4103b50 0x7f78f419f570 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:56.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.959+0000 7f78faa00640 1 --2- 172.21.15.17:0/2762552448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78f4103190 0x7f78f4198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:56.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.959+0000 7f78faa00640 1 --2- 172.21.15.17:0/2762552448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78f4101fa0 0x7f78f4197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:56.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.959+0000 7f78faa00640 1 -- 172.21.15.17:0/2762552448 >> 172.21.15.17:0/2762552448 conn(0x7f78f40fd700 msgr2=0x7f78f4106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:56.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.960+0000 7f78faa00640 1 -- 172.21.15.17:0/2762552448 shutdown_connections 2024-09-13T15:54:56.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:56.960+0000 7f78faa00640 1 -- 172.21.15.17:0/2762552448 wait complete. 2024-09-13T15:54:56.990 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-13T15:54:57.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.151+0000 7fb898800640 1 -- 172.21.15.17:0/1979022315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb890101f80 msgr2=0x7fb890102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:57.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.151+0000 7fb898800640 1 --2- 172.21.15.17:0/1979022315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb890101f80 0x7fb890102380 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb884009900 tx=0x7fb88402a3f0 comp rx=0 tx=0).stop 2024-09-13T15:54:57.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.151+0000 7fb898800640 1 -- 172.21.15.17:0/1979022315 shutdown_connections 2024-09-13T15:54:57.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.151+0000 7fb898800640 1 --2- 172.21.15.17:0/1979022315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb890103b30 0x7fb89010a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:57.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.151+0000 7fb898800640 1 --2- 172.21.15.17:0/1979022315 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb890103170 0x7fb8901035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:57.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.151+0000 7fb898800640 1 --2- 172.21.15.17:0/1979022315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb890101f80 0x7fb890102380 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:57.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.151+0000 7fb898800640 1 -- 172.21.15.17:0/1979022315 >> 172.21.15.17:0/1979022315 conn(0x7fb8900fd700 msgr2=0x7fb8900ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:57.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.151+0000 7fb898800640 1 -- 172.21.15.17:0/1979022315 shutdown_connections 2024-09-13T15:54:57.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.151+0000 7fb898800640 1 -- 172.21.15.17:0/1979022315 wait complete. 2024-09-13T15:54:57.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.152+0000 7fb898800640 1 Processor -- start 2024-09-13T15:54:57.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.152+0000 7fb898800640 1 -- start start 2024-09-13T15:54:57.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.152+0000 7fb898800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb890101f80 0x7fb890197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:57.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.152+0000 7fb898800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb890103170 0x7fb8901984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:57.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.152+0000 7fb898800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb890103b30 0x7fb89019f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:57.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.152+0000 7fb898800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89019fa60 con 0x7fb890103170 2024-09-13T15:54:57.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.152+0000 7fb898800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89019fbd0 con 0x7fb890103b30 2024-09-13T15:54:57.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.152+0000 7fb898800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89019fd90 con 0x7fb890101f80 2024-09-13T15:54:57.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.152+0000 7fb895e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb890101f80 0x7fb890197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:57.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.152+0000 7fb895400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb890103170 0x7fb8901984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:57.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.152+0000 7fb895e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb890101f80 0x7fb890197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:37170/0 (socket says 172.21.15.17:37170) 2024-09-13T15:54:57.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.152+0000 7fb895e00640 1 -- 172.21.15.17:0/1739923642 learned_addr learned my addr 172.21.15.17:0/1739923642 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:57.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.153+0000 7fb896800640 1 --2- 172.21.15.17:0/1739923642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb890103b30 0x7fb89019f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:57.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.153+0000 7fb895e00640 1 -- 172.21.15.17:0/1739923642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb890103b30 msgr2=0x7fb89019f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:57.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.153+0000 7fb895e00640 1 --2- 172.21.15.17:0/1739923642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb890103b30 0x7fb89019f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:57.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.153+0000 7fb895e00640 1 -- 172.21.15.17:0/1739923642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb890103170 msgr2=0x7fb8901984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:57.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.153+0000 7fb895e00640 1 --2- 172.21.15.17:0/1739923642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb890103170 0x7fb8901984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:57.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.153+0000 7fb895e00640 1 -- 172.21.15.17:0/1739923642 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb884009560 con 0x7fb890101f80 2024-09-13T15:54:57.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.153+0000 7fb895400640 1 --2- 172.21.15.17:0/1739923642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb890103170 0x7fb8901984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:54:57.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.153+0000 7fb895e00640 1 --2- 172.21.15.17:0/1739923642 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb890101f80 0x7fb890197f70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb8840057c0 tx=0x7fb8840055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:57.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.153+0000 7fb88aa00640 1 -- 172.21.15.17:0/1739923642 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb884004bd0 con 0x7fb890101f80 2024-09-13T15:54:57.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.153+0000 7fb88aa00640 1 -- 172.21.15.17:0/1739923642 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb884004d30 con 0x7fb890101f80 2024-09-13T15:54:57.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.153+0000 7fb88aa00640 1 -- 172.21.15.17:0/1739923642 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb884031b60 con 0x7fb890101f80 2024-09-13T15:54:57.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.153+0000 7fb898800640 1 -- 172.21.15.17:0/1739923642 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8901a0010 con 0x7fb890101f80 2024-09-13T15:54:57.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.154+0000 7fb898800640 1 -- 172.21.15.17:0/1739923642 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8901a0470 con 0x7fb890101f80 2024-09-13T15:54:57.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.154+0000 7fb898800640 1 -- 172.21.15.17:0/1739923642 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8901093b0 con 0x7fb890101f80 2024-09-13T15:54:57.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.156+0000 7fb88aa00640 1 -- 172.21.15.17:0/1739923642 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb884003cb0 con 0x7fb890101f80 2024-09-13T15:54:57.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.157+0000 7fb88aa00640 1 --2- 172.21.15.17:0/1739923642 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb8780a1110 0x7fb8780a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:57.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.158+0000 7fb88aa00640 1 -- 172.21.15.17:0/1739923642 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8698+0+0 (secure 0 0 0) 0x7fb8840edc80 con 0x7fb890101f80 2024-09-13T15:54:57.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.158+0000 7fb895400640 1 --2- 172.21.15.17:0/1739923642 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb8780a1110 0x7fb8780a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:57.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.158+0000 7fb895400640 1 --2- 172.21.15.17:0/1739923642 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb8780a1110 0x7fb8780a35d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb890199480 tx=0x7fb880005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:57.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.160+0000 7fb88aa00640 1 -- 172.21.15.17:0/1739923642 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb8840b71e0 con 0x7fb890101f80 2024-09-13T15:54:57.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:56 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1350017438' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-13T15:54:57.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:56 smithi193 ceph-mon[35248]: osdmap e88: 12 total, 12 up, 12 in 2024-09-13T15:54:57.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:56 smithi193 ceph-mon[35248]: pgmap v295: 129 pgs: 7 creating+peering, 69 unknown, 53 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s wr, 5 op/s 2024-09-13T15:54:57.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:56 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/2762552448' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-13T15:54:57.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:56 smithi193 ceph-mon[35248]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-13T15:54:57.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:56 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1350017438' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-13T15:54:57.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:56 smithi017 ceph-mon[30494]: osdmap e88: 12 total, 12 up, 12 in 2024-09-13T15:54:57.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:56 smithi017 ceph-mon[30494]: pgmap v295: 129 pgs: 7 creating+peering, 69 unknown, 53 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s wr, 5 op/s 2024-09-13T15:54:57.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:56 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/2762552448' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-13T15:54:57.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:56 smithi017 ceph-mon[30494]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-13T15:54:57.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:56 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1350017438' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-13T15:54:57.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:56 smithi189 ceph-mon[34790]: osdmap e88: 12 total, 12 up, 12 in 2024-09-13T15:54:57.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:56 smithi189 ceph-mon[34790]: pgmap v295: 129 pgs: 7 creating+peering, 69 unknown, 53 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s wr, 5 op/s 2024-09-13T15:54:57.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:56 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/2762552448' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-13T15:54:57.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:56 smithi189 ceph-mon[34790]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-13T15:54:57.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.381+0000 7fb898800640 1 -- 172.21.15.17:0/1739923642 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fb89010d840 con 0x7fb890101f80 2024-09-13T15:54:57.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.387+0000 7fb88aa00640 1 -- 172.21.15.17:0/1739923642 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) v1 ==== 137+0+0 (secure 0 0 0) 0x7fb8840400b0 con 0x7fb890101f80 2024-09-13T15:54:57.390 INFO:teuthology.orchestra.run.smithi017.stderr:added data pool 4 to fsmap 2024-09-13T15:54:57.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.390+0000 7fb898800640 1 -- 172.21.15.17:0/1739923642 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb8780a1110 msgr2=0x7fb8780a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:57.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.390+0000 7fb898800640 1 --2- 172.21.15.17:0/1739923642 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb8780a1110 0x7fb8780a35d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb890199480 tx=0x7fb880005f90 comp rx=0 tx=0).stop 2024-09-13T15:54:57.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.390+0000 7fb898800640 1 -- 172.21.15.17:0/1739923642 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb890101f80 msgr2=0x7fb890197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:57.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.390+0000 7fb898800640 1 --2- 172.21.15.17:0/1739923642 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb890101f80 0x7fb890197f70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb8840057c0 tx=0x7fb8840055a0 comp rx=0 tx=0).stop 2024-09-13T15:54:57.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.390+0000 7fb898800640 1 -- 172.21.15.17:0/1739923642 shutdown_connections 2024-09-13T15:54:57.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.390+0000 7fb898800640 1 --2- 172.21.15.17:0/1739923642 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb8780a1110 0x7fb8780a35d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:57.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.390+0000 7fb898800640 1 --2- 172.21.15.17:0/1739923642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb890103b30 0x7fb89019f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:57.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.390+0000 7fb898800640 1 --2- 172.21.15.17:0/1739923642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb890103170 0x7fb8901984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:57.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.390+0000 7fb898800640 1 --2- 172.21.15.17:0/1739923642 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb890101f80 0x7fb890197f70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:57.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.390+0000 7fb898800640 1 -- 172.21.15.17:0/1739923642 >> 172.21.15.17:0/1739923642 conn(0x7fb8900fd700 msgr2=0x7fb890106580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:57.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.390+0000 7fb898800640 1 -- 172.21.15.17:0/1739923642 shutdown_connections 2024-09-13T15:54:57.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.390+0000 7fb898800640 1 -- 172.21.15.17:0/1739923642 wait complete. 2024-09-13T15:54:57.407 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:54:57.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.611+0000 7f5c6f000640 1 -- 172.21.15.17:0/3168470657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c68102f40 msgr2=0x7f5c68105330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:57.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.611+0000 7f5c6f000640 1 --2- 172.21.15.17:0/3168470657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c68102f40 0x7f5c68105330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5c54009900 tx=0x7f5c5402a3f0 comp rx=0 tx=0).stop 2024-09-13T15:54:57.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.611+0000 7f5c6f000640 1 -- 172.21.15.17:0/3168470657 shutdown_connections 2024-09-13T15:54:57.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.611+0000 7f5c6f000640 1 --2- 172.21.15.17:0/3168470657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c68105870 0x7f5c68107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:57.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.611+0000 7f5c6f000640 1 --2- 172.21.15.17:0/3168470657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c68102f40 0x7f5c68105330 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:57.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.611+0000 7f5c6f000640 1 --2- 172.21.15.17:0/3168470657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c68100610 0x7f5c68102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:57.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.611+0000 7f5c6f000640 1 -- 172.21.15.17:0/3168470657 >> 172.21.15.17:0/3168470657 conn(0x7f5c680fa1f0 msgr2=0x7f5c680fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:57.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.612+0000 7f5c6f000640 1 -- 172.21.15.17:0/3168470657 shutdown_connections 2024-09-13T15:54:57.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.612+0000 7f5c6f000640 1 -- 172.21.15.17:0/3168470657 wait complete. 2024-09-13T15:54:57.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.612+0000 7f5c6f000640 1 Processor -- start 2024-09-13T15:54:57.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.613+0000 7f5c6f000640 1 -- start start 2024-09-13T15:54:57.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.613+0000 7f5c6f000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c68100610 0x7f5c68195c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:57.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.613+0000 7f5c6f000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c68102f40 0x7f5c681961c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.613+0000 7f5c6f000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c68105870 0x7f5c6819d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.613+0000 7f5c6f000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6819d760 con 0x7f5c68102f40 2024-09-13T15:54:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.613+0000 7f5c6f000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6819d8d0 con 0x7f5c68100610 2024-09-13T15:54:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.613+0000 7f5c6f000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6819da90 con 0x7f5c68105870 2024-09-13T15:54:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.613+0000 7f5c6dc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c68100610 0x7f5c68195c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.613+0000 7f5c6e600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c68105870 0x7f5c6819d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.613+0000 7f5c6dc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c68100610 0x7f5c68195c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:45182/0 (socket says 172.21.15.17:45182) 2024-09-13T15:54:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.613+0000 7f5c6dc00640 1 -- 172.21.15.17:0/197440493 learned_addr learned my addr 172.21.15.17:0/197440493 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.613+0000 7f5c6d200640 1 --2- 172.21.15.17:0/197440493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c68102f40 0x7f5c681961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:57.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.614+0000 7f5c6e600640 1 -- 172.21.15.17:0/197440493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c68100610 msgr2=0x7f5c68195c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:57.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.614+0000 7f5c6e600640 1 --2- 172.21.15.17:0/197440493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c68100610 0x7f5c68195c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:57.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.614+0000 7f5c6e600640 1 -- 172.21.15.17:0/197440493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c68102f40 msgr2=0x7f5c681961c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:57.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.614+0000 7f5c6e600640 1 --2- 172.21.15.17:0/197440493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c68102f40 0x7f5c681961c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:57.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.614+0000 7f5c6e600640 1 -- 172.21.15.17:0/197440493 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5c009490 con 0x7f5c68105870 2024-09-13T15:54:57.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.614+0000 7f5c6e600640 1 --2- 172.21.15.17:0/197440493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c68105870 0x7f5c6819d1f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5c60005fd0 tx=0x7f5c6000dea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:57.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.614+0000 7f5c66000640 1 -- 172.21.15.17:0/197440493 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6000bd40 con 0x7f5c68105870 2024-09-13T15:54:57.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.614+0000 7f5c66000640 1 -- 172.21.15.17:0/197440493 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c60003e30 con 0x7f5c68105870 2024-09-13T15:54:57.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.614+0000 7f5c6f000640 1 -- 172.21.15.17:0/197440493 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c54009560 con 0x7f5c68105870 2024-09-13T15:54:57.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.614+0000 7f5c66000640 1 -- 172.21.15.17:0/197440493 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c600106c0 con 0x7f5c68105870 2024-09-13T15:54:57.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.614+0000 7f5c6f000640 1 -- 172.21.15.17:0/197440493 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c6819e0f0 con 0x7f5c68105870 2024-09-13T15:54:57.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.615+0000 7f5c6f000640 1 -- 172.21.15.17:0/197440493 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c680fbce0 con 0x7f5c68105870 2024-09-13T15:54:57.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.617+0000 7f5c66000640 1 -- 172.21.15.17:0/197440493 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5c600041a0 con 0x7f5c68105870 2024-09-13T15:54:57.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.618+0000 7f5c66000640 1 --2- 172.21.15.17:0/197440493 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5c500a1110 0x7f5c500a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:57.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.619+0000 7f5c66000640 1 -- 172.21.15.17:0/197440493 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f5c600cced0 con 0x7f5c68105870 2024-09-13T15:54:57.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.619+0000 7f5c6dc00640 1 --2- 172.21.15.17:0/197440493 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5c500a1110 0x7f5c500a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:57.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.619+0000 7f5c6dc00640 1 --2- 172.21.15.17:0/197440493 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5c500a1110 0x7f5c500a35d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5c68197150 tx=0x7f5c5c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:57.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.622+0000 7f5c66000640 1 -- 172.21.15.17:0/197440493 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5c60096380 con 0x7f5c68105870 2024-09-13T15:54:57.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.840+0000 7f5c6f000640 1 -- 172.21.15.17:0/197440493 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c6810b460 con 0x7f5c68105870 2024-09-13T15:54:57.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.842+0000 7f5c66000640 1 -- 172.21.15.17:0/197440493 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+10819 (secure 0 0 0) 0x7f5c600982b0 con 0x7f5c68105870 2024-09-13T15:54:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:57.843 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1730156534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1730156534},{"type":"v1","addr":"172.21.15.17:6837","nonce":1730156534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/1295854211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1295854211},{"type":"v1","addr":"172.21.15.17:6841","nonce":1295854211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2888593680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2888593680},{"type":"v1","addr":"172.21.15.17:6835","nonce":2888593680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4135454212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4135454212},{"type":"v1","addr":"172.21.15.189:6835","nonce":4135454212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24520,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/4049465204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":4049465204},{"type":"v1","addr":"172.21.15.193:6835","nonce":4049465204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24524,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/2079181485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2079181485},{"type":"v1","addr":"172.21.15.189:6837","nonce":2079181485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/792056943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":792056943},{"type":"v1","addr":"172.21.15.193:6837","nonce":792056943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24553,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6839/3012199875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":3012199875},{"type":"v1","addr":"172.21.15.193:6839","nonce":3012199875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3750040765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3750040765},{"type":"v1","addr":"172.21.15.17:6839","nonce":3750040765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:54:52.929867+0000","modified":"2024-09-13T15:54:57.383895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24578},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6839/2624723395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2624723395},{"type":"v1","addr":"172.21.15.189:6839","nonce":2624723395}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T15:54:57.844 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2024-09-13T15:54:57.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.844+0000 7f5c6f000640 1 -- 172.21.15.17:0/197440493 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5c500a1110 msgr2=0x7f5c500a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:57.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.844+0000 7f5c6f000640 1 --2- 172.21.15.17:0/197440493 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5c500a1110 0x7f5c500a35d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5c68197150 tx=0x7f5c5c005f90 comp rx=0 tx=0).stop 2024-09-13T15:54:57.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.844+0000 7f5c6f000640 1 -- 172.21.15.17:0/197440493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c68105870 msgr2=0x7f5c6819d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:57.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.844+0000 7f5c6f000640 1 --2- 172.21.15.17:0/197440493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c68105870 0x7f5c6819d1f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5c60005fd0 tx=0x7f5c6000dea0 comp rx=0 tx=0).stop 2024-09-13T15:54:57.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.844+0000 7f5c6f000640 1 -- 172.21.15.17:0/197440493 shutdown_connections 2024-09-13T15:54:57.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.844+0000 7f5c6f000640 1 --2- 172.21.15.17:0/197440493 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5c500a1110 0x7f5c500a35d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:57.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.844+0000 7f5c6f000640 1 --2- 172.21.15.17:0/197440493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c68105870 0x7f5c6819d1f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:57.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.844+0000 7f5c6f000640 1 --2- 172.21.15.17:0/197440493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c68102f40 0x7f5c681961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:57.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.844+0000 7f5c6f000640 1 --2- 172.21.15.17:0/197440493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c68100610 0x7f5c68195c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:57.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.844+0000 7f5c6f000640 1 -- 172.21.15.17:0/197440493 >> 172.21.15.17:0/197440493 conn(0x7f5c680fa1f0 msgr2=0x7f5c68101150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:57.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.844+0000 7f5c6f000640 1 -- 172.21.15.17:0/197440493 shutdown_connections 2024-09-13T15:54:57.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:57.844+0000 7f5c6f000640 1 -- 172.21.15.17:0/197440493 wait complete. 2024-09-13T15:54:57.866 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:54:58.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.022+0000 7f8162c00640 1 -- 172.21.15.17:0/1954717676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f815c101fa0 msgr2=0x7f815c1023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:58.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.022+0000 7f8162c00640 1 --2- 172.21.15.17:0/1954717676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f815c101fa0 0x7f815c1023a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f814c009900 tx=0x7f814c02a410 comp rx=0 tx=0).stop 2024-09-13T15:54:58.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.022+0000 7f8162c00640 1 -- 172.21.15.17:0/1954717676 shutdown_connections 2024-09-13T15:54:58.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.022+0000 7f8162c00640 1 --2- 172.21.15.17:0/1954717676 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f815c103b50 0x7f815c10a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.022+0000 7f8162c00640 1 --2- 172.21.15.17:0/1954717676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f815c103190 0x7f815c103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.022+0000 7f8162c00640 1 --2- 172.21.15.17:0/1954717676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f815c101fa0 0x7f815c1023a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.022+0000 7f8162c00640 1 -- 172.21.15.17:0/1954717676 >> 172.21.15.17:0/1954717676 conn(0x7f815c0fd700 msgr2=0x7f815c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:58.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.022+0000 7f8162c00640 1 -- 172.21.15.17:0/1954717676 shutdown_connections 2024-09-13T15:54:58.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.022+0000 7f8162c00640 1 -- 172.21.15.17:0/1954717676 wait complete. 2024-09-13T15:54:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.023+0000 7f8162c00640 1 Processor -- start 2024-09-13T15:54:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.023+0000 7f8162c00640 1 -- start start 2024-09-13T15:54:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.024+0000 7f8162c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f815c101fa0 0x7f815c197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.024+0000 7f8162c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f815c103190 0x7f815c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.024+0000 7f8162c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f815c103b50 0x7f815c19f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.024+0000 7f8162c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c19faa0 con 0x7f815c103b50 2024-09-13T15:54:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.024+0000 7f8162c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c19fc10 con 0x7f815c101fa0 2024-09-13T15:54:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.024+0000 7f8162c00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c19fdd0 con 0x7f815c103190 2024-09-13T15:54:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.024+0000 7f815be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f815c101fa0 0x7f815c197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.024+0000 7f8160c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f815c103b50 0x7f815c19f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.024+0000 7f815be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f815c101fa0 0x7f815c197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:45208/0 (socket says 172.21.15.17:45208) 2024-09-13T15:54:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.024+0000 7f815be00640 1 -- 172.21.15.17:0/1709036333 learned_addr learned my addr 172.21.15.17:0/1709036333 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.024+0000 7f8153400640 1 --2- 172.21.15.17:0/1709036333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f815c103190 0x7f815c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.024+0000 7f8160c00640 1 -- 172.21.15.17:0/1709036333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f815c103190 msgr2=0x7f815c1984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.024+0000 7f8160c00640 1 --2- 172.21.15.17:0/1709036333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f815c103190 0x7f815c1984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.024+0000 7f8160c00640 1 -- 172.21.15.17:0/1709036333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f815c101fa0 msgr2=0x7f815c197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.024+0000 7f8160c00640 1 --2- 172.21.15.17:0/1709036333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f815c101fa0 0x7f815c197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.024+0000 7f8160c00640 1 -- 172.21.15.17:0/1709036333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c009560 con 0x7f815c103b50 2024-09-13T15:54:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.024+0000 7f815be00640 1 --2- 172.21.15.17:0/1709036333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f815c101fa0 0x7f815c197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:54:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.025+0000 7f8160c00640 1 --2- 172.21.15.17:0/1709036333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f815c103b50 0x7f815c19f560 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8154009fd0 tx=0x7f815400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.025+0000 7f8159600640 1 -- 172.21.15.17:0/1709036333 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815400ce20 con 0x7f815c103b50 2024-09-13T15:54:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.025+0000 7f8159600640 1 -- 172.21.15.17:0/1709036333 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8154005020 con 0x7f815c103b50 2024-09-13T15:54:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.025+0000 7f8159600640 1 -- 172.21.15.17:0/1709036333 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8154010670 con 0x7f815c103b50 2024-09-13T15:54:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.025+0000 7f8162c00640 1 -- 172.21.15.17:0/1709036333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f815c1a00b0 con 0x7f815c103b50 2024-09-13T15:54:58.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.025+0000 7f8162c00640 1 -- 172.21.15.17:0/1709036333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f815c1a0570 con 0x7f815c103b50 2024-09-13T15:54:58.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.026+0000 7f8162c00640 1 -- 172.21.15.17:0/1709036333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f815c109430 con 0x7f815c103b50 2024-09-13T15:54:58.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.028+0000 7f8159600640 1 -- 172.21.15.17:0/1709036333 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8154005450 con 0x7f815c103b50 2024-09-13T15:54:58.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.029+0000 7f8159600640 1 --2- 172.21.15.17:0/1709036333 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f81400a1110 0x7f81400a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:58.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.030+0000 7f8159600640 1 -- 172.21.15.17:0/1709036333 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8154014070 con 0x7f815c103b50 2024-09-13T15:54:58.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.030+0000 7f815be00640 1 --2- 172.21.15.17:0/1709036333 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f81400a1110 0x7f81400a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:58.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.031+0000 7f815be00640 1 --2- 172.21.15.17:0/1709036333 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f81400a1110 0x7f81400a35d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f814c000c00 tx=0x7f814c005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:58.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.032+0000 7f8159600640 1 -- 172.21.15.17:0/1709036333 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f81540965f0 con 0x7f815c103b50 2024-09-13T15:54:58.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.212+0000 7f8162c00640 1 -- 172.21.15.17:0/1709036333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f815c02c480 con 0x7f815c103b50 2024-09-13T15:54:58.214 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:57 smithi189 ceph-mon[34790]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T15:54:58.214 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:57 smithi189 ceph-mon[34790]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-13T15:54:58.214 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:57 smithi189 ceph-mon[34790]: osdmap e89: 12 total, 12 up, 12 in 2024-09-13T15:54:58.214 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:57 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1739923642' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-13T15:54:58.214 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:57 smithi189 ceph-mon[34790]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-13T15:54:58.214 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:57 smithi189 ceph-mon[34790]: osdmap e90: 12 total, 12 up, 12 in 2024-09-13T15:54:58.214 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:57 smithi189 ceph-mon[34790]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-13T15:54:58.214 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:57 smithi189 ceph-mon[34790]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T15:54:58.214 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:57 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/197440493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:58.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.213+0000 7f8159600640 1 -- 172.21.15.17:0/1709036333 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23935 (secure 0 0 0) 0x7f8154099c10 con 0x7f815c103b50 2024-09-13T15:54:58.215 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:58.216 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":90,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","created":"2024-09-13T15:46:50.475750+0000","modified":"2024-09-13T15:54:57.383548+0000","last_up_change":"2024-09-13T15:53:59.138985+0000","last_in_change":"2024-09-13T15:53:39.220264+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:50:10.657011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:54:51.436469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:54:52.427930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:54:55.478058+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5d39d6af-15e6-463b-b9ff-a9a5dd94e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6803","nonce":158651212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6805","nonce":158651212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6809","nonce":158651212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6807","nonce":158651212}]},"public_addr":"172.21.15.17:6803/158651212","cluster_addr":"172.21.15.17:6805/158651212","heartbeat_back_addr":"172.21.15.17:6809/158651212","heartbeat_front_addr":"172.21.15.17:6807/158651212","state":["exists","up"]},{"osd":1,"uuid":"0da621c7-645b-44ae-ba7c-a573861c3aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6801","nonce":964319421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6803","nonce":964319421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6807","nonce":964319421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6805","nonce":964319421}]},"public_addr":"172.21.15.189:6801/964319421","cluster_addr":"172.21.15.189:6803/964319421","heartbeat_back_addr":"172.21.15.189:6807/964319421","heartbeat_front_addr":"172.21.15.189:6805/964319421","state":["exists","up"]},{"osd":2,"uuid":"fa95af60-1486-4a29-8c79-8a73a4146552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6801","nonce":138468002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6803","nonce":138468002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6807","nonce":138468002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6805","nonce":138468002}]},"public_addr":"172.21.15.193:6801/138468002","cluster_addr":"172.21.15.193:6803/138468002","heartbeat_back_addr":"172.21.15.193:6807/138468002","heartbeat_front_addr":"172.21.15.193:6805/138468002","state":["exists","up"]},{"osd":3,"uuid":"90428e5f-dfd4-4cda-b240-fdb9079bcb7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6811","nonce":919913803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6813","nonce":919913803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6817","nonce":919913803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6815","nonce":919913803}]},"public_addr":"172.21.15.17:6811/919913803","cluster_addr":"172.21.15.17:6813/919913803","heartbeat_back_addr":"172.21.15.17:6817/919913803","heartbeat_front_addr":"172.21.15.17:6815/919913803","state":["exists","up"]},{"osd":4,"uuid":"e1c537b6-98d2-4b66-b15a-65fe70b0ce25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6809","nonce":2310375565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6811","nonce":2310375565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6815","nonce":2310375565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6813","nonce":2310375565}]},"public_addr":"172.21.15.189:6809/2310375565","cluster_addr":"172.21.15.189:6811/2310375565","heartbeat_back_addr":"172.21.15.189:6815/2310375565","heartbeat_front_addr":"172.21.15.189:6813/2310375565","state":["exists","up"]},{"osd":5,"uuid":"48522fd7-d781-4447-873f-174dabd1e33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6809","nonce":1330877824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6811","nonce":1330877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6815","nonce":1330877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6813","nonce":1330877824}]},"public_addr":"172.21.15.193:6809/1330877824","cluster_addr":"172.21.15.193:6811/1330877824","heartbeat_back_addr":"172.21.15.193:6815/1330877824","heartbeat_front_addr":"172.21.15.193:6813/1330877824","state":["exists","up"]},{"osd":6,"uuid":"47bea191-fb53-40a7-8563-8ebf17dd5bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6819","nonce":3930545382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6821","nonce":3930545382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6825","nonce":3930545382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6823","nonce":3930545382}]},"public_addr":"172.21.15.17:6819/3930545382","cluster_addr":"172.21.15.17:6821/3930545382","heartbeat_back_addr":"172.21.15.17:6825/3930545382","heartbeat_front_addr":"172.21.15.17:6823/3930545382","state":["exists","up"]},{"osd":7,"uuid":"a98f36f9-0a19-4c9a-8ed1-615c4a6e7658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6817","nonce":3691677495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6819","nonce":3691677495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6823","nonce":3691677495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6821","nonce":3691677495}]},"public_addr":"172.21.15.189:6817/3691677495","cluster_addr":"172.21.15.189:6819/3691677495","heartbeat_back_addr":"172.21.15.189:6823/3691677495","heartbeat_front_addr":"172.21.15.189:6821/3691677495","state":["exists","up"]},{"osd":8,"uuid":"7a372d9f-c40f-4ead-87da-2f3a570c1373","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6817","nonce":4112907498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6819","nonce":4112907498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6823","nonce":4112907498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6821","nonce":4112907498}]},"public_addr":"172.21.15.193:6817/4112907498","cluster_addr":"172.21.15.193:6819/4112907498","heartbeat_back_addr":"172.21.15.193:6823/4112907498","heartbeat_front_addr":"172.21.15.193:6821/4112907498","state":["exists","up"]},{"osd":9,"uuid":"ac3d983c-c5e7-456b-8271-7c4e6169de61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6827","nonce":663424274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6829","nonce":663424274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6833","nonce":663424274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6831","nonce":663424274}]},"public_addr":"172.21.15.17:6827/663424274","cluster_addr":"172.21.15.17:6829/663424274","heartbeat_back_addr":"172.21.15.17:6833/663424274","heartbeat_front_addr":"172.21.15.17:6831/663424274","state":["exists","up"]},{"osd":10,"uuid":"08dcae02-6c79-4a06-ae88-6eb6e6941cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6825","nonce":3153990375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6827","nonce":3153990375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6831","nonce":3153990375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6829","nonce":3153990375}]},"public_addr":"172.21.15.189:6825/3153990375","cluster_addr":"172.21.15.189:6827/3153990375","heartbeat_back_addr":"172.21.15.189:6831/3153990375","heartbeat_front_addr":"172.21.15.189:6829/3153990375","state":["exists","up"]},{"osd":11,"uuid":"a4ebcf41-d805-4d44-b112-13ae84d51868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6825","nonce":4088053907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6827","nonce":4088053907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6831","nonce":4088053907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6829","nonce":4088053907}]},"public_addr":"172.21.15.193:6825/4088053907","cluster_addr":"172.21.15.193:6827/4088053907","heartbeat_back_addr":"172.21.15.193:6831/4088053907","heartbeat_front_addr":"172.21.15.193:6829/4088053907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:22.172370+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:44.802224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:06.641435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:34.536515+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:58.789324+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:22.189862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:50.382257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:14.678047+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:38.581105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:07.258150+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:32.261383+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:56.739338+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/1550067038":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/3360683829":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/634066188":"2024-09-14T15:47:42.048005+0000","172.21.15.17:6801/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1945536687":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/2214214377":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1224386591":"2024-09-14T15:47:14.996424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:54:58.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.215+0000 7f8162c00640 1 -- 172.21.15.17:0/1709036333 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f81400a1110 msgr2=0x7f81400a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:58.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.215+0000 7f8162c00640 1 --2- 172.21.15.17:0/1709036333 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f81400a1110 0x7f81400a35d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f814c000c00 tx=0x7f814c005780 comp rx=0 tx=0).stop 2024-09-13T15:54:58.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.215+0000 7f8162c00640 1 -- 172.21.15.17:0/1709036333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f815c103b50 msgr2=0x7f815c19f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:58.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.215+0000 7f8162c00640 1 --2- 172.21.15.17:0/1709036333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f815c103b50 0x7f815c19f560 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8154009fd0 tx=0x7f815400ef10 comp rx=0 tx=0).stop 2024-09-13T15:54:58.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.215+0000 7f8162c00640 1 -- 172.21.15.17:0/1709036333 shutdown_connections 2024-09-13T15:54:58.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.215+0000 7f8162c00640 1 --2- 172.21.15.17:0/1709036333 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f81400a1110 0x7f81400a35d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.215+0000 7f8162c00640 1 --2- 172.21.15.17:0/1709036333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f815c103b50 0x7f815c19f560 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.215+0000 7f8162c00640 1 --2- 172.21.15.17:0/1709036333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f815c103190 0x7f815c1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.215+0000 7f8162c00640 1 --2- 172.21.15.17:0/1709036333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f815c101fa0 0x7f815c197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.215+0000 7f8162c00640 1 -- 172.21.15.17:0/1709036333 >> 172.21.15.17:0/1709036333 conn(0x7f815c0fd700 msgr2=0x7f815c106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:58.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.216+0000 7f8162c00640 1 -- 172.21.15.17:0/1709036333 shutdown_connections 2024-09-13T15:54:58.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.216+0000 7f8162c00640 1 -- 172.21.15.17:0/1709036333 wait complete. 2024-09-13T15:54:58.231 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:57 smithi017 ceph-mon[30494]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T15:54:58.232 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:57 smithi017 ceph-mon[30494]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-13T15:54:58.232 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:57 smithi017 ceph-mon[30494]: osdmap e89: 12 total, 12 up, 12 in 2024-09-13T15:54:58.232 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:57 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1739923642' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-13T15:54:58.232 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:57 smithi017 ceph-mon[30494]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-13T15:54:58.232 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:57 smithi017 ceph-mon[30494]: osdmap e90: 12 total, 12 up, 12 in 2024-09-13T15:54:58.232 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:57 smithi017 ceph-mon[30494]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-13T15:54:58.232 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:57 smithi017 ceph-mon[30494]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T15:54:58.232 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:57 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/197440493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:58.234 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:54:58.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:57 smithi193 ceph-mon[35248]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T15:54:58.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:57 smithi193 ceph-mon[35248]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-13T15:54:58.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:57 smithi193 ceph-mon[35248]: osdmap e89: 12 total, 12 up, 12 in 2024-09-13T15:54:58.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:57 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1739923642' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-13T15:54:58.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:57 smithi193 ceph-mon[35248]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-13T15:54:58.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:57 smithi193 ceph-mon[35248]: osdmap e90: 12 total, 12 up, 12 in 2024-09-13T15:54:58.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:57 smithi193 ceph-mon[35248]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-13T15:54:58.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:57 smithi193 ceph-mon[35248]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T15:54:58.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:57 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/197440493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:54:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.389+0000 7fe4fde00640 1 -- 172.21.15.17:0/543112842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe4f80ffda0 msgr2=0x7fe4f81001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.389+0000 7fe4fde00640 1 --2- 172.21.15.17:0/543112842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe4f80ffda0 0x7fe4f81001a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8009860 tx=0x7fe4e802a340 comp rx=0 tx=0).stop 2024-09-13T15:54:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.389+0000 7fe4fde00640 1 -- 172.21.15.17:0/543112842 shutdown_connections 2024-09-13T15:54:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.389+0000 7fe4fde00640 1 --2- 172.21.15.17:0/543112842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4f8101950 0x7fe4f81081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.389+0000 7fe4fde00640 1 --2- 172.21.15.17:0/543112842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f8100f90 0x7fe4f8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.389+0000 7fe4fde00640 1 --2- 172.21.15.17:0/543112842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe4f80ffda0 0x7fe4f81001a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.389+0000 7fe4fde00640 1 -- 172.21.15.17:0/543112842 >> 172.21.15.17:0/543112842 conn(0x7fe4f80fb520 msgr2=0x7fe4f80fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.389+0000 7fe4fde00640 1 -- 172.21.15.17:0/543112842 shutdown_connections 2024-09-13T15:54:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.389+0000 7fe4fde00640 1 -- 172.21.15.17:0/543112842 wait complete. 2024-09-13T15:54:58.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.390+0000 7fe4fde00640 1 Processor -- start 2024-09-13T15:54:58.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.390+0000 7fe4fde00640 1 -- start start 2024-09-13T15:54:58.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.391+0000 7fe4fde00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f80ffda0 0x7fe4f8195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:58.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.391+0000 7fe4fde00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4f8100f90 0x7fe4f8196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:58.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.391+0000 7fe4fde00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe4f8101950 0x7fe4f819d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:58.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.391+0000 7fe4fde00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f819d8c0 con 0x7fe4f80ffda0 2024-09-13T15:54:58.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.391+0000 7fe4fde00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f819da30 con 0x7fe4f8101950 2024-09-13T15:54:58.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.391+0000 7fe4fde00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f819dbf0 con 0x7fe4f8100f90 2024-09-13T15:54:58.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.391+0000 7fe4f6a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f80ffda0 0x7fe4f8195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:58.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.391+0000 7fe4f6a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f80ffda0 0x7fe4f8195dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41332/0 (socket says 172.21.15.17:41332) 2024-09-13T15:54:58.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.391+0000 7fe4f6a00640 1 -- 172.21.15.17:0/2602889460 learned_addr learned my addr 172.21.15.17:0/2602889460 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:58.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.391+0000 7fe4f7400640 1 --2- 172.21.15.17:0/2602889460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe4f8101950 0x7fe4f819d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:58.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.391+0000 7fe4f6000640 1 --2- 172.21.15.17:0/2602889460 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4f8100f90 0x7fe4f8196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:58.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.391+0000 7fe4f6a00640 1 -- 172.21.15.17:0/2602889460 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4f8100f90 msgr2=0x7fe4f8196310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:58.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.391+0000 7fe4f6a00640 1 --2- 172.21.15.17:0/2602889460 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4f8100f90 0x7fe4f8196310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.391+0000 7fe4f6a00640 1 -- 172.21.15.17:0/2602889460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe4f8101950 msgr2=0x7fe4f819d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:58.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.391+0000 7fe4f6a00640 1 --2- 172.21.15.17:0/2602889460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe4f8101950 0x7fe4f819d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.391+0000 7fe4f6a00640 1 -- 172.21.15.17:0/2602889460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e4009560 con 0x7fe4f80ffda0 2024-09-13T15:54:58.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.391+0000 7fe4f7400640 1 --2- 172.21.15.17:0/2602889460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe4f8101950 0x7fe4f819d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:54:58.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.392+0000 7fe4f6a00640 1 --2- 172.21.15.17:0/2602889460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f80ffda0 0x7fe4f8195dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80304b0 tx=0x7fe4e8032d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:58.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.392+0000 7fe4fca00640 1 -- 172.21.15.17:0/2602889460 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8004040 con 0x7fe4f80ffda0 2024-09-13T15:54:58.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.392+0000 7fe4fca00640 1 -- 172.21.15.17:0/2602889460 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4e8005050 con 0x7fe4f80ffda0 2024-09-13T15:54:58.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.392+0000 7fe4fde00640 1 -- 172.21.15.17:0/2602889460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e8009490 con 0x7fe4f80ffda0 2024-09-13T15:54:58.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.392+0000 7fe4fca00640 1 -- 172.21.15.17:0/2602889460 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8004920 con 0x7fe4f80ffda0 2024-09-13T15:54:58.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.392+0000 7fe4fde00640 1 -- 172.21.15.17:0/2602889460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f819e190 con 0x7fe4f80ffda0 2024-09-13T15:54:58.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.393+0000 7fe4fde00640 1 -- 172.21.15.17:0/2602889460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f81072d0 con 0x7fe4f80ffda0 2024-09-13T15:54:58.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.395+0000 7fe4fca00640 1 -- 172.21.15.17:0/2602889460 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe4e80041a0 con 0x7fe4f80ffda0 2024-09-13T15:54:58.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.396+0000 7fe4fca00640 1 --2- 172.21.15.17:0/2602889460 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe4dc0a1090 0x7fe4dc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:58.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.396+0000 7fe4fca00640 1 -- 172.21.15.17:0/2602889460 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fe4e80ed690 con 0x7fe4f80ffda0 2024-09-13T15:54:58.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.396+0000 7fe4f6000640 1 --2- 172.21.15.17:0/2602889460 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe4dc0a1090 0x7fe4dc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:58.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.397+0000 7fe4f6000640 1 --2- 172.21.15.17:0/2602889460 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe4dc0a1090 0x7fe4dc0a3550 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe4f81972e0 tx=0x7fe4e4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:58.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.400+0000 7fe4fca00640 1 -- 172.21.15.17:0/2602889460 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe4e80b6bd0 con 0x7fe4f80ffda0 2024-09-13T15:54:58.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.581+0000 7fe4fde00640 1 -- 172.21.15.17:0/2602889460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4f802c3e0 con 0x7fe4f80ffda0 2024-09-13T15:54:58.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.582+0000 7fe4fca00640 1 -- 172.21.15.17:0/2602889460 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23935 (secure 0 0 0) 0x7fe4e80ba1f0 con 0x7fe4f80ffda0 2024-09-13T15:54:58.584 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:58.585 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":90,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","created":"2024-09-13T15:46:50.475750+0000","modified":"2024-09-13T15:54:57.383548+0000","last_up_change":"2024-09-13T15:53:59.138985+0000","last_in_change":"2024-09-13T15:53:39.220264+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:50:10.657011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:54:51.436469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:54:52.427930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:54:55.478058+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5d39d6af-15e6-463b-b9ff-a9a5dd94e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6803","nonce":158651212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6805","nonce":158651212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6809","nonce":158651212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6807","nonce":158651212}]},"public_addr":"172.21.15.17:6803/158651212","cluster_addr":"172.21.15.17:6805/158651212","heartbeat_back_addr":"172.21.15.17:6809/158651212","heartbeat_front_addr":"172.21.15.17:6807/158651212","state":["exists","up"]},{"osd":1,"uuid":"0da621c7-645b-44ae-ba7c-a573861c3aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6801","nonce":964319421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6803","nonce":964319421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6807","nonce":964319421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6805","nonce":964319421}]},"public_addr":"172.21.15.189:6801/964319421","cluster_addr":"172.21.15.189:6803/964319421","heartbeat_back_addr":"172.21.15.189:6807/964319421","heartbeat_front_addr":"172.21.15.189:6805/964319421","state":["exists","up"]},{"osd":2,"uuid":"fa95af60-1486-4a29-8c79-8a73a4146552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6801","nonce":138468002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6803","nonce":138468002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6807","nonce":138468002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6805","nonce":138468002}]},"public_addr":"172.21.15.193:6801/138468002","cluster_addr":"172.21.15.193:6803/138468002","heartbeat_back_addr":"172.21.15.193:6807/138468002","heartbeat_front_addr":"172.21.15.193:6805/138468002","state":["exists","up"]},{"osd":3,"uuid":"90428e5f-dfd4-4cda-b240-fdb9079bcb7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6811","nonce":919913803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6813","nonce":919913803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6817","nonce":919913803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6815","nonce":919913803}]},"public_addr":"172.21.15.17:6811/919913803","cluster_addr":"172.21.15.17:6813/919913803","heartbeat_back_addr":"172.21.15.17:6817/919913803","heartbeat_front_addr":"172.21.15.17:6815/919913803","state":["exists","up"]},{"osd":4,"uuid":"e1c537b6-98d2-4b66-b15a-65fe70b0ce25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6809","nonce":2310375565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6811","nonce":2310375565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6815","nonce":2310375565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6813","nonce":2310375565}]},"public_addr":"172.21.15.189:6809/2310375565","cluster_addr":"172.21.15.189:6811/2310375565","heartbeat_back_addr":"172.21.15.189:6815/2310375565","heartbeat_front_addr":"172.21.15.189:6813/2310375565","state":["exists","up"]},{"osd":5,"uuid":"48522fd7-d781-4447-873f-174dabd1e33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6809","nonce":1330877824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6811","nonce":1330877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6815","nonce":1330877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6813","nonce":1330877824}]},"public_addr":"172.21.15.193:6809/1330877824","cluster_addr":"172.21.15.193:6811/1330877824","heartbeat_back_addr":"172.21.15.193:6815/1330877824","heartbeat_front_addr":"172.21.15.193:6813/1330877824","state":["exists","up"]},{"osd":6,"uuid":"47bea191-fb53-40a7-8563-8ebf17dd5bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6819","nonce":3930545382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6821","nonce":3930545382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6825","nonce":3930545382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6823","nonce":3930545382}]},"public_addr":"172.21.15.17:6819/3930545382","cluster_addr":"172.21.15.17:6821/3930545382","heartbeat_back_addr":"172.21.15.17:6825/3930545382","heartbeat_front_addr":"172.21.15.17:6823/3930545382","state":["exists","up"]},{"osd":7,"uuid":"a98f36f9-0a19-4c9a-8ed1-615c4a6e7658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6817","nonce":3691677495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6819","nonce":3691677495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6823","nonce":3691677495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6821","nonce":3691677495}]},"public_addr":"172.21.15.189:6817/3691677495","cluster_addr":"172.21.15.189:6819/3691677495","heartbeat_back_addr":"172.21.15.189:6823/3691677495","heartbeat_front_addr":"172.21.15.189:6821/3691677495","state":["exists","up"]},{"osd":8,"uuid":"7a372d9f-c40f-4ead-87da-2f3a570c1373","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6817","nonce":4112907498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6819","nonce":4112907498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6823","nonce":4112907498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6821","nonce":4112907498}]},"public_addr":"172.21.15.193:6817/4112907498","cluster_addr":"172.21.15.193:6819/4112907498","heartbeat_back_addr":"172.21.15.193:6823/4112907498","heartbeat_front_addr":"172.21.15.193:6821/4112907498","state":["exists","up"]},{"osd":9,"uuid":"ac3d983c-c5e7-456b-8271-7c4e6169de61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6827","nonce":663424274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6829","nonce":663424274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6833","nonce":663424274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6831","nonce":663424274}]},"public_addr":"172.21.15.17:6827/663424274","cluster_addr":"172.21.15.17:6829/663424274","heartbeat_back_addr":"172.21.15.17:6833/663424274","heartbeat_front_addr":"172.21.15.17:6831/663424274","state":["exists","up"]},{"osd":10,"uuid":"08dcae02-6c79-4a06-ae88-6eb6e6941cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6825","nonce":3153990375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6827","nonce":3153990375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6831","nonce":3153990375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6829","nonce":3153990375}]},"public_addr":"172.21.15.189:6825/3153990375","cluster_addr":"172.21.15.189:6827/3153990375","heartbeat_back_addr":"172.21.15.189:6831/3153990375","heartbeat_front_addr":"172.21.15.189:6829/3153990375","state":["exists","up"]},{"osd":11,"uuid":"a4ebcf41-d805-4d44-b112-13ae84d51868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6825","nonce":4088053907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6827","nonce":4088053907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6831","nonce":4088053907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6829","nonce":4088053907}]},"public_addr":"172.21.15.193:6825/4088053907","cluster_addr":"172.21.15.193:6827/4088053907","heartbeat_back_addr":"172.21.15.193:6831/4088053907","heartbeat_front_addr":"172.21.15.193:6829/4088053907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:22.172370+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:44.802224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:06.641435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:34.536515+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:58.789324+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:22.189862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:50.382257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:14.678047+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:38.581105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:07.258150+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:32.261383+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:56.739338+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/1550067038":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/3360683829":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/634066188":"2024-09-14T15:47:42.048005+0000","172.21.15.17:6801/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1945536687":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/2214214377":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1224386591":"2024-09-14T15:47:14.996424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:54:58.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.585+0000 7fe4fde00640 1 -- 172.21.15.17:0/2602889460 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe4dc0a1090 msgr2=0x7fe4dc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:58.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.585+0000 7fe4fde00640 1 --2- 172.21.15.17:0/2602889460 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe4dc0a1090 0x7fe4dc0a3550 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe4f81972e0 tx=0x7fe4e4009260 comp rx=0 tx=0).stop 2024-09-13T15:54:58.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.585+0000 7fe4fde00640 1 -- 172.21.15.17:0/2602889460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f80ffda0 msgr2=0x7fe4f8195dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:58.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.585+0000 7fe4fde00640 1 --2- 172.21.15.17:0/2602889460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f80ffda0 0x7fe4f8195dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80304b0 tx=0x7fe4e8032d20 comp rx=0 tx=0).stop 2024-09-13T15:54:58.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.585+0000 7fe4fde00640 1 -- 172.21.15.17:0/2602889460 shutdown_connections 2024-09-13T15:54:58.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.585+0000 7fe4fde00640 1 --2- 172.21.15.17:0/2602889460 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe4dc0a1090 0x7fe4dc0a3550 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.585+0000 7fe4fde00640 1 --2- 172.21.15.17:0/2602889460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe4f8101950 0x7fe4f819d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.585+0000 7fe4fde00640 1 --2- 172.21.15.17:0/2602889460 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4f8100f90 0x7fe4f8196310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.585+0000 7fe4fde00640 1 --2- 172.21.15.17:0/2602889460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f80ffda0 0x7fe4f8195dd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.585+0000 7fe4fde00640 1 -- 172.21.15.17:0/2602889460 >> 172.21.15.17:0/2602889460 conn(0x7fe4f80fb520 msgr2=0x7fe4f81044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:58.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.585+0000 7fe4fde00640 1 -- 172.21.15.17:0/2602889460 shutdown_connections 2024-09-13T15:54:58.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.585+0000 7fe4fde00640 1 -- 172.21.15.17:0/2602889460 wait complete. 2024-09-13T15:54:58.627 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:54:58.628 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 13 15:54:58 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-b[65010]: 2024-09-13T15:54:58.211+0000 7f0b78677640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T15:54:58.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.782+0000 7fa3b1600640 1 -- 172.21.15.17:0/698377880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3ac101f90 msgr2=0x7fa3ac102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:58.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.782+0000 7fa3b1600640 1 --2- 172.21.15.17:0/698377880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3ac101f90 0x7fa3ac102390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009860 tx=0x7fa39c02a340 comp rx=0 tx=0).stop 2024-09-13T15:54:58.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.783+0000 7fa3b1600640 1 -- 172.21.15.17:0/698377880 shutdown_connections 2024-09-13T15:54:58.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.783+0000 7fa3b1600640 1 --2- 172.21.15.17:0/698377880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3ac103b40 0x7fa3ac10a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.783+0000 7fa3b1600640 1 --2- 172.21.15.17:0/698377880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3ac103180 0x7fa3ac103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.783+0000 7fa3b1600640 1 --2- 172.21.15.17:0/698377880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3ac101f90 0x7fa3ac102390 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.783+0000 7fa3b1600640 1 -- 172.21.15.17:0/698377880 >> 172.21.15.17:0/698377880 conn(0x7fa3ac0fd730 msgr2=0x7fa3ac0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:58.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.783+0000 7fa3b1600640 1 -- 172.21.15.17:0/698377880 shutdown_connections 2024-09-13T15:54:58.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.783+0000 7fa3b1600640 1 -- 172.21.15.17:0/698377880 wait complete. 2024-09-13T15:54:58.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.784+0000 7fa3b1600640 1 Processor -- start 2024-09-13T15:54:58.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.784+0000 7fa3b1600640 1 -- start start 2024-09-13T15:54:58.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.784+0000 7fa3b1600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3ac101f90 0x7fa3ac197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:58.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.784+0000 7fa3b1600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3ac103180 0x7fa3ac198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:58.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.784+0000 7fa3b1600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3ac103b40 0x7fa3ac19f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:58.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.784+0000 7fa3b1600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac19fab0 con 0x7fa3ac103180 2024-09-13T15:54:58.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.784+0000 7fa3b1600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac19fc20 con 0x7fa3ac101f90 2024-09-13T15:54:58.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.784+0000 7fa3b1600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac19fde0 con 0x7fa3ac103b40 2024-09-13T15:54:58.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.784+0000 7fa3aaa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3ac101f90 0x7fa3ac197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:58.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.784+0000 7fa3a2000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3ac103180 0x7fa3ac198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:58.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.784+0000 7fa3aaa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3ac101f90 0x7fa3ac197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:45224/0 (socket says 172.21.15.17:45224) 2024-09-13T15:54:58.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.784+0000 7fa3aaa00640 1 -- 172.21.15.17:0/4009008992 learned_addr learned my addr 172.21.15.17:0/4009008992 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:58.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.784+0000 7fa3ab400640 1 --2- 172.21.15.17:0/4009008992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3ac103b40 0x7fa3ac19f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:58.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.785+0000 7fa3aaa00640 1 -- 172.21.15.17:0/4009008992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3ac103b40 msgr2=0x7fa3ac19f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:58.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.785+0000 7fa3aaa00640 1 --2- 172.21.15.17:0/4009008992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3ac103b40 0x7fa3ac19f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.785+0000 7fa3aaa00640 1 -- 172.21.15.17:0/4009008992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3ac103180 msgr2=0x7fa3ac198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:58.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.785+0000 7fa3aaa00640 1 --2- 172.21.15.17:0/4009008992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3ac103180 0x7fa3ac198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:58.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.785+0000 7fa3aaa00640 1 -- 172.21.15.17:0/4009008992 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c009490 con 0x7fa3ac101f90 2024-09-13T15:54:58.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.785+0000 7fa3aaa00640 1 --2- 172.21.15.17:0/4009008992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3ac101f90 0x7fa3ac197fc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0304b0 tx=0x7fa39c032d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:58.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.785+0000 7fa3a3e00640 1 -- 172.21.15.17:0/4009008992 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c004050 con 0x7fa3ac101f90 2024-09-13T15:54:58.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.785+0000 7fa3b1600640 1 -- 172.21.15.17:0/4009008992 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ac1a0060 con 0x7fa3ac101f90 2024-09-13T15:54:58.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.785+0000 7fa3a3e00640 1 -- 172.21.15.17:0/4009008992 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa39c005070 con 0x7fa3ac101f90 2024-09-13T15:54:58.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.785+0000 7fa3a3e00640 1 -- 172.21.15.17:0/4009008992 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c0049b0 con 0x7fa3ac101f90 2024-09-13T15:54:58.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.785+0000 7fa3b1600640 1 -- 172.21.15.17:0/4009008992 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ac1a0510 con 0x7fa3ac101f90 2024-09-13T15:54:58.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.786+0000 7fa3b1600640 1 -- 172.21.15.17:0/4009008992 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ac1094c0 con 0x7fa3ac101f90 2024-09-13T15:54:58.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.788+0000 7fa3a3e00640 1 -- 172.21.15.17:0/4009008992 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa39c0041b0 con 0x7fa3ac101f90 2024-09-13T15:54:58.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.790+0000 7fa3a3e00640 1 --2- 172.21.15.17:0/4009008992 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa3900a1090 0x7fa3900a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:58.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.790+0000 7fa3a3e00640 1 -- 172.21.15.17:0/4009008992 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa39c0ed670 con 0x7fa3ac101f90 2024-09-13T15:54:58.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.790+0000 7fa3a2000640 1 --2- 172.21.15.17:0/4009008992 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa3900a1090 0x7fa3900a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:58.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.790+0000 7fa3a2000640 1 --2- 172.21.15.17:0/4009008992 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa3900a1090 0x7fa3900a3550 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac1994d0 tx=0x7fa394005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:58.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:58.792+0000 7fa3a3e00640 1 -- 172.21.15.17:0/4009008992 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa39c0b6bb0 con 0x7fa3ac101f90 2024-09-13T15:54:59.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.013+0000 7fa3b1600640 1 -- 172.21.15.17:0/4009008992 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3ac10d850 con 0x7fa3ac101f90 2024-09-13T15:54:59.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.014+0000 7fa3a3e00640 1 -- 172.21.15.17:0/4009008992 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+10819 (secure 0 0 0) 0x7fa39c0d8e60 con 0x7fa3ac101f90 2024-09-13T15:54:59.016 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:59.016 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1730156534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1730156534},{"type":"v1","addr":"172.21.15.17:6837","nonce":1730156534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/1295854211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1295854211},{"type":"v1","addr":"172.21.15.17:6841","nonce":1295854211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2888593680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2888593680},{"type":"v1","addr":"172.21.15.17:6835","nonce":2888593680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4135454212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4135454212},{"type":"v1","addr":"172.21.15.189:6835","nonce":4135454212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24520,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/4049465204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":4049465204},{"type":"v1","addr":"172.21.15.193:6835","nonce":4049465204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24524,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/2079181485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2079181485},{"type":"v1","addr":"172.21.15.189:6837","nonce":2079181485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/792056943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":792056943},{"type":"v1","addr":"172.21.15.193:6837","nonce":792056943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24553,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6839/3012199875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":3012199875},{"type":"v1","addr":"172.21.15.193:6839","nonce":3012199875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3750040765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3750040765},{"type":"v1","addr":"172.21.15.17:6839","nonce":3750040765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:54:52.929867+0000","modified":"2024-09-13T15:54:57.383895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24578},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6839/2624723395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2624723395},{"type":"v1","addr":"172.21.15.189:6839","nonce":2624723395}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T15:54:59.016 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2024-09-13T15:54:59.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.016+0000 7fa3b1600640 1 -- 172.21.15.17:0/4009008992 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa3900a1090 msgr2=0x7fa3900a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:59.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.016+0000 7fa3b1600640 1 --2- 172.21.15.17:0/4009008992 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa3900a1090 0x7fa3900a3550 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac1994d0 tx=0x7fa394005f90 comp rx=0 tx=0).stop 2024-09-13T15:54:59.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.016+0000 7fa3b1600640 1 -- 172.21.15.17:0/4009008992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3ac101f90 msgr2=0x7fa3ac197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:59.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.016+0000 7fa3b1600640 1 --2- 172.21.15.17:0/4009008992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3ac101f90 0x7fa3ac197fc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0304b0 tx=0x7fa39c032d20 comp rx=0 tx=0).stop 2024-09-13T15:54:59.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.016+0000 7fa3b1600640 1 -- 172.21.15.17:0/4009008992 shutdown_connections 2024-09-13T15:54:59.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.016+0000 7fa3b1600640 1 --2- 172.21.15.17:0/4009008992 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa3900a1090 0x7fa3900a3550 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.016+0000 7fa3b1600640 1 --2- 172.21.15.17:0/4009008992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3ac103b40 0x7fa3ac19f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.016+0000 7fa3b1600640 1 --2- 172.21.15.17:0/4009008992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3ac103180 0x7fa3ac198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.016+0000 7fa3b1600640 1 --2- 172.21.15.17:0/4009008992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3ac101f90 0x7fa3ac197fc0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.016+0000 7fa3b1600640 1 -- 172.21.15.17:0/4009008992 >> 172.21.15.17:0/4009008992 conn(0x7fa3ac0fd730 msgr2=0x7fa3ac106690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:59.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.016+0000 7fa3b1600640 1 -- 172.21.15.17:0/4009008992 shutdown_connections 2024-09-13T15:54:59.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.016+0000 7fa3b1600640 1 -- 172.21.15.17:0/4009008992 wait complete. 2024-09-13T15:54:59.035 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:54:59.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.192+0000 7f2105600640 1 -- 172.21.15.17:0/132172243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2100103190 msgr2=0x7f2100103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:59.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.192+0000 7f2105600640 1 --2- 172.21.15.17:0/132172243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2100103190 0x7f2100103610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009900 tx=0x7f20ec02a3f0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.192+0000 7f2105600640 1 -- 172.21.15.17:0/132172243 shutdown_connections 2024-09-13T15:54:59.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.192+0000 7f2105600640 1 --2- 172.21.15.17:0/132172243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2100103b50 0x7f210010a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.192+0000 7f2105600640 1 --2- 172.21.15.17:0/132172243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2100103190 0x7f2100103610 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.192+0000 7f2105600640 1 --2- 172.21.15.17:0/132172243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2100101fa0 0x7f21001023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.192+0000 7f2105600640 1 -- 172.21.15.17:0/132172243 >> 172.21.15.17:0/132172243 conn(0x7f21000fd700 msgr2=0x7f21000ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:59.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.192+0000 7f2105600640 1 -- 172.21.15.17:0/132172243 shutdown_connections 2024-09-13T15:54:59.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.192+0000 7f2105600640 1 -- 172.21.15.17:0/132172243 wait complete. 2024-09-13T15:54:59.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.193+0000 7f2105600640 1 Processor -- start 2024-09-13T15:54:59.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.193+0000 7f2105600640 1 -- start start 2024-09-13T15:54:59.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.193+0000 7f2105600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2100101fa0 0x7f2100197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:59.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.193+0000 7f2105600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2100103190 0x7f21001984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:59.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.193+0000 7f2105600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2100103b50 0x7f210019f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:59.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.193+0000 7f2105600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210019fa80 con 0x7f2100101fa0 2024-09-13T15:54:59.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.193+0000 7f2105600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210019fbf0 con 0x7f2100103b50 2024-09-13T15:54:59.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.193+0000 7f2105600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210019fdb0 con 0x7f2100103190 2024-09-13T15:54:59.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.193+0000 7f20fea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2100101fa0 0x7f2100197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:59.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.194+0000 7f20fea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2100101fa0 0x7f2100197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53472/0 (socket says 172.21.15.17:53472) 2024-09-13T15:54:59.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.194+0000 7f20fea00640 1 -- 172.21.15.17:0/3176619261 learned_addr learned my addr 172.21.15.17:0/3176619261 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:59.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.194+0000 7f20ff400640 1 --2- 172.21.15.17:0/3176619261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2100103b50 0x7f210019f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:59.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.194+0000 7f20fe000640 1 --2- 172.21.15.17:0/3176619261 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2100103190 0x7f21001984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:59.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.194+0000 7f20fea00640 1 -- 172.21.15.17:0/3176619261 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2100103190 msgr2=0x7f21001984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:59.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.194+0000 7f20fea00640 1 --2- 172.21.15.17:0/3176619261 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2100103190 0x7f21001984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.194+0000 7f20fea00640 1 -- 172.21.15.17:0/3176619261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2100103b50 msgr2=0x7f210019f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:59.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.194+0000 7f20fea00640 1 --2- 172.21.15.17:0/3176619261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2100103b50 0x7f210019f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.194+0000 7f20fea00640 1 -- 172.21.15.17:0/3176619261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec009560 con 0x7f2100101fa0 2024-09-13T15:54:59.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.194+0000 7f20ff400640 1 --2- 172.21.15.17:0/3176619261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2100103b50 0x7f210019f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:54:59.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.194+0000 7f20fea00640 1 --2- 172.21.15.17:0/3176619261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2100101fa0 0x7f2100197f90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f20f000d950 tx=0x7f20f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:59.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.194+0000 7f20f7400640 1 -- 172.21.15.17:0/3176619261 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f0009c30 con 0x7f2100101fa0 2024-09-13T15:54:59.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.195+0000 7f20f7400640 1 -- 172.21.15.17:0/3176619261 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f20f0009d90 con 0x7f2100101fa0 2024-09-13T15:54:59.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.195+0000 7f20f7400640 1 -- 172.21.15.17:0/3176619261 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f000f6b0 con 0x7f2100101fa0 2024-09-13T15:54:59.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.195+0000 7f2105600640 1 -- 172.21.15.17:0/3176619261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21001a0090 con 0x7f2100101fa0 2024-09-13T15:54:59.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.195+0000 7f2105600640 1 -- 172.21.15.17:0/3176619261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21001a0520 con 0x7f2100101fa0 2024-09-13T15:54:59.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.196+0000 7f2105600640 1 -- 172.21.15.17:0/3176619261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21001023a0 con 0x7f2100101fa0 2024-09-13T15:54:59.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.197+0000 7f20f7400640 1 -- 172.21.15.17:0/3176619261 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f20f00109b0 con 0x7f2100101fa0 2024-09-13T15:54:59.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.199+0000 7f20f7400640 1 --2- 172.21.15.17:0/3176619261 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f20e40a1090 0x7f20e40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:59.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.199+0000 7f20f7400640 1 -- 172.21.15.17:0/3176619261 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f20f00cc830 con 0x7f2100101fa0 2024-09-13T15:54:59.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.199+0000 7f20fe000640 1 --2- 172.21.15.17:0/3176619261 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f20e40a1090 0x7f20e40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:59.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.200+0000 7f20fe000640 1 --2- 172.21.15.17:0/3176619261 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f20e40a1090 0x7f20e40a3550 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f20ec005ab0 tx=0x7f20ec005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:59.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.203+0000 7f20f7400640 1 -- 172.21.15.17:0/3176619261 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f20f0095e20 con 0x7f2100101fa0 2024-09-13T15:54:59.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:58 smithi193 ceph-mon[35248]: pgmap v298: 129 pgs: 4 creating+peering, 24 unknown, 101 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 8 op/s 2024-09-13T15:54:59.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:58 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1709036333' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:54:59.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:58 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/2602889460' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:54:59.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:58 smithi017 ceph-mon[30494]: pgmap v298: 129 pgs: 4 creating+peering, 24 unknown, 101 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 8 op/s 2024-09-13T15:54:59.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:58 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1709036333' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:54:59.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:58 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/2602889460' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:54:59.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:58 smithi189 ceph-mon[34790]: pgmap v298: 129 pgs: 4 creating+peering, 24 unknown, 101 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 8 op/s 2024-09-13T15:54:59.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:58 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1709036333' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:54:59.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:58 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/2602889460' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:54:59.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.386+0000 7f2105600640 1 -- 172.21.15.17:0/3176619261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2100109420 con 0x7f2100101fa0 2024-09-13T15:54:59.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.388+0000 7f20f7400640 1 -- 172.21.15.17:0/3176619261 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23935 (secure 0 0 0) 0x7f20f0099440 con 0x7f2100101fa0 2024-09-13T15:54:59.390 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:54:59.392 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":90,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","created":"2024-09-13T15:46:50.475750+0000","modified":"2024-09-13T15:54:57.383548+0000","last_up_change":"2024-09-13T15:53:59.138985+0000","last_in_change":"2024-09-13T15:53:39.220264+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:50:10.657011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:54:51.436469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:54:52.427930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:54:55.478058+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5d39d6af-15e6-463b-b9ff-a9a5dd94e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6803","nonce":158651212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6805","nonce":158651212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6809","nonce":158651212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6807","nonce":158651212}]},"public_addr":"172.21.15.17:6803/158651212","cluster_addr":"172.21.15.17:6805/158651212","heartbeat_back_addr":"172.21.15.17:6809/158651212","heartbeat_front_addr":"172.21.15.17:6807/158651212","state":["exists","up"]},{"osd":1,"uuid":"0da621c7-645b-44ae-ba7c-a573861c3aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6801","nonce":964319421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6803","nonce":964319421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6807","nonce":964319421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6805","nonce":964319421}]},"public_addr":"172.21.15.189:6801/964319421","cluster_addr":"172.21.15.189:6803/964319421","heartbeat_back_addr":"172.21.15.189:6807/964319421","heartbeat_front_addr":"172.21.15.189:6805/964319421","state":["exists","up"]},{"osd":2,"uuid":"fa95af60-1486-4a29-8c79-8a73a4146552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6801","nonce":138468002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6803","nonce":138468002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6807","nonce":138468002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6805","nonce":138468002}]},"public_addr":"172.21.15.193:6801/138468002","cluster_addr":"172.21.15.193:6803/138468002","heartbeat_back_addr":"172.21.15.193:6807/138468002","heartbeat_front_addr":"172.21.15.193:6805/138468002","state":["exists","up"]},{"osd":3,"uuid":"90428e5f-dfd4-4cda-b240-fdb9079bcb7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6811","nonce":919913803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6813","nonce":919913803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6817","nonce":919913803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6815","nonce":919913803}]},"public_addr":"172.21.15.17:6811/919913803","cluster_addr":"172.21.15.17:6813/919913803","heartbeat_back_addr":"172.21.15.17:6817/919913803","heartbeat_front_addr":"172.21.15.17:6815/919913803","state":["exists","up"]},{"osd":4,"uuid":"e1c537b6-98d2-4b66-b15a-65fe70b0ce25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6809","nonce":2310375565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6811","nonce":2310375565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6815","nonce":2310375565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6813","nonce":2310375565}]},"public_addr":"172.21.15.189:6809/2310375565","cluster_addr":"172.21.15.189:6811/2310375565","heartbeat_back_addr":"172.21.15.189:6815/2310375565","heartbeat_front_addr":"172.21.15.189:6813/2310375565","state":["exists","up"]},{"osd":5,"uuid":"48522fd7-d781-4447-873f-174dabd1e33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6809","nonce":1330877824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6811","nonce":1330877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6815","nonce":1330877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6813","nonce":1330877824}]},"public_addr":"172.21.15.193:6809/1330877824","cluster_addr":"172.21.15.193:6811/1330877824","heartbeat_back_addr":"172.21.15.193:6815/1330877824","heartbeat_front_addr":"172.21.15.193:6813/1330877824","state":["exists","up"]},{"osd":6,"uuid":"47bea191-fb53-40a7-8563-8ebf17dd5bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6819","nonce":3930545382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6821","nonce":3930545382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6825","nonce":3930545382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6823","nonce":3930545382}]},"public_addr":"172.21.15.17:6819/3930545382","cluster_addr":"172.21.15.17:6821/3930545382","heartbeat_back_addr":"172.21.15.17:6825/3930545382","heartbeat_front_addr":"172.21.15.17:6823/3930545382","state":["exists","up"]},{"osd":7,"uuid":"a98f36f9-0a19-4c9a-8ed1-615c4a6e7658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6817","nonce":3691677495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6819","nonce":3691677495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6823","nonce":3691677495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6821","nonce":3691677495}]},"public_addr":"172.21.15.189:6817/3691677495","cluster_addr":"172.21.15.189:6819/3691677495","heartbeat_back_addr":"172.21.15.189:6823/3691677495","heartbeat_front_addr":"172.21.15.189:6821/3691677495","state":["exists","up"]},{"osd":8,"uuid":"7a372d9f-c40f-4ead-87da-2f3a570c1373","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6817","nonce":4112907498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6819","nonce":4112907498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6823","nonce":4112907498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6821","nonce":4112907498}]},"public_addr":"172.21.15.193:6817/4112907498","cluster_addr":"172.21.15.193:6819/4112907498","heartbeat_back_addr":"172.21.15.193:6823/4112907498","heartbeat_front_addr":"172.21.15.193:6821/4112907498","state":["exists","up"]},{"osd":9,"uuid":"ac3d983c-c5e7-456b-8271-7c4e6169de61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6827","nonce":663424274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6829","nonce":663424274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6833","nonce":663424274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6831","nonce":663424274}]},"public_addr":"172.21.15.17:6827/663424274","cluster_addr":"172.21.15.17:6829/663424274","heartbeat_back_addr":"172.21.15.17:6833/663424274","heartbeat_front_addr":"172.21.15.17:6831/663424274","state":["exists","up"]},{"osd":10,"uuid":"08dcae02-6c79-4a06-ae88-6eb6e6941cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6825","nonce":3153990375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6827","nonce":3153990375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6831","nonce":3153990375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6829","nonce":3153990375}]},"public_addr":"172.21.15.189:6825/3153990375","cluster_addr":"172.21.15.189:6827/3153990375","heartbeat_back_addr":"172.21.15.189:6831/3153990375","heartbeat_front_addr":"172.21.15.189:6829/3153990375","state":["exists","up"]},{"osd":11,"uuid":"a4ebcf41-d805-4d44-b112-13ae84d51868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6825","nonce":4088053907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6827","nonce":4088053907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6831","nonce":4088053907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6829","nonce":4088053907}]},"public_addr":"172.21.15.193:6825/4088053907","cluster_addr":"172.21.15.193:6827/4088053907","heartbeat_back_addr":"172.21.15.193:6831/4088053907","heartbeat_front_addr":"172.21.15.193:6829/4088053907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:22.172370+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:44.802224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:06.641435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:34.536515+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:58.789324+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:22.189862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:50.382257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:14.678047+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:38.581105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:07.258150+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:32.261383+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:56.739338+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/1550067038":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/3360683829":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/634066188":"2024-09-14T15:47:42.048005+0000","172.21.15.17:6801/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1945536687":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/2214214377":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1224386591":"2024-09-14T15:47:14.996424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:54:59.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.390+0000 7f2105600640 1 -- 172.21.15.17:0/3176619261 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f20e40a1090 msgr2=0x7f20e40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:59.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.390+0000 7f2105600640 1 --2- 172.21.15.17:0/3176619261 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f20e40a1090 0x7f20e40a3550 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f20ec005ab0 tx=0x7f20ec005780 comp rx=0 tx=0).stop 2024-09-13T15:54:59.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.390+0000 7f2105600640 1 -- 172.21.15.17:0/3176619261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2100101fa0 msgr2=0x7f2100197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:59.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.390+0000 7f2105600640 1 --2- 172.21.15.17:0/3176619261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2100101fa0 0x7f2100197f90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f20f000d950 tx=0x7f20f000de10 comp rx=0 tx=0).stop 2024-09-13T15:54:59.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.390+0000 7f2105600640 1 -- 172.21.15.17:0/3176619261 shutdown_connections 2024-09-13T15:54:59.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.390+0000 7f2105600640 1 --2- 172.21.15.17:0/3176619261 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f20e40a1090 0x7f20e40a3550 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.390+0000 7f2105600640 1 --2- 172.21.15.17:0/3176619261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2100103b50 0x7f210019f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.390+0000 7f2105600640 1 --2- 172.21.15.17:0/3176619261 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2100103190 0x7f21001984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.390+0000 7f2105600640 1 --2- 172.21.15.17:0/3176619261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2100101fa0 0x7f2100197f90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.390+0000 7f2105600640 1 -- 172.21.15.17:0/3176619261 >> 172.21.15.17:0/3176619261 conn(0x7f21000fd700 msgr2=0x7f21001065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:59.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.390+0000 7f2105600640 1 -- 172.21.15.17:0/3176619261 shutdown_connections 2024-09-13T15:54:59.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.391+0000 7f2105600640 1 -- 172.21.15.17:0/3176619261 wait complete. 2024-09-13T15:54:59.411 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T15:54:52.929867+0000', 'modified': '2024-09-13T15:54:57.383895+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24578}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24578': {'gid': 24578, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.189:6839/2624723395', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 2624723395}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 2624723395}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-09-13T15:54:59.413 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T15:54:59.413 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T15:54:59.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.571+0000 7fdc9ce00640 1 -- 172.21.15.17:0/3854921339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc98074470 msgr2=0x7fdc980728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:59.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.571+0000 7fdc9ce00640 1 --2- 172.21.15.17:0/3854921339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc98074470 0x7fdc980728c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009900 tx=0x7fdc8802a480 comp rx=0 tx=0).stop 2024-09-13T15:54:59.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.571+0000 7fdc9ce00640 1 -- 172.21.15.17:0/3854921339 shutdown_connections 2024-09-13T15:54:59.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.571+0000 7fdc9ce00640 1 --2- 172.21.15.17:0/3854921339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc98107c10 0x7fdc9810a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.571+0000 7fdc9ce00640 1 --2- 172.21.15.17:0/3854921339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc98072e90 0x7fdc980732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.571+0000 7fdc9ce00640 1 --2- 172.21.15.17:0/3854921339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc98074470 0x7fdc980728c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.571+0000 7fdc9ce00640 1 -- 172.21.15.17:0/3854921339 >> 172.21.15.17:0/3854921339 conn(0x7fdc980fb4c0 msgr2=0x7fdc980fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:59.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.571+0000 7fdc9ce00640 1 -- 172.21.15.17:0/3854921339 shutdown_connections 2024-09-13T15:54:59.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.571+0000 7fdc9ce00640 1 -- 172.21.15.17:0/3854921339 wait complete. 2024-09-13T15:54:59.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.572+0000 7fdc9ce00640 1 Processor -- start 2024-09-13T15:54:59.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.572+0000 7fdc9ce00640 1 -- start start 2024-09-13T15:54:59.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.572+0000 7fdc9ce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc98072e90 0x7fdc98197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:59.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.572+0000 7fdc9ce00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc98074470 0x7fdc98198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:59.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.572+0000 7fdc9ce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc98107c10 0x7fdc9819f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:59.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.572+0000 7fdc9ce00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9819fa10 con 0x7fdc98107c10 2024-09-13T15:54:59.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.572+0000 7fdc9ce00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9819fb80 con 0x7fdc98072e90 2024-09-13T15:54:59.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.572+0000 7fdc9ce00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9819fd40 con 0x7fdc98074470 2024-09-13T15:54:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.573+0000 7fdc95e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc98072e90 0x7fdc98197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.573+0000 7fdc95e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc98072e90 0x7fdc98197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:45428/0 (socket says 172.21.15.17:45428) 2024-09-13T15:54:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.573+0000 7fdc95e00640 1 -- 172.21.15.17:0/744664290 learned_addr learned my addr 172.21.15.17:0/744664290 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.573+0000 7fdc96800640 1 --2- 172.21.15.17:0/744664290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc98107c10 0x7fdc9819f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.573+0000 7fdc8d400640 1 --2- 172.21.15.17:0/744664290 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc98074470 0x7fdc98198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.573+0000 7fdc95e00640 1 -- 172.21.15.17:0/744664290 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc98074470 msgr2=0x7fdc98198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.573+0000 7fdc95e00640 1 --2- 172.21.15.17:0/744664290 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc98074470 0x7fdc98198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.573+0000 7fdc95e00640 1 -- 172.21.15.17:0/744664290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc98107c10 msgr2=0x7fdc9819f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:59.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.573+0000 7fdc95e00640 1 --2- 172.21.15.17:0/744664290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc98107c10 0x7fdc9819f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.573+0000 7fdc95e00640 1 -- 172.21.15.17:0/744664290 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc88009560 con 0x7fdc98072e90 2024-09-13T15:54:59.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.573+0000 7fdc95e00640 1 --2- 172.21.15.17:0/744664290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc98072e90 0x7fdc98197f20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009a20 tx=0x7fdc88005620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:59.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.574+0000 7fdc8f400640 1 -- 172.21.15.17:0/744664290 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc88004c10 con 0x7fdc98072e90 2024-09-13T15:54:59.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.574+0000 7fdc8f400640 1 -- 172.21.15.17:0/744664290 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc88004d70 con 0x7fdc98072e90 2024-09-13T15:54:59.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.574+0000 7fdc9ce00640 1 -- 172.21.15.17:0/744664290 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9819ffc0 con 0x7fdc98072e90 2024-09-13T15:54:59.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.574+0000 7fdc8f400640 1 -- 172.21.15.17:0/744664290 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc88031ae0 con 0x7fdc98072e90 2024-09-13T15:54:59.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.574+0000 7fdc9ce00640 1 -- 172.21.15.17:0/744664290 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc981a03e0 con 0x7fdc98072e90 2024-09-13T15:54:59.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.577+0000 7fdc9fc71740 1 Processor -- start 2024-09-13T15:54:59.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.578+0000 7fdc9fc71740 1 -- start start 2024-09-13T15:54:59.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.578+0000 7fdc9fc71740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe2b30 0x5654a0fe2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:59.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.578+0000 7fdc9fc71740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654a0fe3470 0x5654a0fe7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:59.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.578+0000 7fdc9fc71740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 0x5654a0fea9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:59.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.578+0000 7fdc9fc71740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a0f4cab0 con 0x5654a0fe2b30 2024-09-13T15:54:59.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.578+0000 7fdc9fc71740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a0f4a240 con 0x5654a0fe3470 2024-09-13T15:54:59.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.578+0000 7fdc9fc71740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a0f45b30 con 0x5654a0fe8500 2024-09-13T15:54:59.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.578+0000 7fdc96800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe2b30 0x5654a0fe2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:59.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.578+0000 7fdc96800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe2b30 0x5654a0fe2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53492/0 (socket says 172.21.15.17:53492) 2024-09-13T15:54:59.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.578+0000 7fdc96800640 1 -- 172.21.15.17:0/676921679 learned_addr learned my addr 172.21.15.17:0/676921679 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:59.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.578+0000 7fdc8f400640 1 -- 172.21.15.17:0/744664290 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fdc88031c40 con 0x7fdc98072e90 2024-09-13T15:54:59.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.578+0000 7fdc8d400640 1 --2- 172.21.15.17:0/676921679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 0x5654a0fea9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:59.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.579+0000 7fdc96800640 1 -- 172.21.15.17:0/676921679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 msgr2=0x5654a0fea9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:54:59.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.579+0000 7fdc96800640 1 --2- 172.21.15.17:0/676921679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 0x5654a0fea9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.579+0000 7fdc96800640 1 -- 172.21.15.17:0/676921679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654a0fe3470 msgr2=0x5654a0fe7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:54:59.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.579+0000 7fdc96800640 1 --2- 172.21.15.17:0/676921679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654a0fe3470 0x5654a0fe7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.579+0000 7fdc96800640 1 -- 172.21.15.17:0/676921679 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654a0f10bd0 con 0x5654a0fe2b30 2024-09-13T15:54:59.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.579+0000 7fdc8d400640 1 --2- 172.21.15.17:0/676921679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 0x5654a0fea9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:54:59.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.579+0000 7fdc96800640 1 --2- 172.21.15.17:0/676921679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe2b30 0x5654a0fe2f30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009fd0 tx=0x7fdc900118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f38a9920550655 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:59.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.579+0000 7fdc87400640 1 -- 172.21.15.17:0/676921679 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc90004d20 con 0x5654a0fe2b30 2024-09-13T15:54:59.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.579+0000 7fdc87400640 1 -- 172.21.15.17:0/676921679 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc90004e80 con 0x5654a0fe2b30 2024-09-13T15:54:59.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.579+0000 7fdc87400640 1 -- 172.21.15.17:0/676921679 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc90005280 con 0x5654a0fe2b30 2024-09-13T15:54:59.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.580+0000 7fdc9fc71740 1 -- 172.21.15.17:0/676921679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe2b30 msgr2=0x5654a0fe2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:59.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.580+0000 7fdc9fc71740 1 --2- 172.21.15.17:0/676921679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe2b30 0x5654a0fe2f30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009fd0 tx=0x7fdc900118d0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.580+0000 7fdc9fc71740 1 -- 172.21.15.17:0/676921679 shutdown_connections 2024-09-13T15:54:59.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.580+0000 7fdc9fc71740 1 --2- 172.21.15.17:0/676921679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 0x5654a0fea9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.580+0000 7fdc9fc71740 1 --2- 172.21.15.17:0/676921679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654a0fe3470 0x5654a0fe7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.580+0000 7fdc9fc71740 1 --2- 172.21.15.17:0/676921679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe2b30 0x5654a0fe2f30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.580+0000 7fdc9fc71740 1 -- 172.21.15.17:0/676921679 >> 172.21.15.17:0/676921679 conn(0x5654a0fde1a0 msgr2=0x5654a0fde5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:59.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.580+0000 7fdc9fc71740 1 -- 172.21.15.17:0/676921679 shutdown_connections 2024-09-13T15:54:59.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.580+0000 7fdc9fc71740 1 -- 172.21.15.17:0/676921679 wait complete. 2024-09-13T15:54:59.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.580+0000 7fdc8f400640 1 --2- 172.21.15.17:0/744664290 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdc7c0a1020 0x7fdc7c0a34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:59.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.580+0000 7fdc8f400640 1 -- 172.21.15.17:0/744664290 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fdc880eda80 con 0x7fdc98072e90 2024-09-13T15:54:59.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.580+0000 7fdc9fc71740 1 -- start start 2024-09-13T15:54:59.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.580+0000 7fdc8d400640 1 --2- 172.21.15.17:0/744664290 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdc7c0a1020 0x7fdc7c0a34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:59.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.581+0000 7fdc9fc71740 1 Processor -- start 2024-09-13T15:54:59.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.581+0000 7fdc8d400640 1 --2- 172.21.15.17:0/744664290 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdc7c0a1020 0x7fdc7c0a34e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x5654a0fdf020 tx=0x7fdc80005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:59.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.581+0000 7fdc9fc71740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654a0fe2b30 0x5654a0fec800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:59.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.581+0000 7fdc9fc71740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe3470 0x5654a0fecd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:59.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.581+0000 7fdc9fc71740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 0x5654a0ff3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:59.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.581+0000 7fdc9fc71740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a0ee7260 con 0x5654a0fe3470 2024-09-13T15:54:59.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.581+0000 7fdc9fc71740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a0ee6f00 con 0x5654a0fe2b30 2024-09-13T15:54:59.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.581+0000 7fdc9fc71740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a0cacf20 con 0x5654a0fe8500 2024-09-13T15:54:59.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.581+0000 7fdc9fc71740 10 client.0 _ll_register_callbacks cb 0x5654a0f3f1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:54:59.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.581+0000 7fdc8d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe3470 0x5654a0fecd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:59.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.581+0000 7fdc96800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 0x5654a0ff3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:59.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.581+0000 7fdc8d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe3470 0x5654a0fecd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53494/0 (socket says 172.21.15.17:53494) 2024-09-13T15:54:59.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.581+0000 7fdc96800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 0x5654a0ff3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:56622/0 (socket says 172.21.15.17:56622) 2024-09-13T15:54:59.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.581+0000 7fdc8d400640 1 -- 172.21.15.17:0/1826192648 learned_addr learned my addr 172.21.15.17:0/1826192648 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:59.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.581+0000 7fdc95e00640 1 --2- 172.21.15.17:0/1826192648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654a0fe2b30 0x5654a0fec800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:59.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.582+0000 7fdc96800640 1 -- 172.21.15.17:0/1826192648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654a0fe2b30 msgr2=0x5654a0fec800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:54:59.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.582+0000 7fdc96800640 1 --2- 172.21.15.17:0/1826192648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654a0fe2b30 0x5654a0fec800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.582+0000 7fdc96800640 1 -- 172.21.15.17:0/1826192648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe3470 msgr2=0x5654a0fecd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:54:59.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.582+0000 7fdc96800640 1 --2- 172.21.15.17:0/1826192648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe3470 0x5654a0fecd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.582+0000 7fdc96800640 1 -- 172.21.15.17:0/1826192648 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc90009c80 con 0x5654a0fe8500 2024-09-13T15:54:59.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.582+0000 7fdc8d400640 1 --2- 172.21.15.17:0/1826192648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe3470 0x5654a0fecd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:54:59.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.582+0000 7fdc96800640 1 --2- 172.21.15.17:0/1826192648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 0x5654a0ff3d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdc90011dd0 tx=0x7fdc90004300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77b18184ee984277 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:59.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.582+0000 7fdc7be00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T15:54:59.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.582+0000 7fdc7be00640 1 -- 172.21.15.17:0/1826192648 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc90003e40 con 0x5654a0fe8500 2024-09-13T15:54:59.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.583+0000 7fdc9fc71740 1 -- 172.21.15.17:0/1826192648 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654a0c393c0 con 0x5654a0fe8500 2024-09-13T15:54:59.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.583+0000 7fdc7be00640 1 -- 172.21.15.17:0/1826192648 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fdc9000f4e0 con 0x5654a0fe8500 2024-09-13T15:54:59.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.583+0000 7fdc7be00640 1 -- 172.21.15.17:0/1826192648 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc9000f6a0 con 0x5654a0fe8500 2024-09-13T15:54:59.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.583+0000 7fdc9fc71740 10 client.24703 fetch_fsmap learned FSMap version 17 2024-09-13T15:54:59.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.583+0000 7fdc9fc71740 1 -- 172.21.15.17:0/1826192648 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x5654a0f441b0 con 0x5654a0fe8500 2024-09-13T15:54:59.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.583+0000 7fdc7be00640 1 -- 172.21.15.17:0/1826192648 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5654a0c393c0 con 0x5654a0fe8500 2024-09-13T15:54:59.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.583+0000 7fdc7be00640 1 -- 172.21.15.17:0/1826192648 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 17) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fdc90021040 con 0x5654a0fe8500 2024-09-13T15:54:59.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.583+0000 7fdc9fc71740 10 client.24703 fetch_fsmap finished waiting for FSMap version 17 2024-09-13T15:54:59.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.583+0000 7fdc9fc71740 10 client.24703 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T15:54:59.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.583+0000 7fdc9fc71740 20 client.24703 populate_metadata read hostname 'smithi017' 2024-09-13T15:54:59.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.583+0000 7fdc9fc71740 1 --2- 172.21.15.17:0/1826192648 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5654a0ff8a70 0x5654a0ffcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:59.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.583+0000 7fdc9fc71740 4 client.24703 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:54:59.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.583+0000 7fdc9fc71740 1 -- 172.21.15.17:0/1826192648 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5654a0c4a6c0 con 0x5654a0ff8a70 2024-09-13T15:54:59.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.584+0000 7fdc95e00640 1 --2- 172.21.15.17:0/1826192648 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5654a0ff8a70 0x5654a0ffcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:59.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.584+0000 7fdc95e00640 1 --2- 172.21.15.17:0/1826192648 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5654a0ff8a70 0x5654a0ffcbb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8216dbfb4d67819 server_cookie=5a72385197d7a114 in_seq=0 out_seq=0 2024-09-13T15:54:59.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.584+0000 7fdc7be00640 10 client.24703 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:54:59.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.585+0000 7fdc7be00640 1 -- 172.21.15.17:0/1826192648 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5654a0c4a6c0 con 0x5654a0ff8a70 2024-09-13T15:54:59.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.585+0000 7fdc7be00640 10 client.24703 handle_command_reply: tid=0 2024-09-13T15:54:59.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.585+0000 7fdc9fc71740 1 client.24703 shutdown 2024-09-13T15:54:59.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.586+0000 7fdc9fc71740 1 -- 172.21.15.17:0/1826192648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 msgr2=0x5654a0ff3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:59.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.586+0000 7fdc9fc71740 1 --2- 172.21.15.17:0/1826192648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 0x5654a0ff3d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdc90011dd0 tx=0x7fdc90004300 comp rx=0 tx=0).stop 2024-09-13T15:54:59.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.586+0000 7fdc9fc71740 1 -- 172.21.15.17:0/1826192648 shutdown_connections 2024-09-13T15:54:59.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.586+0000 7fdc9fc71740 1 --2- 172.21.15.17:0/1826192648 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5654a0ff8a70 0x5654a0ffcbb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.586+0000 7fdc9fc71740 1 --2- 172.21.15.17:0/1826192648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 0x5654a0ff3d80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.586+0000 7fdc9fc71740 1 --2- 172.21.15.17:0/1826192648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe3470 0x5654a0fecd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.586+0000 7fdc7be00640 0 client.24703 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:54:59.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.586+0000 7fdc9fc71740 1 --2- 172.21.15.17:0/1826192648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654a0fe2b30 0x5654a0fec800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.586+0000 7fdc9fc71740 1 -- 172.21.15.17:0/1826192648 >> 172.21.15.17:0/1826192648 conn(0x5654a0fde1a0 msgr2=0x5654a0fdf9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:59.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.586+0000 7fdc9fc71740 1 -- 172.21.15.17:0/1826192648 shutdown_connections 2024-09-13T15:54:59.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.586+0000 7fdc9fc71740 1 -- 172.21.15.17:0/1826192648 wait complete. 2024-09-13T15:54:59.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.586+0000 7fdc9fc71740 20 client.24703 trim_cache size 0 max 16384 2024-09-13T15:54:59.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.601+0000 7fdc9fc71740 1 Processor -- start 2024-09-13T15:54:59.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.602+0000 7fdc9fc71740 1 -- start start 2024-09-13T15:54:59.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.602+0000 7fdc9fc71740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe2b30 0x5654a0fe2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:59.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.602+0000 7fdc9fc71740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654a0fe3470 0x5654a0ff3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:59.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.602+0000 7fdc9fc71740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 0x5654a0fec5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:59.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.602+0000 7fdc9fc71740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a0c4a6f0 con 0x5654a0fe2b30 2024-09-13T15:54:59.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.602+0000 7fdc9fc71740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a0f3e900 con 0x5654a0fe3470 2024-09-13T15:54:59.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.602+0000 7fdc9fc71740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a0ee12f0 con 0x5654a0fe8500 2024-09-13T15:54:59.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.602+0000 7fdc95e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe2b30 0x5654a0fe2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:59.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.602+0000 7fdc95e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe2b30 0x5654a0fe2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53508/0 (socket says 172.21.15.17:53508) 2024-09-13T15:54:59.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.602+0000 7fdc95e00640 1 -- 172.21.15.17:0/1296578461 learned_addr learned my addr 172.21.15.17:0/1296578461 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:59.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.602+0000 7fdc96800640 1 --2- 172.21.15.17:0/1296578461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 0x5654a0fec5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:59.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.602+0000 7fdc8d400640 1 --2- 172.21.15.17:0/1296578461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654a0fe3470 0x5654a0ff3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:59.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.602+0000 7fdc95e00640 1 -- 172.21.15.17:0/1296578461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 msgr2=0x5654a0fec5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:54:59.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.602+0000 7fdc95e00640 1 --2- 172.21.15.17:0/1296578461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 0x5654a0fec5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.602+0000 7fdc95e00640 1 -- 172.21.15.17:0/1296578461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654a0fe3470 msgr2=0x5654a0ff3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:54:59.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.602+0000 7fdc95e00640 1 --2- 172.21.15.17:0/1296578461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654a0fe3470 0x5654a0ff3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.602+0000 7fdc95e00640 1 -- 172.21.15.17:0/1296578461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654a0ee6470 con 0x5654a0fe2b30 2024-09-13T15:54:59.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.602+0000 7fdc8d400640 1 --2- 172.21.15.17:0/1296578461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654a0fe3470 0x5654a0ff3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:54:59.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.603+0000 7fdc95e00640 1 --2- 172.21.15.17:0/1296578461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe2b30 0x5654a0fe2f10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdc8802aa70 tx=0x7fdc880ba6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6309423d5d940a76 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:59.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.603+0000 7fdc87e00640 1 -- 172.21.15.17:0/1296578461 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc880beab0 con 0x5654a0fe2b30 2024-09-13T15:54:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.603+0000 7fdc87e00640 1 -- 172.21.15.17:0/1296578461 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc880c3100 con 0x5654a0fe2b30 2024-09-13T15:54:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.603+0000 7fdc87e00640 1 -- 172.21.15.17:0/1296578461 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc880ba170 con 0x5654a0fe2b30 2024-09-13T15:54:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.603+0000 7fdc9fc71740 1 -- 172.21.15.17:0/1296578461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe2b30 msgr2=0x5654a0fe2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.603+0000 7fdc9fc71740 1 --2- 172.21.15.17:0/1296578461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe2b30 0x5654a0fe2f10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdc8802aa70 tx=0x7fdc880ba6a0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.604+0000 7fdc9fc71740 1 -- 172.21.15.17:0/1296578461 shutdown_connections 2024-09-13T15:54:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.604+0000 7fdc9fc71740 1 --2- 172.21.15.17:0/1296578461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 0x5654a0fec5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.604+0000 7fdc9fc71740 1 --2- 172.21.15.17:0/1296578461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654a0fe3470 0x5654a0ff3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.604+0000 7fdc9fc71740 1 --2- 172.21.15.17:0/1296578461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe2b30 0x5654a0fe2f10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.604+0000 7fdc9fc71740 1 -- 172.21.15.17:0/1296578461 >> 172.21.15.17:0/1296578461 conn(0x5654a0fde1a0 msgr2=0x5654a0fe4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.604+0000 7fdc9fc71740 1 -- 172.21.15.17:0/1296578461 shutdown_connections 2024-09-13T15:54:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.604+0000 7fdc9fc71740 1 -- 172.21.15.17:0/1296578461 wait complete. 2024-09-13T15:54:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.604+0000 7fdc9fc71740 1 -- start start 2024-09-13T15:54:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.604+0000 7fdc9fc71740 1 Processor -- start 2024-09-13T15:54:59.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.605+0000 7fdc9fc71740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654a0fe2b30 0x5654a0fee910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:59.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.605+0000 7fdc9fc71740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe3470 0x5654a0feee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:59.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.605+0000 7fdc9fc71740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 0x5654a104e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:59.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.605+0000 7fdc9fc71740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a0ff3d90 con 0x5654a0fe3470 2024-09-13T15:54:59.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.605+0000 7fdc9fc71740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a0ff3f00 con 0x5654a0fe2b30 2024-09-13T15:54:59.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.605+0000 7fdc9fc71740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a0ff40c0 con 0x5654a0fe8500 2024-09-13T15:54:59.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.605+0000 7fdc9fc71740 10 client.0 _ll_register_callbacks cb 0x7fdc90009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:54:59.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.605+0000 7fdc8d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe3470 0x5654a0feee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:59.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.605+0000 7fdc8d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe3470 0x5654a0feee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53520/0 (socket says 172.21.15.17:53520) 2024-09-13T15:54:59.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.605+0000 7fdc8d400640 1 -- 172.21.15.17:0/470281962 learned_addr learned my addr 172.21.15.17:0/470281962 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:54:59.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.605+0000 7fdc96800640 1 --2- 172.21.15.17:0/470281962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 0x5654a104e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:59.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.605+0000 7fdc95e00640 1 --2- 172.21.15.17:0/470281962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654a0fe2b30 0x5654a0fee910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:59.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.605+0000 7fdc8d400640 1 -- 172.21.15.17:0/470281962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 msgr2=0x5654a104e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:54:59.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.605+0000 7fdc8d400640 1 --2- 172.21.15.17:0/470281962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 0x5654a104e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.605+0000 7fdc8d400640 1 -- 172.21.15.17:0/470281962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654a0fe2b30 msgr2=0x5654a0fee910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:54:59.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.605+0000 7fdc8d400640 1 --2- 172.21.15.17:0/470281962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654a0fe2b30 0x5654a0fee910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.605+0000 7fdc8d400640 1 -- 172.21.15.17:0/470281962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc981a03e0 con 0x5654a0fe3470 2024-09-13T15:54:59.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.605+0000 7fdc96800640 1 --2- 172.21.15.17:0/470281962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 0x5654a104e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:54:59.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.605+0000 7fdc95e00640 1 --2- 172.21.15.17:0/470281962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654a0fe2b30 0x5654a0fee910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:54:59.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.606+0000 7fdc8d400640 1 --2- 172.21.15.17:0/470281962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe3470 0x5654a0feee50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdc80009940 tx=0x7fdc800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f1046440ed19f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:54:59.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.606+0000 7fdc7be00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T15:54:59.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.606+0000 7fdc7be00640 1 -- 172.21.15.17:0/470281962 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc80023040 con 0x5654a0fe3470 2024-09-13T15:54:59.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.606+0000 7fdc9fc71740 1 -- 172.21.15.17:0/470281962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654a0f6fcd0 con 0x5654a0fe3470 2024-09-13T15:54:59.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.606+0000 7fdc7be00640 1 -- 172.21.15.17:0/470281962 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fdc80011e70 con 0x5654a0fe3470 2024-09-13T15:54:59.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.606+0000 7fdc7be00640 1 -- 172.21.15.17:0/470281962 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc8002e430 con 0x5654a0fe3470 2024-09-13T15:54:59.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.606+0000 7fdc9fc71740 10 client.14652 fetch_fsmap learned FSMap version 17 2024-09-13T15:54:59.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.606+0000 7fdc9fc71740 1 -- 172.21.15.17:0/470281962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x5654a0f0b980 con 0x5654a0fe3470 2024-09-13T15:54:59.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.606+0000 7fdc7be00640 1 -- 172.21.15.17:0/470281962 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5654a0f6fcd0 con 0x5654a0fe3470 2024-09-13T15:54:59.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.607+0000 7fdc7be00640 1 -- 172.21.15.17:0/470281962 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 17) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fdc80027560 con 0x5654a0fe3470 2024-09-13T15:54:59.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.607+0000 7fdc9fc71740 10 client.14652 fetch_fsmap finished waiting for FSMap version 17 2024-09-13T15:54:59.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.607+0000 7fdc9fc71740 10 client.14652 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T15:54:59.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.607+0000 7fdc9fc71740 20 client.14652 populate_metadata read hostname 'smithi017' 2024-09-13T15:54:59.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.607+0000 7fdc9fc71740 1 --2- 172.21.15.17:0/470281962 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5654a1053a30 0x5654a1050380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:54:59.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.607+0000 7fdc9fc71740 4 client.14652 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:54:59.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.607+0000 7fdc9fc71740 1 -- 172.21.15.17:0/470281962 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5654a0c9dd10 con 0x5654a1053a30 2024-09-13T15:54:59.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.607+0000 7fdc95e00640 1 --2- 172.21.15.17:0/470281962 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5654a1053a30 0x5654a1050380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:54:59.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.607+0000 7fdc95e00640 1 --2- 172.21.15.17:0/470281962 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5654a1053a30 0x5654a1050380 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69f9eb7505bca3c5 server_cookie=f10da2dba84b2f58 in_seq=0 out_seq=0 2024-09-13T15:54:59.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.608+0000 7fdc7be00640 10 client.14652 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:54:59.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.608+0000 7fdc7be00640 1 -- 172.21.15.17:0/470281962 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5654a0c9dd10 con 0x5654a1053a30 2024-09-13T15:54:59.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.608+0000 7fdc7be00640 10 client.14652 handle_command_reply: tid=0 2024-09-13T15:54:59.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.608+0000 7fdc9fc71740 1 client.14652 shutdown 2024-09-13T15:54:59.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.608+0000 7fdc9fc71740 1 -- 172.21.15.17:0/470281962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe3470 msgr2=0x5654a0feee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:59.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.608+0000 7fdc9fc71740 1 --2- 172.21.15.17:0/470281962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe3470 0x5654a0feee50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdc80009940 tx=0x7fdc800046c0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.608+0000 7fdc9fc71740 1 -- 172.21.15.17:0/470281962 shutdown_connections 2024-09-13T15:54:59.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.608+0000 7fdc9fc71740 1 --2- 172.21.15.17:0/470281962 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5654a1053a30 0x5654a1050380 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.608+0000 7fdc9fc71740 1 --2- 172.21.15.17:0/470281962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5654a0fe8500 0x5654a104e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.608+0000 7fdc7be00640 0 client.14652 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:54:59.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.608+0000 7fdc9fc71740 1 --2- 172.21.15.17:0/470281962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654a0fe3470 0x5654a0feee50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.608+0000 7fdc9fc71740 1 --2- 172.21.15.17:0/470281962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654a0fe2b30 0x5654a0fee910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.608+0000 7fdc9fc71740 1 -- 172.21.15.17:0/470281962 >> 172.21.15.17:0/470281962 conn(0x5654a0fde1a0 msgr2=0x5654a0fec5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:59.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.608+0000 7fdc9fc71740 1 -- 172.21.15.17:0/470281962 shutdown_connections 2024-09-13T15:54:59.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.608+0000 7fdc9fc71740 1 -- 172.21.15.17:0/470281962 wait complete. 2024-09-13T15:54:59.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.608+0000 7fdc9fc71740 20 client.14652 trim_cache size 0 max 16384 2024-09-13T15:54:59.618 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-13T15:54:59.618 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "3334a620-71e7-11ef-bceb-c7b262605968", 2024-09-13T15:54:59.618 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-13T15:54:59.618 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24578, 2024-09-13T15:54:59.618 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-13T15:54:59.618 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-13T15:54:59.618 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-13T15:54:59.619 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 6.6761654300000002, 2024-09-13T15:54:59.619 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 17, 2024-09-13T15:54:59.619 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 90, 2024-09-13T15:54:59.619 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 89, 2024-09-13T15:54:59.619 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 12.006324687999999 2024-09-13T15:54:59.619 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-13T15:54:59.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.609+0000 7fdc9ce00640 1 -- 172.21.15.17:0/744664290 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdc7c0a1020 msgr2=0x7fdc7c0a34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:59.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.609+0000 7fdc9ce00640 1 --2- 172.21.15.17:0/744664290 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdc7c0a1020 0x7fdc7c0a34e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x5654a0fdf020 tx=0x7fdc80005f90 comp rx=0 tx=0).stop 2024-09-13T15:54:59.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.609+0000 7fdc9ce00640 1 -- 172.21.15.17:0/744664290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc98072e90 msgr2=0x7fdc98197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:54:59.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.609+0000 7fdc9ce00640 1 --2- 172.21.15.17:0/744664290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc98072e90 0x7fdc98197f20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009a20 tx=0x7fdc88005620 comp rx=0 tx=0).stop 2024-09-13T15:54:59.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.609+0000 7fdc9ce00640 1 -- 172.21.15.17:0/744664290 shutdown_connections 2024-09-13T15:54:59.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.609+0000 7fdc9ce00640 1 --2- 172.21.15.17:0/744664290 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdc7c0a1020 0x7fdc7c0a34e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.609+0000 7fdc9ce00640 1 --2- 172.21.15.17:0/744664290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc98107c10 0x7fdc9819f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.609+0000 7fdc9ce00640 1 --2- 172.21.15.17:0/744664290 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc98074470 0x7fdc98198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.609+0000 7fdc9ce00640 1 --2- 172.21.15.17:0/744664290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc98072e90 0x7fdc98197f20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:54:59.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.609+0000 7fdc9ce00640 1 -- 172.21.15.17:0/744664290 >> 172.21.15.17:0/744664290 conn(0x7fdc980fb4c0 msgr2=0x7fdc98103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:54:59.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.609+0000 7fdc9ce00640 1 -- 172.21.15.17:0/744664290 shutdown_connections 2024-09-13T15:54:59.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:54:59.609+0000 7fdc9ce00640 1 -- 172.21.15.17:0/744664290 wait complete. 2024-09-13T15:54:59.626 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T15:54:59.627 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:54:59.627 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T15:54:59.947 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:55:00.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:59 smithi193 ceph-mon[35248]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T15:55:00.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:59 smithi193 ceph-mon[35248]: Cluster is now healthy 2024-09-13T15:55:00.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:59 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/4009008992' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:55:00.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:54:59 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3176619261' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:00.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:59 smithi017 ceph-mon[30494]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T15:55:00.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:59 smithi017 ceph-mon[30494]: Cluster is now healthy 2024-09-13T15:55:00.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:59 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/4009008992' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:55:00.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:54:59 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3176619261' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:00.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:59 smithi189 ceph-mon[34790]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T15:55:00.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:59 smithi189 ceph-mon[34790]: Cluster is now healthy 2024-09-13T15:55:00.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:59 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/4009008992' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:55:00.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:54:59 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3176619261' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:01.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:00 smithi193 ceph-mon[35248]: pgmap v299: 129 pgs: 4 creating+peering, 7 unknown, 118 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 788 B/s wr, 6 op/s 2024-09-13T15:55:01.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:00 smithi017 ceph-mon[30494]: pgmap v299: 129 pgs: 4 creating+peering, 7 unknown, 118 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 788 B/s wr, 6 op/s 2024-09-13T15:55:01.358 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:00 smithi189 ceph-mon[34790]: pgmap v299: 129 pgs: 4 creating+peering, 7 unknown, 118 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 788 B/s wr, 6 op/s 2024-09-13T15:55:01.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.981+0000 7f5327200640 1 -- 172.21.15.17:0/2515659366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53280ff330 msgr2=0x7f532810bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:01.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.981+0000 7f5327200640 1 --2- 172.21.15.17:0/2515659366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53280ff330 0x7f532810bff0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5314009900 tx=0x7f531402a410 comp rx=0 tx=0).stop 2024-09-13T15:55:01.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.981+0000 7f5327200640 1 -- 172.21.15.17:0/2515659366 shutdown_connections 2024-09-13T15:55:01.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.981+0000 7f5327200640 1 --2- 172.21.15.17:0/2515659366 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f532810c530 0x7f532810e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:01.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.981+0000 7f5327200640 1 --2- 172.21.15.17:0/2515659366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53280ff330 0x7f532810bff0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:01.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.981+0000 7f5327200640 1 --2- 172.21.15.17:0/2515659366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f53280fe980 0x7f53280fed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:01.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.981+0000 7f5327200640 1 -- 172.21.15.17:0/2515659366 >> 172.21.15.17:0/2515659366 conn(0x7f53280fa830 msgr2=0x7f53280fcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:01.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.981+0000 7f5327200640 1 -- 172.21.15.17:0/2515659366 shutdown_connections 2024-09-13T15:55:01.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.981+0000 7f5327200640 1 -- 172.21.15.17:0/2515659366 wait complete. 2024-09-13T15:55:01.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.983+0000 7f5327200640 1 Processor -- start 2024-09-13T15:55:01.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.983+0000 7f5327200640 1 -- start start 2024-09-13T15:55:01.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.983+0000 7f5327200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53280fe980 0x7f5328198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:01.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.983+0000 7f5327200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53280ff330 0x7f53281988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:01.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.983+0000 7f5327200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f532810c530 0x7f532819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:01.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.983+0000 7f5327200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532819d260 con 0x7f53280fe980 2024-09-13T15:55:01.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.983+0000 7f5327200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532819d3d0 con 0x7f53280ff330 2024-09-13T15:55:01.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.983+0000 7f5327200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532819d540 con 0x7f532810c530 2024-09-13T15:55:01.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.984+0000 7f5325e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53280fe980 0x7f5328198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:01.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.984+0000 7f5325e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53280fe980 0x7f5328198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53546/0 (socket says 172.21.15.17:53546) 2024-09-13T15:55:01.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.984+0000 7f5325e00640 1 -- 172.21.15.17:0/1052580018 learned_addr learned my addr 172.21.15.17:0/1052580018 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:01.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.984+0000 7f5326800640 1 --2- 172.21.15.17:0/1052580018 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f532810c530 0x7f532819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:01.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.984+0000 7f5325400640 1 --2- 172.21.15.17:0/1052580018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53280ff330 0x7f53281988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:01.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.984+0000 7f5325e00640 1 -- 172.21.15.17:0/1052580018 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f532810c530 msgr2=0x7f532819cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:01.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.984+0000 7f5325e00640 1 --2- 172.21.15.17:0/1052580018 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f532810c530 0x7f532819cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:01.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.984+0000 7f5325e00640 1 -- 172.21.15.17:0/1052580018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53280ff330 msgr2=0x7f53281988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:01.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.984+0000 7f5325e00640 1 --2- 172.21.15.17:0/1052580018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53280ff330 0x7f53281988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:01.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.984+0000 7f5325e00640 1 -- 172.21.15.17:0/1052580018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5314009560 con 0x7f53280fe980 2024-09-13T15:55:01.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.984+0000 7f5325e00640 1 --2- 172.21.15.17:0/1052580018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53280fe980 0x7f5328198390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f531800e9f0 tx=0x7f531800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:01.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.985+0000 7f531ea00640 1 -- 172.21.15.17:0/1052580018 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318009720 con 0x7f53280fe980 2024-09-13T15:55:01.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.985+0000 7f531ea00640 1 -- 172.21.15.17:0/1052580018 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f531800cd80 con 0x7f53280fe980 2024-09-13T15:55:01.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.985+0000 7f531ea00640 1 -- 172.21.15.17:0/1052580018 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318010430 con 0x7f53280fe980 2024-09-13T15:55:01.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.985+0000 7f5327200640 1 -- 172.21.15.17:0/1052580018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f532819d820 con 0x7f53280fe980 2024-09-13T15:55:01.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.985+0000 7f5327200640 1 -- 172.21.15.17:0/1052580018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f532819dad0 con 0x7f53280fe980 2024-09-13T15:55:01.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.986+0000 7f5327200640 1 -- 172.21.15.17:0/1052580018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5328068760 con 0x7f53280fe980 2024-09-13T15:55:01.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.988+0000 7f531ea00640 1 -- 172.21.15.17:0/1052580018 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5318005020 con 0x7f53280fe980 2024-09-13T15:55:01.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.989+0000 7f531ea00640 1 --2- 172.21.15.17:0/1052580018 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f530c0a10f0 0x7f530c0a35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:01.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.989+0000 7f531ea00640 1 -- 172.21.15.17:0/1052580018 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f5318014070 con 0x7f53280fe980 2024-09-13T15:55:01.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.990+0000 7f5325400640 1 --2- 172.21.15.17:0/1052580018 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f530c0a10f0 0x7f530c0a35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:01.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.990+0000 7f5325400640 1 --2- 172.21.15.17:0/1052580018 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f530c0a10f0 0x7f530c0a35b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5314005ab0 tx=0x7f5314005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:01.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:01.994+0000 7f531ea00640 1 -- 172.21.15.17:0/1052580018 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f53180961e0 con 0x7f53280fe980 2024-09-13T15:55:02.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:02.215+0000 7f5327200640 1 -- 172.21.15.17:0/1052580018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5328107750 con 0x7f53280fe980 2024-09-13T15:55:02.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:02.216+0000 7f531ea00640 1 -- 172.21.15.17:0/1052580018 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5328107750 con 0x7f53280fe980 2024-09-13T15:55:02.217 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T15:55:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:02.218+0000 7f5327200640 1 -- 172.21.15.17:0/1052580018 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f530c0a10f0 msgr2=0x7f530c0a35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:02.218+0000 7f5327200640 1 --2- 172.21.15.17:0/1052580018 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f530c0a10f0 0x7f530c0a35b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5314005ab0 tx=0x7f5314005a20 comp rx=0 tx=0).stop 2024-09-13T15:55:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:02.218+0000 7f5327200640 1 -- 172.21.15.17:0/1052580018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53280fe980 msgr2=0x7f5328198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:02.218+0000 7f5327200640 1 --2- 172.21.15.17:0/1052580018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53280fe980 0x7f5328198390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f531800e9f0 tx=0x7f531800edf0 comp rx=0 tx=0).stop 2024-09-13T15:55:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:02.218+0000 7f5327200640 1 -- 172.21.15.17:0/1052580018 shutdown_connections 2024-09-13T15:55:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:02.218+0000 7f5327200640 1 --2- 172.21.15.17:0/1052580018 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f530c0a10f0 0x7f530c0a35b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:02.218+0000 7f5327200640 1 --2- 172.21.15.17:0/1052580018 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f532810c530 0x7f532819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:02.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:02.218+0000 7f5327200640 1 --2- 172.21.15.17:0/1052580018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53280ff330 0x7f53281988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:02.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:02.218+0000 7f5327200640 1 --2- 172.21.15.17:0/1052580018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53280fe980 0x7f5328198390 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:02.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:02.218+0000 7f5327200640 1 -- 172.21.15.17:0/1052580018 >> 172.21.15.17:0/1052580018 conn(0x7f53280fa830 msgr2=0x7f53280fcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:02.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:02.218+0000 7f5327200640 1 -- 172.21.15.17:0/1052580018 shutdown_connections 2024-09-13T15:55:02.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:02.218+0000 7f5327200640 1 -- 172.21.15.17:0/1052580018 wait complete. 2024-09-13T15:55:02.896 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T15:55:02.897 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:55:02.897 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-13T15:55:02.897 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-13T15:55:02.897 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:55:02.897 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T15:55:02.897 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T15:55:02.897 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:55:02.897 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T15:55:02.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:55:02.897 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-13T15:55:02.935 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:55:02.935 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:55:02.935 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:55:02.935 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:55:02.935 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-13T15:55:02.935 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:55:02.935 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T15:55:02.936 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:55:02.936 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-13T15:55:02.936 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T15:55:02.936 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:55:02.936 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-13T15:55:02.936 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:55:02.936 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:55:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-13T15:55:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T15:55:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42203sec preferred_lft 42203sec 2024-09-13T15:55:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-13T15:55:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:55:02.937 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T15:55:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:55:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-13T15:55:02.938 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T15:55:02.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:55:02.939 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-09-13T15:55:02.939 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-13T15:55:02.939 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add name ceph-brx type bridge 2024-09-13T15:55:02.939 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr flush dev ceph-brx 2024-09-13T15:55:02.939 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set ceph-brx up 2024-09-13T15:55:02.940 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T15:55:02.940 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-13T15:55:03.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:55:03.350 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:55:03.407 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-13T15:55:03.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:55:03.410 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-13T15:55:03.452 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-13T15:55:03.453 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:55:03.453 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T15:55:03.453 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T15:55:03.453 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:55:03.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:55:03.453 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-09-13T15:55:03.453 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-13T15:55:03.454 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T15:55:03.454 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T15:55:03.454 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T15:55:03.454 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-13T15:55:03.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:03 smithi193 ceph-mon[35248]: pgmap v300: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 165 B/s wr, 3 op/s 2024-09-13T15:55:03.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:03 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1052580018' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T15:55:03.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:03 smithi017 ceph-mon[30494]: pgmap v300: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 165 B/s wr, 3 op/s 2024-09-13T15:55:03.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:03 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1052580018' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T15:55:03.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:03 smithi189 ceph-mon[34790]: pgmap v300: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 165 B/s wr, 3 op/s 2024-09-13T15:55:03.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:03 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1052580018' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T15:55:04.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:55:04.016 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-13T15:55:04.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:55:04.094 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2024-09-13T15:55:04.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:55:04.170 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-09-13T15:55:04.170 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-13T15:55:04.170 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T15:55:04.170 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-13T15:55:04.170 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-13T15:55:04.295 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-13T15:55:04.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:55:04.295 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-09-13T15:55:04.296 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-13T15:55:04.296 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-13T15:55:04.296 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T15:55:04.296 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-13T15:55:04.296 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-13T15:55:04.296 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-13T15:55:04.297 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-13T15:55:04.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:55:04.483 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-09-13T15:55:04.484 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-13T15:55:04.484 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-13T15:55:04.484 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T15:55:04.484 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-13T15:55:04.599 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-13T15:55:04.600 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:55:04.600 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:55:04.635 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T15:55:04.635 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:55:04.635 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:55:04.711 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-13T15:55:04.809 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T15:55:04.809 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T15:55:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T15:55:04.866 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T15:55:04.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:55:04.867 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-13T15:55:04.901 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T15:55:04.902 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-13T15:55:04.946 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-13T15:55:05.006 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T15:55:05.007 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T15:55:05.062 INFO:teuthology.orchestra.run.smithi017.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T15:55:05.064 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T15:55:05.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:55:05.065 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-13T15:55:05.116 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi017.stderr:2024-09-13T15:55:05.115+0000 7fea25535480 -1 init, newargv = 0x55ceb68798d0 newargc=15 2024-09-13T15:55:05.117 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi017.stderr:ceph-fuse[74589]: starting ceph client 2024-09-13T15:55:05.126 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi017.stderr:ceph-fuse[74589]: starting fuse 2024-09-13T15:55:05.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:05 smithi193 ceph-mon[35248]: pgmap v301: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 2 op/s 2024-09-13T15:55:05.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:05 smithi017 ceph-mon[30494]: pgmap v301: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 2 op/s 2024-09-13T15:55:05.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:05 smithi189 ceph-mon[34790]: pgmap v301: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 2 op/s 2024-09-13T15:55:06.204 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-13T15:55:06.268 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T15:55:06.268 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T15:55:06.324 INFO:teuthology.orchestra.run.smithi017.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T15:55:06.327 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T15:55:06.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:55:06.327 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-13T15:55:06.363 INFO:teuthology.orchestra.run.smithi017.stdout:120 2024-09-13T15:55:06.364 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-13T15:55:06.366 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T15:55:06.366 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-13T15:55:06.366 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-13T15:55:06.366 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-13T15:55:06.366 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-13T15:55:06.366 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-13T15:55:06.367 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-13T15:55:06.367 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-13T15:55:06.367 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-13T15:55:06.367 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-13T15:55:06.367 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-13T15:55:06.367 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-13T15:55:06.367 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-13T15:55:06.367 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-13T15:55:06.367 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-13T15:55:06.367 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-13T15:55:06.367 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-13T15:55:06.367 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T15:55:06.367 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T15:55:06.367 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T15:55:06.368 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-13T15:55:06.368 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-13T15:55:06.368 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-13T15:55:06.368 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T15:55:06.368 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-13T15:55:06.368 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.admin")) 2024-09-13T15:55:06.368 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-13T15:55:06.527 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.admin.74589.asok 2024-09-13T15:55:06.711 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.74589.asok 2024-09-13T15:55:06.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:55:06.711 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.74589.asok status 2024-09-13T15:55:06.898 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-13T15:55:06.898 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-13T15:55:06.899 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "50bbe7f395997dcd871813949c49addbbf630361", 2024-09-13T15:55:06.899 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable)", 2024-09-13T15:55:06.899 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "admin", 2024-09-13T15:55:06.899 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-13T15:55:06.899 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-13T15:55:06.899 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "74589", 2024-09-13T15:55:06.899 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-13T15:55:06.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T15:55:06.899 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-13T15:55:06.899 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-13T15:55:06.899 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 14664, 2024-09-13T15:55:06.899 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-13T15:55:06.899 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-13T15:55:06.899 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-13T15:55:06.900 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 14664 2024-09-13T15:55:06.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T15:55:06.900 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-13T15:55:06.900 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-13T15:55:06.900 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-13T15:55:06.900 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1919017145 2024-09-13T15:55:06.900 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T15:55:06.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T15:55:06.900 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-13T15:55:06.900 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-13T15:55:06.900 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-13T15:55:06.900 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1919017145 2024-09-13T15:55:06.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T15:55:06.900 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.14664 192.168.0.1:0/1919017145", 2024-09-13T15:55:06.901 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/1919017145", 2024-09-13T15:55:06.901 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-13T15:55:06.901 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 17, 2024-09-13T15:55:06.901 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 90, 2024-09-13T15:55:06.901 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-13T15:55:06.901 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-13T15:55:06.901 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-13T15:55:06.901 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-13T15:55:06.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:55:06.910 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-13T15:55:06.910 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:55:06.946 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-13T15:55:06.947 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:55:06.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:55:06.947 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:55:07.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:55:07.044 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-13T15:55:07.099 INFO:teuthology.orchestra.run.smithi017.stdout:# file: . 2024-09-13T15:55:07.100 INFO:teuthology.orchestra.run.smithi017.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-13T15:55:07.100 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:55:07.101 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T15:55:07.101 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:55:07.140 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:55:07.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.335+0000 7fce03a00640 1 -- 172.21.15.17:0/2125812082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdfc103180 msgr2=0x7fcdfc103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:07.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.335+0000 7fce03a00640 1 --2- 172.21.15.17:0/2125812082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdfc103180 0x7fcdfc103600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcde8009900 tx=0x7fcde802a3f0 comp rx=0 tx=0).stop 2024-09-13T15:55:07.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.335+0000 7fce03a00640 1 -- 172.21.15.17:0/2125812082 shutdown_connections 2024-09-13T15:55:07.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.335+0000 7fce03a00640 1 --2- 172.21.15.17:0/2125812082 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdfc103b40 0x7fcdfc10a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:07.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.335+0000 7fce03a00640 1 --2- 172.21.15.17:0/2125812082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdfc103180 0x7fcdfc103600 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:07.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.335+0000 7fce03a00640 1 --2- 172.21.15.17:0/2125812082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdfc101f90 0x7fcdfc102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:07.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.335+0000 7fce03a00640 1 -- 172.21.15.17:0/2125812082 >> 172.21.15.17:0/2125812082 conn(0x7fcdfc0fd730 msgr2=0x7fcdfc0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:07.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.335+0000 7fce03a00640 1 -- 172.21.15.17:0/2125812082 shutdown_connections 2024-09-13T15:55:07.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.335+0000 7fce03a00640 1 -- 172.21.15.17:0/2125812082 wait complete. 2024-09-13T15:55:07.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.336+0000 7fce03a00640 1 Processor -- start 2024-09-13T15:55:07.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.336+0000 7fce03a00640 1 -- start start 2024-09-13T15:55:07.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.337+0000 7fce03a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdfc101f90 0x7fcdfc197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:07.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.337+0000 7fce03a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdfc103180 0x7fcdfc1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:07.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.337+0000 7fce03a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdfc103b40 0x7fcdfc19f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:07.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.337+0000 7fce03a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc19fa50 con 0x7fcdfc103b40 2024-09-13T15:55:07.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.337+0000 7fce03a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc19fbc0 con 0x7fcdfc103180 2024-09-13T15:55:07.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.337+0000 7fce03a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc19fd80 con 0x7fcdfc101f90 2024-09-13T15:55:07.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.337+0000 7fce01a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdfc103b40 0x7fcdfc19f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:07.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.337+0000 7fce01a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdfc103b40 0x7fcdfc19f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53560/0 (socket says 172.21.15.17:53560) 2024-09-13T15:55:07.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.337+0000 7fce01a00640 1 -- 172.21.15.17:0/1742950489 learned_addr learned my addr 172.21.15.17:0/1742950489 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:07.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.337+0000 7fcdfbe00640 1 --2- 172.21.15.17:0/1742950489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdfc103180 0x7fcdfc1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:07.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.337+0000 7fce01000640 1 --2- 172.21.15.17:0/1742950489 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdfc101f90 0x7fcdfc197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:07.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.337+0000 7fce01a00640 1 -- 172.21.15.17:0/1742950489 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdfc101f90 msgr2=0x7fcdfc197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:07.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.337+0000 7fce01a00640 1 --2- 172.21.15.17:0/1742950489 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdfc101f90 0x7fcdfc197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:07.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.337+0000 7fce01a00640 1 -- 172.21.15.17:0/1742950489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdfc103180 msgr2=0x7fcdfc1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:07.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.337+0000 7fce01a00640 1 --2- 172.21.15.17:0/1742950489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdfc103180 0x7fcdfc1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:07.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.337+0000 7fce01a00640 1 -- 172.21.15.17:0/1742950489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde8009560 con 0x7fcdfc103b40 2024-09-13T15:55:07.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.338+0000 7fce01a00640 1 --2- 172.21.15.17:0/1742950489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdfc103b40 0x7fcdfc19f510 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400eb10 tx=0x7fcdf400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:07.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.338+0000 7fcdf9600640 1 -- 172.21.15.17:0/1742950489 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4004b20 con 0x7fcdfc103b40 2024-09-13T15:55:07.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.338+0000 7fcdf9600640 1 -- 172.21.15.17:0/1742950489 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcdf4004c80 con 0x7fcdfc103b40 2024-09-13T15:55:07.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.338+0000 7fcdf9600640 1 -- 172.21.15.17:0/1742950489 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4010690 con 0x7fcdfc103b40 2024-09-13T15:55:07.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.338+0000 7fce03a00640 1 -- 172.21.15.17:0/1742950489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdfc1a0060 con 0x7fcdfc103b40 2024-09-13T15:55:07.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.338+0000 7fce03a00640 1 -- 172.21.15.17:0/1742950489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdfc1a04f0 con 0x7fcdfc103b40 2024-09-13T15:55:07.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.339+0000 7fce03a00640 1 -- 172.21.15.17:0/1742950489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdfc109440 con 0x7fcdfc103b40 2024-09-13T15:55:07.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.341+0000 7fcdf9600640 1 -- 172.21.15.17:0/1742950489 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fcdf4005020 con 0x7fcdfc103b40 2024-09-13T15:55:07.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.343+0000 7fcdf9600640 1 --2- 172.21.15.17:0/1742950489 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcde40a1090 0x7fcde40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:07.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.343+0000 7fcdf9600640 1 -- 172.21.15.17:0/1742950489 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fcdf4014070 con 0x7fcdfc103b40 2024-09-13T15:55:07.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.343+0000 7fce01000640 1 --2- 172.21.15.17:0/1742950489 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcde40a1090 0x7fcde40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:07.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.343+0000 7fce01000640 1 --2- 172.21.15.17:0/1742950489 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcde40a1090 0x7fcde40a3550 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc102fe0 tx=0x7fcdf0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:07.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.347+0000 7fcdf9600640 1 -- 172.21.15.17:0/1742950489 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcdf40965e0 con 0x7fcdfc103b40 2024-09-13T15:55:07.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:07 smithi193 ceph-mon[35248]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 111 B/s wr, 0 op/s 2024-09-13T15:55:07.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:07 smithi017 ceph-mon[30494]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 111 B/s wr, 0 op/s 2024-09-13T15:55:07.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.530+0000 7fce03a00640 1 -- 172.21.15.17:0/1742950489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdfc108eb0 con 0x7fcdfc103b40 2024-09-13T15:55:07.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.531+0000 7fcdf9600640 1 -- 172.21.15.17:0/1742950489 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23935 (secure 0 0 0) 0x7fcdf4099c00 con 0x7fcdfc103b40 2024-09-13T15:55:07.533 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:55:07.533 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":90,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","created":"2024-09-13T15:46:50.475750+0000","modified":"2024-09-13T15:54:57.383548+0000","last_up_change":"2024-09-13T15:53:59.138985+0000","last_in_change":"2024-09-13T15:53:39.220264+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:50:10.657011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:54:51.436469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:54:52.427930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:54:55.478058+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5d39d6af-15e6-463b-b9ff-a9a5dd94e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6803","nonce":158651212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6805","nonce":158651212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6809","nonce":158651212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6807","nonce":158651212}]},"public_addr":"172.21.15.17:6803/158651212","cluster_addr":"172.21.15.17:6805/158651212","heartbeat_back_addr":"172.21.15.17:6809/158651212","heartbeat_front_addr":"172.21.15.17:6807/158651212","state":["exists","up"]},{"osd":1,"uuid":"0da621c7-645b-44ae-ba7c-a573861c3aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6801","nonce":964319421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6803","nonce":964319421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6807","nonce":964319421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6805","nonce":964319421}]},"public_addr":"172.21.15.189:6801/964319421","cluster_addr":"172.21.15.189:6803/964319421","heartbeat_back_addr":"172.21.15.189:6807/964319421","heartbeat_front_addr":"172.21.15.189:6805/964319421","state":["exists","up"]},{"osd":2,"uuid":"fa95af60-1486-4a29-8c79-8a73a4146552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6801","nonce":138468002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6803","nonce":138468002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6807","nonce":138468002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6805","nonce":138468002}]},"public_addr":"172.21.15.193:6801/138468002","cluster_addr":"172.21.15.193:6803/138468002","heartbeat_back_addr":"172.21.15.193:6807/138468002","heartbeat_front_addr":"172.21.15.193:6805/138468002","state":["exists","up"]},{"osd":3,"uuid":"90428e5f-dfd4-4cda-b240-fdb9079bcb7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6811","nonce":919913803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6813","nonce":919913803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6817","nonce":919913803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6815","nonce":919913803}]},"public_addr":"172.21.15.17:6811/919913803","cluster_addr":"172.21.15.17:6813/919913803","heartbeat_back_addr":"172.21.15.17:6817/919913803","heartbeat_front_addr":"172.21.15.17:6815/919913803","state":["exists","up"]},{"osd":4,"uuid":"e1c537b6-98d2-4b66-b15a-65fe70b0ce25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6809","nonce":2310375565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6811","nonce":2310375565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6815","nonce":2310375565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6813","nonce":2310375565}]},"public_addr":"172.21.15.189:6809/2310375565","cluster_addr":"172.21.15.189:6811/2310375565","heartbeat_back_addr":"172.21.15.189:6815/2310375565","heartbeat_front_addr":"172.21.15.189:6813/2310375565","state":["exists","up"]},{"osd":5,"uuid":"48522fd7-d781-4447-873f-174dabd1e33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6809","nonce":1330877824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6811","nonce":1330877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6815","nonce":1330877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6813","nonce":1330877824}]},"public_addr":"172.21.15.193:6809/1330877824","cluster_addr":"172.21.15.193:6811/1330877824","heartbeat_back_addr":"172.21.15.193:6815/1330877824","heartbeat_front_addr":"172.21.15.193:6813/1330877824","state":["exists","up"]},{"osd":6,"uuid":"47bea191-fb53-40a7-8563-8ebf17dd5bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6819","nonce":3930545382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6821","nonce":3930545382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6825","nonce":3930545382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6823","nonce":3930545382}]},"public_addr":"172.21.15.17:6819/3930545382","cluster_addr":"172.21.15.17:6821/3930545382","heartbeat_back_addr":"172.21.15.17:6825/3930545382","heartbeat_front_addr":"172.21.15.17:6823/3930545382","state":["exists","up"]},{"osd":7,"uuid":"a98f36f9-0a19-4c9a-8ed1-615c4a6e7658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6817","nonce":3691677495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6819","nonce":3691677495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6823","nonce":3691677495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6821","nonce":3691677495}]},"public_addr":"172.21.15.189:6817/3691677495","cluster_addr":"172.21.15.189:6819/3691677495","heartbeat_back_addr":"172.21.15.189:6823/3691677495","heartbeat_front_addr":"172.21.15.189:6821/3691677495","state":["exists","up"]},{"osd":8,"uuid":"7a372d9f-c40f-4ead-87da-2f3a570c1373","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6817","nonce":4112907498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6819","nonce":4112907498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6823","nonce":4112907498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6821","nonce":4112907498}]},"public_addr":"172.21.15.193:6817/4112907498","cluster_addr":"172.21.15.193:6819/4112907498","heartbeat_back_addr":"172.21.15.193:6823/4112907498","heartbeat_front_addr":"172.21.15.193:6821/4112907498","state":["exists","up"]},{"osd":9,"uuid":"ac3d983c-c5e7-456b-8271-7c4e6169de61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6827","nonce":663424274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6829","nonce":663424274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6833","nonce":663424274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6831","nonce":663424274}]},"public_addr":"172.21.15.17:6827/663424274","cluster_addr":"172.21.15.17:6829/663424274","heartbeat_back_addr":"172.21.15.17:6833/663424274","heartbeat_front_addr":"172.21.15.17:6831/663424274","state":["exists","up"]},{"osd":10,"uuid":"08dcae02-6c79-4a06-ae88-6eb6e6941cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6825","nonce":3153990375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6827","nonce":3153990375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6831","nonce":3153990375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6829","nonce":3153990375}]},"public_addr":"172.21.15.189:6825/3153990375","cluster_addr":"172.21.15.189:6827/3153990375","heartbeat_back_addr":"172.21.15.189:6831/3153990375","heartbeat_front_addr":"172.21.15.189:6829/3153990375","state":["exists","up"]},{"osd":11,"uuid":"a4ebcf41-d805-4d44-b112-13ae84d51868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6825","nonce":4088053907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6827","nonce":4088053907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6831","nonce":4088053907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6829","nonce":4088053907}]},"public_addr":"172.21.15.193:6825/4088053907","cluster_addr":"172.21.15.193:6827/4088053907","heartbeat_back_addr":"172.21.15.193:6831/4088053907","heartbeat_front_addr":"172.21.15.193:6829/4088053907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:22.172370+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:44.802224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:06.641435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:34.536515+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:58.789324+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:22.189862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:50.382257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:14.678047+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:38.581105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:07.258150+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:32.261383+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:56.739338+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/1550067038":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/3360683829":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/634066188":"2024-09-14T15:47:42.048005+0000","172.21.15.17:6801/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1945536687":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/2214214377":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1224386591":"2024-09-14T15:47:14.996424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:55:07.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.533+0000 7fce03a00640 1 -- 172.21.15.17:0/1742950489 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcde40a1090 msgr2=0x7fcde40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:07.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.533+0000 7fce03a00640 1 --2- 172.21.15.17:0/1742950489 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcde40a1090 0x7fcde40a3550 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc102fe0 tx=0x7fcdf0005f90 comp rx=0 tx=0).stop 2024-09-13T15:55:07.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.533+0000 7fce03a00640 1 -- 172.21.15.17:0/1742950489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdfc103b40 msgr2=0x7fcdfc19f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:07.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.533+0000 7fce03a00640 1 --2- 172.21.15.17:0/1742950489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdfc103b40 0x7fcdfc19f510 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400eb10 tx=0x7fcdf400c2d0 comp rx=0 tx=0).stop 2024-09-13T15:55:07.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.533+0000 7fce03a00640 1 -- 172.21.15.17:0/1742950489 shutdown_connections 2024-09-13T15:55:07.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.533+0000 7fce03a00640 1 --2- 172.21.15.17:0/1742950489 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcde40a1090 0x7fcde40a3550 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:07.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.533+0000 7fce03a00640 1 --2- 172.21.15.17:0/1742950489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdfc103b40 0x7fcdfc19f510 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:07.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.533+0000 7fce03a00640 1 --2- 172.21.15.17:0/1742950489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdfc103180 0x7fcdfc1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:07.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.533+0000 7fce03a00640 1 --2- 172.21.15.17:0/1742950489 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdfc101f90 0x7fcdfc197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:07.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.533+0000 7fce03a00640 1 -- 172.21.15.17:0/1742950489 >> 172.21.15.17:0/1742950489 conn(0x7fcdfc0fd730 msgr2=0x7fcdfc106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:07.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.533+0000 7fce03a00640 1 -- 172.21.15.17:0/1742950489 shutdown_connections 2024-09-13T15:55:07.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.534+0000 7fce03a00640 1 -- 172.21.15.17:0/1742950489 wait complete. 2024-09-13T15:55:07.551 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:50:10.657011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:54:51.436469+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:54:52.427930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:54:55.478058+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:55:07.551 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:55:07.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:07 smithi189 ceph-mon[34790]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 111 B/s wr, 0 op/s 2024-09-13T15:55:07.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.709+0000 7fa9b0c00640 1 -- 172.21.15.17:0/716513208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9ac0744f0 msgr2=0x7fa9ac072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:07.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.709+0000 7fa9b0c00640 1 --2- 172.21.15.17:0/716513208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9ac0744f0 0x7fa9ac072940 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa99c009900 tx=0x7fa99c02a410 comp rx=0 tx=0).stop 2024-09-13T15:55:07.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.709+0000 7fa9b0c00640 1 -- 172.21.15.17:0/716513208 shutdown_connections 2024-09-13T15:55:07.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.709+0000 7fa9b0c00640 1 --2- 172.21.15.17:0/716513208 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9ac10c340 0x7fa9ac10e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:07.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.709+0000 7fa9b0c00640 1 --2- 172.21.15.17:0/716513208 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9ac072f10 0x7fa9ac073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:07.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.709+0000 7fa9b0c00640 1 --2- 172.21.15.17:0/716513208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9ac0744f0 0x7fa9ac072940 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:07.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.709+0000 7fa9b0c00640 1 -- 172.21.15.17:0/716513208 >> 172.21.15.17:0/716513208 conn(0x7fa9ac0fb4d0 msgr2=0x7fa9ac0fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:07.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.709+0000 7fa9b0c00640 1 -- 172.21.15.17:0/716513208 shutdown_connections 2024-09-13T15:55:07.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.709+0000 7fa9b0c00640 1 -- 172.21.15.17:0/716513208 wait complete. 2024-09-13T15:55:07.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.710+0000 7fa9b0c00640 1 Processor -- start 2024-09-13T15:55:07.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.710+0000 7fa9b0c00640 1 -- start start 2024-09-13T15:55:07.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.710+0000 7fa9b0c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9ac072f10 0x7fa9ac19c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:07.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.710+0000 7fa9b0c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9ac0744f0 0x7fa9ac19c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:07.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.711+0000 7fa9b0c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9ac10c340 0x7fa9ac1a3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:07.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.711+0000 7fa9b0c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ac1a3e90 con 0x7fa9ac10c340 2024-09-13T15:55:07.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.711+0000 7fa9b0c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ac1a4000 con 0x7fa9ac072f10 2024-09-13T15:55:07.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.711+0000 7fa9b0c00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ac1a41c0 con 0x7fa9ac0744f0 2024-09-13T15:55:07.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.711+0000 7fa9aa800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9ac10c340 0x7fa9ac1a3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:07.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.711+0000 7fa9aa800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9ac10c340 0x7fa9ac1a3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53588/0 (socket says 172.21.15.17:53588) 2024-09-13T15:55:07.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.711+0000 7fa9aa800640 1 -- 172.21.15.17:0/3408891847 learned_addr learned my addr 172.21.15.17:0/3408891847 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:07.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.711+0000 7fa9a9e00640 1 --2- 172.21.15.17:0/3408891847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9ac072f10 0x7fa9ac19c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:07.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.711+0000 7fa9a9400640 1 --2- 172.21.15.17:0/3408891847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9ac0744f0 0x7fa9ac19c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:07.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.711+0000 7fa9aa800640 1 -- 172.21.15.17:0/3408891847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9ac0744f0 msgr2=0x7fa9ac19c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:07.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.711+0000 7fa9aa800640 1 --2- 172.21.15.17:0/3408891847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9ac0744f0 0x7fa9ac19c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:07.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.711+0000 7fa9aa800640 1 -- 172.21.15.17:0/3408891847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9ac072f10 msgr2=0x7fa9ac19c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:07.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.711+0000 7fa9aa800640 1 --2- 172.21.15.17:0/3408891847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9ac072f10 0x7fa9ac19c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:07.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.711+0000 7fa9aa800640 1 -- 172.21.15.17:0/3408891847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c009560 con 0x7fa9ac10c340 2024-09-13T15:55:07.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.711+0000 7fa9a9e00640 1 --2- 172.21.15.17:0/3408891847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9ac072f10 0x7fa9ac19c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:55:07.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.712+0000 7fa9aa800640 1 --2- 172.21.15.17:0/3408891847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9ac10c340 0x7fa9ac1a3950 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa9a400eb10 tx=0x7fa9a400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:07.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.712+0000 7fa9a2a00640 1 -- 172.21.15.17:0/3408891847 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4004b20 con 0x7fa9ac10c340 2024-09-13T15:55:07.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.712+0000 7fa9a2a00640 1 -- 172.21.15.17:0/3408891847 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9a4004c80 con 0x7fa9ac10c340 2024-09-13T15:55:07.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.712+0000 7fa9a2a00640 1 -- 172.21.15.17:0/3408891847 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4010690 con 0x7fa9ac10c340 2024-09-13T15:55:07.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.712+0000 7fa9b0c00640 1 -- 172.21.15.17:0/3408891847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9ac1a44a0 con 0x7fa9ac10c340 2024-09-13T15:55:07.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.712+0000 7fa9b0c00640 1 -- 172.21.15.17:0/3408891847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9ac1a4960 con 0x7fa9ac10c340 2024-09-13T15:55:07.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.713+0000 7fa9b0c00640 1 -- 172.21.15.17:0/3408891847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9ac101ce0 con 0x7fa9ac10c340 2024-09-13T15:55:07.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.715+0000 7fa9a2a00640 1 -- 172.21.15.17:0/3408891847 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa9a4005020 con 0x7fa9ac10c340 2024-09-13T15:55:07.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.716+0000 7fa9a2a00640 1 --2- 172.21.15.17:0/3408891847 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa9900a1110 0x7fa9900a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:07.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.716+0000 7fa9a2a00640 1 -- 172.21.15.17:0/3408891847 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa9a4014070 con 0x7fa9ac10c340 2024-09-13T15:55:07.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.716+0000 7fa9a9e00640 1 --2- 172.21.15.17:0/3408891847 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa9900a1110 0x7fa9900a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:07.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.717+0000 7fa9a9e00640 1 --2- 172.21.15.17:0/3408891847 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa9900a1110 0x7fa9900a35d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa99c005ab0 tx=0x7fa99c005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:07.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.720+0000 7fa9a2a00640 1 -- 172.21.15.17:0/3408891847 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa9a4096590 con 0x7fa9ac10c340 2024-09-13T15:55:07.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.897+0000 7fa9b0c00640 1 -- 172.21.15.17:0/3408891847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa9ac02c410 con 0x7fa9ac10c340 2024-09-13T15:55:07.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.898+0000 7fa9a2a00640 1 -- 172.21.15.17:0/3408891847 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa9a4094e60 con 0x7fa9ac10c340 2024-09-13T15:55:07.900 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-13T15:55:07.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.900+0000 7fa9b0c00640 1 -- 172.21.15.17:0/3408891847 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa9900a1110 msgr2=0x7fa9900a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:07.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.900+0000 7fa9b0c00640 1 --2- 172.21.15.17:0/3408891847 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa9900a1110 0x7fa9900a35d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa99c005ab0 tx=0x7fa99c005780 comp rx=0 tx=0).stop 2024-09-13T15:55:07.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.900+0000 7fa9b0c00640 1 -- 172.21.15.17:0/3408891847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9ac10c340 msgr2=0x7fa9ac1a3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:07.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.900+0000 7fa9b0c00640 1 --2- 172.21.15.17:0/3408891847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9ac10c340 0x7fa9ac1a3950 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa9a400eb10 tx=0x7fa9a400c2d0 comp rx=0 tx=0).stop 2024-09-13T15:55:07.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.900+0000 7fa9b0c00640 1 -- 172.21.15.17:0/3408891847 shutdown_connections 2024-09-13T15:55:07.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.900+0000 7fa9b0c00640 1 --2- 172.21.15.17:0/3408891847 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa9900a1110 0x7fa9900a35d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:07.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.900+0000 7fa9b0c00640 1 --2- 172.21.15.17:0/3408891847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9ac10c340 0x7fa9ac1a3950 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:07.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.900+0000 7fa9b0c00640 1 --2- 172.21.15.17:0/3408891847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9ac0744f0 0x7fa9ac19c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:07.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.900+0000 7fa9b0c00640 1 --2- 172.21.15.17:0/3408891847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9ac072f10 0x7fa9ac19c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:07.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.900+0000 7fa9b0c00640 1 -- 172.21.15.17:0/3408891847 >> 172.21.15.17:0/3408891847 conn(0x7fa9ac0fb4d0 msgr2=0x7fa9ac0fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:07.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.900+0000 7fa9b0c00640 1 -- 172.21.15.17:0/3408891847 shutdown_connections 2024-09-13T15:55:07.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:07.900+0000 7fa9b0c00640 1 -- 172.21.15.17:0/3408891847 wait complete. 2024-09-13T15:55:07.918 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:55:08.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.076+0000 7efc9d000640 1 -- 172.21.15.17:0/3525252558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98101fa0 msgr2=0x7efc981023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:08.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.076+0000 7efc9d000640 1 --2- 172.21.15.17:0/3525252558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98101fa0 0x7efc981023a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efc88009900 tx=0x7efc8802a410 comp rx=0 tx=0).stop 2024-09-13T15:55:08.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.076+0000 7efc9d000640 1 -- 172.21.15.17:0/3525252558 shutdown_connections 2024-09-13T15:55:08.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.076+0000 7efc9d000640 1 --2- 172.21.15.17:0/3525252558 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc98103b50 0x7efc9810a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.076+0000 7efc9d000640 1 --2- 172.21.15.17:0/3525252558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc98103190 0x7efc98103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.076+0000 7efc9d000640 1 --2- 172.21.15.17:0/3525252558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98101fa0 0x7efc981023a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.076+0000 7efc9d000640 1 -- 172.21.15.17:0/3525252558 >> 172.21.15.17:0/3525252558 conn(0x7efc980fd700 msgr2=0x7efc980ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:08.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.076+0000 7efc9d000640 1 -- 172.21.15.17:0/3525252558 shutdown_connections 2024-09-13T15:55:08.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.076+0000 7efc9d000640 1 -- 172.21.15.17:0/3525252558 wait complete. 2024-09-13T15:55:08.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.077+0000 7efc9d000640 1 Processor -- start 2024-09-13T15:55:08.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.077+0000 7efc9d000640 1 -- start start 2024-09-13T15:55:08.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.077+0000 7efc9d000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc98101fa0 0x7efc98197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:08.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.077+0000 7efc9d000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc98103190 0x7efc98198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:08.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.077+0000 7efc9d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98103b50 0x7efc9819f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:08.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.077+0000 7efc9d000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9819fad0 con 0x7efc98103b50 2024-09-13T15:55:08.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.077+0000 7efc9d000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9819fc40 con 0x7efc98103190 2024-09-13T15:55:08.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.077+0000 7efc9d000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9819fe00 con 0x7efc98101fa0 2024-09-13T15:55:08.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.078+0000 7efc96800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98103b50 0x7efc9819f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:08.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.078+0000 7efc96800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98103b50 0x7efc9819f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53602/0 (socket says 172.21.15.17:53602) 2024-09-13T15:55:08.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.078+0000 7efc96800640 1 -- 172.21.15.17:0/3424799448 learned_addr learned my addr 172.21.15.17:0/3424799448 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:08.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.078+0000 7efc95400640 1 --2- 172.21.15.17:0/3424799448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc98103190 0x7efc98198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:08.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.078+0000 7efc95e00640 1 --2- 172.21.15.17:0/3424799448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc98101fa0 0x7efc98197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:08.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.078+0000 7efc96800640 1 -- 172.21.15.17:0/3424799448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc98101fa0 msgr2=0x7efc98197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:08.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.078+0000 7efc96800640 1 --2- 172.21.15.17:0/3424799448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc98101fa0 0x7efc98197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.078+0000 7efc96800640 1 -- 172.21.15.17:0/3424799448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc98103190 msgr2=0x7efc98198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:08.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.078+0000 7efc96800640 1 --2- 172.21.15.17:0/3424799448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc98103190 0x7efc98198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.078+0000 7efc96800640 1 -- 172.21.15.17:0/3424799448 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc90009840 con 0x7efc98103b50 2024-09-13T15:55:08.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.078+0000 7efc96800640 1 --2- 172.21.15.17:0/3424799448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98103b50 0x7efc9819f590 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efc9000efd0 tx=0x7efc9000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:08.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.079+0000 7efc8ea00640 1 -- 172.21.15.17:0/3424799448 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc90009b40 con 0x7efc98103b50 2024-09-13T15:55:08.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.079+0000 7efc8ea00640 1 -- 172.21.15.17:0/3424799448 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc90003b70 con 0x7efc98103b50 2024-09-13T15:55:08.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.079+0000 7efc9d000640 1 -- 172.21.15.17:0/3424799448 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc88009560 con 0x7efc98103b50 2024-09-13T15:55:08.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.079+0000 7efc8ea00640 1 -- 172.21.15.17:0/3424799448 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc90010850 con 0x7efc98103b50 2024-09-13T15:55:08.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.079+0000 7efc9d000640 1 -- 172.21.15.17:0/3424799448 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc981a0460 con 0x7efc98103b50 2024-09-13T15:55:08.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.080+0000 7efc9d000640 1 -- 172.21.15.17:0/3424799448 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc981094d0 con 0x7efc98103b50 2024-09-13T15:55:08.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.082+0000 7efc8ea00640 1 -- 172.21.15.17:0/3424799448 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7efc90004020 con 0x7efc98103b50 2024-09-13T15:55:08.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.084+0000 7efc8ea00640 1 --2- 172.21.15.17:0/3424799448 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efc7c0a1110 0x7efc7c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:08.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.084+0000 7efc8ea00640 1 -- 172.21.15.17:0/3424799448 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7efc90014070 con 0x7efc98103b50 2024-09-13T15:55:08.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.084+0000 7efc95e00640 1 --2- 172.21.15.17:0/3424799448 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efc7c0a1110 0x7efc7c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:08.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.085+0000 7efc95e00640 1 --2- 172.21.15.17:0/3424799448 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efc7c0a1110 0x7efc7c0a35d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efc8802f610 tx=0x7efc88005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:08.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.088+0000 7efc8ea00640 1 -- 172.21.15.17:0/3424799448 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efc90096620 con 0x7efc98103b50 2024-09-13T15:55:08.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.268+0000 7efc9d000640 1 -- 172.21.15.17:0/3424799448 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efc9802c3e0 con 0x7efc98103b50 2024-09-13T15:55:08.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.269+0000 7efc8ea00640 1 -- 172.21.15.17:0/3424799448 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7efc90099c40 con 0x7efc98103b50 2024-09-13T15:55:08.271 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-13T15:55:08.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.271+0000 7efc9d000640 1 -- 172.21.15.17:0/3424799448 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efc7c0a1110 msgr2=0x7efc7c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:08.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.271+0000 7efc9d000640 1 --2- 172.21.15.17:0/3424799448 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efc7c0a1110 0x7efc7c0a35d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efc8802f610 tx=0x7efc88005780 comp rx=0 tx=0).stop 2024-09-13T15:55:08.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.271+0000 7efc9d000640 1 -- 172.21.15.17:0/3424799448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98103b50 msgr2=0x7efc9819f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:08.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.271+0000 7efc9d000640 1 --2- 172.21.15.17:0/3424799448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98103b50 0x7efc9819f590 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efc9000efd0 tx=0x7efc9000c6a0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.271+0000 7efc9d000640 1 -- 172.21.15.17:0/3424799448 shutdown_connections 2024-09-13T15:55:08.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.271+0000 7efc9d000640 1 --2- 172.21.15.17:0/3424799448 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efc7c0a1110 0x7efc7c0a35d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.271+0000 7efc9d000640 1 --2- 172.21.15.17:0/3424799448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98103b50 0x7efc9819f590 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.271+0000 7efc9d000640 1 --2- 172.21.15.17:0/3424799448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc98103190 0x7efc98198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.271+0000 7efc9d000640 1 --2- 172.21.15.17:0/3424799448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc98101fa0 0x7efc98197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.271+0000 7efc9d000640 1 -- 172.21.15.17:0/3424799448 >> 172.21.15.17:0/3424799448 conn(0x7efc980fd700 msgr2=0x7efc981066a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:08.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.271+0000 7efc9d000640 1 -- 172.21.15.17:0/3424799448 shutdown_connections 2024-09-13T15:55:08.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.271+0000 7efc9d000640 1 -- 172.21.15.17:0/3424799448 wait complete. 2024-09-13T15:55:08.288 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:55:08.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.447+0000 7f605b800640 1 -- 172.21.15.17:0/2105628466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6054100f60 msgr2=0x7f60541013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:08.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.447+0000 7f605b800640 1 --2- 172.21.15.17:0/2105628466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6054100f60 0x7f60541013e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6040009900 tx=0x7f604002a3f0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.447+0000 7f605b800640 1 -- 172.21.15.17:0/2105628466 shutdown_connections 2024-09-13T15:55:08.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.447+0000 7f605b800640 1 --2- 172.21.15.17:0/2105628466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6054101920 0x7f60541081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.447+0000 7f605b800640 1 --2- 172.21.15.17:0/2105628466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6054100f60 0x7f60541013e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.447+0000 7f605b800640 1 --2- 172.21.15.17:0/2105628466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f60540ffd70 0x7f6054100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.447+0000 7f605b800640 1 -- 172.21.15.17:0/2105628466 >> 172.21.15.17:0/2105628466 conn(0x7f60540fb4d0 msgr2=0x7f60540fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:08.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.447+0000 7f605b800640 1 -- 172.21.15.17:0/2105628466 shutdown_connections 2024-09-13T15:55:08.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.447+0000 7f605b800640 1 -- 172.21.15.17:0/2105628466 wait complete. 2024-09-13T15:55:08.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.448+0000 7f605b800640 1 Processor -- start 2024-09-13T15:55:08.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.448+0000 7f605b800640 1 -- start start 2024-09-13T15:55:08.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.449+0000 7f605b800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60540ffd70 0x7f6054195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:08.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.449+0000 7f605b800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6054100f60 0x7f60541962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:08.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.449+0000 7f605b800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6054101920 0x7f605419d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:08.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.449+0000 7f605b800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605419d850 con 0x7f60540ffd70 2024-09-13T15:55:08.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.449+0000 7f605b800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605419d9c0 con 0x7f6054100f60 2024-09-13T15:55:08.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.449+0000 7f605b800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605419db80 con 0x7f6054101920 2024-09-13T15:55:08.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.449+0000 7f6058e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60540ffd70 0x7f6054195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:08.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.449+0000 7f6058e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60540ffd70 0x7f6054195d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53628/0 (socket says 172.21.15.17:53628) 2024-09-13T15:55:08.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.449+0000 7f6058e00640 1 -- 172.21.15.17:0/4072679238 learned_addr learned my addr 172.21.15.17:0/4072679238 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:08.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.449+0000 7f6059800640 1 --2- 172.21.15.17:0/4072679238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6054101920 0x7f605419d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:08.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.449+0000 7f6053e00640 1 --2- 172.21.15.17:0/4072679238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6054100f60 0x7f60541962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:08.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.449+0000 7f6058e00640 1 -- 172.21.15.17:0/4072679238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6054101920 msgr2=0x7f605419d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:08.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.449+0000 7f6058e00640 1 --2- 172.21.15.17:0/4072679238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6054101920 0x7f605419d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.449+0000 7f6058e00640 1 -- 172.21.15.17:0/4072679238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6054100f60 msgr2=0x7f60541962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:08.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.449+0000 7f6058e00640 1 --2- 172.21.15.17:0/4072679238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6054100f60 0x7f60541962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.449+0000 7f6058e00640 1 -- 172.21.15.17:0/4072679238 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6040009560 con 0x7f60540ffd70 2024-09-13T15:55:08.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.449+0000 7f6059800640 1 --2- 172.21.15.17:0/4072679238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6054101920 0x7f605419d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:55:08.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.450+0000 7f6058e00640 1 --2- 172.21.15.17:0/4072679238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60540ffd70 0x7f6054195d60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f604800e9c0 tx=0x7f604800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:08.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.450+0000 7f6051600640 1 -- 172.21.15.17:0/4072679238 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60480096e0 con 0x7f60540ffd70 2024-09-13T15:55:08.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.450+0000 7f6051600640 1 -- 172.21.15.17:0/4072679238 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f60480044f0 con 0x7f60540ffd70 2024-09-13T15:55:08.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.450+0000 7f6051600640 1 -- 172.21.15.17:0/4072679238 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6048010430 con 0x7f60540ffd70 2024-09-13T15:55:08.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.450+0000 7f605b800640 1 -- 172.21.15.17:0/4072679238 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605419de60 con 0x7f60540ffd70 2024-09-13T15:55:08.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.450+0000 7f605b800640 1 -- 172.21.15.17:0/4072679238 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605419e230 con 0x7f60540ffd70 2024-09-13T15:55:08.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.451+0000 7f605b800640 1 -- 172.21.15.17:0/4072679238 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60541071f0 con 0x7f60540ffd70 2024-09-13T15:55:08.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.453+0000 7f6051600640 1 -- 172.21.15.17:0/4072679238 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f60480035f0 con 0x7f60540ffd70 2024-09-13T15:55:08.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.455+0000 7f6051600640 1 --2- 172.21.15.17:0/4072679238 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f603c0a1110 0x7f603c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:08.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.455+0000 7f6051600640 1 -- 172.21.15.17:0/4072679238 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f6048014070 con 0x7f60540ffd70 2024-09-13T15:55:08.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.455+0000 7f6053e00640 1 --2- 172.21.15.17:0/4072679238 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f603c0a1110 0x7f603c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:08.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.456+0000 7f6053e00640 1 --2- 172.21.15.17:0/4072679238 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f603c0a1110 0x7f603c0a35d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6040000c00 tx=0x7f60400314c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:08.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.459+0000 7f6051600640 1 -- 172.21.15.17:0/4072679238 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f60480d0030 con 0x7f60540ffd70 2024-09-13T15:55:08.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:08 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1742950489' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:08.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:08 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3408891847' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:55:08.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:08 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1742950489' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:08.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:08 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3408891847' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:55:08.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:08 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1742950489' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:08.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:08 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3408891847' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:55:08.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.642+0000 7f605b800640 1 -- 172.21.15.17:0/4072679238 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f605402c480 con 0x7f60540ffd70 2024-09-13T15:55:08.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.643+0000 7f6051600640 1 -- 172.21.15.17:0/4072679238 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6048099fa0 con 0x7f60540ffd70 2024-09-13T15:55:08.645 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-09-13T15:55:08.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.645+0000 7f605b800640 1 -- 172.21.15.17:0/4072679238 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f603c0a1110 msgr2=0x7f603c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:08.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.645+0000 7f605b800640 1 --2- 172.21.15.17:0/4072679238 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f603c0a1110 0x7f603c0a35d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6040000c00 tx=0x7f60400314c0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.645+0000 7f605b800640 1 -- 172.21.15.17:0/4072679238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60540ffd70 msgr2=0x7f6054195d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:08.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.645+0000 7f605b800640 1 --2- 172.21.15.17:0/4072679238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60540ffd70 0x7f6054195d60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f604800e9c0 tx=0x7f604800ee80 comp rx=0 tx=0).stop 2024-09-13T15:55:08.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.645+0000 7f605b800640 1 -- 172.21.15.17:0/4072679238 shutdown_connections 2024-09-13T15:55:08.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.645+0000 7f605b800640 1 --2- 172.21.15.17:0/4072679238 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f603c0a1110 0x7f603c0a35d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.645+0000 7f605b800640 1 --2- 172.21.15.17:0/4072679238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6054101920 0x7f605419d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.645+0000 7f605b800640 1 --2- 172.21.15.17:0/4072679238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6054100f60 0x7f60541962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.645+0000 7f605b800640 1 --2- 172.21.15.17:0/4072679238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60540ffd70 0x7f6054195d60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.645+0000 7f605b800640 1 -- 172.21.15.17:0/4072679238 >> 172.21.15.17:0/4072679238 conn(0x7f60540fb4d0 msgr2=0x7f60541043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:08.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.645+0000 7f605b800640 1 -- 172.21.15.17:0/4072679238 shutdown_connections 2024-09-13T15:55:08.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.645+0000 7f605b800640 1 -- 172.21.15.17:0/4072679238 wait complete. 2024-09-13T15:55:08.664 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:55:08.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.828+0000 7f4852200640 1 -- 172.21.15.17:0/1569652409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f484c105a60 msgr2=0x7f484c107ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:08.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.828+0000 7f4852200640 1 --2- 172.21.15.17:0/1569652409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f484c105a60 0x7f484c107ed0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4844009ca0 tx=0x7f484402a8c0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.828+0000 7f4852200640 1 -- 172.21.15.17:0/1569652409 shutdown_connections 2024-09-13T15:55:08.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.828+0000 7f4852200640 1 --2- 172.21.15.17:0/1569652409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f484c105a60 0x7f484c107ed0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.828+0000 7f4852200640 1 --2- 172.21.15.17:0/1569652409 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f484c103130 0x7f484c105520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.828+0000 7f4852200640 1 --2- 172.21.15.17:0/1569652409 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f484c100800 0x7f484c102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.828+0000 7f4852200640 1 -- 172.21.15.17:0/1569652409 >> 172.21.15.17:0/1569652409 conn(0x7f484c0fa3e0 msgr2=0x7f484c0fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:08.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.828+0000 7f4852200640 1 -- 172.21.15.17:0/1569652409 shutdown_connections 2024-09-13T15:55:08.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.828+0000 7f4852200640 1 -- 172.21.15.17:0/1569652409 wait complete. 2024-09-13T15:55:08.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.829+0000 7f4852200640 1 Processor -- start 2024-09-13T15:55:08.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.829+0000 7f4852200640 1 -- start start 2024-09-13T15:55:08.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.829+0000 7f4852200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f484c100800 0x7f484c198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:08.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.829+0000 7f4852200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f484c103130 0x7f484c1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:08.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.830+0000 7f4852200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f484c105a60 0x7f484c19f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:08.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.830+0000 7f4852200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c19fb60 con 0x7f484c100800 2024-09-13T15:55:08.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.830+0000 7f4852200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c19fcd0 con 0x7f484c103130 2024-09-13T15:55:08.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.830+0000 7f4852200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c19fe90 con 0x7f484c105a60 2024-09-13T15:55:08.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.830+0000 7f484b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f484c100800 0x7f484c198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:08.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.830+0000 7f484b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f484c100800 0x7f484c198070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53658/0 (socket says 172.21.15.17:53658) 2024-09-13T15:55:08.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.830+0000 7f484b400640 1 -- 172.21.15.17:0/1393239687 learned_addr learned my addr 172.21.15.17:0/1393239687 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:08.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.830+0000 7f484aa00640 1 --2- 172.21.15.17:0/1393239687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f484c103130 0x7f484c1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:08.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.830+0000 7f484be00640 1 --2- 172.21.15.17:0/1393239687 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f484c105a60 0x7f484c19f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:08.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.830+0000 7f484b400640 1 -- 172.21.15.17:0/1393239687 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f484c105a60 msgr2=0x7f484c19f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:08.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.830+0000 7f484b400640 1 --2- 172.21.15.17:0/1393239687 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f484c105a60 0x7f484c19f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.830+0000 7f484b400640 1 -- 172.21.15.17:0/1393239687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f484c103130 msgr2=0x7f484c1985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:08.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.830+0000 7f484b400640 1 --2- 172.21.15.17:0/1393239687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f484c103130 0x7f484c1985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:08.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.830+0000 7f484b400640 1 -- 172.21.15.17:0/1393239687 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4844009900 con 0x7f484c100800 2024-09-13T15:55:08.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.831+0000 7f484b400640 1 --2- 172.21.15.17:0/1393239687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f484c100800 0x7f484c198070 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f483c00e9f0 tx=0x7f483c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:08.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.831+0000 7f4843e00640 1 -- 172.21.15.17:0/1393239687 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c009700 con 0x7f484c100800 2024-09-13T15:55:08.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.831+0000 7f4843e00640 1 -- 172.21.15.17:0/1393239687 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f483c00cd80 con 0x7f484c100800 2024-09-13T15:55:08.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.831+0000 7f4852200640 1 -- 172.21.15.17:0/1393239687 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484c1a0170 con 0x7f484c100800 2024-09-13T15:55:08.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.831+0000 7f4843e00640 1 -- 172.21.15.17:0/1393239687 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c018860 con 0x7f484c100800 2024-09-13T15:55:08.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.831+0000 7f4852200640 1 -- 172.21.15.17:0/1393239687 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484c1a06d0 con 0x7f484c100800 2024-09-13T15:55:08.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.832+0000 7f4852200640 1 -- 172.21.15.17:0/1393239687 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f484c107550 con 0x7f484c100800 2024-09-13T15:55:08.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.834+0000 7f4843e00640 1 -- 172.21.15.17:0/1393239687 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f483c0189c0 con 0x7f484c100800 2024-09-13T15:55:08.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.835+0000 7f4843e00640 1 --2- 172.21.15.17:0/1393239687 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f48300a1110 0x7f48300a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:08.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.835+0000 7f4843e00640 1 -- 172.21.15.17:0/1393239687 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f483c014070 con 0x7f484c100800 2024-09-13T15:55:08.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.835+0000 7f484aa00640 1 --2- 172.21.15.17:0/1393239687 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f48300a1110 0x7f48300a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:08.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.836+0000 7f484aa00640 1 --2- 172.21.15.17:0/1393239687 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f48300a1110 0x7f48300a35d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f484c199580 tx=0x7f4838005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:08.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:08.839+0000 7f4843e00640 1 -- 172.21.15.17:0/1393239687 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f483c052e20 con 0x7f484c100800 2024-09-13T15:55:09.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.030+0000 7f4852200640 1 -- 172.21.15.17:0/1393239687 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f484c106fc0 con 0x7f484c100800 2024-09-13T15:55:09.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.031+0000 7f4843e00640 1 -- 172.21.15.17:0/1393239687 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) v1 ==== 103+0+11 (secure 0 0 0) 0x7f483c096410 con 0x7f484c100800 2024-09-13T15:55:09.032 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-13T15:55:09.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.033+0000 7f4852200640 1 -- 172.21.15.17:0/1393239687 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f48300a1110 msgr2=0x7f48300a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:09.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.033+0000 7f4852200640 1 --2- 172.21.15.17:0/1393239687 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f48300a1110 0x7f48300a35d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f484c199580 tx=0x7f4838005f90 comp rx=0 tx=0).stop 2024-09-13T15:55:09.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.033+0000 7f4852200640 1 -- 172.21.15.17:0/1393239687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f484c100800 msgr2=0x7f484c198070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:09.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.033+0000 7f4852200640 1 --2- 172.21.15.17:0/1393239687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f484c100800 0x7f484c198070 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f483c00e9f0 tx=0x7f483c00eeb0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.034+0000 7f4852200640 1 -- 172.21.15.17:0/1393239687 shutdown_connections 2024-09-13T15:55:09.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.034+0000 7f4852200640 1 --2- 172.21.15.17:0/1393239687 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f48300a1110 0x7f48300a35d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.034+0000 7f4852200640 1 --2- 172.21.15.17:0/1393239687 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f484c105a60 0x7f484c19f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.034+0000 7f4852200640 1 --2- 172.21.15.17:0/1393239687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f484c103130 0x7f484c1985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.034+0000 7f4852200640 1 --2- 172.21.15.17:0/1393239687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f484c100800 0x7f484c198070 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.034+0000 7f4852200640 1 -- 172.21.15.17:0/1393239687 >> 172.21.15.17:0/1393239687 conn(0x7f484c0fa3e0 msgr2=0x7f484c0fffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:09.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.034+0000 7f4852200640 1 -- 172.21.15.17:0/1393239687 shutdown_connections 2024-09-13T15:55:09.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.034+0000 7f4852200640 1 -- 172.21.15.17:0/1393239687 wait complete. 2024-09-13T15:55:09.052 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:55:09.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.210+0000 7f5b12c00640 1 -- 172.21.15.17:0/4188992816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b0c103b40 msgr2=0x7f5b0c10a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:09.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.210+0000 7f5b12c00640 1 --2- 172.21.15.17:0/4188992816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b0c103b40 0x7f5b0c10a3d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009be0 tx=0x7f5b0402a6d0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.211+0000 7f5b12c00640 1 -- 172.21.15.17:0/4188992816 shutdown_connections 2024-09-13T15:55:09.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.211+0000 7f5b12c00640 1 --2- 172.21.15.17:0/4188992816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b0c103b40 0x7f5b0c10a3d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.211+0000 7f5b12c00640 1 --2- 172.21.15.17:0/4188992816 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5b0c103180 0x7f5b0c103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.211+0000 7f5b12c00640 1 --2- 172.21.15.17:0/4188992816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b0c101f90 0x7f5b0c102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.211+0000 7f5b12c00640 1 -- 172.21.15.17:0/4188992816 >> 172.21.15.17:0/4188992816 conn(0x7f5b0c0fd6d0 msgr2=0x7f5b0c0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:09.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.211+0000 7f5b12c00640 1 -- 172.21.15.17:0/4188992816 shutdown_connections 2024-09-13T15:55:09.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.211+0000 7f5b12c00640 1 -- 172.21.15.17:0/4188992816 wait complete. 2024-09-13T15:55:09.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.212+0000 7f5b12c00640 1 Processor -- start 2024-09-13T15:55:09.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.212+0000 7f5b12c00640 1 -- start start 2024-09-13T15:55:09.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.212+0000 7f5b12c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b0c101f90 0x7f5b0c197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:09.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.212+0000 7f5b12c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5b0c103180 0x7f5b0c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:09.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.212+0000 7f5b12c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b0c103b40 0x7f5b0c19f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:09.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.212+0000 7f5b12c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c19fa90 con 0x7f5b0c101f90 2024-09-13T15:55:09.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.212+0000 7f5b12c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c19fc00 con 0x7f5b0c103b40 2024-09-13T15:55:09.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.212+0000 7f5b12c00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c19fdc0 con 0x7f5b0c103180 2024-09-13T15:55:09.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.212+0000 7f5b0be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b0c101f90 0x7f5b0c197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:09.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.212+0000 7f5b0be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b0c101f90 0x7f5b0c197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56846/0 (socket says 172.21.15.17:56846) 2024-09-13T15:55:09.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.212+0000 7f5b0be00640 1 -- 172.21.15.17:0/838318853 learned_addr learned my addr 172.21.15.17:0/838318853 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:09.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.212+0000 7f5b0b400640 1 --2- 172.21.15.17:0/838318853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5b0c103180 0x7f5b0c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:09.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.212+0000 7f5b10c00640 1 --2- 172.21.15.17:0/838318853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b0c103b40 0x7f5b0c19f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:09.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.213+0000 7f5b0be00640 1 -- 172.21.15.17:0/838318853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5b0c103180 msgr2=0x7f5b0c1984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:09.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.213+0000 7f5b0be00640 1 --2- 172.21.15.17:0/838318853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5b0c103180 0x7f5b0c1984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.213+0000 7f5b0be00640 1 -- 172.21.15.17:0/838318853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b0c103b40 msgr2=0x7f5b0c19f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:09.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.213+0000 7f5b0be00640 1 --2- 172.21.15.17:0/838318853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b0c103b40 0x7f5b0c19f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.213+0000 7f5b0be00640 1 -- 172.21.15.17:0/838318853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc009560 con 0x7f5b0c101f90 2024-09-13T15:55:09.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.213+0000 7f5b0b400640 1 --2- 172.21.15.17:0/838318853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5b0c103180 0x7f5b0c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:55:09.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.213+0000 7f5b0be00640 1 --2- 172.21.15.17:0/838318853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b0c101f90 0x7f5b0c197fa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00e9a0 tx=0x7f5afc00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:09.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.213+0000 7f5b08c00640 1 -- 172.21.15.17:0/838318853 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc00cd80 con 0x7f5b0c101f90 2024-09-13T15:55:09.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.213+0000 7f5b12c00640 1 -- 172.21.15.17:0/838318853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b04009840 con 0x7f5b0c101f90 2024-09-13T15:55:09.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.213+0000 7f5b08c00640 1 -- 172.21.15.17:0/838318853 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5afc0108f0 con 0x7f5b0c101f90 2024-09-13T15:55:09.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.213+0000 7f5b08c00640 1 -- 172.21.15.17:0/838318853 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc018960 con 0x7f5b0c101f90 2024-09-13T15:55:09.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.213+0000 7f5b12c00640 1 -- 172.21.15.17:0/838318853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0c1a0420 con 0x7f5b0c101f90 2024-09-13T15:55:09.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.214+0000 7f5b12c00640 1 -- 172.21.15.17:0/838318853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0c109370 con 0x7f5b0c101f90 2024-09-13T15:55:09.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.216+0000 7f5b08c00640 1 -- 172.21.15.17:0/838318853 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5afc010a60 con 0x7f5b0c101f90 2024-09-13T15:55:09.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.217+0000 7f5b08c00640 1 --2- 172.21.15.17:0/838318853 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5af00a1090 0x7f5af00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:09.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.218+0000 7f5b08c00640 1 -- 172.21.15.17:0/838318853 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f5afc014070 con 0x7f5b0c101f90 2024-09-13T15:55:09.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.218+0000 7f5b0b400640 1 --2- 172.21.15.17:0/838318853 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5af00a1090 0x7f5af00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:09.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.218+0000 7f5b0b400640 1 --2- 172.21.15.17:0/838318853 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5af00a1090 0x7f5af00a3550 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c1994b0 tx=0x7f5af8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:09.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.221+0000 7f5b08c00640 1 -- 172.21.15.17:0/838318853 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5afc0966b0 con 0x7f5b0c101f90 2024-09-13T15:55:09.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.414+0000 7f5b12c00640 1 -- 172.21.15.17:0/838318853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5b0c10d830 con 0x7f5b0c101f90 2024-09-13T15:55:09.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.414+0000 7f5b08c00640 1 -- 172.21.15.17:0/838318853 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) v1 ==== 81+0+589 (secure 0 0 0) 0x7f5afc099cd0 con 0x7f5b0c101f90 2024-09-13T15:55:09.416 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/386837955 2024-09-14T15:47:42.048005+0000 2024-09-13T15:55:09.416 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1550067038 2024-09-14T15:47:42.048005+0000 2024-09-13T15:55:09.416 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3360683829 2024-09-14T15:47:42.048005+0000 2024-09-13T15:55:09.416 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/634066188 2024-09-14T15:47:42.048005+0000 2024-09-13T15:55:09.416 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/1047258336 2024-09-14T15:47:14.996424+0000 2024-09-13T15:55:09.417 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/1047258336 2024-09-14T15:47:14.996424+0000 2024-09-13T15:55:09.417 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1945536687 2024-09-14T15:47:14.996424+0000 2024-09-13T15:55:09.417 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/386837955 2024-09-14T15:47:42.048005+0000 2024-09-13T15:55:09.417 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2214214377 2024-09-14T15:47:14.996424+0000 2024-09-13T15:55:09.417 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1224386591 2024-09-14T15:47:14.996424+0000 2024-09-13T15:55:09.417 INFO:teuthology.orchestra.run.smithi017.stderr:listed 10 entries 2024-09-13T15:55:09.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.416+0000 7f5b12c00640 1 -- 172.21.15.17:0/838318853 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5af00a1090 msgr2=0x7f5af00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:09.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.416+0000 7f5b12c00640 1 --2- 172.21.15.17:0/838318853 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5af00a1090 0x7f5af00a3550 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c1994b0 tx=0x7f5af8005f90 comp rx=0 tx=0).stop 2024-09-13T15:55:09.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.416+0000 7f5b12c00640 1 -- 172.21.15.17:0/838318853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b0c101f90 msgr2=0x7f5b0c197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:09.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.416+0000 7f5b12c00640 1 --2- 172.21.15.17:0/838318853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b0c101f90 0x7f5b0c197fa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00e9a0 tx=0x7f5afc00ee60 comp rx=0 tx=0).stop 2024-09-13T15:55:09.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.417+0000 7f5b12c00640 1 -- 172.21.15.17:0/838318853 shutdown_connections 2024-09-13T15:55:09.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.417+0000 7f5b12c00640 1 --2- 172.21.15.17:0/838318853 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5af00a1090 0x7f5af00a3550 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.417+0000 7f5b12c00640 1 --2- 172.21.15.17:0/838318853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b0c103b40 0x7f5b0c19f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.417+0000 7f5b12c00640 1 --2- 172.21.15.17:0/838318853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5b0c103180 0x7f5b0c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.417+0000 7f5b12c00640 1 --2- 172.21.15.17:0/838318853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b0c101f90 0x7f5b0c197fa0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.417+0000 7f5b12c00640 1 -- 172.21.15.17:0/838318853 >> 172.21.15.17:0/838318853 conn(0x7f5b0c0fd6d0 msgr2=0x7f5b0c106540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:09.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.417+0000 7f5b12c00640 1 -- 172.21.15.17:0/838318853 shutdown_connections 2024-09-13T15:55:09.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.417+0000 7f5b12c00640 1 -- 172.21.15.17:0/838318853 wait complete. 2024-09-13T15:55:09.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:09 smithi017 ceph-mon[30494]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 95 B/s wr, 0 op/s 2024-09-13T15:55:09.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:09 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3424799448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T15:55:09.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:09 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/4072679238' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T15:55:09.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:09 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1393239687' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T15:55:09.434 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T15:55:09.434 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:55:09.470 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:55:09.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:09 smithi193 ceph-mon[35248]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 95 B/s wr, 0 op/s 2024-09-13T15:55:09.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:09 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3424799448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T15:55:09.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:09 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/4072679238' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T15:55:09.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:09 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1393239687' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T15:55:09.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:09 smithi189 ceph-mon[34790]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 95 B/s wr, 0 op/s 2024-09-13T15:55:09.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:09 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3424799448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T15:55:09.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:09 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/4072679238' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T15:55:09.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:09 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1393239687' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T15:55:09.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.666+0000 7f7907200640 1 -- 172.21.15.17:0/3514919088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7908101dc0 msgr2=0x7f79081021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:09.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.666+0000 7f7907200640 1 --2- 172.21.15.17:0/3514919088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7908101dc0 0x7f79081021c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009900 tx=0x7f78f802a3f0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.667+0000 7f7907200640 1 -- 172.21.15.17:0/3514919088 shutdown_connections 2024-09-13T15:55:09.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.667+0000 7f7907200640 1 --2- 172.21.15.17:0/3514919088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7908103970 0x7f790810a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.667+0000 7f7907200640 1 --2- 172.21.15.17:0/3514919088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7908102fb0 0x7f7908103430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.667+0000 7f7907200640 1 --2- 172.21.15.17:0/3514919088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7908101dc0 0x7f79081021c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.667+0000 7f7907200640 1 -- 172.21.15.17:0/3514919088 >> 172.21.15.17:0/3514919088 conn(0x7f79080fd540 msgr2=0x7f79080ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:09.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.667+0000 7f7907200640 1 -- 172.21.15.17:0/3514919088 shutdown_connections 2024-09-13T15:55:09.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.667+0000 7f7907200640 1 -- 172.21.15.17:0/3514919088 wait complete. 2024-09-13T15:55:09.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.668+0000 7f7907200640 1 Processor -- start 2024-09-13T15:55:09.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.668+0000 7f7907200640 1 -- start start 2024-09-13T15:55:09.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.668+0000 7f7907200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7908101dc0 0x7f7908197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:09.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.668+0000 7f7907200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7908102fb0 0x7f7908198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:09.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.668+0000 7f7907200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7908103970 0x7f790819f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:09.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.668+0000 7f7907200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790819f880 con 0x7f7908103970 2024-09-13T15:55:09.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.668+0000 7f7907200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790819f9f0 con 0x7f7908101dc0 2024-09-13T15:55:09.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.668+0000 7f7907200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790819fbb0 con 0x7f7908102fb0 2024-09-13T15:55:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.668+0000 7f7906800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7908103970 0x7f790819f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.668+0000 7f7905e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7908101dc0 0x7f7908197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.668+0000 7f7905e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7908101dc0 0x7f7908197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:53508/0 (socket says 172.21.15.17:53508) 2024-09-13T15:55:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.668+0000 7f7905e00640 1 -- 172.21.15.17:0/4198955592 learned_addr learned my addr 172.21.15.17:0/4198955592 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.668+0000 7f78fd400640 1 --2- 172.21.15.17:0/4198955592 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7908102fb0 0x7f7908198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.669+0000 7f7905e00640 1 -- 172.21.15.17:0/4198955592 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7908102fb0 msgr2=0x7f7908198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.669+0000 7f7905e00640 1 --2- 172.21.15.17:0/4198955592 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7908102fb0 0x7f7908198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.669+0000 7f7905e00640 1 -- 172.21.15.17:0/4198955592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7908103970 msgr2=0x7f790819f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.669+0000 7f7905e00640 1 --2- 172.21.15.17:0/4198955592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7908103970 0x7f790819f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.669+0000 7f7905e00640 1 -- 172.21.15.17:0/4198955592 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f8009560 con 0x7f7908101dc0 2024-09-13T15:55:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.669+0000 7f7905e00640 1 --2- 172.21.15.17:0/4198955592 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7908101dc0 0x7f7908197df0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f78f80057c0 tx=0x7f78f80055a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.669+0000 7f78ff400640 1 -- 172.21.15.17:0/4198955592 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f8004bd0 con 0x7f7908101dc0 2024-09-13T15:55:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.669+0000 7f7907200640 1 -- 172.21.15.17:0/4198955592 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790819fe30 con 0x7f7908101dc0 2024-09-13T15:55:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.669+0000 7f78ff400640 1 -- 172.21.15.17:0/4198955592 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78f8004d30 con 0x7f7908101dc0 2024-09-13T15:55:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.669+0000 7f78ff400640 1 -- 172.21.15.17:0/4198955592 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f8031b60 con 0x7f7908101dc0 2024-09-13T15:55:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.669+0000 7f7907200640 1 -- 172.21.15.17:0/4198955592 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79081a0220 con 0x7f7908101dc0 2024-09-13T15:55:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.670+0000 7f7907200640 1 -- 172.21.15.17:0/4198955592 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7908109310 con 0x7f7908101dc0 2024-09-13T15:55:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.672+0000 7f78ff400640 1 -- 172.21.15.17:0/4198955592 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f78f8003cb0 con 0x7f7908101dc0 2024-09-13T15:55:09.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.673+0000 7f78ff400640 1 --2- 172.21.15.17:0/4198955592 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f78ec0a1090 0x7f78ec0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:09.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.674+0000 7f78ff400640 1 -- 172.21.15.17:0/4198955592 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f78f80edcc0 con 0x7f7908101dc0 2024-09-13T15:55:09.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.674+0000 7f78fd400640 1 --2- 172.21.15.17:0/4198955592 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f78ec0a1090 0x7f78ec0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:09.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.674+0000 7f78fd400640 1 --2- 172.21.15.17:0/4198955592 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f78ec0a1090 0x7f78ec0a3550 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f78f0005d00 tx=0x7f78f000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:09.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.676+0000 7f78ff400640 1 -- 172.21.15.17:0/4198955592 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f78f80b7220 con 0x7f7908101dc0 2024-09-13T15:55:09.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.856+0000 7f7907200640 1 -- 172.21.15.17:0/4198955592 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f790810d660 con 0x7f7908101dc0 2024-09-13T15:55:09.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.858+0000 7f78ff400640 1 -- 172.21.15.17:0/4198955592 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23935 (secure 0 0 0) 0x7f78f80b9150 con 0x7f7908101dc0 2024-09-13T15:55:09.860 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:55:09.860 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":90,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","created":"2024-09-13T15:46:50.475750+0000","modified":"2024-09-13T15:54:57.383548+0000","last_up_change":"2024-09-13T15:53:59.138985+0000","last_in_change":"2024-09-13T15:53:39.220264+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:50:10.657011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:54:51.436469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:54:52.427930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:54:55.478058+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5d39d6af-15e6-463b-b9ff-a9a5dd94e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6803","nonce":158651212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6805","nonce":158651212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6809","nonce":158651212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6807","nonce":158651212}]},"public_addr":"172.21.15.17:6803/158651212","cluster_addr":"172.21.15.17:6805/158651212","heartbeat_back_addr":"172.21.15.17:6809/158651212","heartbeat_front_addr":"172.21.15.17:6807/158651212","state":["exists","up"]},{"osd":1,"uuid":"0da621c7-645b-44ae-ba7c-a573861c3aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6801","nonce":964319421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6803","nonce":964319421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6807","nonce":964319421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6805","nonce":964319421}]},"public_addr":"172.21.15.189:6801/964319421","cluster_addr":"172.21.15.189:6803/964319421","heartbeat_back_addr":"172.21.15.189:6807/964319421","heartbeat_front_addr":"172.21.15.189:6805/964319421","state":["exists","up"]},{"osd":2,"uuid":"fa95af60-1486-4a29-8c79-8a73a4146552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6801","nonce":138468002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6803","nonce":138468002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6807","nonce":138468002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6805","nonce":138468002}]},"public_addr":"172.21.15.193:6801/138468002","cluster_addr":"172.21.15.193:6803/138468002","heartbeat_back_addr":"172.21.15.193:6807/138468002","heartbeat_front_addr":"172.21.15.193:6805/138468002","state":["exists","up"]},{"osd":3,"uuid":"90428e5f-dfd4-4cda-b240-fdb9079bcb7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6811","nonce":919913803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6813","nonce":919913803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6817","nonce":919913803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6815","nonce":919913803}]},"public_addr":"172.21.15.17:6811/919913803","cluster_addr":"172.21.15.17:6813/919913803","heartbeat_back_addr":"172.21.15.17:6817/919913803","heartbeat_front_addr":"172.21.15.17:6815/919913803","state":["exists","up"]},{"osd":4,"uuid":"e1c537b6-98d2-4b66-b15a-65fe70b0ce25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6809","nonce":2310375565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6811","nonce":2310375565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6815","nonce":2310375565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6813","nonce":2310375565}]},"public_addr":"172.21.15.189:6809/2310375565","cluster_addr":"172.21.15.189:6811/2310375565","heartbeat_back_addr":"172.21.15.189:6815/2310375565","heartbeat_front_addr":"172.21.15.189:6813/2310375565","state":["exists","up"]},{"osd":5,"uuid":"48522fd7-d781-4447-873f-174dabd1e33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6809","nonce":1330877824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6811","nonce":1330877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6815","nonce":1330877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6813","nonce":1330877824}]},"public_addr":"172.21.15.193:6809/1330877824","cluster_addr":"172.21.15.193:6811/1330877824","heartbeat_back_addr":"172.21.15.193:6815/1330877824","heartbeat_front_addr":"172.21.15.193:6813/1330877824","state":["exists","up"]},{"osd":6,"uuid":"47bea191-fb53-40a7-8563-8ebf17dd5bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6819","nonce":3930545382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6821","nonce":3930545382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6825","nonce":3930545382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6823","nonce":3930545382}]},"public_addr":"172.21.15.17:6819/3930545382","cluster_addr":"172.21.15.17:6821/3930545382","heartbeat_back_addr":"172.21.15.17:6825/3930545382","heartbeat_front_addr":"172.21.15.17:6823/3930545382","state":["exists","up"]},{"osd":7,"uuid":"a98f36f9-0a19-4c9a-8ed1-615c4a6e7658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6817","nonce":3691677495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6819","nonce":3691677495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6823","nonce":3691677495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6821","nonce":3691677495}]},"public_addr":"172.21.15.189:6817/3691677495","cluster_addr":"172.21.15.189:6819/3691677495","heartbeat_back_addr":"172.21.15.189:6823/3691677495","heartbeat_front_addr":"172.21.15.189:6821/3691677495","state":["exists","up"]},{"osd":8,"uuid":"7a372d9f-c40f-4ead-87da-2f3a570c1373","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6817","nonce":4112907498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6819","nonce":4112907498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6823","nonce":4112907498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6821","nonce":4112907498}]},"public_addr":"172.21.15.193:6817/4112907498","cluster_addr":"172.21.15.193:6819/4112907498","heartbeat_back_addr":"172.21.15.193:6823/4112907498","heartbeat_front_addr":"172.21.15.193:6821/4112907498","state":["exists","up"]},{"osd":9,"uuid":"ac3d983c-c5e7-456b-8271-7c4e6169de61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6827","nonce":663424274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6829","nonce":663424274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6833","nonce":663424274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6831","nonce":663424274}]},"public_addr":"172.21.15.17:6827/663424274","cluster_addr":"172.21.15.17:6829/663424274","heartbeat_back_addr":"172.21.15.17:6833/663424274","heartbeat_front_addr":"172.21.15.17:6831/663424274","state":["exists","up"]},{"osd":10,"uuid":"08dcae02-6c79-4a06-ae88-6eb6e6941cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6825","nonce":3153990375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6827","nonce":3153990375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6831","nonce":3153990375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6829","nonce":3153990375}]},"public_addr":"172.21.15.189:6825/3153990375","cluster_addr":"172.21.15.189:6827/3153990375","heartbeat_back_addr":"172.21.15.189:6831/3153990375","heartbeat_front_addr":"172.21.15.189:6829/3153990375","state":["exists","up"]},{"osd":11,"uuid":"a4ebcf41-d805-4d44-b112-13ae84d51868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6825","nonce":4088053907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6827","nonce":4088053907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6831","nonce":4088053907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6829","nonce":4088053907}]},"public_addr":"172.21.15.193:6825/4088053907","cluster_addr":"172.21.15.193:6827/4088053907","heartbeat_back_addr":"172.21.15.193:6831/4088053907","heartbeat_front_addr":"172.21.15.193:6829/4088053907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:22.172370+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:44.802224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:06.641435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:34.536515+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:58.789324+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:22.189862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:50.382257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:14.678047+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:38.581105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:07.258150+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:32.261383+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:56.739338+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/1550067038":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/3360683829":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/634066188":"2024-09-14T15:47:42.048005+0000","172.21.15.17:6801/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1945536687":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/2214214377":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1224386591":"2024-09-14T15:47:14.996424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:55:09.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.860+0000 7f7907200640 1 -- 172.21.15.17:0/4198955592 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f78ec0a1090 msgr2=0x7f78ec0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:09.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.860+0000 7f7907200640 1 --2- 172.21.15.17:0/4198955592 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f78ec0a1090 0x7f78ec0a3550 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f78f0005d00 tx=0x7f78f000b410 comp rx=0 tx=0).stop 2024-09-13T15:55:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.860+0000 7f7907200640 1 -- 172.21.15.17:0/4198955592 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7908101dc0 msgr2=0x7f7908197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.860+0000 7f7907200640 1 --2- 172.21.15.17:0/4198955592 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7908101dc0 0x7f7908197df0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f78f80057c0 tx=0x7f78f80055a0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.860+0000 7f7907200640 1 -- 172.21.15.17:0/4198955592 shutdown_connections 2024-09-13T15:55:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.860+0000 7f7907200640 1 --2- 172.21.15.17:0/4198955592 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f78ec0a1090 0x7f78ec0a3550 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.860+0000 7f7907200640 1 --2- 172.21.15.17:0/4198955592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7908103970 0x7f790819f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.860+0000 7f7907200640 1 --2- 172.21.15.17:0/4198955592 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7908102fb0 0x7f7908198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.860+0000 7f7907200640 1 --2- 172.21.15.17:0/4198955592 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7908101dc0 0x7f7908197df0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.860+0000 7f7907200640 1 -- 172.21.15.17:0/4198955592 >> 172.21.15.17:0/4198955592 conn(0x7f79080fd540 msgr2=0x7f79081064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.860+0000 7f7907200640 1 -- 172.21.15.17:0/4198955592 shutdown_connections 2024-09-13T15:55:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:09.860+0000 7f7907200640 1 -- 172.21.15.17:0/4198955592 wait complete. 2024-09-13T15:55:09.878 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:50:10.657011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:54:51.436469+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:54:52.427930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:54:55.478058+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:55:09.878 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:55:10.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.037+0000 7f3106a00640 1 -- 172.21.15.17:0/2342674393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31001030f0 msgr2=0x7f3100103570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:10.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.037+0000 7f3106a00640 1 --2- 172.21.15.17:0/2342674393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31001030f0 0x7f3100103570 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009900 tx=0x7f30e802a410 comp rx=0 tx=0).stop 2024-09-13T15:55:10.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.037+0000 7f3106a00640 1 -- 172.21.15.17:0/2342674393 shutdown_connections 2024-09-13T15:55:10.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.037+0000 7f3106a00640 1 --2- 172.21.15.17:0/2342674393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3100103ab0 0x7f310010a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.037+0000 7f3106a00640 1 --2- 172.21.15.17:0/2342674393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31001030f0 0x7f3100103570 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.037+0000 7f3106a00640 1 --2- 172.21.15.17:0/2342674393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3100101f20 0x7f3100102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.037+0000 7f3106a00640 1 -- 172.21.15.17:0/2342674393 >> 172.21.15.17:0/2342674393 conn(0x7f31000fd6f0 msgr2=0x7f31000ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:10.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.037+0000 7f3106a00640 1 -- 172.21.15.17:0/2342674393 shutdown_connections 2024-09-13T15:55:10.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.037+0000 7f3106a00640 1 -- 172.21.15.17:0/2342674393 wait complete. 2024-09-13T15:55:10.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.038+0000 7f3106a00640 1 Processor -- start 2024-09-13T15:55:10.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.038+0000 7f3106a00640 1 -- start start 2024-09-13T15:55:10.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.039+0000 7f3106a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3100101f20 0x7f3100197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:10.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.039+0000 7f3106a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31001030f0 0x7f3100198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:10.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.039+0000 7f3106a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3100103ab0 0x7f310019f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:10.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.039+0000 7f3106a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310019fa40 con 0x7f31001030f0 2024-09-13T15:55:10.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.039+0000 7f3106a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310019fbb0 con 0x7f3100101f20 2024-09-13T15:55:10.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.039+0000 7f3106a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310019fd70 con 0x7f3100103ab0 2024-09-13T15:55:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.039+0000 7f30f7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31001030f0 0x7f3100198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.039+0000 7f30f7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31001030f0 0x7f3100198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56878/0 (socket says 172.21.15.17:56878) 2024-09-13T15:55:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.039+0000 7f30f7e00640 1 -- 172.21.15.17:0/964877174 learned_addr learned my addr 172.21.15.17:0/964877174 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.039+0000 7f30ffe00640 1 --2- 172.21.15.17:0/964877174 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3100101f20 0x7f3100197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.039+0000 7f3104a00640 1 --2- 172.21.15.17:0/964877174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3100103ab0 0x7f310019f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.039+0000 7f30f7e00640 1 -- 172.21.15.17:0/964877174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3100103ab0 msgr2=0x7f310019f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.039+0000 7f30f7e00640 1 --2- 172.21.15.17:0/964877174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3100103ab0 0x7f310019f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.039+0000 7f30f7e00640 1 -- 172.21.15.17:0/964877174 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3100101f20 msgr2=0x7f3100197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.039+0000 7f30f7e00640 1 --2- 172.21.15.17:0/964877174 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3100101f20 0x7f3100197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.039+0000 7f30f7e00640 1 -- 172.21.15.17:0/964877174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e8009560 con 0x7f31001030f0 2024-09-13T15:55:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.040+0000 7f30f7e00640 1 --2- 172.21.15.17:0/964877174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31001030f0 0x7f3100198490 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009a20 tx=0x7f30e8005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.040+0000 7f30fd600640 1 -- 172.21.15.17:0/964877174 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8004c10 con 0x7f31001030f0 2024-09-13T15:55:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.040+0000 7f30fd600640 1 -- 172.21.15.17:0/964877174 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30e8004d70 con 0x7f31001030f0 2024-09-13T15:55:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.040+0000 7f30fd600640 1 -- 172.21.15.17:0/964877174 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8031ae0 con 0x7f31001030f0 2024-09-13T15:55:10.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.040+0000 7f3106a00640 1 -- 172.21.15.17:0/964877174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310019fff0 con 0x7f31001030f0 2024-09-13T15:55:10.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.040+0000 7f3106a00640 1 -- 172.21.15.17:0/964877174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31001a03c0 con 0x7f31001030f0 2024-09-13T15:55:10.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.041+0000 7f3106a00640 1 -- 172.21.15.17:0/964877174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31001094c0 con 0x7f31001030f0 2024-09-13T15:55:10.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.043+0000 7f30fd600640 1 -- 172.21.15.17:0/964877174 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f30e8031c40 con 0x7f31001030f0 2024-09-13T15:55:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.044+0000 7f30fd600640 1 --2- 172.21.15.17:0/964877174 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30e40a1110 0x7f30e40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.044+0000 7f30fd600640 1 -- 172.21.15.17:0/964877174 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f30e80eda60 con 0x7f31001030f0 2024-09-13T15:55:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.044+0000 7f30ffe00640 1 --2- 172.21.15.17:0/964877174 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30e40a1110 0x7f30e40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.045+0000 7f30ffe00640 1 --2- 172.21.15.17:0/964877174 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30e40a1110 0x7f30e40a35d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3100101c40 tx=0x7f30f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:10.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.048+0000 7f30fd600640 1 -- 172.21.15.17:0/964877174 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f30e80b6fa0 con 0x7f31001030f0 2024-09-13T15:55:10.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.232+0000 7f3106a00640 1 -- 172.21.15.17:0/964877174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f310002c480 con 0x7f31001030f0 2024-09-13T15:55:10.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.232+0000 7f30fd600640 1 -- 172.21.15.17:0/964877174 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f30e8040020 con 0x7f31001030f0 2024-09-13T15:55:10.234 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-13T15:55:10.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.234+0000 7f3106a00640 1 -- 172.21.15.17:0/964877174 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30e40a1110 msgr2=0x7f30e40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:10.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.234+0000 7f3106a00640 1 --2- 172.21.15.17:0/964877174 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30e40a1110 0x7f30e40a35d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3100101c40 tx=0x7f30f0005f90 comp rx=0 tx=0).stop 2024-09-13T15:55:10.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.234+0000 7f3106a00640 1 -- 172.21.15.17:0/964877174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31001030f0 msgr2=0x7f3100198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:10.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.234+0000 7f3106a00640 1 --2- 172.21.15.17:0/964877174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31001030f0 0x7f3100198490 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009a20 tx=0x7f30e8005620 comp rx=0 tx=0).stop 2024-09-13T15:55:10.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.235+0000 7f3106a00640 1 -- 172.21.15.17:0/964877174 shutdown_connections 2024-09-13T15:55:10.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.235+0000 7f3106a00640 1 --2- 172.21.15.17:0/964877174 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30e40a1110 0x7f30e40a35d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.235+0000 7f3106a00640 1 --2- 172.21.15.17:0/964877174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3100103ab0 0x7f310019f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.235+0000 7f3106a00640 1 --2- 172.21.15.17:0/964877174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31001030f0 0x7f3100198490 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.235+0000 7f3106a00640 1 --2- 172.21.15.17:0/964877174 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3100101f20 0x7f3100197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.235+0000 7f3106a00640 1 -- 172.21.15.17:0/964877174 >> 172.21.15.17:0/964877174 conn(0x7f31000fd6f0 msgr2=0x7f3100106690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:10.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.235+0000 7f3106a00640 1 -- 172.21.15.17:0/964877174 shutdown_connections 2024-09-13T15:55:10.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.235+0000 7f3106a00640 1 -- 172.21.15.17:0/964877174 wait complete. 2024-09-13T15:55:10.253 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:55:10.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.411+0000 7f9852800640 1 -- 172.21.15.17:0/559291218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f984c0ffd70 msgr2=0x7f984c100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:10.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.411+0000 7f9852800640 1 --2- 172.21.15.17:0/559291218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f984c0ffd70 0x7f984c100170 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f983c009900 tx=0x7f983c02a3f0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.411+0000 7f9852800640 1 -- 172.21.15.17:0/559291218 shutdown_connections 2024-09-13T15:55:10.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.411+0000 7f9852800640 1 --2- 172.21.15.17:0/559291218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f984c101920 0x7f984c1081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.411+0000 7f9852800640 1 --2- 172.21.15.17:0/559291218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f984c100f60 0x7f984c1013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.411+0000 7f9852800640 1 --2- 172.21.15.17:0/559291218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f984c0ffd70 0x7f984c100170 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.411+0000 7f9852800640 1 -- 172.21.15.17:0/559291218 >> 172.21.15.17:0/559291218 conn(0x7f984c0fb4d0 msgr2=0x7f984c0fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:10.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.411+0000 7f9852800640 1 -- 172.21.15.17:0/559291218 shutdown_connections 2024-09-13T15:55:10.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.411+0000 7f9852800640 1 -- 172.21.15.17:0/559291218 wait complete. 2024-09-13T15:55:10.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.412+0000 7f9852800640 1 Processor -- start 2024-09-13T15:55:10.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.412+0000 7f9852800640 1 -- start start 2024-09-13T15:55:10.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.413+0000 7f9852800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f984c0ffd70 0x7f984c198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:10.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.413+0000 7f9852800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f984c100f60 0x7f984c198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:10.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.413+0000 7f9852800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f984c101920 0x7f984c19f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:10.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.413+0000 7f9852800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c19fb10 con 0x7f984c0ffd70 2024-09-13T15:55:10.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.413+0000 7f9852800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c19fc80 con 0x7f984c101920 2024-09-13T15:55:10.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.413+0000 7f9852800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c19fe40 con 0x7f984c100f60 2024-09-13T15:55:10.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.413+0000 7f984b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f984c0ffd70 0x7f984c198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:10.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.413+0000 7f984b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f984c0ffd70 0x7f984c198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56894/0 (socket says 172.21.15.17:56894) 2024-09-13T15:55:10.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.413+0000 7f984b400640 1 -- 172.21.15.17:0/881363965 learned_addr learned my addr 172.21.15.17:0/881363965 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:10.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.413+0000 7f9843e00640 1 --2- 172.21.15.17:0/881363965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f984c100f60 0x7f984c198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.413+0000 7f984be00640 1 --2- 172.21.15.17:0/881363965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f984c101920 0x7f984c19f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.413+0000 7f984b400640 1 -- 172.21.15.17:0/881363965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f984c100f60 msgr2=0x7f984c198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.413+0000 7f984b400640 1 --2- 172.21.15.17:0/881363965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f984c100f60 0x7f984c198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.413+0000 7f984b400640 1 -- 172.21.15.17:0/881363965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f984c101920 msgr2=0x7f984c19f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.413+0000 7f984b400640 1 --2- 172.21.15.17:0/881363965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f984c101920 0x7f984c19f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.413+0000 7f984b400640 1 -- 172.21.15.17:0/881363965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c009560 con 0x7f984c0ffd70 2024-09-13T15:55:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.413+0000 7f9843e00640 1 --2- 172.21.15.17:0/881363965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f984c100f60 0x7f984c198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:55:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.414+0000 7f984b400640 1 --2- 172.21.15.17:0/881363965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f984c0ffd70 0x7f984c198020 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f983c031500 tx=0x7f983c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.414+0000 7f9848c00640 1 -- 172.21.15.17:0/881363965 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983c003e00 con 0x7f984c0ffd70 2024-09-13T15:55:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.414+0000 7f9848c00640 1 -- 172.21.15.17:0/881363965 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f983c031c70 con 0x7f984c0ffd70 2024-09-13T15:55:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.414+0000 7f9848c00640 1 -- 172.21.15.17:0/881363965 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983c03bc20 con 0x7f984c0ffd70 2024-09-13T15:55:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.414+0000 7f9852800640 1 -- 172.21.15.17:0/881363965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984c1a00c0 con 0x7f984c0ffd70 2024-09-13T15:55:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.414+0000 7f9852800640 1 -- 172.21.15.17:0/881363965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984c1a0520 con 0x7f984c0ffd70 2024-09-13T15:55:10.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.415+0000 7f9852800640 1 -- 172.21.15.17:0/881363965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f984c10b680 con 0x7f984c0ffd70 2024-09-13T15:55:10.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.417+0000 7f9848c00640 1 -- 172.21.15.17:0/881363965 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f983c0317b0 con 0x7f984c0ffd70 2024-09-13T15:55:10.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.418+0000 7f9848c00640 1 --2- 172.21.15.17:0/881363965 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f98300a1090 0x7f98300a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:10.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.419+0000 7f9848c00640 1 -- 172.21.15.17:0/881363965 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f983c0ed350 con 0x7f984c0ffd70 2024-09-13T15:55:10.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.419+0000 7f9843e00640 1 --2- 172.21.15.17:0/881363965 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f98300a1090 0x7f98300a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:10.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.419+0000 7f9843e00640 1 --2- 172.21.15.17:0/881363965 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f98300a1090 0x7f98300a3550 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f984c199530 tx=0x7f9834005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:10.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.422+0000 7f9848c00640 1 -- 172.21.15.17:0/881363965 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f983c0b6940 con 0x7f984c0ffd70 2024-09-13T15:55:10.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:10 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/838318853' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T15:55:10.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:10 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/4198955592' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:10.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:10 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/838318853' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T15:55:10.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:10 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/4198955592' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:10.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.602+0000 7f9852800640 1 -- 172.21.15.17:0/881363965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f984c1a0930 con 0x7f984c0ffd70 2024-09-13T15:55:10.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.603+0000 7f9848c00640 1 -- 172.21.15.17:0/881363965 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7f983c0b9f60 con 0x7f984c0ffd70 2024-09-13T15:55:10.605 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-13T15:55:10.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:10 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/838318853' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T15:55:10.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:10 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/4198955592' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.605+0000 7f9852800640 1 -- 172.21.15.17:0/881363965 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f98300a1090 msgr2=0x7f98300a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.605+0000 7f9852800640 1 --2- 172.21.15.17:0/881363965 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f98300a1090 0x7f98300a3550 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f984c199530 tx=0x7f9834005f90 comp rx=0 tx=0).stop 2024-09-13T15:55:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.605+0000 7f9852800640 1 -- 172.21.15.17:0/881363965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f984c0ffd70 msgr2=0x7f984c198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.605+0000 7f9852800640 1 --2- 172.21.15.17:0/881363965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f984c0ffd70 0x7f984c198020 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f983c031500 tx=0x7f983c003c10 comp rx=0 tx=0).stop 2024-09-13T15:55:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.605+0000 7f9852800640 1 -- 172.21.15.17:0/881363965 shutdown_connections 2024-09-13T15:55:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.605+0000 7f9852800640 1 --2- 172.21.15.17:0/881363965 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f98300a1090 0x7f98300a3550 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.605+0000 7f9852800640 1 --2- 172.21.15.17:0/881363965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f984c101920 0x7f984c19f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.605+0000 7f9852800640 1 --2- 172.21.15.17:0/881363965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f984c100f60 0x7f984c198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.605+0000 7f9852800640 1 --2- 172.21.15.17:0/881363965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f984c0ffd70 0x7f984c198020 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.605+0000 7f9852800640 1 -- 172.21.15.17:0/881363965 >> 172.21.15.17:0/881363965 conn(0x7f984c0fb4d0 msgr2=0x7f984c106770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.605+0000 7f9852800640 1 -- 172.21.15.17:0/881363965 shutdown_connections 2024-09-13T15:55:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.605+0000 7f9852800640 1 -- 172.21.15.17:0/881363965 wait complete. 2024-09-13T15:55:10.622 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:55:10.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.780+0000 7fe275c00640 1 -- 172.21.15.17:0/1342379642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe270101ea0 msgr2=0x7fe2701022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:10.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.780+0000 7fe275c00640 1 --2- 172.21.15.17:0/1342379642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe270101ea0 0x7fe2701022a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe260009900 tx=0x7fe26002a3f0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.781+0000 7fe275c00640 1 -- 172.21.15.17:0/1342379642 shutdown_connections 2024-09-13T15:55:10.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.781+0000 7fe275c00640 1 --2- 172.21.15.17:0/1342379642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe270103a40 0x7fe27010a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.781+0000 7fe275c00640 1 --2- 172.21.15.17:0/1342379642 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe270103080 0x7fe270103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.781+0000 7fe275c00640 1 --2- 172.21.15.17:0/1342379642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe270101ea0 0x7fe2701022a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.781+0000 7fe275c00640 1 -- 172.21.15.17:0/1342379642 >> 172.21.15.17:0/1342379642 conn(0x7fe2700fd670 msgr2=0x7fe2700ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:10.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.781+0000 7fe275c00640 1 -- 172.21.15.17:0/1342379642 shutdown_connections 2024-09-13T15:55:10.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.781+0000 7fe275c00640 1 -- 172.21.15.17:0/1342379642 wait complete. 2024-09-13T15:55:10.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.781+0000 7fe275c00640 1 Processor -- start 2024-09-13T15:55:10.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.782+0000 7fe275c00640 1 -- start start 2024-09-13T15:55:10.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.782+0000 7fe275c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe270101ea0 0x7fe270197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:10.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.782+0000 7fe275c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe270103080 0x7fe270198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:10.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.782+0000 7fe275c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe270103a40 0x7fe27019f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:10.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.782+0000 7fe275c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27019f9e0 con 0x7fe270101ea0 2024-09-13T15:55:10.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.782+0000 7fe275c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27019fb50 con 0x7fe270103a40 2024-09-13T15:55:10.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.782+0000 7fe275c00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27019fd10 con 0x7fe270103080 2024-09-13T15:55:10.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.782+0000 7fe26fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe270101ea0 0x7fe270197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:10.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.782+0000 7fe26fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe270101ea0 0x7fe270197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56918/0 (socket says 172.21.15.17:56918) 2024-09-13T15:55:10.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.782+0000 7fe26fe00640 1 -- 172.21.15.17:0/2937395624 learned_addr learned my addr 172.21.15.17:0/2937395624 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:10.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.782+0000 7fe267e00640 1 --2- 172.21.15.17:0/2937395624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe270103080 0x7fe270198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:10.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.782+0000 7fe275200640 1 --2- 172.21.15.17:0/2937395624 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe270103a40 0x7fe27019f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:10.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.783+0000 7fe26fe00640 1 -- 172.21.15.17:0/2937395624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe270103080 msgr2=0x7fe270198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:10.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.783+0000 7fe26fe00640 1 --2- 172.21.15.17:0/2937395624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe270103080 0x7fe270198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.783+0000 7fe26fe00640 1 -- 172.21.15.17:0/2937395624 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe270103a40 msgr2=0x7fe27019f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:10.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.783+0000 7fe26fe00640 1 --2- 172.21.15.17:0/2937395624 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe270103a40 0x7fe27019f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.783+0000 7fe26fe00640 1 -- 172.21.15.17:0/2937395624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe260009560 con 0x7fe270101ea0 2024-09-13T15:55:10.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.783+0000 7fe275200640 1 --2- 172.21.15.17:0/2937395624 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe270103a40 0x7fe27019f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:55:10.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.783+0000 7fe26fe00640 1 --2- 172.21.15.17:0/2937395624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe270101ea0 0x7fe270197ef0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe260031500 tx=0x7fe260003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:10.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.783+0000 7fe26d600640 1 -- 172.21.15.17:0/2937395624 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260003e00 con 0x7fe270101ea0 2024-09-13T15:55:10.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.783+0000 7fe26d600640 1 -- 172.21.15.17:0/2937395624 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe260031c70 con 0x7fe270101ea0 2024-09-13T15:55:10.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.783+0000 7fe275c00640 1 -- 172.21.15.17:0/2937395624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe27019ff90 con 0x7fe270101ea0 2024-09-13T15:55:10.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.783+0000 7fe26d600640 1 -- 172.21.15.17:0/2937395624 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26003bdc0 con 0x7fe270101ea0 2024-09-13T15:55:10.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.783+0000 7fe275c00640 1 -- 172.21.15.17:0/2937395624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2701a0360 con 0x7fe270101ea0 2024-09-13T15:55:10.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.784+0000 7fe275c00640 1 -- 172.21.15.17:0/2937395624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2701093b0 con 0x7fe270101ea0 2024-09-13T15:55:10.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.786+0000 7fe26d600640 1 -- 172.21.15.17:0/2937395624 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe26003b4f0 con 0x7fe270101ea0 2024-09-13T15:55:10.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.787+0000 7fe26d600640 1 --2- 172.21.15.17:0/2937395624 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe2540a1090 0x7fe2540a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:10.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.787+0000 7fe26d600640 1 -- 172.21.15.17:0/2937395624 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fe2600ed4c0 con 0x7fe270101ea0 2024-09-13T15:55:10.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.788+0000 7fe267e00640 1 --2- 172.21.15.17:0/2937395624 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe2540a1090 0x7fe2540a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:10.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.788+0000 7fe267e00640 1 --2- 172.21.15.17:0/2937395624 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe2540a1090 0x7fe2540a3550 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe270199400 tx=0x7fe25800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:10.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.791+0000 7fe26d600640 1 -- 172.21.15.17:0/2937395624 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe2600b6a00 con 0x7fe270101ea0 2024-09-13T15:55:10.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.971+0000 7fe275c00640 1 -- 172.21.15.17:0/2937395624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe27010d800 con 0x7fe270101ea0 2024-09-13T15:55:10.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.971+0000 7fe26d600640 1 -- 172.21.15.17:0/2937395624 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe27010d800 con 0x7fe270101ea0 2024-09-13T15:55:10.975 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-09-13T15:55:10.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.973+0000 7fe275c00640 1 -- 172.21.15.17:0/2937395624 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe2540a1090 msgr2=0x7fe2540a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:10.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.973+0000 7fe275c00640 1 --2- 172.21.15.17:0/2937395624 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe2540a1090 0x7fe2540a3550 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe270199400 tx=0x7fe25800b390 comp rx=0 tx=0).stop 2024-09-13T15:55:10.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.973+0000 7fe275c00640 1 -- 172.21.15.17:0/2937395624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe270101ea0 msgr2=0x7fe270197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:10.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.973+0000 7fe275c00640 1 --2- 172.21.15.17:0/2937395624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe270101ea0 0x7fe270197ef0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe260031500 tx=0x7fe260003c10 comp rx=0 tx=0).stop 2024-09-13T15:55:10.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.973+0000 7fe275c00640 1 -- 172.21.15.17:0/2937395624 shutdown_connections 2024-09-13T15:55:10.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.973+0000 7fe275c00640 1 --2- 172.21.15.17:0/2937395624 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe2540a1090 0x7fe2540a3550 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.973+0000 7fe275c00640 1 --2- 172.21.15.17:0/2937395624 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe270103a40 0x7fe27019f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.973+0000 7fe275c00640 1 --2- 172.21.15.17:0/2937395624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe270103080 0x7fe270198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.973+0000 7fe275c00640 1 --2- 172.21.15.17:0/2937395624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe270101ea0 0x7fe270197ef0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:10.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.973+0000 7fe275c00640 1 -- 172.21.15.17:0/2937395624 >> 172.21.15.17:0/2937395624 conn(0x7fe2700fd670 msgr2=0x7fe270106580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:10.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.974+0000 7fe275c00640 1 -- 172.21.15.17:0/2937395624 shutdown_connections 2024-09-13T15:55:10.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:10.974+0000 7fe275c00640 1 -- 172.21.15.17:0/2937395624 wait complete. 2024-09-13T15:55:10.992 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:55:11.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.159+0000 7fd872c00640 1 -- 172.21.15.17:0/174294557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86c101ea0 msgr2=0x7fd86c1022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:11.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.159+0000 7fd872c00640 1 --2- 172.21.15.17:0/174294557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86c101ea0 0x7fd86c1022a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd860009900 tx=0x7fd86002a3f0 comp rx=0 tx=0).stop 2024-09-13T15:55:11.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.160+0000 7fd872c00640 1 -- 172.21.15.17:0/174294557 shutdown_connections 2024-09-13T15:55:11.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.160+0000 7fd872c00640 1 --2- 172.21.15.17:0/174294557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd86c103a40 0x7fd86c10a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:11.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.160+0000 7fd872c00640 1 --2- 172.21.15.17:0/174294557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd86c103080 0x7fd86c103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:11.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.160+0000 7fd872c00640 1 --2- 172.21.15.17:0/174294557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86c101ea0 0x7fd86c1022a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:11.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.160+0000 7fd872c00640 1 -- 172.21.15.17:0/174294557 >> 172.21.15.17:0/174294557 conn(0x7fd86c0fd670 msgr2=0x7fd86c0ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:11.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.160+0000 7fd872c00640 1 -- 172.21.15.17:0/174294557 shutdown_connections 2024-09-13T15:55:11.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.160+0000 7fd872c00640 1 -- 172.21.15.17:0/174294557 wait complete. 2024-09-13T15:55:11.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.161+0000 7fd872c00640 1 Processor -- start 2024-09-13T15:55:11.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.161+0000 7fd872c00640 1 -- start start 2024-09-13T15:55:11.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.161+0000 7fd872c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86c101ea0 0x7fd86c197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:11.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.161+0000 7fd872c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd86c103080 0x7fd86c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:11.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.161+0000 7fd872c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd86c103a40 0x7fd86c19f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:11.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.161+0000 7fd872c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c19f990 con 0x7fd86c101ea0 2024-09-13T15:55:11.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.161+0000 7fd872c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c19fb00 con 0x7fd86c103080 2024-09-13T15:55:11.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.161+0000 7fd872c00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c19fcc0 con 0x7fd86c103a40 2024-09-13T15:55:11.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.161+0000 7fd871800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86c101ea0 0x7fd86c197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:11.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.161+0000 7fd871800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86c101ea0 0x7fd86c197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56936/0 (socket says 172.21.15.17:56936) 2024-09-13T15:55:11.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.161+0000 7fd871800640 1 -- 172.21.15.17:0/2455046832 learned_addr learned my addr 172.21.15.17:0/2455046832 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:11.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.161+0000 7fd870e00640 1 --2- 172.21.15.17:0/2455046832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd86c103080 0x7fd86c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:11.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.161+0000 7fd872200640 1 --2- 172.21.15.17:0/2455046832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd86c103a40 0x7fd86c19f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:11.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.162+0000 7fd872200640 1 -- 172.21.15.17:0/2455046832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd86c103080 msgr2=0x7fd86c1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:11.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.162+0000 7fd872200640 1 --2- 172.21.15.17:0/2455046832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd86c103080 0x7fd86c1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:11.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.162+0000 7fd872200640 1 -- 172.21.15.17:0/2455046832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86c101ea0 msgr2=0x7fd86c197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:11.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.162+0000 7fd872200640 1 --2- 172.21.15.17:0/2455046832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86c101ea0 0x7fd86c197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:11.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.162+0000 7fd872200640 1 -- 172.21.15.17:0/2455046832 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd858009490 con 0x7fd86c103a40 2024-09-13T15:55:11.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.162+0000 7fd872200640 1 --2- 172.21.15.17:0/2455046832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd86c103a40 0x7fd86c19f450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd864009fd0 tx=0x7fd86400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:11.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.162+0000 7fd86a000640 1 -- 172.21.15.17:0/2455046832 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86400ce20 con 0x7fd86c103a40 2024-09-13T15:55:11.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.162+0000 7fd872c00640 1 -- 172.21.15.17:0/2455046832 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd860009560 con 0x7fd86c103a40 2024-09-13T15:55:11.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.163+0000 7fd86a000640 1 -- 172.21.15.17:0/2455046832 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd864010430 con 0x7fd86c103a40 2024-09-13T15:55:11.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.163+0000 7fd86a000640 1 -- 172.21.15.17:0/2455046832 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86400f620 con 0x7fd86c103a40 2024-09-13T15:55:11.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.163+0000 7fd872c00640 1 -- 172.21.15.17:0/2455046832 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd86c1a0290 con 0x7fd86c103a40 2024-09-13T15:55:11.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.163+0000 7fd872c00640 1 -- 172.21.15.17:0/2455046832 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86c1022a0 con 0x7fd86c103a40 2024-09-13T15:55:11.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.166+0000 7fd86a000640 1 -- 172.21.15.17:0/2455046832 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd864004a40 con 0x7fd86c103a40 2024-09-13T15:55:11.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.167+0000 7fd86a000640 1 --2- 172.21.15.17:0/2455046832 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd8540a1090 0x7fd8540a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:11.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.167+0000 7fd86a000640 1 -- 172.21.15.17:0/2455046832 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd864014070 con 0x7fd86c103a40 2024-09-13T15:55:11.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.167+0000 7fd871800640 1 --2- 172.21.15.17:0/2455046832 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd8540a1090 0x7fd8540a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:11.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.168+0000 7fd871800640 1 --2- 172.21.15.17:0/2455046832 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd8540a1090 0x7fd8540a3550 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd860000c00 tx=0x7fd8600314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:11.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.169+0000 7fd86a000640 1 -- 172.21.15.17:0/2455046832 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd864096820 con 0x7fd86c103a40 2024-09-13T15:55:11.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:11 smithi017 ceph-mon[30494]: pgmap v304: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-13T15:55:11.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:11 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/964877174' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:55:11.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:11 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/881363965' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T15:55:11.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:11 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/2937395624' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T15:55:11.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.350+0000 7fd872c00640 1 -- 172.21.15.17:0/2455046832 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd86c02c3e0 con 0x7fd86c103a40 2024-09-13T15:55:11.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.351+0000 7fd86a000640 1 -- 172.21.15.17:0/2455046832 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd864099e40 con 0x7fd86c103a40 2024-09-13T15:55:11.353 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-13T15:55:11.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.353+0000 7fd872c00640 1 -- 172.21.15.17:0/2455046832 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd8540a1090 msgr2=0x7fd8540a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:11.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.353+0000 7fd872c00640 1 --2- 172.21.15.17:0/2455046832 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd8540a1090 0x7fd8540a3550 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd860000c00 tx=0x7fd8600314a0 comp rx=0 tx=0).stop 2024-09-13T15:55:11.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.353+0000 7fd872c00640 1 -- 172.21.15.17:0/2455046832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd86c103a40 msgr2=0x7fd86c19f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:11.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.353+0000 7fd872c00640 1 --2- 172.21.15.17:0/2455046832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd86c103a40 0x7fd86c19f450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd864009fd0 tx=0x7fd86400ef10 comp rx=0 tx=0).stop 2024-09-13T15:55:11.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.353+0000 7fd872c00640 1 -- 172.21.15.17:0/2455046832 shutdown_connections 2024-09-13T15:55:11.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.353+0000 7fd872c00640 1 --2- 172.21.15.17:0/2455046832 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd8540a1090 0x7fd8540a3550 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:11.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.353+0000 7fd872c00640 1 --2- 172.21.15.17:0/2455046832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd86c103a40 0x7fd86c19f450 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:11.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.353+0000 7fd872c00640 1 --2- 172.21.15.17:0/2455046832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd86c103080 0x7fd86c1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:11.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.353+0000 7fd872c00640 1 --2- 172.21.15.17:0/2455046832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86c101ea0 0x7fd86c197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:11.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.353+0000 7fd872c00640 1 -- 172.21.15.17:0/2455046832 >> 172.21.15.17:0/2455046832 conn(0x7fd86c0fd670 msgr2=0x7fd86c106580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:11.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.354+0000 7fd872c00640 1 -- 172.21.15.17:0/2455046832 shutdown_connections 2024-09-13T15:55:11.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.354+0000 7fd872c00640 1 -- 172.21.15.17:0/2455046832 wait complete. 2024-09-13T15:55:11.371 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:55:11.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:11 smithi193 ceph-mon[35248]: pgmap v304: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-13T15:55:11.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:11 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/964877174' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:55:11.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:11 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/881363965' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T15:55:11.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:11 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/2937395624' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T15:55:11.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.527+0000 7fc7ee200640 1 -- 172.21.15.17:0/1112194057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7e8103180 msgr2=0x7fc7e8103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:11.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.527+0000 7fc7ee200640 1 --2- 172.21.15.17:0/1112194057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7e8103180 0x7fc7e8103600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009900 tx=0x7fc7d002a3f0 comp rx=0 tx=0).stop 2024-09-13T15:55:11.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.527+0000 7fc7ee200640 1 -- 172.21.15.17:0/1112194057 shutdown_connections 2024-09-13T15:55:11.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.527+0000 7fc7ee200640 1 --2- 172.21.15.17:0/1112194057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7e8103b40 0x7fc7e810a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:11.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.527+0000 7fc7ee200640 1 --2- 172.21.15.17:0/1112194057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7e8103180 0x7fc7e8103600 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:11.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.527+0000 7fc7ee200640 1 --2- 172.21.15.17:0/1112194057 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7e8101f90 0x7fc7e8102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.527+0000 7fc7ee200640 1 -- 172.21.15.17:0/1112194057 >> 172.21.15.17:0/1112194057 conn(0x7fc7e80fd6d0 msgr2=0x7fc7e80ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.527+0000 7fc7ee200640 1 -- 172.21.15.17:0/1112194057 shutdown_connections 2024-09-13T15:55:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.527+0000 7fc7ee200640 1 -- 172.21.15.17:0/1112194057 wait complete. 2024-09-13T15:55:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.528+0000 7fc7ee200640 1 Processor -- start 2024-09-13T15:55:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.528+0000 7fc7ee200640 1 -- start start 2024-09-13T15:55:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.528+0000 7fc7ee200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7e8101f90 0x7fc7e8197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.528+0000 7fc7ee200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7e8103180 0x7fc7e81984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.528+0000 7fc7ee200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7e8103b40 0x7fc7e819f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.528+0000 7fc7ee200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e819fa70 con 0x7fc7e8103b40 2024-09-13T15:55:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.528+0000 7fc7ee200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e819fbe0 con 0x7fc7e8103180 2024-09-13T15:55:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.528+0000 7fc7ee200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e819fda0 con 0x7fc7e8101f90 2024-09-13T15:55:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.529+0000 7fc7e7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7e8103b40 0x7fc7e819f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.529+0000 7fc7e7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7e8103b40 0x7fc7e819f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56956/0 (socket says 172.21.15.17:56956) 2024-09-13T15:55:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.529+0000 7fc7e7e00640 1 -- 172.21.15.17:0/1117878393 learned_addr learned my addr 172.21.15.17:0/1117878393 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.529+0000 7fc7dfe00640 1 --2- 172.21.15.17:0/1117878393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7e8103180 0x7fc7e81984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.529+0000 7fc7e7400640 1 --2- 172.21.15.17:0/1117878393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7e8101f90 0x7fc7e8197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.529+0000 7fc7e7e00640 1 -- 172.21.15.17:0/1117878393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7e8101f90 msgr2=0x7fc7e8197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.529+0000 7fc7e7e00640 1 --2- 172.21.15.17:0/1117878393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7e8101f90 0x7fc7e8197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:11.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.529+0000 7fc7e7e00640 1 -- 172.21.15.17:0/1117878393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7e8103180 msgr2=0x7fc7e81984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:11.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.529+0000 7fc7e7e00640 1 --2- 172.21.15.17:0/1117878393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7e8103180 0x7fc7e81984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:11.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.529+0000 7fc7e7e00640 1 -- 172.21.15.17:0/1117878393 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d0009560 con 0x7fc7e8103b40 2024-09-13T15:55:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.529+0000 7fc7e7e00640 1 --2- 172.21.15.17:0/1117878393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7e8103b40 0x7fc7e819f530 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000eb10 tx=0x7fc7e000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.530+0000 7fc7e4c00640 1 -- 172.21.15.17:0/1117878393 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0004b20 con 0x7fc7e8103b40 2024-09-13T15:55:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.530+0000 7fc7e4c00640 1 -- 172.21.15.17:0/1117878393 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7e0004c80 con 0x7fc7e8103b40 2024-09-13T15:55:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.530+0000 7fc7e4c00640 1 -- 172.21.15.17:0/1117878393 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0010690 con 0x7fc7e8103b40 2024-09-13T15:55:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.530+0000 7fc7ee200640 1 -- 172.21.15.17:0/1117878393 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e81a0080 con 0x7fc7e8103b40 2024-09-13T15:55:11.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.530+0000 7fc7ee200640 1 -- 172.21.15.17:0/1117878393 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e81a0510 con 0x7fc7e8103b40 2024-09-13T15:55:11.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.531+0000 7fc7ee200640 1 -- 172.21.15.17:0/1117878393 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e8109410 con 0x7fc7e8103b40 2024-09-13T15:55:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.533+0000 7fc7e4c00640 1 -- 172.21.15.17:0/1117878393 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc7e0005020 con 0x7fc7e8103b40 2024-09-13T15:55:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.534+0000 7fc7e4c00640 1 --2- 172.21.15.17:0/1117878393 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc7cc0a1110 0x7fc7cc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.534+0000 7fc7e4c00640 1 -- 172.21.15.17:0/1117878393 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc7e0014070 con 0x7fc7e8103b40 2024-09-13T15:55:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.534+0000 7fc7e7400640 1 --2- 172.21.15.17:0/1117878393 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc7cc0a1110 0x7fc7cc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.535+0000 7fc7e7400640 1 --2- 172.21.15.17:0/1117878393 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc7cc0a1110 0x7fc7cc0a35d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8102fe0 tx=0x7fc7d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:11.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.538+0000 7fc7e4c00640 1 -- 172.21.15.17:0/1117878393 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc7e0096590 con 0x7fc7e8103b40 2024-09-13T15:55:11.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:11 smithi189 ceph-mon[34790]: pgmap v304: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-13T15:55:11.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:11 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/964877174' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:55:11.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:11 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/881363965' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T15:55:11.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:11 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/2937395624' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T15:55:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.732+0000 7fc7ee200640 1 -- 172.21.15.17:0/1117878393 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc7e810d8a0 con 0x7fc7e8103b40 2024-09-13T15:55:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.733+0000 7fc7e4c00640 1 -- 172.21.15.17:0/1117878393 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) v1 ==== 81+0+589 (secure 0 0 0) 0x7fc7e0094e60 con 0x7fc7e8103b40 2024-09-13T15:55:11.734 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/386837955 2024-09-14T15:47:42.048005+0000 2024-09-13T15:55:11.735 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1550067038 2024-09-14T15:47:42.048005+0000 2024-09-13T15:55:11.735 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3360683829 2024-09-14T15:47:42.048005+0000 2024-09-13T15:55:11.735 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/634066188 2024-09-14T15:47:42.048005+0000 2024-09-13T15:55:11.735 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/1047258336 2024-09-14T15:47:14.996424+0000 2024-09-13T15:55:11.735 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/1047258336 2024-09-14T15:47:14.996424+0000 2024-09-13T15:55:11.735 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1945536687 2024-09-14T15:47:14.996424+0000 2024-09-13T15:55:11.735 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/386837955 2024-09-14T15:47:42.048005+0000 2024-09-13T15:55:11.735 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2214214377 2024-09-14T15:47:14.996424+0000 2024-09-13T15:55:11.735 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1224386591 2024-09-14T15:47:14.996424+0000 2024-09-13T15:55:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:listed 10 entries 2024-09-13T15:55:11.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.735+0000 7fc7ee200640 1 -- 172.21.15.17:0/1117878393 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc7cc0a1110 msgr2=0x7fc7cc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:11.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.735+0000 7fc7ee200640 1 --2- 172.21.15.17:0/1117878393 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc7cc0a1110 0x7fc7cc0a35d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8102fe0 tx=0x7fc7d8005f90 comp rx=0 tx=0).stop 2024-09-13T15:55:11.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.735+0000 7fc7ee200640 1 -- 172.21.15.17:0/1117878393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7e8103b40 msgr2=0x7fc7e819f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:11.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.735+0000 7fc7ee200640 1 --2- 172.21.15.17:0/1117878393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7e8103b40 0x7fc7e819f530 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000eb10 tx=0x7fc7e000c2d0 comp rx=0 tx=0).stop 2024-09-13T15:55:11.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.735+0000 7fc7ee200640 1 -- 172.21.15.17:0/1117878393 shutdown_connections 2024-09-13T15:55:11.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.735+0000 7fc7ee200640 1 --2- 172.21.15.17:0/1117878393 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc7cc0a1110 0x7fc7cc0a35d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:11.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.735+0000 7fc7ee200640 1 --2- 172.21.15.17:0/1117878393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7e8103b40 0x7fc7e819f530 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:11.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.735+0000 7fc7ee200640 1 --2- 172.21.15.17:0/1117878393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7e8103180 0x7fc7e81984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:11.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.735+0000 7fc7ee200640 1 --2- 172.21.15.17:0/1117878393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7e8101f90 0x7fc7e8197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:11.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.735+0000 7fc7ee200640 1 -- 172.21.15.17:0/1117878393 >> 172.21.15.17:0/1117878393 conn(0x7fc7e80fd6d0 msgr2=0x7fc7e81065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:11.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.735+0000 7fc7ee200640 1 -- 172.21.15.17:0/1117878393 shutdown_connections 2024-09-13T15:55:11.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:11.735+0000 7fc7ee200640 1 -- 172.21.15.17:0/1117878393 wait complete. 2024-09-13T15:55:11.752 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-13T15:55:11.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:55:11.752 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:55:11.806 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi017.stderr:ceph-fuse[74589]: fuse finished with error 0 and tester_r 0 2024-09-13T15:55:11.810 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:55:11.897 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-13T15:55:11.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:55:11.898 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-13T15:55:11.941 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:55:12.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.137+0000 7f9987200640 1 -- 172.21.15.17:0/279195550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9988102fc0 msgr2=0x7f9988103440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:12.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.137+0000 7f9987200640 1 --2- 172.21.15.17:0/279195550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9988102fc0 0x7f9988103440 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9970009900 tx=0x7f997002a410 comp rx=0 tx=0).stop 2024-09-13T15:55:12.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.137+0000 7f9987200640 1 -- 172.21.15.17:0/279195550 shutdown_connections 2024-09-13T15:55:12.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.137+0000 7f9987200640 1 --2- 172.21.15.17:0/279195550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9988103980 0x7f998810a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.137+0000 7f9987200640 1 --2- 172.21.15.17:0/279195550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9988102fc0 0x7f9988103440 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.137+0000 7f9987200640 1 --2- 172.21.15.17:0/279195550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9988101dd0 0x7f99881021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.137+0000 7f9987200640 1 -- 172.21.15.17:0/279195550 >> 172.21.15.17:0/279195550 conn(0x7f99880fd510 msgr2=0x7f99880ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:12.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.137+0000 7f9987200640 1 -- 172.21.15.17:0/279195550 shutdown_connections 2024-09-13T15:55:12.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.137+0000 7f9987200640 1 -- 172.21.15.17:0/279195550 wait complete. 2024-09-13T15:55:12.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.138+0000 7f9987200640 1 Processor -- start 2024-09-13T15:55:12.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.138+0000 7f9987200640 1 -- start start 2024-09-13T15:55:12.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.138+0000 7f9987200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9988101dd0 0x7f9988197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:12.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.138+0000 7f9987200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9988102fc0 0x7f9988198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:12.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.138+0000 7f9987200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9988103980 0x7f998819f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:12.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.138+0000 7f9987200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998819f8c0 con 0x7f9988102fc0 2024-09-13T15:55:12.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.138+0000 7f9987200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998819fa30 con 0x7f9988101dd0 2024-09-13T15:55:12.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.138+0000 7f9987200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998819fbf0 con 0x7f9988103980 2024-09-13T15:55:12.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.138+0000 7f997d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9988102fc0 0x7f9988198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:12.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.138+0000 7f997d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9988102fc0 0x7f9988198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56976/0 (socket says 172.21.15.17:56976) 2024-09-13T15:55:12.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.138+0000 7f997d400640 1 -- 172.21.15.17:0/4202875237 learned_addr learned my addr 172.21.15.17:0/4202875237 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:12.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.139+0000 7f9986800640 1 --2- 172.21.15.17:0/4202875237 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9988103980 0x7f998819f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:12.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.139+0000 7f9985e00640 1 --2- 172.21.15.17:0/4202875237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9988101dd0 0x7f9988197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:12.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.139+0000 7f997d400640 1 -- 172.21.15.17:0/4202875237 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9988103980 msgr2=0x7f998819f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:12.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.139+0000 7f997d400640 1 --2- 172.21.15.17:0/4202875237 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9988103980 0x7f998819f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.139+0000 7f997d400640 1 -- 172.21.15.17:0/4202875237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9988101dd0 msgr2=0x7f9988197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:12.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.139+0000 7f997d400640 1 --2- 172.21.15.17:0/4202875237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9988101dd0 0x7f9988197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.139+0000 7f997d400640 1 -- 172.21.15.17:0/4202875237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9970009560 con 0x7f9988102fc0 2024-09-13T15:55:12.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.139+0000 7f997d400640 1 --2- 172.21.15.17:0/4202875237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9988102fc0 0x7f9988198360 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9970031500 tx=0x7f9970003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:12.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.140+0000 7f997f400640 1 -- 172.21.15.17:0/4202875237 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9970003e00 con 0x7f9988102fc0 2024-09-13T15:55:12.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.140+0000 7f997f400640 1 -- 172.21.15.17:0/4202875237 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9970031c70 con 0x7f9988102fc0 2024-09-13T15:55:12.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.140+0000 7f997f400640 1 -- 172.21.15.17:0/4202875237 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997003bc20 con 0x7f9988102fc0 2024-09-13T15:55:12.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.140+0000 7f9987200640 1 -- 172.21.15.17:0/4202875237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998819fe70 con 0x7f9988102fc0 2024-09-13T15:55:12.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.140+0000 7f9987200640 1 -- 172.21.15.17:0/4202875237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99881a0290 con 0x7f9988102fc0 2024-09-13T15:55:12.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.141+0000 7f9987200640 1 -- 172.21.15.17:0/4202875237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9988109300 con 0x7f9988102fc0 2024-09-13T15:55:12.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.143+0000 7f997f400640 1 -- 172.21.15.17:0/4202875237 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f99700317b0 con 0x7f9988102fc0 2024-09-13T15:55:12.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.145+0000 7f997f400640 1 --2- 172.21.15.17:0/4202875237 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f996c0a1110 0x7f996c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:12.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.145+0000 7f997f400640 1 -- 172.21.15.17:0/4202875237 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f99700ed300 con 0x7f9988102fc0 2024-09-13T15:55:12.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.145+0000 7f9985e00640 1 --2- 172.21.15.17:0/4202875237 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f996c0a1110 0x7f996c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:12.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.146+0000 7f9985e00640 1 --2- 172.21.15.17:0/4202875237 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f996c0a1110 0x7f996c0a35d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9988102e20 tx=0x7f9978005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:12.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.148+0000 7f997f400640 1 -- 172.21.15.17:0/4202875237 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f99700b68f0 con 0x7f9988102fc0 2024-09-13T15:55:12.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.332+0000 7f9987200640 1 -- 172.21.15.17:0/4202875237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f998810d6c0 con 0x7f9988102fc0 2024-09-13T15:55:12.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.334+0000 7f997f400640 1 -- 172.21.15.17:0/4202875237 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23935 (secure 0 0 0) 0x7f99700b9f10 con 0x7f9988102fc0 2024-09-13T15:55:12.336 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:55:12.336 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":90,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","created":"2024-09-13T15:46:50.475750+0000","modified":"2024-09-13T15:54:57.383548+0000","last_up_change":"2024-09-13T15:53:59.138985+0000","last_in_change":"2024-09-13T15:53:39.220264+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:50:10.657011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:54:51.436469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:54:52.427930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:54:55.478058+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5d39d6af-15e6-463b-b9ff-a9a5dd94e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6803","nonce":158651212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6805","nonce":158651212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6809","nonce":158651212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6807","nonce":158651212}]},"public_addr":"172.21.15.17:6803/158651212","cluster_addr":"172.21.15.17:6805/158651212","heartbeat_back_addr":"172.21.15.17:6809/158651212","heartbeat_front_addr":"172.21.15.17:6807/158651212","state":["exists","up"]},{"osd":1,"uuid":"0da621c7-645b-44ae-ba7c-a573861c3aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6801","nonce":964319421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6803","nonce":964319421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6807","nonce":964319421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6805","nonce":964319421}]},"public_addr":"172.21.15.189:6801/964319421","cluster_addr":"172.21.15.189:6803/964319421","heartbeat_back_addr":"172.21.15.189:6807/964319421","heartbeat_front_addr":"172.21.15.189:6805/964319421","state":["exists","up"]},{"osd":2,"uuid":"fa95af60-1486-4a29-8c79-8a73a4146552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6801","nonce":138468002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6803","nonce":138468002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6807","nonce":138468002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6805","nonce":138468002}]},"public_addr":"172.21.15.193:6801/138468002","cluster_addr":"172.21.15.193:6803/138468002","heartbeat_back_addr":"172.21.15.193:6807/138468002","heartbeat_front_addr":"172.21.15.193:6805/138468002","state":["exists","up"]},{"osd":3,"uuid":"90428e5f-dfd4-4cda-b240-fdb9079bcb7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6811","nonce":919913803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6813","nonce":919913803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6817","nonce":919913803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6815","nonce":919913803}]},"public_addr":"172.21.15.17:6811/919913803","cluster_addr":"172.21.15.17:6813/919913803","heartbeat_back_addr":"172.21.15.17:6817/919913803","heartbeat_front_addr":"172.21.15.17:6815/919913803","state":["exists","up"]},{"osd":4,"uuid":"e1c537b6-98d2-4b66-b15a-65fe70b0ce25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6809","nonce":2310375565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6811","nonce":2310375565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6815","nonce":2310375565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6813","nonce":2310375565}]},"public_addr":"172.21.15.189:6809/2310375565","cluster_addr":"172.21.15.189:6811/2310375565","heartbeat_back_addr":"172.21.15.189:6815/2310375565","heartbeat_front_addr":"172.21.15.189:6813/2310375565","state":["exists","up"]},{"osd":5,"uuid":"48522fd7-d781-4447-873f-174dabd1e33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6809","nonce":1330877824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6811","nonce":1330877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6815","nonce":1330877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6813","nonce":1330877824}]},"public_addr":"172.21.15.193:6809/1330877824","cluster_addr":"172.21.15.193:6811/1330877824","heartbeat_back_addr":"172.21.15.193:6815/1330877824","heartbeat_front_addr":"172.21.15.193:6813/1330877824","state":["exists","up"]},{"osd":6,"uuid":"47bea191-fb53-40a7-8563-8ebf17dd5bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6819","nonce":3930545382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6821","nonce":3930545382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6825","nonce":3930545382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6823","nonce":3930545382}]},"public_addr":"172.21.15.17:6819/3930545382","cluster_addr":"172.21.15.17:6821/3930545382","heartbeat_back_addr":"172.21.15.17:6825/3930545382","heartbeat_front_addr":"172.21.15.17:6823/3930545382","state":["exists","up"]},{"osd":7,"uuid":"a98f36f9-0a19-4c9a-8ed1-615c4a6e7658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6817","nonce":3691677495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6819","nonce":3691677495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6823","nonce":3691677495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6821","nonce":3691677495}]},"public_addr":"172.21.15.189:6817/3691677495","cluster_addr":"172.21.15.189:6819/3691677495","heartbeat_back_addr":"172.21.15.189:6823/3691677495","heartbeat_front_addr":"172.21.15.189:6821/3691677495","state":["exists","up"]},{"osd":8,"uuid":"7a372d9f-c40f-4ead-87da-2f3a570c1373","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6817","nonce":4112907498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6819","nonce":4112907498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6823","nonce":4112907498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6821","nonce":4112907498}]},"public_addr":"172.21.15.193:6817/4112907498","cluster_addr":"172.21.15.193:6819/4112907498","heartbeat_back_addr":"172.21.15.193:6823/4112907498","heartbeat_front_addr":"172.21.15.193:6821/4112907498","state":["exists","up"]},{"osd":9,"uuid":"ac3d983c-c5e7-456b-8271-7c4e6169de61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6827","nonce":663424274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6829","nonce":663424274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6833","nonce":663424274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6831","nonce":663424274}]},"public_addr":"172.21.15.17:6827/663424274","cluster_addr":"172.21.15.17:6829/663424274","heartbeat_back_addr":"172.21.15.17:6833/663424274","heartbeat_front_addr":"172.21.15.17:6831/663424274","state":["exists","up"]},{"osd":10,"uuid":"08dcae02-6c79-4a06-ae88-6eb6e6941cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6825","nonce":3153990375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6827","nonce":3153990375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6831","nonce":3153990375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6829","nonce":3153990375}]},"public_addr":"172.21.15.189:6825/3153990375","cluster_addr":"172.21.15.189:6827/3153990375","heartbeat_back_addr":"172.21.15.189:6831/3153990375","heartbeat_front_addr":"172.21.15.189:6829/3153990375","state":["exists","up"]},{"osd":11,"uuid":"a4ebcf41-d805-4d44-b112-13ae84d51868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6825","nonce":4088053907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6827","nonce":4088053907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6831","nonce":4088053907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6829","nonce":4088053907}]},"public_addr":"172.21.15.193:6825/4088053907","cluster_addr":"172.21.15.193:6827/4088053907","heartbeat_back_addr":"172.21.15.193:6831/4088053907","heartbeat_front_addr":"172.21.15.193:6829/4088053907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:22.172370+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:44.802224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:06.641435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:34.536515+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:58.789324+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:22.189862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:50.382257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:14.678047+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:38.581105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:07.258150+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:32.261383+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:56.739338+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/1550067038":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/3360683829":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/634066188":"2024-09-14T15:47:42.048005+0000","172.21.15.17:6801/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1945536687":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/2214214377":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1224386591":"2024-09-14T15:47:14.996424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:55:12.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.336+0000 7f9987200640 1 -- 172.21.15.17:0/4202875237 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f996c0a1110 msgr2=0x7f996c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:12.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.336+0000 7f9987200640 1 --2- 172.21.15.17:0/4202875237 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f996c0a1110 0x7f996c0a35d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9988102e20 tx=0x7f9978005f90 comp rx=0 tx=0).stop 2024-09-13T15:55:12.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.336+0000 7f9987200640 1 -- 172.21.15.17:0/4202875237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9988102fc0 msgr2=0x7f9988198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:12.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.336+0000 7f9987200640 1 --2- 172.21.15.17:0/4202875237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9988102fc0 0x7f9988198360 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9970031500 tx=0x7f9970003c10 comp rx=0 tx=0).stop 2024-09-13T15:55:12.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.336+0000 7f9987200640 1 -- 172.21.15.17:0/4202875237 shutdown_connections 2024-09-13T15:55:12.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.336+0000 7f9987200640 1 --2- 172.21.15.17:0/4202875237 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f996c0a1110 0x7f996c0a35d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.336+0000 7f9987200640 1 --2- 172.21.15.17:0/4202875237 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9988103980 0x7f998819f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.336+0000 7f9987200640 1 --2- 172.21.15.17:0/4202875237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9988102fc0 0x7f9988198360 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.336+0000 7f9987200640 1 --2- 172.21.15.17:0/4202875237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9988101dd0 0x7f9988197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.336+0000 7f9987200640 1 -- 172.21.15.17:0/4202875237 >> 172.21.15.17:0/4202875237 conn(0x7f99880fd510 msgr2=0x7f99881064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:12.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.336+0000 7f9987200640 1 -- 172.21.15.17:0/4202875237 shutdown_connections 2024-09-13T15:55:12.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.336+0000 7f9987200640 1 -- 172.21.15.17:0/4202875237 wait complete. 2024-09-13T15:55:12.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:12 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/2455046832' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T15:55:12.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:12 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1117878393' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T15:55:12.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:12 smithi017 ceph-mon[30494]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-13T15:55:12.354 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:55:12.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:12 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/2455046832' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T15:55:12.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:12 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1117878393' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T15:55:12.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:12 smithi193 ceph-mon[35248]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-13T15:55:12.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.510+0000 7f34a9c00640 1 -- 172.21.15.17:0/2173984681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a4076a50 msgr2=0x7f34a40772f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:12.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.510+0000 7f34a9c00640 1 --2- 172.21.15.17:0/2173984681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a4076a50 0x7f34a40772f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f349c009ca0 tx=0x7f349c02a8b0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.510+0000 7f34a9c00640 1 -- 172.21.15.17:0/2173984681 shutdown_connections 2024-09-13T15:55:12.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.510+0000 7f34a9c00640 1 --2- 172.21.15.17:0/2173984681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a4076a50 0x7f34a40772f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.511+0000 7f34a9c00640 1 --2- 172.21.15.17:0/2173984681 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34a40760b0 0x7f34a4076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.511+0000 7f34a9c00640 1 --2- 172.21.15.17:0/2173984681 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34a4074e70 0x7f34a4075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.511+0000 7f34a9c00640 1 -- 172.21.15.17:0/2173984681 >> 172.21.15.17:0/2173984681 conn(0x7f34a40fd530 msgr2=0x7f34a40ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:12.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.511+0000 7f34a9c00640 1 -- 172.21.15.17:0/2173984681 shutdown_connections 2024-09-13T15:55:12.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.511+0000 7f34a9c00640 1 -- 172.21.15.17:0/2173984681 wait complete. 2024-09-13T15:55:12.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.511+0000 7f34a9c00640 1 Processor -- start 2024-09-13T15:55:12.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.512+0000 7f34a9c00640 1 -- start start 2024-09-13T15:55:12.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.512+0000 7f34a9c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a4074e70 0x7f34a419c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:12.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.512+0000 7f34a9c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34a40760b0 0x7f34a419c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:12.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.512+0000 7f34a9c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34a4076a50 0x7f34a41a3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:12.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.512+0000 7f34a9c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a41a3c70 con 0x7f34a4074e70 2024-09-13T15:55:12.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.512+0000 7f34a9c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a41a3de0 con 0x7f34a40760b0 2024-09-13T15:55:12.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.512+0000 7f34a9c00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a41a3fa0 con 0x7f34a4076a50 2024-09-13T15:55:12.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.512+0000 7f34a3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a4074e70 0x7f34a419c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:12.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.512+0000 7f34a3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a4074e70 0x7f34a419c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56990/0 (socket says 172.21.15.17:56990) 2024-09-13T15:55:12.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.512+0000 7f34a3e00640 1 -- 172.21.15.17:0/3818265243 learned_addr learned my addr 172.21.15.17:0/3818265243 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:12.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.512+0000 7f349be00640 1 --2- 172.21.15.17:0/3818265243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34a40760b0 0x7f34a419c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:12.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.512+0000 7f34a9200640 1 --2- 172.21.15.17:0/3818265243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34a4076a50 0x7f34a41a3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:12.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.513+0000 7f34a3e00640 1 -- 172.21.15.17:0/3818265243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34a4076a50 msgr2=0x7f34a41a3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:12.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.513+0000 7f34a3e00640 1 --2- 172.21.15.17:0/3818265243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34a4076a50 0x7f34a41a3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.513+0000 7f34a3e00640 1 -- 172.21.15.17:0/3818265243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34a40760b0 msgr2=0x7f34a419c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:12.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.513+0000 7f34a3e00640 1 --2- 172.21.15.17:0/3818265243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34a40760b0 0x7f34a419c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.513+0000 7f34a3e00640 1 -- 172.21.15.17:0/3818265243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c009490 con 0x7f34a4074e70 2024-09-13T15:55:12.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.513+0000 7f34a3e00640 1 --2- 172.21.15.17:0/3818265243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a4074e70 0x7f34a419c180 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f349400e9f0 tx=0x7f349400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:12.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.513+0000 7f34a1600640 1 -- 172.21.15.17:0/3818265243 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494009700 con 0x7f34a4074e70 2024-09-13T15:55:12.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.513+0000 7f34a1600640 1 -- 172.21.15.17:0/3818265243 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f349400cd80 con 0x7f34a4074e70 2024-09-13T15:55:12.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.513+0000 7f34a9c00640 1 -- 172.21.15.17:0/3818265243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349c009900 con 0x7f34a4074e70 2024-09-13T15:55:12.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.513+0000 7f34a1600640 1 -- 172.21.15.17:0/3818265243 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494018860 con 0x7f34a4074e70 2024-09-13T15:55:12.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.513+0000 7f34a9c00640 1 -- 172.21.15.17:0/3818265243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a41a4600 con 0x7f34a4074e70 2024-09-13T15:55:12.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.514+0000 7f34a9c00640 1 -- 172.21.15.17:0/3818265243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a410e720 con 0x7f34a4074e70 2024-09-13T15:55:12.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.516+0000 7f34a1600640 1 -- 172.21.15.17:0/3818265243 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f34940189c0 con 0x7f34a4074e70 2024-09-13T15:55:12.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.517+0000 7f34a1600640 1 --2- 172.21.15.17:0/3818265243 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f34880a1090 0x7f34880a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:12.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.517+0000 7f34a1600640 1 -- 172.21.15.17:0/3818265243 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f3494014070 con 0x7f34a4074e70 2024-09-13T15:55:12.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.518+0000 7f349be00640 1 --2- 172.21.15.17:0/3818265243 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f34880a1090 0x7f34880a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:12.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.518+0000 7f349be00640 1 --2- 172.21.15.17:0/3818265243 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f34880a1090 0x7f34880a3550 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f34a419d690 tx=0x7f348c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:12.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.521+0000 7f34a1600640 1 -- 172.21.15.17:0/3818265243 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3494052e20 con 0x7f34a4074e70 2024-09-13T15:55:12.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:12 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/2455046832' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T15:55:12.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:12 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1117878393' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T15:55:12.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:12 smithi189 ceph-mon[34790]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-13T15:55:12.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.702+0000 7f34a9c00640 1 -- 172.21.15.17:0/3818265243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34a4111b10 con 0x7f34a4074e70 2024-09-13T15:55:12.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.703+0000 7f34a1600640 1 -- 172.21.15.17:0/3818265243 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23935 (secure 0 0 0) 0x7f34940964a0 con 0x7f34a4074e70 2024-09-13T15:55:12.705 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:55:12.705 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":90,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","created":"2024-09-13T15:46:50.475750+0000","modified":"2024-09-13T15:54:57.383548+0000","last_up_change":"2024-09-13T15:53:59.138985+0000","last_in_change":"2024-09-13T15:53:39.220264+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:50:10.657011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:54:51.436469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:54:52.427930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:54:55.478058+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5d39d6af-15e6-463b-b9ff-a9a5dd94e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6803","nonce":158651212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6805","nonce":158651212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6809","nonce":158651212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6807","nonce":158651212}]},"public_addr":"172.21.15.17:6803/158651212","cluster_addr":"172.21.15.17:6805/158651212","heartbeat_back_addr":"172.21.15.17:6809/158651212","heartbeat_front_addr":"172.21.15.17:6807/158651212","state":["exists","up"]},{"osd":1,"uuid":"0da621c7-645b-44ae-ba7c-a573861c3aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6801","nonce":964319421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6803","nonce":964319421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6807","nonce":964319421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6805","nonce":964319421}]},"public_addr":"172.21.15.189:6801/964319421","cluster_addr":"172.21.15.189:6803/964319421","heartbeat_back_addr":"172.21.15.189:6807/964319421","heartbeat_front_addr":"172.21.15.189:6805/964319421","state":["exists","up"]},{"osd":2,"uuid":"fa95af60-1486-4a29-8c79-8a73a4146552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6801","nonce":138468002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6803","nonce":138468002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6807","nonce":138468002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6805","nonce":138468002}]},"public_addr":"172.21.15.193:6801/138468002","cluster_addr":"172.21.15.193:6803/138468002","heartbeat_back_addr":"172.21.15.193:6807/138468002","heartbeat_front_addr":"172.21.15.193:6805/138468002","state":["exists","up"]},{"osd":3,"uuid":"90428e5f-dfd4-4cda-b240-fdb9079bcb7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6811","nonce":919913803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6813","nonce":919913803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6817","nonce":919913803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6815","nonce":919913803}]},"public_addr":"172.21.15.17:6811/919913803","cluster_addr":"172.21.15.17:6813/919913803","heartbeat_back_addr":"172.21.15.17:6817/919913803","heartbeat_front_addr":"172.21.15.17:6815/919913803","state":["exists","up"]},{"osd":4,"uuid":"e1c537b6-98d2-4b66-b15a-65fe70b0ce25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6809","nonce":2310375565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6811","nonce":2310375565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6815","nonce":2310375565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6813","nonce":2310375565}]},"public_addr":"172.21.15.189:6809/2310375565","cluster_addr":"172.21.15.189:6811/2310375565","heartbeat_back_addr":"172.21.15.189:6815/2310375565","heartbeat_front_addr":"172.21.15.189:6813/2310375565","state":["exists","up"]},{"osd":5,"uuid":"48522fd7-d781-4447-873f-174dabd1e33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6809","nonce":1330877824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6811","nonce":1330877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6815","nonce":1330877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6813","nonce":1330877824}]},"public_addr":"172.21.15.193:6809/1330877824","cluster_addr":"172.21.15.193:6811/1330877824","heartbeat_back_addr":"172.21.15.193:6815/1330877824","heartbeat_front_addr":"172.21.15.193:6813/1330877824","state":["exists","up"]},{"osd":6,"uuid":"47bea191-fb53-40a7-8563-8ebf17dd5bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6819","nonce":3930545382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6821","nonce":3930545382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6825","nonce":3930545382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6823","nonce":3930545382}]},"public_addr":"172.21.15.17:6819/3930545382","cluster_addr":"172.21.15.17:6821/3930545382","heartbeat_back_addr":"172.21.15.17:6825/3930545382","heartbeat_front_addr":"172.21.15.17:6823/3930545382","state":["exists","up"]},{"osd":7,"uuid":"a98f36f9-0a19-4c9a-8ed1-615c4a6e7658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6817","nonce":3691677495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6819","nonce":3691677495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6823","nonce":3691677495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6821","nonce":3691677495}]},"public_addr":"172.21.15.189:6817/3691677495","cluster_addr":"172.21.15.189:6819/3691677495","heartbeat_back_addr":"172.21.15.189:6823/3691677495","heartbeat_front_addr":"172.21.15.189:6821/3691677495","state":["exists","up"]},{"osd":8,"uuid":"7a372d9f-c40f-4ead-87da-2f3a570c1373","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6817","nonce":4112907498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6819","nonce":4112907498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6823","nonce":4112907498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6821","nonce":4112907498}]},"public_addr":"172.21.15.193:6817/4112907498","cluster_addr":"172.21.15.193:6819/4112907498","heartbeat_back_addr":"172.21.15.193:6823/4112907498","heartbeat_front_addr":"172.21.15.193:6821/4112907498","state":["exists","up"]},{"osd":9,"uuid":"ac3d983c-c5e7-456b-8271-7c4e6169de61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6827","nonce":663424274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6829","nonce":663424274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6833","nonce":663424274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6831","nonce":663424274}]},"public_addr":"172.21.15.17:6827/663424274","cluster_addr":"172.21.15.17:6829/663424274","heartbeat_back_addr":"172.21.15.17:6833/663424274","heartbeat_front_addr":"172.21.15.17:6831/663424274","state":["exists","up"]},{"osd":10,"uuid":"08dcae02-6c79-4a06-ae88-6eb6e6941cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6825","nonce":3153990375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6827","nonce":3153990375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6831","nonce":3153990375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6829","nonce":3153990375}]},"public_addr":"172.21.15.189:6825/3153990375","cluster_addr":"172.21.15.189:6827/3153990375","heartbeat_back_addr":"172.21.15.189:6831/3153990375","heartbeat_front_addr":"172.21.15.189:6829/3153990375","state":["exists","up"]},{"osd":11,"uuid":"a4ebcf41-d805-4d44-b112-13ae84d51868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6825","nonce":4088053907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6827","nonce":4088053907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6831","nonce":4088053907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6829","nonce":4088053907}]},"public_addr":"172.21.15.193:6825/4088053907","cluster_addr":"172.21.15.193:6827/4088053907","heartbeat_back_addr":"172.21.15.193:6831/4088053907","heartbeat_front_addr":"172.21.15.193:6829/4088053907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:22.172370+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:44.802224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:06.641435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:34.536515+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:58.789324+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:22.189862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:50.382257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:14.678047+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:38.581105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:07.258150+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:32.261383+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:56.739338+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/1550067038":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/3360683829":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/634066188":"2024-09-14T15:47:42.048005+0000","172.21.15.17:6801/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1945536687":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/2214214377":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1224386591":"2024-09-14T15:47:14.996424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:55:12.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.705+0000 7f34a9c00640 1 -- 172.21.15.17:0/3818265243 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f34880a1090 msgr2=0x7f34880a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:12.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.705+0000 7f34a9c00640 1 --2- 172.21.15.17:0/3818265243 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f34880a1090 0x7f34880a3550 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f34a419d690 tx=0x7f348c005f90 comp rx=0 tx=0).stop 2024-09-13T15:55:12.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.705+0000 7f34a9c00640 1 -- 172.21.15.17:0/3818265243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a4074e70 msgr2=0x7f34a419c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:12.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.705+0000 7f34a9c00640 1 --2- 172.21.15.17:0/3818265243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a4074e70 0x7f34a419c180 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f349400e9f0 tx=0x7f349400eeb0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.706+0000 7f34a9c00640 1 -- 172.21.15.17:0/3818265243 shutdown_connections 2024-09-13T15:55:12.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.706+0000 7f34a9c00640 1 --2- 172.21.15.17:0/3818265243 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f34880a1090 0x7f34880a3550 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.706+0000 7f34a9c00640 1 --2- 172.21.15.17:0/3818265243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34a4076a50 0x7f34a41a3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.706+0000 7f34a9c00640 1 --2- 172.21.15.17:0/3818265243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34a40760b0 0x7f34a419c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.706+0000 7f34a9c00640 1 --2- 172.21.15.17:0/3818265243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a4074e70 0x7f34a419c180 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.706+0000 7f34a9c00640 1 -- 172.21.15.17:0/3818265243 >> 172.21.15.17:0/3818265243 conn(0x7f34a40fd530 msgr2=0x7f34a40fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:12.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.706+0000 7f34a9c00640 1 -- 172.21.15.17:0/3818265243 shutdown_connections 2024-09-13T15:55:12.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.706+0000 7f34a9c00640 1 -- 172.21.15.17:0/3818265243 wait complete. 2024-09-13T15:55:12.726 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T15:55:12.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.886+0000 7f1989200640 1 -- 172.21.15.17:0/1761853859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1984103b30 msgr2=0x7f198410a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:12.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.886+0000 7f1989200640 1 --2- 172.21.15.17:0/1761853859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1984103b30 0x7f198410a3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f197c009be0 tx=0x7f197c02a6c0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.886+0000 7f1989200640 1 -- 172.21.15.17:0/1761853859 shutdown_connections 2024-09-13T15:55:12.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.886+0000 7f1989200640 1 --2- 172.21.15.17:0/1761853859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1984103b30 0x7f198410a3c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.886+0000 7f1989200640 1 --2- 172.21.15.17:0/1761853859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1984103170 0x7f19841035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.886+0000 7f1989200640 1 --2- 172.21.15.17:0/1761853859 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1984101f80 0x7f1984102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.886+0000 7f1989200640 1 -- 172.21.15.17:0/1761853859 >> 172.21.15.17:0/1761853859 conn(0x7f19840fd700 msgr2=0x7f19840ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:12.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.887+0000 7f1989200640 1 -- 172.21.15.17:0/1761853859 shutdown_connections 2024-09-13T15:55:12.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.887+0000 7f1989200640 1 -- 172.21.15.17:0/1761853859 wait complete. 2024-09-13T15:55:12.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.888+0000 7f1989200640 1 Processor -- start 2024-09-13T15:55:12.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.888+0000 7f1989200640 1 -- start start 2024-09-13T15:55:12.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.888+0000 7f1989200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1984101f80 0x7f1984197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:12.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.888+0000 7f1989200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1984103170 0x7f1984198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:12.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.888+0000 7f1989200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1984103b30 0x7f198419f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:12.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.888+0000 7f1989200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198419fab0 con 0x7f1984103b30 2024-09-13T15:55:12.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.888+0000 7f1989200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198419fc20 con 0x7f1984101f80 2024-09-13T15:55:12.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.888+0000 7f1989200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198419fde0 con 0x7f1984103170 2024-09-13T15:55:12.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.888+0000 7f197be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1984103170 0x7f1984198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:12.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.888+0000 7f1982800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1984103b30 0x7f198419f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:12.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.888+0000 7f197be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1984103170 0x7f1984198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:60440/0 (socket says 172.21.15.17:60440) 2024-09-13T15:55:12.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.888+0000 7f197be00640 1 -- 172.21.15.17:0/1027783738 learned_addr learned my addr 172.21.15.17:0/1027783738 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:12.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.888+0000 7f1981e00640 1 --2- 172.21.15.17:0/1027783738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1984101f80 0x7f1984197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:12.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.889+0000 7f197be00640 1 -- 172.21.15.17:0/1027783738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1984101f80 msgr2=0x7f1984197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:12.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.889+0000 7f197be00640 1 --2- 172.21.15.17:0/1027783738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1984101f80 0x7f1984197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.889+0000 7f197be00640 1 -- 172.21.15.17:0/1027783738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1984103b30 msgr2=0x7f198419f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:12.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.889+0000 7f197be00640 1 --2- 172.21.15.17:0/1027783738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1984103b30 0x7f198419f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:12.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.889+0000 7f197be00640 1 -- 172.21.15.17:0/1027783738 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c009560 con 0x7f1984103170 2024-09-13T15:55:12.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.889+0000 7f197be00640 1 --2- 172.21.15.17:0/1027783738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1984103170 0x7f1984198500 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f196c00e9c0 tx=0x7f196c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:12.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.889+0000 7f197aa00640 1 -- 172.21.15.17:0/1027783738 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c00cde0 con 0x7f1984103170 2024-09-13T15:55:12.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.889+0000 7f197aa00640 1 -- 172.21.15.17:0/1027783738 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f196c0035f0 con 0x7f1984103170 2024-09-13T15:55:12.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.889+0000 7f1989200640 1 -- 172.21.15.17:0/1027783738 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197c009840 con 0x7f1984103170 2024-09-13T15:55:12.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.889+0000 7f197aa00640 1 -- 172.21.15.17:0/1027783738 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c0044e0 con 0x7f1984103170 2024-09-13T15:55:12.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.889+0000 7f1989200640 1 -- 172.21.15.17:0/1027783738 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19841a0440 con 0x7f1984103170 2024-09-13T15:55:12.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.890+0000 7f1989200640 1 -- 172.21.15.17:0/1027783738 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1984109400 con 0x7f1984103170 2024-09-13T15:55:12.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.892+0000 7f197aa00640 1 -- 172.21.15.17:0/1027783738 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f196c003760 con 0x7f1984103170 2024-09-13T15:55:12.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.894+0000 7f197aa00640 1 --2- 172.21.15.17:0/1027783738 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f19680a1090 0x7f19680a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:12.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.894+0000 7f197aa00640 1 -- 172.21.15.17:0/1027783738 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f196c014070 con 0x7f1984103170 2024-09-13T15:55:12.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.894+0000 7f1981e00640 1 --2- 172.21.15.17:0/1027783738 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f19680a1090 0x7f19680a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:12.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.895+0000 7f1981e00640 1 --2- 172.21.15.17:0/1027783738 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f19680a1090 0x7f19680a3550 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1984102fd0 tx=0x7f1974005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:12.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:12.895+0000 7f197aa00640 1 -- 172.21.15.17:0/1027783738 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f196c096680 con 0x7f1984103170 2024-09-13T15:55:13.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.113+0000 7f1989200640 1 -- 172.21.15.17:0/1027783738 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f198410d840 con 0x7f1984103170 2024-09-13T15:55:13.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.229+0000 7f197aa00640 1 -- 172.21.15.17:0/1027783738 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7f196c099ca0 con 0x7f1984103170 2024-09-13T15:55:13.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.230+0000 7f1989200640 1 -- 172.21.15.17:0/1027783738 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f19680a1090 msgr2=0x7f19680a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:13.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.230+0000 7f1989200640 1 --2- 172.21.15.17:0/1027783738 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f19680a1090 0x7f19680a3550 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1984102fd0 tx=0x7f1974005f90 comp rx=0 tx=0).stop 2024-09-13T15:55:13.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.230+0000 7f1989200640 1 -- 172.21.15.17:0/1027783738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1984103170 msgr2=0x7f1984198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:13.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.230+0000 7f1989200640 1 --2- 172.21.15.17:0/1027783738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1984103170 0x7f1984198500 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f196c00e9c0 tx=0x7f196c00ee80 comp rx=0 tx=0).stop 2024-09-13T15:55:13.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.230+0000 7f1989200640 1 -- 172.21.15.17:0/1027783738 shutdown_connections 2024-09-13T15:55:13.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.230+0000 7f1989200640 1 --2- 172.21.15.17:0/1027783738 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f19680a1090 0x7f19680a3550 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:13.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.230+0000 7f1989200640 1 --2- 172.21.15.17:0/1027783738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1984103b30 0x7f198419f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:13.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.230+0000 7f1989200640 1 --2- 172.21.15.17:0/1027783738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1984103170 0x7f1984198500 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:13.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.230+0000 7f1989200640 1 --2- 172.21.15.17:0/1027783738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1984101f80 0x7f1984197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:13.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.230+0000 7f1989200640 1 -- 172.21.15.17:0/1027783738 >> 172.21.15.17:0/1027783738 conn(0x7f19840fd700 msgr2=0x7f19841065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:13.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.230+0000 7f1989200640 1 -- 172.21.15.17:0/1027783738 shutdown_connections 2024-09-13T15:55:13.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.230+0000 7f1989200640 1 -- 172.21.15.17:0/1027783738 wait complete. 2024-09-13T15:55:13.250 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-13T15:55:13.250 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-13T15:55:13.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.424+0000 7f0c53c00640 1 -- 172.21.15.17:0/551537890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c4c103b50 msgr2=0x7f0c4c10a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:13.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.424+0000 7f0c53c00640 1 --2- 172.21.15.17:0/551537890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c4c103b50 0x7f0c4c10a3e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009ca0 tx=0x7f0c4402a8c0 comp rx=0 tx=0).stop 2024-09-13T15:55:13.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.424+0000 7f0c53c00640 1 -- 172.21.15.17:0/551537890 shutdown_connections 2024-09-13T15:55:13.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.424+0000 7f0c53c00640 1 --2- 172.21.15.17:0/551537890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c4c103b50 0x7f0c4c10a3e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:13.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.424+0000 7f0c53c00640 1 --2- 172.21.15.17:0/551537890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c4c103190 0x7f0c4c103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:13.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.424+0000 7f0c53c00640 1 --2- 172.21.15.17:0/551537890 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c4c101fa0 0x7f0c4c1023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:13.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.424+0000 7f0c53c00640 1 -- 172.21.15.17:0/551537890 >> 172.21.15.17:0/551537890 conn(0x7f0c4c0fd700 msgr2=0x7f0c4c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:13.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.424+0000 7f0c53c00640 1 -- 172.21.15.17:0/551537890 shutdown_connections 2024-09-13T15:55:13.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.424+0000 7f0c53c00640 1 -- 172.21.15.17:0/551537890 wait complete. 2024-09-13T15:55:13.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.425+0000 7f0c53c00640 1 Processor -- start 2024-09-13T15:55:13.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.425+0000 7f0c53c00640 1 -- start start 2024-09-13T15:55:13.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.425+0000 7f0c53c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c4c101fa0 0x7f0c4c197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:13.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.425+0000 7f0c53c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c4c103190 0x7f0c4c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:13.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.426+0000 7f0c53c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c4c103b50 0x7f0c4c19f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:13.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.426+0000 7f0c53c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c19fa40 con 0x7f0c4c103190 2024-09-13T15:55:13.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.426+0000 7f0c53c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c19fbb0 con 0x7f0c4c101fa0 2024-09-13T15:55:13.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.426+0000 7f0c53c00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c19fd70 con 0x7f0c4c103b50 2024-09-13T15:55:13.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.426+0000 7f0c4be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c4c103190 0x7f0c4c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:13.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.426+0000 7f0c4be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c4c103190 0x7f0c4c198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57034/0 (socket says 172.21.15.17:57034) 2024-09-13T15:55:13.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.426+0000 7f0c4be00640 1 -- 172.21.15.17:0/4164821034 learned_addr learned my addr 172.21.15.17:0/4164821034 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:13.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.426+0000 7f0c51200640 1 --2- 172.21.15.17:0/4164821034 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c4c101fa0 0x7f0c4c197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:13.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.426+0000 7f0c51c00640 1 --2- 172.21.15.17:0/4164821034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c4c103b50 0x7f0c4c19f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:13.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.426+0000 7f0c4be00640 1 -- 172.21.15.17:0/4164821034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c4c103b50 msgr2=0x7f0c4c19f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:13.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.426+0000 7f0c4be00640 1 --2- 172.21.15.17:0/4164821034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c4c103b50 0x7f0c4c19f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:13.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.426+0000 7f0c4be00640 1 -- 172.21.15.17:0/4164821034 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c4c101fa0 msgr2=0x7f0c4c197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:13.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.426+0000 7f0c4be00640 1 --2- 172.21.15.17:0/4164821034 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c4c101fa0 0x7f0c4c197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:13.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.426+0000 7f0c4be00640 1 -- 172.21.15.17:0/4164821034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c40009490 con 0x7f0c4c103190 2024-09-13T15:55:13.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.427+0000 7f0c4be00640 1 --2- 172.21.15.17:0/4164821034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c4c103190 0x7f0c4c198490 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0c3800e9f0 tx=0x7f0c3800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:13.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.427+0000 7f0c49600640 1 -- 172.21.15.17:0/4164821034 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c38009700 con 0x7f0c4c103190 2024-09-13T15:55:13.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.427+0000 7f0c49600640 1 -- 172.21.15.17:0/4164821034 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c3800cd80 con 0x7f0c4c103190 2024-09-13T15:55:13.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.427+0000 7f0c53c00640 1 -- 172.21.15.17:0/4164821034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c44009900 con 0x7f0c4c103190 2024-09-13T15:55:13.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.427+0000 7f0c49600640 1 -- 172.21.15.17:0/4164821034 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c38018860 con 0x7f0c4c103190 2024-09-13T15:55:13.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.427+0000 7f0c53c00640 1 -- 172.21.15.17:0/4164821034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4c1a0390 con 0x7f0c4c103190 2024-09-13T15:55:13.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.428+0000 7f0c53c00640 1 -- 172.21.15.17:0/4164821034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4c109400 con 0x7f0c4c103190 2024-09-13T15:55:13.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.430+0000 7f0c49600640 1 -- 172.21.15.17:0/4164821034 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0c380189c0 con 0x7f0c4c103190 2024-09-13T15:55:13.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.431+0000 7f0c49600640 1 --2- 172.21.15.17:0/4164821034 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0c340a1110 0x7f0c340a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:13.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.431+0000 7f0c49600640 1 -- 172.21.15.17:0/4164821034 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f0c38014070 con 0x7f0c4c103190 2024-09-13T15:55:13.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.432+0000 7f0c51200640 1 --2- 172.21.15.17:0/4164821034 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0c340a1110 0x7f0c340a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:13.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.432+0000 7f0c51200640 1 --2- 172.21.15.17:0/4164821034 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0c340a1110 0x7f0c340a35d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c102ff0 tx=0x7f0c40005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:13.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.435+0000 7f0c49600640 1 -- 172.21.15.17:0/4164821034 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0c38052e20 con 0x7f0c4c103190 2024-09-13T15:55:13.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:13 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/4202875237' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:13.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:13 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3818265243' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:13.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:13 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1027783738' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-13T15:55:13.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:13 smithi193 ceph-mon[35248]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-13T15:55:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:13 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/4202875237' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:13 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3818265243' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:13 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1027783738' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-13T15:55:13.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:13 smithi017 ceph-mon[30494]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-13T15:55:13.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:13 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/4202875237' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:13.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:13 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3818265243' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:13.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:13 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1027783738' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-13T15:55:13.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:13 smithi189 ceph-mon[34790]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-13T15:55:13.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:13.655+0000 7f0c53c00640 1 -- 172.21.15.17:0/4164821034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f0c4c02c480 con 0x7f0c4c103190 2024-09-13T15:55:14.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.235+0000 7f0c49600640 1 -- 172.21.15.17:0/4164821034 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) v1 ==== 105+0+0 (secure 0 0 0) 0x7f0c38096390 con 0x7f0c4c103190 2024-09-13T15:55:14.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.237+0000 7f0c53c00640 1 -- 172.21.15.17:0/4164821034 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0c340a1110 msgr2=0x7f0c340a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:14.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.237+0000 7f0c53c00640 1 --2- 172.21.15.17:0/4164821034 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0c340a1110 0x7f0c340a35d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c102ff0 tx=0x7f0c40005f90 comp rx=0 tx=0).stop 2024-09-13T15:55:14.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.237+0000 7f0c53c00640 1 -- 172.21.15.17:0/4164821034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c4c103190 msgr2=0x7f0c4c198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:14.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.237+0000 7f0c53c00640 1 --2- 172.21.15.17:0/4164821034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c4c103190 0x7f0c4c198490 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0c3800e9f0 tx=0x7f0c3800eeb0 comp rx=0 tx=0).stop 2024-09-13T15:55:14.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.237+0000 7f0c53c00640 1 -- 172.21.15.17:0/4164821034 shutdown_connections 2024-09-13T15:55:14.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.237+0000 7f0c53c00640 1 --2- 172.21.15.17:0/4164821034 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0c340a1110 0x7f0c340a35d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:14.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.237+0000 7f0c53c00640 1 --2- 172.21.15.17:0/4164821034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c4c103b50 0x7f0c4c19f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:14.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.237+0000 7f0c53c00640 1 --2- 172.21.15.17:0/4164821034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c4c103190 0x7f0c4c198490 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:14.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.237+0000 7f0c53c00640 1 --2- 172.21.15.17:0/4164821034 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c4c101fa0 0x7f0c4c197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:14.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.237+0000 7f0c53c00640 1 -- 172.21.15.17:0/4164821034 >> 172.21.15.17:0/4164821034 conn(0x7f0c4c0fd700 msgr2=0x7f0c4c1065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:14.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.238+0000 7f0c53c00640 1 -- 172.21.15.17:0/4164821034 shutdown_connections 2024-09-13T15:55:14.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.238+0000 7f0c53c00640 1 -- 172.21.15.17:0/4164821034 wait complete. 2024-09-13T15:55:14.263 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-09-13T15:55:14.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.428+0000 7f3286200640 1 -- 172.21.15.17:0/2230406418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3280103a40 msgr2=0x7f328010a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:14.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.428+0000 7f3286200640 1 --2- 172.21.15.17:0/2230406418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3280103a40 0x7f328010a360 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3278009ca0 tx=0x7f327802a8c0 comp rx=0 tx=0).stop 2024-09-13T15:55:14.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.428+0000 7f3286200640 1 -- 172.21.15.17:0/2230406418 shutdown_connections 2024-09-13T15:55:14.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.428+0000 7f3286200640 1 --2- 172.21.15.17:0/2230406418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3280103a40 0x7f328010a360 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:14.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.428+0000 7f3286200640 1 --2- 172.21.15.17:0/2230406418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3280103080 0x7f3280103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:14.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.428+0000 7f3286200640 1 --2- 172.21.15.17:0/2230406418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3280101ea0 0x7f32801022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:14.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.428+0000 7f3286200640 1 -- 172.21.15.17:0/2230406418 >> 172.21.15.17:0/2230406418 conn(0x7f32800fd670 msgr2=0x7f32800ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:14.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.428+0000 7f3286200640 1 -- 172.21.15.17:0/2230406418 shutdown_connections 2024-09-13T15:55:14.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.428+0000 7f3286200640 1 -- 172.21.15.17:0/2230406418 wait complete. 2024-09-13T15:55:14.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.429+0000 7f3286200640 1 Processor -- start 2024-09-13T15:55:14.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.429+0000 7f3286200640 1 -- start start 2024-09-13T15:55:14.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.429+0000 7f3286200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3280101ea0 0x7f3280197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:14.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.429+0000 7f3286200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3280103080 0x7f3280198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:14.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.429+0000 7f3286200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3280103a40 0x7f328019f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:14.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.429+0000 7f3286200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328019f900 con 0x7f3280103a40 2024-09-13T15:55:14.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.429+0000 7f3286200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328019fa70 con 0x7f3280103080 2024-09-13T15:55:14.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.429+0000 7f3286200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328019fc30 con 0x7f3280101ea0 2024-09-13T15:55:14.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.429+0000 7f3285800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3280103a40 0x7f328019f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:14.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.429+0000 7f3285800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3280103a40 0x7f328019f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57040/0 (socket says 172.21.15.17:57040) 2024-09-13T15:55:14.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.429+0000 7f3285800640 1 -- 172.21.15.17:0/3409236200 learned_addr learned my addr 172.21.15.17:0/3409236200 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:14.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.429+0000 7f3284e00640 1 --2- 172.21.15.17:0/3409236200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3280101ea0 0x7f3280197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:14.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.429+0000 7f327fe00640 1 --2- 172.21.15.17:0/3409236200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3280103080 0x7f3280198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:14.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.429+0000 7f3285800640 1 -- 172.21.15.17:0/3409236200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3280101ea0 msgr2=0x7f3280197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:14.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.429+0000 7f3285800640 1 --2- 172.21.15.17:0/3409236200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3280101ea0 0x7f3280197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:14.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.429+0000 7f3285800640 1 -- 172.21.15.17:0/3409236200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3280103080 msgr2=0x7f3280198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:14.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.429+0000 7f3285800640 1 --2- 172.21.15.17:0/3409236200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3280103080 0x7f3280198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:14.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.429+0000 7f3285800640 1 -- 172.21.15.17:0/3409236200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3278009900 con 0x7f3280103a40 2024-09-13T15:55:14.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.429+0000 7f327fe00640 1 --2- 172.21.15.17:0/3409236200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3280103080 0x7f3280198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:55:14.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.429+0000 7f3285800640 1 --2- 172.21.15.17:0/3409236200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3280103a40 0x7f328019f3c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f327802aeb0 tx=0x7f3278003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:14.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.431+0000 7f327d600640 1 -- 172.21.15.17:0/3409236200 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32780307c0 con 0x7f3280103a40 2024-09-13T15:55:14.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.431+0000 7f327d600640 1 -- 172.21.15.17:0/3409236200 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3278040070 con 0x7f3280103a40 2024-09-13T15:55:14.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.431+0000 7f3286200640 1 -- 172.21.15.17:0/3409236200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328019feb0 con 0x7f3280103a40 2024-09-13T15:55:14.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.431+0000 7f327d600640 1 -- 172.21.15.17:0/3409236200 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32780044a0 con 0x7f3280103a40 2024-09-13T15:55:14.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.431+0000 7f3286200640 1 -- 172.21.15.17:0/3409236200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32801a0330 con 0x7f3280103a40 2024-09-13T15:55:14.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.432+0000 7f3286200640 1 -- 172.21.15.17:0/3409236200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3280109330 con 0x7f3280103a40 2024-09-13T15:55:14.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.434+0000 7f327d600640 1 -- 172.21.15.17:0/3409236200 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3278042030 con 0x7f3280103a40 2024-09-13T15:55:14.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.435+0000 7f327d600640 1 --2- 172.21.15.17:0/3409236200 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f32680a1090 0x7f32680a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:14.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.435+0000 7f327d600640 1 -- 172.21.15.17:0/3409236200 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f32780ee180 con 0x7f3280103a40 2024-09-13T15:55:14.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.435+0000 7f3284e00640 1 --2- 172.21.15.17:0/3409236200 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f32680a1090 0x7f32680a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:14.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.436+0000 7f3284e00640 1 --2- 172.21.15.17:0/3409236200 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f32680a1090 0x7f32680a3550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3280102bf0 tx=0x7f3274005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:14.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.439+0000 7f327d600640 1 -- 172.21.15.17:0/3409236200 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f32780b76c0 con 0x7f3280103a40 2024-09-13T15:55:14.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:14 smithi193 ceph-mon[35248]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-13T15:55:14.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:14 smithi193 ceph-mon[35248]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T15:55:14.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:14 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/4164821034' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-13T15:55:14.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:14 smithi193 ceph-mon[35248]: pgmap v306: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-13T15:55:14.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:14 smithi017 ceph-mon[30494]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-13T15:55:14.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:14 smithi017 ceph-mon[30494]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T15:55:14.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:14 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/4164821034' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-13T15:55:14.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:14 smithi017 ceph-mon[30494]: pgmap v306: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-13T15:55:14.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:14 smithi189 ceph-mon[34790]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-13T15:55:14.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:14 smithi189 ceph-mon[34790]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T15:55:14.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:14 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/4164821034' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-13T15:55:14.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:14 smithi189 ceph-mon[34790]: pgmap v306: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-13T15:55:14.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:14.658+0000 7f3286200640 1 -- 172.21.15.17:0/3409236200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f3280108da0 con 0x7f3280103a40 2024-09-13T15:55:15.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.241+0000 7f327d600640 1 -- 172.21.15.17:0/3409236200 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) v1 ==== 121+0+0 (secure 0 0 0) 0x7f32780bace0 con 0x7f3280103a40 2024-09-13T15:55:15.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.244+0000 7f3286200640 1 -- 172.21.15.17:0/3409236200 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f32680a1090 msgr2=0x7f32680a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:15.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.244+0000 7f3286200640 1 --2- 172.21.15.17:0/3409236200 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f32680a1090 0x7f32680a3550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3280102bf0 tx=0x7f3274005f90 comp rx=0 tx=0).stop 2024-09-13T15:55:15.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.244+0000 7f3286200640 1 -- 172.21.15.17:0/3409236200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3280103a40 msgr2=0x7f328019f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:15.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.244+0000 7f3286200640 1 --2- 172.21.15.17:0/3409236200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3280103a40 0x7f328019f3c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f327802aeb0 tx=0x7f3278003c20 comp rx=0 tx=0).stop 2024-09-13T15:55:15.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.244+0000 7f3286200640 1 -- 172.21.15.17:0/3409236200 shutdown_connections 2024-09-13T15:55:15.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.244+0000 7f3286200640 1 --2- 172.21.15.17:0/3409236200 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f32680a1090 0x7f32680a3550 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:15.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.244+0000 7f3286200640 1 --2- 172.21.15.17:0/3409236200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3280103a40 0x7f328019f3c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:15.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.244+0000 7f3286200640 1 --2- 172.21.15.17:0/3409236200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3280103080 0x7f3280198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:15.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.244+0000 7f3286200640 1 --2- 172.21.15.17:0/3409236200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3280101ea0 0x7f3280197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:15.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.244+0000 7f3286200640 1 -- 172.21.15.17:0/3409236200 >> 172.21.15.17:0/3409236200 conn(0x7f32800fd670 msgr2=0x7f3280106500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:15.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.244+0000 7f3286200640 1 -- 172.21.15.17:0/3409236200 shutdown_connections 2024-09-13T15:55:15.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.244+0000 7f3286200640 1 -- 172.21.15.17:0/3409236200 wait complete. 2024-09-13T15:55:15.267 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-09-13T15:55:15.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.431+0000 7f1f75e00640 1 -- 172.21.15.17:0/3733635830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f70101890 msgr2=0x7f1f70108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:15.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.431+0000 7f1f75e00640 1 --2- 172.21.15.17:0/3733635830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f70101890 0x7f1f70108120 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009ca0 tx=0x7f1f6802a8c0 comp rx=0 tx=0).stop 2024-09-13T15:55:15.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.431+0000 7f1f75e00640 1 -- 172.21.15.17:0/3733635830 shutdown_connections 2024-09-13T15:55:15.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.431+0000 7f1f75e00640 1 --2- 172.21.15.17:0/3733635830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f70101890 0x7f1f70108120 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:15.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.431+0000 7f1f75e00640 1 --2- 172.21.15.17:0/3733635830 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f70100ed0 0x7f1f70101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:15.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.431+0000 7f1f75e00640 1 --2- 172.21.15.17:0/3733635830 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f700ffce0 0x7f1f701000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:15.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.431+0000 7f1f75e00640 1 -- 172.21.15.17:0/3733635830 >> 172.21.15.17:0/3733635830 conn(0x7f1f700fb440 msgr2=0x7f1f700fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:15.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.431+0000 7f1f75e00640 1 -- 172.21.15.17:0/3733635830 shutdown_connections 2024-09-13T15:55:15.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.431+0000 7f1f75e00640 1 -- 172.21.15.17:0/3733635830 wait complete. 2024-09-13T15:55:15.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.432+0000 7f1f75e00640 1 Processor -- start 2024-09-13T15:55:15.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.432+0000 7f1f75e00640 1 -- start start 2024-09-13T15:55:15.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.432+0000 7f1f75e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f700ffce0 0x7f1f70074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:15.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.432+0000 7f1f75e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f70100ed0 0x7f1f700728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:15.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.432+0000 7f1f75e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f70101890 0x7f1f70072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:15.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.432+0000 7f1f75e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f70073540 con 0x7f1f70101890 2024-09-13T15:55:15.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.432+0000 7f1f75e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f700736b0 con 0x7f1f70100ed0 2024-09-13T15:55:15.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.432+0000 7f1f75e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7019fcc0 con 0x7f1f700ffce0 2024-09-13T15:55:15.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.432+0000 7f1f75400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f70101890 0x7f1f70072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:15.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.432+0000 7f1f75400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f70101890 0x7f1f70072de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57056/0 (socket says 172.21.15.17:57056) 2024-09-13T15:55:15.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.432+0000 7f1f75400640 1 -- 172.21.15.17:0/518032610 learned_addr learned my addr 172.21.15.17:0/518032610 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:15.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.432+0000 7f1f74a00640 1 --2- 172.21.15.17:0/518032610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f700ffce0 0x7f1f70074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:15.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.433+0000 7f1f6fe00640 1 --2- 172.21.15.17:0/518032610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f70100ed0 0x7f1f700728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:15.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.433+0000 7f1f74a00640 1 -- 172.21.15.17:0/518032610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f70100ed0 msgr2=0x7f1f700728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:15.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.433+0000 7f1f74a00640 1 --2- 172.21.15.17:0/518032610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f70100ed0 0x7f1f700728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:15.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.433+0000 7f1f74a00640 1 -- 172.21.15.17:0/518032610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f70101890 msgr2=0x7f1f70072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:15.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.433+0000 7f1f74a00640 1 --2- 172.21.15.17:0/518032610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f70101890 0x7f1f70072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:15.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.433+0000 7f1f74a00640 1 -- 172.21.15.17:0/518032610 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f68009900 con 0x7f1f700ffce0 2024-09-13T15:55:15.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.433+0000 7f1f75400640 1 --2- 172.21.15.17:0/518032610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f70101890 0x7f1f70072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:55:15.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.433+0000 7f1f6fe00640 1 --2- 172.21.15.17:0/518032610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f70100ed0 0x7f1f700728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:55:15.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.433+0000 7f1f74a00640 1 --2- 172.21.15.17:0/518032610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f700ffce0 0x7f1f70074260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400e9c0 tx=0x7f1f6400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:15.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.433+0000 7f1f6d600640 1 -- 172.21.15.17:0/518032610 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6400ccc0 con 0x7f1f700ffce0 2024-09-13T15:55:15.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.434+0000 7f1f6d600640 1 -- 172.21.15.17:0/518032610 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1f640044f0 con 0x7f1f700ffce0 2024-09-13T15:55:15.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.434+0000 7f1f75e00640 1 -- 172.21.15.17:0/518032610 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7019ff70 con 0x7f1f700ffce0 2024-09-13T15:55:15.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.434+0000 7f1f6d600640 1 -- 172.21.15.17:0/518032610 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64010430 con 0x7f1f700ffce0 2024-09-13T15:55:15.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.434+0000 7f1f75e00640 1 -- 172.21.15.17:0/518032610 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f701a0390 con 0x7f1f700ffce0 2024-09-13T15:55:15.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.435+0000 7f1f75e00640 1 -- 172.21.15.17:0/518032610 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f701000e0 con 0x7f1f700ffce0 2024-09-13T15:55:15.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.437+0000 7f1f6d600640 1 -- 172.21.15.17:0/518032610 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1f64003f20 con 0x7f1f700ffce0 2024-09-13T15:55:15.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.438+0000 7f1f6d600640 1 --2- 172.21.15.17:0/518032610 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1f580a1110 0x7f1f580a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:15.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.438+0000 7f1f6d600640 1 -- 172.21.15.17:0/518032610 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f1f64014070 con 0x7f1f700ffce0 2024-09-13T15:55:15.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.438+0000 7f1f6fe00640 1 --2- 172.21.15.17:0/518032610 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1f580a1110 0x7f1f580a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:15.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.439+0000 7f1f6fe00640 1 --2- 172.21.15.17:0/518032610 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1f580a1110 0x7f1f580a35d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1f70073fd0 tx=0x7f1f5c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:15.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.440+0000 7f1f6d600640 1 -- 172.21.15.17:0/518032610 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1f640963f0 con 0x7f1f700ffce0 2024-09-13T15:55:15.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:15 smithi193 ceph-mon[35248]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T15:55:15.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:15 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/4164821034' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-13T15:55:15.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:15 smithi193 ceph-mon[35248]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T15:55:15.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:15 smithi193 ceph-mon[35248]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T15:55:15.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:15 smithi193 ceph-mon[35248]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-09-13T15:55:15.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:15 smithi193 ceph-mon[35248]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-09-13T15:55:15.506 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:15 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3409236200' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T15:55:15.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:15 smithi017 ceph-mon[30494]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T15:55:15.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:15 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/4164821034' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-13T15:55:15.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:15 smithi017 ceph-mon[30494]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T15:55:15.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:15 smithi017 ceph-mon[30494]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T15:55:15.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:15 smithi017 ceph-mon[30494]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-09-13T15:55:15.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:15 smithi017 ceph-mon[30494]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-09-13T15:55:15.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:15 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3409236200' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T15:55:15.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:15 smithi189 ceph-mon[34790]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T15:55:15.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:15 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/4164821034' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-13T15:55:15.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:15 smithi189 ceph-mon[34790]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T15:55:15.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:15 smithi189 ceph-mon[34790]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T15:55:15.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:15 smithi189 ceph-mon[34790]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-09-13T15:55:15.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:15 smithi189 ceph-mon[34790]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-09-13T15:55:15.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:15 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3409236200' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T15:55:15.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:15.658+0000 7f1f75e00640 1 -- 172.21.15.17:0/518032610 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f1f7010b7d0 con 0x7f1f700ffce0 2024-09-13T15:55:16.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.254+0000 7f1f6d600640 1 -- 172.21.15.17:0/518032610 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) v1 ==== 115+0+0 (secure 0 0 0) 0x7f1f64099a10 con 0x7f1f700ffce0 2024-09-13T15:55:16.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.256+0000 7f1f75e00640 1 -- 172.21.15.17:0/518032610 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1f580a1110 msgr2=0x7f1f580a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:16.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.256+0000 7f1f75e00640 1 --2- 172.21.15.17:0/518032610 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1f580a1110 0x7f1f580a35d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1f70073fd0 tx=0x7f1f5c005f90 comp rx=0 tx=0).stop 2024-09-13T15:55:16.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.256+0000 7f1f75e00640 1 -- 172.21.15.17:0/518032610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f700ffce0 msgr2=0x7f1f70074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:16.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.256+0000 7f1f75e00640 1 --2- 172.21.15.17:0/518032610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f700ffce0 0x7f1f70074260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400e9c0 tx=0x7f1f6400ee80 comp rx=0 tx=0).stop 2024-09-13T15:55:16.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.256+0000 7f1f75e00640 1 -- 172.21.15.17:0/518032610 shutdown_connections 2024-09-13T15:55:16.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.256+0000 7f1f75e00640 1 --2- 172.21.15.17:0/518032610 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1f580a1110 0x7f1f580a35d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:16.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.256+0000 7f1f75e00640 1 --2- 172.21.15.17:0/518032610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f70101890 0x7f1f70072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:16.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.256+0000 7f1f75e00640 1 --2- 172.21.15.17:0/518032610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f70100ed0 0x7f1f700728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:16.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.256+0000 7f1f75e00640 1 --2- 172.21.15.17:0/518032610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f700ffce0 0x7f1f70074260 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:16.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.256+0000 7f1f75e00640 1 -- 172.21.15.17:0/518032610 >> 172.21.15.17:0/518032610 conn(0x7f1f700fb440 msgr2=0x7f1f70104310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:16.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.257+0000 7f1f75e00640 1 -- 172.21.15.17:0/518032610 shutdown_connections 2024-09-13T15:55:16.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.257+0000 7f1f75e00640 1 -- 172.21.15.17:0/518032610 wait complete. 2024-09-13T15:55:16.276 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-13T15:55:16.276 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-09-13T15:55:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.438+0000 7fd31c000640 1 -- 172.21.15.17:0/519665794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd314105a50 msgr2=0x7fd314107ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.438+0000 7fd31c000640 1 --2- 172.21.15.17:0/519665794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd314105a50 0x7fd314107ec0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009ca0 tx=0x7fd30c02a8c0 comp rx=0 tx=0).stop 2024-09-13T15:55:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.438+0000 7fd31c000640 1 -- 172.21.15.17:0/519665794 shutdown_connections 2024-09-13T15:55:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.438+0000 7fd31c000640 1 --2- 172.21.15.17:0/519665794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd314105a50 0x7fd314107ec0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.438+0000 7fd31c000640 1 --2- 172.21.15.17:0/519665794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd314103120 0x7fd314105510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.438+0000 7fd31c000640 1 --2- 172.21.15.17:0/519665794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3141007f0 0x7fd314102be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:16.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.438+0000 7fd31c000640 1 -- 172.21.15.17:0/519665794 >> 172.21.15.17:0/519665794 conn(0x7fd3140fa3d0 msgr2=0x7fd3140fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:16.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.438+0000 7fd31c000640 1 -- 172.21.15.17:0/519665794 shutdown_connections 2024-09-13T15:55:16.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.438+0000 7fd31c000640 1 -- 172.21.15.17:0/519665794 wait complete. 2024-09-13T15:55:16.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.439+0000 7fd31c000640 1 Processor -- start 2024-09-13T15:55:16.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.439+0000 7fd31c000640 1 -- start start 2024-09-13T15:55:16.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.439+0000 7fd31c000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3141007f0 0x7fd314198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:16.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.439+0000 7fd31c000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd314103120 0x7fd314198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:16.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.439+0000 7fd31c000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd314105a50 0x7fd31419f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:16.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.439+0000 7fd31c000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31419fb00 con 0x7fd314103120 2024-09-13T15:55:16.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.439+0000 7fd31c000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31419fc70 con 0x7fd3141007f0 2024-09-13T15:55:16.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.439+0000 7fd31c000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31419fe30 con 0x7fd314105a50 2024-09-13T15:55:16.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.440+0000 7fd318c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd314103120 0x7fd314198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:16.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.440+0000 7fd318c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd314103120 0x7fd314198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57072/0 (socket says 172.21.15.17:57072) 2024-09-13T15:55:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.440+0000 7fd318c00640 1 -- 172.21.15.17:0/4146965215 learned_addr learned my addr 172.21.15.17:0/4146965215 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.440+0000 7fd31a000640 1 --2- 172.21.15.17:0/4146965215 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd314105a50 0x7fd31419f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.440+0000 7fd319600640 1 --2- 172.21.15.17:0/4146965215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3141007f0 0x7fd314198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.440+0000 7fd318c00640 1 -- 172.21.15.17:0/4146965215 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd314105a50 msgr2=0x7fd31419f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.440+0000 7fd318c00640 1 --2- 172.21.15.17:0/4146965215 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd314105a50 0x7fd31419f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.440+0000 7fd318c00640 1 -- 172.21.15.17:0/4146965215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3141007f0 msgr2=0x7fd314198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.440+0000 7fd318c00640 1 --2- 172.21.15.17:0/4146965215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3141007f0 0x7fd314198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.440+0000 7fd318c00640 1 -- 172.21.15.17:0/4146965215 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c009900 con 0x7fd314103120 2024-09-13T15:55:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.441+0000 7fd318c00640 1 --2- 172.21.15.17:0/4146965215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd314103120 0x7fd314198550 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd30000e9f0 tx=0x7fd30000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.441+0000 7fd312000640 1 -- 172.21.15.17:0/4146965215 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3000096c0 con 0x7fd314103120 2024-09-13T15:55:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.441+0000 7fd312000640 1 -- 172.21.15.17:0/4146965215 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3000054e0 con 0x7fd314103120 2024-09-13T15:55:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.441+0000 7fd31c000640 1 -- 172.21.15.17:0/4146965215 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3141a0110 con 0x7fd314103120 2024-09-13T15:55:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.441+0000 7fd312000640 1 -- 172.21.15.17:0/4146965215 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd300010430 con 0x7fd314103120 2024-09-13T15:55:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.441+0000 7fd31c000640 1 -- 172.21.15.17:0/4146965215 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3141a05d0 con 0x7fd314103120 2024-09-13T15:55:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.442+0000 7fd31c000640 1 -- 172.21.15.17:0/4146965215 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd314107540 con 0x7fd314103120 2024-09-13T15:55:16.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.444+0000 7fd312000640 1 -- 172.21.15.17:0/4146965215 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd300005020 con 0x7fd314103120 2024-09-13T15:55:16.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.446+0000 7fd312000640 1 --2- 172.21.15.17:0/4146965215 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd2fc0a1090 0x7fd2fc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:16.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.446+0000 7fd312000640 1 -- 172.21.15.17:0/4146965215 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd300014070 con 0x7fd314103120 2024-09-13T15:55:16.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.446+0000 7fd319600640 1 --2- 172.21.15.17:0/4146965215 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd2fc0a1090 0x7fd2fc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:16.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.447+0000 7fd319600640 1 --2- 172.21.15.17:0/4146965215 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd2fc0a1090 0x7fd2fc0a3550 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd308009bd0 tx=0x7fd308005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:16.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.450+0000 7fd312000640 1 -- 172.21.15.17:0/4146965215 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd3000963e0 con 0x7fd314103120 2024-09-13T15:55:16.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:16 smithi193 ceph-mon[35248]: mds.? [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] up:active 2024-09-13T15:55:16.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:16 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3409236200' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T15:55:16.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:16 smithi193 ceph-mon[35248]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-13T15:55:16.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:16 smithi193 ceph-mon[35248]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T15:55:16.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:16 smithi193 ceph-mon[35248]: Cluster is now healthy 2024-09-13T15:55:16.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:16 smithi193 ceph-mon[35248]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-09-13T15:55:16.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:16 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2024-09-13T15:55:16.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:16 smithi193 ceph-mon[35248]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-13T15:55:16.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:16 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/518032610' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T15:55:16.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:16 smithi193 ceph-mon[35248]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T15:55:16.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:16 smithi193 ceph-mon[35248]: pgmap v307: 129 pgs: 129 active+clean; 582 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 1 op/s 2024-09-13T15:55:16.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:16 smithi017 ceph-mon[30494]: mds.? [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] up:active 2024-09-13T15:55:16.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:16 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3409236200' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T15:55:16.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:16 smithi017 ceph-mon[30494]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-13T15:55:16.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:16 smithi017 ceph-mon[30494]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T15:55:16.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:16 smithi017 ceph-mon[30494]: Cluster is now healthy 2024-09-13T15:55:16.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:16 smithi017 ceph-mon[30494]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-09-13T15:55:16.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:16 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2024-09-13T15:55:16.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:16 smithi017 ceph-mon[30494]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-13T15:55:16.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:16 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/518032610' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T15:55:16.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:16 smithi017 ceph-mon[30494]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T15:55:16.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:16 smithi017 ceph-mon[30494]: pgmap v307: 129 pgs: 129 active+clean; 582 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 1 op/s 2024-09-13T15:55:16.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:16 smithi189 ceph-mon[34790]: mds.? [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] up:active 2024-09-13T15:55:16.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:16 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3409236200' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T15:55:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:16 smithi189 ceph-mon[34790]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-13T15:55:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:16 smithi189 ceph-mon[34790]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T15:55:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:16 smithi189 ceph-mon[34790]: Cluster is now healthy 2024-09-13T15:55:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:16 smithi189 ceph-mon[34790]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-09-13T15:55:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:16 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2024-09-13T15:55:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:16 smithi189 ceph-mon[34790]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-13T15:55:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:16 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/518032610' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T15:55:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:16 smithi189 ceph-mon[34790]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T15:55:16.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:16 smithi189 ceph-mon[34790]: pgmap v307: 129 pgs: 129 active+clean; 582 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 1 op/s 2024-09-13T15:55:16.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.658+0000 7fd31c000640 1 -- 172.21.15.17:0/4146965215 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3140608f0 con 0x7fd2fc0a1090 2024-09-13T15:55:16.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.687+0000 7fd312000640 1 -- 172.21.15.17:0/4146965215 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd3140608f0 con 0x7fd2fc0a1090 2024-09-13T15:55:16.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.689+0000 7fd31c000640 1 -- 172.21.15.17:0/4146965215 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd2fc0a1090 msgr2=0x7fd2fc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:16.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.689+0000 7fd31c000640 1 --2- 172.21.15.17:0/4146965215 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd2fc0a1090 0x7fd2fc0a3550 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd308009bd0 tx=0x7fd308005f90 comp rx=0 tx=0).stop 2024-09-13T15:55:16.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.689+0000 7fd31c000640 1 -- 172.21.15.17:0/4146965215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd314103120 msgr2=0x7fd314198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:16.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.689+0000 7fd31c000640 1 --2- 172.21.15.17:0/4146965215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd314103120 0x7fd314198550 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd30000e9f0 tx=0x7fd30000eeb0 comp rx=0 tx=0).stop 2024-09-13T15:55:16.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.689+0000 7fd31c000640 1 -- 172.21.15.17:0/4146965215 shutdown_connections 2024-09-13T15:55:16.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.689+0000 7fd31c000640 1 --2- 172.21.15.17:0/4146965215 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd2fc0a1090 0x7fd2fc0a3550 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:16.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.689+0000 7fd31c000640 1 --2- 172.21.15.17:0/4146965215 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd314105a50 0x7fd31419f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:16.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.689+0000 7fd31c000640 1 --2- 172.21.15.17:0/4146965215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd314103120 0x7fd314198550 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:16.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.689+0000 7fd31c000640 1 --2- 172.21.15.17:0/4146965215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3141007f0 0x7fd314198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:16.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.689+0000 7fd31c000640 1 -- 172.21.15.17:0/4146965215 >> 172.21.15.17:0/4146965215 conn(0x7fd3140fa3d0 msgr2=0x7fd3140fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:16.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.689+0000 7fd31c000640 1 -- 172.21.15.17:0/4146965215 shutdown_connections 2024-09-13T15:55:16.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.689+0000 7fd31c000640 1 -- 172.21.15.17:0/4146965215 wait complete. 2024-09-13T15:55:16.705 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-13T15:55:16.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.867+0000 7f84b5400640 1 -- 172.21.15.17:0/1286988340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b0101ea0 msgr2=0x7f84b01022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:16.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.867+0000 7f84b5400640 1 --2- 172.21.15.17:0/1286988340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b0101ea0 0x7f84b01022a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009900 tx=0x7f84a002a3f0 comp rx=0 tx=0).stop 2024-09-13T15:55:16.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.867+0000 7f84b5400640 1 -- 172.21.15.17:0/1286988340 shutdown_connections 2024-09-13T15:55:16.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.867+0000 7f84b5400640 1 --2- 172.21.15.17:0/1286988340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84b0103a40 0x7f84b010a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:16.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.867+0000 7f84b5400640 1 --2- 172.21.15.17:0/1286988340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84b0103080 0x7f84b0103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:16.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.867+0000 7f84b5400640 1 --2- 172.21.15.17:0/1286988340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b0101ea0 0x7f84b01022a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:16.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.867+0000 7f84b5400640 1 -- 172.21.15.17:0/1286988340 >> 172.21.15.17:0/1286988340 conn(0x7f84b00fd670 msgr2=0x7f84b00ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:16.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.867+0000 7f84b5400640 1 -- 172.21.15.17:0/1286988340 shutdown_connections 2024-09-13T15:55:16.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.867+0000 7f84b5400640 1 -- 172.21.15.17:0/1286988340 wait complete. 2024-09-13T15:55:16.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.868+0000 7f84b5400640 1 Processor -- start 2024-09-13T15:55:16.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.868+0000 7f84b5400640 1 -- start start 2024-09-13T15:55:16.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.869+0000 7f84b5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b0101ea0 0x7f84b0197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:16.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.869+0000 7f84b5400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84b0103080 0x7f84b0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:16.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.869+0000 7f84b5400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84b0103a40 0x7f84b019f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:16.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.869+0000 7f84b5400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b019f9e0 con 0x7f84b0101ea0 2024-09-13T15:55:16.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.869+0000 7f84b5400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b019fb50 con 0x7f84b0103080 2024-09-13T15:55:16.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.869+0000 7f84b5400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b019fd10 con 0x7f84b0103a40 2024-09-13T15:55:16.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.869+0000 7f84afe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b0101ea0 0x7f84b0197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:16.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.869+0000 7f84afe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b0101ea0 0x7f84b0197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57110/0 (socket says 172.21.15.17:57110) 2024-09-13T15:55:16.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.869+0000 7f84afe00640 1 -- 172.21.15.17:0/2041626286 learned_addr learned my addr 172.21.15.17:0/2041626286 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:16.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.869+0000 7f84b4a00640 1 --2- 172.21.15.17:0/2041626286 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84b0103a40 0x7f84b019f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:16.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.869+0000 7f84a7400640 1 --2- 172.21.15.17:0/2041626286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84b0103080 0x7f84b0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:16.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.869+0000 7f84afe00640 1 -- 172.21.15.17:0/2041626286 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84b0103a40 msgr2=0x7f84b019f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:16.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.869+0000 7f84afe00640 1 --2- 172.21.15.17:0/2041626286 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84b0103a40 0x7f84b019f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:16.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.869+0000 7f84afe00640 1 -- 172.21.15.17:0/2041626286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84b0103080 msgr2=0x7f84b0198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:16.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.869+0000 7f84afe00640 1 --2- 172.21.15.17:0/2041626286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84b0103080 0x7f84b0198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:16.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.869+0000 7f84afe00640 1 -- 172.21.15.17:0/2041626286 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a0009560 con 0x7f84b0101ea0 2024-09-13T15:55:16.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.870+0000 7f84afe00640 1 --2- 172.21.15.17:0/2041626286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b0101ea0 0x7f84b0197ef0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f84a0031500 tx=0x7f84a0003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:16.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.870+0000 7f84ad600640 1 -- 172.21.15.17:0/2041626286 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a0003e70 con 0x7f84b0101ea0 2024-09-13T15:55:16.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.870+0000 7f84ad600640 1 -- 172.21.15.17:0/2041626286 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84a0031c70 con 0x7f84b0101ea0 2024-09-13T15:55:16.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.870+0000 7f84ad600640 1 -- 172.21.15.17:0/2041626286 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a003bdf0 con 0x7f84b0101ea0 2024-09-13T15:55:16.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.870+0000 7f84b5400640 1 -- 172.21.15.17:0/2041626286 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b019ff90 con 0x7f84b0101ea0 2024-09-13T15:55:16.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.870+0000 7f84b5400640 1 -- 172.21.15.17:0/2041626286 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b01a0350 con 0x7f84b0101ea0 2024-09-13T15:55:16.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.871+0000 7f84b5400640 1 -- 172.21.15.17:0/2041626286 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b01093b0 con 0x7f84b0101ea0 2024-09-13T15:55:16.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.873+0000 7f84ad600640 1 -- 172.21.15.17:0/2041626286 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f84a00317b0 con 0x7f84b0101ea0 2024-09-13T15:55:16.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.874+0000 7f84ad600640 1 --2- 172.21.15.17:0/2041626286 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f84940a1090 0x7f84940a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:16.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.874+0000 7f84ad600640 1 -- 172.21.15.17:0/2041626286 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f84a00ed620 con 0x7f84b0101ea0 2024-09-13T15:55:16.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.875+0000 7f84a7400640 1 --2- 172.21.15.17:0/2041626286 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f84940a1090 0x7f84940a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:16.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.875+0000 7f84a7400640 1 --2- 172.21.15.17:0/2041626286 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f84940a1090 0x7f84940a3550 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8498005d00 tx=0x7f8498005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:16.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:16.878+0000 7f84ad600640 1 -- 172.21.15.17:0/2041626286 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f84a00b6b60 con 0x7f84b0101ea0 2024-09-13T15:55:17.011 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:55:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:55:16.664+0000 7f3b7f400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:55:17.011 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:55:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:55:16.664+0000 7f3b7f400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:55:17.011 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:55:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:55:16.664+0000 7f3b7f400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:55:17.011 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:55:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:55:16.664+0000 7f3b7f400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:55:17.011 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 15:55:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T15:55:16.664+0000 7f3b7f400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:55:17.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.093+0000 7f84b5400640 1 -- 172.21.15.17:0/2041626286 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f84b002c480 con 0x7f84940a1090 2024-09-13T15:55:17.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.119+0000 7f84ad600640 1 -- 172.21.15.17:0/2041626286 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f84b002c480 con 0x7f84940a1090 2024-09-13T15:55:17.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.121+0000 7f84b5400640 1 -- 172.21.15.17:0/2041626286 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f84940a1090 msgr2=0x7f84940a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:17.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.121+0000 7f84b5400640 1 --2- 172.21.15.17:0/2041626286 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f84940a1090 0x7f84940a3550 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8498005d00 tx=0x7f8498005c50 comp rx=0 tx=0).stop 2024-09-13T15:55:17.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.121+0000 7f84b5400640 1 -- 172.21.15.17:0/2041626286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b0101ea0 msgr2=0x7f84b0197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:17.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.121+0000 7f84b5400640 1 --2- 172.21.15.17:0/2041626286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b0101ea0 0x7f84b0197ef0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f84a0031500 tx=0x7f84a0003c80 comp rx=0 tx=0).stop 2024-09-13T15:55:17.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.122+0000 7f84b5400640 1 -- 172.21.15.17:0/2041626286 shutdown_connections 2024-09-13T15:55:17.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.122+0000 7f84b5400640 1 --2- 172.21.15.17:0/2041626286 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f84940a1090 0x7f84940a3550 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.122+0000 7f84b5400640 1 --2- 172.21.15.17:0/2041626286 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84b0103a40 0x7f84b019f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.122+0000 7f84b5400640 1 --2- 172.21.15.17:0/2041626286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84b0103080 0x7f84b0198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.122+0000 7f84b5400640 1 --2- 172.21.15.17:0/2041626286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b0101ea0 0x7f84b0197ef0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.122+0000 7f84b5400640 1 -- 172.21.15.17:0/2041626286 >> 172.21.15.17:0/2041626286 conn(0x7f84b00fd670 msgr2=0x7f84b0106580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:17.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.122+0000 7f84b5400640 1 -- 172.21.15.17:0/2041626286 shutdown_connections 2024-09-13T15:55:17.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.122+0000 7f84b5400640 1 -- 172.21.15.17:0/2041626286 wait complete. 2024-09-13T15:55:17.139 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-13T15:55:17.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.302+0000 7f2b8ae00640 1 -- 172.21.15.17:0/2765104054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b84074e70 msgr2=0x7f2b84075270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:17.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.302+0000 7f2b8ae00640 1 --2- 172.21.15.17:0/2765104054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b84074e70 0x7f2b84075270 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009900 tx=0x7f2b7402a3f0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.302+0000 7f2b8ae00640 1 -- 172.21.15.17:0/2765104054 shutdown_connections 2024-09-13T15:55:17.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.302+0000 7f2b8ae00640 1 --2- 172.21.15.17:0/2765104054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b84076a50 0x7f2b840772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.302+0000 7f2b8ae00640 1 --2- 172.21.15.17:0/2765104054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b840760b0 0x7f2b84076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.302+0000 7f2b8ae00640 1 --2- 172.21.15.17:0/2765104054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b84074e70 0x7f2b84075270 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.302+0000 7f2b8ae00640 1 -- 172.21.15.17:0/2765104054 >> 172.21.15.17:0/2765104054 conn(0x7f2b840fd700 msgr2=0x7f2b840ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:17.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.302+0000 7f2b8ae00640 1 -- 172.21.15.17:0/2765104054 shutdown_connections 2024-09-13T15:55:17.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.302+0000 7f2b8ae00640 1 -- 172.21.15.17:0/2765104054 wait complete. 2024-09-13T15:55:17.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.303+0000 7f2b8ae00640 1 Processor -- start 2024-09-13T15:55:17.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.303+0000 7f2b8ae00640 1 -- start start 2024-09-13T15:55:17.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.303+0000 7f2b8ae00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b84074e70 0x7f2b8419c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:17.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.303+0000 7f2b8ae00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b840760b0 0x7f2b8419c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:17.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.303+0000 7f2b8ae00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b84076a50 0x7f2b841a3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:17.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.303+0000 7f2b8ae00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b841a3e60 con 0x7f2b84076a50 2024-09-13T15:55:17.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.303+0000 7f2b8ae00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b841a3fd0 con 0x7f2b840760b0 2024-09-13T15:55:17.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.303+0000 7f2b8ae00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b841a4190 con 0x7f2b84074e70 2024-09-13T15:55:17.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.303+0000 7f2b88e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b84076a50 0x7f2b841a3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:17.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.303+0000 7f2b83e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b84074e70 0x7f2b8419c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:17.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.304+0000 7f2b83e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b84074e70 0x7f2b8419c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:60572/0 (socket says 172.21.15.17:60572) 2024-09-13T15:55:17.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.304+0000 7f2b88e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b84076a50 0x7f2b841a3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57126/0 (socket says 172.21.15.17:57126) 2024-09-13T15:55:17.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.304+0000 7f2b83e00640 1 -- 172.21.15.17:0/770187693 learned_addr learned my addr 172.21.15.17:0/770187693 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:17.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.304+0000 7f2b7b400640 1 --2- 172.21.15.17:0/770187693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b840760b0 0x7f2b8419c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:17.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.304+0000 7f2b7b400640 1 -- 172.21.15.17:0/770187693 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b84074e70 msgr2=0x7f2b8419c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:17.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.304+0000 7f2b7b400640 1 --2- 172.21.15.17:0/770187693 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b84074e70 0x7f2b8419c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.304+0000 7f2b7b400640 1 -- 172.21.15.17:0/770187693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b84076a50 msgr2=0x7f2b841a3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:17.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.304+0000 7f2b7b400640 1 --2- 172.21.15.17:0/770187693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b84076a50 0x7f2b841a3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.304+0000 7f2b7b400640 1 -- 172.21.15.17:0/770187693 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b74009560 con 0x7f2b840760b0 2024-09-13T15:55:17.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.304+0000 7f2b83e00640 1 --2- 172.21.15.17:0/770187693 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b84074e70 0x7f2b8419c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:55:17.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.304+0000 7f2b88e00640 1 --2- 172.21.15.17:0/770187693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b84076a50 0x7f2b841a3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:55:17.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.304+0000 7f2b7b400640 1 --2- 172.21.15.17:0/770187693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b840760b0 0x7f2b8419c8b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c00e9f0 tx=0x7f2b6c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:17.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.304+0000 7f2b81600640 1 -- 172.21.15.17:0/770187693 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c00ccc0 con 0x7f2b840760b0 2024-09-13T15:55:17.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.305+0000 7f2b81600640 1 -- 172.21.15.17:0/770187693 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b6c00ce20 con 0x7f2b840760b0 2024-09-13T15:55:17.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.305+0000 7f2b8ae00640 1 -- 172.21.15.17:0/770187693 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b841a4470 con 0x7f2b840760b0 2024-09-13T15:55:17.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.305+0000 7f2b81600640 1 -- 172.21.15.17:0/770187693 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c0187e0 con 0x7f2b840760b0 2024-09-13T15:55:17.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.305+0000 7f2b8ae00640 1 -- 172.21.15.17:0/770187693 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b841a4980 con 0x7f2b840760b0 2024-09-13T15:55:17.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.305+0000 7f2b8ae00640 1 -- 172.21.15.17:0/770187693 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8410eae0 con 0x7f2b840760b0 2024-09-13T15:55:17.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.307+0000 7f2b81600640 1 -- 172.21.15.17:0/770187693 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2b6c010430 con 0x7f2b840760b0 2024-09-13T15:55:17.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.309+0000 7f2b81600640 1 --2- 172.21.15.17:0/770187693 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2b680a1090 0x7f2b680a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:17.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.309+0000 7f2b81600640 1 -- 172.21.15.17:0/770187693 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f2b6c014070 con 0x7f2b840760b0 2024-09-13T15:55:17.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.309+0000 7f2b83e00640 1 --2- 172.21.15.17:0/770187693 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2b680a1090 0x7f2b680a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:17.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.310+0000 7f2b83e00640 1 --2- 172.21.15.17:0/770187693 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2b680a1090 0x7f2b680a3550 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2b74005ec0 tx=0x7f2b740314c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:17.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.311+0000 7f2b81600640 1 -- 172.21.15.17:0/770187693 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2b6c0968e0 con 0x7f2b840760b0 2024-09-13T15:55:17.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:17 smithi193 ceph-mon[35248]: mds.? [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] up:active 2024-09-13T15:55:17.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:17 smithi193 ceph-mon[35248]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-13T15:55:17.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:17 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-09-13T15:55:17.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:17 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T15:55:17.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:17 smithi193 ceph-mon[35248]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:55:17.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:17 smithi193 ceph-mon[35248]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:55:17.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:17 smithi017 ceph-mon[30494]: mds.? [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] up:active 2024-09-13T15:55:17.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:17 smithi017 ceph-mon[30494]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-13T15:55:17.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:17 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-09-13T15:55:17.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:17 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T15:55:17.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:17 smithi017 ceph-mon[30494]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:55:17.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:17 smithi017 ceph-mon[30494]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:55:17.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.519+0000 7f2b8ae00640 1 -- 172.21.15.17:0/770187693 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b840608f0 con 0x7f2b680a1090 2024-09-13T15:55:17.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.524+0000 7f2b81600640 1 -- 172.21.15.17:0/770187693 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f2b840608f0 con 0x7f2b680a1090 2024-09-13T15:55:17.524 INFO:teuthology.orchestra.run.smithi017.stdout:/volumes/qa/sv_0/5c594cd2-7ad0-483e-ab5e-d6319a7d00ec 2024-09-13T15:55:17.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.526+0000 7f2b8ae00640 1 -- 172.21.15.17:0/770187693 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2b680a1090 msgr2=0x7f2b680a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:17.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.526+0000 7f2b8ae00640 1 --2- 172.21.15.17:0/770187693 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2b680a1090 0x7f2b680a3550 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2b74005ec0 tx=0x7f2b740314c0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.526+0000 7f2b8ae00640 1 -- 172.21.15.17:0/770187693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b840760b0 msgr2=0x7f2b8419c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:17.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.526+0000 7f2b8ae00640 1 --2- 172.21.15.17:0/770187693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b840760b0 0x7f2b8419c8b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c00e9f0 tx=0x7f2b6c00eeb0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.526+0000 7f2b8ae00640 1 -- 172.21.15.17:0/770187693 shutdown_connections 2024-09-13T15:55:17.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.526+0000 7f2b8ae00640 1 --2- 172.21.15.17:0/770187693 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2b680a1090 0x7f2b680a3550 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.526+0000 7f2b8ae00640 1 --2- 172.21.15.17:0/770187693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b84076a50 0x7f2b841a3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.526+0000 7f2b8ae00640 1 --2- 172.21.15.17:0/770187693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b840760b0 0x7f2b8419c8b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.526+0000 7f2b8ae00640 1 --2- 172.21.15.17:0/770187693 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b84074e70 0x7f2b8419c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.526+0000 7f2b8ae00640 1 -- 172.21.15.17:0/770187693 >> 172.21.15.17:0/770187693 conn(0x7f2b840fd700 msgr2=0x7f2b840fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:17.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.526+0000 7f2b8ae00640 1 -- 172.21.15.17:0/770187693 shutdown_connections 2024-09-13T15:55:17.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.526+0000 7f2b8ae00640 1 -- 172.21.15.17:0/770187693 wait complete. 2024-09-13T15:55:17.542 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-13T15:55:17.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:17 smithi189 ceph-mon[34790]: mds.? [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] up:active 2024-09-13T15:55:17.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:17 smithi189 ceph-mon[34790]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-13T15:55:17.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:17 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-09-13T15:55:17.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:17 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T15:55:17.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:17 smithi189 ceph-mon[34790]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:55:17.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:17 smithi189 ceph-mon[34790]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:55:17.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.705+0000 7f876f400640 1 -- 172.21.15.17:0/1274322380 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8768101fa0 msgr2=0x7f87681023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:17.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.705+0000 7f876f400640 1 --2- 172.21.15.17:0/1274322380 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8768101fa0 0x7f87681023a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8758009900 tx=0x7f875802a3f0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.705+0000 7f876f400640 1 -- 172.21.15.17:0/1274322380 shutdown_connections 2024-09-13T15:55:17.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.705+0000 7f876f400640 1 --2- 172.21.15.17:0/1274322380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8768103b50 0x7f876810a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.705+0000 7f876f400640 1 --2- 172.21.15.17:0/1274322380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8768103190 0x7f8768103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.705+0000 7f876f400640 1 --2- 172.21.15.17:0/1274322380 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8768101fa0 0x7f87681023a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.705+0000 7f876f400640 1 -- 172.21.15.17:0/1274322380 >> 172.21.15.17:0/1274322380 conn(0x7f87680fd700 msgr2=0x7f87680ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:17.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.705+0000 7f876f400640 1 -- 172.21.15.17:0/1274322380 shutdown_connections 2024-09-13T15:55:17.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.705+0000 7f876f400640 1 -- 172.21.15.17:0/1274322380 wait complete. 2024-09-13T15:55:17.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.706+0000 7f876f400640 1 Processor -- start 2024-09-13T15:55:17.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.706+0000 7f876f400640 1 -- start start 2024-09-13T15:55:17.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.706+0000 7f876f400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8768101fa0 0x7f8768197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:17.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.706+0000 7f876f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8768103190 0x7f8768198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:17.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.706+0000 7f876f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8768103b50 0x7f876819f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:17.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.706+0000 7f876f400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876819fab0 con 0x7f8768103190 2024-09-13T15:55:17.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.706+0000 7f876f400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876819fc20 con 0x7f8768103b50 2024-09-13T15:55:17.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.706+0000 7f876f400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876819fde0 con 0x7f8768101fa0 2024-09-13T15:55:17.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.707+0000 7f875fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8768103190 0x7f8768198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:17.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.707+0000 7f875fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8768103190 0x7f8768198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57136/0 (socket says 172.21.15.17:57136) 2024-09-13T15:55:17.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.707+0000 7f875fe00640 1 -- 172.21.15.17:0/1545745138 learned_addr learned my addr 172.21.15.17:0/1545745138 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:17.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.707+0000 7f876ca00640 1 --2- 172.21.15.17:0/1545745138 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8768101fa0 0x7f8768197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:17.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.707+0000 7f876d400640 1 --2- 172.21.15.17:0/1545745138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8768103b50 0x7f876819f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:17.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.707+0000 7f875fe00640 1 -- 172.21.15.17:0/1545745138 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8768101fa0 msgr2=0x7f8768197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:17.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.707+0000 7f875fe00640 1 --2- 172.21.15.17:0/1545745138 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8768101fa0 0x7f8768197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.707+0000 7f875fe00640 1 -- 172.21.15.17:0/1545745138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8768103b50 msgr2=0x7f876819f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:17.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.707+0000 7f875fe00640 1 --2- 172.21.15.17:0/1545745138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8768103b50 0x7f876819f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.707+0000 7f875fe00640 1 -- 172.21.15.17:0/1545745138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8758009560 con 0x7f8768103190 2024-09-13T15:55:17.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.707+0000 7f875fe00640 1 --2- 172.21.15.17:0/1545745138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8768103190 0x7f8768198500 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f875000e9f0 tx=0x7f875000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:17.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.708+0000 7f8766000640 1 -- 172.21.15.17:0/1545745138 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750009720 con 0x7f8768103190 2024-09-13T15:55:17.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.708+0000 7f876f400640 1 -- 172.21.15.17:0/1545745138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87681a00c0 con 0x7f8768103190 2024-09-13T15:55:17.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.708+0000 7f8766000640 1 -- 172.21.15.17:0/1545745138 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f875000cd80 con 0x7f8768103190 2024-09-13T15:55:17.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.708+0000 7f8766000640 1 -- 172.21.15.17:0/1545745138 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750018630 con 0x7f8768103190 2024-09-13T15:55:17.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.708+0000 7f876f400640 1 -- 172.21.15.17:0/1545745138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87681a05d0 con 0x7f8768103190 2024-09-13T15:55:17.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.709+0000 7f876f400640 1 -- 172.21.15.17:0/1545745138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8768109480 con 0x7f8768103190 2024-09-13T15:55:17.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.711+0000 7f8766000640 1 -- 172.21.15.17:0/1545745138 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8750004e00 con 0x7f8768103190 2024-09-13T15:55:17.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.712+0000 7f8766000640 1 --2- 172.21.15.17:0/1545745138 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f874c0a1090 0x7f874c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:17.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.712+0000 7f8766000640 1 -- 172.21.15.17:0/1545745138 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8750014070 con 0x7f8768103190 2024-09-13T15:55:17.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.712+0000 7f876ca00640 1 --2- 172.21.15.17:0/1545745138 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f874c0a1090 0x7f874c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:17.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.713+0000 7f876ca00640 1 --2- 172.21.15.17:0/1545745138 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f874c0a1090 0x7f874c0a3550 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8758005ab0 tx=0x7f87580314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.716+0000 7f8766000640 1 -- 172.21.15.17:0/1545745138 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8750096550 con 0x7f8768103190 2024-09-13T15:55:17.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.923+0000 7f876f400640 1 -- 172.21.15.17:0/1545745138 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f87680608f0 con 0x7f874c0a1090 2024-09-13T15:55:17.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.948+0000 7f8766000640 1 -- 172.21.15.17:0/1545745138 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f87680608f0 con 0x7f874c0a1090 2024-09-13T15:55:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.951+0000 7f876f400640 1 -- 172.21.15.17:0/1545745138 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f874c0a1090 msgr2=0x7f874c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.951+0000 7f876f400640 1 --2- 172.21.15.17:0/1545745138 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f874c0a1090 0x7f874c0a3550 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8758005ab0 tx=0x7f87580314a0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.951+0000 7f876f400640 1 -- 172.21.15.17:0/1545745138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8768103190 msgr2=0x7f8768198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.951+0000 7f876f400640 1 --2- 172.21.15.17:0/1545745138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8768103190 0x7f8768198500 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f875000e9f0 tx=0x7f875000edf0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.951+0000 7f876f400640 1 -- 172.21.15.17:0/1545745138 shutdown_connections 2024-09-13T15:55:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.951+0000 7f876f400640 1 --2- 172.21.15.17:0/1545745138 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f874c0a1090 0x7f874c0a3550 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.951+0000 7f876f400640 1 --2- 172.21.15.17:0/1545745138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8768103b50 0x7f876819f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.951+0000 7f876f400640 1 --2- 172.21.15.17:0/1545745138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8768103190 0x7f8768198500 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.951+0000 7f876f400640 1 --2- 172.21.15.17:0/1545745138 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8768101fa0 0x7f8768197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.951+0000 7f876f400640 1 -- 172.21.15.17:0/1545745138 >> 172.21.15.17:0/1545745138 conn(0x7f87680fd700 msgr2=0x7f8768106650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.951+0000 7f876f400640 1 -- 172.21.15.17:0/1545745138 shutdown_connections 2024-09-13T15:55:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:17.951+0000 7f876f400640 1 -- 172.21.15.17:0/1545745138 wait complete. 2024-09-13T15:55:17.969 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-13T15:55:18.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.131+0000 7fb542000640 1 -- 172.21.15.17:0/3118259633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb53c103b30 msgr2=0x7fb53c10a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:18.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.131+0000 7fb542000640 1 --2- 172.21.15.17:0/3118259633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb53c103b30 0x7fb53c10a3c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb534009ca0 tx=0x7fb53402a8c0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.131+0000 7fb542000640 1 -- 172.21.15.17:0/3118259633 shutdown_connections 2024-09-13T15:55:18.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.131+0000 7fb542000640 1 --2- 172.21.15.17:0/3118259633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb53c103b30 0x7fb53c10a3c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.131+0000 7fb542000640 1 --2- 172.21.15.17:0/3118259633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb53c103170 0x7fb53c1035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.131+0000 7fb542000640 1 --2- 172.21.15.17:0/3118259633 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb53c101f80 0x7fb53c102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.131+0000 7fb542000640 1 -- 172.21.15.17:0/3118259633 >> 172.21.15.17:0/3118259633 conn(0x7fb53c0fd700 msgr2=0x7fb53c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:18.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.131+0000 7fb542000640 1 -- 172.21.15.17:0/3118259633 shutdown_connections 2024-09-13T15:55:18.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.131+0000 7fb542000640 1 -- 172.21.15.17:0/3118259633 wait complete. 2024-09-13T15:55:18.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.132+0000 7fb542000640 1 Processor -- start 2024-09-13T15:55:18.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.132+0000 7fb542000640 1 -- start start 2024-09-13T15:55:18.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.133+0000 7fb542000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb53c101f80 0x7fb53c197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:18.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.133+0000 7fb542000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb53c103170 0x7fb53c198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:18.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.133+0000 7fb542000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb53c103b30 0x7fb53c19f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:18.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.133+0000 7fb542000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c19f9b0 con 0x7fb53c103170 2024-09-13T15:55:18.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.133+0000 7fb542000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c19fb20 con 0x7fb53c103b30 2024-09-13T15:55:18.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.133+0000 7fb542000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c19fce0 con 0x7fb53c101f80 2024-09-13T15:55:18.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.133+0000 7fb533e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb53c103170 0x7fb53c198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:18.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.133+0000 7fb533e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb53c103170 0x7fb53c198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57156/0 (socket says 172.21.15.17:57156) 2024-09-13T15:55:18.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.133+0000 7fb533e00640 1 -- 172.21.15.17:0/2311177136 learned_addr learned my addr 172.21.15.17:0/2311177136 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:18.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.133+0000 7fb53b400640 1 --2- 172.21.15.17:0/2311177136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb53c101f80 0x7fb53c197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:18.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.133+0000 7fb53be00640 1 --2- 172.21.15.17:0/2311177136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb53c103b30 0x7fb53c19f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:18.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.133+0000 7fb533e00640 1 -- 172.21.15.17:0/2311177136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb53c101f80 msgr2=0x7fb53c197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:18.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.133+0000 7fb533e00640 1 --2- 172.21.15.17:0/2311177136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb53c101f80 0x7fb53c197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.133+0000 7fb533e00640 1 -- 172.21.15.17:0/2311177136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb53c103b30 msgr2=0x7fb53c19f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:18.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.133+0000 7fb533e00640 1 --2- 172.21.15.17:0/2311177136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb53c103b30 0x7fb53c19f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.134+0000 7fb533e00640 1 -- 172.21.15.17:0/2311177136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb534009900 con 0x7fb53c103170 2024-09-13T15:55:18.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.134+0000 7fb533e00640 1 --2- 172.21.15.17:0/2311177136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb53c103170 0x7fb53c198400 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb52400e9f0 tx=0x7fb52400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:18.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.134+0000 7fb538c00640 1 -- 172.21.15.17:0/2311177136 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb524009700 con 0x7fb53c103170 2024-09-13T15:55:18.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.134+0000 7fb538c00640 1 -- 172.21.15.17:0/2311177136 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb52400cd80 con 0x7fb53c103170 2024-09-13T15:55:18.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.134+0000 7fb538c00640 1 -- 172.21.15.17:0/2311177136 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb524018860 con 0x7fb53c103170 2024-09-13T15:55:18.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.134+0000 7fb542000640 1 -- 172.21.15.17:0/2311177136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53c19ffc0 con 0x7fb53c103170 2024-09-13T15:55:18.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.134+0000 7fb542000640 1 -- 172.21.15.17:0/2311177136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53c1a03f0 con 0x7fb53c103170 2024-09-13T15:55:18.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.135+0000 7fb542000640 1 -- 172.21.15.17:0/2311177136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53c1093c0 con 0x7fb53c103170 2024-09-13T15:55:18.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.138+0000 7fb538c00640 1 -- 172.21.15.17:0/2311177136 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb5240189c0 con 0x7fb53c103170 2024-09-13T15:55:18.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.139+0000 7fb538c00640 1 --2- 172.21.15.17:0/2311177136 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb5200a1110 0x7fb5200a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:18.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.139+0000 7fb538c00640 1 -- 172.21.15.17:0/2311177136 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fb524014070 con 0x7fb53c103170 2024-09-13T15:55:18.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.139+0000 7fb53b400640 1 --2- 172.21.15.17:0/2311177136 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb5200a1110 0x7fb5200a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:18.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.140+0000 7fb53b400640 1 --2- 172.21.15.17:0/2311177136 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb5200a1110 0x7fb5200a35d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb53c102fd0 tx=0x7fb52c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:18.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.143+0000 7fb538c00640 1 -- 172.21.15.17:0/2311177136 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb524052e20 con 0x7fb53c103170 2024-09-13T15:55:18.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.269+0000 7fb538c00640 1 -- 172.21.15.17:0/2311177136 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb524096760 con 0x7fb53c103170 2024-09-13T15:55:18.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.358+0000 7fb542000640 1 -- 172.21.15.17:0/2311177136 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb53c02c520 con 0x7fb5200a1110 2024-09-13T15:55:18.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.363+0000 7fb538c00640 1 -- 172.21.15.17:0/2311177136 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7fb53c02c520 con 0x7fb5200a1110 2024-09-13T15:55:18.363 INFO:teuthology.orchestra.run.smithi017.stdout:/volumes/qa/sv_1/736a29cb-9b11-44c3-992c-0a482d8f2699 2024-09-13T15:55:18.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.365+0000 7fb542000640 1 -- 172.21.15.17:0/2311177136 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb5200a1110 msgr2=0x7fb5200a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:18.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.365+0000 7fb542000640 1 --2- 172.21.15.17:0/2311177136 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb5200a1110 0x7fb5200a35d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb53c102fd0 tx=0x7fb52c00b390 comp rx=0 tx=0).stop 2024-09-13T15:55:18.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.365+0000 7fb542000640 1 -- 172.21.15.17:0/2311177136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb53c103170 msgr2=0x7fb53c198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:18.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.365+0000 7fb542000640 1 --2- 172.21.15.17:0/2311177136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb53c103170 0x7fb53c198400 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb52400e9f0 tx=0x7fb52400eeb0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.365+0000 7fb542000640 1 -- 172.21.15.17:0/2311177136 shutdown_connections 2024-09-13T15:55:18.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.365+0000 7fb542000640 1 --2- 172.21.15.17:0/2311177136 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb5200a1110 0x7fb5200a35d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.365+0000 7fb542000640 1 --2- 172.21.15.17:0/2311177136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb53c103b30 0x7fb53c19f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.365+0000 7fb542000640 1 --2- 172.21.15.17:0/2311177136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb53c103170 0x7fb53c198400 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.365+0000 7fb542000640 1 --2- 172.21.15.17:0/2311177136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb53c101f80 0x7fb53c197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.365+0000 7fb542000640 1 -- 172.21.15.17:0/2311177136 >> 172.21.15.17:0/2311177136 conn(0x7fb53c0fd700 msgr2=0x7fb53c106590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:18.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.365+0000 7fb542000640 1 -- 172.21.15.17:0/2311177136 shutdown_connections 2024-09-13T15:55:18.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.365+0000 7fb542000640 1 -- 172.21.15.17:0/2311177136 wait complete. 2024-09-13T15:55:18.382 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:55:18.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:18 smithi017 ceph-mon[30494]: from='client.24833 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:55:18.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:18 smithi017 ceph-mon[30494]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:55:18.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:18 smithi017 ceph-mon[30494]: pgmap v308: 129 pgs: 129 active+clean; 582 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 2.0 KiB/s wr, 4 op/s 2024-09-13T15:55:18.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.540+0000 7f2abc600640 1 -- 172.21.15.17:0/240849842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ab4101fb0 msgr2=0x7f2ab41023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:18.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.540+0000 7f2abc600640 1 --2- 172.21.15.17:0/240849842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ab4101fb0 0x7f2ab41023b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009900 tx=0x7f2aa802a3f0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.540+0000 7f2abc600640 1 -- 172.21.15.17:0/240849842 shutdown_connections 2024-09-13T15:55:18.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.540+0000 7f2abc600640 1 --2- 172.21.15.17:0/240849842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ab4103b60 0x7f2ab410a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.540+0000 7f2abc600640 1 --2- 172.21.15.17:0/240849842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ab41031a0 0x7f2ab4103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.540+0000 7f2abc600640 1 --2- 172.21.15.17:0/240849842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ab4101fb0 0x7f2ab41023b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.540+0000 7f2abc600640 1 -- 172.21.15.17:0/240849842 >> 172.21.15.17:0/240849842 conn(0x7f2ab40fd730 msgr2=0x7f2ab40ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:18.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.540+0000 7f2abc600640 1 -- 172.21.15.17:0/240849842 shutdown_connections 2024-09-13T15:55:18.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.540+0000 7f2abc600640 1 -- 172.21.15.17:0/240849842 wait complete. 2024-09-13T15:55:18.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.541+0000 7f2abc600640 1 Processor -- start 2024-09-13T15:55:18.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.542+0000 7f2abc600640 1 -- start start 2024-09-13T15:55:18.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.542+0000 7f2abc600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ab4101fb0 0x7f2ab4197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:18.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.542+0000 7f2abc600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ab41031a0 0x7f2ab41984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:18.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.542+0000 7f2abc600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ab4103b60 0x7f2ab419f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:18.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.542+0000 7f2abc600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab419faa0 con 0x7f2ab4103b60 2024-09-13T15:55:18.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.542+0000 7f2abc600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab419fc10 con 0x7f2ab41031a0 2024-09-13T15:55:18.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.542+0000 7f2abc600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab419fdd0 con 0x7f2ab4101fb0 2024-09-13T15:55:18.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.542+0000 7f2aba600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ab4103b60 0x7f2ab419f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:18.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.542+0000 7f2ab9c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ab4101fb0 0x7f2ab4197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:18.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.542+0000 7f2aba600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ab4103b60 0x7f2ab419f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57176/0 (socket says 172.21.15.17:57176) 2024-09-13T15:55:18.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.542+0000 7f2aba600640 1 -- 172.21.15.17:0/4051353189 learned_addr learned my addr 172.21.15.17:0/4051353189 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:18.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.542+0000 7f2ab9c00640 1 --2- 172.21.15.17:0/4051353189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ab4101fb0 0x7f2ab4197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:60640/0 (socket says 172.21.15.17:60640) 2024-09-13T15:55:18.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.542+0000 7f2ab9200640 1 --2- 172.21.15.17:0/4051353189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ab41031a0 0x7f2ab41984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:18.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.543+0000 7f2ab9c00640 1 -- 172.21.15.17:0/4051353189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ab41031a0 msgr2=0x7f2ab41984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:18.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.543+0000 7f2ab9c00640 1 --2- 172.21.15.17:0/4051353189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ab41031a0 0x7f2ab41984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.543+0000 7f2ab9c00640 1 -- 172.21.15.17:0/4051353189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ab4103b60 msgr2=0x7f2ab419f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:18.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.543+0000 7f2ab9c00640 1 --2- 172.21.15.17:0/4051353189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ab4103b60 0x7f2ab419f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.543+0000 7f2ab9c00640 1 -- 172.21.15.17:0/4051353189 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa0009490 con 0x7f2ab4101fb0 2024-09-13T15:55:18.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.543+0000 7f2ab9c00640 1 --2- 172.21.15.17:0/4051353189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ab4101fb0 0x7f2ab4197fb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009230 tx=0x7f2aa8003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:18.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.543+0000 7f2ab2000640 1 -- 172.21.15.17:0/4051353189 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8003e00 con 0x7f2ab4101fb0 2024-09-13T15:55:18.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.543+0000 7f2abc600640 1 -- 172.21.15.17:0/4051353189 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa8009560 con 0x7f2ab4101fb0 2024-09-13T15:55:18.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.543+0000 7f2ab2000640 1 -- 172.21.15.17:0/4051353189 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2aa8031c70 con 0x7f2ab4101fb0 2024-09-13T15:55:18.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.543+0000 7f2ab2000640 1 -- 172.21.15.17:0/4051353189 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa803bbf0 con 0x7f2ab4101fb0 2024-09-13T15:55:18.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.543+0000 7f2abc600640 1 -- 172.21.15.17:0/4051353189 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab41a0340 con 0x7f2ab4101fb0 2024-09-13T15:55:18.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.544+0000 7f2abc600640 1 -- 172.21.15.17:0/4051353189 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab4109410 con 0x7f2ab4101fb0 2024-09-13T15:55:18.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.546+0000 7f2ab2000640 1 -- 172.21.15.17:0/4051353189 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2aa803bd50 con 0x7f2ab4101fb0 2024-09-13T15:55:18.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.548+0000 7f2ab2000640 1 --2- 172.21.15.17:0/4051353189 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2a9c0a1120 0x7f2a9c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:18.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.548+0000 7f2ab2000640 1 -- 172.21.15.17:0/4051353189 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f2aa80ed410 con 0x7f2ab4101fb0 2024-09-13T15:55:18.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.548+0000 7f2ab9200640 1 --2- 172.21.15.17:0/4051353189 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2a9c0a1120 0x7f2a9c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:18.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.549+0000 7f2ab9200640 1 --2- 172.21.15.17:0/4051353189 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2a9c0a1120 0x7f2a9c0a35e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2ab41994c0 tx=0x7f2aa0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:18.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.550+0000 7f2ab2000640 1 -- 172.21.15.17:0/4051353189 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2aa80b68a0 con 0x7f2ab4101fb0 2024-09-13T15:55:18.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:18 smithi189 ceph-mon[34790]: from='client.24833 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:55:18.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:18 smithi189 ceph-mon[34790]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:55:18.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:18 smithi189 ceph-mon[34790]: pgmap v308: 129 pgs: 129 active+clean; 582 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 2.0 KiB/s wr, 4 op/s 2024-09-13T15:55:18.607 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 13 15:55:18 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-b[65010]: 2024-09-13T15:55:18.212+0000 7f0b78677640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-13T15:55:18.607 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 13 15:55:18 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-b[65010]: 2024-09-13T15:55:18.212+0000 7f0b78677640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-13T15:55:18.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:18 smithi193 ceph-mon[35248]: from='client.24833 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:55:18.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:18 smithi193 ceph-mon[35248]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:55:18.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:18 smithi193 ceph-mon[35248]: pgmap v308: 129 pgs: 129 active+clean; 582 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 2.0 KiB/s wr, 4 op/s 2024-09-13T15:55:18.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.766+0000 7f2abc600640 1 -- 172.21.15.17:0/4051353189 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ab410d8c0 con 0x7f2ab4101fb0 2024-09-13T15:55:18.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.767+0000 7f2ab2000640 1 -- 172.21.15.17:0/4051353189 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10879 (secure 0 0 0) 0x7f2aa80b6020 con 0x7f2ab4101fb0 2024-09-13T15:55:18.768 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:55:18.768 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1730156534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1730156534},{"type":"v1","addr":"172.21.15.17:6837","nonce":1730156534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/1295854211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1295854211},{"type":"v1","addr":"172.21.15.17:6841","nonce":1295854211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2888593680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2888593680},{"type":"v1","addr":"172.21.15.17:6835","nonce":2888593680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4135454212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4135454212},{"type":"v1","addr":"172.21.15.189:6835","nonce":4135454212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T15:54:52.929867+0000","modified":"2024-09-13T15:55:16.253229+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24565,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24520":{"gid":24520,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/4049465204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":4049465204},{"type":"v1","addr":"172.21.15.193:6835","nonce":4049465204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/2079181485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2079181485},{"type":"v1","addr":"172.21.15.189:6837","nonce":2079181485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24532":{"gid":24532,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/792056943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":792056943},{"type":"v1","addr":"172.21.15.193:6837","nonce":792056943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24553":{"gid":24553,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6839/3012199875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":3012199875},{"type":"v1","addr":"172.21.15.193:6839","nonce":3012199875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24565":{"gid":24565,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.17:6839/3750040765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3750040765},{"type":"v1","addr":"172.21.15.17:6839","nonce":3750040765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6839/2624723395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2624723395},{"type":"v1","addr":"172.21.15.189:6839","nonce":2624723395}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:55:18.769 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-13T15:55:18.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.770+0000 7f2abc600640 1 -- 172.21.15.17:0/4051353189 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2a9c0a1120 msgr2=0x7f2a9c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:18.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.770+0000 7f2abc600640 1 --2- 172.21.15.17:0/4051353189 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2a9c0a1120 0x7f2a9c0a35e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2ab41994c0 tx=0x7f2aa0005f90 comp rx=0 tx=0).stop 2024-09-13T15:55:18.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.770+0000 7f2abc600640 1 -- 172.21.15.17:0/4051353189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ab4101fb0 msgr2=0x7f2ab4197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:18.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.770+0000 7f2abc600640 1 --2- 172.21.15.17:0/4051353189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ab4101fb0 0x7f2ab4197fb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009230 tx=0x7f2aa8003c10 comp rx=0 tx=0).stop 2024-09-13T15:55:18.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.770+0000 7f2abc600640 1 -- 172.21.15.17:0/4051353189 shutdown_connections 2024-09-13T15:55:18.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.770+0000 7f2abc600640 1 --2- 172.21.15.17:0/4051353189 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2a9c0a1120 0x7f2a9c0a35e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.770+0000 7f2abc600640 1 --2- 172.21.15.17:0/4051353189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ab4103b60 0x7f2ab419f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.770+0000 7f2abc600640 1 --2- 172.21.15.17:0/4051353189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ab41031a0 0x7f2ab41984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.770+0000 7f2abc600640 1 --2- 172.21.15.17:0/4051353189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ab4101fb0 0x7f2ab4197fb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.770+0000 7f2abc600640 1 -- 172.21.15.17:0/4051353189 >> 172.21.15.17:0/4051353189 conn(0x7f2ab40fd730 msgr2=0x7f2ab41065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:18.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.770+0000 7f2abc600640 1 -- 172.21.15.17:0/4051353189 shutdown_connections 2024-09-13T15:55:18.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.770+0000 7f2abc600640 1 -- 172.21.15.17:0/4051353189 wait complete. 2024-09-13T15:55:18.787 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:55:18.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.943+0000 7fcec5200640 1 -- 172.21.15.17:0/1512178149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcec00ffda0 msgr2=0x7fcec01001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:18.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.943+0000 7fcec5200640 1 --2- 172.21.15.17:0/1512178149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcec00ffda0 0x7fcec01001a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009900 tx=0x7fceb002a400 comp rx=0 tx=0).stop 2024-09-13T15:55:18.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.943+0000 7fcec5200640 1 -- 172.21.15.17:0/1512178149 shutdown_connections 2024-09-13T15:55:18.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.943+0000 7fcec5200640 1 --2- 172.21.15.17:0/1512178149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcec0101950 0x7fcec01081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.943+0000 7fcec5200640 1 --2- 172.21.15.17:0/1512178149 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcec0100f90 0x7fcec0101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.943+0000 7fcec5200640 1 --2- 172.21.15.17:0/1512178149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcec00ffda0 0x7fcec01001a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.943+0000 7fcec5200640 1 -- 172.21.15.17:0/1512178149 >> 172.21.15.17:0/1512178149 conn(0x7fcec00fb520 msgr2=0x7fcec00fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:18.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.943+0000 7fcec5200640 1 -- 172.21.15.17:0/1512178149 shutdown_connections 2024-09-13T15:55:18.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.943+0000 7fcec5200640 1 -- 172.21.15.17:0/1512178149 wait complete. 2024-09-13T15:55:18.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.944+0000 7fcec5200640 1 Processor -- start 2024-09-13T15:55:18.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.944+0000 7fcec5200640 1 -- start start 2024-09-13T15:55:18.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.944+0000 7fcec5200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcec00ffda0 0x7fcec0195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:18.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.944+0000 7fcec5200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcec0100f90 0x7fcec0196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:18.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.944+0000 7fcec5200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcec0101950 0x7fcec019d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:18.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.944+0000 7fcec5200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec019d900 con 0x7fcec00ffda0 2024-09-13T15:55:18.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.944+0000 7fcec5200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec019da70 con 0x7fcec0100f90 2024-09-13T15:55:18.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.944+0000 7fcec5200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec019dc30 con 0x7fcec0101950 2024-09-13T15:55:18.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.945+0000 7fcebde00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcec00ffda0 0x7fcec0195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:18.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.945+0000 7fcebde00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcec00ffda0 0x7fcec0195e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45976/0 (socket says 172.21.15.17:45976) 2024-09-13T15:55:18.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.945+0000 7fcebde00640 1 -- 172.21.15.17:0/482363475 learned_addr learned my addr 172.21.15.17:0/482363475 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:18.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.945+0000 7fcebe800640 1 --2- 172.21.15.17:0/482363475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcec0101950 0x7fcec019d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:18.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.945+0000 7fceb5400640 1 --2- 172.21.15.17:0/482363475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcec0100f90 0x7fcec0196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:18.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.945+0000 7fcebde00640 1 -- 172.21.15.17:0/482363475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcec0101950 msgr2=0x7fcec019d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:18.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.945+0000 7fcebde00640 1 --2- 172.21.15.17:0/482363475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcec0101950 0x7fcec019d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.945+0000 7fcebde00640 1 -- 172.21.15.17:0/482363475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcec0100f90 msgr2=0x7fcec0196350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:18.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.945+0000 7fcebde00640 1 --2- 172.21.15.17:0/482363475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcec0100f90 0x7fcec0196350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:18.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.945+0000 7fcebde00640 1 -- 172.21.15.17:0/482363475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb0009560 con 0x7fcec00ffda0 2024-09-13T15:55:18.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.945+0000 7fcebde00640 1 --2- 172.21.15.17:0/482363475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcec00ffda0 0x7fcec0195e10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fceb0031500 tx=0x7fceb0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:18.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.946+0000 7fceb7400640 1 -- 172.21.15.17:0/482363475 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb0003e00 con 0x7fcec00ffda0 2024-09-13T15:55:18.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.946+0000 7fceb7400640 1 -- 172.21.15.17:0/482363475 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fceb0031c70 con 0x7fcec00ffda0 2024-09-13T15:55:18.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.946+0000 7fcec5200640 1 -- 172.21.15.17:0/482363475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec019deb0 con 0x7fcec00ffda0 2024-09-13T15:55:18.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.946+0000 7fceb7400640 1 -- 172.21.15.17:0/482363475 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb003bd80 con 0x7fcec00ffda0 2024-09-13T15:55:18.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.946+0000 7fcec5200640 1 -- 172.21.15.17:0/482363475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec019e2d0 con 0x7fcec00ffda0 2024-09-13T15:55:18.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.947+0000 7fcec5200640 1 -- 172.21.15.17:0/482363475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec0107280 con 0x7fcec00ffda0 2024-09-13T15:55:18.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.949+0000 7fceb7400640 1 -- 172.21.15.17:0/482363475 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fceb003b460 con 0x7fcec00ffda0 2024-09-13T15:55:18.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.950+0000 7fceb7400640 1 --2- 172.21.15.17:0/482363475 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcea40a11a0 0x7fcea40a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:18.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.950+0000 7fceb7400640 1 -- 172.21.15.17:0/482363475 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fceb00ed500 con 0x7fcec00ffda0 2024-09-13T15:55:18.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.950+0000 7fceb5400640 1 --2- 172.21.15.17:0/482363475 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcea40a11a0 0x7fcea40a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:18.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.951+0000 7fceb5400640 1 --2- 172.21.15.17:0/482363475 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcea40a11a0 0x7fcea40a3660 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcec0197320 tx=0x7fcea800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:18.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:18.954+0000 7fceb7400640 1 -- 172.21.15.17:0/482363475 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fceb00b6990 con 0x7fcec00ffda0 2024-09-13T15:55:19.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.134+0000 7fcec5200640 1 -- 172.21.15.17:0/482363475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcec002c480 con 0x7fcec00ffda0 2024-09-13T15:55:19.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.136+0000 7fceb7400640 1 -- 172.21.15.17:0/482363475 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23935 (secure 0 0 0) 0x7fceb00b9fb0 con 0x7fcec00ffda0 2024-09-13T15:55:19.137 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:55:19.137 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":90,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","created":"2024-09-13T15:46:50.475750+0000","modified":"2024-09-13T15:54:57.383548+0000","last_up_change":"2024-09-13T15:53:59.138985+0000","last_in_change":"2024-09-13T15:53:39.220264+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:50:10.657011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:54:51.436469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:54:52.427930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:54:55.478058+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5d39d6af-15e6-463b-b9ff-a9a5dd94e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6803","nonce":158651212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6805","nonce":158651212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6809","nonce":158651212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6807","nonce":158651212}]},"public_addr":"172.21.15.17:6803/158651212","cluster_addr":"172.21.15.17:6805/158651212","heartbeat_back_addr":"172.21.15.17:6809/158651212","heartbeat_front_addr":"172.21.15.17:6807/158651212","state":["exists","up"]},{"osd":1,"uuid":"0da621c7-645b-44ae-ba7c-a573861c3aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6801","nonce":964319421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6803","nonce":964319421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6807","nonce":964319421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6805","nonce":964319421}]},"public_addr":"172.21.15.189:6801/964319421","cluster_addr":"172.21.15.189:6803/964319421","heartbeat_back_addr":"172.21.15.189:6807/964319421","heartbeat_front_addr":"172.21.15.189:6805/964319421","state":["exists","up"]},{"osd":2,"uuid":"fa95af60-1486-4a29-8c79-8a73a4146552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6801","nonce":138468002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6803","nonce":138468002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6807","nonce":138468002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6805","nonce":138468002}]},"public_addr":"172.21.15.193:6801/138468002","cluster_addr":"172.21.15.193:6803/138468002","heartbeat_back_addr":"172.21.15.193:6807/138468002","heartbeat_front_addr":"172.21.15.193:6805/138468002","state":["exists","up"]},{"osd":3,"uuid":"90428e5f-dfd4-4cda-b240-fdb9079bcb7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6811","nonce":919913803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6813","nonce":919913803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6817","nonce":919913803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6815","nonce":919913803}]},"public_addr":"172.21.15.17:6811/919913803","cluster_addr":"172.21.15.17:6813/919913803","heartbeat_back_addr":"172.21.15.17:6817/919913803","heartbeat_front_addr":"172.21.15.17:6815/919913803","state":["exists","up"]},{"osd":4,"uuid":"e1c537b6-98d2-4b66-b15a-65fe70b0ce25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6809","nonce":2310375565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6811","nonce":2310375565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6815","nonce":2310375565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6813","nonce":2310375565}]},"public_addr":"172.21.15.189:6809/2310375565","cluster_addr":"172.21.15.189:6811/2310375565","heartbeat_back_addr":"172.21.15.189:6815/2310375565","heartbeat_front_addr":"172.21.15.189:6813/2310375565","state":["exists","up"]},{"osd":5,"uuid":"48522fd7-d781-4447-873f-174dabd1e33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6809","nonce":1330877824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6811","nonce":1330877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6815","nonce":1330877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6813","nonce":1330877824}]},"public_addr":"172.21.15.193:6809/1330877824","cluster_addr":"172.21.15.193:6811/1330877824","heartbeat_back_addr":"172.21.15.193:6815/1330877824","heartbeat_front_addr":"172.21.15.193:6813/1330877824","state":["exists","up"]},{"osd":6,"uuid":"47bea191-fb53-40a7-8563-8ebf17dd5bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6819","nonce":3930545382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6821","nonce":3930545382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6825","nonce":3930545382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6823","nonce":3930545382}]},"public_addr":"172.21.15.17:6819/3930545382","cluster_addr":"172.21.15.17:6821/3930545382","heartbeat_back_addr":"172.21.15.17:6825/3930545382","heartbeat_front_addr":"172.21.15.17:6823/3930545382","state":["exists","up"]},{"osd":7,"uuid":"a98f36f9-0a19-4c9a-8ed1-615c4a6e7658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6817","nonce":3691677495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6819","nonce":3691677495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6823","nonce":3691677495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6821","nonce":3691677495}]},"public_addr":"172.21.15.189:6817/3691677495","cluster_addr":"172.21.15.189:6819/3691677495","heartbeat_back_addr":"172.21.15.189:6823/3691677495","heartbeat_front_addr":"172.21.15.189:6821/3691677495","state":["exists","up"]},{"osd":8,"uuid":"7a372d9f-c40f-4ead-87da-2f3a570c1373","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6817","nonce":4112907498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6819","nonce":4112907498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6823","nonce":4112907498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6821","nonce":4112907498}]},"public_addr":"172.21.15.193:6817/4112907498","cluster_addr":"172.21.15.193:6819/4112907498","heartbeat_back_addr":"172.21.15.193:6823/4112907498","heartbeat_front_addr":"172.21.15.193:6821/4112907498","state":["exists","up"]},{"osd":9,"uuid":"ac3d983c-c5e7-456b-8271-7c4e6169de61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6827","nonce":663424274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6829","nonce":663424274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6833","nonce":663424274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6831","nonce":663424274}]},"public_addr":"172.21.15.17:6827/663424274","cluster_addr":"172.21.15.17:6829/663424274","heartbeat_back_addr":"172.21.15.17:6833/663424274","heartbeat_front_addr":"172.21.15.17:6831/663424274","state":["exists","up"]},{"osd":10,"uuid":"08dcae02-6c79-4a06-ae88-6eb6e6941cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6825","nonce":3153990375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6827","nonce":3153990375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6831","nonce":3153990375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6829","nonce":3153990375}]},"public_addr":"172.21.15.189:6825/3153990375","cluster_addr":"172.21.15.189:6827/3153990375","heartbeat_back_addr":"172.21.15.189:6831/3153990375","heartbeat_front_addr":"172.21.15.189:6829/3153990375","state":["exists","up"]},{"osd":11,"uuid":"a4ebcf41-d805-4d44-b112-13ae84d51868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6825","nonce":4088053907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6827","nonce":4088053907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6831","nonce":4088053907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6829","nonce":4088053907}]},"public_addr":"172.21.15.193:6825/4088053907","cluster_addr":"172.21.15.193:6827/4088053907","heartbeat_back_addr":"172.21.15.193:6831/4088053907","heartbeat_front_addr":"172.21.15.193:6829/4088053907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:22.172370+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:44.802224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:06.641435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:34.536515+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:58.789324+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:22.189862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:50.382257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:14.678047+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:38.581105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:07.258150+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:32.261383+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:56.739338+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/1550067038":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/3360683829":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/634066188":"2024-09-14T15:47:42.048005+0000","172.21.15.17:6801/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1945536687":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/2214214377":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1224386591":"2024-09-14T15:47:14.996424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:55:19.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.138+0000 7fcec5200640 1 -- 172.21.15.17:0/482363475 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcea40a11a0 msgr2=0x7fcea40a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:19.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.138+0000 7fcec5200640 1 --2- 172.21.15.17:0/482363475 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcea40a11a0 0x7fcea40a3660 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcec0197320 tx=0x7fcea800b390 comp rx=0 tx=0).stop 2024-09-13T15:55:19.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.138+0000 7fcec5200640 1 -- 172.21.15.17:0/482363475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcec00ffda0 msgr2=0x7fcec0195e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:19.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.138+0000 7fcec5200640 1 --2- 172.21.15.17:0/482363475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcec00ffda0 0x7fcec0195e10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fceb0031500 tx=0x7fceb0003c10 comp rx=0 tx=0).stop 2024-09-13T15:55:19.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.138+0000 7fcec5200640 1 -- 172.21.15.17:0/482363475 shutdown_connections 2024-09-13T15:55:19.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.138+0000 7fcec5200640 1 --2- 172.21.15.17:0/482363475 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcea40a11a0 0x7fcea40a3660 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:19.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.138+0000 7fcec5200640 1 --2- 172.21.15.17:0/482363475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcec0101950 0x7fcec019d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:19.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.138+0000 7fcec5200640 1 --2- 172.21.15.17:0/482363475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcec0100f90 0x7fcec0196350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:19.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.138+0000 7fcec5200640 1 --2- 172.21.15.17:0/482363475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcec00ffda0 0x7fcec0195e10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:19.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.138+0000 7fcec5200640 1 -- 172.21.15.17:0/482363475 >> 172.21.15.17:0/482363475 conn(0x7fcec00fb520 msgr2=0x7fcec0104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:19.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.138+0000 7fcec5200640 1 -- 172.21.15.17:0/482363475 shutdown_connections 2024-09-13T15:55:19.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.138+0000 7fcec5200640 1 -- 172.21.15.17:0/482363475 wait complete. 2024-09-13T15:55:19.156 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T15:55:19.156 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:55:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.318+0000 7fd62ba00640 1 -- 172.21.15.17:0/13942521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd624100820 msgr2=0x7fd624102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.318+0000 7fd62ba00640 1 --2- 172.21.15.17:0/13942521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd624100820 0x7fd624102c10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd618009900 tx=0x7fd61802a410 comp rx=0 tx=0).stop 2024-09-13T15:55:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.318+0000 7fd62ba00640 1 -- 172.21.15.17:0/13942521 shutdown_connections 2024-09-13T15:55:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.318+0000 7fd62ba00640 1 --2- 172.21.15.17:0/13942521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd624105a80 0x7fd624107ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.318+0000 7fd62ba00640 1 --2- 172.21.15.17:0/13942521 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd624103150 0x7fd624105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.318+0000 7fd62ba00640 1 --2- 172.21.15.17:0/13942521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd624100820 0x7fd624102c10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.318+0000 7fd62ba00640 1 -- 172.21.15.17:0/13942521 >> 172.21.15.17:0/13942521 conn(0x7fd6240fa420 msgr2=0x7fd6240fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.318+0000 7fd62ba00640 1 -- 172.21.15.17:0/13942521 shutdown_connections 2024-09-13T15:55:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.319+0000 7fd62ba00640 1 -- 172.21.15.17:0/13942521 wait complete. 2024-09-13T15:55:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.319+0000 7fd62ba00640 1 Processor -- start 2024-09-13T15:55:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.319+0000 7fd62ba00640 1 -- start start 2024-09-13T15:55:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.320+0000 7fd62ba00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd624100820 0x7fd624100190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.320+0000 7fd62ba00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd624103150 0x7fd6240fe7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.320+0000 7fd62ba00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd624105a80 0x7fd6240fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.320+0000 7fd62ba00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6240ff470 con 0x7fd624105a80 2024-09-13T15:55:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.320+0000 7fd62ba00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6240ff5e0 con 0x7fd624103150 2024-09-13T15:55:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.320+0000 7fd62ba00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62419ff60 con 0x7fd624100820 2024-09-13T15:55:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.320+0000 7fd629a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd624105a80 0x7fd6240fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.320+0000 7fd629a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd624105a80 0x7fd6240fed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46000/0 (socket says 172.21.15.17:46000) 2024-09-13T15:55:19.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.320+0000 7fd629a00640 1 -- 172.21.15.17:0/2731530738 learned_addr learned my addr 172.21.15.17:0/2731530738 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:19.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.320+0000 7fd623e00640 1 --2- 172.21.15.17:0/2731530738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd624103150 0x7fd6240fe7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:19.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.320+0000 7fd629000640 1 --2- 172.21.15.17:0/2731530738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd624100820 0x7fd624100190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:19.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.321+0000 7fd629a00640 1 -- 172.21.15.17:0/2731530738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd624100820 msgr2=0x7fd624100190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:19.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.321+0000 7fd629a00640 1 --2- 172.21.15.17:0/2731530738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd624100820 0x7fd624100190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:19.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.321+0000 7fd629a00640 1 -- 172.21.15.17:0/2731530738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd624103150 msgr2=0x7fd6240fe7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:19.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.321+0000 7fd629a00640 1 --2- 172.21.15.17:0/2731530738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd624103150 0x7fd6240fe7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:19.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.321+0000 7fd629a00640 1 -- 172.21.15.17:0/2731530738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd618009560 con 0x7fd624105a80 2024-09-13T15:55:19.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.321+0000 7fd629a00640 1 --2- 172.21.15.17:0/2731530738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd624105a80 0x7fd6240fed10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd61c00eb70 tx=0x7fd61c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:19.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.321+0000 7fd621600640 1 -- 172.21.15.17:0/2731530738 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c004d20 con 0x7fd624105a80 2024-09-13T15:55:19.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.321+0000 7fd621600640 1 -- 172.21.15.17:0/2731530738 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd61c004e80 con 0x7fd624105a80 2024-09-13T15:55:19.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.321+0000 7fd62ba00640 1 -- 172.21.15.17:0/2731530738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6241a0210 con 0x7fd624105a80 2024-09-13T15:55:19.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.321+0000 7fd621600640 1 -- 172.21.15.17:0/2731530738 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c010670 con 0x7fd624105a80 2024-09-13T15:55:19.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.321+0000 7fd62ba00640 1 -- 172.21.15.17:0/2731530738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6241a06d0 con 0x7fd624105a80 2024-09-13T15:55:19.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.322+0000 7fd62ba00640 1 -- 172.21.15.17:0/2731530738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6240fbf10 con 0x7fd624105a80 2024-09-13T15:55:19.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.324+0000 7fd621600640 1 -- 172.21.15.17:0/2731530738 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fd61c005020 con 0x7fd624105a80 2024-09-13T15:55:19.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.325+0000 7fd621600640 1 --2- 172.21.15.17:0/2731530738 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd60c0a1120 0x7fd60c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:19.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.326+0000 7fd621600640 1 -- 172.21.15.17:0/2731530738 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd61c014070 con 0x7fd624105a80 2024-09-13T15:55:19.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.326+0000 7fd629000640 1 --2- 172.21.15.17:0/2731530738 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd60c0a1120 0x7fd60c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:19.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.326+0000 7fd629000640 1 --2- 172.21.15.17:0/2731530738 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd60c0a1120 0x7fd60c0a35e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd618006010 tx=0x7fd6180314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:19.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.329+0000 7fd621600640 1 -- 172.21.15.17:0/2731530738 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd61c096910 con 0x7fd624105a80 2024-09-13T15:55:19.496 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:19 smithi017 ceph-mon[30494]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-13T15:55:19.496 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:19 smithi017 ceph-mon[30494]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:55:19.496 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:19 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/4051353189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:55:19.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:19 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/482363475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:19.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.544+0000 7fd62ba00640 1 -- 172.21.15.17:0/2731530738 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd62402c450 con 0x7fd60c0a1120 2024-09-13T15:55:19.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.559+0000 7fd621600640 1 -- 172.21.15.17:0/2731530738 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+423069 (secure 0 0 0) 0x7fd62402c450 con 0x7fd60c0a1120 2024-09-13T15:55:19.565 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:55:19.570 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-13T15:55:19.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.565+0000 7fd62ba00640 1 -- 172.21.15.17:0/2731530738 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd60c0a1120 msgr2=0x7fd60c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:19.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.565+0000 7fd62ba00640 1 --2- 172.21.15.17:0/2731530738 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd60c0a1120 0x7fd60c0a35e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd618006010 tx=0x7fd6180314a0 comp rx=0 tx=0).stop 2024-09-13T15:55:19.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.565+0000 7fd62ba00640 1 -- 172.21.15.17:0/2731530738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd624105a80 msgr2=0x7fd6240fed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:19.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.565+0000 7fd62ba00640 1 --2- 172.21.15.17:0/2731530738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd624105a80 0x7fd6240fed10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd61c00eb70 tx=0x7fd61c00c6a0 comp rx=0 tx=0).stop 2024-09-13T15:55:19.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.565+0000 7fd62ba00640 1 -- 172.21.15.17:0/2731530738 shutdown_connections 2024-09-13T15:55:19.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.565+0000 7fd62ba00640 1 --2- 172.21.15.17:0/2731530738 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd60c0a1120 0x7fd60c0a35e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:19.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.565+0000 7fd62ba00640 1 --2- 172.21.15.17:0/2731530738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd624105a80 0x7fd6240fed10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:19.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.565+0000 7fd62ba00640 1 --2- 172.21.15.17:0/2731530738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd624103150 0x7fd6240fe7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:19.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.565+0000 7fd62ba00640 1 --2- 172.21.15.17:0/2731530738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd624100820 0x7fd624100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:19.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.565+0000 7fd62ba00640 1 -- 172.21.15.17:0/2731530738 >> 172.21.15.17:0/2731530738 conn(0x7fd6240fa420 msgr2=0x7fd624101180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:19.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.566+0000 7fd62ba00640 1 -- 172.21.15.17:0/2731530738 shutdown_connections 2024-09-13T15:55:19.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.566+0000 7fd62ba00640 1 -- 172.21.15.17:0/2731530738 wait complete. 2024-09-13T15:55:19.585 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2024-09-13T15:55:18.142642+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595939,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":128,"num_read_kb":111,"num_write":280,"num_write_kb":2977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370468,"kb_used_data":13452,"kb_used_omap":18,"kb_used_meta":356845,"kb_avail":1124571356,"statfs":{"total":1151940427776,"available":1151561068544,"internally_reserved":0,"allocated":13774848,"data_stored":7560525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19130,"internal_metadata":365409606},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2759,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003470"},"pg_stats":[{"pgid":"2.1f","version":"85'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953629+0000","last_change":"2024-09-13T15:54:52.516551+0000","last_active":"2024-09-13T15:54:56.953629+0000","last_peered":"2024-09-13T15:54:56.953629+0000","last_clean":"2024-09-13T15:54:56.953629+0000","last_became_active":"2024-09-13T15:54:52.516112+0000","last_became_peered":"2024-09-13T15:54:52.516112+0000","last_unstale":"2024-09-13T15:54:56.953629+0000","last_undegraded":"2024-09-13T15:54:56.953629+0000","last_fullsized":"2024-09-13T15:54:56.953629+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:55.147164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.975263+0000","last_change":"2024-09-13T15:54:52.954466+0000","last_active":"2024-09-13T15:54:56.975263+0000","last_peered":"2024-09-13T15:54:56.975263+0000","last_clean":"2024-09-13T15:54:56.975263+0000","last_became_active":"2024-09-13T15:54:52.953991+0000","last_became_peered":"2024-09-13T15:54:52.953991+0000","last_unstale":"2024-09-13T15:54:56.975263+0000","last_undegraded":"2024-09-13T15:54:56.975263+0000","last_fullsized":"2024-09-13T15:54:56.975263+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:17.702395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638764+0000","last_change":"2024-09-13T15:54:56.970987+0000","last_active":"2024-09-13T15:54:57.638764+0000","last_peered":"2024-09-13T15:54:57.638764+0000","last_clean":"2024-09-13T15:54:57.638764+0000","last_became_active":"2024-09-13T15:54:56.970594+0000","last_became_peered":"2024-09-13T15:54:56.970594+0000","last_unstale":"2024-09-13T15:54:57.638764+0000","last_undegraded":"2024-09-13T15:54:57.638764+0000","last_fullsized":"2024-09-13T15:54:57.638764+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:56.833427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.609821+0000","last_change":"2024-09-13T15:54:52.517608+0000","last_active":"2024-09-13T15:54:57.609821+0000","last_peered":"2024-09-13T15:54:57.609821+0000","last_clean":"2024-09-13T15:54:57.609821+0000","last_became_active":"2024-09-13T15:54:52.517001+0000","last_became_peered":"2024-09-13T15:54:52.517001+0000","last_unstale":"2024-09-13T15:54:57.609821+0000","last_undegraded":"2024-09-13T15:54:57.609821+0000","last_fullsized":"2024-09-13T15:54:57.609821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:51.459179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.973682+0000","last_change":"2024-09-13T15:54:52.944713+0000","last_active":"2024-09-13T15:54:56.973682+0000","last_peered":"2024-09-13T15:54:56.973682+0000","last_clean":"2024-09-13T15:54:56.973682+0000","last_became_active":"2024-09-13T15:54:52.943602+0000","last_became_peered":"2024-09-13T15:54:52.943602+0000","last_unstale":"2024-09-13T15:54:56.973682+0000","last_undegraded":"2024-09-13T15:54:56.973682+0000","last_fullsized":"2024-09-13T15:54:56.973682+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:59.305153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638386+0000","last_change":"2024-09-13T15:54:56.981923+0000","last_active":"2024-09-13T15:54:57.638386+0000","last_peered":"2024-09-13T15:54:57.638386+0000","last_clean":"2024-09-13T15:54:57.638386+0000","last_became_active":"2024-09-13T15:54:56.981640+0000","last_became_peered":"2024-09-13T15:54:56.981640+0000","last_unstale":"2024-09-13T15:54:57.638386+0000","last_undegraded":"2024-09-13T15:54:57.638386+0000","last_fullsized":"2024-09-13T15:54:57.638386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:42.158619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:15.254688+0000","last_change":"2024-09-13T15:54:52.512700+0000","last_active":"2024-09-13T15:55:15.254688+0000","last_peered":"2024-09-13T15:55:15.254688+0000","last_clean":"2024-09-13T15:55:15.254688+0000","last_became_active":"2024-09-13T15:54:52.512378+0000","last_became_peered":"2024-09-13T15:54:52.512378+0000","last_unstale":"2024-09-13T15:55:15.254688+0000","last_undegraded":"2024-09-13T15:55:15.254688+0000","last_fullsized":"2024-09-13T15:55:15.254688+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:43:23.573164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.193395+0000","last_change":"2024-09-13T15:54:52.957314+0000","last_active":"2024-09-13T15:54:57.193395+0000","last_peered":"2024-09-13T15:54:57.193395+0000","last_clean":"2024-09-13T15:54:57.193395+0000","last_became_active":"2024-09-13T15:54:52.956836+0000","last_became_peered":"2024-09-13T15:54:52.956836+0000","last_unstale":"2024-09-13T15:54:57.193395+0000","last_undegraded":"2024-09-13T15:54:57.193395+0000","last_fullsized":"2024-09-13T15:54:57.193395+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:06.088700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.639200+0000","last_change":"2024-09-13T15:54:56.970777+0000","last_active":"2024-09-13T15:54:57.639200+0000","last_peered":"2024-09-13T15:54:57.639200+0000","last_clean":"2024-09-13T15:54:57.639200+0000","last_became_active":"2024-09-13T15:54:56.970424+0000","last_became_peered":"2024-09-13T15:54:56.970424+0000","last_unstale":"2024-09-13T15:54:57.639200+0000","last_undegraded":"2024-09-13T15:54:57.639200+0000","last_fullsized":"2024-09-13T15:54:57.639200+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:00.045336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.958914+0000","last_change":"2024-09-13T15:54:52.511776+0000","last_active":"2024-09-13T15:54:56.958914+0000","last_peered":"2024-09-13T15:54:56.958914+0000","last_clean":"2024-09-13T15:54:56.958914+0000","last_became_active":"2024-09-13T15:54:52.511412+0000","last_became_peered":"2024-09-13T15:54:52.511412+0000","last_unstale":"2024-09-13T15:54:56.958914+0000","last_undegraded":"2024-09-13T15:54:56.958914+0000","last_fullsized":"2024-09-13T15:54:56.958914+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:18.162778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.964405+0000","last_change":"2024-09-13T15:54:52.960036+0000","last_active":"2024-09-13T15:54:56.964405+0000","last_peered":"2024-09-13T15:54:56.964405+0000","last_clean":"2024-09-13T15:54:56.964405+0000","last_became_active":"2024-09-13T15:54:52.959736+0000","last_became_peered":"2024-09-13T15:54:52.959736+0000","last_unstale":"2024-09-13T15:54:56.964405+0000","last_undegraded":"2024-09-13T15:54:56.964405+0000","last_fullsized":"2024-09-13T15:54:56.964405+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:20.567295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638665+0000","last_change":"2024-09-13T15:54:56.973334+0000","last_active":"2024-09-13T15:54:57.638665+0000","last_peered":"2024-09-13T15:54:57.638665+0000","last_clean":"2024-09-13T15:54:57.638665+0000","last_became_active":"2024-09-13T15:54:56.973087+0000","last_became_peered":"2024-09-13T15:54:56.973087+0000","last_unstale":"2024-09-13T15:54:57.638665+0000","last_undegraded":"2024-09-13T15:54:57.638665+0000","last_fullsized":"2024-09-13T15:54:57.638665+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:19.727601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953492+0000","last_change":"2024-09-13T15:54:52.955223+0000","last_active":"2024-09-13T15:54:56.953492+0000","last_peered":"2024-09-13T15:54:56.953492+0000","last_clean":"2024-09-13T15:54:56.953492+0000","last_became_active":"2024-09-13T15:54:52.954848+0000","last_became_peered":"2024-09-13T15:54:52.954848+0000","last_unstale":"2024-09-13T15:54:56.953492+0000","last_undegraded":"2024-09-13T15:54:56.953492+0000","last_fullsized":"2024-09-13T15:54:56.953492+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:36.921666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:14.250552+0000","last_change":"2024-09-13T15:54:52.513484+0000","last_active":"2024-09-13T15:55:14.250552+0000","last_peered":"2024-09-13T15:55:14.250552+0000","last_clean":"2024-09-13T15:55:14.250552+0000","last_became_active":"2024-09-13T15:54:52.513143+0000","last_became_peered":"2024-09-13T15:54:52.513143+0000","last_unstale":"2024-09-13T15:55:14.250552+0000","last_undegraded":"2024-09-13T15:55:14.250552+0000","last_fullsized":"2024-09-13T15:55:14.250552+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:31.735280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638860+0000","last_change":"2024-09-13T15:54:57.082924+0000","last_active":"2024-09-13T15:54:57.638860+0000","last_peered":"2024-09-13T15:54:57.638860+0000","last_clean":"2024-09-13T15:54:57.638860+0000","last_became_active":"2024-09-13T15:54:57.082552+0000","last_became_peered":"2024-09-13T15:54:57.082552+0000","last_unstale":"2024-09-13T15:54:57.638860+0000","last_undegraded":"2024-09-13T15:54:57.638860+0000","last_fullsized":"2024-09-13T15:54:57.638860+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:05.144646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.974229+0000","last_change":"2024-09-13T15:54:52.954909+0000","last_active":"2024-09-13T15:54:56.974229+0000","last_peered":"2024-09-13T15:54:56.974229+0000","last_clean":"2024-09-13T15:54:56.974229+0000","last_became_active":"2024-09-13T15:54:52.954639+0000","last_became_peered":"2024-09-13T15:54:52.954639+0000","last_unstale":"2024-09-13T15:54:56.974229+0000","last_undegraded":"2024-09-13T15:54:56.974229+0000","last_fullsized":"2024-09-13T15:54:56.974229+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:35.984856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953421+0000","last_change":"2024-09-13T15:54:52.518709+0000","last_active":"2024-09-13T15:54:56.953421+0000","last_peered":"2024-09-13T15:54:56.953421+0000","last_clean":"2024-09-13T15:54:56.953421+0000","last_became_active":"2024-09-13T15:54:52.518200+0000","last_became_peered":"2024-09-13T15:54:52.518200+0000","last_unstale":"2024-09-13T15:54:56.953421+0000","last_undegraded":"2024-09-13T15:54:56.953421+0000","last_fullsized":"2024-09-13T15:54:56.953421+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:09.438542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.639220+0000","last_change":"2024-09-13T15:54:56.963815+0000","last_active":"2024-09-13T15:54:57.639220+0000","last_peered":"2024-09-13T15:54:57.639220+0000","last_clean":"2024-09-13T15:54:57.639220+0000","last_became_active":"2024-09-13T15:54:56.963311+0000","last_became_peered":"2024-09-13T15:54:56.963311+0000","last_unstale":"2024-09-13T15:54:57.639220+0000","last_undegraded":"2024-09-13T15:54:57.639220+0000","last_fullsized":"2024-09-13T15:54:57.639220+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:56.464599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.958683+0000","last_change":"2024-09-13T15:54:52.963277+0000","last_active":"2024-09-13T15:54:56.958683+0000","last_peered":"2024-09-13T15:54:56.958683+0000","last_clean":"2024-09-13T15:54:56.958683+0000","last_became_active":"2024-09-13T15:54:52.962941+0000","last_became_peered":"2024-09-13T15:54:52.962941+0000","last_unstale":"2024-09-13T15:54:56.958683+0000","last_undegraded":"2024-09-13T15:54:56.958683+0000","last_fullsized":"2024-09-13T15:54:56.958683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:11.843307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:14.252778+0000","last_change":"2024-09-13T15:54:52.518703+0000","last_active":"2024-09-13T15:55:14.252778+0000","last_peered":"2024-09-13T15:55:14.252778+0000","last_clean":"2024-09-13T15:55:14.252778+0000","last_became_active":"2024-09-13T15:54:52.518384+0000","last_became_peered":"2024-09-13T15:54:52.518384+0000","last_unstale":"2024-09-13T15:55:14.252778+0000","last_undegraded":"2024-09-13T15:55:14.252778+0000","last_fullsized":"2024-09-13T15:55:14.252778+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:39:48.117161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.607534+0000","last_change":"2024-09-13T15:54:56.977372+0000","last_active":"2024-09-13T15:54:57.607534+0000","last_peered":"2024-09-13T15:54:57.607534+0000","last_clean":"2024-09-13T15:54:57.607534+0000","last_became_active":"2024-09-13T15:54:56.976980+0000","last_became_peered":"2024-09-13T15:54:56.976980+0000","last_unstale":"2024-09-13T15:54:57.607534+0000","last_undegraded":"2024-09-13T15:54:57.607534+0000","last_fullsized":"2024-09-13T15:54:57.607534+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:51.597228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.958158+0000","last_change":"2024-09-13T15:54:52.958598+0000","last_active":"2024-09-13T15:54:56.958158+0000","last_peered":"2024-09-13T15:54:56.958158+0000","last_clean":"2024-09-13T15:54:56.958158+0000","last_became_active":"2024-09-13T15:54:52.958272+0000","last_became_peered":"2024-09-13T15:54:52.958272+0000","last_unstale":"2024-09-13T15:54:56.958158+0000","last_undegraded":"2024-09-13T15:54:56.958158+0000","last_fullsized":"2024-09-13T15:54:56.958158+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:28.174228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:14.250463+0000","last_change":"2024-09-13T15:54:52.507028+0000","last_active":"2024-09-13T15:55:14.250463+0000","last_peered":"2024-09-13T15:55:14.250463+0000","last_clean":"2024-09-13T15:55:14.250463+0000","last_became_active":"2024-09-13T15:54:52.506229+0000","last_became_peered":"2024-09-13T15:54:52.506229+0000","last_unstale":"2024-09-13T15:55:14.250463+0000","last_undegraded":"2024-09-13T15:55:14.250463+0000","last_fullsized":"2024-09-13T15:55:14.250463+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:35:02.793140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638892+0000","last_change":"2024-09-13T15:54:57.084002+0000","last_active":"2024-09-13T15:54:57.638892+0000","last_peered":"2024-09-13T15:54:57.638892+0000","last_clean":"2024-09-13T15:54:57.638892+0000","last_became_active":"2024-09-13T15:54:57.083597+0000","last_became_peered":"2024-09-13T15:54:57.083597+0000","last_unstale":"2024-09-13T15:54:57.638892+0000","last_undegraded":"2024-09-13T15:54:57.638892+0000","last_fullsized":"2024-09-13T15:54:57.638892+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:12.137510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.973821+0000","last_change":"2024-09-13T15:54:52.961897+0000","last_active":"2024-09-13T15:54:56.973821+0000","last_peered":"2024-09-13T15:54:56.973821+0000","last_clean":"2024-09-13T15:54:56.973821+0000","last_became_active":"2024-09-13T15:54:52.957467+0000","last_became_peered":"2024-09-13T15:54:52.957467+0000","last_unstale":"2024-09-13T15:54:56.973821+0000","last_undegraded":"2024-09-13T15:54:56.973821+0000","last_fullsized":"2024-09-13T15:54:56.973821+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:57:04.150561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:14.250859+0000","last_change":"2024-09-13T15:54:52.507564+0000","last_active":"2024-09-13T15:55:14.250859+0000","last_peered":"2024-09-13T15:55:14.250859+0000","last_clean":"2024-09-13T15:55:14.250859+0000","last_became_active":"2024-09-13T15:54:52.507267+0000","last_became_peered":"2024-09-13T15:54:52.507267+0000","last_unstale":"2024-09-13T15:55:14.250859+0000","last_undegraded":"2024-09-13T15:55:14.250859+0000","last_fullsized":"2024-09-13T15:55:14.250859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:56.093402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638866+0000","last_change":"2024-09-13T15:54:56.961499+0000","last_active":"2024-09-13T15:54:57.638866+0000","last_peered":"2024-09-13T15:54:57.638866+0000","last_clean":"2024-09-13T15:54:57.638866+0000","last_became_active":"2024-09-13T15:54:56.961032+0000","last_became_peered":"2024-09-13T15:54:56.961032+0000","last_unstale":"2024-09-13T15:54:57.638866+0000","last_undegraded":"2024-09-13T15:54:57.638866+0000","last_fullsized":"2024-09-13T15:54:57.638866+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:28.937286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.978166+0000","last_change":"2024-09-13T15:54:52.951517+0000","last_active":"2024-09-13T15:54:56.978166+0000","last_peered":"2024-09-13T15:54:56.978166+0000","last_clean":"2024-09-13T15:54:56.978166+0000","last_became_active":"2024-09-13T15:54:52.951205+0000","last_became_peered":"2024-09-13T15:54:52.951205+0000","last_unstale":"2024-09-13T15:54:56.978166+0000","last_undegraded":"2024-09-13T15:54:56.978166+0000","last_fullsized":"2024-09-13T15:54:56.978166+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:36.936826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'1","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.607505+0000","last_change":"2024-09-13T15:54:52.518580+0000","last_active":"2024-09-13T15:54:57.607505+0000","last_peered":"2024-09-13T15:54:57.607505+0000","last_clean":"2024-09-13T15:54:57.607505+0000","last_became_active":"2024-09-13T15:54:52.518277+0000","last_became_peered":"2024-09-13T15:54:52.518277+0000","last_unstale":"2024-09-13T15:54:57.607505+0000","last_undegraded":"2024-09-13T15:54:57.607505+0000","last_fullsized":"2024-09-13T15:54:57.607505+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:10.842369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.084691+0000","last_change":"2024-09-13T15:54:57.082786+0000","last_active":"2024-09-13T15:54:57.084691+0000","last_peered":"2024-09-13T15:54:57.084691+0000","last_clean":"2024-09-13T15:54:57.084691+0000","last_became_active":"2024-09-13T15:54:57.082357+0000","last_became_peered":"2024-09-13T15:54:57.082357+0000","last_unstale":"2024-09-13T15:54:57.084691+0000","last_undegraded":"2024-09-13T15:54:57.084691+0000","last_fullsized":"2024-09-13T15:54:57.084691+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:40.867554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.968622+0000","last_change":"2024-09-13T15:54:52.944433+0000","last_active":"2024-09-13T15:54:56.968622+0000","last_peered":"2024-09-13T15:54:56.968622+0000","last_clean":"2024-09-13T15:54:56.968622+0000","last_became_active":"2024-09-13T15:54:52.943624+0000","last_became_peered":"2024-09-13T15:54:52.943624+0000","last_unstale":"2024-09-13T15:54:56.968622+0000","last_undegraded":"2024-09-13T15:54:56.968622+0000","last_fullsized":"2024-09-13T15:54:56.968622+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:49.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.609406+0000","last_change":"2024-09-13T15:54:52.525629+0000","last_active":"2024-09-13T15:54:57.609406+0000","last_peered":"2024-09-13T15:54:57.609406+0000","last_clean":"2024-09-13T15:54:57.609406+0000","last_became_active":"2024-09-13T15:54:52.525311+0000","last_became_peered":"2024-09-13T15:54:52.525311+0000","last_unstale":"2024-09-13T15:54:57.609406+0000","last_undegraded":"2024-09-13T15:54:57.609406+0000","last_fullsized":"2024-09-13T15:54:57.609406+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:25.856415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638319+0000","last_change":"2024-09-13T15:54:56.971608+0000","last_active":"2024-09-13T15:54:57.638319+0000","last_peered":"2024-09-13T15:54:57.638319+0000","last_clean":"2024-09-13T15:54:57.638319+0000","last_became_active":"2024-09-13T15:54:56.971185+0000","last_became_peered":"2024-09-13T15:54:56.971185+0000","last_unstale":"2024-09-13T15:54:57.638319+0000","last_undegraded":"2024-09-13T15:54:57.638319+0000","last_fullsized":"2024-09-13T15:54:57.638319+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:46.098922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.082000+0000","last_change":"2024-09-13T15:54:52.958843+0000","last_active":"2024-09-13T15:54:57.082000+0000","last_peered":"2024-09-13T15:54:57.082000+0000","last_clean":"2024-09-13T15:54:57.082000+0000","last_became_active":"2024-09-13T15:54:52.958534+0000","last_became_peered":"2024-09-13T15:54:52.958534+0000","last_unstale":"2024-09-13T15:54:57.082000+0000","last_undegraded":"2024-09-13T15:54:57.082000+0000","last_fullsized":"2024-09-13T15:54:57.082000+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:34.721886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.952874+0000","last_change":"2024-09-13T15:54:52.524043+0000","last_active":"2024-09-13T15:54:56.952874+0000","last_peered":"2024-09-13T15:54:56.952874+0000","last_clean":"2024-09-13T15:54:56.952874+0000","last_became_active":"2024-09-13T15:54:52.523681+0000","last_became_peered":"2024-09-13T15:54:52.523681+0000","last_unstale":"2024-09-13T15:54:56.952874+0000","last_undegraded":"2024-09-13T15:54:56.952874+0000","last_fullsized":"2024-09-13T15:54:56.952874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:21.164458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.083542+0000","last_change":"2024-09-13T15:54:57.083066+0000","last_active":"2024-09-13T15:54:57.083542+0000","last_peered":"2024-09-13T15:54:57.083542+0000","last_clean":"2024-09-13T15:54:57.083542+0000","last_became_active":"2024-09-13T15:54:57.082664+0000","last_became_peered":"2024-09-13T15:54:57.082664+0000","last_unstale":"2024-09-13T15:54:57.083542+0000","last_undegraded":"2024-09-13T15:54:57.083542+0000","last_fullsized":"2024-09-13T15:54:57.083542+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:54.872482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.081889+0000","last_change":"2024-09-13T15:54:52.957428+0000","last_active":"2024-09-13T15:54:57.081889+0000","last_peered":"2024-09-13T15:54:57.081889+0000","last_clean":"2024-09-13T15:54:57.081889+0000","last_became_active":"2024-09-13T15:54:52.957121+0000","last_became_peered":"2024-09-13T15:54:52.957121+0000","last_unstale":"2024-09-13T15:54:57.081889+0000","last_undegraded":"2024-09-13T15:54:57.081889+0000","last_fullsized":"2024-09-13T15:54:57.081889+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:40.821503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.639861+0000","last_change":"2024-09-13T15:54:52.509101+0000","last_active":"2024-09-13T15:54:57.639861+0000","last_peered":"2024-09-13T15:54:57.639861+0000","last_clean":"2024-09-13T15:54:57.639861+0000","last_became_active":"2024-09-13T15:54:52.508808+0000","last_became_peered":"2024-09-13T15:54:52.508808+0000","last_unstale":"2024-09-13T15:54:57.639861+0000","last_undegraded":"2024-09-13T15:54:57.639861+0000","last_fullsized":"2024-09-13T15:54:57.639861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.181340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.388014+0000","last_change":"2024-09-13T15:54:56.976153+0000","last_active":"2024-09-13T15:54:57.388014+0000","last_peered":"2024-09-13T15:54:57.388014+0000","last_clean":"2024-09-13T15:54:57.388014+0000","last_became_active":"2024-09-13T15:54:56.975727+0000","last_became_peered":"2024-09-13T15:54:56.975727+0000","last_unstale":"2024-09-13T15:54:57.388014+0000","last_undegraded":"2024-09-13T15:54:57.388014+0000","last_fullsized":"2024-09-13T15:54:57.388014+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:12:19.431484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.962808+0000","last_change":"2024-09-13T15:54:52.958321+0000","last_active":"2024-09-13T15:54:56.962808+0000","last_peered":"2024-09-13T15:54:56.962808+0000","last_clean":"2024-09-13T15:54:56.962808+0000","last_became_active":"2024-09-13T15:54:52.958030+0000","last_became_peered":"2024-09-13T15:54:52.958030+0000","last_unstale":"2024-09-13T15:54:56.962808+0000","last_undegraded":"2024-09-13T15:54:56.962808+0000","last_fullsized":"2024-09-13T15:54:56.962808+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:15.159807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:16.263980+0000","last_change":"2024-09-13T15:54:52.519475+0000","last_active":"2024-09-13T15:55:16.263980+0000","last_peered":"2024-09-13T15:55:16.263980+0000","last_clean":"2024-09-13T15:55:16.263980+0000","last_became_active":"2024-09-13T15:54:52.519144+0000","last_became_peered":"2024-09-13T15:54:52.519144+0000","last_unstale":"2024-09-13T15:55:16.263980+0000","last_undegraded":"2024-09-13T15:55:16.263980+0000","last_fullsized":"2024-09-13T15:55:16.263980+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:07.085691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.388257+0000","last_change":"2024-09-13T15:54:57.083036+0000","last_active":"2024-09-13T15:54:57.388257+0000","last_peered":"2024-09-13T15:54:57.388257+0000","last_clean":"2024-09-13T15:54:57.388257+0000","last_became_active":"2024-09-13T15:54:57.082577+0000","last_became_peered":"2024-09-13T15:54:57.082577+0000","last_unstale":"2024-09-13T15:54:57.388257+0000","last_undegraded":"2024-09-13T15:54:57.388257+0000","last_fullsized":"2024-09-13T15:54:57.388257+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:06.309671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.960549+0000","last_change":"2024-09-13T15:54:52.950494+0000","last_active":"2024-09-13T15:54:56.960549+0000","last_peered":"2024-09-13T15:54:56.960549+0000","last_clean":"2024-09-13T15:54:56.960549+0000","last_became_active":"2024-09-13T15:54:52.950160+0000","last_became_peered":"2024-09-13T15:54:52.950160+0000","last_unstale":"2024-09-13T15:54:56.960549+0000","last_undegraded":"2024-09-13T15:54:56.960549+0000","last_fullsized":"2024-09-13T15:54:56.960549+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:59.070083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:15.254559+0000","last_change":"2024-09-13T15:54:52.511717+0000","last_active":"2024-09-13T15:55:15.254559+0000","last_peered":"2024-09-13T15:55:15.254559+0000","last_clean":"2024-09-13T15:55:15.254559+0000","last_became_active":"2024-09-13T15:54:52.511421+0000","last_became_peered":"2024-09-13T15:54:52.511421+0000","last_unstale":"2024-09-13T15:55:15.254559+0000","last_undegraded":"2024-09-13T15:55:15.254559+0000","last_fullsized":"2024-09-13T15:55:15.254559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:30:03.037852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.388030+0000","last_change":"2024-09-13T15:54:57.083707+0000","last_active":"2024-09-13T15:54:57.388030+0000","last_peered":"2024-09-13T15:54:57.388030+0000","last_clean":"2024-09-13T15:54:57.388030+0000","last_became_active":"2024-09-13T15:54:57.083351+0000","last_became_peered":"2024-09-13T15:54:57.083351+0000","last_unstale":"2024-09-13T15:54:57.388030+0000","last_undegraded":"2024-09-13T15:54:57.388030+0000","last_fullsized":"2024-09-13T15:54:57.388030+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:42.058114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.974237+0000","last_change":"2024-09-13T15:54:52.955696+0000","last_active":"2024-09-13T15:54:56.974237+0000","last_peered":"2024-09-13T15:54:56.974237+0000","last_clean":"2024-09-13T15:54:56.974237+0000","last_became_active":"2024-09-13T15:54:52.955271+0000","last_became_peered":"2024-09-13T15:54:52.955271+0000","last_unstale":"2024-09-13T15:54:56.974237+0000","last_undegraded":"2024-09-13T15:54:56.974237+0000","last_fullsized":"2024-09-13T15:54:56.974237+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:16.904541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:14.251973+0000","last_change":"2024-09-13T15:54:52.507152+0000","last_active":"2024-09-13T15:55:14.251973+0000","last_peered":"2024-09-13T15:55:14.251973+0000","last_clean":"2024-09-13T15:55:14.251973+0000","last_became_active":"2024-09-13T15:54:52.506805+0000","last_became_peered":"2024-09-13T15:54:52.506805+0000","last_unstale":"2024-09-13T15:55:14.251973+0000","last_undegraded":"2024-09-13T15:55:14.251973+0000","last_fullsized":"2024-09-13T15:55:14.251973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:51.221341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":329,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953229+0000","last_change":"2024-09-13T15:53:37.322379+0000","last_active":"2024-09-13T15:54:56.953229+0000","last_peered":"2024-09-13T15:54:56.953229+0000","last_clean":"2024-09-13T15:54:56.953229+0000","last_became_active":"2024-09-13T15:53:37.321987+0000","last_became_peered":"2024-09-13T15:53:37.321987+0000","last_unstale":"2024-09-13T15:54:56.953229+0000","last_undegraded":"2024-09-13T15:54:56.953229+0000","last_fullsized":"2024-09-13T15:54:56.953229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:50:10.707150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:50:10.707150+0000","last_clean_scrub_stamp":"2024-09-13T15:50:10.707150+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:16.244946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.965375+0000","last_change":"2024-09-13T15:54:56.964729+0000","last_active":"2024-09-13T15:54:56.965375+0000","last_peered":"2024-09-13T15:54:56.965375+0000","last_clean":"2024-09-13T15:54:56.965375+0000","last_became_active":"2024-09-13T15:54:56.964385+0000","last_became_peered":"2024-09-13T15:54:56.964385+0000","last_unstale":"2024-09-13T15:54:56.965375+0000","last_undegraded":"2024-09-13T15:54:56.965375+0000","last_fullsized":"2024-09-13T15:54:56.965375+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:11.884248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953691+0000","last_change":"2024-09-13T15:54:52.960069+0000","last_active":"2024-09-13T15:54:56.953691+0000","last_peered":"2024-09-13T15:54:56.953691+0000","last_clean":"2024-09-13T15:54:56.953691+0000","last_became_active":"2024-09-13T15:54:52.959762+0000","last_became_peered":"2024-09-13T15:54:52.959762+0000","last_unstale":"2024-09-13T15:54:56.953691+0000","last_undegraded":"2024-09-13T15:54:56.953691+0000","last_fullsized":"2024-09-13T15:54:56.953691+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:18.506596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953961+0000","last_change":"2024-09-13T15:54:52.524137+0000","last_active":"2024-09-13T15:54:56.953961+0000","last_peered":"2024-09-13T15:54:56.953961+0000","last_clean":"2024-09-13T15:54:56.953961+0000","last_became_active":"2024-09-13T15:54:52.523781+0000","last_became_peered":"2024-09-13T15:54:52.523781+0000","last_unstale":"2024-09-13T15:54:56.953961+0000","last_undegraded":"2024-09-13T15:54:56.953961+0000","last_fullsized":"2024-09-13T15:54:56.953961+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:04.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.193371+0000","last_change":"2024-09-13T15:54:56.967557+0000","last_active":"2024-09-13T15:54:57.193371+0000","last_peered":"2024-09-13T15:54:57.193371+0000","last_clean":"2024-09-13T15:54:57.193371+0000","last_became_active":"2024-09-13T15:54:56.967190+0000","last_became_peered":"2024-09-13T15:54:56.967190+0000","last_unstale":"2024-09-13T15:54:57.193371+0000","last_undegraded":"2024-09-13T15:54:57.193371+0000","last_fullsized":"2024-09-13T15:54:57.193371+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:45.630557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953260+0000","last_change":"2024-09-13T15:54:52.955587+0000","last_active":"2024-09-13T15:54:56.953260+0000","last_peered":"2024-09-13T15:54:56.953260+0000","last_clean":"2024-09-13T15:54:56.953260+0000","last_became_active":"2024-09-13T15:54:52.955270+0000","last_became_peered":"2024-09-13T15:54:52.955270+0000","last_unstale":"2024-09-13T15:54:56.953260+0000","last_undegraded":"2024-09-13T15:54:56.953260+0000","last_fullsized":"2024-09-13T15:54:56.953260+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:59.425468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.964523+0000","last_change":"2024-09-13T15:54:52.518617+0000","last_active":"2024-09-13T15:54:56.964523+0000","last_peered":"2024-09-13T15:54:56.964523+0000","last_clean":"2024-09-13T15:54:56.964523+0000","last_became_active":"2024-09-13T15:54:52.518292+0000","last_became_peered":"2024-09-13T15:54:52.518292+0000","last_unstale":"2024-09-13T15:54:56.964523+0000","last_undegraded":"2024-09-13T15:54:56.964523+0000","last_fullsized":"2024-09-13T15:54:56.964523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:06.890484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638470+0000","last_change":"2024-09-13T15:54:56.978521+0000","last_active":"2024-09-13T15:54:57.638470+0000","last_peered":"2024-09-13T15:54:57.638470+0000","last_clean":"2024-09-13T15:54:57.638470+0000","last_became_active":"2024-09-13T15:54:56.977938+0000","last_became_peered":"2024-09-13T15:54:56.977938+0000","last_unstale":"2024-09-13T15:54:57.638470+0000","last_undegraded":"2024-09-13T15:54:57.638470+0000","last_fullsized":"2024-09-13T15:54:57.638470+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:26.251881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953394+0000","last_change":"2024-09-13T15:54:52.954992+0000","last_active":"2024-09-13T15:54:56.953394+0000","last_peered":"2024-09-13T15:54:56.953394+0000","last_clean":"2024-09-13T15:54:56.953394+0000","last_became_active":"2024-09-13T15:54:52.954646+0000","last_became_peered":"2024-09-13T15:54:52.954646+0000","last_unstale":"2024-09-13T15:54:56.953394+0000","last_undegraded":"2024-09-13T15:54:56.953394+0000","last_fullsized":"2024-09-13T15:54:56.953394+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:28.362703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.968985+0000","last_change":"2024-09-13T15:54:52.509976+0000","last_active":"2024-09-13T15:54:56.968985+0000","last_peered":"2024-09-13T15:54:56.968985+0000","last_clean":"2024-09-13T15:54:56.968985+0000","last_became_active":"2024-09-13T15:54:52.509669+0000","last_became_peered":"2024-09-13T15:54:52.509669+0000","last_unstale":"2024-09-13T15:54:56.968985+0000","last_undegraded":"2024-09-13T15:54:56.968985+0000","last_fullsized":"2024-09-13T15:54:56.968985+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:06:02.622401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.387673+0000","last_change":"2024-09-13T15:54:56.966090+0000","last_active":"2024-09-13T15:54:57.387673+0000","last_peered":"2024-09-13T15:54:57.387673+0000","last_clean":"2024-09-13T15:54:57.387673+0000","last_became_active":"2024-09-13T15:54:56.965671+0000","last_became_peered":"2024-09-13T15:54:56.965671+0000","last_unstale":"2024-09-13T15:54:57.387673+0000","last_undegraded":"2024-09-13T15:54:57.387673+0000","last_fullsized":"2024-09-13T15:54:57.387673+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:20.318451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.958900+0000","last_change":"2024-09-13T15:54:52.964008+0000","last_active":"2024-09-13T15:54:56.958900+0000","last_peered":"2024-09-13T15:54:56.958900+0000","last_clean":"2024-09-13T15:54:56.958900+0000","last_became_active":"2024-09-13T15:54:52.963667+0000","last_became_peered":"2024-09-13T15:54:52.963667+0000","last_unstale":"2024-09-13T15:54:56.958900+0000","last_undegraded":"2024-09-13T15:54:56.958900+0000","last_fullsized":"2024-09-13T15:54:56.958900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:25:09.911005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.959148+0000","last_change":"2024-09-13T15:54:52.512258+0000","last_active":"2024-09-13T15:54:56.959148+0000","last_peered":"2024-09-13T15:54:56.959148+0000","last_clean":"2024-09-13T15:54:56.959148+0000","last_became_active":"2024-09-13T15:54:52.511585+0000","last_became_peered":"2024-09-13T15:54:52.511585+0000","last_unstale":"2024-09-13T15:54:56.959148+0000","last_undegraded":"2024-09-13T15:54:56.959148+0000","last_fullsized":"2024-09-13T15:54:56.959148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:41.717042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.387827+0000","last_change":"2024-09-13T15:54:56.975391+0000","last_active":"2024-09-13T15:54:57.387827+0000","last_peered":"2024-09-13T15:54:57.387827+0000","last_clean":"2024-09-13T15:54:57.387827+0000","last_became_active":"2024-09-13T15:54:56.975110+0000","last_became_peered":"2024-09-13T15:54:56.975110+0000","last_unstale":"2024-09-13T15:54:57.387827+0000","last_undegraded":"2024-09-13T15:54:57.387827+0000","last_fullsized":"2024-09-13T15:54:57.387827+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:41.001352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.963134+0000","last_change":"2024-09-13T15:54:52.962697+0000","last_active":"2024-09-13T15:54:56.963134+0000","last_peered":"2024-09-13T15:54:56.963134+0000","last_clean":"2024-09-13T15:54:56.963134+0000","last_became_active":"2024-09-13T15:54:52.962202+0000","last_became_peered":"2024-09-13T15:54:52.962202+0000","last_unstale":"2024-09-13T15:54:56.963134+0000","last_undegraded":"2024-09-13T15:54:56.963134+0000","last_fullsized":"2024-09-13T15:54:56.963134+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:18.993166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:15.257318+0000","last_change":"2024-09-13T15:54:52.522834+0000","last_active":"2024-09-13T15:55:15.257318+0000","last_peered":"2024-09-13T15:55:15.257318+0000","last_clean":"2024-09-13T15:55:15.257318+0000","last_became_active":"2024-09-13T15:54:52.522537+0000","last_became_peered":"2024-09-13T15:54:52.522537+0000","last_unstale":"2024-09-13T15:55:15.257318+0000","last_undegraded":"2024-09-13T15:55:15.257318+0000","last_fullsized":"2024-09-13T15:55:15.257318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:44.616636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.388210+0000","last_change":"2024-09-13T15:54:56.979994+0000","last_active":"2024-09-13T15:54:57.388210+0000","last_peered":"2024-09-13T15:54:57.388210+0000","last_clean":"2024-09-13T15:54:57.388210+0000","last_became_active":"2024-09-13T15:54:56.979586+0000","last_became_peered":"2024-09-13T15:54:56.979586+0000","last_unstale":"2024-09-13T15:54:57.388210+0000","last_undegraded":"2024-09-13T15:54:57.388210+0000","last_fullsized":"2024-09-13T15:54:57.388210+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:17.364566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953132+0000","last_change":"2024-09-13T15:54:52.952927+0000","last_active":"2024-09-13T15:54:56.953132+0000","last_peered":"2024-09-13T15:54:56.953132+0000","last_clean":"2024-09-13T15:54:56.953132+0000","last_became_active":"2024-09-13T15:54:52.952647+0000","last_became_peered":"2024-09-13T15:54:52.952647+0000","last_unstale":"2024-09-13T15:54:56.953132+0000","last_undegraded":"2024-09-13T15:54:56.953132+0000","last_fullsized":"2024-09-13T15:54:56.953132+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:47.085104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:15.253144+0000","last_change":"2024-09-13T15:54:52.502696+0000","last_active":"2024-09-13T15:55:15.253144+0000","last_peered":"2024-09-13T15:55:15.253144+0000","last_clean":"2024-09-13T15:55:15.253144+0000","last_became_active":"2024-09-13T15:54:52.502352+0000","last_became_peered":"2024-09-13T15:54:52.502352+0000","last_unstale":"2024-09-13T15:55:15.253144+0000","last_undegraded":"2024-09-13T15:55:15.253144+0000","last_fullsized":"2024-09-13T15:55:15.253144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:55.899194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.607568+0000","last_change":"2024-09-13T15:54:56.977617+0000","last_active":"2024-09-13T15:54:57.607568+0000","last_peered":"2024-09-13T15:54:57.607568+0000","last_clean":"2024-09-13T15:54:57.607568+0000","last_became_active":"2024-09-13T15:54:56.977250+0000","last_became_peered":"2024-09-13T15:54:56.977250+0000","last_unstale":"2024-09-13T15:54:57.607568+0000","last_undegraded":"2024-09-13T15:54:57.607568+0000","last_fullsized":"2024-09-13T15:54:57.607568+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:59.213043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953295+0000","last_change":"2024-09-13T15:54:52.950419+0000","last_active":"2024-09-13T15:54:56.953295+0000","last_peered":"2024-09-13T15:54:56.953295+0000","last_clean":"2024-09-13T15:54:56.953295+0000","last_became_active":"2024-09-13T15:54:52.950111+0000","last_became_peered":"2024-09-13T15:54:52.950111+0000","last_unstale":"2024-09-13T15:54:56.953295+0000","last_undegraded":"2024-09-13T15:54:56.953295+0000","last_fullsized":"2024-09-13T15:54:56.953295+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:02:14.424589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.962650+0000","last_change":"2024-09-13T15:54:52.520700+0000","last_active":"2024-09-13T15:54:56.962650+0000","last_peered":"2024-09-13T15:54:56.962650+0000","last_clean":"2024-09-13T15:54:56.962650+0000","last_became_active":"2024-09-13T15:54:52.520438+0000","last_became_peered":"2024-09-13T15:54:52.520438+0000","last_unstale":"2024-09-13T15:54:56.962650+0000","last_undegraded":"2024-09-13T15:54:56.962650+0000","last_fullsized":"2024-09-13T15:54:56.962650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:45.740101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638438+0000","last_change":"2024-09-13T15:54:56.971469+0000","last_active":"2024-09-13T15:54:57.638438+0000","last_peered":"2024-09-13T15:54:57.638438+0000","last_clean":"2024-09-13T15:54:57.638438+0000","last_became_active":"2024-09-13T15:54:56.971018+0000","last_became_peered":"2024-09-13T15:54:56.971018+0000","last_unstale":"2024-09-13T15:54:57.638438+0000","last_undegraded":"2024-09-13T15:54:57.638438+0000","last_fullsized":"2024-09-13T15:54:57.638438+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:48.980523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.965932+0000","last_change":"2024-09-13T15:54:52.953776+0000","last_active":"2024-09-13T15:54:56.965932+0000","last_peered":"2024-09-13T15:54:56.965932+0000","last_clean":"2024-09-13T15:54:56.965932+0000","last_became_active":"2024-09-13T15:54:52.950879+0000","last_became_peered":"2024-09-13T15:54:52.950879+0000","last_unstale":"2024-09-13T15:54:56.965932+0000","last_undegraded":"2024-09-13T15:54:56.965932+0000","last_fullsized":"2024-09-13T15:54:56.965932+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:15:12.817499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953291+0000","last_change":"2024-09-13T15:54:52.519322+0000","last_active":"2024-09-13T15:54:56.953291+0000","last_peered":"2024-09-13T15:54:56.953291+0000","last_clean":"2024-09-13T15:54:56.953291+0000","last_became_active":"2024-09-13T15:54:52.518751+0000","last_became_peered":"2024-09-13T15:54:52.518751+0000","last_unstale":"2024-09-13T15:54:56.953291+0000","last_undegraded":"2024-09-13T15:54:56.953291+0000","last_fullsized":"2024-09-13T15:54:56.953291+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:10.835566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.387971+0000","last_change":"2024-09-13T15:54:56.974091+0000","last_active":"2024-09-13T15:54:57.387971+0000","last_peered":"2024-09-13T15:54:57.387971+0000","last_clean":"2024-09-13T15:54:57.387971+0000","last_became_active":"2024-09-13T15:54:56.973717+0000","last_became_peered":"2024-09-13T15:54:56.973717+0000","last_unstale":"2024-09-13T15:54:57.387971+0000","last_undegraded":"2024-09-13T15:54:57.387971+0000","last_fullsized":"2024-09-13T15:54:57.387971+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:17:22.158270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.959404+0000","last_change":"2024-09-13T15:54:52.954562+0000","last_active":"2024-09-13T15:54:56.959404+0000","last_peered":"2024-09-13T15:54:56.959404+0000","last_clean":"2024-09-13T15:54:56.959404+0000","last_became_active":"2024-09-13T15:54:52.954228+0000","last_became_peered":"2024-09-13T15:54:52.954228+0000","last_unstale":"2024-09-13T15:54:56.959404+0000","last_undegraded":"2024-09-13T15:54:56.959404+0000","last_fullsized":"2024-09-13T15:54:56.959404+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:57.833958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'12","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:14.251176+0000","last_change":"2024-09-13T15:54:52.506559+0000","last_active":"2024-09-13T15:55:14.251176+0000","last_peered":"2024-09-13T15:55:14.251176+0000","last_clean":"2024-09-13T15:55:14.251176+0000","last_became_active":"2024-09-13T15:54:52.506248+0000","last_became_peered":"2024-09-13T15:54:52.506248+0000","last_unstale":"2024-09-13T15:55:14.251176+0000","last_undegraded":"2024-09-13T15:55:14.251176+0000","last_fullsized":"2024-09-13T15:55:14.251176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:13:26.349727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.607057+0000","last_change":"2024-09-13T15:54:56.977311+0000","last_active":"2024-09-13T15:54:57.607057+0000","last_peered":"2024-09-13T15:54:57.607057+0000","last_clean":"2024-09-13T15:54:57.607057+0000","last_became_active":"2024-09-13T15:54:56.972677+0000","last_became_peered":"2024-09-13T15:54:56.972677+0000","last_unstale":"2024-09-13T15:54:57.607057+0000","last_undegraded":"2024-09-13T15:54:57.607057+0000","last_fullsized":"2024-09-13T15:54:57.607057+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:03.162029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.193405+0000","last_change":"2024-09-13T15:54:52.952983+0000","last_active":"2024-09-13T15:54:57.193405+0000","last_peered":"2024-09-13T15:54:57.193405+0000","last_clean":"2024-09-13T15:54:57.193405+0000","last_became_active":"2024-09-13T15:54:52.952710+0000","last_became_peered":"2024-09-13T15:54:52.952710+0000","last_unstale":"2024-09-13T15:54:57.193405+0000","last_undegraded":"2024-09-13T15:54:57.193405+0000","last_fullsized":"2024-09-13T15:54:57.193405+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:07.006629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'3","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.964509+0000","last_change":"2024-09-13T15:54:52.514710+0000","last_active":"2024-09-13T15:54:56.964509+0000","last_peered":"2024-09-13T15:54:56.964509+0000","last_clean":"2024-09-13T15:54:56.964509+0000","last_became_active":"2024-09-13T15:54:52.514377+0000","last_became_peered":"2024-09-13T15:54:52.514377+0000","last_unstale":"2024-09-13T15:54:56.964509+0000","last_undegraded":"2024-09-13T15:54:56.964509+0000","last_fullsized":"2024-09-13T15:54:56.964509+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:07.434722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.639064+0000","last_change":"2024-09-13T15:54:56.963704+0000","last_active":"2024-09-13T15:54:57.639064+0000","last_peered":"2024-09-13T15:54:57.639064+0000","last_clean":"2024-09-13T15:54:57.639064+0000","last_became_active":"2024-09-13T15:54:56.963249+0000","last_became_peered":"2024-09-13T15:54:56.963249+0000","last_unstale":"2024-09-13T15:54:57.639064+0000","last_undegraded":"2024-09-13T15:54:57.639064+0000","last_fullsized":"2024-09-13T15:54:57.639064+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:36.983366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.973760+0000","last_change":"2024-09-13T15:54:52.960772+0000","last_active":"2024-09-13T15:54:56.973760+0000","last_peered":"2024-09-13T15:54:56.973760+0000","last_clean":"2024-09-13T15:54:56.973760+0000","last_became_active":"2024-09-13T15:54:52.957092+0000","last_became_peered":"2024-09-13T15:54:52.957092+0000","last_unstale":"2024-09-13T15:54:56.973760+0000","last_undegraded":"2024-09-13T15:54:56.973760+0000","last_fullsized":"2024-09-13T15:54:56.973760+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:02.563773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:14.251288+0000","last_change":"2024-09-13T15:54:52.507815+0000","last_active":"2024-09-13T15:55:14.251288+0000","last_peered":"2024-09-13T15:55:14.251288+0000","last_clean":"2024-09-13T15:55:14.251288+0000","last_became_active":"2024-09-13T15:54:52.507340+0000","last_became_peered":"2024-09-13T15:54:52.507340+0000","last_unstale":"2024-09-13T15:55:14.251288+0000","last_undegraded":"2024-09-13T15:55:14.251288+0000","last_fullsized":"2024-09-13T15:55:14.251288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:58.896215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.606888+0000","last_change":"2024-09-13T15:54:56.977240+0000","last_active":"2024-09-13T15:54:57.606888+0000","last_peered":"2024-09-13T15:54:57.606888+0000","last_clean":"2024-09-13T15:54:57.606888+0000","last_became_active":"2024-09-13T15:54:56.976848+0000","last_became_peered":"2024-09-13T15:54:56.976848+0000","last_unstale":"2024-09-13T15:54:57.606888+0000","last_undegraded":"2024-09-13T15:54:57.606888+0000","last_fullsized":"2024-09-13T15:54:57.606888+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:48.223930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.193415+0000","last_change":"2024-09-13T15:54:52.956493+0000","last_active":"2024-09-13T15:54:57.193415+0000","last_peered":"2024-09-13T15:54:57.193415+0000","last_clean":"2024-09-13T15:54:57.193415+0000","last_became_active":"2024-09-13T15:54:52.955994+0000","last_became_peered":"2024-09-13T15:54:52.955994+0000","last_unstale":"2024-09-13T15:54:57.193415+0000","last_undegraded":"2024-09-13T15:54:57.193415+0000","last_fullsized":"2024-09-13T15:54:57.193415+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:14.515253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:14.250955+0000","last_change":"2024-09-13T15:54:52.507394+0000","last_active":"2024-09-13T15:55:14.250955+0000","last_peered":"2024-09-13T15:55:14.250955+0000","last_clean":"2024-09-13T15:55:14.250955+0000","last_became_active":"2024-09-13T15:54:52.507104+0000","last_became_peered":"2024-09-13T15:54:52.507104+0000","last_unstale":"2024-09-13T15:55:14.250955+0000","last_undegraded":"2024-09-13T15:55:14.250955+0000","last_fullsized":"2024-09-13T15:55:14.250955+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:57.442678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.974571+0000","last_change":"2024-09-13T15:54:56.971867+0000","last_active":"2024-09-13T15:54:56.974571+0000","last_peered":"2024-09-13T15:54:56.974571+0000","last_clean":"2024-09-13T15:54:56.974571+0000","last_became_active":"2024-09-13T15:54:56.970041+0000","last_became_peered":"2024-09-13T15:54:56.970041+0000","last_unstale":"2024-09-13T15:54:56.974571+0000","last_undegraded":"2024-09-13T15:54:56.974571+0000","last_fullsized":"2024-09-13T15:54:56.974571+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:02.478595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638620+0000","last_change":"2024-09-13T15:54:56.974886+0000","last_active":"2024-09-13T15:54:57.638620+0000","last_peered":"2024-09-13T15:54:57.638620+0000","last_clean":"2024-09-13T15:54:57.638620+0000","last_became_active":"2024-09-13T15:54:56.972879+0000","last_became_peered":"2024-09-13T15:54:56.972879+0000","last_unstale":"2024-09-13T15:54:57.638620+0000","last_undegraded":"2024-09-13T15:54:57.638620+0000","last_fullsized":"2024-09-13T15:54:57.638620+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:59.869941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.952593+0000","last_change":"2024-09-13T15:54:52.956887+0000","last_active":"2024-09-13T15:54:56.952593+0000","last_peered":"2024-09-13T15:54:56.952593+0000","last_clean":"2024-09-13T15:54:56.952593+0000","last_became_active":"2024-09-13T15:54:52.951413+0000","last_became_peered":"2024-09-13T15:54:52.951413+0000","last_unstale":"2024-09-13T15:54:56.952593+0000","last_undegraded":"2024-09-13T15:54:56.952593+0000","last_fullsized":"2024-09-13T15:54:56.952593+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:05.664170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.962884+0000","last_change":"2024-09-13T15:54:52.509235+0000","last_active":"2024-09-13T15:54:56.962884+0000","last_peered":"2024-09-13T15:54:56.962884+0000","last_clean":"2024-09-13T15:54:56.962884+0000","last_became_active":"2024-09-13T15:54:52.508956+0000","last_became_peered":"2024-09-13T15:54:52.508956+0000","last_unstale":"2024-09-13T15:54:56.962884+0000","last_undegraded":"2024-09-13T15:54:56.962884+0000","last_fullsized":"2024-09-13T15:54:56.962884+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:52.884396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638559+0000","last_change":"2024-09-13T15:54:56.979137+0000","last_active":"2024-09-13T15:54:57.638559+0000","last_peered":"2024-09-13T15:54:57.638559+0000","last_clean":"2024-09-13T15:54:57.638559+0000","last_became_active":"2024-09-13T15:54:56.978742+0000","last_became_peered":"2024-09-13T15:54:56.978742+0000","last_unstale":"2024-09-13T15:54:57.638559+0000","last_undegraded":"2024-09-13T15:54:57.638559+0000","last_fullsized":"2024-09-13T15:54:57.638559+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:30.102938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.967109+0000","last_change":"2024-09-13T15:54:52.956422+0000","last_active":"2024-09-13T15:54:56.967109+0000","last_peered":"2024-09-13T15:54:56.967109+0000","last_clean":"2024-09-13T15:54:56.967109+0000","last_became_active":"2024-09-13T15:54:52.956083+0000","last_became_peered":"2024-09-13T15:54:52.956083+0000","last_unstale":"2024-09-13T15:54:56.967109+0000","last_undegraded":"2024-09-13T15:54:56.967109+0000","last_fullsized":"2024-09-13T15:54:56.967109+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:17.057214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:15.258364+0000","last_change":"2024-09-13T15:54:52.507204+0000","last_active":"2024-09-13T15:55:15.258364+0000","last_peered":"2024-09-13T15:55:15.258364+0000","last_clean":"2024-09-13T15:55:15.258364+0000","last_became_active":"2024-09-13T15:54:52.506827+0000","last_became_peered":"2024-09-13T15:54:52.506827+0000","last_unstale":"2024-09-13T15:55:15.258364+0000","last_undegraded":"2024-09-13T15:55:15.258364+0000","last_fullsized":"2024-09-13T15:55:15.258364+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:03.960238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.081724+0000","last_change":"2024-09-13T15:54:52.511748+0000","last_active":"2024-09-13T15:54:57.081724+0000","last_peered":"2024-09-13T15:54:57.081724+0000","last_clean":"2024-09-13T15:54:57.081724+0000","last_became_active":"2024-09-13T15:54:52.511252+0000","last_became_peered":"2024-09-13T15:54:52.511252+0000","last_unstale":"2024-09-13T15:54:57.081724+0000","last_undegraded":"2024-09-13T15:54:57.081724+0000","last_fullsized":"2024-09-13T15:54:57.081724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:13.141009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.964398+0000","last_change":"2024-09-13T15:54:52.961880+0000","last_active":"2024-09-13T15:54:56.964398+0000","last_peered":"2024-09-13T15:54:56.964398+0000","last_clean":"2024-09-13T15:54:56.964398+0000","last_became_active":"2024-09-13T15:54:52.961450+0000","last_became_peered":"2024-09-13T15:54:52.961450+0000","last_unstale":"2024-09-13T15:54:56.964398+0000","last_undegraded":"2024-09-13T15:54:56.964398+0000","last_fullsized":"2024-09-13T15:54:56.964398+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:14.060479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.639017+0000","last_change":"2024-09-13T15:54:56.965541+0000","last_active":"2024-09-13T15:54:57.639017+0000","last_peered":"2024-09-13T15:54:57.639017+0000","last_clean":"2024-09-13T15:54:57.639017+0000","last_became_active":"2024-09-13T15:54:56.965185+0000","last_became_peered":"2024-09-13T15:54:56.965185+0000","last_unstale":"2024-09-13T15:54:57.639017+0000","last_undegraded":"2024-09-13T15:54:57.639017+0000","last_fullsized":"2024-09-13T15:54:57.639017+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:38:44.356201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.964441+0000","last_change":"2024-09-13T15:54:52.507878+0000","last_active":"2024-09-13T15:54:56.964441+0000","last_peered":"2024-09-13T15:54:56.964441+0000","last_clean":"2024-09-13T15:54:56.964441+0000","last_became_active":"2024-09-13T15:54:52.507564+0000","last_became_peered":"2024-09-13T15:54:52.507564+0000","last_unstale":"2024-09-13T15:54:56.964441+0000","last_undegraded":"2024-09-13T15:54:56.964441+0000","last_fullsized":"2024-09-13T15:54:56.964441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:55:31.921870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.959733+0000","last_change":"2024-09-13T15:54:52.951596+0000","last_active":"2024-09-13T15:54:56.959733+0000","last_peered":"2024-09-13T15:54:56.959733+0000","last_clean":"2024-09-13T15:54:56.959733+0000","last_became_active":"2024-09-13T15:54:52.951202+0000","last_became_peered":"2024-09-13T15:54:52.951202+0000","last_unstale":"2024-09-13T15:54:56.959733+0000","last_undegraded":"2024-09-13T15:54:56.959733+0000","last_fullsized":"2024-09-13T15:54:56.959733+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:04.421318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638921+0000","last_change":"2024-09-13T15:54:56.964449+0000","last_active":"2024-09-13T15:54:57.638921+0000","last_peered":"2024-09-13T15:54:57.638921+0000","last_clean":"2024-09-13T15:54:57.638921+0000","last_became_active":"2024-09-13T15:54:56.964025+0000","last_became_peered":"2024-09-13T15:54:56.964025+0000","last_unstale":"2024-09-13T15:54:57.638921+0000","last_undegraded":"2024-09-13T15:54:57.638921+0000","last_fullsized":"2024-09-13T15:54:57.638921+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:06.337648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.958576+0000","last_change":"2024-09-13T15:54:52.953460+0000","last_active":"2024-09-13T15:54:56.958576+0000","last_peered":"2024-09-13T15:54:56.958576+0000","last_clean":"2024-09-13T15:54:56.958576+0000","last_became_active":"2024-09-13T15:54:52.953112+0000","last_became_peered":"2024-09-13T15:54:52.953112+0000","last_unstale":"2024-09-13T15:54:56.958576+0000","last_undegraded":"2024-09-13T15:54:56.958576+0000","last_fullsized":"2024-09-13T15:54:56.958576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:56.676237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953893+0000","last_change":"2024-09-13T15:54:52.955844+0000","last_active":"2024-09-13T15:54:56.953893+0000","last_peered":"2024-09-13T15:54:56.953893+0000","last_clean":"2024-09-13T15:54:56.953893+0000","last_became_active":"2024-09-13T15:54:52.954217+0000","last_became_peered":"2024-09-13T15:54:52.954217+0000","last_unstale":"2024-09-13T15:54:56.953893+0000","last_undegraded":"2024-09-13T15:54:56.953893+0000","last_fullsized":"2024-09-13T15:54:56.953893+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:21.601680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953302+0000","last_change":"2024-09-13T15:54:52.950686+0000","last_active":"2024-09-13T15:54:56.953302+0000","last_peered":"2024-09-13T15:54:56.953302+0000","last_clean":"2024-09-13T15:54:56.953302+0000","last_became_active":"2024-09-13T15:54:52.950380+0000","last_became_peered":"2024-09-13T15:54:52.950380+0000","last_unstale":"2024-09-13T15:54:56.953302+0000","last_undegraded":"2024-09-13T15:54:56.953302+0000","last_fullsized":"2024-09-13T15:54:56.953302+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:44.181584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.965595+0000","last_change":"2024-09-13T15:54:52.956522+0000","last_active":"2024-09-13T15:54:56.965595+0000","last_peered":"2024-09-13T15:54:56.965595+0000","last_clean":"2024-09-13T15:54:56.965595+0000","last_became_active":"2024-09-13T15:54:52.956243+0000","last_became_peered":"2024-09-13T15:54:52.956243+0000","last_unstale":"2024-09-13T15:54:56.965595+0000","last_undegraded":"2024-09-13T15:54:56.965595+0000","last_fullsized":"2024-09-13T15:54:56.965595+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:50.633743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.968543+0000","last_change":"2024-09-13T15:54:52.951515+0000","last_active":"2024-09-13T15:54:56.968543+0000","last_peered":"2024-09-13T15:54:56.968543+0000","last_clean":"2024-09-13T15:54:56.968543+0000","last_became_active":"2024-09-13T15:54:52.951244+0000","last_became_peered":"2024-09-13T15:54:52.951244+0000","last_unstale":"2024-09-13T15:54:56.968543+0000","last_undegraded":"2024-09-13T15:54:56.968543+0000","last_fullsized":"2024-09-13T15:54:56.968543+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:30.834271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.959114+0000","last_change":"2024-09-13T15:54:52.951749+0000","last_active":"2024-09-13T15:54:56.959114+0000","last_peered":"2024-09-13T15:54:56.959114+0000","last_clean":"2024-09-13T15:54:56.959114+0000","last_became_active":"2024-09-13T15:54:52.951451+0000","last_became_peered":"2024-09-13T15:54:52.951451+0000","last_unstale":"2024-09-13T15:54:56.959114+0000","last_undegraded":"2024-09-13T15:54:56.959114+0000","last_fullsized":"2024-09-13T15:54:56.959114+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:32.628282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953996+0000","last_change":"2024-09-13T15:54:52.947562+0000","last_active":"2024-09-13T15:54:56.953996+0000","last_peered":"2024-09-13T15:54:56.953996+0000","last_clean":"2024-09-13T15:54:56.953996+0000","last_became_active":"2024-09-13T15:54:52.947246+0000","last_became_peered":"2024-09-13T15:54:52.947246+0000","last_unstale":"2024-09-13T15:54:56.953996+0000","last_undegraded":"2024-09-13T15:54:56.953996+0000","last_fullsized":"2024-09-13T15:54:56.953996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:12.595329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.976584+0000","last_change":"2024-09-13T15:54:52.951597+0000","last_active":"2024-09-13T15:54:56.976584+0000","last_peered":"2024-09-13T15:54:56.976584+0000","last_clean":"2024-09-13T15:54:56.976584+0000","last_became_active":"2024-09-13T15:54:52.951302+0000","last_became_peered":"2024-09-13T15:54:52.951302+0000","last_unstale":"2024-09-13T15:54:56.976584+0000","last_undegraded":"2024-09-13T15:54:56.976584+0000","last_fullsized":"2024-09-13T15:54:56.976584+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:06.638449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.962717+0000","last_change":"2024-09-13T15:54:52.957616+0000","last_active":"2024-09-13T15:54:56.962717+0000","last_peered":"2024-09-13T15:54:56.962717+0000","last_clean":"2024-09-13T15:54:56.962717+0000","last_became_active":"2024-09-13T15:54:52.957290+0000","last_became_peered":"2024-09-13T15:54:52.957290+0000","last_unstale":"2024-09-13T15:54:56.962717+0000","last_undegraded":"2024-09-13T15:54:56.962717+0000","last_fullsized":"2024-09-13T15:54:56.962717+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:40.262838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.971542+0000","last_change":"2024-09-13T15:54:52.947816+0000","last_active":"2024-09-13T15:54:56.971542+0000","last_peered":"2024-09-13T15:54:56.971542+0000","last_clean":"2024-09-13T15:54:56.971542+0000","last_became_active":"2024-09-13T15:54:52.947480+0000","last_became_peered":"2024-09-13T15:54:52.947480+0000","last_unstale":"2024-09-13T15:54:56.971542+0000","last_undegraded":"2024-09-13T15:54:56.971542+0000","last_fullsized":"2024-09-13T15:54:56.971542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:23.643741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.193383+0000","last_change":"2024-09-13T15:54:52.952203+0000","last_active":"2024-09-13T15:54:57.193383+0000","last_peered":"2024-09-13T15:54:57.193383+0000","last_clean":"2024-09-13T15:54:57.193383+0000","last_became_active":"2024-09-13T15:54:52.951913+0000","last_became_peered":"2024-09-13T15:54:52.951913+0000","last_unstale":"2024-09-13T15:54:57.193383+0000","last_undegraded":"2024-09-13T15:54:57.193383+0000","last_fullsized":"2024-09-13T15:54:57.193383+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:18.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.966750+0000","last_change":"2024-09-13T15:54:52.953810+0000","last_active":"2024-09-13T15:54:56.966750+0000","last_peered":"2024-09-13T15:54:56.966750+0000","last_clean":"2024-09-13T15:54:56.966750+0000","last_became_active":"2024-09-13T15:54:52.952774+0000","last_became_peered":"2024-09-13T15:54:52.952774+0000","last_unstale":"2024-09-13T15:54:56.966750+0000","last_undegraded":"2024-09-13T15:54:56.966750+0000","last_fullsized":"2024-09-13T15:54:56.966750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:37.836176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.958988+0000","last_change":"2024-09-13T15:54:52.953545+0000","last_active":"2024-09-13T15:54:56.958988+0000","last_peered":"2024-09-13T15:54:56.958988+0000","last_clean":"2024-09-13T15:54:56.958988+0000","last_became_active":"2024-09-13T15:54:52.953189+0000","last_became_peered":"2024-09-13T15:54:52.953189+0000","last_unstale":"2024-09-13T15:54:56.958988+0000","last_undegraded":"2024-09-13T15:54:56.958988+0000","last_fullsized":"2024-09-13T15:54:56.958988+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:34.130870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.954062+0000","last_change":"2024-09-13T15:54:52.953671+0000","last_active":"2024-09-13T15:54:56.954062+0000","last_peered":"2024-09-13T15:54:56.954062+0000","last_clean":"2024-09-13T15:54:56.954062+0000","last_became_active":"2024-09-13T15:54:52.952550+0000","last_became_peered":"2024-09-13T15:54:52.952550+0000","last_unstale":"2024-09-13T15:54:56.954062+0000","last_undegraded":"2024-09-13T15:54:56.954062+0000","last_fullsized":"2024-09-13T15:54:56.954062+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:48.525059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.952872+0000","last_change":"2024-09-13T15:54:52.951561+0000","last_active":"2024-09-13T15:54:56.952872+0000","last_peered":"2024-09-13T15:54:56.952872+0000","last_clean":"2024-09-13T15:54:56.952872+0000","last_became_active":"2024-09-13T15:54:52.951185+0000","last_became_peered":"2024-09-13T15:54:52.951185+0000","last_unstale":"2024-09-13T15:54:56.952872+0000","last_undegraded":"2024-09-13T15:54:56.952872+0000","last_fullsized":"2024-09-13T15:54:56.952872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:07.698614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.959980+0000","last_change":"2024-09-13T15:54:52.965016+0000","last_active":"2024-09-13T15:54:56.959980+0000","last_peered":"2024-09-13T15:54:56.959980+0000","last_clean":"2024-09-13T15:54:56.959980+0000","last_became_active":"2024-09-13T15:54:52.964684+0000","last_became_peered":"2024-09-13T15:54:52.964684+0000","last_unstale":"2024-09-13T15:54:56.959980+0000","last_undegraded":"2024-09-13T15:54:56.959980+0000","last_fullsized":"2024-09-13T15:54:56.959980+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:28.491075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.193350+0000","last_change":"2024-09-13T15:54:52.953679+0000","last_active":"2024-09-13T15:54:57.193350+0000","last_peered":"2024-09-13T15:54:57.193350+0000","last_clean":"2024-09-13T15:54:57.193350+0000","last_became_active":"2024-09-13T15:54:52.953409+0000","last_became_peered":"2024-09-13T15:54:52.953409+0000","last_unstale":"2024-09-13T15:54:57.193350+0000","last_undegraded":"2024-09-13T15:54:57.193350+0000","last_fullsized":"2024-09-13T15:54:57.193350+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:53.296327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.969167+0000","last_change":"2024-09-13T15:54:52.962219+0000","last_active":"2024-09-13T15:54:56.969167+0000","last_peered":"2024-09-13T15:54:56.969167+0000","last_clean":"2024-09-13T15:54:56.969167+0000","last_became_active":"2024-09-13T15:54:52.957640+0000","last_became_peered":"2024-09-13T15:54:52.957640+0000","last_unstale":"2024-09-13T15:54:56.969167+0000","last_undegraded":"2024-09-13T15:54:56.969167+0000","last_fullsized":"2024-09-13T15:54:56.969167+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:46.162478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.963977+0000","last_change":"2024-09-13T15:54:52.959852+0000","last_active":"2024-09-13T15:54:56.963977+0000","last_peered":"2024-09-13T15:54:56.963977+0000","last_clean":"2024-09-13T15:54:56.963977+0000","last_became_active":"2024-09-13T15:54:52.959495+0000","last_became_peered":"2024-09-13T15:54:52.959495+0000","last_unstale":"2024-09-13T15:54:56.963977+0000","last_undegraded":"2024-09-13T15:54:56.963977+0000","last_fullsized":"2024-09-13T15:54:56.963977+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:31.035977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.966675+0000","last_change":"2024-09-13T15:54:52.954059+0000","last_active":"2024-09-13T15:54:56.966675+0000","last_peered":"2024-09-13T15:54:56.966675+0000","last_clean":"2024-09-13T15:54:56.966675+0000","last_became_active":"2024-09-13T15:54:52.953500+0000","last_became_peered":"2024-09-13T15:54:52.953500+0000","last_unstale":"2024-09-13T15:54:56.966675+0000","last_undegraded":"2024-09-13T15:54:56.966675+0000","last_fullsized":"2024-09-13T15:54:56.966675+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:07.156723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.959450+0000","last_change":"2024-09-13T15:54:52.954236+0000","last_active":"2024-09-13T15:54:56.959450+0000","last_peered":"2024-09-13T15:54:56.959450+0000","last_clean":"2024-09-13T15:54:56.959450+0000","last_became_active":"2024-09-13T15:54:52.951975+0000","last_became_peered":"2024-09-13T15:54:52.951975+0000","last_unstale":"2024-09-13T15:54:56.959450+0000","last_undegraded":"2024-09-13T15:54:56.959450+0000","last_fullsized":"2024-09-13T15:54:56.959450+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:24.261419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953652+0000","last_change":"2024-09-13T15:54:52.960090+0000","last_active":"2024-09-13T15:54:56.953652+0000","last_peered":"2024-09-13T15:54:56.953652+0000","last_clean":"2024-09-13T15:54:56.953652+0000","last_became_active":"2024-09-13T15:54:52.959804+0000","last_became_peered":"2024-09-13T15:54:52.959804+0000","last_unstale":"2024-09-13T15:54:56.953652+0000","last_undegraded":"2024-09-13T15:54:56.953652+0000","last_fullsized":"2024-09-13T15:54:56.953652+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:27.467154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.082125+0000","last_change":"2024-09-13T15:54:52.957541+0000","last_active":"2024-09-13T15:54:57.082125+0000","last_peered":"2024-09-13T15:54:57.082125+0000","last_clean":"2024-09-13T15:54:57.082125+0000","last_became_active":"2024-09-13T15:54:52.957252+0000","last_became_peered":"2024-09-13T15:54:52.957252+0000","last_unstale":"2024-09-13T15:54:57.082125+0000","last_undegraded":"2024-09-13T15:54:57.082125+0000","last_fullsized":"2024-09-13T15:54:57.082125+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.768018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.193426+0000","last_change":"2024-09-13T15:54:52.951048+0000","last_active":"2024-09-13T15:54:57.193426+0000","last_peered":"2024-09-13T15:54:57.193426+0000","last_clean":"2024-09-13T15:54:57.193426+0000","last_became_active":"2024-09-13T15:54:52.948798+0000","last_became_peered":"2024-09-13T15:54:52.948798+0000","last_unstale":"2024-09-13T15:54:57.193426+0000","last_undegraded":"2024-09-13T15:54:57.193426+0000","last_fullsized":"2024-09-13T15:54:57.193426+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:48.081213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.967028+0000","last_change":"2024-09-13T15:54:52.952456+0000","last_active":"2024-09-13T15:54:56.967028+0000","last_peered":"2024-09-13T15:54:56.967028+0000","last_clean":"2024-09-13T15:54:56.967028+0000","last_became_active":"2024-09-13T15:54:52.951983+0000","last_became_peered":"2024-09-13T15:54:52.951983+0000","last_unstale":"2024-09-13T15:54:56.967028+0000","last_undegraded":"2024-09-13T15:54:56.967028+0000","last_fullsized":"2024-09-13T15:54:56.967028+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:06.748567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953133+0000","last_change":"2024-09-13T15:54:52.950155+0000","last_active":"2024-09-13T15:54:56.953133+0000","last_peered":"2024-09-13T15:54:56.953133+0000","last_clean":"2024-09-13T15:54:56.953133+0000","last_became_active":"2024-09-13T15:54:52.949758+0000","last_became_peered":"2024-09-13T15:54:52.949758+0000","last_unstale":"2024-09-13T15:54:56.953133+0000","last_undegraded":"2024-09-13T15:54:56.953133+0000","last_fullsized":"2024-09-13T15:54:56.953133+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:49.117434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.081674+0000","last_change":"2024-09-13T15:54:52.953741+0000","last_active":"2024-09-13T15:54:57.081674+0000","last_peered":"2024-09-13T15:54:57.081674+0000","last_clean":"2024-09-13T15:54:57.081674+0000","last_became_active":"2024-09-13T15:54:52.952648+0000","last_became_peered":"2024-09-13T15:54:52.952648+0000","last_unstale":"2024-09-13T15:54:57.081674+0000","last_undegraded":"2024-09-13T15:54:57.081674+0000","last_fullsized":"2024-09-13T15:54:57.081674+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:56:46.640480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.958642+0000","last_change":"2024-09-13T15:54:52.948822+0000","last_active":"2024-09-13T15:54:56.958642+0000","last_peered":"2024-09-13T15:54:56.958642+0000","last_clean":"2024-09-13T15:54:56.958642+0000","last_became_active":"2024-09-13T15:54:52.948528+0000","last_became_peered":"2024-09-13T15:54:52.948528+0000","last_unstale":"2024-09-13T15:54:56.958642+0000","last_undegraded":"2024-09-13T15:54:56.958642+0000","last_fullsized":"2024-09-13T15:54:56.958642+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:28:25.700799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.959415+0000","last_change":"2024-09-13T15:54:52.950609+0000","last_active":"2024-09-13T15:54:56.959415+0000","last_peered":"2024-09-13T15:54:56.959415+0000","last_clean":"2024-09-13T15:54:56.959415+0000","last_became_active":"2024-09-13T15:54:52.949481+0000","last_became_peered":"2024-09-13T15:54:52.949481+0000","last_unstale":"2024-09-13T15:54:56.959415+0000","last_undegraded":"2024-09-13T15:54:56.959415+0000","last_fullsized":"2024-09-13T15:54:56.959415+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:59.272557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.973230+0000","last_change":"2024-09-13T15:54:52.950857+0000","last_active":"2024-09-13T15:54:56.973230+0000","last_peered":"2024-09-13T15:54:56.973230+0000","last_clean":"2024-09-13T15:54:56.973230+0000","last_became_active":"2024-09-13T15:54:52.948553+0000","last_became_peered":"2024-09-13T15:54:52.948553+0000","last_unstale":"2024-09-13T15:54:56.973230+0000","last_undegraded":"2024-09-13T15:54:56.973230+0000","last_fullsized":"2024-09-13T15:54:56.973230+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:33.644131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.976004+0000","last_change":"2024-09-13T15:54:52.965573+0000","last_active":"2024-09-13T15:54:56.976004+0000","last_peered":"2024-09-13T15:54:56.976004+0000","last_clean":"2024-09-13T15:54:56.976004+0000","last_became_active":"2024-09-13T15:54:52.961538+0000","last_became_peered":"2024-09-13T15:54:52.961538+0000","last_unstale":"2024-09-13T15:54:56.976004+0000","last_undegraded":"2024-09-13T15:54:56.976004+0000","last_fullsized":"2024-09-13T15:54:56.976004+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:12.887939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.959902+0000","last_change":"2024-09-13T15:54:52.964064+0000","last_active":"2024-09-13T15:54:56.959902+0000","last_peered":"2024-09-13T15:54:56.959902+0000","last_clean":"2024-09-13T15:54:56.959902+0000","last_became_active":"2024-09-13T15:54:52.963770+0000","last_became_peered":"2024-09-13T15:54:52.963770+0000","last_unstale":"2024-09-13T15:54:56.959902+0000","last_undegraded":"2024-09-13T15:54:56.959902+0000","last_fullsized":"2024-09-13T15:54:56.959902+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:28.967227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5571,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":99,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":36135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":987136,"data_stored":479614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36043205},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":5.0389999999999997,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65900000000000003}]},{"osd":1,"last update":"Fri Sep 13 15:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.62},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.63500000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Sep 13 15:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60799999999999998}]},{"osd":5,"last update":"Fri Sep 13 15:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47799999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":5.0880000000000001,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.77900000000000003}]},{"osd":7,"last update":"Fri Sep 13 15:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.755},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.67900000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":9,"last update":"Fri Sep 13 15:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.71499999999999997}]},{"osd":10,"last update":"Fri Sep 13 15:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.86799999999999999}]}]},{"osd":10,"up_from":73,"seq":313532612629,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1617920,"data_stored":1074733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.48099999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.629},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.76500000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.56100000000000005}]},{"osd":6,"last update":"Fri Sep 13 15:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.83099999999999996}]},{"osd":7,"last update":"Fri Sep 13 15:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.49299999999999999}]},{"osd":8,"last update":"Fri Sep 13 15:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.72399999999999998}]},{"osd":9,"last update":"Fri Sep 13 15:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.85999999999999999}]},{"osd":11,"last update":"Fri Sep 13 15:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.77900000000000003}]}]},{"osd":9,"up_from":68,"seq":292057776156,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":991232,"data_stored":480196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:55:12 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.438}]},{"osd":1,"last update":"Fri Sep 13 15:55:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.75700000000000001,"15min":0.76700000000000002},"min":{"1min":0.499,"5min":0.443,"15min":0.443},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.64600000000000002,"15min":0.65000000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.57599999999999996}]},{"osd":2,"last update":"Fri Sep 13 15:55:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.81000000000000005,"15min":0.81799999999999995},"min":{"1min":0.47899999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77600000000000002,"15min":0.77900000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.84299999999999997}]},{"osd":3,"last update":"Fri Sep 13 15:55:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0189999999999999,"5min":1.089,"15min":1.089},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.75800000000000001,"15min":0.77600000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.47099999999999997}]},{"osd":4,"last update":"Fri Sep 13 15:55:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.48799999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.754},{"interface":"front","average":{"1min":0.754,"5min":0.83099999999999996,"15min":0.84399999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1819999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Fri Sep 13 15:55:12 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.88700000000000001,"15min":0.90300000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.88500000000000001,"15min":0.89800000000000002},"min":{"1min":0.53900000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.71899999999999997}]},{"osd":6,"last update":"Fri Sep 13 15:54:12 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.0349999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:55:12 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.97199999999999998,"15min":0.99299999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2949999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.93200000000000005,"15min":0.94799999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2769999999999999,"5min":1.325,"15min":1.325},"last":0.79400000000000004}]},{"osd":8,"last update":"Fri Sep 13 15:55:12 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.97799999999999998,"15min":0.99399999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.3859999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.85499999999999998,"15min":0.86699999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.81999999999999995}]},{"osd":10,"last update":"Fri Sep 13 15:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.70999999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]},{"osd":8,"up_from":60,"seq":257698037793,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":480021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80700000000000005,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.432}]},{"osd":1,"last update":"Fri Sep 13 15:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.502,"15min":0.49299999999999999},"min":{"1min":0.34899999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68700000000000006,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.629}]},{"osd":2,"last update":"Fri Sep 13 15:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.52800000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38,"15min":0.376},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.499,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.49399999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.62,"15min":0.623},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.876,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86499999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66200000000000003,"5min":0.754,"15min":0.754},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.58299999999999996}]},{"osd":5,"last update":"Fri Sep 13 15:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.44600000000000001,"15min":0.443},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45200000000000001,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.55900000000000005}]},{"osd":6,"last update":"Fri Sep 13 15:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64500000000000002,"15min":0.63900000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84999999999999998,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.74199999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.45400000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.745,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.60499999999999998}]},{"osd":9,"last update":"Fri Sep 13 15:55:10 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69199999999999995,"15min":0.69599999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.84799999999999998,"5min":0.876,"15min":0.876},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.71399999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.70199999999999996}]},{"osd":10,"last update":"Fri Sep 13 15:54:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.68200000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":7,"up_from":52,"seq":223338299429,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36764,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708388,"statfs":{"total":95995035648,"available":95957389312,"internally_reserved":0,"allocated":1593344,"data_stored":1071347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36043211},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80700000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79400000000000004,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.39600000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38500000000000001,"15min":0.38100000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.42999999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54300000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.504}]},{"osd":3,"last update":"Fri Sep 13 15:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60799999999999998,"15min":0.60299999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.62},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80400000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.65100000000000002}]},{"osd":4,"last update":"Fri Sep 13 15:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.47299999999999998,"15min":0.47999999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.66500000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.41299999999999998}]},{"osd":5,"last update":"Fri Sep 13 15:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Sep 13 15:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.82899999999999996,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88200000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.78800000000000003}]},{"osd":8,"last update":"Fri Sep 13 15:54:42 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.42799999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67400000000000004,"15min":0.67000000000000004},"min":{"1min":0.47099999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.67000000000000004}]},{"osd":9,"last update":"Fri Sep 13 15:55:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70499999999999996,"15min":0.70699999999999996},"min":{"1min":0.50700000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.497,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92800000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.71599999999999997}]},{"osd":10,"last update":"Fri Sep 13 15:54:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.60499999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":6,"up_from":47,"seq":201863462956,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":991232,"data_stored":479704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36043207},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.34599999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72899999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.53200000000000003,"15min":0.54400000000000004},"min":{"1min":0.375,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72899999999999998,"5min":1.008,"15min":1.008},"last":0.35499999999999998}]},{"osd":1,"last update":"Fri Sep 13 15:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66300000000000003,"15min":0.67300000000000004},"min":{"1min":0.48399999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.83699999999999997,"5min":1.113,"15min":1.113},"last":0.624},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.89300000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.69799999999999995,"15min":0.71099999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72799999999999998,"15min":0.72899999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.70799999999999996}]},{"osd":3,"last update":"Fri Sep 13 15:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.42199999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91800000000000004,"5min":1.121,"15min":1.121},"last":0.433},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66900000000000004,"15min":0.67500000000000004},"min":{"1min":0.39100000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.874,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.499}]},{"osd":4,"last update":"Fri Sep 13 15:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.70099999999999996,"15min":0.72699999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.85799999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.748,"15min":0.749},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.79900000000000004}]},{"osd":5,"last update":"Fri Sep 13 15:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.77900000000000003,"15min":0.78400000000000003},"min":{"1min":0.57699999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.99399999999999999,"5min":1.032,"15min":1.032},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.78600000000000003,"15min":0.80800000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0700000000000001,"5min":1.236,"15min":1.236},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Sep 13 15:54:19 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.755,"15min":0.749},"min":{"1min":0.53600000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.77800000000000002,"15min":0.76400000000000001},"min":{"1min":0.629,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.89600000000000002}]},{"osd":8,"last update":"Fri Sep 13 15:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.85699999999999998,"15min":0.86699999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.036,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.63900000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0089999999999999,"5min":1.044,"15min":1.044},"last":0.69099999999999995}]},{"osd":9,"last update":"Fri Sep 13 15:55:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.90000000000000002,"15min":0.92000000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1850000000000001,"5min":1.222,"15min":1.222},"last":0.875},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.89100000000000001,"15min":0.89800000000000002},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.77500000000000002}]},{"osd":10,"last update":"Fri Sep 13 15:54:34 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.91600000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":5,"up_from":39,"seq":167503724591,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28588,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716564,"statfs":{"total":95995035648,"available":95965761536,"internally_reserved":0,"allocated":1593344,"data_stored":1070164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:54:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56599999999999995,"15min":0.54900000000000004},"min":{"1min":0.42799999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.38900000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:54:30 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.497,"15min":0.48999999999999999},"min":{"1min":0.38100000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70699999999999996,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.499,"15min":0.48699999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.63600000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:54:30 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.37,"15min":0.36799999999999999},"min":{"1min":0.26300000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.51200000000000001,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27300000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.56100000000000005,"5min":0.749,"15min":0.749},"last":0.33000000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:54:30 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58699999999999997,"15min":0.59299999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.57899999999999996}]},{"osd":4,"last update":"Fri Sep 13 15:54:30 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54900000000000004,"15min":0.53400000000000003},"min":{"1min":0.432,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.748,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.498},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:54:56 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61099999999999999,"15min":0.60199999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.82499999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81399999999999995,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.65100000000000002}]},{"osd":7,"last update":"Fri Sep 13 15:54:18 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.41799999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.67600000000000005}]},{"osd":8,"last update":"Fri Sep 13 15:54:42 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.51400000000000001,"15min":0.52900000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64700000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.745,"5min":1.024,"15min":1.024},"last":0.59499999999999997}]},{"osd":9,"last update":"Fri Sep 13 15:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.623}]},{"osd":10,"last update":"Fri Sep 13 15:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.71399999999999997}]}]},{"osd":4,"up_from":34,"seq":146028888116,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":991232,"data_stored":479636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:54:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.55000000000000004,"15min":0.53300000000000003},"min":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.83199999999999996,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.41299999999999998}]},{"osd":1,"last update":"Fri Sep 13 15:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.36599999999999999,"15min":0.34899999999999998},"min":{"1min":0.28399999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.371,"15min":0.35699999999999998},"min":{"1min":0.27400000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.439}]},{"osd":2,"last update":"Fri Sep 13 15:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52400000000000002,"15min":0.50800000000000001},"min":{"1min":0.40799999999999997,"5min":0.31,"15min":0.31},"max":{"1min":0.76900000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53200000000000003,"15min":0.52100000000000002},"min":{"1min":0.39000000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.747,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.58499999999999996}]},{"osd":3,"last update":"Fri Sep 13 15:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57499999999999996,"15min":0.55800000000000005},"min":{"1min":0.42799999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.77900000000000003,"5min":0.878,"15min":0.878},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59899999999999998,"15min":0.55900000000000005},"min":{"1min":0.40100000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73399999999999999,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":0.79300000000000004}]},{"osd":5,"last update":"Fri Sep 13 15:54:24 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.56899999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76800000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.443,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83199999999999996,"5min":0.995,"15min":0.995},"last":0.60499999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:54:54 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.625,"15min":0.61599999999999999},"min":{"1min":0.46600000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83499999999999996,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.46100000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.83899999999999997,"5min":0.873,"15min":0.873},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Sep 13 15:54:21 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.53200000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51800000000000002,"15min":0.51400000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.54400000000000004}]},{"osd":8,"last update":"Fri Sep 13 15:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61299999999999999,"15min":0.60999999999999999},"min":{"1min":0.46800000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84399999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.48099999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.63700000000000001}]},{"osd":9,"last update":"Fri Sep 13 15:55:15 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.71499999999999997,"15min":0.72199999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.745},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.71299999999999997,"15min":0.72099999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.77400000000000002}]},{"osd":10,"last update":"Fri Sep 13 15:54:34 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.69099999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]},{"osd":3,"up_from":26,"seq":111669149754,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":995328,"data_stored":479527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.42499999999999999,"15min":0.40400000000000003},"min":{"1min":0.312,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.434,"15min":0.41799999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72499999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.372}]},{"osd":1,"last update":"Fri Sep 13 15:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.63200000000000001,"15min":0.59599999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0249999999999999,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61799999999999999,"15min":0.59199999999999997},"min":{"1min":0.48699999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90800000000000003,"5min":1.345,"15min":1.345},"last":0.82399999999999995}]},{"osd":2,"last update":"Fri Sep 13 15:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63600000000000001,"15min":0.61399999999999999},"min":{"1min":0.441,"5min":0.437,"15min":0.437},"max":{"1min":1.0249999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.438,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96499999999999997,"5min":1.667,"15min":1.667},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Sep 13 15:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66900000000000004,"15min":0.63900000000000001},"min":{"1min":0.47699999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88400000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64800000000000002,"15min":0.622},"min":{"1min":0.48899999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86799999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.69599999999999995}]},{"osd":5,"last update":"Fri Sep 13 15:54:28 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67000000000000004,"15min":0.64400000000000002},"min":{"1min":0.50900000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91600000000000004,"5min":1.357,"15min":1.357},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64200000000000002,"15min":0.626},"min":{"1min":0.47099999999999997,"5min":0.436,"15min":0.436},"max":{"1min":0.88900000000000001,"5min":1.292,"15min":1.292},"last":0.59899999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63500000000000001,"15min":0.629},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.97099999999999997,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.502},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.69599999999999995,"15min":0.70599999999999996},"min":{"1min":0.40100000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.024,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.83599999999999997}]},{"osd":7,"last update":"Fri Sep 13 15:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.78400000000000003,"15min":0.77300000000000002},"min":{"1min":0.59699999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1619999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.55600000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.88100000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.77400000000000002}]},{"osd":8,"last update":"Fri Sep 13 15:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.75600000000000001,"15min":0.753},"min":{"1min":0.54700000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.044,"5min":1.079,"15min":1.079},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.61699999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1899999999999999,"5min":1.466,"15min":1.466},"last":0.83899999999999997}]},{"osd":9,"last update":"Fri Sep 13 15:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.88100000000000001}]},{"osd":10,"last update":"Fri Sep 13 15:54:35 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.80000000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":483443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:54:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.52400000000000002,"15min":0.51700000000000002},"min":{"1min":0.36599999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.35199999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.74199999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.55800000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:54:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.48799999999999999,"15min":0.46600000000000003},"min":{"1min":0.372,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.497,"15min":0.48499999999999999},"min":{"1min":0.32800000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.70399999999999996,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.66000000000000003}]},{"osd":3,"last update":"Fri Sep 13 15:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.54600000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.745,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.81499999999999995,"5min":0.874,"15min":0.874},"last":0.65200000000000002}]},{"osd":4,"last update":"Fri Sep 13 15:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.49099999999999999,"15min":0.47699999999999998},"min":{"1min":0.34499999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.502,"15min":0.49399999999999999},"min":{"1min":0.33700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.60999999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:54:29 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.41399999999999998,"15min":0.40699999999999997},"min":{"1min":0.25800000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.53800000000000003}]},{"osd":6,"last update":"Fri Sep 13 15:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.59499999999999997,"15min":0.58499999999999996},"min":{"1min":0.41399999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.63500000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:54:19 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56200000000000006,"15min":0.55500000000000005},"min":{"1min":0.39900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79800000000000004,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.58099999999999996}]},{"osd":8,"last update":"Fri Sep 13 15:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.35399999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.748}]},{"osd":9,"last update":"Fri Sep 13 15:55:10 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65200000000000002,"15min":0.64900000000000002},"min":{"1min":0.49399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.73499999999999999}]},{"osd":10,"last update":"Fri Sep 13 15:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.78500000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":502436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.51800000000000002,"15min":0.48199999999999998},"min":{"1min":0.317,"5min":0.253,"15min":0.253},"max":{"1min":0.79400000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.505},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.80100000000000005,"5min":1.2,"15min":1.2},"last":0.75700000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:54:23 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.48799999999999999},"min":{"1min":0.37,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.68500000000000005,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.47599999999999998,"15min":0.46800000000000003},"min":{"1min":0.41499999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.69199999999999995,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.78300000000000003}]},{"osd":3,"last update":"Fri Sep 13 15:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.38700000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73399999999999999,"5min":1.087,"15min":1.087},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52800000000000002,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68000000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Sep 13 15:55:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.37},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.76900000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.439},{"interface":"front","average":{"1min":0.496,"5min":0.41799999999999998,"15min":0.39000000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.753,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.37}]},{"osd":5,"last update":"Fri Sep 13 15:54:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.54900000000000004,"15min":0.52700000000000002},"min":{"1min":0.433,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.54600000000000004,"15min":0.52400000000000002},"min":{"1min":0.438,"5min":0.374,"15min":0.374},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.74199999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61899999999999999,"15min":0.60799999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78000000000000003,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85299999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Sep 13 15:54:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.503,"15min":0.5},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.34300000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.626}]},{"osd":8,"last update":"Fri Sep 13 15:54:50 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.67300000000000004,"15min":0.63200000000000001},"min":{"1min":0.46899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":5.2149999999999999,"5min":5.2149999999999999,"15min":5.2149999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.65200000000000002}]},{"osd":9,"last update":"Fri Sep 13 15:55:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0109999999999999,"5min":1.111,"15min":1.111},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.121,"5min":1.325,"15min":1.325},"last":0.72299999999999998}]},{"osd":10,"last update":"Fri Sep 13 15:54:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.499},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.70199999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":479704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63,"15min":0.60599999999999998},"min":{"1min":0.40200000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82299999999999995,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.64500000000000002,"15min":0.59299999999999997},"min":{"1min":0.46700000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86899999999999999,"5min":1.081,"15min":1.081},"last":0.79000000000000004}]},{"osd":2,"last update":"Fri Sep 13 15:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.63600000000000001,"15min":0.59799999999999998},"min":{"1min":0.42799999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.65700000000000003,"15min":0.61499999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.67000000000000004}]},{"osd":3,"last update":"Fri Sep 13 15:53:38 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.49299999999999999,"15min":0.46700000000000003},"min":{"1min":0.36199999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.505,"15min":0.47899999999999998},"min":{"1min":0.377,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.72099999999999997}]},{"osd":4,"last update":"Fri Sep 13 15:55:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64400000000000002,"15min":0.57099999999999995},"min":{"1min":0.42699999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93799999999999994,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61399999999999999,"15min":0.56799999999999995},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89300000000000002,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.73999999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:54:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.65100000000000002,"15min":0.64100000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.93600000000000005,"5min":1.018,"15min":1.018},"last":0.628},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.68300000000000005,"15min":0.66300000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1639999999999999,"5min":1.167,"15min":1.167},"last":0.75800000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64400000000000002,"15min":0.65200000000000002},"min":{"1min":0.35699999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.97099999999999997,"5min":1.151,"15min":1.151},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.40300000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92000000000000004,"5min":1.125,"15min":1.125},"last":0.69799999999999995}]},{"osd":7,"last update":"Fri Sep 13 15:54:19 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.80400000000000005,"15min":0.78600000000000003},"min":{"1min":0.51400000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.79800000000000004,"15min":0.78900000000000003},"min":{"1min":0.57799999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1919999999999999,"5min":1.468,"15min":1.468},"last":0.91500000000000004}]},{"osd":8,"last update":"Fri Sep 13 15:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80400000000000005,"15min":0.80200000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.095,"5min":1.224,"15min":1.224},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.81799999999999995,"15min":0.81999999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.141,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.61399999999999999}]},{"osd":9,"last update":"Fri Sep 13 15:55:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.88400000000000001,"15min":0.89800000000000002},"min":{"1min":0.53100000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95299999999999996,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.92800000000000005,"15min":0.94699999999999995},"min":{"1min":0.55200000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0249999999999999,"5min":1.419,"15min":1.419},"last":0.88400000000000001}]},{"osd":10,"last update":"Fri Sep 13 15:54:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.81399999999999995}]},{"osd":11,"last update":"Fri Sep 13 15:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":1.006},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.78200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":23095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:55:19.593 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:55:19.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:19 smithi189 ceph-mon[34790]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-13T15:55:19.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:19 smithi189 ceph-mon[34790]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:55:19.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:19 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/4051353189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:55:19.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:19 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/482363475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:19.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:19 smithi193 ceph-mon[35248]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-13T15:55:19.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:19 smithi193 ceph-mon[35248]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:55:19.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:19 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/4051353189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:55:19.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:19 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/482363475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:19.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.805+0000 7f7a03e00640 1 -- 172.21.15.17:0/3335323179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79fc10c370 msgr2=0x7f79fc10e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:19.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.805+0000 7f7a03e00640 1 --2- 172.21.15.17:0/3335323179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79fc10c370 0x7f79fc10e760 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f79f4009ca0 tx=0x7f79f402a8c0 comp rx=0 tx=0).stop 2024-09-13T15:55:19.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.805+0000 7f7a03e00640 1 -- 172.21.15.17:0/3335323179 shutdown_connections 2024-09-13T15:55:19.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.805+0000 7f7a03e00640 1 --2- 172.21.15.17:0/3335323179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79fc10c370 0x7f79fc10e760 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:19.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.805+0000 7f7a03e00640 1 --2- 172.21.15.17:0/3335323179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79fc072f10 0x7f79fc073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:19.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.805+0000 7f7a03e00640 1 --2- 172.21.15.17:0/3335323179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79fc0744f0 0x7f79fc072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:19.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.805+0000 7f7a03e00640 1 -- 172.21.15.17:0/3335323179 >> 172.21.15.17:0/3335323179 conn(0x7f79fc0fb520 msgr2=0x7f79fc0fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:19.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.805+0000 7f7a03e00640 1 -- 172.21.15.17:0/3335323179 shutdown_connections 2024-09-13T15:55:19.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.805+0000 7f7a03e00640 1 -- 172.21.15.17:0/3335323179 wait complete. 2024-09-13T15:55:19.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.806+0000 7f7a03e00640 1 Processor -- start 2024-09-13T15:55:19.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.806+0000 7f7a03e00640 1 -- start start 2024-09-13T15:55:19.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.806+0000 7f7a03e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79fc072f10 0x7f79fc19c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:19.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.806+0000 7f7a03e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79fc0744f0 0x7f79fc19c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:19.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.806+0000 7f7a03e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79fc10c370 0x7f79fc1a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:19.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.806+0000 7f7a03e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc1a3e00 con 0x7f79fc10c370 2024-09-13T15:55:19.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.806+0000 7f7a03e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc1a3f70 con 0x7f79fc0744f0 2024-09-13T15:55:19.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.806+0000 7f7a03e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc1a4130 con 0x7f79fc072f10 2024-09-13T15:55:19.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.807+0000 7f7a01e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79fc10c370 0x7f79fc1a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:19.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.807+0000 7f7a01400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79fc072f10 0x7f79fc19c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:19.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.807+0000 7f7a00a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79fc0744f0 0x7f79fc19c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:19.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.807+0000 7f7a01400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79fc072f10 0x7f79fc19c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:33122/0 (socket says 172.21.15.17:33122) 2024-09-13T15:55:19.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.807+0000 7f7a01400640 1 -- 172.21.15.17:0/4254592323 learned_addr learned my addr 172.21.15.17:0/4254592323 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:19.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.807+0000 7f7a00a00640 1 -- 172.21.15.17:0/4254592323 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79fc072f10 msgr2=0x7f79fc19c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:19.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.807+0000 7f7a00a00640 1 --2- 172.21.15.17:0/4254592323 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79fc072f10 0x7f79fc19c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:19.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.807+0000 7f7a00a00640 1 -- 172.21.15.17:0/4254592323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79fc10c370 msgr2=0x7f79fc1a38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:19.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.807+0000 7f7a00a00640 1 --2- 172.21.15.17:0/4254592323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79fc10c370 0x7f79fc1a38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:19.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.807+0000 7f7a00a00640 1 -- 172.21.15.17:0/4254592323 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e8009490 con 0x7f79fc0744f0 2024-09-13T15:55:19.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.807+0000 7f7a01400640 1 --2- 172.21.15.17:0/4254592323 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79fc072f10 0x7f79fc19c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:55:19.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.807+0000 7f7a00a00640 1 --2- 172.21.15.17:0/4254592323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79fc0744f0 0x7f79fc19c850 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f79e800e9f0 tx=0x7f79e800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:19.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.808+0000 7f79fa000640 1 -- 172.21.15.17:0/4254592323 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e800cd80 con 0x7f79fc0744f0 2024-09-13T15:55:19.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.808+0000 7f7a03e00640 1 -- 172.21.15.17:0/4254592323 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f4009900 con 0x7f79fc0744f0 2024-09-13T15:55:19.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.808+0000 7f79fa000640 1 -- 172.21.15.17:0/4254592323 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f79e80035f0 con 0x7f79fc0744f0 2024-09-13T15:55:19.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.808+0000 7f79fa000640 1 -- 172.21.15.17:0/4254592323 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e80044e0 con 0x7f79fc0744f0 2024-09-13T15:55:19.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.808+0000 7f7a03e00640 1 -- 172.21.15.17:0/4254592323 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79fc1a47e0 con 0x7f79fc0744f0 2024-09-13T15:55:19.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.809+0000 7f7a03e00640 1 -- 172.21.15.17:0/4254592323 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79fc101d10 con 0x7f79fc0744f0 2024-09-13T15:55:19.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.811+0000 7f79fa000640 1 -- 172.21.15.17:0/4254592323 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f79e8003a60 con 0x7f79fc0744f0 2024-09-13T15:55:19.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.812+0000 7f79fa000640 1 --2- 172.21.15.17:0/4254592323 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f79e40a1120 0x7f79e40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:19.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.812+0000 7f79fa000640 1 -- 172.21.15.17:0/4254592323 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f79e8014070 con 0x7f79fc0744f0 2024-09-13T15:55:19.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.813+0000 7f7a01400640 1 --2- 172.21.15.17:0/4254592323 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f79e40a1120 0x7f79e40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:19.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.813+0000 7f7a01400640 1 --2- 172.21.15.17:0/4254592323 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f79e40a1120 0x7f79e40a35e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f79f0011500 tx=0x7f79f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:19.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.814+0000 7f79fa000640 1 -- 172.21.15.17:0/4254592323 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f79e8096c80 con 0x7f79fc0744f0 2024-09-13T15:55:19.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:19.996+0000 7f7a03e00640 1 -- 172.21.15.17:0/4254592323 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f79fc0608f0 con 0x7f79e40a1120 2024-09-13T15:55:20.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:20.019+0000 7f79fa000640 1 -- 172.21.15.17:0/4254592323 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+423069 (secure 0 0 0) 0x7f79fc0608f0 con 0x7f79e40a1120 2024-09-13T15:55:20.025 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:55:20.027 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-13T15:55:20.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:20.024+0000 7f7a03e00640 1 -- 172.21.15.17:0/4254592323 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f79e40a1120 msgr2=0x7f79e40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:20.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:20.024+0000 7f7a03e00640 1 --2- 172.21.15.17:0/4254592323 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f79e40a1120 0x7f79e40a35e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f79f0011500 tx=0x7f79f0005f90 comp rx=0 tx=0).stop 2024-09-13T15:55:20.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:20.024+0000 7f7a03e00640 1 -- 172.21.15.17:0/4254592323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79fc0744f0 msgr2=0x7f79fc19c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:20.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:20.024+0000 7f7a03e00640 1 --2- 172.21.15.17:0/4254592323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79fc0744f0 0x7f79fc19c850 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f79e800e9f0 tx=0x7f79e800eeb0 comp rx=0 tx=0).stop 2024-09-13T15:55:20.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:20.024+0000 7f7a03e00640 1 -- 172.21.15.17:0/4254592323 shutdown_connections 2024-09-13T15:55:20.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:20.024+0000 7f7a03e00640 1 --2- 172.21.15.17:0/4254592323 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f79e40a1120 0x7f79e40a35e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:20.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:20.024+0000 7f7a03e00640 1 --2- 172.21.15.17:0/4254592323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79fc10c370 0x7f79fc1a38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:20.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:20.024+0000 7f7a03e00640 1 --2- 172.21.15.17:0/4254592323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79fc0744f0 0x7f79fc19c850 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:20.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:20.024+0000 7f7a03e00640 1 --2- 172.21.15.17:0/4254592323 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79fc072f10 0x7f79fc19c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:20.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:20.024+0000 7f7a03e00640 1 -- 172.21.15.17:0/4254592323 >> 172.21.15.17:0/4254592323 conn(0x7f79fc0fb520 msgr2=0x7f79fc0fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:20.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:20.024+0000 7f7a03e00640 1 -- 172.21.15.17:0/4254592323 shutdown_connections 2024-09-13T15:55:20.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:20.024+0000 7f7a03e00640 1 -- 172.21.15.17:0/4254592323 wait complete. 2024-09-13T15:55:20.041 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2024-09-13T15:55:18.142642+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595939,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":128,"num_read_kb":111,"num_write":280,"num_write_kb":2977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370468,"kb_used_data":13452,"kb_used_omap":18,"kb_used_meta":356845,"kb_avail":1124571356,"statfs":{"total":1151940427776,"available":1151561068544,"internally_reserved":0,"allocated":13774848,"data_stored":7560525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19130,"internal_metadata":365409606},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2759,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003470"},"pg_stats":[{"pgid":"2.1f","version":"85'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953629+0000","last_change":"2024-09-13T15:54:52.516551+0000","last_active":"2024-09-13T15:54:56.953629+0000","last_peered":"2024-09-13T15:54:56.953629+0000","last_clean":"2024-09-13T15:54:56.953629+0000","last_became_active":"2024-09-13T15:54:52.516112+0000","last_became_peered":"2024-09-13T15:54:52.516112+0000","last_unstale":"2024-09-13T15:54:56.953629+0000","last_undegraded":"2024-09-13T15:54:56.953629+0000","last_fullsized":"2024-09-13T15:54:56.953629+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:55.147164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.975263+0000","last_change":"2024-09-13T15:54:52.954466+0000","last_active":"2024-09-13T15:54:56.975263+0000","last_peered":"2024-09-13T15:54:56.975263+0000","last_clean":"2024-09-13T15:54:56.975263+0000","last_became_active":"2024-09-13T15:54:52.953991+0000","last_became_peered":"2024-09-13T15:54:52.953991+0000","last_unstale":"2024-09-13T15:54:56.975263+0000","last_undegraded":"2024-09-13T15:54:56.975263+0000","last_fullsized":"2024-09-13T15:54:56.975263+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:17.702395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638764+0000","last_change":"2024-09-13T15:54:56.970987+0000","last_active":"2024-09-13T15:54:57.638764+0000","last_peered":"2024-09-13T15:54:57.638764+0000","last_clean":"2024-09-13T15:54:57.638764+0000","last_became_active":"2024-09-13T15:54:56.970594+0000","last_became_peered":"2024-09-13T15:54:56.970594+0000","last_unstale":"2024-09-13T15:54:57.638764+0000","last_undegraded":"2024-09-13T15:54:57.638764+0000","last_fullsized":"2024-09-13T15:54:57.638764+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:56.833427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.609821+0000","last_change":"2024-09-13T15:54:52.517608+0000","last_active":"2024-09-13T15:54:57.609821+0000","last_peered":"2024-09-13T15:54:57.609821+0000","last_clean":"2024-09-13T15:54:57.609821+0000","last_became_active":"2024-09-13T15:54:52.517001+0000","last_became_peered":"2024-09-13T15:54:52.517001+0000","last_unstale":"2024-09-13T15:54:57.609821+0000","last_undegraded":"2024-09-13T15:54:57.609821+0000","last_fullsized":"2024-09-13T15:54:57.609821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:51.459179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.973682+0000","last_change":"2024-09-13T15:54:52.944713+0000","last_active":"2024-09-13T15:54:56.973682+0000","last_peered":"2024-09-13T15:54:56.973682+0000","last_clean":"2024-09-13T15:54:56.973682+0000","last_became_active":"2024-09-13T15:54:52.943602+0000","last_became_peered":"2024-09-13T15:54:52.943602+0000","last_unstale":"2024-09-13T15:54:56.973682+0000","last_undegraded":"2024-09-13T15:54:56.973682+0000","last_fullsized":"2024-09-13T15:54:56.973682+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:59.305153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638386+0000","last_change":"2024-09-13T15:54:56.981923+0000","last_active":"2024-09-13T15:54:57.638386+0000","last_peered":"2024-09-13T15:54:57.638386+0000","last_clean":"2024-09-13T15:54:57.638386+0000","last_became_active":"2024-09-13T15:54:56.981640+0000","last_became_peered":"2024-09-13T15:54:56.981640+0000","last_unstale":"2024-09-13T15:54:57.638386+0000","last_undegraded":"2024-09-13T15:54:57.638386+0000","last_fullsized":"2024-09-13T15:54:57.638386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:42.158619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:15.254688+0000","last_change":"2024-09-13T15:54:52.512700+0000","last_active":"2024-09-13T15:55:15.254688+0000","last_peered":"2024-09-13T15:55:15.254688+0000","last_clean":"2024-09-13T15:55:15.254688+0000","last_became_active":"2024-09-13T15:54:52.512378+0000","last_became_peered":"2024-09-13T15:54:52.512378+0000","last_unstale":"2024-09-13T15:55:15.254688+0000","last_undegraded":"2024-09-13T15:55:15.254688+0000","last_fullsized":"2024-09-13T15:55:15.254688+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:43:23.573164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.193395+0000","last_change":"2024-09-13T15:54:52.957314+0000","last_active":"2024-09-13T15:54:57.193395+0000","last_peered":"2024-09-13T15:54:57.193395+0000","last_clean":"2024-09-13T15:54:57.193395+0000","last_became_active":"2024-09-13T15:54:52.956836+0000","last_became_peered":"2024-09-13T15:54:52.956836+0000","last_unstale":"2024-09-13T15:54:57.193395+0000","last_undegraded":"2024-09-13T15:54:57.193395+0000","last_fullsized":"2024-09-13T15:54:57.193395+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:06.088700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.639200+0000","last_change":"2024-09-13T15:54:56.970777+0000","last_active":"2024-09-13T15:54:57.639200+0000","last_peered":"2024-09-13T15:54:57.639200+0000","last_clean":"2024-09-13T15:54:57.639200+0000","last_became_active":"2024-09-13T15:54:56.970424+0000","last_became_peered":"2024-09-13T15:54:56.970424+0000","last_unstale":"2024-09-13T15:54:57.639200+0000","last_undegraded":"2024-09-13T15:54:57.639200+0000","last_fullsized":"2024-09-13T15:54:57.639200+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:00.045336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.958914+0000","last_change":"2024-09-13T15:54:52.511776+0000","last_active":"2024-09-13T15:54:56.958914+0000","last_peered":"2024-09-13T15:54:56.958914+0000","last_clean":"2024-09-13T15:54:56.958914+0000","last_became_active":"2024-09-13T15:54:52.511412+0000","last_became_peered":"2024-09-13T15:54:52.511412+0000","last_unstale":"2024-09-13T15:54:56.958914+0000","last_undegraded":"2024-09-13T15:54:56.958914+0000","last_fullsized":"2024-09-13T15:54:56.958914+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:18.162778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.964405+0000","last_change":"2024-09-13T15:54:52.960036+0000","last_active":"2024-09-13T15:54:56.964405+0000","last_peered":"2024-09-13T15:54:56.964405+0000","last_clean":"2024-09-13T15:54:56.964405+0000","last_became_active":"2024-09-13T15:54:52.959736+0000","last_became_peered":"2024-09-13T15:54:52.959736+0000","last_unstale":"2024-09-13T15:54:56.964405+0000","last_undegraded":"2024-09-13T15:54:56.964405+0000","last_fullsized":"2024-09-13T15:54:56.964405+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:20.567295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638665+0000","last_change":"2024-09-13T15:54:56.973334+0000","last_active":"2024-09-13T15:54:57.638665+0000","last_peered":"2024-09-13T15:54:57.638665+0000","last_clean":"2024-09-13T15:54:57.638665+0000","last_became_active":"2024-09-13T15:54:56.973087+0000","last_became_peered":"2024-09-13T15:54:56.973087+0000","last_unstale":"2024-09-13T15:54:57.638665+0000","last_undegraded":"2024-09-13T15:54:57.638665+0000","last_fullsized":"2024-09-13T15:54:57.638665+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:19.727601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953492+0000","last_change":"2024-09-13T15:54:52.955223+0000","last_active":"2024-09-13T15:54:56.953492+0000","last_peered":"2024-09-13T15:54:56.953492+0000","last_clean":"2024-09-13T15:54:56.953492+0000","last_became_active":"2024-09-13T15:54:52.954848+0000","last_became_peered":"2024-09-13T15:54:52.954848+0000","last_unstale":"2024-09-13T15:54:56.953492+0000","last_undegraded":"2024-09-13T15:54:56.953492+0000","last_fullsized":"2024-09-13T15:54:56.953492+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:36.921666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:14.250552+0000","last_change":"2024-09-13T15:54:52.513484+0000","last_active":"2024-09-13T15:55:14.250552+0000","last_peered":"2024-09-13T15:55:14.250552+0000","last_clean":"2024-09-13T15:55:14.250552+0000","last_became_active":"2024-09-13T15:54:52.513143+0000","last_became_peered":"2024-09-13T15:54:52.513143+0000","last_unstale":"2024-09-13T15:55:14.250552+0000","last_undegraded":"2024-09-13T15:55:14.250552+0000","last_fullsized":"2024-09-13T15:55:14.250552+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:31.735280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638860+0000","last_change":"2024-09-13T15:54:57.082924+0000","last_active":"2024-09-13T15:54:57.638860+0000","last_peered":"2024-09-13T15:54:57.638860+0000","last_clean":"2024-09-13T15:54:57.638860+0000","last_became_active":"2024-09-13T15:54:57.082552+0000","last_became_peered":"2024-09-13T15:54:57.082552+0000","last_unstale":"2024-09-13T15:54:57.638860+0000","last_undegraded":"2024-09-13T15:54:57.638860+0000","last_fullsized":"2024-09-13T15:54:57.638860+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:05.144646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.974229+0000","last_change":"2024-09-13T15:54:52.954909+0000","last_active":"2024-09-13T15:54:56.974229+0000","last_peered":"2024-09-13T15:54:56.974229+0000","last_clean":"2024-09-13T15:54:56.974229+0000","last_became_active":"2024-09-13T15:54:52.954639+0000","last_became_peered":"2024-09-13T15:54:52.954639+0000","last_unstale":"2024-09-13T15:54:56.974229+0000","last_undegraded":"2024-09-13T15:54:56.974229+0000","last_fullsized":"2024-09-13T15:54:56.974229+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:35.984856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953421+0000","last_change":"2024-09-13T15:54:52.518709+0000","last_active":"2024-09-13T15:54:56.953421+0000","last_peered":"2024-09-13T15:54:56.953421+0000","last_clean":"2024-09-13T15:54:56.953421+0000","last_became_active":"2024-09-13T15:54:52.518200+0000","last_became_peered":"2024-09-13T15:54:52.518200+0000","last_unstale":"2024-09-13T15:54:56.953421+0000","last_undegraded":"2024-09-13T15:54:56.953421+0000","last_fullsized":"2024-09-13T15:54:56.953421+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:09.438542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.639220+0000","last_change":"2024-09-13T15:54:56.963815+0000","last_active":"2024-09-13T15:54:57.639220+0000","last_peered":"2024-09-13T15:54:57.639220+0000","last_clean":"2024-09-13T15:54:57.639220+0000","last_became_active":"2024-09-13T15:54:56.963311+0000","last_became_peered":"2024-09-13T15:54:56.963311+0000","last_unstale":"2024-09-13T15:54:57.639220+0000","last_undegraded":"2024-09-13T15:54:57.639220+0000","last_fullsized":"2024-09-13T15:54:57.639220+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:56.464599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.958683+0000","last_change":"2024-09-13T15:54:52.963277+0000","last_active":"2024-09-13T15:54:56.958683+0000","last_peered":"2024-09-13T15:54:56.958683+0000","last_clean":"2024-09-13T15:54:56.958683+0000","last_became_active":"2024-09-13T15:54:52.962941+0000","last_became_peered":"2024-09-13T15:54:52.962941+0000","last_unstale":"2024-09-13T15:54:56.958683+0000","last_undegraded":"2024-09-13T15:54:56.958683+0000","last_fullsized":"2024-09-13T15:54:56.958683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:11.843307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:14.252778+0000","last_change":"2024-09-13T15:54:52.518703+0000","last_active":"2024-09-13T15:55:14.252778+0000","last_peered":"2024-09-13T15:55:14.252778+0000","last_clean":"2024-09-13T15:55:14.252778+0000","last_became_active":"2024-09-13T15:54:52.518384+0000","last_became_peered":"2024-09-13T15:54:52.518384+0000","last_unstale":"2024-09-13T15:55:14.252778+0000","last_undegraded":"2024-09-13T15:55:14.252778+0000","last_fullsized":"2024-09-13T15:55:14.252778+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:39:48.117161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.607534+0000","last_change":"2024-09-13T15:54:56.977372+0000","last_active":"2024-09-13T15:54:57.607534+0000","last_peered":"2024-09-13T15:54:57.607534+0000","last_clean":"2024-09-13T15:54:57.607534+0000","last_became_active":"2024-09-13T15:54:56.976980+0000","last_became_peered":"2024-09-13T15:54:56.976980+0000","last_unstale":"2024-09-13T15:54:57.607534+0000","last_undegraded":"2024-09-13T15:54:57.607534+0000","last_fullsized":"2024-09-13T15:54:57.607534+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:51.597228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.958158+0000","last_change":"2024-09-13T15:54:52.958598+0000","last_active":"2024-09-13T15:54:56.958158+0000","last_peered":"2024-09-13T15:54:56.958158+0000","last_clean":"2024-09-13T15:54:56.958158+0000","last_became_active":"2024-09-13T15:54:52.958272+0000","last_became_peered":"2024-09-13T15:54:52.958272+0000","last_unstale":"2024-09-13T15:54:56.958158+0000","last_undegraded":"2024-09-13T15:54:56.958158+0000","last_fullsized":"2024-09-13T15:54:56.958158+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:28.174228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:14.250463+0000","last_change":"2024-09-13T15:54:52.507028+0000","last_active":"2024-09-13T15:55:14.250463+0000","last_peered":"2024-09-13T15:55:14.250463+0000","last_clean":"2024-09-13T15:55:14.250463+0000","last_became_active":"2024-09-13T15:54:52.506229+0000","last_became_peered":"2024-09-13T15:54:52.506229+0000","last_unstale":"2024-09-13T15:55:14.250463+0000","last_undegraded":"2024-09-13T15:55:14.250463+0000","last_fullsized":"2024-09-13T15:55:14.250463+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:35:02.793140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638892+0000","last_change":"2024-09-13T15:54:57.084002+0000","last_active":"2024-09-13T15:54:57.638892+0000","last_peered":"2024-09-13T15:54:57.638892+0000","last_clean":"2024-09-13T15:54:57.638892+0000","last_became_active":"2024-09-13T15:54:57.083597+0000","last_became_peered":"2024-09-13T15:54:57.083597+0000","last_unstale":"2024-09-13T15:54:57.638892+0000","last_undegraded":"2024-09-13T15:54:57.638892+0000","last_fullsized":"2024-09-13T15:54:57.638892+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:12.137510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.973821+0000","last_change":"2024-09-13T15:54:52.961897+0000","last_active":"2024-09-13T15:54:56.973821+0000","last_peered":"2024-09-13T15:54:56.973821+0000","last_clean":"2024-09-13T15:54:56.973821+0000","last_became_active":"2024-09-13T15:54:52.957467+0000","last_became_peered":"2024-09-13T15:54:52.957467+0000","last_unstale":"2024-09-13T15:54:56.973821+0000","last_undegraded":"2024-09-13T15:54:56.973821+0000","last_fullsized":"2024-09-13T15:54:56.973821+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:57:04.150561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:14.250859+0000","last_change":"2024-09-13T15:54:52.507564+0000","last_active":"2024-09-13T15:55:14.250859+0000","last_peered":"2024-09-13T15:55:14.250859+0000","last_clean":"2024-09-13T15:55:14.250859+0000","last_became_active":"2024-09-13T15:54:52.507267+0000","last_became_peered":"2024-09-13T15:54:52.507267+0000","last_unstale":"2024-09-13T15:55:14.250859+0000","last_undegraded":"2024-09-13T15:55:14.250859+0000","last_fullsized":"2024-09-13T15:55:14.250859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:56.093402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638866+0000","last_change":"2024-09-13T15:54:56.961499+0000","last_active":"2024-09-13T15:54:57.638866+0000","last_peered":"2024-09-13T15:54:57.638866+0000","last_clean":"2024-09-13T15:54:57.638866+0000","last_became_active":"2024-09-13T15:54:56.961032+0000","last_became_peered":"2024-09-13T15:54:56.961032+0000","last_unstale":"2024-09-13T15:54:57.638866+0000","last_undegraded":"2024-09-13T15:54:57.638866+0000","last_fullsized":"2024-09-13T15:54:57.638866+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:28.937286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.978166+0000","last_change":"2024-09-13T15:54:52.951517+0000","last_active":"2024-09-13T15:54:56.978166+0000","last_peered":"2024-09-13T15:54:56.978166+0000","last_clean":"2024-09-13T15:54:56.978166+0000","last_became_active":"2024-09-13T15:54:52.951205+0000","last_became_peered":"2024-09-13T15:54:52.951205+0000","last_unstale":"2024-09-13T15:54:56.978166+0000","last_undegraded":"2024-09-13T15:54:56.978166+0000","last_fullsized":"2024-09-13T15:54:56.978166+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:36.936826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'1","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.607505+0000","last_change":"2024-09-13T15:54:52.518580+0000","last_active":"2024-09-13T15:54:57.607505+0000","last_peered":"2024-09-13T15:54:57.607505+0000","last_clean":"2024-09-13T15:54:57.607505+0000","last_became_active":"2024-09-13T15:54:52.518277+0000","last_became_peered":"2024-09-13T15:54:52.518277+0000","last_unstale":"2024-09-13T15:54:57.607505+0000","last_undegraded":"2024-09-13T15:54:57.607505+0000","last_fullsized":"2024-09-13T15:54:57.607505+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:10.842369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.084691+0000","last_change":"2024-09-13T15:54:57.082786+0000","last_active":"2024-09-13T15:54:57.084691+0000","last_peered":"2024-09-13T15:54:57.084691+0000","last_clean":"2024-09-13T15:54:57.084691+0000","last_became_active":"2024-09-13T15:54:57.082357+0000","last_became_peered":"2024-09-13T15:54:57.082357+0000","last_unstale":"2024-09-13T15:54:57.084691+0000","last_undegraded":"2024-09-13T15:54:57.084691+0000","last_fullsized":"2024-09-13T15:54:57.084691+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:40.867554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.968622+0000","last_change":"2024-09-13T15:54:52.944433+0000","last_active":"2024-09-13T15:54:56.968622+0000","last_peered":"2024-09-13T15:54:56.968622+0000","last_clean":"2024-09-13T15:54:56.968622+0000","last_became_active":"2024-09-13T15:54:52.943624+0000","last_became_peered":"2024-09-13T15:54:52.943624+0000","last_unstale":"2024-09-13T15:54:56.968622+0000","last_undegraded":"2024-09-13T15:54:56.968622+0000","last_fullsized":"2024-09-13T15:54:56.968622+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:49.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.609406+0000","last_change":"2024-09-13T15:54:52.525629+0000","last_active":"2024-09-13T15:54:57.609406+0000","last_peered":"2024-09-13T15:54:57.609406+0000","last_clean":"2024-09-13T15:54:57.609406+0000","last_became_active":"2024-09-13T15:54:52.525311+0000","last_became_peered":"2024-09-13T15:54:52.525311+0000","last_unstale":"2024-09-13T15:54:57.609406+0000","last_undegraded":"2024-09-13T15:54:57.609406+0000","last_fullsized":"2024-09-13T15:54:57.609406+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:25.856415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638319+0000","last_change":"2024-09-13T15:54:56.971608+0000","last_active":"2024-09-13T15:54:57.638319+0000","last_peered":"2024-09-13T15:54:57.638319+0000","last_clean":"2024-09-13T15:54:57.638319+0000","last_became_active":"2024-09-13T15:54:56.971185+0000","last_became_peered":"2024-09-13T15:54:56.971185+0000","last_unstale":"2024-09-13T15:54:57.638319+0000","last_undegraded":"2024-09-13T15:54:57.638319+0000","last_fullsized":"2024-09-13T15:54:57.638319+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:46.098922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.082000+0000","last_change":"2024-09-13T15:54:52.958843+0000","last_active":"2024-09-13T15:54:57.082000+0000","last_peered":"2024-09-13T15:54:57.082000+0000","last_clean":"2024-09-13T15:54:57.082000+0000","last_became_active":"2024-09-13T15:54:52.958534+0000","last_became_peered":"2024-09-13T15:54:52.958534+0000","last_unstale":"2024-09-13T15:54:57.082000+0000","last_undegraded":"2024-09-13T15:54:57.082000+0000","last_fullsized":"2024-09-13T15:54:57.082000+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:34.721886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.952874+0000","last_change":"2024-09-13T15:54:52.524043+0000","last_active":"2024-09-13T15:54:56.952874+0000","last_peered":"2024-09-13T15:54:56.952874+0000","last_clean":"2024-09-13T15:54:56.952874+0000","last_became_active":"2024-09-13T15:54:52.523681+0000","last_became_peered":"2024-09-13T15:54:52.523681+0000","last_unstale":"2024-09-13T15:54:56.952874+0000","last_undegraded":"2024-09-13T15:54:56.952874+0000","last_fullsized":"2024-09-13T15:54:56.952874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:21.164458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.083542+0000","last_change":"2024-09-13T15:54:57.083066+0000","last_active":"2024-09-13T15:54:57.083542+0000","last_peered":"2024-09-13T15:54:57.083542+0000","last_clean":"2024-09-13T15:54:57.083542+0000","last_became_active":"2024-09-13T15:54:57.082664+0000","last_became_peered":"2024-09-13T15:54:57.082664+0000","last_unstale":"2024-09-13T15:54:57.083542+0000","last_undegraded":"2024-09-13T15:54:57.083542+0000","last_fullsized":"2024-09-13T15:54:57.083542+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:54.872482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.081889+0000","last_change":"2024-09-13T15:54:52.957428+0000","last_active":"2024-09-13T15:54:57.081889+0000","last_peered":"2024-09-13T15:54:57.081889+0000","last_clean":"2024-09-13T15:54:57.081889+0000","last_became_active":"2024-09-13T15:54:52.957121+0000","last_became_peered":"2024-09-13T15:54:52.957121+0000","last_unstale":"2024-09-13T15:54:57.081889+0000","last_undegraded":"2024-09-13T15:54:57.081889+0000","last_fullsized":"2024-09-13T15:54:57.081889+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:40.821503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.639861+0000","last_change":"2024-09-13T15:54:52.509101+0000","last_active":"2024-09-13T15:54:57.639861+0000","last_peered":"2024-09-13T15:54:57.639861+0000","last_clean":"2024-09-13T15:54:57.639861+0000","last_became_active":"2024-09-13T15:54:52.508808+0000","last_became_peered":"2024-09-13T15:54:52.508808+0000","last_unstale":"2024-09-13T15:54:57.639861+0000","last_undegraded":"2024-09-13T15:54:57.639861+0000","last_fullsized":"2024-09-13T15:54:57.639861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.181340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.388014+0000","last_change":"2024-09-13T15:54:56.976153+0000","last_active":"2024-09-13T15:54:57.388014+0000","last_peered":"2024-09-13T15:54:57.388014+0000","last_clean":"2024-09-13T15:54:57.388014+0000","last_became_active":"2024-09-13T15:54:56.975727+0000","last_became_peered":"2024-09-13T15:54:56.975727+0000","last_unstale":"2024-09-13T15:54:57.388014+0000","last_undegraded":"2024-09-13T15:54:57.388014+0000","last_fullsized":"2024-09-13T15:54:57.388014+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:12:19.431484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.962808+0000","last_change":"2024-09-13T15:54:52.958321+0000","last_active":"2024-09-13T15:54:56.962808+0000","last_peered":"2024-09-13T15:54:56.962808+0000","last_clean":"2024-09-13T15:54:56.962808+0000","last_became_active":"2024-09-13T15:54:52.958030+0000","last_became_peered":"2024-09-13T15:54:52.958030+0000","last_unstale":"2024-09-13T15:54:56.962808+0000","last_undegraded":"2024-09-13T15:54:56.962808+0000","last_fullsized":"2024-09-13T15:54:56.962808+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:15.159807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:16.263980+0000","last_change":"2024-09-13T15:54:52.519475+0000","last_active":"2024-09-13T15:55:16.263980+0000","last_peered":"2024-09-13T15:55:16.263980+0000","last_clean":"2024-09-13T15:55:16.263980+0000","last_became_active":"2024-09-13T15:54:52.519144+0000","last_became_peered":"2024-09-13T15:54:52.519144+0000","last_unstale":"2024-09-13T15:55:16.263980+0000","last_undegraded":"2024-09-13T15:55:16.263980+0000","last_fullsized":"2024-09-13T15:55:16.263980+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:07.085691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.388257+0000","last_change":"2024-09-13T15:54:57.083036+0000","last_active":"2024-09-13T15:54:57.388257+0000","last_peered":"2024-09-13T15:54:57.388257+0000","last_clean":"2024-09-13T15:54:57.388257+0000","last_became_active":"2024-09-13T15:54:57.082577+0000","last_became_peered":"2024-09-13T15:54:57.082577+0000","last_unstale":"2024-09-13T15:54:57.388257+0000","last_undegraded":"2024-09-13T15:54:57.388257+0000","last_fullsized":"2024-09-13T15:54:57.388257+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:06.309671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.960549+0000","last_change":"2024-09-13T15:54:52.950494+0000","last_active":"2024-09-13T15:54:56.960549+0000","last_peered":"2024-09-13T15:54:56.960549+0000","last_clean":"2024-09-13T15:54:56.960549+0000","last_became_active":"2024-09-13T15:54:52.950160+0000","last_became_peered":"2024-09-13T15:54:52.950160+0000","last_unstale":"2024-09-13T15:54:56.960549+0000","last_undegraded":"2024-09-13T15:54:56.960549+0000","last_fullsized":"2024-09-13T15:54:56.960549+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:59.070083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:15.254559+0000","last_change":"2024-09-13T15:54:52.511717+0000","last_active":"2024-09-13T15:55:15.254559+0000","last_peered":"2024-09-13T15:55:15.254559+0000","last_clean":"2024-09-13T15:55:15.254559+0000","last_became_active":"2024-09-13T15:54:52.511421+0000","last_became_peered":"2024-09-13T15:54:52.511421+0000","last_unstale":"2024-09-13T15:55:15.254559+0000","last_undegraded":"2024-09-13T15:55:15.254559+0000","last_fullsized":"2024-09-13T15:55:15.254559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:30:03.037852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.388030+0000","last_change":"2024-09-13T15:54:57.083707+0000","last_active":"2024-09-13T15:54:57.388030+0000","last_peered":"2024-09-13T15:54:57.388030+0000","last_clean":"2024-09-13T15:54:57.388030+0000","last_became_active":"2024-09-13T15:54:57.083351+0000","last_became_peered":"2024-09-13T15:54:57.083351+0000","last_unstale":"2024-09-13T15:54:57.388030+0000","last_undegraded":"2024-09-13T15:54:57.388030+0000","last_fullsized":"2024-09-13T15:54:57.388030+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:42.058114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.974237+0000","last_change":"2024-09-13T15:54:52.955696+0000","last_active":"2024-09-13T15:54:56.974237+0000","last_peered":"2024-09-13T15:54:56.974237+0000","last_clean":"2024-09-13T15:54:56.974237+0000","last_became_active":"2024-09-13T15:54:52.955271+0000","last_became_peered":"2024-09-13T15:54:52.955271+0000","last_unstale":"2024-09-13T15:54:56.974237+0000","last_undegraded":"2024-09-13T15:54:56.974237+0000","last_fullsized":"2024-09-13T15:54:56.974237+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:16.904541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:14.251973+0000","last_change":"2024-09-13T15:54:52.507152+0000","last_active":"2024-09-13T15:55:14.251973+0000","last_peered":"2024-09-13T15:55:14.251973+0000","last_clean":"2024-09-13T15:55:14.251973+0000","last_became_active":"2024-09-13T15:54:52.506805+0000","last_became_peered":"2024-09-13T15:54:52.506805+0000","last_unstale":"2024-09-13T15:55:14.251973+0000","last_undegraded":"2024-09-13T15:55:14.251973+0000","last_fullsized":"2024-09-13T15:55:14.251973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:51.221341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":329,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953229+0000","last_change":"2024-09-13T15:53:37.322379+0000","last_active":"2024-09-13T15:54:56.953229+0000","last_peered":"2024-09-13T15:54:56.953229+0000","last_clean":"2024-09-13T15:54:56.953229+0000","last_became_active":"2024-09-13T15:53:37.321987+0000","last_became_peered":"2024-09-13T15:53:37.321987+0000","last_unstale":"2024-09-13T15:54:56.953229+0000","last_undegraded":"2024-09-13T15:54:56.953229+0000","last_fullsized":"2024-09-13T15:54:56.953229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:50:10.707150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:50:10.707150+0000","last_clean_scrub_stamp":"2024-09-13T15:50:10.707150+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:16.244946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.965375+0000","last_change":"2024-09-13T15:54:56.964729+0000","last_active":"2024-09-13T15:54:56.965375+0000","last_peered":"2024-09-13T15:54:56.965375+0000","last_clean":"2024-09-13T15:54:56.965375+0000","last_became_active":"2024-09-13T15:54:56.964385+0000","last_became_peered":"2024-09-13T15:54:56.964385+0000","last_unstale":"2024-09-13T15:54:56.965375+0000","last_undegraded":"2024-09-13T15:54:56.965375+0000","last_fullsized":"2024-09-13T15:54:56.965375+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:11.884248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953691+0000","last_change":"2024-09-13T15:54:52.960069+0000","last_active":"2024-09-13T15:54:56.953691+0000","last_peered":"2024-09-13T15:54:56.953691+0000","last_clean":"2024-09-13T15:54:56.953691+0000","last_became_active":"2024-09-13T15:54:52.959762+0000","last_became_peered":"2024-09-13T15:54:52.959762+0000","last_unstale":"2024-09-13T15:54:56.953691+0000","last_undegraded":"2024-09-13T15:54:56.953691+0000","last_fullsized":"2024-09-13T15:54:56.953691+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:18.506596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953961+0000","last_change":"2024-09-13T15:54:52.524137+0000","last_active":"2024-09-13T15:54:56.953961+0000","last_peered":"2024-09-13T15:54:56.953961+0000","last_clean":"2024-09-13T15:54:56.953961+0000","last_became_active":"2024-09-13T15:54:52.523781+0000","last_became_peered":"2024-09-13T15:54:52.523781+0000","last_unstale":"2024-09-13T15:54:56.953961+0000","last_undegraded":"2024-09-13T15:54:56.953961+0000","last_fullsized":"2024-09-13T15:54:56.953961+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:04.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.193371+0000","last_change":"2024-09-13T15:54:56.967557+0000","last_active":"2024-09-13T15:54:57.193371+0000","last_peered":"2024-09-13T15:54:57.193371+0000","last_clean":"2024-09-13T15:54:57.193371+0000","last_became_active":"2024-09-13T15:54:56.967190+0000","last_became_peered":"2024-09-13T15:54:56.967190+0000","last_unstale":"2024-09-13T15:54:57.193371+0000","last_undegraded":"2024-09-13T15:54:57.193371+0000","last_fullsized":"2024-09-13T15:54:57.193371+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:45.630557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953260+0000","last_change":"2024-09-13T15:54:52.955587+0000","last_active":"2024-09-13T15:54:56.953260+0000","last_peered":"2024-09-13T15:54:56.953260+0000","last_clean":"2024-09-13T15:54:56.953260+0000","last_became_active":"2024-09-13T15:54:52.955270+0000","last_became_peered":"2024-09-13T15:54:52.955270+0000","last_unstale":"2024-09-13T15:54:56.953260+0000","last_undegraded":"2024-09-13T15:54:56.953260+0000","last_fullsized":"2024-09-13T15:54:56.953260+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:59.425468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.964523+0000","last_change":"2024-09-13T15:54:52.518617+0000","last_active":"2024-09-13T15:54:56.964523+0000","last_peered":"2024-09-13T15:54:56.964523+0000","last_clean":"2024-09-13T15:54:56.964523+0000","last_became_active":"2024-09-13T15:54:52.518292+0000","last_became_peered":"2024-09-13T15:54:52.518292+0000","last_unstale":"2024-09-13T15:54:56.964523+0000","last_undegraded":"2024-09-13T15:54:56.964523+0000","last_fullsized":"2024-09-13T15:54:56.964523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:06.890484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638470+0000","last_change":"2024-09-13T15:54:56.978521+0000","last_active":"2024-09-13T15:54:57.638470+0000","last_peered":"2024-09-13T15:54:57.638470+0000","last_clean":"2024-09-13T15:54:57.638470+0000","last_became_active":"2024-09-13T15:54:56.977938+0000","last_became_peered":"2024-09-13T15:54:56.977938+0000","last_unstale":"2024-09-13T15:54:57.638470+0000","last_undegraded":"2024-09-13T15:54:57.638470+0000","last_fullsized":"2024-09-13T15:54:57.638470+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:26.251881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953394+0000","last_change":"2024-09-13T15:54:52.954992+0000","last_active":"2024-09-13T15:54:56.953394+0000","last_peered":"2024-09-13T15:54:56.953394+0000","last_clean":"2024-09-13T15:54:56.953394+0000","last_became_active":"2024-09-13T15:54:52.954646+0000","last_became_peered":"2024-09-13T15:54:52.954646+0000","last_unstale":"2024-09-13T15:54:56.953394+0000","last_undegraded":"2024-09-13T15:54:56.953394+0000","last_fullsized":"2024-09-13T15:54:56.953394+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:28.362703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.968985+0000","last_change":"2024-09-13T15:54:52.509976+0000","last_active":"2024-09-13T15:54:56.968985+0000","last_peered":"2024-09-13T15:54:56.968985+0000","last_clean":"2024-09-13T15:54:56.968985+0000","last_became_active":"2024-09-13T15:54:52.509669+0000","last_became_peered":"2024-09-13T15:54:52.509669+0000","last_unstale":"2024-09-13T15:54:56.968985+0000","last_undegraded":"2024-09-13T15:54:56.968985+0000","last_fullsized":"2024-09-13T15:54:56.968985+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:06:02.622401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.387673+0000","last_change":"2024-09-13T15:54:56.966090+0000","last_active":"2024-09-13T15:54:57.387673+0000","last_peered":"2024-09-13T15:54:57.387673+0000","last_clean":"2024-09-13T15:54:57.387673+0000","last_became_active":"2024-09-13T15:54:56.965671+0000","last_became_peered":"2024-09-13T15:54:56.965671+0000","last_unstale":"2024-09-13T15:54:57.387673+0000","last_undegraded":"2024-09-13T15:54:57.387673+0000","last_fullsized":"2024-09-13T15:54:57.387673+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:20.318451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.958900+0000","last_change":"2024-09-13T15:54:52.964008+0000","last_active":"2024-09-13T15:54:56.958900+0000","last_peered":"2024-09-13T15:54:56.958900+0000","last_clean":"2024-09-13T15:54:56.958900+0000","last_became_active":"2024-09-13T15:54:52.963667+0000","last_became_peered":"2024-09-13T15:54:52.963667+0000","last_unstale":"2024-09-13T15:54:56.958900+0000","last_undegraded":"2024-09-13T15:54:56.958900+0000","last_fullsized":"2024-09-13T15:54:56.958900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:25:09.911005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.959148+0000","last_change":"2024-09-13T15:54:52.512258+0000","last_active":"2024-09-13T15:54:56.959148+0000","last_peered":"2024-09-13T15:54:56.959148+0000","last_clean":"2024-09-13T15:54:56.959148+0000","last_became_active":"2024-09-13T15:54:52.511585+0000","last_became_peered":"2024-09-13T15:54:52.511585+0000","last_unstale":"2024-09-13T15:54:56.959148+0000","last_undegraded":"2024-09-13T15:54:56.959148+0000","last_fullsized":"2024-09-13T15:54:56.959148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:41.717042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.387827+0000","last_change":"2024-09-13T15:54:56.975391+0000","last_active":"2024-09-13T15:54:57.387827+0000","last_peered":"2024-09-13T15:54:57.387827+0000","last_clean":"2024-09-13T15:54:57.387827+0000","last_became_active":"2024-09-13T15:54:56.975110+0000","last_became_peered":"2024-09-13T15:54:56.975110+0000","last_unstale":"2024-09-13T15:54:57.387827+0000","last_undegraded":"2024-09-13T15:54:57.387827+0000","last_fullsized":"2024-09-13T15:54:57.387827+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:41.001352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.963134+0000","last_change":"2024-09-13T15:54:52.962697+0000","last_active":"2024-09-13T15:54:56.963134+0000","last_peered":"2024-09-13T15:54:56.963134+0000","last_clean":"2024-09-13T15:54:56.963134+0000","last_became_active":"2024-09-13T15:54:52.962202+0000","last_became_peered":"2024-09-13T15:54:52.962202+0000","last_unstale":"2024-09-13T15:54:56.963134+0000","last_undegraded":"2024-09-13T15:54:56.963134+0000","last_fullsized":"2024-09-13T15:54:56.963134+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:18.993166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:15.257318+0000","last_change":"2024-09-13T15:54:52.522834+0000","last_active":"2024-09-13T15:55:15.257318+0000","last_peered":"2024-09-13T15:55:15.257318+0000","last_clean":"2024-09-13T15:55:15.257318+0000","last_became_active":"2024-09-13T15:54:52.522537+0000","last_became_peered":"2024-09-13T15:54:52.522537+0000","last_unstale":"2024-09-13T15:55:15.257318+0000","last_undegraded":"2024-09-13T15:55:15.257318+0000","last_fullsized":"2024-09-13T15:55:15.257318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:44.616636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.388210+0000","last_change":"2024-09-13T15:54:56.979994+0000","last_active":"2024-09-13T15:54:57.388210+0000","last_peered":"2024-09-13T15:54:57.388210+0000","last_clean":"2024-09-13T15:54:57.388210+0000","last_became_active":"2024-09-13T15:54:56.979586+0000","last_became_peered":"2024-09-13T15:54:56.979586+0000","last_unstale":"2024-09-13T15:54:57.388210+0000","last_undegraded":"2024-09-13T15:54:57.388210+0000","last_fullsized":"2024-09-13T15:54:57.388210+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:17.364566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953132+0000","last_change":"2024-09-13T15:54:52.952927+0000","last_active":"2024-09-13T15:54:56.953132+0000","last_peered":"2024-09-13T15:54:56.953132+0000","last_clean":"2024-09-13T15:54:56.953132+0000","last_became_active":"2024-09-13T15:54:52.952647+0000","last_became_peered":"2024-09-13T15:54:52.952647+0000","last_unstale":"2024-09-13T15:54:56.953132+0000","last_undegraded":"2024-09-13T15:54:56.953132+0000","last_fullsized":"2024-09-13T15:54:56.953132+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:47.085104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:15.253144+0000","last_change":"2024-09-13T15:54:52.502696+0000","last_active":"2024-09-13T15:55:15.253144+0000","last_peered":"2024-09-13T15:55:15.253144+0000","last_clean":"2024-09-13T15:55:15.253144+0000","last_became_active":"2024-09-13T15:54:52.502352+0000","last_became_peered":"2024-09-13T15:54:52.502352+0000","last_unstale":"2024-09-13T15:55:15.253144+0000","last_undegraded":"2024-09-13T15:55:15.253144+0000","last_fullsized":"2024-09-13T15:55:15.253144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:55.899194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.607568+0000","last_change":"2024-09-13T15:54:56.977617+0000","last_active":"2024-09-13T15:54:57.607568+0000","last_peered":"2024-09-13T15:54:57.607568+0000","last_clean":"2024-09-13T15:54:57.607568+0000","last_became_active":"2024-09-13T15:54:56.977250+0000","last_became_peered":"2024-09-13T15:54:56.977250+0000","last_unstale":"2024-09-13T15:54:57.607568+0000","last_undegraded":"2024-09-13T15:54:57.607568+0000","last_fullsized":"2024-09-13T15:54:57.607568+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:59.213043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953295+0000","last_change":"2024-09-13T15:54:52.950419+0000","last_active":"2024-09-13T15:54:56.953295+0000","last_peered":"2024-09-13T15:54:56.953295+0000","last_clean":"2024-09-13T15:54:56.953295+0000","last_became_active":"2024-09-13T15:54:52.950111+0000","last_became_peered":"2024-09-13T15:54:52.950111+0000","last_unstale":"2024-09-13T15:54:56.953295+0000","last_undegraded":"2024-09-13T15:54:56.953295+0000","last_fullsized":"2024-09-13T15:54:56.953295+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:02:14.424589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.962650+0000","last_change":"2024-09-13T15:54:52.520700+0000","last_active":"2024-09-13T15:54:56.962650+0000","last_peered":"2024-09-13T15:54:56.962650+0000","last_clean":"2024-09-13T15:54:56.962650+0000","last_became_active":"2024-09-13T15:54:52.520438+0000","last_became_peered":"2024-09-13T15:54:52.520438+0000","last_unstale":"2024-09-13T15:54:56.962650+0000","last_undegraded":"2024-09-13T15:54:56.962650+0000","last_fullsized":"2024-09-13T15:54:56.962650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:45.740101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638438+0000","last_change":"2024-09-13T15:54:56.971469+0000","last_active":"2024-09-13T15:54:57.638438+0000","last_peered":"2024-09-13T15:54:57.638438+0000","last_clean":"2024-09-13T15:54:57.638438+0000","last_became_active":"2024-09-13T15:54:56.971018+0000","last_became_peered":"2024-09-13T15:54:56.971018+0000","last_unstale":"2024-09-13T15:54:57.638438+0000","last_undegraded":"2024-09-13T15:54:57.638438+0000","last_fullsized":"2024-09-13T15:54:57.638438+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:48.980523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.965932+0000","last_change":"2024-09-13T15:54:52.953776+0000","last_active":"2024-09-13T15:54:56.965932+0000","last_peered":"2024-09-13T15:54:56.965932+0000","last_clean":"2024-09-13T15:54:56.965932+0000","last_became_active":"2024-09-13T15:54:52.950879+0000","last_became_peered":"2024-09-13T15:54:52.950879+0000","last_unstale":"2024-09-13T15:54:56.965932+0000","last_undegraded":"2024-09-13T15:54:56.965932+0000","last_fullsized":"2024-09-13T15:54:56.965932+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:15:12.817499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'2","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953291+0000","last_change":"2024-09-13T15:54:52.519322+0000","last_active":"2024-09-13T15:54:56.953291+0000","last_peered":"2024-09-13T15:54:56.953291+0000","last_clean":"2024-09-13T15:54:56.953291+0000","last_became_active":"2024-09-13T15:54:52.518751+0000","last_became_peered":"2024-09-13T15:54:52.518751+0000","last_unstale":"2024-09-13T15:54:56.953291+0000","last_undegraded":"2024-09-13T15:54:56.953291+0000","last_fullsized":"2024-09-13T15:54:56.953291+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:10.835566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.387971+0000","last_change":"2024-09-13T15:54:56.974091+0000","last_active":"2024-09-13T15:54:57.387971+0000","last_peered":"2024-09-13T15:54:57.387971+0000","last_clean":"2024-09-13T15:54:57.387971+0000","last_became_active":"2024-09-13T15:54:56.973717+0000","last_became_peered":"2024-09-13T15:54:56.973717+0000","last_unstale":"2024-09-13T15:54:57.387971+0000","last_undegraded":"2024-09-13T15:54:57.387971+0000","last_fullsized":"2024-09-13T15:54:57.387971+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:17:22.158270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.959404+0000","last_change":"2024-09-13T15:54:52.954562+0000","last_active":"2024-09-13T15:54:56.959404+0000","last_peered":"2024-09-13T15:54:56.959404+0000","last_clean":"2024-09-13T15:54:56.959404+0000","last_became_active":"2024-09-13T15:54:52.954228+0000","last_became_peered":"2024-09-13T15:54:52.954228+0000","last_unstale":"2024-09-13T15:54:56.959404+0000","last_undegraded":"2024-09-13T15:54:56.959404+0000","last_fullsized":"2024-09-13T15:54:56.959404+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:57.833958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'12","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:14.251176+0000","last_change":"2024-09-13T15:54:52.506559+0000","last_active":"2024-09-13T15:55:14.251176+0000","last_peered":"2024-09-13T15:55:14.251176+0000","last_clean":"2024-09-13T15:55:14.251176+0000","last_became_active":"2024-09-13T15:54:52.506248+0000","last_became_peered":"2024-09-13T15:54:52.506248+0000","last_unstale":"2024-09-13T15:55:14.251176+0000","last_undegraded":"2024-09-13T15:55:14.251176+0000","last_fullsized":"2024-09-13T15:55:14.251176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:13:26.349727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.607057+0000","last_change":"2024-09-13T15:54:56.977311+0000","last_active":"2024-09-13T15:54:57.607057+0000","last_peered":"2024-09-13T15:54:57.607057+0000","last_clean":"2024-09-13T15:54:57.607057+0000","last_became_active":"2024-09-13T15:54:56.972677+0000","last_became_peered":"2024-09-13T15:54:56.972677+0000","last_unstale":"2024-09-13T15:54:57.607057+0000","last_undegraded":"2024-09-13T15:54:57.607057+0000","last_fullsized":"2024-09-13T15:54:57.607057+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:03.162029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.193405+0000","last_change":"2024-09-13T15:54:52.952983+0000","last_active":"2024-09-13T15:54:57.193405+0000","last_peered":"2024-09-13T15:54:57.193405+0000","last_clean":"2024-09-13T15:54:57.193405+0000","last_became_active":"2024-09-13T15:54:52.952710+0000","last_became_peered":"2024-09-13T15:54:52.952710+0000","last_unstale":"2024-09-13T15:54:57.193405+0000","last_undegraded":"2024-09-13T15:54:57.193405+0000","last_fullsized":"2024-09-13T15:54:57.193405+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:07.006629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'3","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.964509+0000","last_change":"2024-09-13T15:54:52.514710+0000","last_active":"2024-09-13T15:54:56.964509+0000","last_peered":"2024-09-13T15:54:56.964509+0000","last_clean":"2024-09-13T15:54:56.964509+0000","last_became_active":"2024-09-13T15:54:52.514377+0000","last_became_peered":"2024-09-13T15:54:52.514377+0000","last_unstale":"2024-09-13T15:54:56.964509+0000","last_undegraded":"2024-09-13T15:54:56.964509+0000","last_fullsized":"2024-09-13T15:54:56.964509+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:07.434722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.639064+0000","last_change":"2024-09-13T15:54:56.963704+0000","last_active":"2024-09-13T15:54:57.639064+0000","last_peered":"2024-09-13T15:54:57.639064+0000","last_clean":"2024-09-13T15:54:57.639064+0000","last_became_active":"2024-09-13T15:54:56.963249+0000","last_became_peered":"2024-09-13T15:54:56.963249+0000","last_unstale":"2024-09-13T15:54:57.639064+0000","last_undegraded":"2024-09-13T15:54:57.639064+0000","last_fullsized":"2024-09-13T15:54:57.639064+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:36.983366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.973760+0000","last_change":"2024-09-13T15:54:52.960772+0000","last_active":"2024-09-13T15:54:56.973760+0000","last_peered":"2024-09-13T15:54:56.973760+0000","last_clean":"2024-09-13T15:54:56.973760+0000","last_became_active":"2024-09-13T15:54:52.957092+0000","last_became_peered":"2024-09-13T15:54:52.957092+0000","last_unstale":"2024-09-13T15:54:56.973760+0000","last_undegraded":"2024-09-13T15:54:56.973760+0000","last_fullsized":"2024-09-13T15:54:56.973760+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:02.563773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:14.251288+0000","last_change":"2024-09-13T15:54:52.507815+0000","last_active":"2024-09-13T15:55:14.251288+0000","last_peered":"2024-09-13T15:55:14.251288+0000","last_clean":"2024-09-13T15:55:14.251288+0000","last_became_active":"2024-09-13T15:54:52.507340+0000","last_became_peered":"2024-09-13T15:54:52.507340+0000","last_unstale":"2024-09-13T15:55:14.251288+0000","last_undegraded":"2024-09-13T15:55:14.251288+0000","last_fullsized":"2024-09-13T15:55:14.251288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:58.896215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.606888+0000","last_change":"2024-09-13T15:54:56.977240+0000","last_active":"2024-09-13T15:54:57.606888+0000","last_peered":"2024-09-13T15:54:57.606888+0000","last_clean":"2024-09-13T15:54:57.606888+0000","last_became_active":"2024-09-13T15:54:56.976848+0000","last_became_peered":"2024-09-13T15:54:56.976848+0000","last_unstale":"2024-09-13T15:54:57.606888+0000","last_undegraded":"2024-09-13T15:54:57.606888+0000","last_fullsized":"2024-09-13T15:54:57.606888+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:48.223930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.193415+0000","last_change":"2024-09-13T15:54:52.956493+0000","last_active":"2024-09-13T15:54:57.193415+0000","last_peered":"2024-09-13T15:54:57.193415+0000","last_clean":"2024-09-13T15:54:57.193415+0000","last_became_active":"2024-09-13T15:54:52.955994+0000","last_became_peered":"2024-09-13T15:54:52.955994+0000","last_unstale":"2024-09-13T15:54:57.193415+0000","last_undegraded":"2024-09-13T15:54:57.193415+0000","last_fullsized":"2024-09-13T15:54:57.193415+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:14.515253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:14.250955+0000","last_change":"2024-09-13T15:54:52.507394+0000","last_active":"2024-09-13T15:55:14.250955+0000","last_peered":"2024-09-13T15:55:14.250955+0000","last_clean":"2024-09-13T15:55:14.250955+0000","last_became_active":"2024-09-13T15:54:52.507104+0000","last_became_peered":"2024-09-13T15:54:52.507104+0000","last_unstale":"2024-09-13T15:55:14.250955+0000","last_undegraded":"2024-09-13T15:55:14.250955+0000","last_fullsized":"2024-09-13T15:55:14.250955+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:57.442678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.974571+0000","last_change":"2024-09-13T15:54:56.971867+0000","last_active":"2024-09-13T15:54:56.974571+0000","last_peered":"2024-09-13T15:54:56.974571+0000","last_clean":"2024-09-13T15:54:56.974571+0000","last_became_active":"2024-09-13T15:54:56.970041+0000","last_became_peered":"2024-09-13T15:54:56.970041+0000","last_unstale":"2024-09-13T15:54:56.974571+0000","last_undegraded":"2024-09-13T15:54:56.974571+0000","last_fullsized":"2024-09-13T15:54:56.974571+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:02.478595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638620+0000","last_change":"2024-09-13T15:54:56.974886+0000","last_active":"2024-09-13T15:54:57.638620+0000","last_peered":"2024-09-13T15:54:57.638620+0000","last_clean":"2024-09-13T15:54:57.638620+0000","last_became_active":"2024-09-13T15:54:56.972879+0000","last_became_peered":"2024-09-13T15:54:56.972879+0000","last_unstale":"2024-09-13T15:54:57.638620+0000","last_undegraded":"2024-09-13T15:54:57.638620+0000","last_fullsized":"2024-09-13T15:54:57.638620+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:59.869941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.952593+0000","last_change":"2024-09-13T15:54:52.956887+0000","last_active":"2024-09-13T15:54:56.952593+0000","last_peered":"2024-09-13T15:54:56.952593+0000","last_clean":"2024-09-13T15:54:56.952593+0000","last_became_active":"2024-09-13T15:54:52.951413+0000","last_became_peered":"2024-09-13T15:54:52.951413+0000","last_unstale":"2024-09-13T15:54:56.952593+0000","last_undegraded":"2024-09-13T15:54:56.952593+0000","last_fullsized":"2024-09-13T15:54:56.952593+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:05.664170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.962884+0000","last_change":"2024-09-13T15:54:52.509235+0000","last_active":"2024-09-13T15:54:56.962884+0000","last_peered":"2024-09-13T15:54:56.962884+0000","last_clean":"2024-09-13T15:54:56.962884+0000","last_became_active":"2024-09-13T15:54:52.508956+0000","last_became_peered":"2024-09-13T15:54:52.508956+0000","last_unstale":"2024-09-13T15:54:56.962884+0000","last_undegraded":"2024-09-13T15:54:56.962884+0000","last_fullsized":"2024-09-13T15:54:56.962884+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:52.884396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638559+0000","last_change":"2024-09-13T15:54:56.979137+0000","last_active":"2024-09-13T15:54:57.638559+0000","last_peered":"2024-09-13T15:54:57.638559+0000","last_clean":"2024-09-13T15:54:57.638559+0000","last_became_active":"2024-09-13T15:54:56.978742+0000","last_became_peered":"2024-09-13T15:54:56.978742+0000","last_unstale":"2024-09-13T15:54:57.638559+0000","last_undegraded":"2024-09-13T15:54:57.638559+0000","last_fullsized":"2024-09-13T15:54:57.638559+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:30.102938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.967109+0000","last_change":"2024-09-13T15:54:52.956422+0000","last_active":"2024-09-13T15:54:56.967109+0000","last_peered":"2024-09-13T15:54:56.967109+0000","last_clean":"2024-09-13T15:54:56.967109+0000","last_became_active":"2024-09-13T15:54:52.956083+0000","last_became_peered":"2024-09-13T15:54:52.956083+0000","last_unstale":"2024-09-13T15:54:56.967109+0000","last_undegraded":"2024-09-13T15:54:56.967109+0000","last_fullsized":"2024-09-13T15:54:56.967109+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:17.057214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:55:15.258364+0000","last_change":"2024-09-13T15:54:52.507204+0000","last_active":"2024-09-13T15:55:15.258364+0000","last_peered":"2024-09-13T15:55:15.258364+0000","last_clean":"2024-09-13T15:55:15.258364+0000","last_became_active":"2024-09-13T15:54:52.506827+0000","last_became_peered":"2024-09-13T15:54:52.506827+0000","last_unstale":"2024-09-13T15:55:15.258364+0000","last_undegraded":"2024-09-13T15:55:15.258364+0000","last_fullsized":"2024-09-13T15:55:15.258364+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:03.960238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.081724+0000","last_change":"2024-09-13T15:54:52.511748+0000","last_active":"2024-09-13T15:54:57.081724+0000","last_peered":"2024-09-13T15:54:57.081724+0000","last_clean":"2024-09-13T15:54:57.081724+0000","last_became_active":"2024-09-13T15:54:52.511252+0000","last_became_peered":"2024-09-13T15:54:52.511252+0000","last_unstale":"2024-09-13T15:54:57.081724+0000","last_undegraded":"2024-09-13T15:54:57.081724+0000","last_fullsized":"2024-09-13T15:54:57.081724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:13.141009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.964398+0000","last_change":"2024-09-13T15:54:52.961880+0000","last_active":"2024-09-13T15:54:56.964398+0000","last_peered":"2024-09-13T15:54:56.964398+0000","last_clean":"2024-09-13T15:54:56.964398+0000","last_became_active":"2024-09-13T15:54:52.961450+0000","last_became_peered":"2024-09-13T15:54:52.961450+0000","last_unstale":"2024-09-13T15:54:56.964398+0000","last_undegraded":"2024-09-13T15:54:56.964398+0000","last_fullsized":"2024-09-13T15:54:56.964398+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:14.060479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.639017+0000","last_change":"2024-09-13T15:54:56.965541+0000","last_active":"2024-09-13T15:54:57.639017+0000","last_peered":"2024-09-13T15:54:57.639017+0000","last_clean":"2024-09-13T15:54:57.639017+0000","last_became_active":"2024-09-13T15:54:56.965185+0000","last_became_peered":"2024-09-13T15:54:56.965185+0000","last_unstale":"2024-09-13T15:54:57.639017+0000","last_undegraded":"2024-09-13T15:54:57.639017+0000","last_fullsized":"2024-09-13T15:54:57.639017+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:38:44.356201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.964441+0000","last_change":"2024-09-13T15:54:52.507878+0000","last_active":"2024-09-13T15:54:56.964441+0000","last_peered":"2024-09-13T15:54:56.964441+0000","last_clean":"2024-09-13T15:54:56.964441+0000","last_became_active":"2024-09-13T15:54:52.507564+0000","last_became_peered":"2024-09-13T15:54:52.507564+0000","last_unstale":"2024-09-13T15:54:56.964441+0000","last_undegraded":"2024-09-13T15:54:56.964441+0000","last_fullsized":"2024-09-13T15:54:56.964441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:55:31.921870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.959733+0000","last_change":"2024-09-13T15:54:52.951596+0000","last_active":"2024-09-13T15:54:56.959733+0000","last_peered":"2024-09-13T15:54:56.959733+0000","last_clean":"2024-09-13T15:54:56.959733+0000","last_became_active":"2024-09-13T15:54:52.951202+0000","last_became_peered":"2024-09-13T15:54:52.951202+0000","last_unstale":"2024-09-13T15:54:56.959733+0000","last_undegraded":"2024-09-13T15:54:56.959733+0000","last_fullsized":"2024-09-13T15:54:56.959733+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:04.421318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.638921+0000","last_change":"2024-09-13T15:54:56.964449+0000","last_active":"2024-09-13T15:54:57.638921+0000","last_peered":"2024-09-13T15:54:57.638921+0000","last_clean":"2024-09-13T15:54:57.638921+0000","last_became_active":"2024-09-13T15:54:56.964025+0000","last_became_peered":"2024-09-13T15:54:56.964025+0000","last_unstale":"2024-09-13T15:54:57.638921+0000","last_undegraded":"2024-09-13T15:54:57.638921+0000","last_fullsized":"2024-09-13T15:54:57.638921+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:06.337648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.958576+0000","last_change":"2024-09-13T15:54:52.953460+0000","last_active":"2024-09-13T15:54:56.958576+0000","last_peered":"2024-09-13T15:54:56.958576+0000","last_clean":"2024-09-13T15:54:56.958576+0000","last_became_active":"2024-09-13T15:54:52.953112+0000","last_became_peered":"2024-09-13T15:54:52.953112+0000","last_unstale":"2024-09-13T15:54:56.958576+0000","last_undegraded":"2024-09-13T15:54:56.958576+0000","last_fullsized":"2024-09-13T15:54:56.958576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:56.676237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953893+0000","last_change":"2024-09-13T15:54:52.955844+0000","last_active":"2024-09-13T15:54:56.953893+0000","last_peered":"2024-09-13T15:54:56.953893+0000","last_clean":"2024-09-13T15:54:56.953893+0000","last_became_active":"2024-09-13T15:54:52.954217+0000","last_became_peered":"2024-09-13T15:54:52.954217+0000","last_unstale":"2024-09-13T15:54:56.953893+0000","last_undegraded":"2024-09-13T15:54:56.953893+0000","last_fullsized":"2024-09-13T15:54:56.953893+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:21.601680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953302+0000","last_change":"2024-09-13T15:54:52.950686+0000","last_active":"2024-09-13T15:54:56.953302+0000","last_peered":"2024-09-13T15:54:56.953302+0000","last_clean":"2024-09-13T15:54:56.953302+0000","last_became_active":"2024-09-13T15:54:52.950380+0000","last_became_peered":"2024-09-13T15:54:52.950380+0000","last_unstale":"2024-09-13T15:54:56.953302+0000","last_undegraded":"2024-09-13T15:54:56.953302+0000","last_fullsized":"2024-09-13T15:54:56.953302+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:44.181584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.965595+0000","last_change":"2024-09-13T15:54:52.956522+0000","last_active":"2024-09-13T15:54:56.965595+0000","last_peered":"2024-09-13T15:54:56.965595+0000","last_clean":"2024-09-13T15:54:56.965595+0000","last_became_active":"2024-09-13T15:54:52.956243+0000","last_became_peered":"2024-09-13T15:54:52.956243+0000","last_unstale":"2024-09-13T15:54:56.965595+0000","last_undegraded":"2024-09-13T15:54:56.965595+0000","last_fullsized":"2024-09-13T15:54:56.965595+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:50.633743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.968543+0000","last_change":"2024-09-13T15:54:52.951515+0000","last_active":"2024-09-13T15:54:56.968543+0000","last_peered":"2024-09-13T15:54:56.968543+0000","last_clean":"2024-09-13T15:54:56.968543+0000","last_became_active":"2024-09-13T15:54:52.951244+0000","last_became_peered":"2024-09-13T15:54:52.951244+0000","last_unstale":"2024-09-13T15:54:56.968543+0000","last_undegraded":"2024-09-13T15:54:56.968543+0000","last_fullsized":"2024-09-13T15:54:56.968543+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:30.834271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.959114+0000","last_change":"2024-09-13T15:54:52.951749+0000","last_active":"2024-09-13T15:54:56.959114+0000","last_peered":"2024-09-13T15:54:56.959114+0000","last_clean":"2024-09-13T15:54:56.959114+0000","last_became_active":"2024-09-13T15:54:52.951451+0000","last_became_peered":"2024-09-13T15:54:52.951451+0000","last_unstale":"2024-09-13T15:54:56.959114+0000","last_undegraded":"2024-09-13T15:54:56.959114+0000","last_fullsized":"2024-09-13T15:54:56.959114+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:32.628282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953996+0000","last_change":"2024-09-13T15:54:52.947562+0000","last_active":"2024-09-13T15:54:56.953996+0000","last_peered":"2024-09-13T15:54:56.953996+0000","last_clean":"2024-09-13T15:54:56.953996+0000","last_became_active":"2024-09-13T15:54:52.947246+0000","last_became_peered":"2024-09-13T15:54:52.947246+0000","last_unstale":"2024-09-13T15:54:56.953996+0000","last_undegraded":"2024-09-13T15:54:56.953996+0000","last_fullsized":"2024-09-13T15:54:56.953996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:12.595329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.976584+0000","last_change":"2024-09-13T15:54:52.951597+0000","last_active":"2024-09-13T15:54:56.976584+0000","last_peered":"2024-09-13T15:54:56.976584+0000","last_clean":"2024-09-13T15:54:56.976584+0000","last_became_active":"2024-09-13T15:54:52.951302+0000","last_became_peered":"2024-09-13T15:54:52.951302+0000","last_unstale":"2024-09-13T15:54:56.976584+0000","last_undegraded":"2024-09-13T15:54:56.976584+0000","last_fullsized":"2024-09-13T15:54:56.976584+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:06.638449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.962717+0000","last_change":"2024-09-13T15:54:52.957616+0000","last_active":"2024-09-13T15:54:56.962717+0000","last_peered":"2024-09-13T15:54:56.962717+0000","last_clean":"2024-09-13T15:54:56.962717+0000","last_became_active":"2024-09-13T15:54:52.957290+0000","last_became_peered":"2024-09-13T15:54:52.957290+0000","last_unstale":"2024-09-13T15:54:56.962717+0000","last_undegraded":"2024-09-13T15:54:56.962717+0000","last_fullsized":"2024-09-13T15:54:56.962717+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:40.262838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.971542+0000","last_change":"2024-09-13T15:54:52.947816+0000","last_active":"2024-09-13T15:54:56.971542+0000","last_peered":"2024-09-13T15:54:56.971542+0000","last_clean":"2024-09-13T15:54:56.971542+0000","last_became_active":"2024-09-13T15:54:52.947480+0000","last_became_peered":"2024-09-13T15:54:52.947480+0000","last_unstale":"2024-09-13T15:54:56.971542+0000","last_undegraded":"2024-09-13T15:54:56.971542+0000","last_fullsized":"2024-09-13T15:54:56.971542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:23.643741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.193383+0000","last_change":"2024-09-13T15:54:52.952203+0000","last_active":"2024-09-13T15:54:57.193383+0000","last_peered":"2024-09-13T15:54:57.193383+0000","last_clean":"2024-09-13T15:54:57.193383+0000","last_became_active":"2024-09-13T15:54:52.951913+0000","last_became_peered":"2024-09-13T15:54:52.951913+0000","last_unstale":"2024-09-13T15:54:57.193383+0000","last_undegraded":"2024-09-13T15:54:57.193383+0000","last_fullsized":"2024-09-13T15:54:57.193383+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:18.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.966750+0000","last_change":"2024-09-13T15:54:52.953810+0000","last_active":"2024-09-13T15:54:56.966750+0000","last_peered":"2024-09-13T15:54:56.966750+0000","last_clean":"2024-09-13T15:54:56.966750+0000","last_became_active":"2024-09-13T15:54:52.952774+0000","last_became_peered":"2024-09-13T15:54:52.952774+0000","last_unstale":"2024-09-13T15:54:56.966750+0000","last_undegraded":"2024-09-13T15:54:56.966750+0000","last_fullsized":"2024-09-13T15:54:56.966750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:37.836176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.958988+0000","last_change":"2024-09-13T15:54:52.953545+0000","last_active":"2024-09-13T15:54:56.958988+0000","last_peered":"2024-09-13T15:54:56.958988+0000","last_clean":"2024-09-13T15:54:56.958988+0000","last_became_active":"2024-09-13T15:54:52.953189+0000","last_became_peered":"2024-09-13T15:54:52.953189+0000","last_unstale":"2024-09-13T15:54:56.958988+0000","last_undegraded":"2024-09-13T15:54:56.958988+0000","last_fullsized":"2024-09-13T15:54:56.958988+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:34.130870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.954062+0000","last_change":"2024-09-13T15:54:52.953671+0000","last_active":"2024-09-13T15:54:56.954062+0000","last_peered":"2024-09-13T15:54:56.954062+0000","last_clean":"2024-09-13T15:54:56.954062+0000","last_became_active":"2024-09-13T15:54:52.952550+0000","last_became_peered":"2024-09-13T15:54:52.952550+0000","last_unstale":"2024-09-13T15:54:56.954062+0000","last_undegraded":"2024-09-13T15:54:56.954062+0000","last_fullsized":"2024-09-13T15:54:56.954062+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:48.525059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.952872+0000","last_change":"2024-09-13T15:54:52.951561+0000","last_active":"2024-09-13T15:54:56.952872+0000","last_peered":"2024-09-13T15:54:56.952872+0000","last_clean":"2024-09-13T15:54:56.952872+0000","last_became_active":"2024-09-13T15:54:52.951185+0000","last_became_peered":"2024-09-13T15:54:52.951185+0000","last_unstale":"2024-09-13T15:54:56.952872+0000","last_undegraded":"2024-09-13T15:54:56.952872+0000","last_fullsized":"2024-09-13T15:54:56.952872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:07.698614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.959980+0000","last_change":"2024-09-13T15:54:52.965016+0000","last_active":"2024-09-13T15:54:56.959980+0000","last_peered":"2024-09-13T15:54:56.959980+0000","last_clean":"2024-09-13T15:54:56.959980+0000","last_became_active":"2024-09-13T15:54:52.964684+0000","last_became_peered":"2024-09-13T15:54:52.964684+0000","last_unstale":"2024-09-13T15:54:56.959980+0000","last_undegraded":"2024-09-13T15:54:56.959980+0000","last_fullsized":"2024-09-13T15:54:56.959980+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:28.491075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.193350+0000","last_change":"2024-09-13T15:54:52.953679+0000","last_active":"2024-09-13T15:54:57.193350+0000","last_peered":"2024-09-13T15:54:57.193350+0000","last_clean":"2024-09-13T15:54:57.193350+0000","last_became_active":"2024-09-13T15:54:52.953409+0000","last_became_peered":"2024-09-13T15:54:52.953409+0000","last_unstale":"2024-09-13T15:54:57.193350+0000","last_undegraded":"2024-09-13T15:54:57.193350+0000","last_fullsized":"2024-09-13T15:54:57.193350+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:53.296327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.969167+0000","last_change":"2024-09-13T15:54:52.962219+0000","last_active":"2024-09-13T15:54:56.969167+0000","last_peered":"2024-09-13T15:54:56.969167+0000","last_clean":"2024-09-13T15:54:56.969167+0000","last_became_active":"2024-09-13T15:54:52.957640+0000","last_became_peered":"2024-09-13T15:54:52.957640+0000","last_unstale":"2024-09-13T15:54:56.969167+0000","last_undegraded":"2024-09-13T15:54:56.969167+0000","last_fullsized":"2024-09-13T15:54:56.969167+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:46.162478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.963977+0000","last_change":"2024-09-13T15:54:52.959852+0000","last_active":"2024-09-13T15:54:56.963977+0000","last_peered":"2024-09-13T15:54:56.963977+0000","last_clean":"2024-09-13T15:54:56.963977+0000","last_became_active":"2024-09-13T15:54:52.959495+0000","last_became_peered":"2024-09-13T15:54:52.959495+0000","last_unstale":"2024-09-13T15:54:56.963977+0000","last_undegraded":"2024-09-13T15:54:56.963977+0000","last_fullsized":"2024-09-13T15:54:56.963977+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:31.035977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.966675+0000","last_change":"2024-09-13T15:54:52.954059+0000","last_active":"2024-09-13T15:54:56.966675+0000","last_peered":"2024-09-13T15:54:56.966675+0000","last_clean":"2024-09-13T15:54:56.966675+0000","last_became_active":"2024-09-13T15:54:52.953500+0000","last_became_peered":"2024-09-13T15:54:52.953500+0000","last_unstale":"2024-09-13T15:54:56.966675+0000","last_undegraded":"2024-09-13T15:54:56.966675+0000","last_fullsized":"2024-09-13T15:54:56.966675+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:07.156723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.959450+0000","last_change":"2024-09-13T15:54:52.954236+0000","last_active":"2024-09-13T15:54:56.959450+0000","last_peered":"2024-09-13T15:54:56.959450+0000","last_clean":"2024-09-13T15:54:56.959450+0000","last_became_active":"2024-09-13T15:54:52.951975+0000","last_became_peered":"2024-09-13T15:54:52.951975+0000","last_unstale":"2024-09-13T15:54:56.959450+0000","last_undegraded":"2024-09-13T15:54:56.959450+0000","last_fullsized":"2024-09-13T15:54:56.959450+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:24.261419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953652+0000","last_change":"2024-09-13T15:54:52.960090+0000","last_active":"2024-09-13T15:54:56.953652+0000","last_peered":"2024-09-13T15:54:56.953652+0000","last_clean":"2024-09-13T15:54:56.953652+0000","last_became_active":"2024-09-13T15:54:52.959804+0000","last_became_peered":"2024-09-13T15:54:52.959804+0000","last_unstale":"2024-09-13T15:54:56.953652+0000","last_undegraded":"2024-09-13T15:54:56.953652+0000","last_fullsized":"2024-09-13T15:54:56.953652+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:27.467154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.082125+0000","last_change":"2024-09-13T15:54:52.957541+0000","last_active":"2024-09-13T15:54:57.082125+0000","last_peered":"2024-09-13T15:54:57.082125+0000","last_clean":"2024-09-13T15:54:57.082125+0000","last_became_active":"2024-09-13T15:54:52.957252+0000","last_became_peered":"2024-09-13T15:54:52.957252+0000","last_unstale":"2024-09-13T15:54:57.082125+0000","last_undegraded":"2024-09-13T15:54:57.082125+0000","last_fullsized":"2024-09-13T15:54:57.082125+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.768018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.193426+0000","last_change":"2024-09-13T15:54:52.951048+0000","last_active":"2024-09-13T15:54:57.193426+0000","last_peered":"2024-09-13T15:54:57.193426+0000","last_clean":"2024-09-13T15:54:57.193426+0000","last_became_active":"2024-09-13T15:54:52.948798+0000","last_became_peered":"2024-09-13T15:54:52.948798+0000","last_unstale":"2024-09-13T15:54:57.193426+0000","last_undegraded":"2024-09-13T15:54:57.193426+0000","last_fullsized":"2024-09-13T15:54:57.193426+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:48.081213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.967028+0000","last_change":"2024-09-13T15:54:52.952456+0000","last_active":"2024-09-13T15:54:56.967028+0000","last_peered":"2024-09-13T15:54:56.967028+0000","last_clean":"2024-09-13T15:54:56.967028+0000","last_became_active":"2024-09-13T15:54:52.951983+0000","last_became_peered":"2024-09-13T15:54:52.951983+0000","last_unstale":"2024-09-13T15:54:56.967028+0000","last_undegraded":"2024-09-13T15:54:56.967028+0000","last_fullsized":"2024-09-13T15:54:56.967028+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:06.748567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.953133+0000","last_change":"2024-09-13T15:54:52.950155+0000","last_active":"2024-09-13T15:54:56.953133+0000","last_peered":"2024-09-13T15:54:56.953133+0000","last_clean":"2024-09-13T15:54:56.953133+0000","last_became_active":"2024-09-13T15:54:52.949758+0000","last_became_peered":"2024-09-13T15:54:52.949758+0000","last_unstale":"2024-09-13T15:54:56.953133+0000","last_undegraded":"2024-09-13T15:54:56.953133+0000","last_fullsized":"2024-09-13T15:54:56.953133+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:49.117434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:57.081674+0000","last_change":"2024-09-13T15:54:52.953741+0000","last_active":"2024-09-13T15:54:57.081674+0000","last_peered":"2024-09-13T15:54:57.081674+0000","last_clean":"2024-09-13T15:54:57.081674+0000","last_became_active":"2024-09-13T15:54:52.952648+0000","last_became_peered":"2024-09-13T15:54:52.952648+0000","last_unstale":"2024-09-13T15:54:57.081674+0000","last_undegraded":"2024-09-13T15:54:57.081674+0000","last_fullsized":"2024-09-13T15:54:57.081674+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:56:46.640480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.958642+0000","last_change":"2024-09-13T15:54:52.948822+0000","last_active":"2024-09-13T15:54:56.958642+0000","last_peered":"2024-09-13T15:54:56.958642+0000","last_clean":"2024-09-13T15:54:56.958642+0000","last_became_active":"2024-09-13T15:54:52.948528+0000","last_became_peered":"2024-09-13T15:54:52.948528+0000","last_unstale":"2024-09-13T15:54:56.958642+0000","last_undegraded":"2024-09-13T15:54:56.958642+0000","last_fullsized":"2024-09-13T15:54:56.958642+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:28:25.700799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.959415+0000","last_change":"2024-09-13T15:54:52.950609+0000","last_active":"2024-09-13T15:54:56.959415+0000","last_peered":"2024-09-13T15:54:56.959415+0000","last_clean":"2024-09-13T15:54:56.959415+0000","last_became_active":"2024-09-13T15:54:52.949481+0000","last_became_peered":"2024-09-13T15:54:52.949481+0000","last_unstale":"2024-09-13T15:54:56.959415+0000","last_undegraded":"2024-09-13T15:54:56.959415+0000","last_fullsized":"2024-09-13T15:54:56.959415+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:59.272557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.973230+0000","last_change":"2024-09-13T15:54:52.950857+0000","last_active":"2024-09-13T15:54:56.973230+0000","last_peered":"2024-09-13T15:54:56.973230+0000","last_clean":"2024-09-13T15:54:56.973230+0000","last_became_active":"2024-09-13T15:54:52.948553+0000","last_became_peered":"2024-09-13T15:54:52.948553+0000","last_unstale":"2024-09-13T15:54:56.973230+0000","last_undegraded":"2024-09-13T15:54:56.973230+0000","last_fullsized":"2024-09-13T15:54:56.973230+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:33.644131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.976004+0000","last_change":"2024-09-13T15:54:52.965573+0000","last_active":"2024-09-13T15:54:56.976004+0000","last_peered":"2024-09-13T15:54:56.976004+0000","last_clean":"2024-09-13T15:54:56.976004+0000","last_became_active":"2024-09-13T15:54:52.961538+0000","last_became_peered":"2024-09-13T15:54:52.961538+0000","last_unstale":"2024-09-13T15:54:56.976004+0000","last_undegraded":"2024-09-13T15:54:56.976004+0000","last_fullsized":"2024-09-13T15:54:56.976004+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:12.887939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T15:54:56.959902+0000","last_change":"2024-09-13T15:54:52.964064+0000","last_active":"2024-09-13T15:54:56.959902+0000","last_peered":"2024-09-13T15:54:56.959902+0000","last_clean":"2024-09-13T15:54:56.959902+0000","last_became_active":"2024-09-13T15:54:52.963770+0000","last_became_peered":"2024-09-13T15:54:52.963770+0000","last_unstale":"2024-09-13T15:54:56.959902+0000","last_undegraded":"2024-09-13T15:54:56.959902+0000","last_fullsized":"2024-09-13T15:54:56.959902+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:28.967227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5571,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":99,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":36135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":987136,"data_stored":479614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36043205},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":5.0389999999999997,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65900000000000003}]},{"osd":1,"last update":"Fri Sep 13 15:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.62},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.63500000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Sep 13 15:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60799999999999998}]},{"osd":5,"last update":"Fri Sep 13 15:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47799999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":5.0880000000000001,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.77900000000000003}]},{"osd":7,"last update":"Fri Sep 13 15:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.755},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.67900000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":9,"last update":"Fri Sep 13 15:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.71499999999999997}]},{"osd":10,"last update":"Fri Sep 13 15:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.86799999999999999}]}]},{"osd":10,"up_from":73,"seq":313532612629,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1617920,"data_stored":1074733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.48099999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.629},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.76500000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.56100000000000005}]},{"osd":6,"last update":"Fri Sep 13 15:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.83099999999999996}]},{"osd":7,"last update":"Fri Sep 13 15:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.49299999999999999}]},{"osd":8,"last update":"Fri Sep 13 15:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.72399999999999998}]},{"osd":9,"last update":"Fri Sep 13 15:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.85999999999999999}]},{"osd":11,"last update":"Fri Sep 13 15:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.77900000000000003}]}]},{"osd":9,"up_from":68,"seq":292057776156,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":991232,"data_stored":480196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:55:12 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.438}]},{"osd":1,"last update":"Fri Sep 13 15:55:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.75700000000000001,"15min":0.76700000000000002},"min":{"1min":0.499,"5min":0.443,"15min":0.443},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.64600000000000002,"15min":0.65000000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.57599999999999996}]},{"osd":2,"last update":"Fri Sep 13 15:55:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.81000000000000005,"15min":0.81799999999999995},"min":{"1min":0.47899999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77600000000000002,"15min":0.77900000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.84299999999999997}]},{"osd":3,"last update":"Fri Sep 13 15:55:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0189999999999999,"5min":1.089,"15min":1.089},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.75800000000000001,"15min":0.77600000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.47099999999999997}]},{"osd":4,"last update":"Fri Sep 13 15:55:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.48799999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.754},{"interface":"front","average":{"1min":0.754,"5min":0.83099999999999996,"15min":0.84399999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1819999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Fri Sep 13 15:55:12 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.88700000000000001,"15min":0.90300000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.88500000000000001,"15min":0.89800000000000002},"min":{"1min":0.53900000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.71899999999999997}]},{"osd":6,"last update":"Fri Sep 13 15:54:12 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.0349999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:55:12 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.97199999999999998,"15min":0.99299999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2949999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.93200000000000005,"15min":0.94799999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2769999999999999,"5min":1.325,"15min":1.325},"last":0.79400000000000004}]},{"osd":8,"last update":"Fri Sep 13 15:55:12 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.97799999999999998,"15min":0.99399999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.3859999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.85499999999999998,"15min":0.86699999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.81999999999999995}]},{"osd":10,"last update":"Fri Sep 13 15:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.70999999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]},{"osd":8,"up_from":60,"seq":257698037793,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":480021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80700000000000005,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.432}]},{"osd":1,"last update":"Fri Sep 13 15:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.502,"15min":0.49299999999999999},"min":{"1min":0.34899999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68700000000000006,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.629}]},{"osd":2,"last update":"Fri Sep 13 15:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.52800000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38,"15min":0.376},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.499,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.49399999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.62,"15min":0.623},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.876,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86499999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66200000000000003,"5min":0.754,"15min":0.754},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.58299999999999996}]},{"osd":5,"last update":"Fri Sep 13 15:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.44600000000000001,"15min":0.443},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45200000000000001,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.55900000000000005}]},{"osd":6,"last update":"Fri Sep 13 15:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64500000000000002,"15min":0.63900000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84999999999999998,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.74199999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.45400000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.745,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.60499999999999998}]},{"osd":9,"last update":"Fri Sep 13 15:55:10 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69199999999999995,"15min":0.69599999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.84799999999999998,"5min":0.876,"15min":0.876},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.71399999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.70199999999999996}]},{"osd":10,"last update":"Fri Sep 13 15:54:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.68200000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":7,"up_from":52,"seq":223338299429,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36764,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708388,"statfs":{"total":95995035648,"available":95957389312,"internally_reserved":0,"allocated":1593344,"data_stored":1071347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36043211},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80700000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79400000000000004,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.39600000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38500000000000001,"15min":0.38100000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.42999999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54300000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.504}]},{"osd":3,"last update":"Fri Sep 13 15:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60799999999999998,"15min":0.60299999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.62},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80400000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.65100000000000002}]},{"osd":4,"last update":"Fri Sep 13 15:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.47299999999999998,"15min":0.47999999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.66500000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.41299999999999998}]},{"osd":5,"last update":"Fri Sep 13 15:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Sep 13 15:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.82899999999999996,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88200000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.78800000000000003}]},{"osd":8,"last update":"Fri Sep 13 15:54:42 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.42799999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67400000000000004,"15min":0.67000000000000004},"min":{"1min":0.47099999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.67000000000000004}]},{"osd":9,"last update":"Fri Sep 13 15:55:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70499999999999996,"15min":0.70699999999999996},"min":{"1min":0.50700000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.497,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92800000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.71599999999999997}]},{"osd":10,"last update":"Fri Sep 13 15:54:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.60499999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":6,"up_from":47,"seq":201863462956,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":991232,"data_stored":479704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36043207},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.34599999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72899999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.53200000000000003,"15min":0.54400000000000004},"min":{"1min":0.375,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72899999999999998,"5min":1.008,"15min":1.008},"last":0.35499999999999998}]},{"osd":1,"last update":"Fri Sep 13 15:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66300000000000003,"15min":0.67300000000000004},"min":{"1min":0.48399999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.83699999999999997,"5min":1.113,"15min":1.113},"last":0.624},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.89300000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.69799999999999995,"15min":0.71099999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72799999999999998,"15min":0.72899999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.70799999999999996}]},{"osd":3,"last update":"Fri Sep 13 15:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.42199999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91800000000000004,"5min":1.121,"15min":1.121},"last":0.433},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66900000000000004,"15min":0.67500000000000004},"min":{"1min":0.39100000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.874,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.499}]},{"osd":4,"last update":"Fri Sep 13 15:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.70099999999999996,"15min":0.72699999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.85799999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.748,"15min":0.749},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.79900000000000004}]},{"osd":5,"last update":"Fri Sep 13 15:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.77900000000000003,"15min":0.78400000000000003},"min":{"1min":0.57699999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.99399999999999999,"5min":1.032,"15min":1.032},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.78600000000000003,"15min":0.80800000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0700000000000001,"5min":1.236,"15min":1.236},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Sep 13 15:54:19 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.755,"15min":0.749},"min":{"1min":0.53600000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.77800000000000002,"15min":0.76400000000000001},"min":{"1min":0.629,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.89600000000000002}]},{"osd":8,"last update":"Fri Sep 13 15:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.85699999999999998,"15min":0.86699999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.036,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.63900000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0089999999999999,"5min":1.044,"15min":1.044},"last":0.69099999999999995}]},{"osd":9,"last update":"Fri Sep 13 15:55:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.90000000000000002,"15min":0.92000000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1850000000000001,"5min":1.222,"15min":1.222},"last":0.875},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.89100000000000001,"15min":0.89800000000000002},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.77500000000000002}]},{"osd":10,"last update":"Fri Sep 13 15:54:34 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.91600000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":5,"up_from":39,"seq":167503724591,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28588,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716564,"statfs":{"total":95995035648,"available":95965761536,"internally_reserved":0,"allocated":1593344,"data_stored":1070164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:54:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56599999999999995,"15min":0.54900000000000004},"min":{"1min":0.42799999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.38900000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:54:30 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.497,"15min":0.48999999999999999},"min":{"1min":0.38100000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70699999999999996,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.499,"15min":0.48699999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.63600000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:54:30 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.37,"15min":0.36799999999999999},"min":{"1min":0.26300000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.51200000000000001,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27300000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.56100000000000005,"5min":0.749,"15min":0.749},"last":0.33000000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:54:30 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58699999999999997,"15min":0.59299999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.57899999999999996}]},{"osd":4,"last update":"Fri Sep 13 15:54:30 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54900000000000004,"15min":0.53400000000000003},"min":{"1min":0.432,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.748,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.498},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:54:56 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61099999999999999,"15min":0.60199999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.82499999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81399999999999995,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.65100000000000002}]},{"osd":7,"last update":"Fri Sep 13 15:54:18 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.41799999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.67600000000000005}]},{"osd":8,"last update":"Fri Sep 13 15:54:42 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.51400000000000001,"15min":0.52900000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64700000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.745,"5min":1.024,"15min":1.024},"last":0.59499999999999997}]},{"osd":9,"last update":"Fri Sep 13 15:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.623}]},{"osd":10,"last update":"Fri Sep 13 15:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.71399999999999997}]}]},{"osd":4,"up_from":34,"seq":146028888116,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":991232,"data_stored":479636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:54:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.55000000000000004,"15min":0.53300000000000003},"min":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.83199999999999996,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.41299999999999998}]},{"osd":1,"last update":"Fri Sep 13 15:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.36599999999999999,"15min":0.34899999999999998},"min":{"1min":0.28399999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.371,"15min":0.35699999999999998},"min":{"1min":0.27400000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.439}]},{"osd":2,"last update":"Fri Sep 13 15:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52400000000000002,"15min":0.50800000000000001},"min":{"1min":0.40799999999999997,"5min":0.31,"15min":0.31},"max":{"1min":0.76900000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53200000000000003,"15min":0.52100000000000002},"min":{"1min":0.39000000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.747,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.58499999999999996}]},{"osd":3,"last update":"Fri Sep 13 15:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57499999999999996,"15min":0.55800000000000005},"min":{"1min":0.42799999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.77900000000000003,"5min":0.878,"15min":0.878},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59899999999999998,"15min":0.55900000000000005},"min":{"1min":0.40100000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73399999999999999,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":0.79300000000000004}]},{"osd":5,"last update":"Fri Sep 13 15:54:24 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.56899999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76800000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.443,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83199999999999996,"5min":0.995,"15min":0.995},"last":0.60499999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:54:54 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.625,"15min":0.61599999999999999},"min":{"1min":0.46600000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83499999999999996,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.46100000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.83899999999999997,"5min":0.873,"15min":0.873},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Sep 13 15:54:21 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.53200000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51800000000000002,"15min":0.51400000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.54400000000000004}]},{"osd":8,"last update":"Fri Sep 13 15:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61299999999999999,"15min":0.60999999999999999},"min":{"1min":0.46800000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84399999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.48099999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.63700000000000001}]},{"osd":9,"last update":"Fri Sep 13 15:55:15 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.71499999999999997,"15min":0.72199999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.745},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.71299999999999997,"15min":0.72099999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.77400000000000002}]},{"osd":10,"last update":"Fri Sep 13 15:54:34 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.69099999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]},{"osd":3,"up_from":26,"seq":111669149754,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":995328,"data_stored":479527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.42499999999999999,"15min":0.40400000000000003},"min":{"1min":0.312,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.434,"15min":0.41799999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72499999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.372}]},{"osd":1,"last update":"Fri Sep 13 15:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.63200000000000001,"15min":0.59599999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0249999999999999,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61799999999999999,"15min":0.59199999999999997},"min":{"1min":0.48699999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90800000000000003,"5min":1.345,"15min":1.345},"last":0.82399999999999995}]},{"osd":2,"last update":"Fri Sep 13 15:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63600000000000001,"15min":0.61399999999999999},"min":{"1min":0.441,"5min":0.437,"15min":0.437},"max":{"1min":1.0249999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.438,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96499999999999997,"5min":1.667,"15min":1.667},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Sep 13 15:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66900000000000004,"15min":0.63900000000000001},"min":{"1min":0.47699999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88400000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64800000000000002,"15min":0.622},"min":{"1min":0.48899999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86799999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.69599999999999995}]},{"osd":5,"last update":"Fri Sep 13 15:54:28 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67000000000000004,"15min":0.64400000000000002},"min":{"1min":0.50900000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91600000000000004,"5min":1.357,"15min":1.357},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64200000000000002,"15min":0.626},"min":{"1min":0.47099999999999997,"5min":0.436,"15min":0.436},"max":{"1min":0.88900000000000001,"5min":1.292,"15min":1.292},"last":0.59899999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63500000000000001,"15min":0.629},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.97099999999999997,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.502},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.69599999999999995,"15min":0.70599999999999996},"min":{"1min":0.40100000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.024,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.83599999999999997}]},{"osd":7,"last update":"Fri Sep 13 15:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.78400000000000003,"15min":0.77300000000000002},"min":{"1min":0.59699999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1619999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.55600000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.88100000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.77400000000000002}]},{"osd":8,"last update":"Fri Sep 13 15:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.75600000000000001,"15min":0.753},"min":{"1min":0.54700000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.044,"5min":1.079,"15min":1.079},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.61699999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1899999999999999,"5min":1.466,"15min":1.466},"last":0.83899999999999997}]},{"osd":9,"last update":"Fri Sep 13 15:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.88100000000000001}]},{"osd":10,"last update":"Fri Sep 13 15:54:35 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.80000000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":483443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:54:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.52400000000000002,"15min":0.51700000000000002},"min":{"1min":0.36599999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.35199999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.74199999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.55800000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:54:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.48799999999999999,"15min":0.46600000000000003},"min":{"1min":0.372,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.497,"15min":0.48499999999999999},"min":{"1min":0.32800000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.70399999999999996,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.66000000000000003}]},{"osd":3,"last update":"Fri Sep 13 15:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.54600000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.745,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.81499999999999995,"5min":0.874,"15min":0.874},"last":0.65200000000000002}]},{"osd":4,"last update":"Fri Sep 13 15:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.49099999999999999,"15min":0.47699999999999998},"min":{"1min":0.34499999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.502,"15min":0.49399999999999999},"min":{"1min":0.33700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.60999999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:54:29 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.41399999999999998,"15min":0.40699999999999997},"min":{"1min":0.25800000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.53800000000000003}]},{"osd":6,"last update":"Fri Sep 13 15:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.59499999999999997,"15min":0.58499999999999996},"min":{"1min":0.41399999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.63500000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:54:19 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56200000000000006,"15min":0.55500000000000005},"min":{"1min":0.39900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79800000000000004,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.58099999999999996}]},{"osd":8,"last update":"Fri Sep 13 15:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.35399999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.748}]},{"osd":9,"last update":"Fri Sep 13 15:55:10 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65200000000000002,"15min":0.64900000000000002},"min":{"1min":0.49399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.73499999999999999}]},{"osd":10,"last update":"Fri Sep 13 15:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.78500000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":502436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.51800000000000002,"15min":0.48199999999999998},"min":{"1min":0.317,"5min":0.253,"15min":0.253},"max":{"1min":0.79400000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.505},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.80100000000000005,"5min":1.2,"15min":1.2},"last":0.75700000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:54:23 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.48799999999999999},"min":{"1min":0.37,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.68500000000000005,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.47599999999999998,"15min":0.46800000000000003},"min":{"1min":0.41499999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.69199999999999995,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.78300000000000003}]},{"osd":3,"last update":"Fri Sep 13 15:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.38700000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73399999999999999,"5min":1.087,"15min":1.087},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52800000000000002,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68000000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Sep 13 15:55:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.37},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.76900000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.439},{"interface":"front","average":{"1min":0.496,"5min":0.41799999999999998,"15min":0.39000000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.753,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.37}]},{"osd":5,"last update":"Fri Sep 13 15:54:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.54900000000000004,"15min":0.52700000000000002},"min":{"1min":0.433,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.54600000000000004,"15min":0.52400000000000002},"min":{"1min":0.438,"5min":0.374,"15min":0.374},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.74199999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61899999999999999,"15min":0.60799999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78000000000000003,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85299999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Sep 13 15:54:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.503,"15min":0.5},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.34300000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.626}]},{"osd":8,"last update":"Fri Sep 13 15:54:50 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.67300000000000004,"15min":0.63200000000000001},"min":{"1min":0.46899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":5.2149999999999999,"5min":5.2149999999999999,"15min":5.2149999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.65200000000000002}]},{"osd":9,"last update":"Fri Sep 13 15:55:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0109999999999999,"5min":1.111,"15min":1.111},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.121,"5min":1.325,"15min":1.325},"last":0.72299999999999998}]},{"osd":10,"last update":"Fri Sep 13 15:54:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.499},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.70199999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":479704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63,"15min":0.60599999999999998},"min":{"1min":0.40200000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82299999999999995,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.64500000000000002,"15min":0.59299999999999997},"min":{"1min":0.46700000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86899999999999999,"5min":1.081,"15min":1.081},"last":0.79000000000000004}]},{"osd":2,"last update":"Fri Sep 13 15:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.63600000000000001,"15min":0.59799999999999998},"min":{"1min":0.42799999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.65700000000000003,"15min":0.61499999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.67000000000000004}]},{"osd":3,"last update":"Fri Sep 13 15:53:38 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.49299999999999999,"15min":0.46700000000000003},"min":{"1min":0.36199999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.505,"15min":0.47899999999999998},"min":{"1min":0.377,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.72099999999999997}]},{"osd":4,"last update":"Fri Sep 13 15:55:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64400000000000002,"15min":0.57099999999999995},"min":{"1min":0.42699999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93799999999999994,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61399999999999999,"15min":0.56799999999999995},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89300000000000002,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.73999999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:54:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.65100000000000002,"15min":0.64100000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.93600000000000005,"5min":1.018,"15min":1.018},"last":0.628},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.68300000000000005,"15min":0.66300000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1639999999999999,"5min":1.167,"15min":1.167},"last":0.75800000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64400000000000002,"15min":0.65200000000000002},"min":{"1min":0.35699999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.97099999999999997,"5min":1.151,"15min":1.151},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.40300000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92000000000000004,"5min":1.125,"15min":1.125},"last":0.69799999999999995}]},{"osd":7,"last update":"Fri Sep 13 15:54:19 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.80400000000000005,"15min":0.78600000000000003},"min":{"1min":0.51400000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.79800000000000004,"15min":0.78900000000000003},"min":{"1min":0.57799999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1919999999999999,"5min":1.468,"15min":1.468},"last":0.91500000000000004}]},{"osd":8,"last update":"Fri Sep 13 15:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80400000000000005,"15min":0.80200000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.095,"5min":1.224,"15min":1.224},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.81799999999999995,"15min":0.81999999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.141,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.61399999999999999}]},{"osd":9,"last update":"Fri Sep 13 15:55:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.88400000000000001,"15min":0.89800000000000002},"min":{"1min":0.53100000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95299999999999996,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.92800000000000005,"15min":0.94699999999999995},"min":{"1min":0.55200000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0249999999999999,"5min":1.419,"15min":1.419},"last":0.88400000000000001}]},{"osd":10,"last update":"Fri Sep 13 15:54:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.81399999999999995}]},{"osd":11,"last update":"Fri Sep 13 15:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":1.006},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.78200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":23095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:55:20.050 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T15:55:20.051 INFO:tasks.cephadm:Setting up client nodes... 2024-09-13T15:55:20.051 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T15:55:20.412 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:55:20.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:20 smithi017 ceph-mon[30494]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T15:55:20.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:20 smithi017 ceph-mon[30494]: from='client.24869 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T15:55:20.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:20 smithi017 ceph-mon[30494]: pgmap v309: 129 pgs: 129 active+clean; 584 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 2.4 KiB/s wr, 7 op/s 2024-09-13T15:55:20.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:20 smithi189 ceph-mon[34790]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T15:55:20.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:20 smithi189 ceph-mon[34790]: from='client.24869 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T15:55:20.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:20 smithi189 ceph-mon[34790]: pgmap v309: 129 pgs: 129 active+clean; 584 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 2.4 KiB/s wr, 7 op/s 2024-09-13T15:55:20.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:20 smithi193 ceph-mon[35248]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T15:55:20.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:20 smithi193 ceph-mon[35248]: from='client.24869 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T15:55:20.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:20 smithi193 ceph-mon[35248]: pgmap v309: 129 pgs: 129 active+clean; 584 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 2.4 KiB/s wr, 7 op/s 2024-09-13T15:55:22.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.525+0000 7f1e80800640 1 -- 172.21.15.17:0/2961838666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e78103bd0 msgr2=0x7f1e7810a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:22.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.525+0000 7f1e80800640 1 --2- 172.21.15.17:0/2961838666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e78103bd0 0x7f1e7810a460 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1e74009ca0 tx=0x7f1e7402a8c0 comp rx=0 tx=0).stop 2024-09-13T15:55:22.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.525+0000 7f1e80800640 1 -- 172.21.15.17:0/2961838666 shutdown_connections 2024-09-13T15:55:22.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.525+0000 7f1e80800640 1 --2- 172.21.15.17:0/2961838666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e78103bd0 0x7f1e7810a460 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.525+0000 7f1e80800640 1 --2- 172.21.15.17:0/2961838666 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e78103210 0x7f1e78103690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.525+0000 7f1e80800640 1 --2- 172.21.15.17:0/2961838666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e78102010 0x7f1e78102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.525+0000 7f1e80800640 1 -- 172.21.15.17:0/2961838666 >> 172.21.15.17:0/2961838666 conn(0x7f1e780fd7a0 msgr2=0x7f1e780ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.525+0000 7f1e80800640 1 -- 172.21.15.17:0/2961838666 shutdown_connections 2024-09-13T15:55:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.525+0000 7f1e80800640 1 -- 172.21.15.17:0/2961838666 wait complete. 2024-09-13T15:55:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.526+0000 7f1e80800640 1 Processor -- start 2024-09-13T15:55:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.526+0000 7f1e80800640 1 -- start start 2024-09-13T15:55:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.526+0000 7f1e80800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e78102010 0x7f1e78078260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.526+0000 7f1e80800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e78103210 0x7f1e780787a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.526+0000 7f1e80800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e78103bd0 0x7f1e78074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:22.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.526+0000 7f1e80800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e78075550 con 0x7f1e78102010 2024-09-13T15:55:22.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.526+0000 7f1e80800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e780756c0 con 0x7f1e78103210 2024-09-13T15:55:22.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.526+0000 7f1e80800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e78075880 con 0x7f1e78103bd0 2024-09-13T15:55:22.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.526+0000 7f1e7de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e78102010 0x7f1e78078260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:22.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.527+0000 7f1e7de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e78102010 0x7f1e78078260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46050/0 (socket says 172.21.15.17:46050) 2024-09-13T15:55:22.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.527+0000 7f1e7de00640 1 -- 172.21.15.17:0/3463812808 learned_addr learned my addr 172.21.15.17:0/3463812808 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:22.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.527+0000 7f1e7d400640 1 --2- 172.21.15.17:0/3463812808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e78103210 0x7f1e780787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:22.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.527+0000 7f1e7e800640 1 --2- 172.21.15.17:0/3463812808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e78103bd0 0x7f1e78074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:22.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.527+0000 7f1e7de00640 1 -- 172.21.15.17:0/3463812808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e78103bd0 msgr2=0x7f1e78074dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:22.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.527+0000 7f1e7de00640 1 --2- 172.21.15.17:0/3463812808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e78103bd0 0x7f1e78074dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:22.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.527+0000 7f1e7de00640 1 -- 172.21.15.17:0/3463812808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e78103210 msgr2=0x7f1e780787a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:22.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.527+0000 7f1e7de00640 1 --2- 172.21.15.17:0/3463812808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e78103210 0x7f1e780787a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:22.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.527+0000 7f1e7de00640 1 -- 172.21.15.17:0/3463812808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e74009900 con 0x7f1e78102010 2024-09-13T15:55:22.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.527+0000 7f1e7de00640 1 --2- 172.21.15.17:0/3463812808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e78102010 0x7f1e78078260 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00e9c0 tx=0x7f1e6c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:22.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.528+0000 7f1e72a00640 1 -- 172.21.15.17:0/3463812808 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c009700 con 0x7f1e78102010 2024-09-13T15:55:22.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.528+0000 7f1e72a00640 1 -- 172.21.15.17:0/3463812808 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1e6c0044e0 con 0x7f1e78102010 2024-09-13T15:55:22.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.528+0000 7f1e80800640 1 -- 172.21.15.17:0/3463812808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e781a43e0 con 0x7f1e78102010 2024-09-13T15:55:22.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.528+0000 7f1e72a00640 1 -- 172.21.15.17:0/3463812808 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c010430 con 0x7f1e78102010 2024-09-13T15:55:22.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.528+0000 7f1e80800640 1 -- 172.21.15.17:0/3463812808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e781a48e0 con 0x7f1e78102010 2024-09-13T15:55:22.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.529+0000 7f1e80800640 1 -- 172.21.15.17:0/3463812808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e781094b0 con 0x7f1e78102010 2024-09-13T15:55:22.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.531+0000 7f1e72a00640 1 -- 172.21.15.17:0/3463812808 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f1e6c003f60 con 0x7f1e78102010 2024-09-13T15:55:22.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.532+0000 7f1e72a00640 1 --2- 172.21.15.17:0/3463812808 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1e600a1110 0x7f1e600a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:22.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.532+0000 7f1e72a00640 1 -- 172.21.15.17:0/3463812808 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f1e6c014070 con 0x7f1e78102010 2024-09-13T15:55:22.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.532+0000 7f1e7d400640 1 --2- 172.21.15.17:0/3463812808 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1e600a1110 0x7f1e600a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:22.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.533+0000 7f1e7d400640 1 --2- 172.21.15.17:0/3463812808 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1e600a1110 0x7f1e600a35d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1e780761e0 tx=0x7f1e6800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:22.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.536+0000 7f1e72a00640 1 -- 172.21.15.17:0/3463812808 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1e6c096540 con 0x7f1e78102010 2024-09-13T15:55:22.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.789+0000 7f1e80800640 1 -- 172.21.15.17:0/3463812808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f1e7810d8b0 con 0x7f1e78102010 2024-09-13T15:55:22.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.794+0000 7f1e72a00640 1 -- 172.21.15.17:0/3463812808 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7f1e6c099b60 con 0x7f1e78102010 2024-09-13T15:55:22.795 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-13T15:55:22.795 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBqYORmt34aLxAA+sJrT51U3Ocs7kIHZnJzkw== 2024-09-13T15:55:22.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.796+0000 7f1e80800640 1 -- 172.21.15.17:0/3463812808 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1e600a1110 msgr2=0x7f1e600a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:22.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.796+0000 7f1e80800640 1 --2- 172.21.15.17:0/3463812808 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1e600a1110 0x7f1e600a35d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1e780761e0 tx=0x7f1e6800b390 comp rx=0 tx=0).stop 2024-09-13T15:55:22.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.796+0000 7f1e80800640 1 -- 172.21.15.17:0/3463812808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e78102010 msgr2=0x7f1e78078260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:22.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.796+0000 7f1e80800640 1 --2- 172.21.15.17:0/3463812808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e78102010 0x7f1e78078260 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00e9c0 tx=0x7f1e6c00ee80 comp rx=0 tx=0).stop 2024-09-13T15:55:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.797+0000 7f1e80800640 1 -- 172.21.15.17:0/3463812808 shutdown_connections 2024-09-13T15:55:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.797+0000 7f1e80800640 1 --2- 172.21.15.17:0/3463812808 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1e600a1110 0x7f1e600a35d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.797+0000 7f1e80800640 1 --2- 172.21.15.17:0/3463812808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e78103bd0 0x7f1e78074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.797+0000 7f1e80800640 1 --2- 172.21.15.17:0/3463812808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e78103210 0x7f1e780787a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.797+0000 7f1e80800640 1 --2- 172.21.15.17:0/3463812808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e78102010 0x7f1e78078260 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.797+0000 7f1e80800640 1 -- 172.21.15.17:0/3463812808 >> 172.21.15.17:0/3463812808 conn(0x7f1e780fd7a0 msgr2=0x7f1e78106680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.797+0000 7f1e80800640 1 -- 172.21.15.17:0/3463812808 shutdown_connections 2024-09-13T15:55:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:22.797+0000 7f1e80800640 1 -- 172.21.15.17:0/3463812808 wait complete. 2024-09-13T15:55:23.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:23 smithi193 ceph-mon[35248]: pgmap v310: 129 pgs: 129 active+clean; 620 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.1 KiB/s wr, 12 op/s 2024-09-13T15:55:23.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:23 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3463812808' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T15:55:23.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:23 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3463812808' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T15:55:23.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:23 smithi017 ceph-mon[30494]: pgmap v310: 129 pgs: 129 active+clean; 620 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.1 KiB/s wr, 12 op/s 2024-09-13T15:55:23.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:23 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3463812808' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T15:55:23.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:23 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3463812808' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T15:55:23.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:23 smithi189 ceph-mon[34790]: pgmap v310: 129 pgs: 129 active+clean; 620 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.1 KiB/s wr, 12 op/s 2024-09-13T15:55:23.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:23 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3463812808' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T15:55:23.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:23 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3463812808' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T15:55:23.625 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T15:55:23.625 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-13T15:55:23.625 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T15:55:23.708 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T15:55:23.709 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-13T15:55:23.709 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-13T15:55:24.068 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:55:25.494 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:25 smithi017 ceph-mon[30494]: pgmap v311: 129 pgs: 129 active+clean; 620 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.9 KiB/s wr, 12 op/s 2024-09-13T15:55:25.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:25 smithi193 ceph-mon[35248]: pgmap v311: 129 pgs: 129 active+clean; 620 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.9 KiB/s wr, 12 op/s 2024-09-13T15:55:25.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:25 smithi189 ceph-mon[34790]: pgmap v311: 129 pgs: 129 active+clean; 620 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.9 KiB/s wr, 12 op/s 2024-09-13T15:55:26.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.121+0000 7f2e17200640 1 -- 172.21.15.17:0/3366064535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e18104f40 msgr2=0x7f2e1810cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:26.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.121+0000 7f2e17200640 1 --2- 172.21.15.17:0/3366064535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e18104f40 0x7f2e1810cac0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009cd0 tx=0x7f2e1002a8e0 comp rx=0 tx=0).stop 2024-09-13T15:55:26.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.121+0000 7f2e17200640 1 -- 172.21.15.17:0/3366064535 shutdown_connections 2024-09-13T15:55:26.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.121+0000 7f2e17200640 1 --2- 172.21.15.17:0/3366064535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e18104f40 0x7f2e1810cac0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:26.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.121+0000 7f2e17200640 1 --2- 172.21.15.17:0/3366064535 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e181007c0 0x7f2e18104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:26.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.121+0000 7f2e17200640 1 --2- 172.21.15.17:0/3366064535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e180ffe10 0x7f2e181001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:26.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.121+0000 7f2e17200640 1 -- 172.21.15.17:0/3366064535 >> 172.21.15.17:0/3366064535 conn(0x7f2e180fb870 msgr2=0x7f2e180fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:26.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.121+0000 7f2e17200640 1 -- 172.21.15.17:0/3366064535 shutdown_connections 2024-09-13T15:55:26.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.121+0000 7f2e17200640 1 -- 172.21.15.17:0/3366064535 wait complete. 2024-09-13T15:55:26.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.122+0000 7f2e17200640 1 Processor -- start 2024-09-13T15:55:26.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.122+0000 7f2e17200640 1 -- start start 2024-09-13T15:55:26.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.123+0000 7f2e17200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e180ffe10 0x7f2e18198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:26.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.123+0000 7f2e17200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e181007c0 0x7f2e181987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:26.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.123+0000 7f2e17200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e18104f40 0x7f2e1819cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:26.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.123+0000 7f2e17200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1819d1c0 con 0x7f2e181007c0 2024-09-13T15:55:26.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.123+0000 7f2e17200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1819d330 con 0x7f2e180ffe10 2024-09-13T15:55:26.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.123+0000 7f2e17200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1819d4a0 con 0x7f2e18104f40 2024-09-13T15:55:26.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.123+0000 7f2e0fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e181007c0 0x7f2e181987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:26.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.123+0000 7f2e0fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e181007c0 0x7f2e181987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46060/0 (socket says 172.21.15.17:46060) 2024-09-13T15:55:26.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.123+0000 7f2e0fe00640 1 -- 172.21.15.17:0/3024225090 learned_addr learned my addr 172.21.15.17:0/3024225090 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:26.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.123+0000 7f2e15e00640 1 --2- 172.21.15.17:0/3024225090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e180ffe10 0x7f2e18198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:26.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.123+0000 7f2e16800640 1 --2- 172.21.15.17:0/3024225090 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e18104f40 0x7f2e1819cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:26.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.123+0000 7f2e0fe00640 1 -- 172.21.15.17:0/3024225090 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e18104f40 msgr2=0x7f2e1819cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:26.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.123+0000 7f2e0fe00640 1 --2- 172.21.15.17:0/3024225090 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e18104f40 0x7f2e1819cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:26.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.123+0000 7f2e0fe00640 1 -- 172.21.15.17:0/3024225090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e180ffe10 msgr2=0x7f2e18198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:26.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.123+0000 7f2e0fe00640 1 --2- 172.21.15.17:0/3024225090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e180ffe10 0x7f2e18198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:26.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.123+0000 7f2e0fe00640 1 -- 172.21.15.17:0/3024225090 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e08009490 con 0x7f2e181007c0 2024-09-13T15:55:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.123+0000 7f2e16800640 1 --2- 172.21.15.17:0/3024225090 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e18104f40 0x7f2e1819cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:55:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.124+0000 7f2e0fe00640 1 --2- 172.21.15.17:0/3024225090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e181007c0 0x7f2e181987c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2e0000e9f0 tx=0x7f2e0000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.124+0000 7f2e0ea00640 1 -- 172.21.15.17:0/3024225090 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e00009720 con 0x7f2e181007c0 2024-09-13T15:55:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.124+0000 7f2e0ea00640 1 -- 172.21.15.17:0/3024225090 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e0000cd80 con 0x7f2e181007c0 2024-09-13T15:55:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.124+0000 7f2e17200640 1 -- 172.21.15.17:0/3024225090 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e10009900 con 0x7f2e181007c0 2024-09-13T15:55:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.124+0000 7f2e0ea00640 1 -- 172.21.15.17:0/3024225090 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e00010430 con 0x7f2e181007c0 2024-09-13T15:55:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.124+0000 7f2e17200640 1 -- 172.21.15.17:0/3024225090 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e181a4e70 con 0x7f2e181007c0 2024-09-13T15:55:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.125+0000 7f2e17200640 1 -- 172.21.15.17:0/3024225090 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e181012f0 con 0x7f2e181007c0 2024-09-13T15:55:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.127+0000 7f2e0ea00640 1 -- 172.21.15.17:0/3024225090 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2e00005020 con 0x7f2e181007c0 2024-09-13T15:55:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.129+0000 7f2e0ea00640 1 --2- 172.21.15.17:0/3024225090 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2dfc0a1100 0x7f2dfc0a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.129+0000 7f2e0ea00640 1 -- 172.21.15.17:0/3024225090 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f2e00014070 con 0x7f2e181007c0 2024-09-13T15:55:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.129+0000 7f2e15e00640 1 --2- 172.21.15.17:0/3024225090 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2dfc0a1100 0x7f2dfc0a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.130+0000 7f2e15e00640 1 --2- 172.21.15.17:0/3024225090 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2dfc0a1100 0x7f2dfc0a35c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009d60 tx=0x7f2e08005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:26.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.132+0000 7f2e0ea00640 1 -- 172.21.15.17:0/3024225090 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2e00096390 con 0x7f2e181007c0 2024-09-13T15:55:26.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.366+0000 7f2e17200640 1 -- 172.21.15.17:0/3024225090 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f2e1819d660 con 0x7f2e181007c0 2024-09-13T15:55:26.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.371+0000 7f2e0ea00640 1 -- 172.21.15.17:0/3024225090 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260285 (secure 0 0 0) 0x7f2e000999b0 con 0x7f2e181007c0 2024-09-13T15:55:26.376 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:55:26.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.375+0000 7f2e17200640 1 -- 172.21.15.17:0/3024225090 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2dfc0a1100 msgr2=0x7f2dfc0a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:26.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.375+0000 7f2e17200640 1 --2- 172.21.15.17:0/3024225090 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2dfc0a1100 0x7f2dfc0a35c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009d60 tx=0x7f2e08005f90 comp rx=0 tx=0).stop 2024-09-13T15:55:26.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.375+0000 7f2e17200640 1 -- 172.21.15.17:0/3024225090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e181007c0 msgr2=0x7f2e181987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:26.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.375+0000 7f2e17200640 1 --2- 172.21.15.17:0/3024225090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e181007c0 0x7f2e181987c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2e0000e9f0 tx=0x7f2e0000edf0 comp rx=0 tx=0).stop 2024-09-13T15:55:26.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.375+0000 7f2e17200640 1 -- 172.21.15.17:0/3024225090 shutdown_connections 2024-09-13T15:55:26.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.375+0000 7f2e17200640 1 --2- 172.21.15.17:0/3024225090 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2dfc0a1100 0x7f2dfc0a35c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:26.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.375+0000 7f2e17200640 1 --2- 172.21.15.17:0/3024225090 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e18104f40 0x7f2e1819cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:26.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.375+0000 7f2e17200640 1 --2- 172.21.15.17:0/3024225090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e181007c0 0x7f2e181987c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:26.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.375+0000 7f2e17200640 1 --2- 172.21.15.17:0/3024225090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e180ffe10 0x7f2e18198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:26.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.375+0000 7f2e17200640 1 -- 172.21.15.17:0/3024225090 >> 172.21.15.17:0/3024225090 conn(0x7f2e180fb870 msgr2=0x7f2e180fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:26.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.375+0000 7f2e17200640 1 -- 172.21.15.17:0/3024225090 shutdown_connections 2024-09-13T15:55:26.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:26.375+0000 7f2e17200640 1 -- 172.21.15.17:0/3024225090 wait complete. 2024-09-13T15:55:27.115 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1039314076},{"type":"v1","addr":"172.21.15.17:6801","nonce":1039314076}]},"active_addr":"172.21.15.17:6801/1039314076","active_change":"2024-09-13T15:47:42.048155+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.17:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":3640681841}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":327172059}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":3784934266}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":3556133227}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":2863238930}]}]} 2024-09-13T15:55:27.122 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-13T15:55:27.122 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-13T15:55:27.124 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T15:55:27.446 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:55:27.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:27 smithi193 ceph-mon[35248]: pgmap v312: 129 pgs: 129 active+clean; 629 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.0 KiB/s wr, 15 op/s 2024-09-13T15:55:27.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:27 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3024225090' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T15:55:27.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:27 smithi017 ceph-mon[30494]: pgmap v312: 129 pgs: 129 active+clean; 629 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.0 KiB/s wr, 15 op/s 2024-09-13T15:55:27.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:27 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3024225090' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T15:55:27.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:27 smithi189 ceph-mon[34790]: pgmap v312: 129 pgs: 129 active+clean; 629 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.0 KiB/s wr, 15 op/s 2024-09-13T15:55:27.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:27 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3024225090' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T15:55:29.329 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:29 smithi017 ceph-mon[30494]: pgmap v313: 129 pgs: 129 active+clean; 629 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.1 KiB/s wr, 13 op/s 2024-09-13T15:55:29.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.441+0000 7ff2de000640 1 -- 172.21.15.17:0/860789518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2d8075300 msgr2=0x7ff2d8110700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:29.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.441+0000 7ff2de000640 1 --2- 172.21.15.17:0/860789518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2d8075300 0x7ff2d8110700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0009900 tx=0x7ff2c002a3f0 comp rx=0 tx=0).stop 2024-09-13T15:55:29.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.441+0000 7ff2de000640 1 -- 172.21.15.17:0/860789518 shutdown_connections 2024-09-13T15:55:29.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.441+0000 7ff2de000640 1 --2- 172.21.15.17:0/860789518 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff2d8110c40 0x7ff2d8113030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:29.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.441+0000 7ff2de000640 1 --2- 172.21.15.17:0/860789518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2d8075300 0x7ff2d8110700 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:29.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.441+0000 7ff2de000640 1 --2- 172.21.15.17:0/860789518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2d80749e0 0x7ff2d8074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:29.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.441+0000 7ff2de000640 1 -- 172.21.15.17:0/860789518 >> 172.21.15.17:0/860789518 conn(0x7ff2d80fdc60 msgr2=0x7ff2d8100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:29.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.441+0000 7ff2de000640 1 -- 172.21.15.17:0/860789518 shutdown_connections 2024-09-13T15:55:29.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.441+0000 7ff2de000640 1 -- 172.21.15.17:0/860789518 wait complete. 2024-09-13T15:55:29.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.442+0000 7ff2de000640 1 Processor -- start 2024-09-13T15:55:29.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.442+0000 7ff2de000640 1 -- start start 2024-09-13T15:55:29.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.442+0000 7ff2de000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2d80749e0 0x7ff2d81a2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:29.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.442+0000 7ff2de000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2d8075300 0x7ff2d81a2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:29.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.443+0000 7ff2de000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff2d8110c40 0x7ff2d819c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:29.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.443+0000 7ff2de000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d819ce70 con 0x7ff2d80749e0 2024-09-13T15:55:29.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.443+0000 7ff2de000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d819cfe0 con 0x7ff2d8075300 2024-09-13T15:55:29.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.443+0000 7ff2de000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d819d1a0 con 0x7ff2d8110c40 2024-09-13T15:55:29.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.443+0000 7ff2d7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2d80749e0 0x7ff2d81a2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:29.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.443+0000 7ff2d7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2d80749e0 0x7ff2d81a2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52930/0 (socket says 172.21.15.17:52930) 2024-09-13T15:55:29.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.443+0000 7ff2d7400640 1 -- 172.21.15.17:0/366232598 learned_addr learned my addr 172.21.15.17:0/366232598 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:29.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.443+0000 7ff2cfe00640 1 --2- 172.21.15.17:0/366232598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2d8075300 0x7ff2d81a2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:29.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.443+0000 7ff2d7e00640 1 --2- 172.21.15.17:0/366232598 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff2d8110c40 0x7ff2d819c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:29.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.443+0000 7ff2d7400640 1 -- 172.21.15.17:0/366232598 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff2d8110c40 msgr2=0x7ff2d819c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:29.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.443+0000 7ff2d7400640 1 --2- 172.21.15.17:0/366232598 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff2d8110c40 0x7ff2d819c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:29.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.443+0000 7ff2d7400640 1 -- 172.21.15.17:0/366232598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2d8075300 msgr2=0x7ff2d81a2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:29.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.443+0000 7ff2d7400640 1 --2- 172.21.15.17:0/366232598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2d8075300 0x7ff2d81a2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:29.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.443+0000 7ff2d7400640 1 -- 172.21.15.17:0/366232598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c8009490 con 0x7ff2d80749e0 2024-09-13T15:55:29.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.444+0000 7ff2d7400640 1 --2- 172.21.15.17:0/366232598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2d80749e0 0x7ff2d81a2680 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800ea60 tx=0x7ff2c800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:29.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.444+0000 7ff2d4c00640 1 -- 172.21.15.17:0/366232598 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c800cde0 con 0x7ff2d80749e0 2024-09-13T15:55:29.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.444+0000 7ff2de000640 1 -- 172.21.15.17:0/366232598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c0009560 con 0x7ff2d80749e0 2024-09-13T15:55:29.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.444+0000 7ff2d4c00640 1 -- 172.21.15.17:0/366232598 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2c80035f0 con 0x7ff2d80749e0 2024-09-13T15:55:29.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.444+0000 7ff2de000640 1 -- 172.21.15.17:0/366232598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d81a9670 con 0x7ff2d80749e0 2024-09-13T15:55:29.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.444+0000 7ff2d4c00640 1 -- 172.21.15.17:0/366232598 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c80044e0 con 0x7ff2d80749e0 2024-09-13T15:55:29.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.445+0000 7ff2de000640 1 -- 172.21.15.17:0/366232598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d8076120 con 0x7ff2d80749e0 2024-09-13T15:55:29.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.448+0000 7ff2d4c00640 1 -- 172.21.15.17:0/366232598 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ff2c8003a60 con 0x7ff2d80749e0 2024-09-13T15:55:29.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.450+0000 7ff2d4c00640 1 --2- 172.21.15.17:0/366232598 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff2bc0a1110 0x7ff2bc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:29.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.450+0000 7ff2d4c00640 1 -- 172.21.15.17:0/366232598 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff2c8014070 con 0x7ff2d80749e0 2024-09-13T15:55:29.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.450+0000 7ff2cfe00640 1 --2- 172.21.15.17:0/366232598 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff2bc0a1110 0x7ff2bc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:29.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.451+0000 7ff2cfe00640 1 --2- 172.21.15.17:0/366232598 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff2bc0a1110 0x7ff2bc0a35d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0005ab0 tx=0x7ff2c0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:29.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.452+0000 7ff2d4c00640 1 -- 172.21.15.17:0/366232598 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff2c8096930 con 0x7ff2d80749e0 2024-09-13T15:55:29.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:29 smithi193 ceph-mon[35248]: pgmap v313: 129 pgs: 129 active+clean; 629 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.1 KiB/s wr, 13 op/s 2024-09-13T15:55:29.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:29 smithi189 ceph-mon[34790]: pgmap v313: 129 pgs: 129 active+clean; 629 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.1 KiB/s wr, 13 op/s 2024-09-13T15:55:29.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.634+0000 7ff2de000640 1 -- 172.21.15.17:0/366232598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2d819dcf0 con 0x7ff2d80749e0 2024-09-13T15:55:29.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.636+0000 7ff2d4c00640 1 -- 172.21.15.17:0/366232598 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23935 (secure 0 0 0) 0x7ff2d819dcf0 con 0x7ff2d80749e0 2024-09-13T15:55:29.637 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:55:29.638 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":90,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","created":"2024-09-13T15:46:50.475750+0000","modified":"2024-09-13T15:54:57.383548+0000","last_up_change":"2024-09-13T15:53:59.138985+0000","last_in_change":"2024-09-13T15:53:39.220264+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:50:10.657011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:54:51.436469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:54:52.427930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:54:55.478058+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5d39d6af-15e6-463b-b9ff-a9a5dd94e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6803","nonce":158651212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6805","nonce":158651212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6809","nonce":158651212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6807","nonce":158651212}]},"public_addr":"172.21.15.17:6803/158651212","cluster_addr":"172.21.15.17:6805/158651212","heartbeat_back_addr":"172.21.15.17:6809/158651212","heartbeat_front_addr":"172.21.15.17:6807/158651212","state":["exists","up"]},{"osd":1,"uuid":"0da621c7-645b-44ae-ba7c-a573861c3aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6801","nonce":964319421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6803","nonce":964319421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6807","nonce":964319421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6805","nonce":964319421}]},"public_addr":"172.21.15.189:6801/964319421","cluster_addr":"172.21.15.189:6803/964319421","heartbeat_back_addr":"172.21.15.189:6807/964319421","heartbeat_front_addr":"172.21.15.189:6805/964319421","state":["exists","up"]},{"osd":2,"uuid":"fa95af60-1486-4a29-8c79-8a73a4146552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6801","nonce":138468002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6803","nonce":138468002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6807","nonce":138468002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6805","nonce":138468002}]},"public_addr":"172.21.15.193:6801/138468002","cluster_addr":"172.21.15.193:6803/138468002","heartbeat_back_addr":"172.21.15.193:6807/138468002","heartbeat_front_addr":"172.21.15.193:6805/138468002","state":["exists","up"]},{"osd":3,"uuid":"90428e5f-dfd4-4cda-b240-fdb9079bcb7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6811","nonce":919913803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6813","nonce":919913803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6817","nonce":919913803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6815","nonce":919913803}]},"public_addr":"172.21.15.17:6811/919913803","cluster_addr":"172.21.15.17:6813/919913803","heartbeat_back_addr":"172.21.15.17:6817/919913803","heartbeat_front_addr":"172.21.15.17:6815/919913803","state":["exists","up"]},{"osd":4,"uuid":"e1c537b6-98d2-4b66-b15a-65fe70b0ce25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6809","nonce":2310375565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6811","nonce":2310375565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6815","nonce":2310375565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6813","nonce":2310375565}]},"public_addr":"172.21.15.189:6809/2310375565","cluster_addr":"172.21.15.189:6811/2310375565","heartbeat_back_addr":"172.21.15.189:6815/2310375565","heartbeat_front_addr":"172.21.15.189:6813/2310375565","state":["exists","up"]},{"osd":5,"uuid":"48522fd7-d781-4447-873f-174dabd1e33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6809","nonce":1330877824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6811","nonce":1330877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6815","nonce":1330877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6813","nonce":1330877824}]},"public_addr":"172.21.15.193:6809/1330877824","cluster_addr":"172.21.15.193:6811/1330877824","heartbeat_back_addr":"172.21.15.193:6815/1330877824","heartbeat_front_addr":"172.21.15.193:6813/1330877824","state":["exists","up"]},{"osd":6,"uuid":"47bea191-fb53-40a7-8563-8ebf17dd5bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6819","nonce":3930545382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6821","nonce":3930545382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6825","nonce":3930545382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6823","nonce":3930545382}]},"public_addr":"172.21.15.17:6819/3930545382","cluster_addr":"172.21.15.17:6821/3930545382","heartbeat_back_addr":"172.21.15.17:6825/3930545382","heartbeat_front_addr":"172.21.15.17:6823/3930545382","state":["exists","up"]},{"osd":7,"uuid":"a98f36f9-0a19-4c9a-8ed1-615c4a6e7658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6817","nonce":3691677495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6819","nonce":3691677495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6823","nonce":3691677495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6821","nonce":3691677495}]},"public_addr":"172.21.15.189:6817/3691677495","cluster_addr":"172.21.15.189:6819/3691677495","heartbeat_back_addr":"172.21.15.189:6823/3691677495","heartbeat_front_addr":"172.21.15.189:6821/3691677495","state":["exists","up"]},{"osd":8,"uuid":"7a372d9f-c40f-4ead-87da-2f3a570c1373","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6817","nonce":4112907498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6819","nonce":4112907498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6823","nonce":4112907498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6821","nonce":4112907498}]},"public_addr":"172.21.15.193:6817/4112907498","cluster_addr":"172.21.15.193:6819/4112907498","heartbeat_back_addr":"172.21.15.193:6823/4112907498","heartbeat_front_addr":"172.21.15.193:6821/4112907498","state":["exists","up"]},{"osd":9,"uuid":"ac3d983c-c5e7-456b-8271-7c4e6169de61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6827","nonce":663424274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6829","nonce":663424274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6833","nonce":663424274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6831","nonce":663424274}]},"public_addr":"172.21.15.17:6827/663424274","cluster_addr":"172.21.15.17:6829/663424274","heartbeat_back_addr":"172.21.15.17:6833/663424274","heartbeat_front_addr":"172.21.15.17:6831/663424274","state":["exists","up"]},{"osd":10,"uuid":"08dcae02-6c79-4a06-ae88-6eb6e6941cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6825","nonce":3153990375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6827","nonce":3153990375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6831","nonce":3153990375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6829","nonce":3153990375}]},"public_addr":"172.21.15.189:6825/3153990375","cluster_addr":"172.21.15.189:6827/3153990375","heartbeat_back_addr":"172.21.15.189:6831/3153990375","heartbeat_front_addr":"172.21.15.189:6829/3153990375","state":["exists","up"]},{"osd":11,"uuid":"a4ebcf41-d805-4d44-b112-13ae84d51868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6825","nonce":4088053907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6827","nonce":4088053907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6831","nonce":4088053907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6829","nonce":4088053907}]},"public_addr":"172.21.15.193:6825/4088053907","cluster_addr":"172.21.15.193:6827/4088053907","heartbeat_back_addr":"172.21.15.193:6831/4088053907","heartbeat_front_addr":"172.21.15.193:6829/4088053907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:22.172370+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:44.802224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:06.641435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:34.536515+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:58.789324+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:22.189862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:50.382257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:14.678047+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:38.581105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:07.258150+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:32.261383+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:56.739338+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/1550067038":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/3360683829":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/634066188":"2024-09-14T15:47:42.048005+0000","172.21.15.17:6801/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1945536687":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/2214214377":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1224386591":"2024-09-14T15:47:14.996424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:55:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.638+0000 7ff2de000640 1 -- 172.21.15.17:0/366232598 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff2bc0a1110 msgr2=0x7ff2bc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:29.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.638+0000 7ff2de000640 1 --2- 172.21.15.17:0/366232598 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff2bc0a1110 0x7ff2bc0a35d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0005ab0 tx=0x7ff2c0005a20 comp rx=0 tx=0).stop 2024-09-13T15:55:29.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.638+0000 7ff2de000640 1 -- 172.21.15.17:0/366232598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2d80749e0 msgr2=0x7ff2d81a2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:29.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.638+0000 7ff2de000640 1 --2- 172.21.15.17:0/366232598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2d80749e0 0x7ff2d81a2680 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800ea60 tx=0x7ff2c800ef20 comp rx=0 tx=0).stop 2024-09-13T15:55:29.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.638+0000 7ff2de000640 1 -- 172.21.15.17:0/366232598 shutdown_connections 2024-09-13T15:55:29.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.638+0000 7ff2de000640 1 --2- 172.21.15.17:0/366232598 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff2bc0a1110 0x7ff2bc0a35d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:29.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.638+0000 7ff2de000640 1 --2- 172.21.15.17:0/366232598 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff2d8110c40 0x7ff2d819c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:29.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.638+0000 7ff2de000640 1 --2- 172.21.15.17:0/366232598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2d8075300 0x7ff2d81a2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:29.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.638+0000 7ff2de000640 1 --2- 172.21.15.17:0/366232598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2d80749e0 0x7ff2d81a2680 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:29.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.638+0000 7ff2de000640 1 -- 172.21.15.17:0/366232598 >> 172.21.15.17:0/366232598 conn(0x7ff2d80fdc60 msgr2=0x7ff2d8100050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:29.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.638+0000 7ff2de000640 1 -- 172.21.15.17:0/366232598 shutdown_connections 2024-09-13T15:55:29.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:29.638+0000 7ff2de000640 1 -- 172.21.15.17:0/366232598 wait complete. 2024-09-13T15:55:30.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:30 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/366232598' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:30.492 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-13T15:55:30.492 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T15:55:30.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:30 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/366232598' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:30.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:30 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/366232598' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:30.818 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:55:31.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:31 smithi193 ceph-mon[35248]: pgmap v314: 129 pgs: 129 active+clean; 629 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2024-09-13T15:55:31.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:31 smithi017 ceph-mon[30494]: pgmap v314: 129 pgs: 129 active+clean; 629 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2024-09-13T15:55:31.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:31 smithi189 ceph-mon[34790]: pgmap v314: 129 pgs: 129 active+clean; 629 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2024-09-13T15:55:32.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:32 smithi017 ceph-mon[30494]: pgmap v315: 129 pgs: 129 active+clean; 637 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.6 KiB/s wr, 10 op/s 2024-09-13T15:55:32.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:32 smithi193 ceph-mon[35248]: pgmap v315: 129 pgs: 129 active+clean; 637 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.6 KiB/s wr, 10 op/s 2024-09-13T15:55:32.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:32 smithi189 ceph-mon[34790]: pgmap v315: 129 pgs: 129 active+clean; 637 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.6 KiB/s wr, 10 op/s 2024-09-13T15:55:32.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.629+0000 7f2685e00640 1 -- 172.21.15.17:0/357951452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26800ffe20 msgr2=0x7f2680100200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:32.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.629+0000 7f2685e00640 1 --2- 172.21.15.17:0/357951452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26800ffe20 0x7f2680100200 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2674009930 tx=0x7f267402a420 comp rx=0 tx=0).stop 2024-09-13T15:55:32.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.629+0000 7f2685e00640 1 -- 172.21.15.17:0/357951452 shutdown_connections 2024-09-13T15:55:32.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.629+0000 7f2685e00640 1 --2- 172.21.15.17:0/357951452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2680104f50 0x7f268010cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:32.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.629+0000 7f2685e00640 1 --2- 172.21.15.17:0/357951452 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26801007d0 0x7f2680104820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:32.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.629+0000 7f2685e00640 1 --2- 172.21.15.17:0/357951452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26800ffe20 0x7f2680100200 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:32.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.629+0000 7f2685e00640 1 -- 172.21.15.17:0/357951452 >> 172.21.15.17:0/357951452 conn(0x7f26800fb900 msgr2=0x7f26800fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:32.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.629+0000 7f2685e00640 1 -- 172.21.15.17:0/357951452 shutdown_connections 2024-09-13T15:55:32.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.629+0000 7f2685e00640 1 -- 172.21.15.17:0/357951452 wait complete. 2024-09-13T15:55:32.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.630+0000 7f2685e00640 1 Processor -- start 2024-09-13T15:55:32.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.630+0000 7f2685e00640 1 -- start start 2024-09-13T15:55:32.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.630+0000 7f2685e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26800ffe20 0x7f2680198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:32.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.630+0000 7f2685e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26801007d0 0x7f26801988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:32.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.630+0000 7f2685e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2680104f50 0x7f268019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:32.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.630+0000 7f2685e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268019d2a0 con 0x7f26800ffe20 2024-09-13T15:55:32.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.630+0000 7f2685e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268019d410 con 0x7f2680104f50 2024-09-13T15:55:32.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.630+0000 7f2685e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268019d580 con 0x7f26801007d0 2024-09-13T15:55:32.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.631+0000 7f2684a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26800ffe20 0x7f2680198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:32.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.631+0000 7f2684a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26800ffe20 0x7f2680198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52954/0 (socket says 172.21.15.17:52954) 2024-09-13T15:55:32.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.631+0000 7f2684a00640 1 -- 172.21.15.17:0/2175639892 learned_addr learned my addr 172.21.15.17:0/2175639892 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:32.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.631+0000 7f2685400640 1 --2- 172.21.15.17:0/2175639892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2680104f50 0x7f268019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:32.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.631+0000 7f267fe00640 1 --2- 172.21.15.17:0/2175639892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26801007d0 0x7f26801988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:32.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.631+0000 7f2685400640 1 -- 172.21.15.17:0/2175639892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26801007d0 msgr2=0x7f26801988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:32.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.631+0000 7f2685400640 1 --2- 172.21.15.17:0/2175639892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26801007d0 0x7f26801988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:32.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.631+0000 7f2685400640 1 -- 172.21.15.17:0/2175639892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26800ffe20 msgr2=0x7f2680198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:32.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.631+0000 7f2685400640 1 --2- 172.21.15.17:0/2175639892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26800ffe20 0x7f2680198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:32.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.631+0000 7f2685400640 1 -- 172.21.15.17:0/2175639892 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2674009560 con 0x7f2680104f50 2024-09-13T15:55:32.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.631+0000 7f2684a00640 1 --2- 172.21.15.17:0/2175639892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26800ffe20 0x7f2680198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:55:32.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.632+0000 7f2685400640 1 --2- 172.21.15.17:0/2175639892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2680104f50 0x7f268019cca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f267800e940 tx=0x7f267800ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:32.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.632+0000 7f267d600640 1 -- 172.21.15.17:0/2175639892 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2678004d20 con 0x7f2680104f50 2024-09-13T15:55:32.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.632+0000 7f2685e00640 1 -- 172.21.15.17:0/2175639892 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f268019d860 con 0x7f2680104f50 2024-09-13T15:55:32.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.632+0000 7f267d600640 1 -- 172.21.15.17:0/2175639892 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2678004e80 con 0x7f2680104f50 2024-09-13T15:55:32.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.632+0000 7f267d600640 1 -- 172.21.15.17:0/2175639892 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2678011470 con 0x7f2680104f50 2024-09-13T15:55:32.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.632+0000 7f2685e00640 1 -- 172.21.15.17:0/2175639892 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26801a5120 con 0x7f2680104f50 2024-09-13T15:55:32.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.633+0000 7f2685e00640 1 -- 172.21.15.17:0/2175639892 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2680101300 con 0x7f2680104f50 2024-09-13T15:55:32.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.635+0000 7f267d600640 1 -- 172.21.15.17:0/2175639892 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f267800cb20 con 0x7f2680104f50 2024-09-13T15:55:32.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.636+0000 7f267d600640 1 --2- 172.21.15.17:0/2175639892 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f26680a1100 0x7f26680a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:32.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.636+0000 7f267d600640 1 -- 172.21.15.17:0/2175639892 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f26780cccf0 con 0x7f2680104f50 2024-09-13T15:55:32.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.637+0000 7f2684a00640 1 --2- 172.21.15.17:0/2175639892 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f26680a1100 0x7f26680a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:32.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.637+0000 7f2684a00640 1 --2- 172.21.15.17:0/2175639892 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f26680a1100 0x7f26680a35c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2674000c00 tx=0x7f2674005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:32.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.641+0000 7f267d600640 1 -- 172.21.15.17:0/2175639892 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2678096180 con 0x7f2680104f50 2024-09-13T15:55:32.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.825+0000 7f2685e00640 1 -- 172.21.15.17:0/2175639892 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2680100200 con 0x7f2680104f50 2024-09-13T15:55:32.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.827+0000 7f267d600640 1 -- 172.21.15.17:0/2175639892 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23935 (secure 0 0 0) 0x7f267801f020 con 0x7f2680104f50 2024-09-13T15:55:32.828 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:55:32.828 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":90,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","created":"2024-09-13T15:46:50.475750+0000","modified":"2024-09-13T15:54:57.383548+0000","last_up_change":"2024-09-13T15:53:59.138985+0000","last_in_change":"2024-09-13T15:53:39.220264+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:50:10.657011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:54:51.436469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:54:52.427930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:54:55.478058+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5d39d6af-15e6-463b-b9ff-a9a5dd94e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6803","nonce":158651212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6805","nonce":158651212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6809","nonce":158651212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6807","nonce":158651212}]},"public_addr":"172.21.15.17:6803/158651212","cluster_addr":"172.21.15.17:6805/158651212","heartbeat_back_addr":"172.21.15.17:6809/158651212","heartbeat_front_addr":"172.21.15.17:6807/158651212","state":["exists","up"]},{"osd":1,"uuid":"0da621c7-645b-44ae-ba7c-a573861c3aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6801","nonce":964319421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6803","nonce":964319421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6807","nonce":964319421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6805","nonce":964319421}]},"public_addr":"172.21.15.189:6801/964319421","cluster_addr":"172.21.15.189:6803/964319421","heartbeat_back_addr":"172.21.15.189:6807/964319421","heartbeat_front_addr":"172.21.15.189:6805/964319421","state":["exists","up"]},{"osd":2,"uuid":"fa95af60-1486-4a29-8c79-8a73a4146552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6801","nonce":138468002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6803","nonce":138468002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6807","nonce":138468002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6805","nonce":138468002}]},"public_addr":"172.21.15.193:6801/138468002","cluster_addr":"172.21.15.193:6803/138468002","heartbeat_back_addr":"172.21.15.193:6807/138468002","heartbeat_front_addr":"172.21.15.193:6805/138468002","state":["exists","up"]},{"osd":3,"uuid":"90428e5f-dfd4-4cda-b240-fdb9079bcb7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6811","nonce":919913803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6813","nonce":919913803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6817","nonce":919913803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6815","nonce":919913803}]},"public_addr":"172.21.15.17:6811/919913803","cluster_addr":"172.21.15.17:6813/919913803","heartbeat_back_addr":"172.21.15.17:6817/919913803","heartbeat_front_addr":"172.21.15.17:6815/919913803","state":["exists","up"]},{"osd":4,"uuid":"e1c537b6-98d2-4b66-b15a-65fe70b0ce25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6809","nonce":2310375565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6811","nonce":2310375565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6815","nonce":2310375565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6813","nonce":2310375565}]},"public_addr":"172.21.15.189:6809/2310375565","cluster_addr":"172.21.15.189:6811/2310375565","heartbeat_back_addr":"172.21.15.189:6815/2310375565","heartbeat_front_addr":"172.21.15.189:6813/2310375565","state":["exists","up"]},{"osd":5,"uuid":"48522fd7-d781-4447-873f-174dabd1e33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6809","nonce":1330877824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6811","nonce":1330877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6815","nonce":1330877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6813","nonce":1330877824}]},"public_addr":"172.21.15.193:6809/1330877824","cluster_addr":"172.21.15.193:6811/1330877824","heartbeat_back_addr":"172.21.15.193:6815/1330877824","heartbeat_front_addr":"172.21.15.193:6813/1330877824","state":["exists","up"]},{"osd":6,"uuid":"47bea191-fb53-40a7-8563-8ebf17dd5bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6819","nonce":3930545382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6821","nonce":3930545382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6825","nonce":3930545382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6823","nonce":3930545382}]},"public_addr":"172.21.15.17:6819/3930545382","cluster_addr":"172.21.15.17:6821/3930545382","heartbeat_back_addr":"172.21.15.17:6825/3930545382","heartbeat_front_addr":"172.21.15.17:6823/3930545382","state":["exists","up"]},{"osd":7,"uuid":"a98f36f9-0a19-4c9a-8ed1-615c4a6e7658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6817","nonce":3691677495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6819","nonce":3691677495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6823","nonce":3691677495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6821","nonce":3691677495}]},"public_addr":"172.21.15.189:6817/3691677495","cluster_addr":"172.21.15.189:6819/3691677495","heartbeat_back_addr":"172.21.15.189:6823/3691677495","heartbeat_front_addr":"172.21.15.189:6821/3691677495","state":["exists","up"]},{"osd":8,"uuid":"7a372d9f-c40f-4ead-87da-2f3a570c1373","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6817","nonce":4112907498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6819","nonce":4112907498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6823","nonce":4112907498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6821","nonce":4112907498}]},"public_addr":"172.21.15.193:6817/4112907498","cluster_addr":"172.21.15.193:6819/4112907498","heartbeat_back_addr":"172.21.15.193:6823/4112907498","heartbeat_front_addr":"172.21.15.193:6821/4112907498","state":["exists","up"]},{"osd":9,"uuid":"ac3d983c-c5e7-456b-8271-7c4e6169de61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6827","nonce":663424274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6829","nonce":663424274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6833","nonce":663424274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6831","nonce":663424274}]},"public_addr":"172.21.15.17:6827/663424274","cluster_addr":"172.21.15.17:6829/663424274","heartbeat_back_addr":"172.21.15.17:6833/663424274","heartbeat_front_addr":"172.21.15.17:6831/663424274","state":["exists","up"]},{"osd":10,"uuid":"08dcae02-6c79-4a06-ae88-6eb6e6941cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6825","nonce":3153990375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6827","nonce":3153990375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6831","nonce":3153990375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6829","nonce":3153990375}]},"public_addr":"172.21.15.189:6825/3153990375","cluster_addr":"172.21.15.189:6827/3153990375","heartbeat_back_addr":"172.21.15.189:6831/3153990375","heartbeat_front_addr":"172.21.15.189:6829/3153990375","state":["exists","up"]},{"osd":11,"uuid":"a4ebcf41-d805-4d44-b112-13ae84d51868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6825","nonce":4088053907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6827","nonce":4088053907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6831","nonce":4088053907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6829","nonce":4088053907}]},"public_addr":"172.21.15.193:6825/4088053907","cluster_addr":"172.21.15.193:6827/4088053907","heartbeat_back_addr":"172.21.15.193:6831/4088053907","heartbeat_front_addr":"172.21.15.193:6829/4088053907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:22.172370+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:44.802224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:06.641435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:34.536515+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:58.789324+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:22.189862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:50.382257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:14.678047+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:38.581105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:07.258150+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:32.261383+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:56.739338+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/1550067038":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/3360683829":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/634066188":"2024-09-14T15:47:42.048005+0000","172.21.15.17:6801/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1945536687":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/2214214377":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1224386591":"2024-09-14T15:47:14.996424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:55:32.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.830+0000 7f2685e00640 1 -- 172.21.15.17:0/2175639892 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f26680a1100 msgr2=0x7f26680a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:32.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.830+0000 7f2685e00640 1 --2- 172.21.15.17:0/2175639892 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f26680a1100 0x7f26680a35c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2674000c00 tx=0x7f2674005a20 comp rx=0 tx=0).stop 2024-09-13T15:55:32.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.830+0000 7f2685e00640 1 -- 172.21.15.17:0/2175639892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2680104f50 msgr2=0x7f268019cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:32.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.830+0000 7f2685e00640 1 --2- 172.21.15.17:0/2175639892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2680104f50 0x7f268019cca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f267800e940 tx=0x7f267800ee00 comp rx=0 tx=0).stop 2024-09-13T15:55:32.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.830+0000 7f2685e00640 1 -- 172.21.15.17:0/2175639892 shutdown_connections 2024-09-13T15:55:32.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.830+0000 7f2685e00640 1 --2- 172.21.15.17:0/2175639892 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f26680a1100 0x7f26680a35c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:32.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.830+0000 7f2685e00640 1 --2- 172.21.15.17:0/2175639892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2680104f50 0x7f268019cca0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:32.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.830+0000 7f2685e00640 1 --2- 172.21.15.17:0/2175639892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26801007d0 0x7f26801988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:32.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.830+0000 7f2685e00640 1 --2- 172.21.15.17:0/2175639892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26800ffe20 0x7f2680198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:32.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.830+0000 7f2685e00640 1 -- 172.21.15.17:0/2175639892 >> 172.21.15.17:0/2175639892 conn(0x7f26800fb900 msgr2=0x7f26800fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:32.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.830+0000 7f2685e00640 1 -- 172.21.15.17:0/2175639892 shutdown_connections 2024-09-13T15:55:32.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:32.830+0000 7f2685e00640 1 -- 172.21.15.17:0/2175639892 wait complete. 2024-09-13T15:55:33.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:33 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/2175639892' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:33.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:33 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/2175639892' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:33.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:33 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/2175639892' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:55:33.695 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-13T15:55:33.695 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-13T15:55:33.696 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-13T15:55:33.696 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-13T15:55:33.697 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-13T15:55:33.698 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-13T15:55:33.698 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-13T15:55:33.699 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-13T15:55:33.700 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-13T15:55:33.700 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-13T15:55:33.700 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-13T15:55:33.701 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-13T15:55:34.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:34 smithi193 ceph-mon[35248]: pgmap v316: 129 pgs: 129 active+clean; 637 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-09-13T15:55:34.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:34 smithi017 ceph-mon[30494]: pgmap v316: 129 pgs: 129 active+clean; 637 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-09-13T15:55:34.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:34 smithi189 ceph-mon[34790]: pgmap v316: 129 pgs: 129 active+clean; 637 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-09-13T15:55:34.676 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:55:34.680 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:55:34.688 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:55:34.688 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:55:34.693 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:55:34.693 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:55:34.695 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:55:34.699 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:55:34.699 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:55:34.709 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:55:34.720 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:55:37.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:37 smithi193 ceph-mon[35248]: pgmap v317: 129 pgs: 129 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-13T15:55:37.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:37 smithi017 ceph-mon[30494]: pgmap v317: 129 pgs: 129 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-13T15:55:37.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:37 smithi189 ceph-mon[34790]: pgmap v317: 129 pgs: 129 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-13T15:55:38.981 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:55:39.377 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:39 smithi017 ceph-mon[30494]: pgmap v318: 129 pgs: 129 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-13T15:55:39.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:39 smithi193 ceph-mon[35248]: pgmap v318: 129 pgs: 129 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-13T15:55:39.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:39 smithi189 ceph-mon[34790]: pgmap v318: 129 pgs: 129 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-13T15:55:41.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:41 smithi193 ceph-mon[35248]: pgmap v319: 129 pgs: 129 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-13T15:55:41.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:41 smithi017 ceph-mon[30494]: pgmap v319: 129 pgs: 129 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-13T15:55:41.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:41 smithi189 ceph-mon[34790]: pgmap v319: 129 pgs: 129 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-13T15:55:42.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:42 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-13T15:55:42.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:42 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-13T15:55:42.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:42 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-13T15:55:42.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:42 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-13T15:55:42.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:42 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]: dispatch 2024-09-13T15:55:42.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:42 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-09-13T15:55:42.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:42 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]: dispatch 2024-09-13T15:55:42.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:42 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]: dispatch 2024-09-13T15:55:42.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:42 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-13T15:55:42.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:42 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 10]}]: dispatch 2024-09-13T15:55:42.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-13T15:55:42.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-13T15:55:42.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-13T15:55:42.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-13T15:55:42.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]: dispatch 2024-09-13T15:55:42.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-09-13T15:55:42.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]: dispatch 2024-09-13T15:55:42.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]: dispatch 2024-09-13T15:55:42.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-13T15:55:42.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:42 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 10]}]: dispatch 2024-09-13T15:55:42.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:42 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-13T15:55:42.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:42 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-13T15:55:42.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:42 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-13T15:55:42.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:42 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-13T15:55:42.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:42 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]: dispatch 2024-09-13T15:55:42.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:42 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-09-13T15:55:42.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:42 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]: dispatch 2024-09-13T15:55:42.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:42 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]: dispatch 2024-09-13T15:55:42.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:42 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-13T15:55:42.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:42 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 10]}]: dispatch 2024-09-13T15:55:43.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:43 smithi193 ceph-mon[35248]: pgmap v320: 129 pgs: 129 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-13T15:55:43.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-13T15:55:43.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-13T15:55:43.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-13T15:55:43.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-13T15:55:43.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-09-13T15:55:43.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-13T15:55:43.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-09-13T15:55:43.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]': finished 2024-09-13T15:55:43.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-13T15:55:43.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 10]}]': finished 2024-09-13T15:55:43.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:43 smithi193 ceph-mon[35248]: osdmap e91: 12 total, 12 up, 12 in 2024-09-13T15:55:43.506 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:43 smithi017 ceph-mon[30494]: pgmap v320: 129 pgs: 129 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-13T15:55:43.506 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-13T15:55:43.506 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-13T15:55:43.506 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-13T15:55:43.506 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-13T15:55:43.506 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-09-13T15:55:43.507 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-13T15:55:43.507 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-09-13T15:55:43.507 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]': finished 2024-09-13T15:55:43.507 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-13T15:55:43.507 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 10]}]': finished 2024-09-13T15:55:43.507 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:43 smithi017 ceph-mon[30494]: osdmap e91: 12 total, 12 up, 12 in 2024-09-13T15:55:43.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:43 smithi189 ceph-mon[34790]: pgmap v320: 129 pgs: 129 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-13T15:55:43.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-13T15:55:43.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-13T15:55:43.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-13T15:55:43.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-13T15:55:43.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-09-13T15:55:43.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-13T15:55:43.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-09-13T15:55:43.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]': finished 2024-09-13T15:55:43.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-13T15:55:43.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 10]}]': finished 2024-09-13T15:55:43.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:43 smithi189 ceph-mon[34790]: osdmap e91: 12 total, 12 up, 12 in 2024-09-13T15:55:44.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:44 smithi193 ceph-mon[35248]: osdmap e92: 12 total, 12 up, 12 in 2024-09-13T15:55:44.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:44 smithi193 ceph-mon[35248]: pgmap v323: 129 pgs: 1 peering, 128 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T15:55:44.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:44 smithi017 ceph-mon[30494]: osdmap e92: 12 total, 12 up, 12 in 2024-09-13T15:55:44.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:44 smithi017 ceph-mon[30494]: pgmap v323: 129 pgs: 1 peering, 128 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T15:55:44.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:44 smithi189 ceph-mon[34790]: osdmap e92: 12 total, 12 up, 12 in 2024-09-13T15:55:44.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:44 smithi189 ceph-mon[34790]: pgmap v323: 129 pgs: 1 peering, 128 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T15:55:45.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.666+0000 7fefd2200640 1 -- 172.21.15.17:0/679535715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefcc0ffe10 msgr2=0x7fefcc1001f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.666+0000 7fefd2200640 1 --2- 172.21.15.17:0/679535715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefcc0ffe10 0x7fefcc1001f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fefc0009930 tx=0x7fefc002a420 comp rx=0 tx=0).stop 2024-09-13T15:55:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.666+0000 7fefd2200640 1 -- 172.21.15.17:0/679535715 shutdown_connections 2024-09-13T15:55:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.666+0000 7fefd2200640 1 --2- 172.21.15.17:0/679535715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefcc104f40 0x7fefcc10cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.666+0000 7fefd2200640 1 --2- 172.21.15.17:0/679535715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fefcc1007c0 0x7fefcc104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.666+0000 7fefd2200640 1 --2- 172.21.15.17:0/679535715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefcc0ffe10 0x7fefcc1001f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.666+0000 7fefd2200640 1 -- 172.21.15.17:0/679535715 >> 172.21.15.17:0/679535715 conn(0x7fefcc0fb870 msgr2=0x7fefcc0fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.666+0000 7fefd2200640 1 -- 172.21.15.17:0/679535715 shutdown_connections 2024-09-13T15:55:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.666+0000 7fefd2200640 1 -- 172.21.15.17:0/679535715 wait complete. 2024-09-13T15:55:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.667+0000 7fefd2200640 1 Processor -- start 2024-09-13T15:55:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.667+0000 7fefd2200640 1 -- start start 2024-09-13T15:55:45.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.668+0000 7fefd2200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefcc0ffe10 0x7fefcc0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:45.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.668+0000 7fefd2200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefcc1007c0 0x7fefcc072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:45.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.668+0000 7fefd2200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fefcc104f40 0x7fefcc073230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:45.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.668+0000 7fefd2200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc1a4450 con 0x7fefcc0ffe10 2024-09-13T15:55:45.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.668+0000 7fefd2200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc1a45c0 con 0x7fefcc1007c0 2024-09-13T15:55:45.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.668+0000 7fefd2200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc1a4780 con 0x7fefcc104f40 2024-09-13T15:55:45.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.668+0000 7fefd0e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefcc0ffe10 0x7fefcc0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:45.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.668+0000 7fefd0e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefcc0ffe10 0x7fefcc0727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42142/0 (socket says 172.21.15.17:42142) 2024-09-13T15:55:45.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.668+0000 7fefd0e00640 1 -- 172.21.15.17:0/3358554327 learned_addr learned my addr 172.21.15.17:0/3358554327 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:45.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.668+0000 7fefcbe00640 1 --2- 172.21.15.17:0/3358554327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefcc1007c0 0x7fefcc072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:45.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.668+0000 7fefd1800640 1 --2- 172.21.15.17:0/3358554327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fefcc104f40 0x7fefcc073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:45.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.668+0000 7fefd0e00640 1 -- 172.21.15.17:0/3358554327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fefcc104f40 msgr2=0x7fefcc073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:45.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.668+0000 7fefd0e00640 1 --2- 172.21.15.17:0/3358554327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fefcc104f40 0x7fefcc073230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:45.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.668+0000 7fefd0e00640 1 -- 172.21.15.17:0/3358554327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefcc1007c0 msgr2=0x7fefcc072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:45.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.668+0000 7fefd0e00640 1 --2- 172.21.15.17:0/3358554327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefcc1007c0 0x7fefcc072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:45.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.668+0000 7fefd0e00640 1 -- 172.21.15.17:0/3358554327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb8009490 con 0x7fefcc0ffe10 2024-09-13T15:55:45.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.668+0000 7fefd1800640 1 --2- 172.21.15.17:0/3358554327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fefcc104f40 0x7fefcc073230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:55:45.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.669+0000 7fefd0e00640 1 --2- 172.21.15.17:0/3358554327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefcc0ffe10 0x7fefcc0727b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fefc0005940 tx=0x7fefc00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:45.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.669+0000 7fefc9600640 1 -- 172.21.15.17:0/3358554327 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc0004b90 con 0x7fefcc0ffe10 2024-09-13T15:55:45.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.669+0000 7fefc9600640 1 -- 172.21.15.17:0/3358554327 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefc0004cf0 con 0x7fefcc0ffe10 2024-09-13T15:55:45.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.669+0000 7fefc9600640 1 -- 172.21.15.17:0/3358554327 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc0031890 con 0x7fefcc0ffe10 2024-09-13T15:55:45.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.669+0000 7fefd2200640 1 -- 172.21.15.17:0/3358554327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc4009840 con 0x7fefcc0ffe10 2024-09-13T15:55:45.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.669+0000 7fefd2200640 1 -- 172.21.15.17:0/3358554327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc0009560 con 0x7fefcc0ffe10 2024-09-13T15:55:45.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.670+0000 7fefd2200640 1 -- 172.21.15.17:0/3358554327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fefcc1012f0 con 0x7fefcc0ffe10 2024-09-13T15:55:45.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.672+0000 7fefc9600640 1 -- 172.21.15.17:0/3358554327 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fefc00035f0 con 0x7fefcc0ffe10 2024-09-13T15:55:45.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.673+0000 7fefc9600640 1 --2- 172.21.15.17:0/3358554327 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fefb40a1180 0x7fefb40a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:45.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.673+0000 7fefc9600640 1 -- 172.21.15.17:0/3358554327 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fefc00ede20 con 0x7fefcc0ffe10 2024-09-13T15:55:45.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.673+0000 7fefcbe00640 1 --2- 172.21.15.17:0/3358554327 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fefb40a1180 0x7fefb40a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:45.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.674+0000 7fefc9600640 1 --2- 172.21.15.17:0/3358554327 >> [v2:172.21.15.193:6824/4088053907,v1:172.21.15.193:6825/4088053907] conn(0x7fefb40abd70 0x7fefb40ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:45.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.674+0000 7fefc9600640 1 -- 172.21.15.17:0/3358554327 --> [v2:172.21.15.193:6824/4088053907,v1:172.21.15.193:6825/4088053907] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fefb40ae880 con 0x7fefb40abd70 2024-09-13T15:55:45.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.674+0000 7fefc9600640 1 -- 172.21.15.17:0/3358554327 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefc00ee190 con 0x7fefcc0ffe10 2024-09-13T15:55:45.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.674+0000 7fefcbe00640 1 --2- 172.21.15.17:0/3358554327 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fefb40a1180 0x7fefb40a3640 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fefcc073f30 tx=0x7fefb8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:45.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.674+0000 7fefd1800640 1 --2- 172.21.15.17:0/3358554327 >> [v2:172.21.15.193:6824/4088053907,v1:172.21.15.193:6825/4088053907] conn(0x7fefb40abd70 0x7fefb40ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:45.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.675+0000 7fefd1800640 1 --2- 172.21.15.17:0/3358554327 >> [v2:172.21.15.193:6824/4088053907,v1:172.21.15.193:6825/4088053907] conn(0x7fefb40abd70 0x7fefb40ae1b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:45.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.676+0000 7fefc9600640 1 -- 172.21.15.17:0/3358554327 <== osd.11 v2:172.21.15.193:6824/4088053907 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fefb40ae880 con 0x7fefb40abd70 2024-09-13T15:55:45.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.690+0000 7fefd2200640 1 -- 172.21.15.17:0/3358554327 --> [v2:172.21.15.193:6824/4088053907,v1:172.21.15.193:6825/4088053907] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fefcc10ff10 con 0x7fefb40abd70 2024-09-13T15:55:45.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.690+0000 7fefc9600640 1 -- 172.21.15.17:0/3358554327 <== osd.11 v2:172.21.15.193:6824/4088053907 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fefc4009d10 con 0x7fefb40abd70 2024-09-13T15:55:45.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.691+0000 7fefd2200640 1 -- 172.21.15.17:0/3358554327 >> [v2:172.21.15.193:6824/4088053907,v1:172.21.15.193:6825/4088053907] conn(0x7fefb40abd70 msgr2=0x7fefb40ae1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:45.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.691+0000 7fefd2200640 1 --2- 172.21.15.17:0/3358554327 >> [v2:172.21.15.193:6824/4088053907,v1:172.21.15.193:6825/4088053907] conn(0x7fefb40abd70 0x7fefb40ae1b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:45.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.691+0000 7fefd2200640 1 -- 172.21.15.17:0/3358554327 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fefb40a1180 msgr2=0x7fefb40a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:45.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.691+0000 7fefd2200640 1 --2- 172.21.15.17:0/3358554327 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fefb40a1180 0x7fefb40a3640 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fefcc073f30 tx=0x7fefb8005f90 comp rx=0 tx=0).stop 2024-09-13T15:55:45.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.691+0000 7fefd2200640 1 -- 172.21.15.17:0/3358554327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefcc0ffe10 msgr2=0x7fefcc0727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:45.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.691+0000 7fefd2200640 1 --2- 172.21.15.17:0/3358554327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefcc0ffe10 0x7fefcc0727b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fefc0005940 tx=0x7fefc00055a0 comp rx=0 tx=0).stop 2024-09-13T15:55:45.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.691+0000 7fefd1800640 1 -- 172.21.15.17:0/3358554327 reap_dead start 2024-09-13T15:55:45.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.691+0000 7fefd2200640 1 -- 172.21.15.17:0/3358554327 shutdown_connections 2024-09-13T15:55:45.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.691+0000 7fefd2200640 1 -- 172.21.15.17:0/3358554327 >> 172.21.15.17:0/3358554327 conn(0x7fefcc0fb870 msgr2=0x7fefcc0fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:45.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.691+0000 7fefd2200640 1 -- 172.21.15.17:0/3358554327 shutdown_connections 2024-09-13T15:55:45.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:41.691+0000 7fefd2200640 1 -- 172.21.15.17:0/3358554327 wait complete. 2024-09-13T15:55:46.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.067+0000 7f1e13e00640 1 -- 172.21.15.17:0/1186732131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e0c102ba0 msgr2=0x7f1e0c106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:46.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.067+0000 7f1e13e00640 1 --2- 172.21.15.17:0/1186732131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e0c102ba0 0x7f1e0c106bf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009930 tx=0x7f1df802a420 comp rx=0 tx=0).stop 2024-09-13T15:55:46.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.068+0000 7f1e13e00640 1 -- 172.21.15.17:0/1186732131 shutdown_connections 2024-09-13T15:55:46.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.068+0000 7f1e13e00640 1 --2- 172.21.15.17:0/1186732131 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e0c107320 0x7f1e0c10eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:46.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.068+0000 7f1e13e00640 1 --2- 172.21.15.17:0/1186732131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e0c102ba0 0x7f1e0c106bf0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:46.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.068+0000 7f1e13e00640 1 --2- 172.21.15.17:0/1186732131 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e0c1021f0 0x7f1e0c1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:46.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.068+0000 7f1e13e00640 1 -- 172.21.15.17:0/1186732131 >> 172.21.15.17:0/1186732131 conn(0x7f1e0c0fdc70 msgr2=0x7f1e0c100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:46.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.068+0000 7f1e13e00640 1 -- 172.21.15.17:0/1186732131 shutdown_connections 2024-09-13T15:55:46.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.068+0000 7f1e13e00640 1 -- 172.21.15.17:0/1186732131 wait complete. 2024-09-13T15:55:46.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.069+0000 7f1e13e00640 1 Processor -- start 2024-09-13T15:55:46.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.069+0000 7f1e13e00640 1 -- start start 2024-09-13T15:55:46.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.069+0000 7f1e13e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e0c1021f0 0x7f1e0c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:46.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.069+0000 7f1e13e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e0c102ba0 0x7f1e0c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:46.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.069+0000 7f1e13e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e0c107320 0x7f1e0c19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:46.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.069+0000 7f1e13e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c19d420 con 0x7f1e0c107320 2024-09-13T15:55:46.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.069+0000 7f1e13e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c19d590 con 0x7f1e0c102ba0 2024-09-13T15:55:46.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.069+0000 7f1e13e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c19d700 con 0x7f1e0c1021f0 2024-09-13T15:55:46.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.069+0000 7f1e11400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e0c1021f0 0x7f1e0c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:46.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.069+0000 7f1e11400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e0c1021f0 0x7f1e0c198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:45090/0 (socket says 172.21.15.17:45090) 2024-09-13T15:55:46.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.069+0000 7f1e11400640 1 -- 172.21.15.17:0/3634063608 learned_addr learned my addr 172.21.15.17:0/3634063608 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:46.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.070+0000 7f1e11e00640 1 --2- 172.21.15.17:0/3634063608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e0c107320 0x7f1e0c19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:46.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.070+0000 7f1e10a00640 1 --2- 172.21.15.17:0/3634063608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e0c102ba0 0x7f1e0c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:46.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.070+0000 7f1e11400640 1 -- 172.21.15.17:0/3634063608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e0c102ba0 msgr2=0x7f1e0c198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:46.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.070+0000 7f1e11400640 1 --2- 172.21.15.17:0/3634063608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e0c102ba0 0x7f1e0c198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:46.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.070+0000 7f1e11400640 1 -- 172.21.15.17:0/3634063608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e0c107320 msgr2=0x7f1e0c19ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:46.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.070+0000 7f1e11400640 1 --2- 172.21.15.17:0/3634063608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e0c107320 0x7f1e0c19ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:46.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.070+0000 7f1e11400640 1 -- 172.21.15.17:0/3634063608 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df8009560 con 0x7f1e0c1021f0 2024-09-13T15:55:46.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.070+0000 7f1e11400640 1 --2- 172.21.15.17:0/3634063608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e0c1021f0 0x7f1e0c198530 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1e0000e9f0 tx=0x7f1e0000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:46.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.071+0000 7f1e0a000640 1 -- 172.21.15.17:0/3634063608 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e00009700 con 0x7f1e0c1021f0 2024-09-13T15:55:46.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.071+0000 7f1e13e00640 1 -- 172.21.15.17:0/3634063608 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e0c19d9e0 con 0x7f1e0c1021f0 2024-09-13T15:55:46.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.071+0000 7f1e0a000640 1 -- 172.21.15.17:0/3634063608 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1e0000cd80 con 0x7f1e0c1021f0 2024-09-13T15:55:46.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.071+0000 7f1e0a000640 1 -- 172.21.15.17:0/3634063608 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e00018860 con 0x7f1e0c1021f0 2024-09-13T15:55:46.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.071+0000 7f1e13e00640 1 -- 172.21.15.17:0/3634063608 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e0c1a52a0 con 0x7f1e0c1021f0 2024-09-13T15:55:46.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.072+0000 7f1e13e00640 1 -- 172.21.15.17:0/3634063608 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1e0c1036d0 con 0x7f1e0c1021f0 2024-09-13T15:55:46.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.074+0000 7f1e0a000640 1 -- 172.21.15.17:0/3634063608 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f1e000189c0 con 0x7f1e0c1021f0 2024-09-13T15:55:46.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.075+0000 7f1e0a000640 1 --2- 172.21.15.17:0/3634063608 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1df40a1110 0x7f1df40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:46.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.075+0000 7f1e0a000640 1 -- 172.21.15.17:0/3634063608 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f1e00014070 con 0x7f1e0c1021f0 2024-09-13T15:55:46.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.076+0000 7f1e10a00640 1 --2- 172.21.15.17:0/3634063608 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1df40a1110 0x7f1df40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:46.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.076+0000 7f1e0a000640 1 --2- 172.21.15.17:0/3634063608 >> [v2:172.21.15.193:6808/1330877824,v1:172.21.15.193:6809/1330877824] conn(0x7f1df40ac1a0 0x7f1df40ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:46.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.076+0000 7f1e0a000640 1 -- 172.21.15.17:0/3634063608 --> [v2:172.21.15.193:6808/1330877824,v1:172.21.15.193:6809/1330877824] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1df40aed10 con 0x7f1df40ac1a0 2024-09-13T15:55:46.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.076+0000 7f1e0a000640 1 -- 172.21.15.17:0/3634063608 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e000cda90 con 0x7f1e0c1021f0 2024-09-13T15:55:46.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.076+0000 7f1e11e00640 1 --2- 172.21.15.17:0/3634063608 >> [v2:172.21.15.193:6808/1330877824,v1:172.21.15.193:6809/1330877824] conn(0x7f1df40ac1a0 0x7f1df40ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:46.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.076+0000 7f1e10a00640 1 --2- 172.21.15.17:0/3634063608 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1df40a1110 0x7f1df40a35d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1df8031440 tx=0x7f1df8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:46.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.077+0000 7f1e11e00640 1 --2- 172.21.15.17:0/3634063608 >> [v2:172.21.15.193:6808/1330877824,v1:172.21.15.193:6809/1330877824] conn(0x7f1df40ac1a0 0x7f1df40ae640 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:46.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.077+0000 7f1e0a000640 1 -- 172.21.15.17:0/3634063608 <== osd.5 v2:172.21.15.193:6808/1330877824 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1df40aed10 con 0x7f1df40ac1a0 2024-09-13T15:55:46.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.092+0000 7f1e13e00640 1 -- 172.21.15.17:0/3634063608 --> [v2:172.21.15.193:6808/1330877824,v1:172.21.15.193:6809/1330877824] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1e0c1122c0 con 0x7f1df40ac1a0 2024-09-13T15:55:46.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.093+0000 7f1e0a000640 1 -- 172.21.15.17:0/3634063608 <== osd.5 v2:172.21.15.193:6808/1330877824 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f1e04009b20 con 0x7f1df40ac1a0 2024-09-13T15:55:46.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.093+0000 7f1e13e00640 1 -- 172.21.15.17:0/3634063608 >> [v2:172.21.15.193:6808/1330877824,v1:172.21.15.193:6809/1330877824] conn(0x7f1df40ac1a0 msgr2=0x7f1df40ae640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:46.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.093+0000 7f1e13e00640 1 --2- 172.21.15.17:0/3634063608 >> [v2:172.21.15.193:6808/1330877824,v1:172.21.15.193:6809/1330877824] conn(0x7f1df40ac1a0 0x7f1df40ae640 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:46.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.093+0000 7f1e13e00640 1 -- 172.21.15.17:0/3634063608 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1df40a1110 msgr2=0x7f1df40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:46.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.093+0000 7f1e13e00640 1 --2- 172.21.15.17:0/3634063608 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1df40a1110 0x7f1df40a35d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1df8031440 tx=0x7f1df8005a20 comp rx=0 tx=0).stop 2024-09-13T15:55:46.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.093+0000 7f1e13e00640 1 -- 172.21.15.17:0/3634063608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e0c1021f0 msgr2=0x7f1e0c198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:46.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.093+0000 7f1e13e00640 1 --2- 172.21.15.17:0/3634063608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e0c1021f0 0x7f1e0c198530 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1e0000e9f0 tx=0x7f1e0000eeb0 comp rx=0 tx=0).stop 2024-09-13T15:55:46.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.093+0000 7f1e11e00640 1 -- 172.21.15.17:0/3634063608 reap_dead start 2024-09-13T15:55:46.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.093+0000 7f1e13e00640 1 -- 172.21.15.17:0/3634063608 shutdown_connections 2024-09-13T15:55:46.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.093+0000 7f1e13e00640 1 -- 172.21.15.17:0/3634063608 >> 172.21.15.17:0/3634063608 conn(0x7f1e0c0fdc70 msgr2=0x7f1e0c0ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:46.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.093+0000 7f1e13e00640 1 -- 172.21.15.17:0/3634063608 shutdown_connections 2024-09-13T15:55:46.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.094+0000 7f1e13e00640 1 -- 172.21.15.17:0/3634063608 wait complete. 2024-09-13T15:55:47.181 INFO:teuthology.orchestra.run.smithi017.stdout:347892350999 2024-09-13T15:55:47.181 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-13T15:55:47.408 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:47 smithi017 ceph-mon[30494]: pgmap v324: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 383 B/s wr, 6 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-13T15:55:47.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:47 smithi193 ceph-mon[35248]: pgmap v324: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 383 B/s wr, 6 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-13T15:55:47.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:47 smithi189 ceph-mon[34790]: pgmap v324: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 383 B/s wr, 6 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-13T15:55:48.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.850+0000 7f980b200640 1 -- 172.21.15.17:0/2041432434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f980c072880 msgr2=0x7f980c072c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:48.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.850+0000 7f980b200640 1 --2- 172.21.15.17:0/2041432434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f980c072880 0x7f980c072c60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f97fc009900 tx=0x7f97fc02a480 comp rx=0 tx=0).stop 2024-09-13T15:55:48.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.850+0000 7f980b200640 1 -- 172.21.15.17:0/2041432434 shutdown_connections 2024-09-13T15:55:48.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.850+0000 7f980b200640 1 --2- 172.21.15.17:0/2041432434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f980c10c460 0x7f980c10e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:48.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.850+0000 7f980b200640 1 --2- 172.21.15.17:0/2041432434 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f980c0731a0 0x7f980c10bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:48.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.850+0000 7f980b200640 1 --2- 172.21.15.17:0/2041432434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f980c072880 0x7f980c072c60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:48.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.850+0000 7f980b200640 1 -- 172.21.15.17:0/2041432434 >> 172.21.15.17:0/2041432434 conn(0x7f980c0fb900 msgr2=0x7f980c0fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:48.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.850+0000 7f980b200640 1 -- 172.21.15.17:0/2041432434 shutdown_connections 2024-09-13T15:55:48.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.851+0000 7f980b200640 1 -- 172.21.15.17:0/2041432434 wait complete. 2024-09-13T15:55:48.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.852+0000 7f980b200640 1 Processor -- start 2024-09-13T15:55:48.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.852+0000 7f980b200640 1 -- start start 2024-09-13T15:55:48.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.853+0000 7f980b200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f980c072880 0x7f980c1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:48.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.853+0000 7f980b200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f980c0731a0 0x7f980c198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:48.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.853+0000 7f980b200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f980c10c460 0x7f980c19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:48.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.853+0000 7f980b200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c19d220 con 0x7f980c10c460 2024-09-13T15:55:48.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.853+0000 7f980b200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c19d390 con 0x7f980c0731a0 2024-09-13T15:55:48.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.853+0000 7f980b200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c19d500 con 0x7f980c072880 2024-09-13T15:55:48.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.853+0000 7f980a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f980c10c460 0x7f980c19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:48.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.853+0000 7f9809400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f980c0731a0 0x7f980c198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.853+0000 7f9809400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f980c0731a0 0x7f980c198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:57252/0 (socket says 172.21.15.17:57252) 2024-09-13T15:55:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.853+0000 7f980a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f980c10c460 0x7f980c19cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42174/0 (socket says 172.21.15.17:42174) 2024-09-13T15:55:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.853+0000 7f9809400640 1 -- 172.21.15.17:0/3265786320 learned_addr learned my addr 172.21.15.17:0/3265786320 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.853+0000 7f9809e00640 1 --2- 172.21.15.17:0/3265786320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f980c072880 0x7f980c1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.853+0000 7f980a800640 1 -- 172.21.15.17:0/3265786320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f980c072880 msgr2=0x7f980c1982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.853+0000 7f980a800640 1 --2- 172.21.15.17:0/3265786320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f980c072880 0x7f980c1982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.853+0000 7f980a800640 1 -- 172.21.15.17:0/3265786320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f980c0731a0 msgr2=0x7f980c198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.853+0000 7f980a800640 1 --2- 172.21.15.17:0/3265786320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f980c0731a0 0x7f980c198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.853+0000 7f980a800640 1 -- 172.21.15.17:0/3265786320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97fc009560 con 0x7f980c10c460 2024-09-13T15:55:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.854+0000 7f980a800640 1 --2- 172.21.15.17:0/3265786320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f980c10c460 0x7f980c19cc20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9804005fd0 tx=0x7f980400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.854+0000 7f9802a00640 1 -- 172.21.15.17:0/3265786320 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980400cdf0 con 0x7f980c10c460 2024-09-13T15:55:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.854+0000 7f9802a00640 1 -- 172.21.15.17:0/3265786320 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9804005020 con 0x7f980c10c460 2024-09-13T15:55:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.854+0000 7f980b200640 1 -- 172.21.15.17:0/3265786320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f980c19d7e0 con 0x7f980c10c460 2024-09-13T15:55:48.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.854+0000 7f9802a00640 1 -- 172.21.15.17:0/3265786320 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9804010670 con 0x7f980c10c460 2024-09-13T15:55:48.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.854+0000 7f980b200640 1 -- 172.21.15.17:0/3265786320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980c1a50a0 con 0x7f980c10c460 2024-09-13T15:55:48.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.855+0000 7f980b200640 1 -- 172.21.15.17:0/3265786320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f980c073f30 con 0x7f980c10c460 2024-09-13T15:55:48.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.857+0000 7f9802a00640 1 -- 172.21.15.17:0/3265786320 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f9804005450 con 0x7f980c10c460 2024-09-13T15:55:48.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.858+0000 7f9802a00640 1 --2- 172.21.15.17:0/3265786320 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f97f00a1100 0x7f97f00a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:48.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.859+0000 7f9802a00640 1 -- 172.21.15.17:0/3265786320 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f9804014070 con 0x7f980c10c460 2024-09-13T15:55:48.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.859+0000 7f9809e00640 1 --2- 172.21.15.17:0/3265786320 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f97f00a1100 0x7f97f00a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:48.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.859+0000 7f9802a00640 1 --2- 172.21.15.17:0/3265786320 >> [v2:172.21.15.193:6816/4112907498,v1:172.21.15.193:6817/4112907498] conn(0x7f97f00ac190 0x7f97f00ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.859+0000 7f9802a00640 1 -- 172.21.15.17:0/3265786320 --> [v2:172.21.15.193:6816/4112907498,v1:172.21.15.193:6817/4112907498] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f97f00aed00 con 0x7f97f00ac190 2024-09-13T15:55:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.859+0000 7f9802a00640 1 -- 172.21.15.17:0/3265786320 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98040cf840 con 0x7f980c10c460 2024-09-13T15:55:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.859+0000 7f9809400640 1 --2- 172.21.15.17:0/3265786320 >> [v2:172.21.15.193:6816/4112907498,v1:172.21.15.193:6817/4112907498] conn(0x7f97f00ac190 0x7f97f00ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.859+0000 7f9809e00640 1 --2- 172.21.15.17:0/3265786320 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f97f00a1100 0x7f97f00a35c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f97fc005ab0 tx=0x7f97fc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.860+0000 7f9809400640 1 --2- 172.21.15.17:0/3265786320 >> [v2:172.21.15.193:6816/4112907498,v1:172.21.15.193:6817/4112907498] conn(0x7f97f00ac190 0x7f97f00ae630 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.861+0000 7f9802a00640 1 -- 172.21.15.17:0/3265786320 <== osd.8 v2:172.21.15.193:6816/4112907498 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f97f00aed00 con 0x7f97f00ac190 2024-09-13T15:55:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.875+0000 7f980b200640 1 -- 172.21.15.17:0/3265786320 --> [v2:172.21.15.193:6816/4112907498,v1:172.21.15.193:6817/4112907498] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f980c112130 con 0x7f97f00ac190 2024-09-13T15:55:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.876+0000 7f9802a00640 1 -- 172.21.15.17:0/3265786320 <== osd.8 v2:172.21.15.193:6816/4112907498 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f97f80099c0 con 0x7f97f00ac190 2024-09-13T15:55:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.876+0000 7f980b200640 1 -- 172.21.15.17:0/3265786320 >> [v2:172.21.15.193:6816/4112907498,v1:172.21.15.193:6817/4112907498] conn(0x7f97f00ac190 msgr2=0x7f97f00ae630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:48.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.876+0000 7f980b200640 1 --2- 172.21.15.17:0/3265786320 >> [v2:172.21.15.193:6816/4112907498,v1:172.21.15.193:6817/4112907498] conn(0x7f97f00ac190 0x7f97f00ae630 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:48.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.876+0000 7f980b200640 1 -- 172.21.15.17:0/3265786320 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f97f00a1100 msgr2=0x7f97f00a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:48.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.876+0000 7f980b200640 1 --2- 172.21.15.17:0/3265786320 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f97f00a1100 0x7f97f00a35c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f97fc005ab0 tx=0x7f97fc005a20 comp rx=0 tx=0).stop 2024-09-13T15:55:48.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.876+0000 7f980b200640 1 -- 172.21.15.17:0/3265786320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f980c10c460 msgr2=0x7f980c19cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:48.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.876+0000 7f980b200640 1 --2- 172.21.15.17:0/3265786320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f980c10c460 0x7f980c19cc20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9804005fd0 tx=0x7f980400ef10 comp rx=0 tx=0).stop 2024-09-13T15:55:48.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.876+0000 7f980a800640 1 -- 172.21.15.17:0/3265786320 reap_dead start 2024-09-13T15:55:48.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.876+0000 7f980b200640 1 -- 172.21.15.17:0/3265786320 shutdown_connections 2024-09-13T15:55:48.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.876+0000 7f980b200640 1 -- 172.21.15.17:0/3265786320 >> 172.21.15.17:0/3265786320 conn(0x7f980c0fb900 msgr2=0x7f980c0fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:48.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.876+0000 7f980b200640 1 -- 172.21.15.17:0/3265786320 shutdown_connections 2024-09-13T15:55:48.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:46.877+0000 7f980b200640 1 -- 172.21.15.17:0/3265786320 wait complete. 2024-09-13T15:55:49.254 INFO:teuthology.orchestra.run.smithi017.stdout:167503724598 2024-09-13T15:55:49.254 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-13T15:55:49.303 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:49 smithi017 ceph-mon[30494]: pgmap v325: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 383 B/s wr, 6 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-13T15:55:49.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:49 smithi193 ceph-mon[35248]: pgmap v325: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 383 B/s wr, 6 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-13T15:55:49.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:49 smithi189 ceph-mon[34790]: pgmap v325: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 383 B/s wr, 6 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-13T15:55:50.557 INFO:teuthology.orchestra.run.smithi017.stdout:257698037800 2024-09-13T15:55:50.558 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-13T15:55:51.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:51 smithi193 ceph-mon[35248]: pgmap v326: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 383 B/s wr, 4 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-13T15:55:51.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:51 smithi017 ceph-mon[30494]: pgmap v326: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 383 B/s wr, 4 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-13T15:55:51.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:51 smithi189 ceph-mon[34790]: pgmap v326: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 383 B/s wr, 4 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-13T15:55:51.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.797+0000 7f1cefe00640 1 -- 172.21.15.17:0/2166241527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf00749e0 msgr2=0x7f1cf0074dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:51.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.797+0000 7f1cefe00640 1 --2- 172.21.15.17:0/2166241527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf00749e0 0x7f1cf0074dc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009900 tx=0x7f1ce002a410 comp rx=0 tx=0).stop 2024-09-13T15:55:51.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.797+0000 7f1cefe00640 1 -- 172.21.15.17:0/2166241527 shutdown_connections 2024-09-13T15:55:51.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.797+0000 7f1cefe00640 1 --2- 172.21.15.17:0/2166241527 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cf0110a50 0x7f1cf0112e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:51.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.797+0000 7f1cefe00640 1 --2- 172.21.15.17:0/2166241527 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cf0075300 0x7f1cf0110510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:51.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.797+0000 7f1cefe00640 1 --2- 172.21.15.17:0/2166241527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf00749e0 0x7f1cf0074dc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:51.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.797+0000 7f1cefe00640 1 -- 172.21.15.17:0/2166241527 >> 172.21.15.17:0/2166241527 conn(0x7f1cf00fda70 msgr2=0x7f1cf00ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:51.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.797+0000 7f1cefe00640 1 -- 172.21.15.17:0/2166241527 shutdown_connections 2024-09-13T15:55:51.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.797+0000 7f1cefe00640 1 -- 172.21.15.17:0/2166241527 wait complete. 2024-09-13T15:55:51.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.798+0000 7f1cefe00640 1 Processor -- start 2024-09-13T15:55:51.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.799+0000 7f1cefe00640 1 -- start start 2024-09-13T15:55:51.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.799+0000 7f1cefe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf00749e0 0x7f1cf019c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:51.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.799+0000 7f1cefe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cf0075300 0x7f1cf019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:51.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.799+0000 7f1cefe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cf0110a50 0x7f1cf019ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:51.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.799+0000 7f1cefe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf01a05d0 con 0x7f1cf00749e0 2024-09-13T15:55:51.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.799+0000 7f1cefe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf01a0740 con 0x7f1cf0110a50 2024-09-13T15:55:51.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.799+0000 7f1cefe00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf01a0900 con 0x7f1cf0075300 2024-09-13T15:55:51.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.799+0000 7f1ceea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf00749e0 0x7f1cf019c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:51.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.799+0000 7f1ce7e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cf0075300 0x7f1cf019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:51.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.799+0000 7f1ce7e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cf0075300 0x7f1cf019cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:34962/0 (socket says 172.21.15.17:34962) 2024-09-13T15:55:51.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.799+0000 7f1ceea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf00749e0 0x7f1cf019c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37078/0 (socket says 172.21.15.17:37078) 2024-09-13T15:55:51.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.799+0000 7f1ce7e00640 1 -- 172.21.15.17:0/3673712213 learned_addr learned my addr 172.21.15.17:0/3673712213 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:51.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.800+0000 7f1cef400640 1 --2- 172.21.15.17:0/3673712213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cf0110a50 0x7f1cf019ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:51.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.800+0000 7f1ce7e00640 1 -- 172.21.15.17:0/3673712213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cf0110a50 msgr2=0x7f1cf019ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:51.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.800+0000 7f1ce7e00640 1 --2- 172.21.15.17:0/3673712213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cf0110a50 0x7f1cf019ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:51.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.800+0000 7f1ce7e00640 1 -- 172.21.15.17:0/3673712213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf00749e0 msgr2=0x7f1cf019c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:51.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.800+0000 7f1ce7e00640 1 --2- 172.21.15.17:0/3673712213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf00749e0 0x7f1cf019c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:51.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.800+0000 7f1ce7e00640 1 -- 172.21.15.17:0/3673712213 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce0009560 con 0x7f1cf0075300 2024-09-13T15:55:51.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.800+0000 7f1ce7e00640 1 --2- 172.21.15.17:0/3673712213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cf0075300 0x7f1cf019cc80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800e9f0 tx=0x7f1cd800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:51.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.800+0000 7f1ce7400640 1 -- 172.21.15.17:0/3673712213 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8009720 con 0x7f1cf0075300 2024-09-13T15:55:51.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.801+0000 7f1cefe00640 1 -- 172.21.15.17:0/3673712213 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf01a0be0 con 0x7f1cf0075300 2024-09-13T15:55:51.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.801+0000 7f1ce7400640 1 -- 172.21.15.17:0/3673712213 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1cd800cd80 con 0x7f1cf0075300 2024-09-13T15:55:51.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.801+0000 7f1ce7400640 1 -- 172.21.15.17:0/3673712213 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8010430 con 0x7f1cf0075300 2024-09-13T15:55:51.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.801+0000 7f1cefe00640 1 -- 172.21.15.17:0/3673712213 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf01a9530 con 0x7f1cf0075300 2024-09-13T15:55:51.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.802+0000 7f1cefe00640 1 -- 172.21.15.17:0/3673712213 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1cf0116570 con 0x7f1cf0075300 2024-09-13T15:55:51.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.806+0000 7f1ce7400640 1 -- 172.21.15.17:0/3673712213 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f1cd8005020 con 0x7f1cf0075300 2024-09-13T15:55:51.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.808+0000 7f1ce7400640 1 --2- 172.21.15.17:0/3673712213 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1cd40a1180 0x7f1cd40a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:51.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.808+0000 7f1ce7400640 1 -- 172.21.15.17:0/3673712213 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f1cd8014070 con 0x7f1cf0075300 2024-09-13T15:55:51.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.809+0000 7f1ce7400640 1 --2- 172.21.15.17:0/3673712213 >> [v2:172.21.15.189:6824/3153990375,v1:172.21.15.189:6825/3153990375] conn(0x7f1cd40ac210 0x7f1cd40ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:51.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.809+0000 7f1ce7400640 1 -- 172.21.15.17:0/3673712213 --> [v2:172.21.15.189:6824/3153990375,v1:172.21.15.189:6825/3153990375] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1cd40aed80 con 0x7f1cd40ac210 2024-09-13T15:55:51.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.809+0000 7f1ce7400640 1 -- 172.21.15.17:0/3673712213 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cd80cf510 con 0x7f1cf0075300 2024-09-13T15:55:51.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.809+0000 7f1ceea00640 1 --2- 172.21.15.17:0/3673712213 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1cd40a1180 0x7f1cd40a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:51.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.810+0000 7f1cef400640 1 --2- 172.21.15.17:0/3673712213 >> [v2:172.21.15.189:6824/3153990375,v1:172.21.15.189:6825/3153990375] conn(0x7f1cd40ac210 0x7f1cd40ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:51.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.810+0000 7f1ceea00640 1 --2- 172.21.15.17:0/3673712213 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1cd40a1180 0x7f1cd40a3640 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0005ab0 tx=0x7f1ce0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:51.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.810+0000 7f1cef400640 1 --2- 172.21.15.17:0/3673712213 >> [v2:172.21.15.189:6824/3153990375,v1:172.21.15.189:6825/3153990375] conn(0x7f1cd40ac210 0x7f1cd40ae6b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:51.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.812+0000 7f1ce7400640 1 -- 172.21.15.17:0/3673712213 <== osd.10 v2:172.21.15.189:6824/3153990375 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1cd40aed80 con 0x7f1cd40ac210 2024-09-13T15:55:51.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.834+0000 7f1cefe00640 1 -- 172.21.15.17:0/3673712213 --> [v2:172.21.15.189:6824/3153990375,v1:172.21.15.189:6825/3153990375] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1cf0060bb0 con 0x7f1cd40ac210 2024-09-13T15:55:51.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.835+0000 7f1ce7400640 1 -- 172.21.15.17:0/3673712213 <== osd.10 v2:172.21.15.189:6824/3153990375 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f1cf0060bb0 con 0x7f1cd40ac210 2024-09-13T15:55:51.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.836+0000 7f1cefe00640 1 -- 172.21.15.17:0/3673712213 >> [v2:172.21.15.189:6824/3153990375,v1:172.21.15.189:6825/3153990375] conn(0x7f1cd40ac210 msgr2=0x7f1cd40ae6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:51.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.836+0000 7f1cefe00640 1 --2- 172.21.15.17:0/3673712213 >> [v2:172.21.15.189:6824/3153990375,v1:172.21.15.189:6825/3153990375] conn(0x7f1cd40ac210 0x7f1cd40ae6b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:51.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.836+0000 7f1cefe00640 1 -- 172.21.15.17:0/3673712213 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1cd40a1180 msgr2=0x7f1cd40a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:51.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.836+0000 7f1cefe00640 1 --2- 172.21.15.17:0/3673712213 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1cd40a1180 0x7f1cd40a3640 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0005ab0 tx=0x7f1ce0005a20 comp rx=0 tx=0).stop 2024-09-13T15:55:51.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.836+0000 7f1cefe00640 1 -- 172.21.15.17:0/3673712213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cf0075300 msgr2=0x7f1cf019cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:51.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.836+0000 7f1cefe00640 1 --2- 172.21.15.17:0/3673712213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cf0075300 0x7f1cf019cc80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800e9f0 tx=0x7f1cd800edf0 comp rx=0 tx=0).stop 2024-09-13T15:55:51.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.836+0000 7f1cef400640 1 -- 172.21.15.17:0/3673712213 reap_dead start 2024-09-13T15:55:51.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.836+0000 7f1cefe00640 1 -- 172.21.15.17:0/3673712213 shutdown_connections 2024-09-13T15:55:51.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.836+0000 7f1cefe00640 1 -- 172.21.15.17:0/3673712213 >> 172.21.15.17:0/3673712213 conn(0x7f1cf00fda70 msgr2=0x7f1cf00ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:51.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.837+0000 7f1cefe00640 1 -- 172.21.15.17:0/3673712213 shutdown_connections 2024-09-13T15:55:51.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:51.837+0000 7f1cefe00640 1 -- 172.21.15.17:0/3673712213 wait complete. 2024-09-13T15:55:52.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.613+0000 7fd4e1a00640 1 -- 172.21.15.17:0/1485153064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4dc072850 msgr2=0x7fd4dc072c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:52.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.613+0000 7fd4e1a00640 1 --2- 172.21.15.17:0/1485153064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4dc072850 0x7fd4dc072c30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc009900 tx=0x7fd4cc02a480 comp rx=0 tx=0).stop 2024-09-13T15:55:52.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.613+0000 7fd4e1a00640 1 -- 172.21.15.17:0/1485153064 shutdown_connections 2024-09-13T15:55:52.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.613+0000 7fd4e1a00640 1 --2- 172.21.15.17:0/1485153064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4dc110da0 0x7fd4dc113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:52.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.613+0000 7fd4e1a00640 1 --2- 172.21.15.17:0/1485153064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd4dc073170 0x7fd4dc110860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:52.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.613+0000 7fd4e1a00640 1 --2- 172.21.15.17:0/1485153064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4dc072850 0x7fd4dc072c30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:52.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.613+0000 7fd4e1a00640 1 -- 172.21.15.17:0/1485153064 >> 172.21.15.17:0/1485153064 conn(0x7fd4dc0fba90 msgr2=0x7fd4dc0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:52.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.613+0000 7fd4e1a00640 1 -- 172.21.15.17:0/1485153064 shutdown_connections 2024-09-13T15:55:52.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.613+0000 7fd4e1a00640 1 -- 172.21.15.17:0/1485153064 wait complete. 2024-09-13T15:55:52.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.614+0000 7fd4e1a00640 1 Processor -- start 2024-09-13T15:55:52.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.614+0000 7fd4e1a00640 1 -- start start 2024-09-13T15:55:52.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.614+0000 7fd4e1a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4dc072850 0x7fd4dc19c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:52.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.614+0000 7fd4e1a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd4dc073170 0x7fd4dc19cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:52.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.614+0000 7fd4e1a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4dc110da0 0x7fd4dc1a11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:52.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.614+0000 7fd4e1a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4dc1a17e0 con 0x7fd4dc110da0 2024-09-13T15:55:52.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.614+0000 7fd4e1a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4dc1a1950 con 0x7fd4dc072850 2024-09-13T15:55:52.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.614+0000 7fd4e1a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4dc1a1b10 con 0x7fd4dc073170 2024-09-13T15:55:52.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.615+0000 7fd4daa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4dc072850 0x7fd4dc19c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:52.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.615+0000 7fd4daa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4dc072850 0x7fd4dc19c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:38114/0 (socket says 172.21.15.17:38114) 2024-09-13T15:55:52.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.615+0000 7fd4daa00640 1 -- 172.21.15.17:0/356149084 learned_addr learned my addr 172.21.15.17:0/356149084 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:52.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.615+0000 7fd4d2000640 1 --2- 172.21.15.17:0/356149084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd4dc073170 0x7fd4dc19cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:52.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.615+0000 7fd4db400640 1 --2- 172.21.15.17:0/356149084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4dc110da0 0x7fd4dc1a11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:52.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.615+0000 7fd4daa00640 1 -- 172.21.15.17:0/356149084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd4dc073170 msgr2=0x7fd4dc19cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:52.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.615+0000 7fd4daa00640 1 --2- 172.21.15.17:0/356149084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd4dc073170 0x7fd4dc19cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:52.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.615+0000 7fd4daa00640 1 -- 172.21.15.17:0/356149084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4dc110da0 msgr2=0x7fd4dc1a11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:52.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.615+0000 7fd4daa00640 1 --2- 172.21.15.17:0/356149084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4dc110da0 0x7fd4dc1a11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:52.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.615+0000 7fd4daa00640 1 -- 172.21.15.17:0/356149084 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d4009840 con 0x7fd4dc072850 2024-09-13T15:55:52.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.615+0000 7fd4d2000640 1 --2- 172.21.15.17:0/356149084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd4dc073170 0x7fd4dc19cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:55:52.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.615+0000 7fd4db400640 1 --2- 172.21.15.17:0/356149084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4dc110da0 0x7fd4dc1a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:55:52.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.615+0000 7fd4daa00640 1 --2- 172.21.15.17:0/356149084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4dc072850 0x7fd4dc19c9b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc005ab0 tx=0x7fd4cc005600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:52.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.616+0000 7fd4d3e00640 1 -- 172.21.15.17:0/356149084 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc004b90 con 0x7fd4dc072850 2024-09-13T15:55:52.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.616+0000 7fd4e1a00640 1 -- 172.21.15.17:0/356149084 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4cc009560 con 0x7fd4dc072850 2024-09-13T15:55:52.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.616+0000 7fd4d3e00640 1 -- 172.21.15.17:0/356149084 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd4cc004cf0 con 0x7fd4dc072850 2024-09-13T15:55:52.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.616+0000 7fd4d3e00640 1 -- 172.21.15.17:0/356149084 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc031840 con 0x7fd4dc072850 2024-09-13T15:55:52.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.616+0000 7fd4e1a00640 1 -- 172.21.15.17:0/356149084 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4dc1a94b0 con 0x7fd4dc072850 2024-09-13T15:55:52.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.617+0000 7fd4e1a00640 1 -- 172.21.15.17:0/356149084 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd4dc073f90 con 0x7fd4dc072850 2024-09-13T15:55:52.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.619+0000 7fd4d3e00640 1 -- 172.21.15.17:0/356149084 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fd4cc0035f0 con 0x7fd4dc072850 2024-09-13T15:55:52.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.621+0000 7fd4d3e00640 1 --2- 172.21.15.17:0/356149084 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd4c00a1190 0x7fd4c00a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:52.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.621+0000 7fd4d3e00640 1 -- 172.21.15.17:0/356149084 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fd4cc0ee1f0 con 0x7fd4dc072850 2024-09-13T15:55:52.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.621+0000 7fd4d2000640 1 --2- 172.21.15.17:0/356149084 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd4c00a1190 0x7fd4c00a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:52.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.621+0000 7fd4d3e00640 1 --2- 172.21.15.17:0/356149084 >> [v2:172.21.15.189:6808/2310375565,v1:172.21.15.189:6809/2310375565] conn(0x7fd4c00ac220 0x7fd4c00ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:52.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.621+0000 7fd4d3e00640 1 -- 172.21.15.17:0/356149084 --> [v2:172.21.15.189:6808/2310375565,v1:172.21.15.189:6809/2310375565] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4c00aed90 con 0x7fd4c00ac220 2024-09-13T15:55:52.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.621+0000 7fd4d3e00640 1 -- 172.21.15.17:0/356149084 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4cc0ee560 con 0x7fd4dc072850 2024-09-13T15:55:52.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.622+0000 7fd4db400640 1 --2- 172.21.15.17:0/356149084 >> [v2:172.21.15.189:6808/2310375565,v1:172.21.15.189:6809/2310375565] conn(0x7fd4c00ac220 0x7fd4c00ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:52.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.622+0000 7fd4d2000640 1 --2- 172.21.15.17:0/356149084 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd4c00a1190 0x7fd4c00a3650 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc19de50 tx=0x7fd4c4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:52.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.622+0000 7fd4db400640 1 --2- 172.21.15.17:0/356149084 >> [v2:172.21.15.189:6808/2310375565,v1:172.21.15.189:6809/2310375565] conn(0x7fd4c00ac220 0x7fd4c00ae6c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:52.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.623+0000 7fd4d3e00640 1 -- 172.21.15.17:0/356149084 <== osd.4 v2:172.21.15.189:6808/2310375565 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd4c00aed90 con 0x7fd4c00ac220 2024-09-13T15:55:52.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.638+0000 7fd4e1a00640 1 -- 172.21.15.17:0/356149084 --> [v2:172.21.15.189:6808/2310375565,v1:172.21.15.189:6809/2310375565] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd4dc1166c0 con 0x7fd4c00ac220 2024-09-13T15:55:52.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.638+0000 7fd4d3e00640 1 -- 172.21.15.17:0/356149084 <== osd.4 v2:172.21.15.189:6808/2310375565 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd4d4004b40 con 0x7fd4c00ac220 2024-09-13T15:55:52.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.639+0000 7fd4e1a00640 1 -- 172.21.15.17:0/356149084 >> [v2:172.21.15.189:6808/2310375565,v1:172.21.15.189:6809/2310375565] conn(0x7fd4c00ac220 msgr2=0x7fd4c00ae6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:52.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.639+0000 7fd4e1a00640 1 --2- 172.21.15.17:0/356149084 >> [v2:172.21.15.189:6808/2310375565,v1:172.21.15.189:6809/2310375565] conn(0x7fd4c00ac220 0x7fd4c00ae6c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:52.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.639+0000 7fd4e1a00640 1 -- 172.21.15.17:0/356149084 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd4c00a1190 msgr2=0x7fd4c00a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:52.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.639+0000 7fd4e1a00640 1 --2- 172.21.15.17:0/356149084 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd4c00a1190 0x7fd4c00a3650 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc19de50 tx=0x7fd4c4005f90 comp rx=0 tx=0).stop 2024-09-13T15:55:52.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.639+0000 7fd4e1a00640 1 -- 172.21.15.17:0/356149084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4dc072850 msgr2=0x7fd4dc19c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:52.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.639+0000 7fd4e1a00640 1 --2- 172.21.15.17:0/356149084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4dc072850 0x7fd4dc19c9b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc005ab0 tx=0x7fd4cc005600 comp rx=0 tx=0).stop 2024-09-13T15:55:52.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.639+0000 7fd4db400640 1 -- 172.21.15.17:0/356149084 reap_dead start 2024-09-13T15:55:52.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.639+0000 7fd4e1a00640 1 -- 172.21.15.17:0/356149084 shutdown_connections 2024-09-13T15:55:52.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.639+0000 7fd4e1a00640 1 -- 172.21.15.17:0/356149084 >> 172.21.15.17:0/356149084 conn(0x7fd4dc0fba90 msgr2=0x7fd4dc0fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:52.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.639+0000 7fd4e1a00640 1 -- 172.21.15.17:0/356149084 shutdown_connections 2024-09-13T15:55:52.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:52.639+0000 7fd4e1a00640 1 -- 172.21.15.17:0/356149084 wait complete. 2024-09-13T15:55:53.475 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:53 smithi017 ceph-mon[30494]: pgmap v327: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 309 B/s wr, 6 op/s; 6.0 KiB/s, 1 objects/s recovering 2024-09-13T15:55:53.475 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:53 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:55:53.484 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:53 smithi189 ceph-mon[34790]: pgmap v327: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 309 B/s wr, 6 op/s; 6.0 KiB/s, 1 objects/s recovering 2024-09-13T15:55:53.484 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:53 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:55:53.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:53 smithi193 ceph-mon[35248]: pgmap v327: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 309 B/s wr, 6 op/s; 6.0 KiB/s, 1 objects/s recovering 2024-09-13T15:55:53.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:53 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:55:53.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.707+0000 7f5391800640 1 -- 172.21.15.17:0/2473848230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f538c10b720 msgr2=0x7f538c1132a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:53.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.707+0000 7f5391800640 1 --2- 172.21.15.17:0/2473848230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f538c10b720 0x7f538c1132a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5384009cd0 tx=0x7f538402a8f0 comp rx=0 tx=0).stop 2024-09-13T15:55:53.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.707+0000 7f5391800640 1 -- 172.21.15.17:0/2473848230 shutdown_connections 2024-09-13T15:55:53.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.707+0000 7f5391800640 1 --2- 172.21.15.17:0/2473848230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f538c10b720 0x7f538c1132a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:53.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.707+0000 7f5391800640 1 --2- 172.21.15.17:0/2473848230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f538c106fa0 0x7f538c10aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:53.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.707+0000 7f5391800640 1 --2- 172.21.15.17:0/2473848230 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f538c1065f0 0x7f538c1069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:53.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.707+0000 7f5391800640 1 -- 172.21.15.17:0/2473848230 >> 172.21.15.17:0/2473848230 conn(0x7f538c075d10 msgr2=0x7f538c078130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:53.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.707+0000 7f5391800640 1 -- 172.21.15.17:0/2473848230 shutdown_connections 2024-09-13T15:55:53.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.707+0000 7f5391800640 1 -- 172.21.15.17:0/2473848230 wait complete. 2024-09-13T15:55:53.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.708+0000 7f5391800640 1 Processor -- start 2024-09-13T15:55:53.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.708+0000 7f5391800640 1 -- start start 2024-09-13T15:55:53.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.708+0000 7f5391800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f538c1065f0 0x7f538c1a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:53.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.708+0000 7f5391800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f538c106fa0 0x7f538c1a2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:53.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.708+0000 7f5391800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f538c10b720 0x7f538c19c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:53.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.708+0000 7f5391800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c19cdc0 con 0x7f538c106fa0 2024-09-13T15:55:53.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.708+0000 7f5391800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c19cf30 con 0x7f538c1065f0 2024-09-13T15:55:53.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.708+0000 7f5391800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c19d0f0 con 0x7f538c10b720 2024-09-13T15:55:53.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.709+0000 7f538aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f538c1065f0 0x7f538c1a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:53.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.709+0000 7f538b400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f538c10b720 0x7f538c19c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:53.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.709+0000 7f538aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f538c1065f0 0x7f538c1a2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:38142/0 (socket says 172.21.15.17:38142) 2024-09-13T15:55:53.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.709+0000 7f538aa00640 1 -- 172.21.15.17:0/2914416057 learned_addr learned my addr 172.21.15.17:0/2914416057 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:53.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.709+0000 7f538b400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f538c10b720 0x7f538c19c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:35018/0 (socket says 172.21.15.17:35018) 2024-09-13T15:55:53.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.709+0000 7f5383e00640 1 --2- 172.21.15.17:0/2914416057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f538c106fa0 0x7f538c1a2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:53.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.709+0000 7f538b400640 1 -- 172.21.15.17:0/2914416057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f538c1065f0 msgr2=0x7f538c1a2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:53.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.709+0000 7f538b400640 1 --2- 172.21.15.17:0/2914416057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f538c1065f0 0x7f538c1a2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:53.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.709+0000 7f538b400640 1 -- 172.21.15.17:0/2914416057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f538c106fa0 msgr2=0x7f538c1a2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:53.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.709+0000 7f538b400640 1 --2- 172.21.15.17:0/2914416057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f538c106fa0 0x7f538c1a2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:53.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.709+0000 7f538b400640 1 -- 172.21.15.17:0/2914416057 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c009490 con 0x7f538c10b720 2024-09-13T15:55:53.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.709+0000 7f538b400640 1 --2- 172.21.15.17:0/2914416057 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f538c10b720 0x7f538c19c680 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5384009ca0 tx=0x7f5384030f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:53.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.710+0000 7f5383400640 1 -- 172.21.15.17:0/2914416057 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384003e80 con 0x7f538c10b720 2024-09-13T15:55:53.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.710+0000 7f5383400640 1 -- 172.21.15.17:0/2914416057 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5384004500 con 0x7f538c10b720 2024-09-13T15:55:53.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.710+0000 7f5391800640 1 -- 172.21.15.17:0/2914416057 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5384009900 con 0x7f538c10b720 2024-09-13T15:55:53.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.710+0000 7f5383400640 1 -- 172.21.15.17:0/2914416057 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384045b30 con 0x7f538c10b720 2024-09-13T15:55:53.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.710+0000 7f5391800640 1 -- 172.21.15.17:0/2914416057 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538c1a93d0 con 0x7f538c10b720 2024-09-13T15:55:53.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.711+0000 7f5391800640 1 -- 172.21.15.17:0/2914416057 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f538c107ad0 con 0x7f538c10b720 2024-09-13T15:55:53.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.713+0000 7f5383400640 1 -- 172.21.15.17:0/2914416057 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5384042070 con 0x7f538c10b720 2024-09-13T15:55:53.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.714+0000 7f5383400640 1 --2- 172.21.15.17:0/2914416057 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f53700a1110 0x7f53700a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:53.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.714+0000 7f5383400640 1 -- 172.21.15.17:0/2914416057 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f53840ee3b0 con 0x7f538c10b720 2024-09-13T15:55:53.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.714+0000 7f538aa00640 1 --2- 172.21.15.17:0/2914416057 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f53700a1110 0x7f53700a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:53.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.714+0000 7f5383400640 1 --2- 172.21.15.17:0/2914416057 >> [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382] conn(0x7f53700ac1a0 0x7f53700ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:53.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.714+0000 7f5383400640 1 -- 172.21.15.17:0/2914416057 --> [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53700aed10 con 0x7f53700ac1a0 2024-09-13T15:55:53.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.715+0000 7f5383400640 1 -- 172.21.15.17:0/2914416057 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53840ee7c0 con 0x7f538c10b720 2024-09-13T15:55:53.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.715+0000 7f5383e00640 1 --2- 172.21.15.17:0/2914416057 >> [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382] conn(0x7f53700ac1a0 0x7f53700ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:53.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.715+0000 7f538aa00640 1 --2- 172.21.15.17:0/2914416057 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f53700a1110 0x7f53700a35d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f537c009e60 tx=0x7f537c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:53.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.715+0000 7f5383e00640 1 --2- 172.21.15.17:0/2914416057 >> [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382] conn(0x7f53700ac1a0 0x7f53700ae640 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:53.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.716+0000 7f5383400640 1 -- 172.21.15.17:0/2914416057 <== osd.6 v2:172.21.15.17:6818/3930545382 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f53700aed10 con 0x7f53700ac1a0 2024-09-13T15:55:53.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.730+0000 7f5391800640 1 -- 172.21.15.17:0/2914416057 --> [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f538c060b30 con 0x7f53700ac1a0 2024-09-13T15:55:53.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.731+0000 7f5383400640 1 -- 172.21.15.17:0/2914416057 <== osd.6 v2:172.21.15.17:6818/3930545382 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f538c060b30 con 0x7f53700ac1a0 2024-09-13T15:55:53.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.731+0000 7f5391800640 1 -- 172.21.15.17:0/2914416057 >> [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382] conn(0x7f53700ac1a0 msgr2=0x7f53700ae640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:53.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.731+0000 7f5391800640 1 --2- 172.21.15.17:0/2914416057 >> [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382] conn(0x7f53700ac1a0 0x7f53700ae640 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:53.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.732+0000 7f5391800640 1 -- 172.21.15.17:0/2914416057 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f53700a1110 msgr2=0x7f53700a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:53.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.732+0000 7f5391800640 1 --2- 172.21.15.17:0/2914416057 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f53700a1110 0x7f53700a35d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f537c009e60 tx=0x7f537c005f90 comp rx=0 tx=0).stop 2024-09-13T15:55:53.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.732+0000 7f5391800640 1 -- 172.21.15.17:0/2914416057 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f538c10b720 msgr2=0x7f538c19c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:53.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.732+0000 7f5391800640 1 --2- 172.21.15.17:0/2914416057 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f538c10b720 0x7f538c19c680 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5384009ca0 tx=0x7f5384030f50 comp rx=0 tx=0).stop 2024-09-13T15:55:53.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.732+0000 7f538b400640 1 -- 172.21.15.17:0/2914416057 reap_dead start 2024-09-13T15:55:53.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.732+0000 7f5391800640 1 -- 172.21.15.17:0/2914416057 shutdown_connections 2024-09-13T15:55:53.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.732+0000 7f5391800640 1 -- 172.21.15.17:0/2914416057 >> 172.21.15.17:0/2914416057 conn(0x7f538c075d10 msgr2=0x7f538c077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:53.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.732+0000 7f5391800640 1 -- 172.21.15.17:0/2914416057 shutdown_connections 2024-09-13T15:55:53.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:53.732+0000 7f5391800640 1 -- 172.21.15.17:0/2914416057 wait complete. 2024-09-13T15:55:54.182 INFO:teuthology.orchestra.run.smithi017.stdout:313532612637 2024-09-13T15:55:54.182 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-13T15:55:55.405 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:55 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:55:55.405 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:55 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:55:55.405 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:55 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:55:55.405 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:55 smithi017 ceph-mon[30494]: pgmap v328: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 280 B/s wr, 6 op/s; 5.4 KiB/s, 1 objects/s recovering 2024-09-13T15:55:55.405 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:55 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:55:55.407 INFO:teuthology.orchestra.run.smithi017.stdout:146028888124 2024-09-13T15:55:55.407 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-13T15:55:55.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:55 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:55:55.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:55 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:55:55.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:55 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:55:55.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:55 smithi193 ceph-mon[35248]: pgmap v328: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 280 B/s wr, 6 op/s; 5.4 KiB/s, 1 objects/s recovering 2024-09-13T15:55:55.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:55 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:55:55.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:55 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:55:55.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:55 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:55:55.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:55 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:55:55.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:55 smithi189 ceph-mon[34790]: pgmap v328: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 280 B/s wr, 6 op/s; 5.4 KiB/s, 1 objects/s recovering 2024-09-13T15:55:55.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:55 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:55:55.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.873+0000 7f217b600640 1 -- 172.21.15.17:0/2939871423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2174102bb0 msgr2=0x7f2174106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.873+0000 7f217b600640 1 --2- 172.21.15.17:0/2939871423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2174102bb0 0x7f2174106c00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2160009930 tx=0x7f216002a420 comp rx=0 tx=0).stop 2024-09-13T15:55:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.873+0000 7f217b600640 1 -- 172.21.15.17:0/2939871423 shutdown_connections 2024-09-13T15:55:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.873+0000 7f217b600640 1 --2- 172.21.15.17:0/2939871423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2174107330 0x7f217410eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.873+0000 7f217b600640 1 --2- 172.21.15.17:0/2939871423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2174102bb0 0x7f2174106c00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.873+0000 7f217b600640 1 --2- 172.21.15.17:0/2939871423 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2174102200 0x7f21741025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.873+0000 7f217b600640 1 -- 172.21.15.17:0/2939871423 >> 172.21.15.17:0/2939871423 conn(0x7f21740fdc60 msgr2=0x7f2174100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.874+0000 7f217b600640 1 -- 172.21.15.17:0/2939871423 shutdown_connections 2024-09-13T15:55:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.874+0000 7f217b600640 1 -- 172.21.15.17:0/2939871423 wait complete. 2024-09-13T15:55:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.875+0000 7f217b600640 1 Processor -- start 2024-09-13T15:55:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.875+0000 7f217b600640 1 -- start start 2024-09-13T15:55:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.875+0000 7f217b600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2174102200 0x7f2174198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:55.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.875+0000 7f217b600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2174102bb0 0x7f2174198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:55.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.875+0000 7f217b600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2174107330 0x7f217419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:55.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.875+0000 7f217b600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217419d460 con 0x7f2174102bb0 2024-09-13T15:55:55.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.875+0000 7f217b600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217419d5d0 con 0x7f2174107330 2024-09-13T15:55:55.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.875+0000 7f217b600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217419d740 con 0x7f2174102200 2024-09-13T15:55:55.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.876+0000 7f2173e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2174102bb0 0x7f2174198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:55.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.876+0000 7f2173e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2174102bb0 0x7f2174198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37136/0 (socket says 172.21.15.17:37136) 2024-09-13T15:55:55.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.876+0000 7f2178c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2174102200 0x7f2174198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:55.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.876+0000 7f2173e00640 1 -- 172.21.15.17:0/1118988989 learned_addr learned my addr 172.21.15.17:0/1118988989 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:55.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.876+0000 7f2179600640 1 --2- 172.21.15.17:0/1118988989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2174107330 0x7f217419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:55.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.876+0000 7f2173e00640 1 -- 172.21.15.17:0/1118988989 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2174102200 msgr2=0x7f2174198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:55.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.876+0000 7f2173e00640 1 --2- 172.21.15.17:0/1118988989 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2174102200 0x7f2174198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.876+0000 7f2173e00640 1 -- 172.21.15.17:0/1118988989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2174107330 msgr2=0x7f217419ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.876+0000 7f2173e00640 1 --2- 172.21.15.17:0/1118988989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2174107330 0x7f217419ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.876+0000 7f2173e00640 1 -- 172.21.15.17:0/1118988989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c009840 con 0x7f2174102bb0 2024-09-13T15:55:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.876+0000 7f2179600640 1 --2- 172.21.15.17:0/1118988989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2174107330 0x7f217419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:55:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.877+0000 7f2173e00640 1 --2- 172.21.15.17:0/1118988989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2174102bb0 0x7f2174198a60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2160005ab0 tx=0x7f2160003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.877+0000 7f2171600640 1 -- 172.21.15.17:0/1118988989 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2160005d50 con 0x7f2174102bb0 2024-09-13T15:55:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.877+0000 7f217b600640 1 -- 172.21.15.17:0/1118988989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2160009560 con 0x7f2174102bb0 2024-09-13T15:55:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.877+0000 7f2171600640 1 -- 172.21.15.17:0/1118988989 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2160003e00 con 0x7f2174102bb0 2024-09-13T15:55:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.877+0000 7f2171600640 1 -- 172.21.15.17:0/1118988989 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216003bac0 con 0x7f2174102bb0 2024-09-13T15:55:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.877+0000 7f217b600640 1 -- 172.21.15.17:0/1118988989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21741a5110 con 0x7f2174102bb0 2024-09-13T15:55:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.878+0000 7f217b600640 1 -- 172.21.15.17:0/1118988989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f21741036e0 con 0x7f2174102bb0 2024-09-13T15:55:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.880+0000 7f2171600640 1 -- 172.21.15.17:0/1118988989 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f216003bc20 con 0x7f2174102bb0 2024-09-13T15:55:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.881+0000 7f2171600640 1 --2- 172.21.15.17:0/1118988989 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f215c0a1190 0x7f215c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:55.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.881+0000 7f2171600640 1 -- 172.21.15.17:0/1118988989 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f21600ed880 con 0x7f2174102bb0 2024-09-13T15:55:55.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.881+0000 7f2178c00640 1 --2- 172.21.15.17:0/1118988989 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f215c0a1190 0x7f215c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:55.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.882+0000 7f2171600640 1 --2- 172.21.15.17:0/1118988989 >> [v2:172.21.15.189:6800/964319421,v1:172.21.15.189:6801/964319421] conn(0x7f215c0ac220 0x7f215c0ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:55.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.882+0000 7f2171600640 1 -- 172.21.15.17:0/1118988989 --> [v2:172.21.15.189:6800/964319421,v1:172.21.15.189:6801/964319421] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f215c0aed90 con 0x7f215c0ac220 2024-09-13T15:55:55.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.882+0000 7f2171600640 1 -- 172.21.15.17:0/1118988989 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21600edbf0 con 0x7f2174102bb0 2024-09-13T15:55:55.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.882+0000 7f2178c00640 1 --2- 172.21.15.17:0/1118988989 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f215c0a1190 0x7f215c0a3650 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2168009bd0 tx=0x7f2168005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:55.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.882+0000 7f2179600640 1 --2- 172.21.15.17:0/1118988989 >> [v2:172.21.15.189:6800/964319421,v1:172.21.15.189:6801/964319421] conn(0x7f215c0ac220 0x7f215c0ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:55.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.883+0000 7f2179600640 1 --2- 172.21.15.17:0/1118988989 >> [v2:172.21.15.189:6800/964319421,v1:172.21.15.189:6801/964319421] conn(0x7f215c0ac220 0x7f215c0ae6c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:55.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.884+0000 7f2171600640 1 -- 172.21.15.17:0/1118988989 <== osd.1 v2:172.21.15.189:6800/964319421 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f215c0aed90 con 0x7f215c0ac220 2024-09-13T15:55:55.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.898+0000 7f217b600640 1 -- 172.21.15.17:0/1118988989 --> [v2:172.21.15.189:6800/964319421,v1:172.21.15.189:6801/964319421] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2174060b30 con 0x7f215c0ac220 2024-09-13T15:55:55.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.898+0000 7f2171600640 1 -- 172.21.15.17:0/1118988989 <== osd.1 v2:172.21.15.189:6800/964319421 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2174060b30 con 0x7f215c0ac220 2024-09-13T15:55:55.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.899+0000 7f217b600640 1 -- 172.21.15.17:0/1118988989 >> [v2:172.21.15.189:6800/964319421,v1:172.21.15.189:6801/964319421] conn(0x7f215c0ac220 msgr2=0x7f215c0ae6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:55.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.899+0000 7f217b600640 1 --2- 172.21.15.17:0/1118988989 >> [v2:172.21.15.189:6800/964319421,v1:172.21.15.189:6801/964319421] conn(0x7f215c0ac220 0x7f215c0ae6c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:55.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.899+0000 7f217b600640 1 -- 172.21.15.17:0/1118988989 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f215c0a1190 msgr2=0x7f215c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:55.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.899+0000 7f217b600640 1 --2- 172.21.15.17:0/1118988989 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f215c0a1190 0x7f215c0a3650 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2168009bd0 tx=0x7f2168005f90 comp rx=0 tx=0).stop 2024-09-13T15:55:55.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.899+0000 7f217b600640 1 -- 172.21.15.17:0/1118988989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2174102bb0 msgr2=0x7f2174198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:55.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.899+0000 7f217b600640 1 --2- 172.21.15.17:0/1118988989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2174102bb0 0x7f2174198a60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2160005ab0 tx=0x7f2160003c10 comp rx=0 tx=0).stop 2024-09-13T15:55:55.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.899+0000 7f2179600640 1 -- 172.21.15.17:0/1118988989 reap_dead start 2024-09-13T15:55:55.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.899+0000 7f217b600640 1 -- 172.21.15.17:0/1118988989 shutdown_connections 2024-09-13T15:55:55.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.899+0000 7f217b600640 1 -- 172.21.15.17:0/1118988989 >> 172.21.15.17:0/1118988989 conn(0x7f21740fdc60 msgr2=0x7f21740ff0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:55.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.899+0000 7f217b600640 1 -- 172.21.15.17:0/1118988989 shutdown_connections 2024-09-13T15:55:55.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:55.899+0000 7f217b600640 1 -- 172.21.15.17:0/1118988989 wait complete. 2024-09-13T15:55:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.210+0000 7fc2ebc00640 1 -- 172.21.15.17:0/3467663529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2e4107330 msgr2=0x7fc2e410eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.210+0000 7fc2ebc00640 1 --2- 172.21.15.17:0/3467663529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2e4107330 0x7fc2e410eeb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009be0 tx=0x7fc2dc02a6c0 comp rx=0 tx=0).stop 2024-09-13T15:55:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.210+0000 7fc2ebc00640 1 -- 172.21.15.17:0/3467663529 shutdown_connections 2024-09-13T15:55:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.210+0000 7fc2ebc00640 1 --2- 172.21.15.17:0/3467663529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2e4107330 0x7fc2e410eeb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.210+0000 7fc2ebc00640 1 --2- 172.21.15.17:0/3467663529 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2e4102bb0 0x7fc2e4106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.210+0000 7fc2ebc00640 1 --2- 172.21.15.17:0/3467663529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2e4102200 0x7fc2e41025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.210+0000 7fc2ebc00640 1 -- 172.21.15.17:0/3467663529 >> 172.21.15.17:0/3467663529 conn(0x7fc2e40fdc60 msgr2=0x7fc2e4100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.210+0000 7fc2ebc00640 1 -- 172.21.15.17:0/3467663529 shutdown_connections 2024-09-13T15:55:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.210+0000 7fc2ebc00640 1 -- 172.21.15.17:0/3467663529 wait complete. 2024-09-13T15:55:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.211+0000 7fc2ebc00640 1 Processor -- start 2024-09-13T15:55:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.212+0000 7fc2ebc00640 1 -- start start 2024-09-13T15:55:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.212+0000 7fc2ebc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2e4102200 0x7fc2e4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.212+0000 7fc2ebc00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2e4102bb0 0x7fc2e41989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.212+0000 7fc2ebc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2e4107330 0x7fc2e419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.212+0000 7fc2ebc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e419d3a0 con 0x7fc2e4102200 2024-09-13T15:55:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.212+0000 7fc2ebc00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e419d510 con 0x7fc2e4107330 2024-09-13T15:55:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.212+0000 7fc2ebc00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e419d680 con 0x7fc2e4102bb0 2024-09-13T15:55:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.212+0000 7fc2e9200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2e4102200 0x7fc2e4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.212+0000 7fc2e9200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2e4102200 0x7fc2e4198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37152/0 (socket says 172.21.15.17:37152) 2024-09-13T15:55:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.212+0000 7fc2e9200640 1 -- 172.21.15.17:0/3827572654 learned_addr learned my addr 172.21.15.17:0/3827572654 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.212+0000 7fc2e3e00640 1 --2- 172.21.15.17:0/3827572654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2e4102bb0 0x7fc2e41989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.213+0000 7fc2e9c00640 1 --2- 172.21.15.17:0/3827572654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2e4107330 0x7fc2e419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.213+0000 7fc2e9200640 1 -- 172.21.15.17:0/3827572654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2e4102bb0 msgr2=0x7fc2e41989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.213+0000 7fc2e9200640 1 --2- 172.21.15.17:0/3827572654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2e4102bb0 0x7fc2e41989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.213+0000 7fc2e9200640 1 -- 172.21.15.17:0/3827572654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2e4107330 msgr2=0x7fc2e419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.213+0000 7fc2e9200640 1 --2- 172.21.15.17:0/3827572654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2e4107330 0x7fc2e419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.213+0000 7fc2e9200640 1 -- 172.21.15.17:0/3827572654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc009840 con 0x7fc2e4102200 2024-09-13T15:55:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.213+0000 7fc2e3e00640 1 --2- 172.21.15.17:0/3827572654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2e4102bb0 0x7fc2e41989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:55:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.213+0000 7fc2e9200640 1 --2- 172.21.15.17:0/3827572654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2e4102200 0x7fc2e4198460 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc2d800e9f0 tx=0x7fc2d800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:56.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.213+0000 7fc2e1600640 1 -- 172.21.15.17:0/3827572654 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8009700 con 0x7fc2e4102200 2024-09-13T15:55:56.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.214+0000 7fc2ebc00640 1 -- 172.21.15.17:0/3827572654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e419d960 con 0x7fc2e4102200 2024-09-13T15:55:56.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.214+0000 7fc2e1600640 1 -- 172.21.15.17:0/3827572654 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc2d800ccc0 con 0x7fc2e4102200 2024-09-13T15:55:56.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.214+0000 7fc2e1600640 1 -- 172.21.15.17:0/3827572654 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8018790 con 0x7fc2e4102200 2024-09-13T15:55:56.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.214+0000 7fc2ebc00640 1 -- 172.21.15.17:0/3827572654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e41a5220 con 0x7fc2e4102200 2024-09-13T15:55:56.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.215+0000 7fc2ebc00640 1 -- 172.21.15.17:0/3827572654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc2e41036e0 con 0x7fc2e4102200 2024-09-13T15:55:56.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.217+0000 7fc2e1600640 1 -- 172.21.15.17:0/3827572654 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fc2d80188f0 con 0x7fc2e4102200 2024-09-13T15:55:56.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.219+0000 7fc2e1600640 1 --2- 172.21.15.17:0/3827572654 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc2cc0a1110 0x7fc2cc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:56.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.219+0000 7fc2e1600640 1 -- 172.21.15.17:0/3827572654 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc2d8014070 con 0x7fc2e4102200 2024-09-13T15:55:56.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.219+0000 7fc2e3e00640 1 --2- 172.21.15.17:0/3827572654 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc2cc0a1110 0x7fc2cc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:56.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.219+0000 7fc2e1600640 1 --2- 172.21.15.17:0/3827572654 >> [v2:172.21.15.193:6800/138468002,v1:172.21.15.193:6801/138468002] conn(0x7fc2cc0ac1a0 0x7fc2cc0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:56.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.219+0000 7fc2e1600640 1 -- 172.21.15.17:0/3827572654 --> [v2:172.21.15.193:6800/138468002,v1:172.21.15.193:6801/138468002] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2cc0aed10 con 0x7fc2cc0ac1a0 2024-09-13T15:55:56.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.219+0000 7fc2e1600640 1 -- 172.21.15.17:0/3827572654 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2d80cdbf0 con 0x7fc2e4102200 2024-09-13T15:55:56.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.220+0000 7fc2e9c00640 1 --2- 172.21.15.17:0/3827572654 >> [v2:172.21.15.193:6800/138468002,v1:172.21.15.193:6801/138468002] conn(0x7fc2cc0ac1a0 0x7fc2cc0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:56.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.220+0000 7fc2e3e00640 1 --2- 172.21.15.17:0/3827572654 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc2cc0a1110 0x7fc2cc0a35d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4199a10 tx=0x7fc2d0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:56.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.220+0000 7fc2e9c00640 1 --2- 172.21.15.17:0/3827572654 >> [v2:172.21.15.193:6800/138468002,v1:172.21.15.193:6801/138468002] conn(0x7fc2cc0ac1a0 0x7fc2cc0ae640 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:56.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.221+0000 7fc2e1600640 1 -- 172.21.15.17:0/3827572654 <== osd.2 v2:172.21.15.193:6800/138468002 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc2cc0aed10 con 0x7fc2cc0ac1a0 2024-09-13T15:55:56.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.236+0000 7fc2ebc00640 1 -- 172.21.15.17:0/3827572654 --> [v2:172.21.15.193:6800/138468002,v1:172.21.15.193:6801/138468002] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc2e4112290 con 0x7fc2cc0ac1a0 2024-09-13T15:55:56.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.236+0000 7fc2e1600640 1 -- 172.21.15.17:0/3827572654 <== osd.2 v2:172.21.15.193:6800/138468002 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc2dc030660 con 0x7fc2cc0ac1a0 2024-09-13T15:55:56.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.236+0000 7fc2ebc00640 1 -- 172.21.15.17:0/3827572654 >> [v2:172.21.15.193:6800/138468002,v1:172.21.15.193:6801/138468002] conn(0x7fc2cc0ac1a0 msgr2=0x7fc2cc0ae640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:56.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.236+0000 7fc2ebc00640 1 --2- 172.21.15.17:0/3827572654 >> [v2:172.21.15.193:6800/138468002,v1:172.21.15.193:6801/138468002] conn(0x7fc2cc0ac1a0 0x7fc2cc0ae640 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:56.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.237+0000 7fc2ebc00640 1 -- 172.21.15.17:0/3827572654 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc2cc0a1110 msgr2=0x7fc2cc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:56.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.237+0000 7fc2ebc00640 1 --2- 172.21.15.17:0/3827572654 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc2cc0a1110 0x7fc2cc0a35d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4199a10 tx=0x7fc2d0009260 comp rx=0 tx=0).stop 2024-09-13T15:55:56.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.237+0000 7fc2ebc00640 1 -- 172.21.15.17:0/3827572654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2e4102200 msgr2=0x7fc2e4198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:56.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.237+0000 7fc2ebc00640 1 --2- 172.21.15.17:0/3827572654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2e4102200 0x7fc2e4198460 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc2d800e9f0 tx=0x7fc2d800edf0 comp rx=0 tx=0).stop 2024-09-13T15:55:56.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.237+0000 7fc2e9c00640 1 -- 172.21.15.17:0/3827572654 reap_dead start 2024-09-13T15:55:56.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.237+0000 7fc2ebc00640 1 -- 172.21.15.17:0/3827572654 shutdown_connections 2024-09-13T15:55:56.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.237+0000 7fc2ebc00640 1 -- 172.21.15.17:0/3827572654 >> 172.21.15.17:0/3827572654 conn(0x7fc2e40fdc60 msgr2=0x7fc2e40ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:56.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.237+0000 7fc2ebc00640 1 -- 172.21.15.17:0/3827572654 shutdown_connections 2024-09-13T15:55:56.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.237+0000 7fc2ebc00640 1 -- 172.21.15.17:0/3827572654 wait complete. 2024-09-13T15:55:56.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.822+0000 7fefd2400640 1 -- 172.21.15.17:0/2694613913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefcc100000 msgr2=0x7fefcc1003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:56.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.822+0000 7fefd2400640 1 --2- 172.21.15.17:0/2694613913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefcc100000 0x7fefcc1003e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fefbc009930 tx=0x7fefbc02a420 comp rx=0 tx=0).stop 2024-09-13T15:55:56.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.823+0000 7fefd2400640 1 -- 172.21.15.17:0/2694613913 shutdown_connections 2024-09-13T15:55:56.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.823+0000 7fefd2400640 1 --2- 172.21.15.17:0/2694613913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefcc105130 0x7fefcc10ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:56.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.823+0000 7fefd2400640 1 --2- 172.21.15.17:0/2694613913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fefcc1009b0 0x7fefcc104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:56.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.823+0000 7fefd2400640 1 --2- 172.21.15.17:0/2694613913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefcc100000 0x7fefcc1003e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:56.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.823+0000 7fefd2400640 1 -- 172.21.15.17:0/2694613913 >> 172.21.15.17:0/2694613913 conn(0x7fefcc0fbaa0 msgr2=0x7fefcc0fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:56.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.823+0000 7fefd2400640 1 -- 172.21.15.17:0/2694613913 shutdown_connections 2024-09-13T15:55:56.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.823+0000 7fefd2400640 1 -- 172.21.15.17:0/2694613913 wait complete. 2024-09-13T15:55:56.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.824+0000 7fefd2400640 1 Processor -- start 2024-09-13T15:55:56.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.824+0000 7fefd2400640 1 -- start start 2024-09-13T15:55:56.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.824+0000 7fefd2400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefcc100000 0x7fefcc1962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:56.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.824+0000 7fefd2400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fefcc1009b0 0x7fefcc196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:56.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.824+0000 7fefd2400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefcc105130 0x7fefcc19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:56.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.824+0000 7fefd2400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc19b230 con 0x7fefcc100000 2024-09-13T15:55:56.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.824+0000 7fefd2400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc19b3a0 con 0x7fefcc105130 2024-09-13T15:55:56.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.824+0000 7fefd2400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc19b510 con 0x7fefcc1009b0 2024-09-13T15:55:56.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.824+0000 7fefcb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefcc100000 0x7fefcc1962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:56.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.824+0000 7fefcb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefcc100000 0x7fefcc1962f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37170/0 (socket says 172.21.15.17:37170) 2024-09-13T15:55:56.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.824+0000 7fefcb400640 1 -- 172.21.15.17:0/3461584069 learned_addr learned my addr 172.21.15.17:0/3461584069 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:56.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.825+0000 7fefcbe00640 1 --2- 172.21.15.17:0/3461584069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefcc105130 0x7fefcc19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:56.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.825+0000 7fefc2a00640 1 --2- 172.21.15.17:0/3461584069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fefcc1009b0 0x7fefcc196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:56.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.825+0000 7fefcbe00640 1 -- 172.21.15.17:0/3461584069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fefcc1009b0 msgr2=0x7fefcc196830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:56.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.825+0000 7fefcbe00640 1 --2- 172.21.15.17:0/3461584069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fefcc1009b0 0x7fefcc196830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:56.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.825+0000 7fefcbe00640 1 -- 172.21.15.17:0/3461584069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefcc100000 msgr2=0x7fefcc1962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:56.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.825+0000 7fefcbe00640 1 --2- 172.21.15.17:0/3461584069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefcc100000 0x7fefcc1962f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:56.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.825+0000 7fefcbe00640 1 -- 172.21.15.17:0/3461584069 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefbc009560 con 0x7fefcc105130 2024-09-13T15:55:56.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.825+0000 7fefcb400640 1 --2- 172.21.15.17:0/3461584069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefcc100000 0x7fefcc1962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:55:56.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.825+0000 7fefcbe00640 1 --2- 172.21.15.17:0/3461584069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefcc105130 0x7fefcc19ac30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fefc4009fd0 tx=0x7fefc400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:56.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.825+0000 7fefc8c00640 1 -- 172.21.15.17:0/3461584069 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc400ce20 con 0x7fefcc105130 2024-09-13T15:55:56.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.825+0000 7fefd2400640 1 -- 172.21.15.17:0/3461584069 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefcc19b7f0 con 0x7fefcc105130 2024-09-13T15:55:56.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.825+0000 7fefc8c00640 1 -- 172.21.15.17:0/3461584069 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefc4005020 con 0x7fefcc105130 2024-09-13T15:55:56.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.826+0000 7fefc8c00640 1 -- 172.21.15.17:0/3461584069 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc4010670 con 0x7fefcc105130 2024-09-13T15:55:56.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.826+0000 7fefd2400640 1 -- 172.21.15.17:0/3461584069 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefcc1a30b0 con 0x7fefcc105130 2024-09-13T15:55:56.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.827+0000 7fefd2400640 1 -- 172.21.15.17:0/3461584069 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fefcc1014e0 con 0x7fefcc105130 2024-09-13T15:55:56.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.829+0000 7fefc8c00640 1 -- 172.21.15.17:0/3461584069 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fefc4005450 con 0x7fefcc105130 2024-09-13T15:55:56.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.830+0000 7fefc8c00640 1 --2- 172.21.15.17:0/3461584069 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fefb00a1190 0x7fefb00a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:56.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.830+0000 7fefc8c00640 1 -- 172.21.15.17:0/3461584069 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fefc4014070 con 0x7fefcc105130 2024-09-13T15:55:56.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.830+0000 7fefcb400640 1 --2- 172.21.15.17:0/3461584069 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fefb00a1190 0x7fefb00a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:56.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.830+0000 7fefc8c00640 1 --2- 172.21.15.17:0/3461584069 >> [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212] conn(0x7fefb00ac220 0x7fefb00ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:56.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.830+0000 7fefc8c00640 1 -- 172.21.15.17:0/3461584069 --> [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fefb00aed90 con 0x7fefb00ac220 2024-09-13T15:55:56.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.830+0000 7fefc8c00640 1 -- 172.21.15.17:0/3461584069 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefc40cd6c0 con 0x7fefcc105130 2024-09-13T15:55:56.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.831+0000 7fefc2a00640 1 --2- 172.21.15.17:0/3461584069 >> [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212] conn(0x7fefb00ac220 0x7fefb00ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:56.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.831+0000 7fefcb400640 1 --2- 172.21.15.17:0/3461584069 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fefb00a1190 0x7fefb00a3650 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fefbc000c00 tx=0x7fefbc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:56.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.831+0000 7fefc2a00640 1 --2- 172.21.15.17:0/3461584069 >> [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212] conn(0x7fefb00ac220 0x7fefb00ae6c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:56.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.832+0000 7fefc8c00640 1 -- 172.21.15.17:0/3461584069 <== osd.0 v2:172.21.15.17:6802/158651212 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fefb00aed90 con 0x7fefb00ac220 2024-09-13T15:55:56.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.846+0000 7fefd2400640 1 -- 172.21.15.17:0/3461584069 --> [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fefcc110100 con 0x7fefb00ac220 2024-09-13T15:55:56.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.846+0000 7fefc8c00640 1 -- 172.21.15.17:0/3461584069 <== osd.0 v2:172.21.15.17:6802/158651212 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fefb4009900 con 0x7fefb00ac220 2024-09-13T15:55:56.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.847+0000 7fefd2400640 1 -- 172.21.15.17:0/3461584069 >> [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212] conn(0x7fefb00ac220 msgr2=0x7fefb00ae6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:56.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.847+0000 7fefd2400640 1 --2- 172.21.15.17:0/3461584069 >> [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212] conn(0x7fefb00ac220 0x7fefb00ae6c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:56.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.847+0000 7fefd2400640 1 -- 172.21.15.17:0/3461584069 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fefb00a1190 msgr2=0x7fefb00a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:56.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.847+0000 7fefd2400640 1 --2- 172.21.15.17:0/3461584069 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fefb00a1190 0x7fefb00a3650 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fefbc000c00 tx=0x7fefbc005a20 comp rx=0 tx=0).stop 2024-09-13T15:55:56.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.847+0000 7fefd2400640 1 -- 172.21.15.17:0/3461584069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefcc105130 msgr2=0x7fefcc19ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:56.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.847+0000 7fefd2400640 1 --2- 172.21.15.17:0/3461584069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefcc105130 0x7fefcc19ac30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fefc4009fd0 tx=0x7fefc400ef10 comp rx=0 tx=0).stop 2024-09-13T15:55:56.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.847+0000 7fefcbe00640 1 -- 172.21.15.17:0/3461584069 reap_dead start 2024-09-13T15:55:56.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.847+0000 7fefd2400640 1 -- 172.21.15.17:0/3461584069 shutdown_connections 2024-09-13T15:55:56.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.847+0000 7fefd2400640 1 -- 172.21.15.17:0/3461584069 >> 172.21.15.17:0/3461584069 conn(0x7fefcc0fbaa0 msgr2=0x7fefcc0fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:56.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.847+0000 7fefd2400640 1 -- 172.21.15.17:0/3461584069 shutdown_connections 2024-09-13T15:55:56.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:56.847+0000 7fefd2400640 1 -- 172.21.15.17:0/3461584069 wait complete. 2024-09-13T15:55:57.425 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:57 smithi017 ceph-mon[30494]: pgmap v329: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s; 4.9 KiB/s, 1 objects/s recovering 2024-09-13T15:55:57.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:57 smithi193 ceph-mon[35248]: pgmap v329: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s; 4.9 KiB/s, 1 objects/s recovering 2024-09-13T15:55:57.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:57 smithi189 ceph-mon[34790]: pgmap v329: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s; 4.9 KiB/s, 1 objects/s recovering 2024-09-13T15:55:58.026 INFO:teuthology.orchestra.run.smithi017.stdout:201863462964 2024-09-13T15:55:58.027 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-13T15:55:58.694 INFO:teuthology.orchestra.run.smithi017.stdout:55834574924 2024-09-13T15:55:58.695 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-13T15:55:59.089 INFO:teuthology.orchestra.run.smithi017.stdout:34359738448 2024-09-13T15:55:59.089 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-13T15:55:59.412 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:55:59 smithi017 ceph-mon[30494]: pgmap v330: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:55:59.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:55:59 smithi193 ceph-mon[35248]: pgmap v330: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:55:59.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.525+0000 7f6ce8000640 1 -- 172.21.15.17:0/2450049195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ce0102200 msgr2=0x7f6ce01025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:59.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.525+0000 7f6ce8000640 1 --2- 172.21.15.17:0/2450049195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ce0102200 0x7f6ce01025e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009930 tx=0x7f6cd402a420 comp rx=0 tx=0).stop 2024-09-13T15:55:59.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.525+0000 7f6ce8000640 1 -- 172.21.15.17:0/2450049195 shutdown_connections 2024-09-13T15:55:59.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.525+0000 7f6ce8000640 1 --2- 172.21.15.17:0/2450049195 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ce0107330 0x7f6ce010eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:59.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.525+0000 7f6ce8000640 1 --2- 172.21.15.17:0/2450049195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ce0102bb0 0x7f6ce0106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:59.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.525+0000 7f6ce8000640 1 --2- 172.21.15.17:0/2450049195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ce0102200 0x7f6ce01025e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:59.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.525+0000 7f6ce8000640 1 -- 172.21.15.17:0/2450049195 >> 172.21.15.17:0/2450049195 conn(0x7f6ce00fdc40 msgr2=0x7f6ce0100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:59.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.525+0000 7f6ce8000640 1 -- 172.21.15.17:0/2450049195 shutdown_connections 2024-09-13T15:55:59.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.525+0000 7f6ce8000640 1 -- 172.21.15.17:0/2450049195 wait complete. 2024-09-13T15:55:59.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.526+0000 7f6ce8000640 1 Processor -- start 2024-09-13T15:55:59.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.526+0000 7f6ce8000640 1 -- start start 2024-09-13T15:55:59.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.527+0000 7f6ce8000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ce0102200 0x7f6ce0198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:59.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.527+0000 7f6ce8000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ce0102bb0 0x7f6ce0198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:59.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.527+0000 7f6ce8000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ce0107330 0x7f6ce019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:59.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.527+0000 7f6ce8000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce019d4a0 con 0x7f6ce0107330 2024-09-13T15:55:59.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.527+0000 7f6ce8000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce019d610 con 0x7f6ce0102bb0 2024-09-13T15:55:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.527+0000 7f6ce8000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce019d780 con 0x7f6ce0102200 2024-09-13T15:55:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.527+0000 7f6ce6000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ce0107330 0x7f6ce019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.527+0000 7f6ce5600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ce0102200 0x7f6ce0198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.527+0000 7f6ce5600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ce0102200 0x7f6ce0198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:44150/0 (socket says 172.21.15.17:44150) 2024-09-13T15:55:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.527+0000 7f6ce6000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ce0107330 0x7f6ce019cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56888/0 (socket says 172.21.15.17:56888) 2024-09-13T15:55:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.527+0000 7f6ce5600640 1 -- 172.21.15.17:0/3920453827 learned_addr learned my addr 172.21.15.17:0/3920453827 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:55:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.527+0000 7f6ce4c00640 1 --2- 172.21.15.17:0/3920453827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ce0102bb0 0x7f6ce0198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.528+0000 7f6ce5600640 1 -- 172.21.15.17:0/3920453827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ce0102bb0 msgr2=0x7f6ce0198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.528+0000 7f6ce5600640 1 --2- 172.21.15.17:0/3920453827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ce0102bb0 0x7f6ce0198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.528+0000 7f6ce5600640 1 -- 172.21.15.17:0/3920453827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ce0107330 msgr2=0x7f6ce019cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.528+0000 7f6ce5600640 1 --2- 172.21.15.17:0/3920453827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ce0107330 0x7f6ce019cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.528+0000 7f6ce5600640 1 -- 172.21.15.17:0/3920453827 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd4009560 con 0x7f6ce0102200 2024-09-13T15:55:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.528+0000 7f6ce4c00640 1 --2- 172.21.15.17:0/3920453827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ce0102bb0 0x7f6ce0198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:55:59.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.528+0000 7f6ce5600640 1 --2- 172.21.15.17:0/3920453827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ce0102200 0x7f6ce0198560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4005ab0 tx=0x7f6cd4003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:59.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.528+0000 7f6cde000640 1 -- 172.21.15.17:0/3920453827 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4003e00 con 0x7f6ce0102200 2024-09-13T15:55:59.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.528+0000 7f6ce8000640 1 -- 172.21.15.17:0/3920453827 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce019da00 con 0x7f6ce0102200 2024-09-13T15:55:59.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.528+0000 7f6cde000640 1 -- 172.21.15.17:0/3920453827 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6cd4031b70 con 0x7f6ce0102200 2024-09-13T15:55:59.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.528+0000 7f6cde000640 1 -- 172.21.15.17:0/3920453827 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd403bbe0 con 0x7f6ce0102200 2024-09-13T15:55:59.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.528+0000 7f6ce8000640 1 -- 172.21.15.17:0/3920453827 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce019dd20 con 0x7f6ce0102200 2024-09-13T15:55:59.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.529+0000 7f6ce8000640 1 -- 172.21.15.17:0/3920453827 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6ce0112290 con 0x7f6ce0102200 2024-09-13T15:55:59.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.532+0000 7f6cde000640 1 -- 172.21.15.17:0/3920453827 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f6cd40316b0 con 0x7f6ce0102200 2024-09-13T15:55:59.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.533+0000 7f6cde000640 1 --2- 172.21.15.17:0/3920453827 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6cc80a1110 0x7f6cc80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:59.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.533+0000 7f6cde000640 1 -- 172.21.15.17:0/3920453827 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f6cd40edb90 con 0x7f6ce0102200 2024-09-13T15:55:59.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.533+0000 7f6ce4c00640 1 --2- 172.21.15.17:0/3920453827 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6cc80a1110 0x7f6cc80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:59.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.533+0000 7f6cde000640 1 --2- 172.21.15.17:0/3920453827 >> [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274] conn(0x7f6cc80ac1a0 0x7f6cc80ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:55:59.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.534+0000 7f6cde000640 1 -- 172.21.15.17:0/3920453827 --> [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6cc80aed10 con 0x7f6cc80ac1a0 2024-09-13T15:55:59.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.534+0000 7f6cde000640 1 -- 172.21.15.17:0/3920453827 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6cd40edf00 con 0x7f6ce0102200 2024-09-13T15:55:59.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.534+0000 7f6ce6000640 1 --2- 172.21.15.17:0/3920453827 >> [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274] conn(0x7f6cc80ac1a0 0x7f6cc80ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:55:59.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.534+0000 7f6ce4c00640 1 --2- 172.21.15.17:0/3920453827 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6cc80a1110 0x7f6cc80a35d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0199b10 tx=0x7f6ccc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:59.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.534+0000 7f6ce6000640 1 --2- 172.21.15.17:0/3920453827 >> [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274] conn(0x7f6cc80ac1a0 0x7f6cc80ae640 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:55:59.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.535+0000 7f6cde000640 1 -- 172.21.15.17:0/3920453827 <== osd.9 v2:172.21.15.17:6826/663424274 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f6cc80aed10 con 0x7f6cc80ac1a0 2024-09-13T15:55:59.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.549+0000 7f6ce8000640 1 -- 172.21.15.17:0/3920453827 --> [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6ce01036e0 con 0x7f6cc80ac1a0 2024-09-13T15:55:59.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.550+0000 7f6cde000640 1 -- 172.21.15.17:0/3920453827 <== osd.9 v2:172.21.15.17:6826/663424274 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6ce01036e0 con 0x7f6cc80ac1a0 2024-09-13T15:55:59.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.550+0000 7f6ce8000640 1 -- 172.21.15.17:0/3920453827 >> [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274] conn(0x7f6cc80ac1a0 msgr2=0x7f6cc80ae640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:59.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.550+0000 7f6ce8000640 1 --2- 172.21.15.17:0/3920453827 >> [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274] conn(0x7f6cc80ac1a0 0x7f6cc80ae640 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:55:59.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.550+0000 7f6ce8000640 1 -- 172.21.15.17:0/3920453827 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6cc80a1110 msgr2=0x7f6cc80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:59.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.550+0000 7f6ce8000640 1 --2- 172.21.15.17:0/3920453827 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6cc80a1110 0x7f6cc80a35d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0199b10 tx=0x7f6ccc00b410 comp rx=0 tx=0).stop 2024-09-13T15:55:59.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.550+0000 7f6ce8000640 1 -- 172.21.15.17:0/3920453827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ce0102200 msgr2=0x7f6ce0198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:55:59.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.550+0000 7f6ce8000640 1 --2- 172.21.15.17:0/3920453827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ce0102200 0x7f6ce0198560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4005ab0 tx=0x7f6cd4003c10 comp rx=0 tx=0).stop 2024-09-13T15:55:59.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.550+0000 7f6ce6000640 1 -- 172.21.15.17:0/3920453827 reap_dead start 2024-09-13T15:55:59.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.550+0000 7f6ce8000640 1 -- 172.21.15.17:0/3920453827 shutdown_connections 2024-09-13T15:55:59.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.550+0000 7f6ce8000640 1 -- 172.21.15.17:0/3920453827 >> 172.21.15.17:0/3920453827 conn(0x7f6ce00fdc40 msgr2=0x7f6ce00ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:55:59.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.551+0000 7f6ce8000640 1 -- 172.21.15.17:0/3920453827 shutdown_connections 2024-09-13T15:55:59.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:55:59.551+0000 7f6ce8000640 1 -- 172.21.15.17:0/3920453827 wait complete. 2024-09-13T15:55:59.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:55:59 smithi189 ceph-mon[34790]: pgmap v330: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:00.803 INFO:teuthology.orchestra.run.smithi017.stdout:77309411399 2024-09-13T15:56:00.803 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-13T15:56:01.382 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:01 smithi017 ceph-mon[30494]: pgmap v331: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:56:01.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.380+0000 7f5690a00640 1 -- 172.21.15.17:0/1785393864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f568c102010 msgr2=0x7f568c1023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:01.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.380+0000 7f5690a00640 1 --2- 172.21.15.17:0/1785393864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f568c102010 0x7f568c1023f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f567c009930 tx=0x7f567c02a420 comp rx=0 tx=0).stop 2024-09-13T15:56:01.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.380+0000 7f5690a00640 1 -- 172.21.15.17:0/1785393864 shutdown_connections 2024-09-13T15:56:01.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.380+0000 7f5690a00640 1 --2- 172.21.15.17:0/1785393864 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f568c107140 0x7f568c10ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:01.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.380+0000 7f5690a00640 1 --2- 172.21.15.17:0/1785393864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f568c1029c0 0x7f568c106a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:01.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.380+0000 7f5690a00640 1 --2- 172.21.15.17:0/1785393864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f568c102010 0x7f568c1023f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:01.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.380+0000 7f5690a00640 1 -- 172.21.15.17:0/1785393864 >> 172.21.15.17:0/1785393864 conn(0x7f568c0fda70 msgr2=0x7f568c0ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:01.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.380+0000 7f5690a00640 1 -- 172.21.15.17:0/1785393864 shutdown_connections 2024-09-13T15:56:01.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.381+0000 7f5690a00640 1 -- 172.21.15.17:0/1785393864 wait complete. 2024-09-13T15:56:01.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.382+0000 7f5690a00640 1 Processor -- start 2024-09-13T15:56:01.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.382+0000 7f5690a00640 1 -- start start 2024-09-13T15:56:01.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.382+0000 7f5690a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f568c102010 0x7f568c1982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:01.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.382+0000 7f5690a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f568c1029c0 0x7f568c198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:01.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.383+0000 7f5690a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f568c107140 0x7f568c19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:01.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.383+0000 7f5690a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c19d210 con 0x7f568c107140 2024-09-13T15:56:01.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.383+0000 7f5690a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c19d380 con 0x7f568c102010 2024-09-13T15:56:01.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.383+0000 7f5690a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c19d4f0 con 0x7f568c1029c0 2024-09-13T15:56:01.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.383+0000 7f568b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f568c102010 0x7f568c1982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:01.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.383+0000 7f568b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f568c102010 0x7f568c1982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:52168/0 (socket says 172.21.15.17:52168) 2024-09-13T15:56:01.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.383+0000 7f568b400640 1 -- 172.21.15.17:0/1258295227 learned_addr learned my addr 172.21.15.17:0/1258295227 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:01.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.383+0000 7f5683e00640 1 --2- 172.21.15.17:0/1258295227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f568c1029c0 0x7f568c198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:01.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.383+0000 7f568be00640 1 --2- 172.21.15.17:0/1258295227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f568c107140 0x7f568c19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.383+0000 7f568b400640 1 -- 172.21.15.17:0/1258295227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f568c1029c0 msgr2=0x7f568c198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.383+0000 7f568b400640 1 --2- 172.21.15.17:0/1258295227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f568c1029c0 0x7f568c198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.383+0000 7f568b400640 1 -- 172.21.15.17:0/1258295227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f568c107140 msgr2=0x7f568c19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.383+0000 7f568b400640 1 --2- 172.21.15.17:0/1258295227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f568c107140 0x7f568c19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.383+0000 7f568b400640 1 -- 172.21.15.17:0/1258295227 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567c009560 con 0x7f568c102010 2024-09-13T15:56:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.384+0000 7f5683e00640 1 --2- 172.21.15.17:0/1258295227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f568c1029c0 0x7f568c198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.384+0000 7f568b400640 1 --2- 172.21.15.17:0/1258295227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f568c102010 0x7f568c1982d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f567c005ab0 tx=0x7f567c003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.384+0000 7f5688c00640 1 -- 172.21.15.17:0/1258295227 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567c005d50 con 0x7f568c102010 2024-09-13T15:56:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.384+0000 7f5688c00640 1 -- 172.21.15.17:0/1258295227 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f567c003e00 con 0x7f568c102010 2024-09-13T15:56:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.384+0000 7f5690a00640 1 -- 172.21.15.17:0/1258295227 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f568c19d770 con 0x7f568c102010 2024-09-13T15:56:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.384+0000 7f5688c00640 1 -- 172.21.15.17:0/1258295227 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567c03bb00 con 0x7f568c102010 2024-09-13T15:56:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.384+0000 7f5690a00640 1 -- 172.21.15.17:0/1258295227 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568c1a4ec0 con 0x7f568c102010 2024-09-13T15:56:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.385+0000 7f5690a00640 1 -- 172.21.15.17:0/1258295227 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f568c1034f0 con 0x7f568c102010 2024-09-13T15:56:01.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.387+0000 7f5688c00640 1 -- 172.21.15.17:0/1258295227 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f567c03bc60 con 0x7f568c102010 2024-09-13T15:56:01.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.389+0000 7f5688c00640 1 --2- 172.21.15.17:0/1258295227 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f56700a1100 0x7f56700a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:01.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.389+0000 7f5688c00640 1 -- 172.21.15.17:0/1258295227 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f567c0ed610 con 0x7f568c102010 2024-09-13T15:56:01.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.389+0000 7f5683e00640 1 --2- 172.21.15.17:0/1258295227 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f56700a1100 0x7f56700a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:01.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.389+0000 7f5688c00640 1 --2- 172.21.15.17:0/1258295227 >> [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803] conn(0x7f56700ac190 0x7f56700ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:01.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.389+0000 7f5688c00640 1 -- 172.21.15.17:0/1258295227 --> [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f56700aed00 con 0x7f56700ac190 2024-09-13T15:56:01.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.389+0000 7f5688c00640 1 -- 172.21.15.17:0/1258295227 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f567c0ed980 con 0x7f568c102010 2024-09-13T15:56:01.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.389+0000 7f568be00640 1 --2- 172.21.15.17:0/1258295227 >> [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803] conn(0x7f56700ac190 0x7f56700ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:01.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.390+0000 7f5683e00640 1 --2- 172.21.15.17:0/1258295227 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f56700a1100 0x7f56700a35c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f568c199880 tx=0x7f5674005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:01.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.390+0000 7f568be00640 1 --2- 172.21.15.17:0/1258295227 >> [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803] conn(0x7f56700ac190 0x7f56700ae630 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:01.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.391+0000 7f5688c00640 1 -- 172.21.15.17:0/1258295227 <== osd.3 v2:172.21.15.17:6810/919913803 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f56700aed00 con 0x7f56700ac190 2024-09-13T15:56:01.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.406+0000 7f5690a00640 1 -- 172.21.15.17:0/1258295227 --> [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f568c112100 con 0x7f56700ac190 2024-09-13T15:56:01.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.407+0000 7f5688c00640 1 -- 172.21.15.17:0/1258295227 <== osd.3 v2:172.21.15.17:6810/919913803 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f5684004b20 con 0x7f56700ac190 2024-09-13T15:56:01.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.407+0000 7f5690a00640 1 -- 172.21.15.17:0/1258295227 >> [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803] conn(0x7f56700ac190 msgr2=0x7f56700ae630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:01.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.407+0000 7f5690a00640 1 --2- 172.21.15.17:0/1258295227 >> [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803] conn(0x7f56700ac190 0x7f56700ae630 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:01.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.407+0000 7f5690a00640 1 -- 172.21.15.17:0/1258295227 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f56700a1100 msgr2=0x7f56700a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:01.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.407+0000 7f5690a00640 1 --2- 172.21.15.17:0/1258295227 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f56700a1100 0x7f56700a35c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f568c199880 tx=0x7f5674005f90 comp rx=0 tx=0).stop 2024-09-13T15:56:01.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.407+0000 7f5690a00640 1 -- 172.21.15.17:0/1258295227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f568c102010 msgr2=0x7f568c1982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:01.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.407+0000 7f5690a00640 1 --2- 172.21.15.17:0/1258295227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f568c102010 0x7f568c1982d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f567c005ab0 tx=0x7f567c003c10 comp rx=0 tx=0).stop 2024-09-13T15:56:01.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.407+0000 7f568be00640 1 -- 172.21.15.17:0/1258295227 reap_dead start 2024-09-13T15:56:01.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.407+0000 7f5690a00640 1 -- 172.21.15.17:0/1258295227 shutdown_connections 2024-09-13T15:56:01.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.407+0000 7f5690a00640 1 -- 172.21.15.17:0/1258295227 >> 172.21.15.17:0/1258295227 conn(0x7f568c0fda70 msgr2=0x7f568c0fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:01.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.408+0000 7f5690a00640 1 -- 172.21.15.17:0/1258295227 shutdown_connections 2024-09-13T15:56:01.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.408+0000 7f5690a00640 1 -- 172.21.15.17:0/1258295227 wait complete. 2024-09-13T15:56:01.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:01 smithi193 ceph-mon[35248]: pgmap v331: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:56:01.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:01 smithi189 ceph-mon[34790]: pgmap v331: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:56:01.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.652+0000 7f0802000640 1 -- 172.21.15.17:0/831842491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07fc0ff660 msgr2=0x7f07fc103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:01.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.652+0000 7f0802000640 1 --2- 172.21.15.17:0/831842491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07fc0ff660 0x7f07fc103b30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f07e8009930 tx=0x7f07e802a420 comp rx=0 tx=0).stop 2024-09-13T15:56:01.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.652+0000 7f0802000640 1 -- 172.21.15.17:0/831842491 shutdown_connections 2024-09-13T15:56:01.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.652+0000 7f0802000640 1 --2- 172.21.15.17:0/831842491 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07fc104260 0x7f07fc104710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:01.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.652+0000 7f0802000640 1 --2- 172.21.15.17:0/831842491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07fc0ff660 0x7f07fc103b30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:01.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.652+0000 7f0802000640 1 --2- 172.21.15.17:0/831842491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07fc0fed40 0x7f07fc0ff120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:01.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.652+0000 7f0802000640 1 -- 172.21.15.17:0/831842491 >> 172.21.15.17:0/831842491 conn(0x7f07fc0fa9b0 msgr2=0x7f07fc0fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:01.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.652+0000 7f0802000640 1 -- 172.21.15.17:0/831842491 shutdown_connections 2024-09-13T15:56:01.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.652+0000 7f0802000640 1 -- 172.21.15.17:0/831842491 wait complete. 2024-09-13T15:56:01.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.653+0000 7f0802000640 1 Processor -- start 2024-09-13T15:56:01.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.654+0000 7f0802000640 1 -- start start 2024-09-13T15:56:01.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.654+0000 7f0802000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07fc0fed40 0x7f07fc19c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:01.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.654+0000 7f0802000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07fc0ff660 0x7f07fc19cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:01.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.654+0000 7f07fb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07fc0fed40 0x7f07fc19c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:01.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.654+0000 7f07fb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07fc0fed40 0x7f07fc19c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56906/0 (socket says 172.21.15.17:56906) 2024-09-13T15:56:01.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.654+0000 7f07faa00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07fc0ff660 0x7f07fc19cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:01.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.654+0000 7f07faa00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07fc0ff660 0x7f07fc19cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:44198/0 (socket says 172.21.15.17:44198) 2024-09-13T15:56:01.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.655+0000 7f0802000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07fc104260 0x7f07fc1a1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:01.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.655+0000 7f0802000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc1a1960 con 0x7f07fc0fed40 2024-09-13T15:56:01.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.655+0000 7f0802000640 1 -- 172.21.15.17:0/4019060328 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc1a1ad0 con 0x7f07fc104260 2024-09-13T15:56:01.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.655+0000 7f07fb400640 1 -- 172.21.15.17:0/4019060328 learned_addr learned my addr 172.21.15.17:0/4019060328 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:01.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.655+0000 7f0802000640 1 -- 172.21.15.17:0/4019060328 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc1a1c90 con 0x7f07fc0ff660 2024-09-13T15:56:01.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.655+0000 7f07fbe00640 1 --2- 172.21.15.17:0/4019060328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07fc104260 0x7f07fc1a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:01.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.655+0000 7f07faa00640 1 -- 172.21.15.17:0/4019060328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07fc104260 msgr2=0x7f07fc1a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:01.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.655+0000 7f07faa00640 1 --2- 172.21.15.17:0/4019060328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07fc104260 0x7f07fc1a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:01.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.655+0000 7f07faa00640 1 -- 172.21.15.17:0/4019060328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07fc0fed40 msgr2=0x7f07fc19c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:01.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.655+0000 7f07faa00640 1 --2- 172.21.15.17:0/4019060328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07fc0fed40 0x7f07fc19c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:01.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.655+0000 7f07faa00640 1 -- 172.21.15.17:0/4019060328 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e8009560 con 0x7f07fc0ff660 2024-09-13T15:56:01.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.655+0000 7f07fb400640 1 --2- 172.21.15.17:0/4019060328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07fc0fed40 0x7f07fc19c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:01.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.656+0000 7f07faa00640 1 --2- 172.21.15.17:0/4019060328 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07fc0ff660 0x7f07fc19cf30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f07e802a940 tx=0x7f07e8003cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:01.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.656+0000 7f07f3e00640 1 -- 172.21.15.17:0/4019060328 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e8005460 con 0x7f07fc0ff660 2024-09-13T15:56:01.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.656+0000 7f0802000640 1 -- 172.21.15.17:0/4019060328 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07fc1a1f10 con 0x7f07fc0ff660 2024-09-13T15:56:01.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.656+0000 7f07f3e00640 1 -- 172.21.15.17:0/4019060328 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07e80055c0 con 0x7f07fc0ff660 2024-09-13T15:56:01.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.656+0000 7f07f3e00640 1 -- 172.21.15.17:0/4019060328 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e8031ae0 con 0x7f07fc0ff660 2024-09-13T15:56:01.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.656+0000 7f0802000640 1 -- 172.21.15.17:0/4019060328 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07fc1a97e0 con 0x7f07fc0ff660 2024-09-13T15:56:01.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.657+0000 7f0802000640 1 -- 172.21.15.17:0/4019060328 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f07fc1167c0 con 0x7f07fc0ff660 2024-09-13T15:56:01.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.660+0000 7f07f3e00640 1 -- 172.21.15.17:0/4019060328 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f07e80046c0 con 0x7f07fc0ff660 2024-09-13T15:56:01.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.661+0000 7f07f3e00640 1 --2- 172.21.15.17:0/4019060328 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f07e00a1190 0x7f07e00a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.661+0000 7f07f3e00640 1 -- 172.21.15.17:0/4019060328 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f07e80ee440 con 0x7f07fc0ff660 2024-09-13T15:56:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.661+0000 7f07fb400640 1 --2- 172.21.15.17:0/4019060328 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f07e00a1190 0x7f07e00a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.661+0000 7f07f3e00640 1 --2- 172.21.15.17:0/4019060328 >> [v2:172.21.15.189:6816/3691677495,v1:172.21.15.189:6817/3691677495] conn(0x7f07e00ac220 0x7f07e00ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.661+0000 7f07f3e00640 1 -- 172.21.15.17:0/4019060328 --> [v2:172.21.15.189:6816/3691677495,v1:172.21.15.189:6817/3691677495] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f07e00aed90 con 0x7f07e00ac220 2024-09-13T15:56:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.661+0000 7f07f3e00640 1 -- 172.21.15.17:0/4019060328 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07e80ee7b0 con 0x7f07fc0ff660 2024-09-13T15:56:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.662+0000 7f07fbe00640 1 --2- 172.21.15.17:0/4019060328 >> [v2:172.21.15.189:6816/3691677495,v1:172.21.15.189:6817/3691677495] conn(0x7f07e00ac220 0x7f07e00ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:01.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.662+0000 7f07fb400640 1 --2- 172.21.15.17:0/4019060328 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f07e00a1190 0x7f07e00a3650 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009e10 tx=0x7f07ec0091c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:01.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.662+0000 7f07fbe00640 1 --2- 172.21.15.17:0/4019060328 >> [v2:172.21.15.189:6816/3691677495,v1:172.21.15.189:6817/3691677495] conn(0x7f07e00ac220 0x7f07e00ae6c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:01.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.663+0000 7f07f3e00640 1 -- 172.21.15.17:0/4019060328 <== osd.7 v2:172.21.15.189:6816/3691677495 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f07e00aed90 con 0x7f07e00ac220 2024-09-13T15:56:01.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.677+0000 7f0802000640 1 -- 172.21.15.17:0/4019060328 --> [v2:172.21.15.189:6816/3691677495,v1:172.21.15.189:6817/3691677495] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f07fc0fc570 con 0x7f07e00ac220 2024-09-13T15:56:01.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.678+0000 7f07f3e00640 1 -- 172.21.15.17:0/4019060328 <== osd.7 v2:172.21.15.189:6816/3691677495 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f07fc0fc570 con 0x7f07e00ac220 2024-09-13T15:56:01.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.678+0000 7f0802000640 1 -- 172.21.15.17:0/4019060328 >> [v2:172.21.15.189:6816/3691677495,v1:172.21.15.189:6817/3691677495] conn(0x7f07e00ac220 msgr2=0x7f07e00ae6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:01.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.678+0000 7f0802000640 1 --2- 172.21.15.17:0/4019060328 >> [v2:172.21.15.189:6816/3691677495,v1:172.21.15.189:6817/3691677495] conn(0x7f07e00ac220 0x7f07e00ae6c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:01.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.678+0000 7f0802000640 1 -- 172.21.15.17:0/4019060328 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f07e00a1190 msgr2=0x7f07e00a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:01.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.678+0000 7f0802000640 1 --2- 172.21.15.17:0/4019060328 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f07e00a1190 0x7f07e00a3650 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009e10 tx=0x7f07ec0091c0 comp rx=0 tx=0).stop 2024-09-13T15:56:01.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.678+0000 7f0802000640 1 -- 172.21.15.17:0/4019060328 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07fc0ff660 msgr2=0x7f07fc19cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:01.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.678+0000 7f0802000640 1 --2- 172.21.15.17:0/4019060328 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07fc0ff660 0x7f07fc19cf30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f07e802a940 tx=0x7f07e8003cd0 comp rx=0 tx=0).stop 2024-09-13T15:56:01.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.679+0000 7f07fbe00640 1 -- 172.21.15.17:0/4019060328 reap_dead start 2024-09-13T15:56:01.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.679+0000 7f0802000640 1 -- 172.21.15.17:0/4019060328 shutdown_connections 2024-09-13T15:56:01.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.679+0000 7f0802000640 1 -- 172.21.15.17:0/4019060328 >> 172.21.15.17:0/4019060328 conn(0x7f07fc0fa9b0 msgr2=0x7f07fc0fbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:01.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.679+0000 7f0802000640 1 -- 172.21.15.17:0/4019060328 shutdown_connections 2024-09-13T15:56:01.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:01.679+0000 7f0802000640 1 -- 172.21.15.17:0/4019060328 wait complete. 2024-09-13T15:56:02.136 INFO:teuthology.orchestra.run.smithi017.stdout:292057776166 2024-09-13T15:56:02.137 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-13T15:56:02.589 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:56:02.597 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:56:02.604 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:56:03.129 INFO:teuthology.orchestra.run.smithi017.stdout:111669149764 2024-09-13T15:56:03.129 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-13T15:56:03.370 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:03 smithi017 ceph-mon[30494]: pgmap v332: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:03.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:03 smithi193 ceph-mon[35248]: pgmap v332: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:03.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:03 smithi189 ceph-mon[34790]: pgmap v332: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:05.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:05 smithi193 ceph-mon[35248]: pgmap v333: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-13T15:56:05.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:05 smithi017 ceph-mon[30494]: pgmap v333: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-13T15:56:05.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:05 smithi189 ceph-mon[34790]: pgmap v333: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-13T15:56:06.324 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:56:06.329 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:06 smithi017 ceph-mon[30494]: pgmap v334: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:06.507 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:06 smithi193 ceph-mon[35248]: pgmap v334: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:06.608 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:06 smithi189 ceph-mon[34790]: pgmap v334: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:06.956 INFO:teuthology.orchestra.run.smithi017.stdout:223338299439 2024-09-13T15:56:06.957 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-13T15:56:07.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.693+0000 7fb06ae00640 1 -- 172.21.15.17:0/4068810052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb064110a50 msgr2=0x7fb064112e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:07.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.693+0000 7fb06ae00640 1 --2- 172.21.15.17:0/4068810052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb064110a50 0x7fb064112e40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009900 tx=0x7fb05c02a3f0 comp rx=0 tx=0).stop 2024-09-13T15:56:07.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.693+0000 7fb06ae00640 1 -- 172.21.15.17:0/4068810052 shutdown_connections 2024-09-13T15:56:07.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.693+0000 7fb06ae00640 1 --2- 172.21.15.17:0/4068810052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb064110a50 0x7fb064112e40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:07.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.693+0000 7fb06ae00640 1 --2- 172.21.15.17:0/4068810052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb064075300 0x7fb064110510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:07.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.693+0000 7fb06ae00640 1 --2- 172.21.15.17:0/4068810052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0640749e0 0x7fb064074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:07.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.693+0000 7fb06ae00640 1 -- 172.21.15.17:0/4068810052 >> 172.21.15.17:0/4068810052 conn(0x7fb0640fda70 msgr2=0x7fb0640ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:07.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.693+0000 7fb06ae00640 1 -- 172.21.15.17:0/4068810052 shutdown_connections 2024-09-13T15:56:07.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.693+0000 7fb06ae00640 1 -- 172.21.15.17:0/4068810052 wait complete. 2024-09-13T15:56:07.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.694+0000 7fb06ae00640 1 Processor -- start 2024-09-13T15:56:07.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.694+0000 7fb06ae00640 1 -- start start 2024-09-13T15:56:07.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.694+0000 7fb06ae00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0640749e0 0x7fb06419c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:07.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.694+0000 7fb06ae00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb064075300 0x7fb06419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:07.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.694+0000 7fb06ae00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb064110a50 0x7fb0641a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:07.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.694+0000 7fb06ae00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0641a15f0 con 0x7fb064110a50 2024-09-13T15:56:07.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.694+0000 7fb06ae00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0641a1760 con 0x7fb0640749e0 2024-09-13T15:56:07.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.694+0000 7fb06ae00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0641a18d0 con 0x7fb064075300 2024-09-13T15:56:07.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.695+0000 7fb06a400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb064110a50 0x7fb0641a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:07.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.695+0000 7fb069a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0640749e0 0x7fb06419c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:07.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.695+0000 7fb06a400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb064110a50 0x7fb0641a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56936/0 (socket says 172.21.15.17:56936) 2024-09-13T15:56:07.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.695+0000 7fb06a400640 1 -- 172.21.15.17:0/53759975 learned_addr learned my addr 172.21.15.17:0/53759975 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:07.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.695+0000 7fb069000640 1 --2- 172.21.15.17:0/53759975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb064075300 0x7fb06419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:07.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.695+0000 7fb069a00640 1 -- 172.21.15.17:0/53759975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb064075300 msgr2=0x7fb06419cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:07.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.695+0000 7fb069a00640 1 --2- 172.21.15.17:0/53759975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb064075300 0x7fb06419cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:07.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.695+0000 7fb069a00640 1 -- 172.21.15.17:0/53759975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb064110a50 msgr2=0x7fb0641a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:07.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.695+0000 7fb069a00640 1 --2- 172.21.15.17:0/53759975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb064110a50 0x7fb0641a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:07.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.695+0000 7fb069a00640 1 -- 172.21.15.17:0/53759975 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05c009560 con 0x7fb0640749e0 2024-09-13T15:56:07.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.695+0000 7fb069a00640 1 --2- 172.21.15.17:0/53759975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0640749e0 0x7fb06419c6b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb05800eb00 tx=0x7fb05800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:07.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.696+0000 7fb062000640 1 -- 172.21.15.17:0/53759975 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058010430 con 0x7fb0640749e0 2024-09-13T15:56:07.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.696+0000 7fb062000640 1 -- 172.21.15.17:0/53759975 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb058010a50 con 0x7fb0640749e0 2024-09-13T15:56:07.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.696+0000 7fb06ae00640 1 -- 172.21.15.17:0/53759975 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0641a1bb0 con 0x7fb0640749e0 2024-09-13T15:56:07.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.696+0000 7fb062000640 1 -- 172.21.15.17:0/53759975 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058017a60 con 0x7fb0640749e0 2024-09-13T15:56:07.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.696+0000 7fb06ae00640 1 -- 172.21.15.17:0/53759975 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0641a9470 con 0x7fb0640749e0 2024-09-13T15:56:07.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.697+0000 7fb06ae00640 1 -- 172.21.15.17:0/53759975 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb064076120 con 0x7fb0640749e0 2024-09-13T15:56:07.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.699+0000 7fb062000640 1 -- 172.21.15.17:0/53759975 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb058017bc0 con 0x7fb0640749e0 2024-09-13T15:56:07.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.700+0000 7fb062000640 1 --2- 172.21.15.17:0/53759975 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb04c0a1100 0x7fb04c0a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:07.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.701+0000 7fb062000640 1 -- 172.21.15.17:0/53759975 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb058014070 con 0x7fb0640749e0 2024-09-13T15:56:07.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.701+0000 7fb069000640 1 --2- 172.21.15.17:0/53759975 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb04c0a1100 0x7fb04c0a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:07.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.701+0000 7fb069000640 1 --2- 172.21.15.17:0/53759975 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb04c0a1100 0x7fb04c0a35c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb06419dc60 tx=0x7fb05000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:07.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.702+0000 7fb062000640 1 -- 172.21.15.17:0/53759975 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb058096f50 con 0x7fb0640749e0 2024-09-13T15:56:07.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.887+0000 7fb06ae00640 1 -- 172.21.15.17:0/53759975 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7fb06419da10 con 0x7fb0640749e0 2024-09-13T15:56:07.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.888+0000 7fb062000640 1 -- 172.21.15.17:0/53759975 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fb05809a570 con 0x7fb0640749e0 2024-09-13T15:56:07.065 INFO:teuthology.orchestra.run.smithi017.stdout:313532612640 2024-09-13T15:56:07.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.890+0000 7fb06ae00640 1 -- 172.21.15.17:0/53759975 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb04c0a1100 msgr2=0x7fb04c0a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:07.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.890+0000 7fb06ae00640 1 --2- 172.21.15.17:0/53759975 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb04c0a1100 0x7fb04c0a35c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb06419dc60 tx=0x7fb05000b410 comp rx=0 tx=0).stop 2024-09-13T15:56:07.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.890+0000 7fb06ae00640 1 -- 172.21.15.17:0/53759975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0640749e0 msgr2=0x7fb06419c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:07.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.890+0000 7fb06ae00640 1 --2- 172.21.15.17:0/53759975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0640749e0 0x7fb06419c6b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb05800eb00 tx=0x7fb05800c2d0 comp rx=0 tx=0).stop 2024-09-13T15:56:07.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.890+0000 7fb06ae00640 1 -- 172.21.15.17:0/53759975 shutdown_connections 2024-09-13T15:56:07.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.890+0000 7fb06ae00640 1 --2- 172.21.15.17:0/53759975 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb04c0a1100 0x7fb04c0a35c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:07.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.890+0000 7fb06ae00640 1 --2- 172.21.15.17:0/53759975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb064110a50 0x7fb0641a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:07.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.890+0000 7fb06ae00640 1 --2- 172.21.15.17:0/53759975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb064075300 0x7fb06419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:07.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.890+0000 7fb06ae00640 1 --2- 172.21.15.17:0/53759975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0640749e0 0x7fb06419c6b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:07.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.890+0000 7fb06ae00640 1 -- 172.21.15.17:0/53759975 >> 172.21.15.17:0/53759975 conn(0x7fb0640fda70 msgr2=0x7fb0640ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:07.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.890+0000 7fb06ae00640 1 -- 172.21.15.17:0/53759975 shutdown_connections 2024-09-13T15:56:07.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:06.890+0000 7fb06ae00640 1 -- 172.21.15.17:0/53759975 wait complete. 2024-09-13T15:56:07.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:07 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/53759975' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-13T15:56:07.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:07 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/53759975' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-13T15:56:07.557 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:56:07.591 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:56:07.592 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:56:07.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:07 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/53759975' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-13T15:56:07.887 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612637 got 313532612640 for osd.10 2024-09-13T15:56:07.888 DEBUG:teuthology.parallel:result is None 2024-09-13T15:56:08.471 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:08 smithi017 ceph-mon[30494]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-13T15:56:08.500 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:56:08.501 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:56:08.501 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:56:08.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:08 smithi193 ceph-mon[35248]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-13T15:56:08.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:08 smithi189 ceph-mon[34790]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-13T15:56:09.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.912+0000 7f464da00640 1 -- 172.21.15.17:0/1494441118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46480749e0 msgr2=0x7f4648074dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:09.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.912+0000 7f464da00640 1 --2- 172.21.15.17:0/1494441118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46480749e0 0x7f4648074dc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4638009900 tx=0x7f463802a3f0 comp rx=0 tx=0).stop 2024-09-13T15:56:09.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.912+0000 7f464da00640 1 -- 172.21.15.17:0/1494441118 shutdown_connections 2024-09-13T15:56:09.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.912+0000 7f464da00640 1 --2- 172.21.15.17:0/1494441118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4648110c40 0x7f4648113030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:09.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.912+0000 7f464da00640 1 --2- 172.21.15.17:0/1494441118 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4648075300 0x7f4648110700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:09.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.912+0000 7f464da00640 1 --2- 172.21.15.17:0/1494441118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46480749e0 0x7f4648074dc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:09.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.912+0000 7f464da00640 1 -- 172.21.15.17:0/1494441118 >> 172.21.15.17:0/1494441118 conn(0x7f46480fdc60 msgr2=0x7f4648100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:09.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.912+0000 7f464da00640 1 -- 172.21.15.17:0/1494441118 shutdown_connections 2024-09-13T15:56:09.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.912+0000 7f464da00640 1 -- 172.21.15.17:0/1494441118 wait complete. 2024-09-13T15:56:09.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.913+0000 7f464da00640 1 Processor -- start 2024-09-13T15:56:09.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.914+0000 7f464da00640 1 -- start start 2024-09-13T15:56:09.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.914+0000 7f464da00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46480749e0 0x7f46481a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:09.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.914+0000 7f464da00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4648075300 0x7f46481a2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:09.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.914+0000 7f464da00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4648110c40 0x7f464819c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:09.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.914+0000 7f464da00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464819ce90 con 0x7f4648075300 2024-09-13T15:56:09.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.914+0000 7f464da00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464819d000 con 0x7f46480749e0 2024-09-13T15:56:09.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.914+0000 7f464da00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464819d1c0 con 0x7f4648110c40 2024-09-13T15:56:09.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.914+0000 7f4646000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4648075300 0x7f46481a2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:09.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.914+0000 7f4646000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4648075300 0x7f46481a2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33948/0 (socket says 172.21.15.17:33948) 2024-09-13T15:56:09.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.914+0000 7f4647400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4648110c40 0x7f464819c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:09.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.914+0000 7f4646000640 1 -- 172.21.15.17:0/4153799748 learned_addr learned my addr 172.21.15.17:0/4153799748 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:09.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.914+0000 7f4646a00640 1 --2- 172.21.15.17:0/4153799748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46480749e0 0x7f46481a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:09.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.915+0000 7f4646000640 1 -- 172.21.15.17:0/4153799748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4648110c40 msgr2=0x7f464819c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:09.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.915+0000 7f4646000640 1 --2- 172.21.15.17:0/4153799748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4648110c40 0x7f464819c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:09.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.915+0000 7f4646000640 1 -- 172.21.15.17:0/4153799748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46480749e0 msgr2=0x7f46481a26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.915+0000 7f4646000640 1 --2- 172.21.15.17:0/4153799748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46480749e0 0x7f46481a26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.915+0000 7f4646000640 1 -- 172.21.15.17:0/4153799748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4638009560 con 0x7f4648075300 2024-09-13T15:56:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.915+0000 7f4646000640 1 --2- 172.21.15.17:0/4153799748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4648075300 0x7f46481a2be0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f463400e9f0 tx=0x7f463400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.915+0000 7f463f400640 1 -- 172.21.15.17:0/4153799748 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4634009720 con 0x7f4648075300 2024-09-13T15:56:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.915+0000 7f463f400640 1 -- 172.21.15.17:0/4153799748 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f463400cd80 con 0x7f4648075300 2024-09-13T15:56:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.915+0000 7f464da00640 1 -- 172.21.15.17:0/4153799748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464819d4a0 con 0x7f4648075300 2024-09-13T15:56:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.915+0000 7f463f400640 1 -- 172.21.15.17:0/4153799748 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4634010430 con 0x7f4648075300 2024-09-13T15:56:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.916+0000 7f464da00640 1 -- 172.21.15.17:0/4153799748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46481a9690 con 0x7f4648075300 2024-09-13T15:56:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.917+0000 7f464da00640 1 -- 172.21.15.17:0/4153799748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4648076120 con 0x7f4648075300 2024-09-13T15:56:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.919+0000 7f463f400640 1 -- 172.21.15.17:0/4153799748 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f4634005020 con 0x7f4648075300 2024-09-13T15:56:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.921+0000 7f463f400640 1 --2- 172.21.15.17:0/4153799748 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f462c0a1110 0x7f462c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.922+0000 7f463f400640 1 -- 172.21.15.17:0/4153799748 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f4634014070 con 0x7f4648075300 2024-09-13T15:56:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.922+0000 7f4646a00640 1 --2- 172.21.15.17:0/4153799748 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f462c0a1110 0x7f462c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.922+0000 7f4646a00640 1 --2- 172.21.15.17:0/4153799748 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f462c0a1110 0x7f462c0a35d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f463802a9e0 tx=0x7f46380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:09.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:08.926+0000 7f463f400640 1 -- 172.21.15.17:0/4153799748 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4634096420 con 0x7f4648075300 2024-09-13T15:56:09.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:09.127+0000 7f464da00640 1 -- 172.21.15.17:0/4153799748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f4648074dc0 con 0x7f4648075300 2024-09-13T15:56:09.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:09.127+0000 7f463f400640 1 -- 172.21.15.17:0/4153799748 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f4634099a40 con 0x7f4648075300 2024-09-13T15:56:09.129 INFO:teuthology.orchestra.run.smithi017.stdout:347892351004 2024-09-13T15:56:09.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:09.129+0000 7f464da00640 1 -- 172.21.15.17:0/4153799748 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f462c0a1110 msgr2=0x7f462c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:09.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:09.129+0000 7f464da00640 1 --2- 172.21.15.17:0/4153799748 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f462c0a1110 0x7f462c0a35d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f463802a9e0 tx=0x7f46380058d0 comp rx=0 tx=0).stop 2024-09-13T15:56:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:09.129+0000 7f464da00640 1 -- 172.21.15.17:0/4153799748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4648075300 msgr2=0x7f46481a2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:09.129+0000 7f464da00640 1 --2- 172.21.15.17:0/4153799748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4648075300 0x7f46481a2be0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f463400e9f0 tx=0x7f463400edf0 comp rx=0 tx=0).stop 2024-09-13T15:56:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:09.129+0000 7f464da00640 1 -- 172.21.15.17:0/4153799748 shutdown_connections 2024-09-13T15:56:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:09.129+0000 7f464da00640 1 --2- 172.21.15.17:0/4153799748 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f462c0a1110 0x7f462c0a35d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:09.129+0000 7f464da00640 1 --2- 172.21.15.17:0/4153799748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4648110c40 0x7f464819c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:09.129+0000 7f464da00640 1 --2- 172.21.15.17:0/4153799748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4648075300 0x7f46481a2be0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:09.129+0000 7f464da00640 1 --2- 172.21.15.17:0/4153799748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46480749e0 0x7f46481a26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:09.130+0000 7f464da00640 1 -- 172.21.15.17:0/4153799748 >> 172.21.15.17:0/4153799748 conn(0x7f46480fdc60 msgr2=0x7f4648112a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:09.130+0000 7f464da00640 1 -- 172.21.15.17:0/4153799748 shutdown_connections 2024-09-13T15:56:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:09.130+0000 7f464da00640 1 -- 172.21.15.17:0/4153799748 wait complete. 2024-09-13T15:56:09.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:09 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/4153799748' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-13T15:56:09.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:09 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/4153799748' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-13T15:56:09.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:09 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/4153799748' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-13T15:56:10.475 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:10 smithi017 ceph-mon[30494]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:56:10.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:10 smithi193 ceph-mon[35248]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:56:10.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:10 smithi189 ceph-mon[34790]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:56:11.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.476+0000 7fef56600640 1 -- 172.21.15.17:0/3327671608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef50102bb0 msgr2=0x7fef50106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:11.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.476+0000 7fef56600640 1 --2- 172.21.15.17:0/3327671608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef50102bb0 0x7fef50106c00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fef38009890 tx=0x7fef3802a360 comp rx=0 tx=0).stop 2024-09-13T15:56:11.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.476+0000 7fef56600640 1 -- 172.21.15.17:0/3327671608 shutdown_connections 2024-09-13T15:56:11.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.476+0000 7fef56600640 1 --2- 172.21.15.17:0/3327671608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef50107330 0x7fef5010eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:11.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.476+0000 7fef56600640 1 --2- 172.21.15.17:0/3327671608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef50102bb0 0x7fef50106c00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:11.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.476+0000 7fef56600640 1 --2- 172.21.15.17:0/3327671608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef50102200 0x7fef501025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:11.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.476+0000 7fef56600640 1 -- 172.21.15.17:0/3327671608 >> 172.21.15.17:0/3327671608 conn(0x7fef500fdc60 msgr2=0x7fef50100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:11.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.476+0000 7fef56600640 1 -- 172.21.15.17:0/3327671608 shutdown_connections 2024-09-13T15:56:11.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.476+0000 7fef56600640 1 -- 172.21.15.17:0/3327671608 wait complete. 2024-09-13T15:56:11.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.477+0000 7fef56600640 1 Processor -- start 2024-09-13T15:56:11.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.478+0000 7fef56600640 1 -- start start 2024-09-13T15:56:11.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.478+0000 7fef56600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef50102200 0x7fef50198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:11.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.478+0000 7fef56600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef50102bb0 0x7fef50198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:11.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.478+0000 7fef56600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef50107330 0x7fef5019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:11.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.478+0000 7fef56600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5019d450 con 0x7fef50102bb0 2024-09-13T15:56:11.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.478+0000 7fef56600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5019d5c0 con 0x7fef50102200 2024-09-13T15:56:11.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.478+0000 7fef56600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5019d730 con 0x7fef50107330 2024-09-13T15:56:11.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.478+0000 7fef4f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef50102200 0x7fef50198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:11.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.478+0000 7fef4f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef50102200 0x7fef50198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:49578/0 (socket says 172.21.15.17:49578) 2024-09-13T15:56:11.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.478+0000 7fef4f400640 1 -- 172.21.15.17:0/4173913210 learned_addr learned my addr 172.21.15.17:0/4173913210 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:11.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.478+0000 7fef47e00640 1 --2- 172.21.15.17:0/4173913210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef50102bb0 0x7fef50198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:11.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.478+0000 7fef4fe00640 1 --2- 172.21.15.17:0/4173913210 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef50107330 0x7fef5019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:11.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.479+0000 7fef4f400640 1 -- 172.21.15.17:0/4173913210 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef50107330 msgr2=0x7fef5019ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:11.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.479+0000 7fef4f400640 1 --2- 172.21.15.17:0/4173913210 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef50107330 0x7fef5019ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:11.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.479+0000 7fef4f400640 1 -- 172.21.15.17:0/4173913210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef50102bb0 msgr2=0x7fef50198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:11.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.479+0000 7fef4f400640 1 --2- 172.21.15.17:0/4173913210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef50102bb0 0x7fef50198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:11.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.479+0000 7fef4f400640 1 -- 172.21.15.17:0/4173913210 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef48009900 con 0x7fef50102200 2024-09-13T15:56:11.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.479+0000 7fef4f400640 1 --2- 172.21.15.17:0/4173913210 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef50102200 0x7fef50198510 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fef4000e9f0 tx=0x7fef4000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:11.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.479+0000 7fef4cc00640 1 -- 172.21.15.17:0/4173913210 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef40009700 con 0x7fef50102200 2024-09-13T15:56:11.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.479+0000 7fef4cc00640 1 -- 172.21.15.17:0/4173913210 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef4000cd80 con 0x7fef50102200 2024-09-13T15:56:11.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.479+0000 7fef56600640 1 -- 172.21.15.17:0/4173913210 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef38009490 con 0x7fef50102200 2024-09-13T15:56:11.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.480+0000 7fef56600640 1 -- 172.21.15.17:0/4173913210 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef501a5100 con 0x7fef50102200 2024-09-13T15:56:11.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.480+0000 7fef4cc00640 1 -- 172.21.15.17:0/4173913210 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef40018860 con 0x7fef50102200 2024-09-13T15:56:11.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.481+0000 7fef56600640 1 -- 172.21.15.17:0/4173913210 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef501036e0 con 0x7fef50102200 2024-09-13T15:56:11.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.483+0000 7fef4cc00640 1 -- 172.21.15.17:0/4173913210 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fef400189c0 con 0x7fef50102200 2024-09-13T15:56:11.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.484+0000 7fef4cc00640 1 --2- 172.21.15.17:0/4173913210 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fef340a1190 0x7fef340a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:11.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.484+0000 7fef4cc00640 1 -- 172.21.15.17:0/4173913210 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fef40014070 con 0x7fef50102200 2024-09-13T15:56:11.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.484+0000 7fef47e00640 1 --2- 172.21.15.17:0/4173913210 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fef340a1190 0x7fef340a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:11.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.485+0000 7fef47e00640 1 --2- 172.21.15.17:0/4173913210 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fef340a1190 0x7fef340a3650 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fef3802a950 tx=0x7fef380056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:11.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.486+0000 7fef4cc00640 1 -- 172.21.15.17:0/4173913210 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fef40096860 con 0x7fef50102200 2024-09-13T15:56:11.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.668+0000 7fef56600640 1 -- 172.21.15.17:0/4173913210 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fef50199870 con 0x7fef50102200 2024-09-13T15:56:11.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.669+0000 7fef4cc00640 1 -- 172.21.15.17:0/4173913210 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef40026090 con 0x7fef50102200 2024-09-13T15:56:11.671 INFO:teuthology.orchestra.run.smithi017.stdout:201863462967 2024-09-13T15:56:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.671+0000 7fef56600640 1 -- 172.21.15.17:0/4173913210 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fef340a1190 msgr2=0x7fef340a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.671+0000 7fef56600640 1 --2- 172.21.15.17:0/4173913210 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fef340a1190 0x7fef340a3650 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fef3802a950 tx=0x7fef380056d0 comp rx=0 tx=0).stop 2024-09-13T15:56:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.671+0000 7fef56600640 1 -- 172.21.15.17:0/4173913210 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef50102200 msgr2=0x7fef50198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.671+0000 7fef56600640 1 --2- 172.21.15.17:0/4173913210 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef50102200 0x7fef50198510 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fef4000e9f0 tx=0x7fef4000eeb0 comp rx=0 tx=0).stop 2024-09-13T15:56:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.671+0000 7fef56600640 1 -- 172.21.15.17:0/4173913210 shutdown_connections 2024-09-13T15:56:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.671+0000 7fef56600640 1 --2- 172.21.15.17:0/4173913210 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fef340a1190 0x7fef340a3650 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.671+0000 7fef56600640 1 --2- 172.21.15.17:0/4173913210 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef50107330 0x7fef5019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.671+0000 7fef56600640 1 --2- 172.21.15.17:0/4173913210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef50102bb0 0x7fef50198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.671+0000 7fef56600640 1 --2- 172.21.15.17:0/4173913210 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef50102200 0x7fef50198510 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.671+0000 7fef56600640 1 -- 172.21.15.17:0/4173913210 >> 172.21.15.17:0/4173913210 conn(0x7fef500fdc60 msgr2=0x7fef500ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.671+0000 7fef56600640 1 -- 172.21.15.17:0/4173913210 shutdown_connections 2024-09-13T15:56:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:11.671+0000 7fef56600640 1 -- 172.21.15.17:0/4173913210 wait complete. 2024-09-13T15:56:11.836 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:11 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/4173913210' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-13T15:56:12.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:11 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/4173913210' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-13T15:56:12.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:11 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/4173913210' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-13T15:56:12.954 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:12 smithi017 ceph-mon[30494]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:13.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:12 smithi193 ceph-mon[35248]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:13.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:12 smithi189 ceph-mon[34790]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:15.021 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:56:15.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:15 smithi193 ceph-mon[35248]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:15.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:15 smithi017 ceph-mon[30494]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:15.566 INFO:tasks.cephadm.ceph_manager.ceph:need seq 347892350999 got 347892351004 for osd.11 2024-09-13T15:56:15.566 DEBUG:teuthology.parallel:result is None 2024-09-13T15:56:15.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:15 smithi189 ceph-mon[34790]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:16.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.551+0000 7ffa81000640 1 -- 172.21.15.17:0/4240133321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa7c107330 msgr2=0x7ffa7c10eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:16.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.551+0000 7ffa81000640 1 --2- 172.21.15.17:0/4240133321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa7c107330 0x7ffa7c10eeb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009cd0 tx=0x7ffa7402a8e0 comp rx=0 tx=0).stop 2024-09-13T15:56:16.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.551+0000 7ffa81000640 1 -- 172.21.15.17:0/4240133321 shutdown_connections 2024-09-13T15:56:16.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.551+0000 7ffa81000640 1 --2- 172.21.15.17:0/4240133321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa7c107330 0x7ffa7c10eeb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:16.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.551+0000 7ffa81000640 1 --2- 172.21.15.17:0/4240133321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa7c102bb0 0x7ffa7c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:16.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.551+0000 7ffa81000640 1 --2- 172.21.15.17:0/4240133321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa7c102200 0x7ffa7c1025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:16.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.551+0000 7ffa81000640 1 -- 172.21.15.17:0/4240133321 >> 172.21.15.17:0/4240133321 conn(0x7ffa7c0fdc60 msgr2=0x7ffa7c100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:16.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.551+0000 7ffa81000640 1 -- 172.21.15.17:0/4240133321 shutdown_connections 2024-09-13T15:56:16.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.551+0000 7ffa81000640 1 -- 172.21.15.17:0/4240133321 wait complete. 2024-09-13T15:56:16.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.552+0000 7ffa81000640 1 Processor -- start 2024-09-13T15:56:16.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.552+0000 7ffa81000640 1 -- start start 2024-09-13T15:56:16.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.553+0000 7ffa81000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa7c102200 0x7ffa7c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:16.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.553+0000 7ffa81000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa7c102bb0 0x7ffa7c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:16.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.553+0000 7ffa81000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa7c107330 0x7ffa7c19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:16.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.553+0000 7ffa81000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c19d380 con 0x7ffa7c102200 2024-09-13T15:56:16.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.553+0000 7ffa81000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c19d4f0 con 0x7ffa7c102bb0 2024-09-13T15:56:16.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.553+0000 7ffa81000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c19d660 con 0x7ffa7c107330 2024-09-13T15:56:16.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.553+0000 7ffa79e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa7c102200 0x7ffa7c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:16.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.553+0000 7ffa79e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa7c102200 0x7ffa7c198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33968/0 (socket says 172.21.15.17:33968) 2024-09-13T15:56:16.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.553+0000 7ffa79e00640 1 -- 172.21.15.17:0/3978090415 learned_addr learned my addr 172.21.15.17:0/3978090415 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:16.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.553+0000 7ffa7a800640 1 --2- 172.21.15.17:0/3978090415 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa7c107330 0x7ffa7c19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:16.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.553+0000 7ffa79400640 1 --2- 172.21.15.17:0/3978090415 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa7c102bb0 0x7ffa7c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:16.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.554+0000 7ffa7a800640 1 -- 172.21.15.17:0/3978090415 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa7c102bb0 msgr2=0x7ffa7c198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:16.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.554+0000 7ffa7a800640 1 --2- 172.21.15.17:0/3978090415 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa7c102bb0 0x7ffa7c198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:16.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.554+0000 7ffa7a800640 1 -- 172.21.15.17:0/3978090415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa7c102200 msgr2=0x7ffa7c198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:16.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.554+0000 7ffa7a800640 1 --2- 172.21.15.17:0/3978090415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa7c102200 0x7ffa7c198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:16.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.554+0000 7ffa7a800640 1 -- 172.21.15.17:0/3978090415 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa74009900 con 0x7ffa7c107330 2024-09-13T15:56:16.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.554+0000 7ffa79e00640 1 --2- 172.21.15.17:0/3978090415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa7c102200 0x7ffa7c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:16.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.554+0000 7ffa7a800640 1 --2- 172.21.15.17:0/3978090415 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa7c107330 0x7ffa7c19cd80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffa74031040 tx=0x7ffa74031a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:16.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.555+0000 7ffa72a00640 1 -- 172.21.15.17:0/3978090415 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74003d80 con 0x7ffa7c107330 2024-09-13T15:56:16.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.555+0000 7ffa81000640 1 -- 172.21.15.17:0/3978090415 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa7c19d8e0 con 0x7ffa7c107330 2024-09-13T15:56:16.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.555+0000 7ffa72a00640 1 -- 172.21.15.17:0/3978090415 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa74031c30 con 0x7ffa7c107330 2024-09-13T15:56:16.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.555+0000 7ffa72a00640 1 -- 172.21.15.17:0/3978090415 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74045830 con 0x7ffa7c107330 2024-09-13T15:56:16.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.555+0000 7ffa81000640 1 -- 172.21.15.17:0/3978090415 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7c1a5200 con 0x7ffa7c107330 2024-09-13T15:56:16.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.556+0000 7ffa81000640 1 -- 172.21.15.17:0/3978090415 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7c1036e0 con 0x7ffa7c107330 2024-09-13T15:56:16.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.558+0000 7ffa72a00640 1 -- 172.21.15.17:0/3978090415 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ffa7400a040 con 0x7ffa7c107330 2024-09-13T15:56:16.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.559+0000 7ffa72a00640 1 --2- 172.21.15.17:0/3978090415 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ffa600a1110 0x7ffa600a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:16.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.559+0000 7ffa72a00640 1 -- 172.21.15.17:0/3978090415 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ffa740ee780 con 0x7ffa7c107330 2024-09-13T15:56:16.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.559+0000 7ffa79e00640 1 --2- 172.21.15.17:0/3978090415 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ffa600a1110 0x7ffa600a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:16.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.560+0000 7ffa79e00640 1 --2- 172.21.15.17:0/3978090415 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ffa600a1110 0x7ffa600a35d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c005fd0 tx=0x7ffa6c00b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:16.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.563+0000 7ffa72a00640 1 -- 172.21.15.17:0/3978090415 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ffa740b7af0 con 0x7ffa7c107330 2024-09-13T15:56:16.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.750+0000 7ffa81000640 1 -- 172.21.15.17:0/3978090415 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7ffa7c1025e0 con 0x7ffa7c107330 2024-09-13T15:56:16.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.751+0000 7ffa72a00640 1 -- 172.21.15.17:0/3978090415 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa740bb110 con 0x7ffa7c107330 2024-09-13T15:56:16.753 INFO:teuthology.orchestra.run.smithi017.stdout:257698037805 2024-09-13T15:56:16.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.754+0000 7ffa81000640 1 -- 172.21.15.17:0/3978090415 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ffa600a1110 msgr2=0x7ffa600a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:16.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.754+0000 7ffa81000640 1 --2- 172.21.15.17:0/3978090415 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ffa600a1110 0x7ffa600a35d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c005fd0 tx=0x7ffa6c00b4a0 comp rx=0 tx=0).stop 2024-09-13T15:56:16.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.754+0000 7ffa81000640 1 -- 172.21.15.17:0/3978090415 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa7c107330 msgr2=0x7ffa7c19cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:16.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.754+0000 7ffa81000640 1 --2- 172.21.15.17:0/3978090415 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa7c107330 0x7ffa7c19cd80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffa74031040 tx=0x7ffa74031a40 comp rx=0 tx=0).stop 2024-09-13T15:56:16.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.754+0000 7ffa81000640 1 -- 172.21.15.17:0/3978090415 shutdown_connections 2024-09-13T15:56:16.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.754+0000 7ffa81000640 1 --2- 172.21.15.17:0/3978090415 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ffa600a1110 0x7ffa600a35d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:16.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.754+0000 7ffa81000640 1 --2- 172.21.15.17:0/3978090415 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa7c107330 0x7ffa7c19cd80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:16.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.754+0000 7ffa81000640 1 --2- 172.21.15.17:0/3978090415 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa7c102bb0 0x7ffa7c198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:16.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.754+0000 7ffa81000640 1 --2- 172.21.15.17:0/3978090415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa7c102200 0x7ffa7c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:16.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.754+0000 7ffa81000640 1 -- 172.21.15.17:0/3978090415 >> 172.21.15.17:0/3978090415 conn(0x7ffa7c0fdc60 msgr2=0x7ffa7c0ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:16.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.754+0000 7ffa81000640 1 -- 172.21.15.17:0/3978090415 shutdown_connections 2024-09-13T15:56:16.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:16.754+0000 7ffa81000640 1 -- 172.21.15.17:0/3978090415 wait complete. 2024-09-13T15:56:17.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:17 smithi193 ceph-mon[35248]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:17.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:17 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3978090415' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-13T15:56:17.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:17 smithi017 ceph-mon[30494]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:17.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:17 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3978090415' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-13T15:56:17.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:17 smithi189 ceph-mon[34790]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:17.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:17 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3978090415' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-13T15:56:17.990 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462964 got 201863462967 for osd.6 2024-09-13T15:56:17.991 DEBUG:teuthology.parallel:result is None 2024-09-13T15:56:19.503 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:19 smithi017 ceph-mon[30494]: pgmap v340: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:19.503 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:19 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3253820194' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T15:56:19.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:19 smithi193 ceph-mon[35248]: pgmap v340: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:19.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:19 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3253820194' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T15:56:19.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:19 smithi189 ceph-mon[34790]: pgmap v340: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:19.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:19 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3253820194' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T15:56:19.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.927+0000 7f3a9ea00640 1 -- 172.21.15.17:0/855415498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a980730f0 msgr2=0x7f3a9810c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:19.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.927+0000 7f3a9ea00640 1 --2- 172.21.15.17:0/855415498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a980730f0 0x7f3a9810c100 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009900 tx=0x7f3a8402a480 comp rx=0 tx=0).stop 2024-09-13T15:56:19.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.927+0000 7f3a9ea00640 1 -- 172.21.15.17:0/855415498 shutdown_connections 2024-09-13T15:56:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.927+0000 7f3a9ea00640 1 --2- 172.21.15.17:0/855415498 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a9810c640 0x7f3a9810ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.927+0000 7f3a9ea00640 1 --2- 172.21.15.17:0/855415498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a980730f0 0x7f3a9810c100 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.927+0000 7f3a9ea00640 1 --2- 172.21.15.17:0/855415498 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a980727d0 0x7f3a98072bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.927+0000 7f3a9ea00640 1 -- 172.21.15.17:0/855415498 >> 172.21.15.17:0/855415498 conn(0x7f3a980fbae0 msgr2=0x7f3a980fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.927+0000 7f3a9ea00640 1 -- 172.21.15.17:0/855415498 shutdown_connections 2024-09-13T15:56:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.927+0000 7f3a9ea00640 1 -- 172.21.15.17:0/855415498 wait complete. 2024-09-13T15:56:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.928+0000 7f3a9ea00640 1 Processor -- start 2024-09-13T15:56:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.928+0000 7f3a9ea00640 1 -- start start 2024-09-13T15:56:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.929+0000 7f3a9ea00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a980727d0 0x7f3a98198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.929+0000 7f3a9ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a980730f0 0x7f3a98198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.929+0000 7f3a9ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a9810c640 0x7f3a9819cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.929+0000 7f3a9ea00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9819d4a0 con 0x7f3a980730f0 2024-09-13T15:56:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.929+0000 7f3a9ea00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9819d610 con 0x7f3a9810c640 2024-09-13T15:56:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.929+0000 7f3a9ea00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9819d780 con 0x7f3a980727d0 2024-09-13T15:56:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.929+0000 7f3a97400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a980730f0 0x7f3a98198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.929+0000 7f3a97e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a980727d0 0x7f3a98198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.929+0000 7f3a97e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a980727d0 0x7f3a98198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:37268/0 (socket says 172.21.15.17:37268) 2024-09-13T15:56:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.929+0000 7f3a97e00640 1 -- 172.21.15.17:0/903793373 learned_addr learned my addr 172.21.15.17:0/903793373 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.929+0000 7f3a9ca00640 1 --2- 172.21.15.17:0/903793373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a9810c640 0x7f3a9819cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.929+0000 7f3a97400640 1 -- 172.21.15.17:0/903793373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a980727d0 msgr2=0x7f3a98198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.929+0000 7f3a97400640 1 --2- 172.21.15.17:0/903793373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a980727d0 0x7f3a98198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.929+0000 7f3a97400640 1 -- 172.21.15.17:0/903793373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a9810c640 msgr2=0x7f3a9819cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.929+0000 7f3a97400640 1 --2- 172.21.15.17:0/903793373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a9810c640 0x7f3a9819cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.929+0000 7f3a97400640 1 -- 172.21.15.17:0/903793373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a84009560 con 0x7f3a980730f0 2024-09-13T15:56:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.930+0000 7f3a97e00640 1 --2- 172.21.15.17:0/903793373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a980727d0 0x7f3a98198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.930+0000 7f3a97400640 1 --2- 172.21.15.17:0/903793373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a980730f0 0x7f3a98198aa0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3a8402aa70 tx=0x7f3a84003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.930+0000 7f3a94c00640 1 -- 172.21.15.17:0/903793373 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84003e00 con 0x7f3a980730f0 2024-09-13T15:56:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.930+0000 7f3a94c00640 1 -- 172.21.15.17:0/903793373 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a84031b70 con 0x7f3a980730f0 2024-09-13T15:56:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.930+0000 7f3a9ea00640 1 -- 172.21.15.17:0/903793373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a9819da00 con 0x7f3a980730f0 2024-09-13T15:56:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.930+0000 7f3a94c00640 1 -- 172.21.15.17:0/903793373 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8403bb20 con 0x7f3a980730f0 2024-09-13T15:56:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.930+0000 7f3a9ea00640 1 -- 172.21.15.17:0/903793373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a9819dcf0 con 0x7f3a980730f0 2024-09-13T15:56:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.931+0000 7f3a8e000640 1 -- 172.21.15.17:0/903793373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a98073f10 con 0x7f3a980730f0 2024-09-13T15:56:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.933+0000 7f3a94c00640 1 -- 172.21.15.17:0/903793373 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f3a8403bca0 con 0x7f3a980730f0 2024-09-13T15:56:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.934+0000 7f3a94c00640 1 --2- 172.21.15.17:0/903793373 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3a7c0a1190 0x7f3a7c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.935+0000 7f3a94c00640 1 -- 172.21.15.17:0/903793373 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f3a840ed480 con 0x7f3a980730f0 2024-09-13T15:56:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.935+0000 7f3a97e00640 1 --2- 172.21.15.17:0/903793373 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3a7c0a1190 0x7f3a7c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.936+0000 7f3a97e00640 1 --2- 172.21.15.17:0/903793373 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3a7c0a1190 0x7f3a7c0a3650 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3a88011550 tx=0x7f3a88005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:19.939+0000 7f3a94c00640 1 -- 172.21.15.17:0/903793373 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3a840b67f0 con 0x7f3a980730f0 2024-09-13T15:56:20.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.640+0000 7fb44f200640 1 -- 172.21.15.17:0/2738306117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb448100990 msgr2=0x7fb4481049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:20.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.640+0000 7fb44f200640 1 --2- 172.21.15.17:0/2738306117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb448100990 0x7fb4481049e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb430009930 tx=0x7fb43002a420 comp rx=0 tx=0).stop 2024-09-13T15:56:20.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.640+0000 7fb44f200640 1 -- 172.21.15.17:0/2738306117 shutdown_connections 2024-09-13T15:56:20.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.640+0000 7fb44f200640 1 --2- 172.21.15.17:0/2738306117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb448105110 0x7fb44810cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:20.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.640+0000 7fb44f200640 1 --2- 172.21.15.17:0/2738306117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb448100990 0x7fb4481049e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:20.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.640+0000 7fb44f200640 1 --2- 172.21.15.17:0/2738306117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4480fffe0 0x7fb4481003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:20.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.640+0000 7fb44f200640 1 -- 172.21.15.17:0/2738306117 >> 172.21.15.17:0/2738306117 conn(0x7fb4480fba80 msgr2=0x7fb4480fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:20.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.640+0000 7fb44f200640 1 -- 172.21.15.17:0/2738306117 shutdown_connections 2024-09-13T15:56:20.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.641+0000 7fb44f200640 1 -- 172.21.15.17:0/2738306117 wait complete. 2024-09-13T15:56:20.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.642+0000 7fb44f200640 1 Processor -- start 2024-09-13T15:56:20.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.642+0000 7fb44f200640 1 -- start start 2024-09-13T15:56:20.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.642+0000 7fb44f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb4480fffe0 0x7fb4481962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:20.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.642+0000 7fb44f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb448100990 0x7fb448196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:20.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.642+0000 7fb44f200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb448105110 0x7fb44819ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:20.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.642+0000 7fb44f200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44819b210 con 0x7fb448100990 2024-09-13T15:56:20.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.642+0000 7fb44f200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44819b380 con 0x7fb4480fffe0 2024-09-13T15:56:20.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.642+0000 7fb44f200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44819b4f0 con 0x7fb448105110 2024-09-13T15:56:20.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.642+0000 7fb43fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb448100990 0x7fb448196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:20.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.642+0000 7fb447e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb4480fffe0 0x7fb4481962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:20.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.642+0000 7fb43fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb448100990 0x7fb448196810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33988/0 (socket says 172.21.15.17:33988) 2024-09-13T15:56:20.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.642+0000 7fb43fe00640 1 -- 172.21.15.17:0/3253820194 learned_addr learned my addr 172.21.15.17:0/3253820194 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.643+0000 7fb44d200640 1 --2- 172.21.15.17:0/3253820194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb448105110 0x7fb44819ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.643+0000 7fb447e00640 1 -- 172.21.15.17:0/3253820194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb448105110 msgr2=0x7fb44819ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.643+0000 7fb447e00640 1 --2- 172.21.15.17:0/3253820194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb448105110 0x7fb44819ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.643+0000 7fb447e00640 1 -- 172.21.15.17:0/3253820194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb448100990 msgr2=0x7fb448196810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.643+0000 7fb447e00640 1 --2- 172.21.15.17:0/3253820194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb448100990 0x7fb448196810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.643+0000 7fb447e00640 1 -- 172.21.15.17:0/3253820194 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb440009840 con 0x7fb4480fffe0 2024-09-13T15:56:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.643+0000 7fb43fe00640 1 --2- 172.21.15.17:0/3253820194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb448100990 0x7fb448196810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.643+0000 7fb447e00640 1 --2- 172.21.15.17:0/3253820194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb4480fffe0 0x7fb4481962d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb43800e9f0 tx=0x7fb43800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.643+0000 7fb445600640 1 -- 172.21.15.17:0/3253820194 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438009640 con 0x7fb4480fffe0 2024-09-13T15:56:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.643+0000 7fb445600640 1 -- 172.21.15.17:0/3253820194 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb43800ccc0 con 0x7fb4480fffe0 2024-09-13T15:56:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.643+0000 7fb44f200640 1 -- 172.21.15.17:0/3253820194 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb430009560 con 0x7fb4480fffe0 2024-09-13T15:56:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.644+0000 7fb445600640 1 -- 172.21.15.17:0/3253820194 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438018640 con 0x7fb4480fffe0 2024-09-13T15:56:20.070 INFO:teuthology.orchestra.run.smithi017.stdout:146028888129 2024-09-13T15:56:20.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.644+0000 7fb44f200640 1 -- 172.21.15.17:0/3253820194 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4481a2ec0 con 0x7fb4480fffe0 2024-09-13T15:56:20.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.645+0000 7fb44f200640 1 -- 172.21.15.17:0/3253820194 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4481014c0 con 0x7fb4480fffe0 2024-09-13T15:56:20.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.647+0000 7fb445600640 1 -- 172.21.15.17:0/3253820194 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb438005030 con 0x7fb4480fffe0 2024-09-13T15:56:20.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.648+0000 7fb445600640 1 --2- 172.21.15.17:0/3253820194 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb42c0a1190 0x7fb42c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:20.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.648+0000 7fb445600640 1 -- 172.21.15.17:0/3253820194 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb438014070 con 0x7fb4480fffe0 2024-09-13T15:56:20.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.648+0000 7fb43fe00640 1 --2- 172.21.15.17:0/3253820194 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb42c0a1190 0x7fb42c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:20.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.649+0000 7fb43fe00640 1 --2- 172.21.15.17:0/3253820194 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb42c0a1190 0x7fb42c0a3650 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb430005ec0 tx=0x7fb4300058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:20.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.650+0000 7fb445600640 1 -- 172.21.15.17:0/3253820194 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb4380962d0 con 0x7fb4480fffe0 2024-09-13T15:56:20.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.836+0000 7fb44f200640 1 -- 172.21.15.17:0/3253820194 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb4481003c0 con 0x7fb4480fffe0 2024-09-13T15:56:20.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.837+0000 7fb445600640 1 -- 172.21.15.17:0/3253820194 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb4380998f0 con 0x7fb4480fffe0 2024-09-13T15:56:20.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.839+0000 7fb44f200640 1 -- 172.21.15.17:0/3253820194 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb42c0a1190 msgr2=0x7fb42c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:20.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.839+0000 7fb44f200640 1 --2- 172.21.15.17:0/3253820194 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb42c0a1190 0x7fb42c0a3650 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb430005ec0 tx=0x7fb4300058d0 comp rx=0 tx=0).stop 2024-09-13T15:56:20.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.839+0000 7fb44f200640 1 -- 172.21.15.17:0/3253820194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb4480fffe0 msgr2=0x7fb4481962d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:20.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.839+0000 7fb44f200640 1 --2- 172.21.15.17:0/3253820194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb4480fffe0 0x7fb4481962d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb43800e9f0 tx=0x7fb43800edf0 comp rx=0 tx=0).stop 2024-09-13T15:56:20.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.839+0000 7fb44f200640 1 -- 172.21.15.17:0/3253820194 shutdown_connections 2024-09-13T15:56:20.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.839+0000 7fb44f200640 1 --2- 172.21.15.17:0/3253820194 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb42c0a1190 0x7fb42c0a3650 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:20.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.839+0000 7fb44f200640 1 --2- 172.21.15.17:0/3253820194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb448105110 0x7fb44819ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:20.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.839+0000 7fb44f200640 1 --2- 172.21.15.17:0/3253820194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb448100990 0x7fb448196810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:20.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.839+0000 7fb44f200640 1 --2- 172.21.15.17:0/3253820194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb4480fffe0 0x7fb4481962d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:20.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.839+0000 7fb44f200640 1 -- 172.21.15.17:0/3253820194 >> 172.21.15.17:0/3253820194 conn(0x7fb4480fba80 msgr2=0x7fb4480fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:20.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.839+0000 7fb44f200640 1 -- 172.21.15.17:0/3253820194 shutdown_connections 2024-09-13T15:56:20.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:18.839+0000 7fb44f200640 1 -- 172.21.15.17:0/3253820194 wait complete. 2024-09-13T15:56:20.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:20.127+0000 7f3a8e000640 1 -- 172.21.15.17:0/903793373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3a98072bb0 con 0x7f3a980730f0 2024-09-13T15:56:20.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:20.127+0000 7f3a94c00640 1 -- 172.21.15.17:0/903793373 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a840b9e10 con 0x7f3a980730f0 2024-09-13T15:56:20.129 INFO:teuthology.orchestra.run.smithi017.stdout:167503724604 2024-09-13T15:56:20.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:20.130+0000 7f3a8e000640 1 -- 172.21.15.17:0/903793373 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3a7c0a1190 msgr2=0x7f3a7c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:20.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:20.130+0000 7f3a8e000640 1 --2- 172.21.15.17:0/903793373 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3a7c0a1190 0x7f3a7c0a3650 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3a88011550 tx=0x7f3a88005f90 comp rx=0 tx=0).stop 2024-09-13T15:56:20.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:20.130+0000 7f3a8e000640 1 -- 172.21.15.17:0/903793373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a980730f0 msgr2=0x7f3a98198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:20.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:20.130+0000 7f3a8e000640 1 --2- 172.21.15.17:0/903793373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a980730f0 0x7f3a98198aa0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3a8402aa70 tx=0x7f3a84003c10 comp rx=0 tx=0).stop 2024-09-13T15:56:20.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:20.130+0000 7f3a8e000640 1 -- 172.21.15.17:0/903793373 shutdown_connections 2024-09-13T15:56:20.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:20.130+0000 7f3a8e000640 1 --2- 172.21.15.17:0/903793373 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3a7c0a1190 0x7f3a7c0a3650 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:20.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:20.130+0000 7f3a8e000640 1 --2- 172.21.15.17:0/903793373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a9810c640 0x7f3a9819cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:20.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:20.130+0000 7f3a8e000640 1 --2- 172.21.15.17:0/903793373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a980730f0 0x7f3a98198aa0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:20.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:20.130+0000 7f3a8e000640 1 --2- 172.21.15.17:0/903793373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a980727d0 0x7f3a98198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:20.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:20.130+0000 7f3a8e000640 1 -- 172.21.15.17:0/903793373 >> 172.21.15.17:0/903793373 conn(0x7f3a980fbae0 msgr2=0x7f3a980fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:20.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:20.130+0000 7f3a8e000640 1 -- 172.21.15.17:0/903793373 shutdown_connections 2024-09-13T15:56:20.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:20.130+0000 7f3a8e000640 1 -- 172.21.15.17:0/903793373 wait complete. 2024-09-13T15:56:20.406 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:20 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/903793373' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T15:56:20.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:20 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/903793373' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T15:56:20.611 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:20 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/903793373' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T15:56:21.207 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888124 got 146028888129 for osd.4 2024-09-13T15:56:21.208 DEBUG:teuthology.parallel:result is None 2024-09-13T15:56:21.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:21 smithi193 ceph-mon[35248]: pgmap v341: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:56:21.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:21 smithi017 ceph-mon[30494]: pgmap v341: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:56:21.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:21 smithi189 ceph-mon[34790]: pgmap v341: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:56:22.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:22 smithi017 ceph-mon[30494]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:22.486 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724598 got 167503724604 for osd.5 2024-09-13T15:56:22.486 DEBUG:teuthology.parallel:result is None 2024-09-13T15:56:22.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:22 smithi193 ceph-mon[35248]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:22.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:22 smithi189 ceph-mon[34790]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:23.002 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:56:23.511 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037800 got 257698037805 for osd.8 2024-09-13T15:56:23.511 DEBUG:teuthology.parallel:result is None 2024-09-13T15:56:25.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.084+0000 7f515e600640 1 -- 172.21.15.17:0/3427408022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5158107330 msgr2=0x7f515810eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:25.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.084+0000 7f515e600640 1 --2- 172.21.15.17:0/3427408022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5158107330 0x7f515810eeb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5150009c10 tx=0x7f515002a6e0 comp rx=0 tx=0).stop 2024-09-13T15:56:25.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.085+0000 7f515e600640 1 -- 172.21.15.17:0/3427408022 shutdown_connections 2024-09-13T15:56:25.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.085+0000 7f515e600640 1 --2- 172.21.15.17:0/3427408022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5158107330 0x7f515810eeb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:25.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.085+0000 7f515e600640 1 --2- 172.21.15.17:0/3427408022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5158102bb0 0x7f5158106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:25.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.085+0000 7f515e600640 1 --2- 172.21.15.17:0/3427408022 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5158102200 0x7f51581025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:25.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.085+0000 7f515e600640 1 -- 172.21.15.17:0/3427408022 >> 172.21.15.17:0/3427408022 conn(0x7f51580fdc60 msgr2=0x7f5158100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:25.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.085+0000 7f515e600640 1 -- 172.21.15.17:0/3427408022 shutdown_connections 2024-09-13T15:56:25.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.085+0000 7f515e600640 1 -- 172.21.15.17:0/3427408022 wait complete. 2024-09-13T15:56:25.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.086+0000 7f515e600640 1 Processor -- start 2024-09-13T15:56:25.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.086+0000 7f515e600640 1 -- start start 2024-09-13T15:56:25.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.087+0000 7f515e600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5158102200 0x7f5158198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:25.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.087+0000 7f515e600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5158102bb0 0x7f5158198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:25.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.087+0000 7f515e600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5158107330 0x7f515819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:25.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.087+0000 7f515e600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515819d4c0 con 0x7f5158107330 2024-09-13T15:56:25.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.087+0000 7f515e600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515819d630 con 0x7f5158102bb0 2024-09-13T15:56:25.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.087+0000 7f515e600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515819d7a0 con 0x7f5158102200 2024-09-13T15:56:25.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.087+0000 7f5157400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5158102200 0x7f5158198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:25.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.087+0000 7f5156a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5158102bb0 0x7f5158198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:25.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.087+0000 7f5157400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5158102200 0x7f5158198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:37286/0 (socket says 172.21.15.17:37286) 2024-09-13T15:56:25.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.087+0000 7f5157400640 1 -- 172.21.15.17:0/3629006140 learned_addr learned my addr 172.21.15.17:0/3629006140 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:25.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.087+0000 7f5157e00640 1 --2- 172.21.15.17:0/3629006140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5158107330 0x7f515819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:25.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.088+0000 7f5157400640 1 -- 172.21.15.17:0/3629006140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5158102bb0 msgr2=0x7f5158198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:25.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.088+0000 7f5157400640 1 --2- 172.21.15.17:0/3629006140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5158102bb0 0x7f5158198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:25.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.088+0000 7f5157400640 1 -- 172.21.15.17:0/3629006140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5158107330 msgr2=0x7f515819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:25.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.088+0000 7f5157400640 1 --2- 172.21.15.17:0/3629006140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5158107330 0x7f515819cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:25.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.088+0000 7f5157400640 1 -- 172.21.15.17:0/3629006140 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5150009840 con 0x7f5158102200 2024-09-13T15:56:25.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.088+0000 7f5157400640 1 --2- 172.21.15.17:0/3629006140 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5158102200 0x7f5158198580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f514800e9f0 tx=0x7f514800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:25.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.088+0000 7f514fe00640 1 -- 172.21.15.17:0/3629006140 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5148009700 con 0x7f5158102200 2024-09-13T15:56:25.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.088+0000 7f515e600640 1 -- 172.21.15.17:0/3629006140 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515819da80 con 0x7f5158102200 2024-09-13T15:56:25.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.088+0000 7f514fe00640 1 -- 172.21.15.17:0/3629006140 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f514800ccc0 con 0x7f5158102200 2024-09-13T15:56:25.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.088+0000 7f514fe00640 1 -- 172.21.15.17:0/3629006140 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5148018790 con 0x7f5158102200 2024-09-13T15:56:25.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.088+0000 7f515e600640 1 -- 172.21.15.17:0/3629006140 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51581a5340 con 0x7f5158102200 2024-09-13T15:56:25.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.089+0000 7f515e600640 1 -- 172.21.15.17:0/3629006140 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51581036e0 con 0x7f5158102200 2024-09-13T15:56:25.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.092+0000 7f514fe00640 1 -- 172.21.15.17:0/3629006140 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f51480188f0 con 0x7f5158102200 2024-09-13T15:56:25.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.093+0000 7f514fe00640 1 --2- 172.21.15.17:0/3629006140 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f513c0a1110 0x7f513c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:25.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.093+0000 7f514fe00640 1 -- 172.21.15.17:0/3629006140 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f5148014070 con 0x7f5158102200 2024-09-13T15:56:25.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.093+0000 7f5156a00640 1 --2- 172.21.15.17:0/3629006140 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f513c0a1110 0x7f513c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:25.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.094+0000 7f5156a00640 1 --2- 172.21.15.17:0/3629006140 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f513c0a1110 0x7f513c0a35d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5158199b30 tx=0x7f5144009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:25.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.095+0000 7f514fe00640 1 -- 172.21.15.17:0/3629006140 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f51480964d0 con 0x7f5158102200 2024-09-13T15:56:25.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.279+0000 7f515e600640 1 -- 172.21.15.17:0/3629006140 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f51581025e0 con 0x7f5158102200 2024-09-13T15:56:25.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.279+0000 7f514fe00640 1 -- 172.21.15.17:0/3629006140 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5148099af0 con 0x7f5158102200 2024-09-13T15:56:25.281 INFO:teuthology.orchestra.run.smithi017.stdout:55834574930 2024-09-13T15:56:25.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.281+0000 7f515e600640 1 -- 172.21.15.17:0/3629006140 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f513c0a1110 msgr2=0x7f513c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:25.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.281+0000 7f515e600640 1 --2- 172.21.15.17:0/3629006140 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f513c0a1110 0x7f513c0a35d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5158199b30 tx=0x7f5144009260 comp rx=0 tx=0).stop 2024-09-13T15:56:25.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.281+0000 7f515e600640 1 -- 172.21.15.17:0/3629006140 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5158102200 msgr2=0x7f5158198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:25.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.281+0000 7f515e600640 1 --2- 172.21.15.17:0/3629006140 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5158102200 0x7f5158198580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f514800e9f0 tx=0x7f514800edf0 comp rx=0 tx=0).stop 2024-09-13T15:56:25.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.282+0000 7f515e600640 1 -- 172.21.15.17:0/3629006140 shutdown_connections 2024-09-13T15:56:25.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.282+0000 7f515e600640 1 --2- 172.21.15.17:0/3629006140 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f513c0a1110 0x7f513c0a35d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:25.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.282+0000 7f515e600640 1 --2- 172.21.15.17:0/3629006140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5158107330 0x7f515819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:25.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.282+0000 7f515e600640 1 --2- 172.21.15.17:0/3629006140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5158102bb0 0x7f5158198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:25.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.282+0000 7f515e600640 1 --2- 172.21.15.17:0/3629006140 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5158102200 0x7f5158198580 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:25.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.282+0000 7f515e600640 1 -- 172.21.15.17:0/3629006140 >> 172.21.15.17:0/3629006140 conn(0x7f51580fdc60 msgr2=0x7f51580ff0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:25.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.282+0000 7f515e600640 1 -- 172.21.15.17:0/3629006140 shutdown_connections 2024-09-13T15:56:25.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.282+0000 7f515e600640 1 -- 172.21.15.17:0/3629006140 wait complete. 2024-09-13T15:56:25.426 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:25 smithi017 ceph-mon[30494]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:25.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:25 smithi193 ceph-mon[35248]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:25.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:25 smithi189 ceph-mon[34790]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.424+0000 7fc511600640 1 -- 172.21.15.17:0/3367122791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc50c072880 msgr2=0x7fc50c072c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.424+0000 7fc511600640 1 --2- 172.21.15.17:0/3367122791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc50c072880 0x7fc50c072c60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc009900 tx=0x7fc4fc02a480 comp rx=0 tx=0).stop 2024-09-13T15:56:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.424+0000 7fc511600640 1 -- 172.21.15.17:0/3367122791 shutdown_connections 2024-09-13T15:56:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.424+0000 7fc511600640 1 --2- 172.21.15.17:0/3367122791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc50c10c630 0x7fc50c10ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.424+0000 7fc511600640 1 --2- 172.21.15.17:0/3367122791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc50c0731a0 0x7fc50c10c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.424+0000 7fc511600640 1 --2- 172.21.15.17:0/3367122791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc50c072880 0x7fc50c072c60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.424+0000 7fc511600640 1 -- 172.21.15.17:0/3367122791 >> 172.21.15.17:0/3367122791 conn(0x7fc50c0fba90 msgr2=0x7fc50c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.424+0000 7fc511600640 1 -- 172.21.15.17:0/3367122791 shutdown_connections 2024-09-13T15:56:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.425+0000 7fc511600640 1 -- 172.21.15.17:0/3367122791 wait complete. 2024-09-13T15:56:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.425+0000 7fc511600640 1 Processor -- start 2024-09-13T15:56:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.426+0000 7fc511600640 1 -- start start 2024-09-13T15:56:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.426+0000 7fc511600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc50c072880 0x7fc50c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.426+0000 7fc511600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc50c0731a0 0x7fc50c198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.426+0000 7fc511600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc50c10c630 0x7fc50c19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.426+0000 7fc511600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c19d3e0 con 0x7fc50c072880 2024-09-13T15:56:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.426+0000 7fc511600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c19d550 con 0x7fc50c0731a0 2024-09-13T15:56:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.426+0000 7fc511600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c19d6c0 con 0x7fc50c10c630 2024-09-13T15:56:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.426+0000 7fc50aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc50c072880 0x7fc50c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.426+0000 7fc50a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc50c0731a0 0x7fc50c198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.426+0000 7fc50a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc50c0731a0 0x7fc50c198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:52890/0 (socket says 172.21.15.17:52890) 2024-09-13T15:56:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.426+0000 7fc50a000640 1 -- 172.21.15.17:0/1830909951 learned_addr learned my addr 172.21.15.17:0/1830909951 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.426+0000 7fc50b400640 1 --2- 172.21.15.17:0/1830909951 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc50c10c630 0x7fc50c19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.427+0000 7fc50a000640 1 -- 172.21.15.17:0/1830909951 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc50c10c630 msgr2=0x7fc50c19cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.427+0000 7fc50a000640 1 --2- 172.21.15.17:0/1830909951 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc50c10c630 0x7fc50c19cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.427+0000 7fc50a000640 1 -- 172.21.15.17:0/1830909951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc50c072880 msgr2=0x7fc50c1984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.427+0000 7fc50a000640 1 --2- 172.21.15.17:0/1830909951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc50c072880 0x7fc50c1984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.427+0000 7fc50a000640 1 -- 172.21.15.17:0/1830909951 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc009560 con 0x7fc50c0731a0 2024-09-13T15:56:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.427+0000 7fc50aa00640 1 --2- 172.21.15.17:0/1830909951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc50c072880 0x7fc50c1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.427+0000 7fc50a000640 1 --2- 172.21.15.17:0/1830909951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc50c0731a0 0x7fc50c198a30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800e9f0 tx=0x7fc4f800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.427+0000 7fc503400640 1 -- 172.21.15.17:0/1830909951 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8009720 con 0x7fc50c0731a0 2024-09-13T15:56:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.428+0000 7fc511600640 1 -- 172.21.15.17:0/1830909951 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc50c19d9a0 con 0x7fc50c0731a0 2024-09-13T15:56:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.428+0000 7fc503400640 1 -- 172.21.15.17:0/1830909951 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4f800cd80 con 0x7fc50c0731a0 2024-09-13T15:56:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.428+0000 7fc503400640 1 -- 172.21.15.17:0/1830909951 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8010430 con 0x7fc50c0731a0 2024-09-13T15:56:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.428+0000 7fc511600640 1 -- 172.21.15.17:0/1830909951 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc50c1a5260 con 0x7fc50c0731a0 2024-09-13T15:56:25.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.429+0000 7fc511600640 1 -- 172.21.15.17:0/1830909951 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc50c073f30 con 0x7fc50c0731a0 2024-09-13T15:56:25.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.431+0000 7fc503400640 1 -- 172.21.15.17:0/1830909951 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fc4f8005020 con 0x7fc50c0731a0 2024-09-13T15:56:25.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.433+0000 7fc503400640 1 --2- 172.21.15.17:0/1830909951 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc4f00a1190 0x7fc4f00a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:25.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.433+0000 7fc503400640 1 -- 172.21.15.17:0/1830909951 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc4f8014070 con 0x7fc50c0731a0 2024-09-13T15:56:25.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.433+0000 7fc50aa00640 1 --2- 172.21.15.17:0/1830909951 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc4f00a1190 0x7fc4f00a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:25.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.434+0000 7fc50aa00640 1 --2- 172.21.15.17:0/1830909951 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc4f00a1190 0x7fc4f00a3650 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc02aa70 tx=0x7fc4fc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:25.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.437+0000 7fc503400640 1 -- 172.21.15.17:0/1830909951 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc4f80963a0 con 0x7fc50c0731a0 2024-09-13T15:56:25.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.620+0000 7fc511600640 1 -- 172.21.15.17:0/1830909951 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc50c072c60 con 0x7fc50c0731a0 2024-09-13T15:56:25.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.621+0000 7fc503400640 1 -- 172.21.15.17:0/1830909951 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc4f80999c0 con 0x7fc50c0731a0 2024-09-13T15:56:25.677 INFO:teuthology.orchestra.run.smithi017.stdout:77309411405 2024-09-13T15:56:25.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.623+0000 7fc511600640 1 -- 172.21.15.17:0/1830909951 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc4f00a1190 msgr2=0x7fc4f00a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:25.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.623+0000 7fc511600640 1 --2- 172.21.15.17:0/1830909951 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc4f00a1190 0x7fc4f00a3650 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc02aa70 tx=0x7fc4fc0058d0 comp rx=0 tx=0).stop 2024-09-13T15:56:25.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.623+0000 7fc511600640 1 -- 172.21.15.17:0/1830909951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc50c0731a0 msgr2=0x7fc50c198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:25.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.623+0000 7fc511600640 1 --2- 172.21.15.17:0/1830909951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc50c0731a0 0x7fc50c198a30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800e9f0 tx=0x7fc4f800edf0 comp rx=0 tx=0).stop 2024-09-13T15:56:25.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.624+0000 7fc511600640 1 -- 172.21.15.17:0/1830909951 shutdown_connections 2024-09-13T15:56:25.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.624+0000 7fc511600640 1 --2- 172.21.15.17:0/1830909951 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc4f00a1190 0x7fc4f00a3650 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:25.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.624+0000 7fc511600640 1 --2- 172.21.15.17:0/1830909951 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc50c10c630 0x7fc50c19cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:25.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.624+0000 7fc511600640 1 --2- 172.21.15.17:0/1830909951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc50c0731a0 0x7fc50c198a30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:25.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.624+0000 7fc511600640 1 --2- 172.21.15.17:0/1830909951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc50c072880 0x7fc50c1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:25.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.624+0000 7fc511600640 1 -- 172.21.15.17:0/1830909951 >> 172.21.15.17:0/1830909951 conn(0x7fc50c0fba90 msgr2=0x7fc50c0fd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:25.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.624+0000 7fc511600640 1 -- 172.21.15.17:0/1830909951 shutdown_connections 2024-09-13T15:56:25.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:25.624+0000 7fc511600640 1 -- 172.21.15.17:0/1830909951 wait complete. 2024-09-13T15:56:26.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:26 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3629006140' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T15:56:26.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:26 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1830909951' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T15:56:26.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:26 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3629006140' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T15:56:26.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:26 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1830909951' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T15:56:26.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:26 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3629006140' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T15:56:26.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:26 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1830909951' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T15:56:26.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.800+0000 7f9e81a00640 1 -- 172.21.15.17:0/1237264344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e7c105120 msgr2=0x7f9e7c10cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:26.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.800+0000 7f9e81a00640 1 --2- 172.21.15.17:0/1237264344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e7c105120 0x7f9e7c10cca0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009cd0 tx=0x7f9e7402a8e0 comp rx=0 tx=0).stop 2024-09-13T15:56:26.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.800+0000 7f9e81a00640 1 -- 172.21.15.17:0/1237264344 shutdown_connections 2024-09-13T15:56:26.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.800+0000 7f9e81a00640 1 --2- 172.21.15.17:0/1237264344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e7c105120 0x7f9e7c10cca0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:26.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.800+0000 7f9e81a00640 1 --2- 172.21.15.17:0/1237264344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e7c1009a0 0x7f9e7c1049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:26.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.800+0000 7f9e81a00640 1 --2- 172.21.15.17:0/1237264344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e7c0ffff0 0x7f9e7c1003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:26.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.800+0000 7f9e81a00640 1 -- 172.21.15.17:0/1237264344 >> 172.21.15.17:0/1237264344 conn(0x7f9e7c0fba90 msgr2=0x7f9e7c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:26.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.800+0000 7f9e81a00640 1 -- 172.21.15.17:0/1237264344 shutdown_connections 2024-09-13T15:56:26.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.800+0000 7f9e81a00640 1 -- 172.21.15.17:0/1237264344 wait complete. 2024-09-13T15:56:26.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.801+0000 7f9e81a00640 1 Processor -- start 2024-09-13T15:56:26.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.802+0000 7f9e81a00640 1 -- start start 2024-09-13T15:56:26.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.802+0000 7f9e81a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e7c0ffff0 0x7f9e7c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:26.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.802+0000 7f9e81a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e7c1009a0 0x7f9e7c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:26.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.802+0000 7f9e81a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e7c105120 0x7f9e7c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:26.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.802+0000 7f9e81a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c19d3a0 con 0x7f9e7c0ffff0 2024-09-13T15:56:26.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.802+0000 7f9e81a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c19d510 con 0x7f9e7c105120 2024-09-13T15:56:26.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.802+0000 7f9e81a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c19d680 con 0x7f9e7c1009a0 2024-09-13T15:56:26.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.802+0000 7f9e7aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e7c0ffff0 0x7f9e7c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:26.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.802+0000 7f9e7aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e7c0ffff0 0x7f9e7c198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49478/0 (socket says 172.21.15.17:49478) 2024-09-13T15:56:26.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.802+0000 7f9e7aa00640 1 -- 172.21.15.17:0/373205679 learned_addr learned my addr 172.21.15.17:0/373205679 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:26.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.802+0000 7f9e7a000640 1 --2- 172.21.15.17:0/373205679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e7c1009a0 0x7f9e7c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:26.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.802+0000 7f9e7b400640 1 --2- 172.21.15.17:0/373205679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e7c105120 0x7f9e7c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:26.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.803+0000 7f9e7aa00640 1 -- 172.21.15.17:0/373205679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e7c1009a0 msgr2=0x7f9e7c1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:26.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.803+0000 7f9e7aa00640 1 --2- 172.21.15.17:0/373205679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e7c1009a0 0x7f9e7c1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:26.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.803+0000 7f9e7aa00640 1 -- 172.21.15.17:0/373205679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e7c105120 msgr2=0x7f9e7c19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:26.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.803+0000 7f9e7aa00640 1 --2- 172.21.15.17:0/373205679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e7c105120 0x7f9e7c19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:26.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.803+0000 7f9e7aa00640 1 -- 172.21.15.17:0/373205679 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e74009900 con 0x7f9e7c0ffff0 2024-09-13T15:56:26.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.803+0000 7f9e7aa00640 1 --2- 172.21.15.17:0/373205679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e7c0ffff0 0x7f9e7c198460 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c00e9f0 tx=0x7f9e6c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:26.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.803+0000 7f9e73400640 1 -- 172.21.15.17:0/373205679 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c009700 con 0x7f9e7c0ffff0 2024-09-13T15:56:26.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.803+0000 7f9e73400640 1 -- 172.21.15.17:0/373205679 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9e6c00cd80 con 0x7f9e7c0ffff0 2024-09-13T15:56:26.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.803+0000 7f9e73400640 1 -- 172.21.15.17:0/373205679 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c018860 con 0x7f9e7c0ffff0 2024-09-13T15:56:26.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.804+0000 7f9e81a00640 1 -- 172.21.15.17:0/373205679 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e7c19d960 con 0x7f9e7c0ffff0 2024-09-13T15:56:26.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.804+0000 7f9e81a00640 1 -- 172.21.15.17:0/373205679 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7c1a5220 con 0x7f9e7c0ffff0 2024-09-13T15:56:26.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.805+0000 7f9e81a00640 1 -- 172.21.15.17:0/373205679 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e7c1014d0 con 0x7f9e7c0ffff0 2024-09-13T15:56:26.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.806+0000 7f9e73400640 1 -- 172.21.15.17:0/373205679 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f9e6c0189c0 con 0x7f9e7c0ffff0 2024-09-13T15:56:26.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.808+0000 7f9e73400640 1 --2- 172.21.15.17:0/373205679 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9e600a1190 0x7f9e600a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:26.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.808+0000 7f9e73400640 1 -- 172.21.15.17:0/373205679 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f9e6c014070 con 0x7f9e7c0ffff0 2024-09-13T15:56:26.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.808+0000 7f9e7a000640 1 --2- 172.21.15.17:0/373205679 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9e600a1190 0x7f9e600a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:26.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.809+0000 7f9e7a000640 1 --2- 172.21.15.17:0/373205679 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9e600a1190 0x7f9e600a3650 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c199a10 tx=0x7f9e6800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:26.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.812+0000 7f9e73400640 1 -- 172.21.15.17:0/373205679 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9e6c052e20 con 0x7f9e7c0ffff0 2024-09-13T15:56:26.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.995+0000 7f9e81a00640 1 -- 172.21.15.17:0/373205679 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9e7c10fdf0 con 0x7f9e7c0ffff0 2024-09-13T15:56:26.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.996+0000 7f9e73400640 1 -- 172.21.15.17:0/373205679 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9e6c096440 con 0x7f9e7c0ffff0 2024-09-13T15:56:26.998 INFO:teuthology.orchestra.run.smithi017.stdout:34359738454 2024-09-13T15:56:27.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.998+0000 7f9e81a00640 1 -- 172.21.15.17:0/373205679 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9e600a1190 msgr2=0x7f9e600a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:27.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.998+0000 7f9e81a00640 1 --2- 172.21.15.17:0/373205679 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9e600a1190 0x7f9e600a3650 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c199a10 tx=0x7f9e6800b390 comp rx=0 tx=0).stop 2024-09-13T15:56:27.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.998+0000 7f9e81a00640 1 -- 172.21.15.17:0/373205679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e7c0ffff0 msgr2=0x7f9e7c198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:27.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.998+0000 7f9e81a00640 1 --2- 172.21.15.17:0/373205679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e7c0ffff0 0x7f9e7c198460 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c00e9f0 tx=0x7f9e6c00eeb0 comp rx=0 tx=0).stop 2024-09-13T15:56:27.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.998+0000 7f9e81a00640 1 -- 172.21.15.17:0/373205679 shutdown_connections 2024-09-13T15:56:27.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.998+0000 7f9e81a00640 1 --2- 172.21.15.17:0/373205679 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9e600a1190 0x7f9e600a3650 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:27.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.998+0000 7f9e81a00640 1 --2- 172.21.15.17:0/373205679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e7c105120 0x7f9e7c19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:27.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.998+0000 7f9e81a00640 1 --2- 172.21.15.17:0/373205679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e7c1009a0 0x7f9e7c1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:27.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.998+0000 7f9e81a00640 1 --2- 172.21.15.17:0/373205679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e7c0ffff0 0x7f9e7c198460 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:27.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.998+0000 7f9e81a00640 1 -- 172.21.15.17:0/373205679 >> 172.21.15.17:0/373205679 conn(0x7f9e7c0fba90 msgr2=0x7f9e7c0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:27.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.998+0000 7f9e81a00640 1 -- 172.21.15.17:0/373205679 shutdown_connections 2024-09-13T15:56:27.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:26.998+0000 7f9e81a00640 1 -- 172.21.15.17:0/373205679 wait complete. 2024-09-13T15:56:27.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:27 smithi193 ceph-mon[35248]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:27.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:27 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/373205679' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T15:56:27.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:27 smithi017 ceph-mon[30494]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:27.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:27 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/373205679' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T15:56:27.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:27 smithi189 ceph-mon[34790]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:27.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:27 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/373205679' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T15:56:27.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.682+0000 7f83b5000640 1 -- 172.21.15.17:0/2760316746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83b0102bb0 msgr2=0x7f83b0106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:27.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.682+0000 7f83b5000640 1 --2- 172.21.15.17:0/2760316746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83b0102bb0 0x7f83b0106c00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f839c009930 tx=0x7f839c02a420 comp rx=0 tx=0).stop 2024-09-13T15:56:27.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.683+0000 7f83b5000640 1 -- 172.21.15.17:0/2760316746 shutdown_connections 2024-09-13T15:56:27.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.683+0000 7f83b5000640 1 --2- 172.21.15.17:0/2760316746 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83b0107330 0x7f83b010eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:27.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.683+0000 7f83b5000640 1 --2- 172.21.15.17:0/2760316746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83b0102bb0 0x7f83b0106c00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:27.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.683+0000 7f83b5000640 1 --2- 172.21.15.17:0/2760316746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83b0102200 0x7f83b01025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:27.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.683+0000 7f83b5000640 1 -- 172.21.15.17:0/2760316746 >> 172.21.15.17:0/2760316746 conn(0x7f83b00fdc60 msgr2=0x7f83b0100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:27.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.683+0000 7f83b5000640 1 -- 172.21.15.17:0/2760316746 shutdown_connections 2024-09-13T15:56:27.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.683+0000 7f83b5000640 1 -- 172.21.15.17:0/2760316746 wait complete. 2024-09-13T15:56:27.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.684+0000 7f83b5000640 1 Processor -- start 2024-09-13T15:56:27.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.684+0000 7f83b5000640 1 -- start start 2024-09-13T15:56:27.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.685+0000 7f83b5000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83b0102200 0x7f83b0198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:27.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.685+0000 7f83b5000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83b0102bb0 0x7f83b0198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:27.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.685+0000 7f83b5000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83b0107330 0x7f83b019ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:27.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.685+0000 7f83b5000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b019d430 con 0x7f83b0102bb0 2024-09-13T15:56:27.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.685+0000 7f83b5000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b019d5a0 con 0x7f83b0102200 2024-09-13T15:56:27.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.685+0000 7f83b5000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b019d710 con 0x7f83b0107330 2024-09-13T15:56:27.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.685+0000 7f83ad400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83b0102bb0 0x7f83b0198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:27.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.685+0000 7f83ade00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83b0102200 0x7f83b0198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:27.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.685+0000 7f83ade00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83b0102200 0x7f83b0198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:52904/0 (socket says 172.21.15.17:52904) 2024-09-13T15:56:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.685+0000 7f83ade00640 1 -- 172.21.15.17:0/3576897038 learned_addr learned my addr 172.21.15.17:0/3576897038 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.685+0000 7f83ae800640 1 --2- 172.21.15.17:0/3576897038 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83b0107330 0x7f83b019ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.685+0000 7f83ade00640 1 -- 172.21.15.17:0/3576897038 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83b0107330 msgr2=0x7f83b019ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.685+0000 7f83ade00640 1 --2- 172.21.15.17:0/3576897038 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83b0107330 0x7f83b019ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.685+0000 7f83ade00640 1 -- 172.21.15.17:0/3576897038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83b0102bb0 msgr2=0x7f83b0198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.685+0000 7f83ade00640 1 --2- 172.21.15.17:0/3576897038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83b0102bb0 0x7f83b0198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.685+0000 7f83ade00640 1 -- 172.21.15.17:0/3576897038 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839c009560 con 0x7f83b0102200 2024-09-13T15:56:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.685+0000 7f83ad400640 1 --2- 172.21.15.17:0/3576897038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83b0102bb0 0x7f83b0198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.686+0000 7f83ade00640 1 --2- 172.21.15.17:0/3576897038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83b0102200 0x7f83b0198540 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f83a000e9f0 tx=0x7f83a000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.686+0000 7f83a6a00640 1 -- 172.21.15.17:0/3576897038 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0009700 con 0x7f83b0102200 2024-09-13T15:56:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.686+0000 7f83b5000640 1 -- 172.21.15.17:0/3576897038 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b019d9f0 con 0x7f83b0102200 2024-09-13T15:56:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.686+0000 7f83a6a00640 1 -- 172.21.15.17:0/3576897038 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f83a000cd80 con 0x7f83b0102200 2024-09-13T15:56:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.686+0000 7f83a6a00640 1 -- 172.21.15.17:0/3576897038 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0018860 con 0x7f83b0102200 2024-09-13T15:56:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.686+0000 7f83b5000640 1 -- 172.21.15.17:0/3576897038 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b01a52b0 con 0x7f83b0102200 2024-09-13T15:56:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.687+0000 7f83b5000640 1 -- 172.21.15.17:0/3576897038 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b01036e0 con 0x7f83b0102200 2024-09-13T15:56:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.689+0000 7f83a6a00640 1 -- 172.21.15.17:0/3576897038 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f83a00189c0 con 0x7f83b0102200 2024-09-13T15:56:27.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.691+0000 7f83a6a00640 1 --2- 172.21.15.17:0/3576897038 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f83940a1110 0x7f83940a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:27.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.691+0000 7f83a6a00640 1 -- 172.21.15.17:0/3576897038 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f83a0014070 con 0x7f83b0102200 2024-09-13T15:56:27.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.691+0000 7f83ad400640 1 --2- 172.21.15.17:0/3576897038 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f83940a1110 0x7f83940a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:27.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.692+0000 7f83ad400640 1 --2- 172.21.15.17:0/3576897038 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f83940a1110 0x7f83940a35d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f839c031440 tx=0x7f839c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:27.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.694+0000 7f83a6a00640 1 -- 172.21.15.17:0/3576897038 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f83a0052e20 con 0x7f83b0102200 2024-09-13T15:56:27.840 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411399 got 77309411405 for osd.2 2024-09-13T15:56:27.840 DEBUG:teuthology.parallel:result is None 2024-09-13T15:56:27.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.887+0000 7f83b5000640 1 -- 172.21.15.17:0/3576897038 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f83b01025e0 con 0x7f83b0102200 2024-09-13T15:56:27.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.887+0000 7f83a6a00640 1 -- 172.21.15.17:0/3576897038 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83a00964d0 con 0x7f83b0102200 2024-09-13T15:56:27.893 INFO:teuthology.orchestra.run.smithi017.stdout:292057776171 2024-09-13T15:56:27.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.890+0000 7f83b5000640 1 -- 172.21.15.17:0/3576897038 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f83940a1110 msgr2=0x7f83940a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:27.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.890+0000 7f83b5000640 1 --2- 172.21.15.17:0/3576897038 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f83940a1110 0x7f83940a35d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f839c031440 tx=0x7f839c005a20 comp rx=0 tx=0).stop 2024-09-13T15:56:27.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.890+0000 7f83b5000640 1 -- 172.21.15.17:0/3576897038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83b0102200 msgr2=0x7f83b0198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:27.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.890+0000 7f83b5000640 1 --2- 172.21.15.17:0/3576897038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83b0102200 0x7f83b0198540 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f83a000e9f0 tx=0x7f83a000eeb0 comp rx=0 tx=0).stop 2024-09-13T15:56:27.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.890+0000 7f83b5000640 1 -- 172.21.15.17:0/3576897038 shutdown_connections 2024-09-13T15:56:27.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.890+0000 7f83b5000640 1 --2- 172.21.15.17:0/3576897038 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f83940a1110 0x7f83940a35d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:27.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.890+0000 7f83b5000640 1 --2- 172.21.15.17:0/3576897038 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83b0107330 0x7f83b019ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:27.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.890+0000 7f83b5000640 1 --2- 172.21.15.17:0/3576897038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83b0102bb0 0x7f83b0198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:27.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.890+0000 7f83b5000640 1 --2- 172.21.15.17:0/3576897038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83b0102200 0x7f83b0198540 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:27.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.890+0000 7f83b5000640 1 -- 172.21.15.17:0/3576897038 >> 172.21.15.17:0/3576897038 conn(0x7f83b00fdc60 msgr2=0x7f83b00ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:27.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.890+0000 7f83b5000640 1 -- 172.21.15.17:0/3576897038 shutdown_connections 2024-09-13T15:56:27.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:27.890+0000 7f83b5000640 1 -- 172.21.15.17:0/3576897038 wait complete. 2024-09-13T15:56:28.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:28 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3576897038' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-13T15:56:28.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:28 smithi193 ceph-mon[35248]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:28.509 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:28 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3576897038' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-13T15:56:28.509 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:28 smithi017 ceph-mon[30494]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:28.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:28 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3576897038' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-13T15:56:28.887 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:28 smithi189 ceph-mon[34790]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:28.951 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738448 got 34359738454 for osd.0 2024-09-13T15:56:28.952 DEBUG:teuthology.parallel:result is None 2024-09-13T15:56:29.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.168+0000 7f848ca00640 1 -- 172.21.15.17:0/2245050935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84880fe0b0 msgr2=0x7f84880fe490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:29.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.168+0000 7f848ca00640 1 --2- 172.21.15.17:0/2245050935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84880fe0b0 0x7f84880fe490 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8478009930 tx=0x7f847802a4d0 comp rx=0 tx=0).stop 2024-09-13T15:56:29.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.168+0000 7f848ca00640 1 -- 172.21.15.17:0/2245050935 shutdown_connections 2024-09-13T15:56:29.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.168+0000 7f848ca00640 1 --2- 172.21.15.17:0/2245050935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8488108580 0x7f848810ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:29.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.168+0000 7f848ca00640 1 --2- 172.21.15.17:0/2245050935 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84880fe9d0 0x7f8488107ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:29.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.168+0000 7f848ca00640 1 --2- 172.21.15.17:0/2245050935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84880fe0b0 0x7f84880fe490 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:29.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.168+0000 7f848ca00640 1 -- 172.21.15.17:0/2245050935 >> 172.21.15.17:0/2245050935 conn(0x7f84880f9ce0 msgr2=0x7f84880fc100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:29.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.169+0000 7f848ca00640 1 -- 172.21.15.17:0/2245050935 shutdown_connections 2024-09-13T15:56:29.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.169+0000 7f848ca00640 1 -- 172.21.15.17:0/2245050935 wait complete. 2024-09-13T15:56:29.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.169+0000 7f848ca00640 1 Processor -- start 2024-09-13T15:56:29.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.170+0000 7f848ca00640 1 -- start start 2024-09-13T15:56:29.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.170+0000 7f848ca00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84880fe0b0 0x7f84881984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:29.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.170+0000 7f848ca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84880fe9d0 0x7f8488198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:29.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.170+0000 7f848ca00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8488108580 0x7f848819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:29.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.170+0000 7f848ca00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848819d400 con 0x7f84880fe9d0 2024-09-13T15:56:29.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.170+0000 7f848ca00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848819d570 con 0x7f84880fe0b0 2024-09-13T15:56:29.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.170+0000 7f848ca00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848819d6e0 con 0x7f8488108580 2024-09-13T15:56:29.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.170+0000 7f8485400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84880fe9d0 0x7f8488198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:29.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.170+0000 7f8485e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84880fe0b0 0x7f84881984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:29.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.170+0000 7f8485400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84880fe9d0 0x7f8488198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54314/0 (socket says 172.21.15.17:54314) 2024-09-13T15:56:29.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.170+0000 7f8485e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84880fe0b0 0x7f84881984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:51388/0 (socket says 172.21.15.17:51388) 2024-09-13T15:56:29.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.170+0000 7f8485400640 1 -- 172.21.15.17:0/1660599831 learned_addr learned my addr 172.21.15.17:0/1660599831 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:29.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.170+0000 7f8486800640 1 --2- 172.21.15.17:0/1660599831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8488108580 0x7f848819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:29.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.171+0000 7f8485400640 1 -- 172.21.15.17:0/1660599831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8488108580 msgr2=0x7f848819ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:29.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.171+0000 7f8485400640 1 --2- 172.21.15.17:0/1660599831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8488108580 0x7f848819ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:29.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.171+0000 7f8485400640 1 -- 172.21.15.17:0/1660599831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84880fe0b0 msgr2=0x7f84881984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:29.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.171+0000 7f8485400640 1 --2- 172.21.15.17:0/1660599831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84880fe0b0 0x7f84881984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:29.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.171+0000 7f8485400640 1 -- 172.21.15.17:0/1660599831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8478009560 con 0x7f84880fe9d0 2024-09-13T15:56:29.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.171+0000 7f8485e00640 1 --2- 172.21.15.17:0/1660599831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84880fe0b0 0x7f84881984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:29.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.171+0000 7f8485400640 1 --2- 172.21.15.17:0/1660599831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84880fe9d0 0x7f8488198a00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f847400e9f0 tx=0x7f847400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:29.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.171+0000 7f847ea00640 1 -- 172.21.15.17:0/1660599831 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84740096c0 con 0x7f84880fe9d0 2024-09-13T15:56:29.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.172+0000 7f848ca00640 1 -- 172.21.15.17:0/1660599831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848819d9c0 con 0x7f84880fe9d0 2024-09-13T15:56:29.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.172+0000 7f847ea00640 1 -- 172.21.15.17:0/1660599831 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84740054e0 con 0x7f84880fe9d0 2024-09-13T15:56:29.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.172+0000 7f847ea00640 1 -- 172.21.15.17:0/1660599831 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8474010430 con 0x7f84880fe9d0 2024-09-13T15:56:29.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.172+0000 7f848ca00640 1 -- 172.21.15.17:0/1660599831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84881a5280 con 0x7f84880fe9d0 2024-09-13T15:56:29.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.173+0000 7f848ca00640 1 -- 172.21.15.17:0/1660599831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84880ff2c0 con 0x7f84880fe9d0 2024-09-13T15:56:29.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.175+0000 7f847ea00640 1 -- 172.21.15.17:0/1660599831 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f8474005020 con 0x7f84880fe9d0 2024-09-13T15:56:29.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.176+0000 7f847ea00640 1 --2- 172.21.15.17:0/1660599831 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f846c0a1190 0x7f846c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:29.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.176+0000 7f847ea00640 1 -- 172.21.15.17:0/1660599831 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f8474014070 con 0x7f84880fe9d0 2024-09-13T15:56:29.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.176+0000 7f8485e00640 1 --2- 172.21.15.17:0/1660599831 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f846c0a1190 0x7f846c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:29.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.177+0000 7f8485e00640 1 --2- 172.21.15.17:0/1660599831 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f846c0a1190 0x7f846c0a3650 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8478031440 tx=0x7f8478005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:29.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.180+0000 7f847ea00640 1 -- 172.21.15.17:0/1660599831 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8474096390 con 0x7f84880fe9d0 2024-09-13T15:56:29.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.365+0000 7f848ca00640 1 -- 172.21.15.17:0/1660599831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f84880fe490 con 0x7f84880fe9d0 2024-09-13T15:56:29.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.366+0000 7f847ea00640 1 -- 172.21.15.17:0/1660599831 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f84740999b0 con 0x7f84880fe9d0 2024-09-13T15:56:29.367 INFO:teuthology.orchestra.run.smithi017.stdout:223338299444 2024-09-13T15:56:29.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.368+0000 7f848ca00640 1 -- 172.21.15.17:0/1660599831 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f846c0a1190 msgr2=0x7f846c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:29.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.368+0000 7f848ca00640 1 --2- 172.21.15.17:0/1660599831 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f846c0a1190 0x7f846c0a3650 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8478031440 tx=0x7f8478005a20 comp rx=0 tx=0).stop 2024-09-13T15:56:29.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.368+0000 7f848ca00640 1 -- 172.21.15.17:0/1660599831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84880fe9d0 msgr2=0x7f8488198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:29.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.368+0000 7f848ca00640 1 --2- 172.21.15.17:0/1660599831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84880fe9d0 0x7f8488198a00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f847400e9f0 tx=0x7f847400eeb0 comp rx=0 tx=0).stop 2024-09-13T15:56:29.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.368+0000 7f848ca00640 1 -- 172.21.15.17:0/1660599831 shutdown_connections 2024-09-13T15:56:29.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.368+0000 7f848ca00640 1 --2- 172.21.15.17:0/1660599831 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f846c0a1190 0x7f846c0a3650 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:29.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.368+0000 7f848ca00640 1 --2- 172.21.15.17:0/1660599831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8488108580 0x7f848819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:29.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.368+0000 7f848ca00640 1 --2- 172.21.15.17:0/1660599831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84880fe9d0 0x7f8488198a00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:29.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.368+0000 7f848ca00640 1 --2- 172.21.15.17:0/1660599831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84880fe0b0 0x7f84881984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:29.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.368+0000 7f848ca00640 1 -- 172.21.15.17:0/1660599831 >> 172.21.15.17:0/1660599831 conn(0x7f84880f9ce0 msgr2=0x7f8488106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:29.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.368+0000 7f848ca00640 1 -- 172.21.15.17:0/1660599831 shutdown_connections 2024-09-13T15:56:29.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:29.368+0000 7f848ca00640 1 -- 172.21.15.17:0/1660599831 wait complete. 2024-09-13T15:56:29.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:29 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1660599831' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-13T15:56:29.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:29 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1660599831' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-13T15:56:29.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:29 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1660599831' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-13T15:56:30.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:30 smithi193 ceph-mon[35248]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:56:30.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:30 smithi017 ceph-mon[30494]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:56:30.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:30 smithi189 ceph-mon[34790]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:56:30.867 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776166 got 292057776171 for osd.9 2024-09-13T15:56:30.868 DEBUG:teuthology.parallel:result is None 2024-09-13T15:56:31.701 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574924 got 55834574930 for osd.1 2024-09-13T15:56:31.702 DEBUG:teuthology.parallel:result is None 2024-09-13T15:56:32.149 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299439 got 223338299444 for osd.7 2024-09-13T15:56:32.149 DEBUG:teuthology.parallel:result is None 2024-09-13T15:56:32.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.899+0000 7ff2c6000640 1 -- 172.21.15.17:0/3670033602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2c010c650 msgr2=0x7ff2c010ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:32.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.899+0000 7ff2c6000640 1 --2- 172.21.15.17:0/3670033602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2c010c650 0x7ff2c010ea40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009ca0 tx=0x7ff2b802a950 comp rx=0 tx=0).stop 2024-09-13T15:56:32.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.900+0000 7ff2c6000640 1 -- 172.21.15.17:0/3670033602 shutdown_connections 2024-09-13T15:56:32.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.900+0000 7ff2c6000640 1 --2- 172.21.15.17:0/3670033602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2c010c650 0x7ff2c010ea40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:32.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.900+0000 7ff2c6000640 1 --2- 172.21.15.17:0/3670033602 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff2c00730f0 0x7ff2c010c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:32.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.900+0000 7ff2c6000640 1 --2- 172.21.15.17:0/3670033602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2c00727d0 0x7ff2c0072bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:32.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.900+0000 7ff2c6000640 1 -- 172.21.15.17:0/3670033602 >> 172.21.15.17:0/3670033602 conn(0x7ff2c00fba90 msgr2=0x7ff2c00fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:32.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.900+0000 7ff2c6000640 1 -- 172.21.15.17:0/3670033602 shutdown_connections 2024-09-13T15:56:32.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.900+0000 7ff2c6000640 1 -- 172.21.15.17:0/3670033602 wait complete. 2024-09-13T15:56:32.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.901+0000 7ff2c6000640 1 Processor -- start 2024-09-13T15:56:32.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.901+0000 7ff2c6000640 1 -- start start 2024-09-13T15:56:32.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.901+0000 7ff2c6000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2c00727d0 0x7ff2c0198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:32.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.901+0000 7ff2c6000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff2c00730f0 0x7ff2c0198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:32.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.901+0000 7ff2c6000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2c010c650 0x7ff2c019ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:32.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.901+0000 7ff2c6000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c019d440 con 0x7ff2c00727d0 2024-09-13T15:56:32.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.901+0000 7ff2c6000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c019d5b0 con 0x7ff2c010c650 2024-09-13T15:56:32.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.901+0000 7ff2c6000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c019d720 con 0x7ff2c00730f0 2024-09-13T15:56:32.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.901+0000 7ff2bf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2c00727d0 0x7ff2c0198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:32.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.902+0000 7ff2bf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2c00727d0 0x7ff2c0198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54332/0 (socket says 172.21.15.17:54332) 2024-09-13T15:56:32.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.902+0000 7ff2bf400640 1 -- 172.21.15.17:0/3853869218 learned_addr learned my addr 172.21.15.17:0/3853869218 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:32.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.902+0000 7ff2b7e00640 1 --2- 172.21.15.17:0/3853869218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff2c00730f0 0x7ff2c0198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:32.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.902+0000 7ff2bfe00640 1 --2- 172.21.15.17:0/3853869218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2c010c650 0x7ff2c019ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:32.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.902+0000 7ff2bf400640 1 -- 172.21.15.17:0/3853869218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff2c00730f0 msgr2=0x7ff2c0198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:32.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.902+0000 7ff2bf400640 1 --2- 172.21.15.17:0/3853869218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff2c00730f0 0x7ff2c0198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:32.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.902+0000 7ff2bf400640 1 -- 172.21.15.17:0/3853869218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2c010c650 msgr2=0x7ff2c019ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:32.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.902+0000 7ff2bf400640 1 --2- 172.21.15.17:0/3853869218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2c010c650 0x7ff2c019ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:32.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.902+0000 7ff2bf400640 1 -- 172.21.15.17:0/3853869218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b8009900 con 0x7ff2c00727d0 2024-09-13T15:56:32.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.902+0000 7ff2bf400640 1 --2- 172.21.15.17:0/3853869218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2c00727d0 0x7ff2c0198500 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000e9f0 tx=0x7ff2b000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:32.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.903+0000 7ff2bcc00640 1 -- 172.21.15.17:0/3853869218 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0009700 con 0x7ff2c00727d0 2024-09-13T15:56:32.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.903+0000 7ff2bcc00640 1 -- 172.21.15.17:0/3853869218 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2b000cd80 con 0x7ff2c00727d0 2024-09-13T15:56:32.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.903+0000 7ff2c6000640 1 -- 172.21.15.17:0/3853869218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c019da00 con 0x7ff2c00727d0 2024-09-13T15:56:32.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.903+0000 7ff2bcc00640 1 -- 172.21.15.17:0/3853869218 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0018860 con 0x7ff2c00727d0 2024-09-13T15:56:32.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.903+0000 7ff2c6000640 1 -- 172.21.15.17:0/3853869218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c01a52c0 con 0x7ff2c00727d0 2024-09-13T15:56:32.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.904+0000 7ff2c6000640 1 -- 172.21.15.17:0/3853869218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c0073f10 con 0x7ff2c00727d0 2024-09-13T15:56:32.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.906+0000 7ff2bcc00640 1 -- 172.21.15.17:0/3853869218 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ff2b00189c0 con 0x7ff2c00727d0 2024-09-13T15:56:32.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.907+0000 7ff2bcc00640 1 --2- 172.21.15.17:0/3853869218 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff2a40a1110 0x7ff2a40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:32.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.907+0000 7ff2bcc00640 1 -- 172.21.15.17:0/3853869218 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ff2b0014070 con 0x7ff2c00727d0 2024-09-13T15:56:32.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.908+0000 7ff2b7e00640 1 --2- 172.21.15.17:0/3853869218 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff2a40a1110 0x7ff2a40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:32.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.908+0000 7ff2b7e00640 1 --2- 172.21.15.17:0/3853869218 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff2a40a1110 0x7ff2a40a35d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0199ab0 tx=0x7ff2a8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:32.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:31.915+0000 7ff2bcc00640 1 -- 172.21.15.17:0/3853869218 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff2b0052e20 con 0x7ff2c00727d0 2024-09-13T15:56:32.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:32.109+0000 7ff2c6000640 1 -- 172.21.15.17:0/3853869218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff2c01998b0 con 0x7ff2c00727d0 2024-09-13T15:56:32.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:32.109+0000 7ff2bcc00640 1 -- 172.21.15.17:0/3853869218 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2b00964d0 con 0x7ff2c00727d0 2024-09-13T15:56:32.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:32.112+0000 7ff2c6000640 1 -- 172.21.15.17:0/3853869218 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff2a40a1110 msgr2=0x7ff2a40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:32.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:32.112+0000 7ff2c6000640 1 --2- 172.21.15.17:0/3853869218 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff2a40a1110 0x7ff2a40a35d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0199ab0 tx=0x7ff2a8005f90 comp rx=0 tx=0).stop 2024-09-13T15:56:32.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:32.112+0000 7ff2c6000640 1 -- 172.21.15.17:0/3853869218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2c00727d0 msgr2=0x7ff2c0198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:32.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:32.112+0000 7ff2c6000640 1 --2- 172.21.15.17:0/3853869218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2c00727d0 0x7ff2c0198500 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000e9f0 tx=0x7ff2b000eeb0 comp rx=0 tx=0).stop 2024-09-13T15:56:32.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:32.112+0000 7ff2c6000640 1 -- 172.21.15.17:0/3853869218 shutdown_connections 2024-09-13T15:56:32.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:32.112+0000 7ff2c6000640 1 --2- 172.21.15.17:0/3853869218 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff2a40a1110 0x7ff2a40a35d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:32.229 INFO:teuthology.orchestra.run.smithi017.stdout:111669149769 2024-09-13T15:56:32.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:32.112+0000 7ff2c6000640 1 --2- 172.21.15.17:0/3853869218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff2c010c650 0x7ff2c019ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:32.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:32.112+0000 7ff2c6000640 1 --2- 172.21.15.17:0/3853869218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff2c00730f0 0x7ff2c0198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:32.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:32.112+0000 7ff2c6000640 1 --2- 172.21.15.17:0/3853869218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2c00727d0 0x7ff2c0198500 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:32.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:32.112+0000 7ff2c6000640 1 -- 172.21.15.17:0/3853869218 >> 172.21.15.17:0/3853869218 conn(0x7ff2c00fba90 msgr2=0x7ff2c00fd220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:32.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:32.113+0000 7ff2c6000640 1 -- 172.21.15.17:0/3853869218 shutdown_connections 2024-09-13T15:56:32.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:32.113+0000 7ff2c6000640 1 -- 172.21.15.17:0/3853869218 wait complete. 2024-09-13T15:56:32.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:32 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:56:32.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:32 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:56:32.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:32 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:56:32.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:32 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:56:32.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:32 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:56:32.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:32 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3853869218' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T15:56:32.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:32 smithi193 ceph-mon[35248]: pgmap v347: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:32.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:32 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:56:32.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:32 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:56:32.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:32 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:56:32.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:32 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:56:32.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:32 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:56:32.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:32 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3853869218' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T15:56:32.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:32 smithi017 ceph-mon[30494]: pgmap v347: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:32.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:32 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:56:32.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:32 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:56:32.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:32 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:56:32.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:32 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:56:32.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:32 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:56:32.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:32 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3853869218' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T15:56:32.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:32 smithi189 ceph-mon[34790]: pgmap v347: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:32.960 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149764 got 111669149769 for osd.3 2024-09-13T15:56:32.960 DEBUG:teuthology.parallel:result is None 2024-09-13T15:56:32.960 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-13T15:56:32.960 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T15:56:33.285 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:56:35.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.336+0000 7f0ea5000640 1 -- 172.21.15.17:0/4005732275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ea00ffe20 msgr2=0x7f0ea0100200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:35.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.336+0000 7f0ea5000640 1 --2- 172.21.15.17:0/4005732275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ea00ffe20 0x7f0ea0100200 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009930 tx=0x7f0e9002a420 comp rx=0 tx=0).stop 2024-09-13T15:56:35.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.336+0000 7f0ea5000640 1 -- 172.21.15.17:0/4005732275 shutdown_connections 2024-09-13T15:56:35.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.336+0000 7f0ea5000640 1 --2- 172.21.15.17:0/4005732275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0ea0104f50 0x7f0ea010cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:35.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.336+0000 7f0ea5000640 1 --2- 172.21.15.17:0/4005732275 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ea01007d0 0x7f0ea0104820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:35.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.336+0000 7f0ea5000640 1 --2- 172.21.15.17:0/4005732275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ea00ffe20 0x7f0ea0100200 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:35.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.336+0000 7f0ea5000640 1 -- 172.21.15.17:0/4005732275 >> 172.21.15.17:0/4005732275 conn(0x7f0ea00fb900 msgr2=0x7f0ea00fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:35.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.337+0000 7f0ea5000640 1 -- 172.21.15.17:0/4005732275 shutdown_connections 2024-09-13T15:56:35.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.337+0000 7f0ea5000640 1 -- 172.21.15.17:0/4005732275 wait complete. 2024-09-13T15:56:35.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.338+0000 7f0ea5000640 1 Processor -- start 2024-09-13T15:56:35.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.338+0000 7f0ea5000640 1 -- start start 2024-09-13T15:56:35.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.339+0000 7f0ea5000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ea00ffe20 0x7f0ea00727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:35.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.339+0000 7f0ea5000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ea01007d0 0x7f0ea0072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:35.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.339+0000 7f0ea5000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0ea0104f50 0x7f0ea0073230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:35.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.339+0000 7f0ea5000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea01a4630 con 0x7f0ea01007d0 2024-09-13T15:56:35.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.339+0000 7f0ea5000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea01a47a0 con 0x7f0ea0104f50 2024-09-13T15:56:35.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.339+0000 7f0ea5000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea01a4960 con 0x7f0ea00ffe20 2024-09-13T15:56:35.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.339+0000 7f0e97e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ea01007d0 0x7f0ea0072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:35.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.339+0000 7f0e97e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ea01007d0 0x7f0ea0072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54342/0 (socket says 172.21.15.17:54342) 2024-09-13T15:56:35.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.339+0000 7f0e97e00640 1 -- 172.21.15.17:0/549749715 learned_addr learned my addr 172.21.15.17:0/549749715 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:35.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.339+0000 7f0e9f400640 1 --2- 172.21.15.17:0/549749715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ea00ffe20 0x7f0ea00727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:35.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.339+0000 7f0e9fe00640 1 --2- 172.21.15.17:0/549749715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0ea0104f50 0x7f0ea0073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:35.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.340+0000 7f0e97e00640 1 -- 172.21.15.17:0/549749715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ea00ffe20 msgr2=0x7f0ea00727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:35.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.340+0000 7f0e97e00640 1 --2- 172.21.15.17:0/549749715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ea00ffe20 0x7f0ea00727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:35.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.340+0000 7f0e97e00640 1 -- 172.21.15.17:0/549749715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0ea0104f50 msgr2=0x7f0ea0073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:35.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.340+0000 7f0e97e00640 1 --2- 172.21.15.17:0/549749715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0ea0104f50 0x7f0ea0073230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:35.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.340+0000 7f0e97e00640 1 -- 172.21.15.17:0/549749715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e90009560 con 0x7f0ea01007d0 2024-09-13T15:56:35.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.340+0000 7f0e9fe00640 1 --2- 172.21.15.17:0/549749715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0ea0104f50 0x7f0ea0073230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:35.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.340+0000 7f0e97e00640 1 --2- 172.21.15.17:0/549749715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ea01007d0 0x7f0ea0072cf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800e9f0 tx=0x7f0e8800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:35.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.340+0000 7f0e9cc00640 1 -- 172.21.15.17:0/549749715 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e88009720 con 0x7f0ea01007d0 2024-09-13T15:56:35.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.340+0000 7f0e9cc00640 1 -- 172.21.15.17:0/549749715 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e8800cd80 con 0x7f0ea01007d0 2024-09-13T15:56:35.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.340+0000 7f0e9cc00640 1 -- 172.21.15.17:0/549749715 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e88010430 con 0x7f0ea01007d0 2024-09-13T15:56:35.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.340+0000 7f0ea5000640 1 -- 172.21.15.17:0/549749715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea01a4c40 con 0x7f0ea01007d0 2024-09-13T15:56:35.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.341+0000 7f0ea5000640 1 -- 172.21.15.17:0/549749715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea01a50f0 con 0x7f0ea01007d0 2024-09-13T15:56:35.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.342+0000 7f0ea5000640 1 -- 172.21.15.17:0/549749715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea0101300 con 0x7f0ea01007d0 2024-09-13T15:56:35.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.344+0000 7f0e9cc00640 1 -- 172.21.15.17:0/549749715 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0e88005020 con 0x7f0ea01007d0 2024-09-13T15:56:35.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.345+0000 7f0e9cc00640 1 --2- 172.21.15.17:0/549749715 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0e840a1180 0x7f0e840a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:35.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.345+0000 7f0e9cc00640 1 -- 172.21.15.17:0/549749715 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f0e88014070 con 0x7f0ea01007d0 2024-09-13T15:56:35.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.345+0000 7f0e9f400640 1 --2- 172.21.15.17:0/549749715 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0e840a1180 0x7f0e840a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:35.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.346+0000 7f0e9f400640 1 --2- 172.21.15.17:0/549749715 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0e840a1180 0x7f0e840a3640 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0e90005940 tx=0x7f0e900058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:35.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.349+0000 7f0e9cc00640 1 -- 172.21.15.17:0/549749715 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0e880963a0 con 0x7f0ea01007d0 2024-09-13T15:56:35.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:35 smithi193 ceph-mon[35248]: pgmap v348: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:35.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:35 smithi017 ceph-mon[30494]: pgmap v348: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:35.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.525+0000 7f0ea5000640 1 -- 172.21.15.17:0/549749715 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0ea010fc20 con 0x7f0e840a1180 2024-09-13T15:56:35.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.538+0000 7f0e9cc00640 1 -- 172.21.15.17:0/549749715 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427826 (secure 0 0 0) 0x7f0ea010fc20 con 0x7f0e840a1180 2024-09-13T15:56:35.546 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:56:35.549 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-13T15:56:35.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.543+0000 7f0ea5000640 1 -- 172.21.15.17:0/549749715 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0e840a1180 msgr2=0x7f0e840a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:35.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.543+0000 7f0ea5000640 1 --2- 172.21.15.17:0/549749715 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0e840a1180 0x7f0e840a3640 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0e90005940 tx=0x7f0e900058d0 comp rx=0 tx=0).stop 2024-09-13T15:56:35.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.543+0000 7f0ea5000640 1 -- 172.21.15.17:0/549749715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ea01007d0 msgr2=0x7f0ea0072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:35.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.543+0000 7f0ea5000640 1 --2- 172.21.15.17:0/549749715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ea01007d0 0x7f0ea0072cf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800e9f0 tx=0x7f0e8800edf0 comp rx=0 tx=0).stop 2024-09-13T15:56:35.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.544+0000 7f0ea5000640 1 -- 172.21.15.17:0/549749715 shutdown_connections 2024-09-13T15:56:35.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.544+0000 7f0ea5000640 1 --2- 172.21.15.17:0/549749715 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0e840a1180 0x7f0e840a3640 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:35.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.544+0000 7f0ea5000640 1 --2- 172.21.15.17:0/549749715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0ea0104f50 0x7f0ea0073230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:35.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.544+0000 7f0ea5000640 1 --2- 172.21.15.17:0/549749715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ea01007d0 0x7f0ea0072cf0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:35.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.544+0000 7f0ea5000640 1 --2- 172.21.15.17:0/549749715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ea00ffe20 0x7f0ea00727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:35.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.544+0000 7f0ea5000640 1 -- 172.21.15.17:0/549749715 >> 172.21.15.17:0/549749715 conn(0x7f0ea00fb900 msgr2=0x7f0ea00fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:35.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.544+0000 7f0ea5000640 1 -- 172.21.15.17:0/549749715 shutdown_connections 2024-09-13T15:56:35.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:35.544+0000 7f0ea5000640 1 -- 172.21.15.17:0/549749715 wait complete. 2024-09-13T15:56:35.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:35 smithi189 ceph-mon[34790]: pgmap v348: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:36.404 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":348,"stamp":"2024-09-13T15:56:34.166057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656795,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":600,"num_read_kb":414,"num_write":341,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1241483,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":371160,"kb_used_data":14128,"kb_used_omap":18,"kb_used_meta":356845,"kb_avail":1124570664,"statfs":{"total":1151940427776,"available":1151560359936,"internally_reserved":0,"allocated":14467072,"data_stored":7982035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19130,"internal_metadata":365409606},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003477"},"pg_stats":[{"pgid":"2.1f","version":"90'9","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.218140+0000","last_change":"2024-09-13T15:54:52.516551+0000","last_active":"2024-09-13T15:55:42.218140+0000","last_peered":"2024-09-13T15:55:42.218140+0000","last_clean":"2024-09-13T15:55:42.218140+0000","last_became_active":"2024-09-13T15:54:52.516112+0000","last_became_peered":"2024-09-13T15:54:52.516112+0000","last_unstale":"2024-09-13T15:55:42.218140+0000","last_undegraded":"2024-09-13T15:55:42.218140+0000","last_fullsized":"2024-09-13T15:55:42.218140+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:55.147164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.222332+0000","last_change":"2024-09-13T15:54:52.954466+0000","last_active":"2024-09-13T15:55:42.222332+0000","last_peered":"2024-09-13T15:55:42.222332+0000","last_clean":"2024-09-13T15:55:42.222332+0000","last_became_active":"2024-09-13T15:54:52.953991+0000","last_became_peered":"2024-09-13T15:54:52.953991+0000","last_unstale":"2024-09-13T15:55:42.222332+0000","last_undegraded":"2024-09-13T15:55:42.222332+0000","last_fullsized":"2024-09-13T15:55:42.222332+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:17.702395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217322+0000","last_change":"2024-09-13T15:54:56.970987+0000","last_active":"2024-09-13T15:55:42.217322+0000","last_peered":"2024-09-13T15:55:42.217322+0000","last_clean":"2024-09-13T15:55:42.217322+0000","last_became_active":"2024-09-13T15:54:56.970594+0000","last_became_peered":"2024-09-13T15:54:56.970594+0000","last_unstale":"2024-09-13T15:55:42.217322+0000","last_undegraded":"2024-09-13T15:55:42.217322+0000","last_fullsized":"2024-09-13T15:55:42.217322+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:56.833427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.222759+0000","last_change":"2024-09-13T15:54:52.517608+0000","last_active":"2024-09-13T15:55:42.222759+0000","last_peered":"2024-09-13T15:55:42.222759+0000","last_clean":"2024-09-13T15:55:42.222759+0000","last_became_active":"2024-09-13T15:54:52.517001+0000","last_became_peered":"2024-09-13T15:54:52.517001+0000","last_unstale":"2024-09-13T15:55:42.222759+0000","last_undegraded":"2024-09-13T15:55:42.222759+0000","last_fullsized":"2024-09-13T15:55:42.222759+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:51.459179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.225666+0000","last_change":"2024-09-13T15:54:52.944713+0000","last_active":"2024-09-13T15:55:42.225666+0000","last_peered":"2024-09-13T15:55:42.225666+0000","last_clean":"2024-09-13T15:55:42.225666+0000","last_became_active":"2024-09-13T15:54:52.943602+0000","last_became_peered":"2024-09-13T15:54:52.943602+0000","last_unstale":"2024-09-13T15:55:42.225666+0000","last_undegraded":"2024-09-13T15:55:42.225666+0000","last_fullsized":"2024-09-13T15:55:42.225666+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:59.305153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217485+0000","last_change":"2024-09-13T15:54:56.981923+0000","last_active":"2024-09-13T15:55:42.217485+0000","last_peered":"2024-09-13T15:55:42.217485+0000","last_clean":"2024-09-13T15:55:42.217485+0000","last_became_active":"2024-09-13T15:54:56.981640+0000","last_became_peered":"2024-09-13T15:54:56.981640+0000","last_unstale":"2024-09-13T15:55:42.217485+0000","last_undegraded":"2024-09-13T15:55:42.217485+0000","last_fullsized":"2024-09-13T15:55:42.217485+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:42.158619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223335+0000","last_change":"2024-09-13T15:54:52.512700+0000","last_active":"2024-09-13T15:55:42.223335+0000","last_peered":"2024-09-13T15:55:42.223335+0000","last_clean":"2024-09-13T15:55:42.223335+0000","last_became_active":"2024-09-13T15:54:52.512378+0000","last_became_peered":"2024-09-13T15:54:52.512378+0000","last_unstale":"2024-09-13T15:55:42.223335+0000","last_undegraded":"2024-09-13T15:55:42.223335+0000","last_fullsized":"2024-09-13T15:55:42.223335+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:43:23.573164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223416+0000","last_change":"2024-09-13T15:54:52.957314+0000","last_active":"2024-09-13T15:55:42.223416+0000","last_peered":"2024-09-13T15:55:42.223416+0000","last_clean":"2024-09-13T15:55:42.223416+0000","last_became_active":"2024-09-13T15:54:52.956836+0000","last_became_peered":"2024-09-13T15:54:52.956836+0000","last_unstale":"2024-09-13T15:55:42.223416+0000","last_undegraded":"2024-09-13T15:55:42.223416+0000","last_fullsized":"2024-09-13T15:55:42.223416+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:06.088700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217775+0000","last_change":"2024-09-13T15:54:56.970777+0000","last_active":"2024-09-13T15:55:42.217775+0000","last_peered":"2024-09-13T15:55:42.217775+0000","last_clean":"2024-09-13T15:55:42.217775+0000","last_became_active":"2024-09-13T15:54:56.970424+0000","last_became_peered":"2024-09-13T15:54:56.970424+0000","last_unstale":"2024-09-13T15:55:42.217775+0000","last_undegraded":"2024-09-13T15:55:42.217775+0000","last_fullsized":"2024-09-13T15:55:42.217775+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:00.045336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.222977+0000","last_change":"2024-09-13T15:54:52.511776+0000","last_active":"2024-09-13T15:55:42.222977+0000","last_peered":"2024-09-13T15:55:42.222977+0000","last_clean":"2024-09-13T15:55:42.222977+0000","last_became_active":"2024-09-13T15:54:52.511412+0000","last_became_peered":"2024-09-13T15:54:52.511412+0000","last_unstale":"2024-09-13T15:55:42.222977+0000","last_undegraded":"2024-09-13T15:55:42.222977+0000","last_fullsized":"2024-09-13T15:55:42.222977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:18.162778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:55:43.230825+0000","last_change":"2024-09-13T15:55:43.230825+0000","last_active":"2024-09-13T15:55:43.230825+0000","last_peered":"2024-09-13T15:55:43.230825+0000","last_clean":"2024-09-13T15:55:43.230825+0000","last_became_active":"2024-09-13T15:55:43.230406+0000","last_became_peered":"2024-09-13T15:55:43.230406+0000","last_unstale":"2024-09-13T15:55:43.230825+0000","last_undegraded":"2024-09-13T15:55:43.230825+0000","last_fullsized":"2024-09-13T15:55:43.230825+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:21:46.579479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217541+0000","last_change":"2024-09-13T15:54:56.973334+0000","last_active":"2024-09-13T15:55:42.217541+0000","last_peered":"2024-09-13T15:55:42.217541+0000","last_clean":"2024-09-13T15:55:42.217541+0000","last_became_active":"2024-09-13T15:54:56.973087+0000","last_became_peered":"2024-09-13T15:54:56.973087+0000","last_unstale":"2024-09-13T15:55:42.217541+0000","last_undegraded":"2024-09-13T15:55:42.217541+0000","last_fullsized":"2024-09-13T15:55:42.217541+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:19.727601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.226964+0000","last_change":"2024-09-13T15:54:52.955223+0000","last_active":"2024-09-13T15:55:42.226964+0000","last_peered":"2024-09-13T15:55:42.226964+0000","last_clean":"2024-09-13T15:55:42.226964+0000","last_became_active":"2024-09-13T15:54:52.954848+0000","last_became_peered":"2024-09-13T15:54:52.954848+0000","last_unstale":"2024-09-13T15:55:42.226964+0000","last_undegraded":"2024-09-13T15:55:42.226964+0000","last_fullsized":"2024-09-13T15:55:42.226964+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:36.921666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.222483+0000","last_change":"2024-09-13T15:54:52.513484+0000","last_active":"2024-09-13T15:55:42.222483+0000","last_peered":"2024-09-13T15:55:42.222483+0000","last_clean":"2024-09-13T15:55:42.222483+0000","last_became_active":"2024-09-13T15:54:52.513143+0000","last_became_peered":"2024-09-13T15:54:52.513143+0000","last_unstale":"2024-09-13T15:55:42.222483+0000","last_undegraded":"2024-09-13T15:55:42.222483+0000","last_fullsized":"2024-09-13T15:55:42.222483+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:31.735280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217896+0000","last_change":"2024-09-13T15:54:57.082924+0000","last_active":"2024-09-13T15:55:42.217896+0000","last_peered":"2024-09-13T15:55:42.217896+0000","last_clean":"2024-09-13T15:55:42.217896+0000","last_became_active":"2024-09-13T15:54:57.082552+0000","last_became_peered":"2024-09-13T15:54:57.082552+0000","last_unstale":"2024-09-13T15:55:42.217896+0000","last_undegraded":"2024-09-13T15:55:42.217896+0000","last_fullsized":"2024-09-13T15:55:42.217896+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:05.144646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.222288+0000","last_change":"2024-09-13T15:54:52.954909+0000","last_active":"2024-09-13T15:55:42.222288+0000","last_peered":"2024-09-13T15:55:42.222288+0000","last_clean":"2024-09-13T15:55:42.222288+0000","last_became_active":"2024-09-13T15:54:52.954639+0000","last_became_peered":"2024-09-13T15:54:52.954639+0000","last_unstale":"2024-09-13T15:55:42.222288+0000","last_undegraded":"2024-09-13T15:55:42.222288+0000","last_fullsized":"2024-09-13T15:55:42.222288+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:35.984856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:55:43.234021+0000","last_change":"2024-09-13T15:55:43.233689+0000","last_active":"2024-09-13T15:55:43.234021+0000","last_peered":"2024-09-13T15:55:43.234021+0000","last_clean":"2024-09-13T15:55:43.234021+0000","last_became_active":"2024-09-13T15:55:43.230745+0000","last_became_peered":"2024-09-13T15:55:43.230745+0000","last_unstale":"2024-09-13T15:55:43.234021+0000","last_undegraded":"2024-09-13T15:55:43.234021+0000","last_fullsized":"2024-09-13T15:55:43.234021+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:32.428515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217673+0000","last_change":"2024-09-13T15:54:56.963815+0000","last_active":"2024-09-13T15:55:42.217673+0000","last_peered":"2024-09-13T15:55:42.217673+0000","last_clean":"2024-09-13T15:55:42.217673+0000","last_became_active":"2024-09-13T15:54:56.963311+0000","last_became_peered":"2024-09-13T15:54:56.963311+0000","last_unstale":"2024-09-13T15:55:42.217673+0000","last_undegraded":"2024-09-13T15:55:42.217673+0000","last_fullsized":"2024-09-13T15:55:42.217673+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:56.464599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223837+0000","last_change":"2024-09-13T15:54:52.963277+0000","last_active":"2024-09-13T15:55:42.223837+0000","last_peered":"2024-09-13T15:55:42.223837+0000","last_clean":"2024-09-13T15:55:42.223837+0000","last_became_active":"2024-09-13T15:54:52.962941+0000","last_became_peered":"2024-09-13T15:54:52.962941+0000","last_unstale":"2024-09-13T15:55:42.223837+0000","last_undegraded":"2024-09-13T15:55:42.223837+0000","last_fullsized":"2024-09-13T15:55:42.223837+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:11.843307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221898+0000","last_change":"2024-09-13T15:54:52.518703+0000","last_active":"2024-09-13T15:55:42.221898+0000","last_peered":"2024-09-13T15:55:42.221898+0000","last_clean":"2024-09-13T15:55:42.221898+0000","last_became_active":"2024-09-13T15:54:52.518384+0000","last_became_peered":"2024-09-13T15:54:52.518384+0000","last_unstale":"2024-09-13T15:55:42.221898+0000","last_undegraded":"2024-09-13T15:55:42.221898+0000","last_fullsized":"2024-09-13T15:55:42.221898+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:39:48.117161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217382+0000","last_change":"2024-09-13T15:54:56.977372+0000","last_active":"2024-09-13T15:55:42.217382+0000","last_peered":"2024-09-13T15:55:42.217382+0000","last_clean":"2024-09-13T15:55:42.217382+0000","last_became_active":"2024-09-13T15:54:56.976980+0000","last_became_peered":"2024-09-13T15:54:56.976980+0000","last_unstale":"2024-09-13T15:55:42.217382+0000","last_undegraded":"2024-09-13T15:55:42.217382+0000","last_fullsized":"2024-09-13T15:55:42.217382+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:51.597228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221291+0000","last_change":"2024-09-13T15:54:52.958598+0000","last_active":"2024-09-13T15:55:42.221291+0000","last_peered":"2024-09-13T15:55:42.221291+0000","last_clean":"2024-09-13T15:55:42.221291+0000","last_became_active":"2024-09-13T15:54:52.958272+0000","last_became_peered":"2024-09-13T15:54:52.958272+0000","last_unstale":"2024-09-13T15:55:42.221291+0000","last_undegraded":"2024-09-13T15:55:42.221291+0000","last_fullsized":"2024-09-13T15:55:42.221291+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:28.174228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223236+0000","last_change":"2024-09-13T15:54:52.507028+0000","last_active":"2024-09-13T15:55:42.223236+0000","last_peered":"2024-09-13T15:55:42.223236+0000","last_clean":"2024-09-13T15:55:42.223236+0000","last_became_active":"2024-09-13T15:54:52.506229+0000","last_became_peered":"2024-09-13T15:54:52.506229+0000","last_unstale":"2024-09-13T15:55:42.223236+0000","last_undegraded":"2024-09-13T15:55:42.223236+0000","last_fullsized":"2024-09-13T15:55:42.223236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:35:02.793140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:55:43.225668+0000","last_change":"2024-09-13T15:55:43.225668+0000","last_active":"2024-09-13T15:55:43.225668+0000","last_peered":"2024-09-13T15:55:43.225668+0000","last_clean":"2024-09-13T15:55:43.225668+0000","last_became_active":"2024-09-13T15:55:43.225200+0000","last_became_peered":"2024-09-13T15:55:43.225200+0000","last_unstale":"2024-09-13T15:55:43.225668+0000","last_undegraded":"2024-09-13T15:55:43.225668+0000","last_fullsized":"2024-09-13T15:55:43.225668+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:55.815724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.225004+0000","last_change":"2024-09-13T15:54:52.961897+0000","last_active":"2024-09-13T15:55:42.225004+0000","last_peered":"2024-09-13T15:55:42.225004+0000","last_clean":"2024-09-13T15:55:42.225004+0000","last_became_active":"2024-09-13T15:54:52.957467+0000","last_became_peered":"2024-09-13T15:54:52.957467+0000","last_unstale":"2024-09-13T15:55:42.225004+0000","last_undegraded":"2024-09-13T15:55:42.225004+0000","last_fullsized":"2024-09-13T15:55:42.225004+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:57:04.150561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.219114+0000","last_change":"2024-09-13T15:54:52.507564+0000","last_active":"2024-09-13T15:55:42.219114+0000","last_peered":"2024-09-13T15:55:42.219114+0000","last_clean":"2024-09-13T15:55:42.219114+0000","last_became_active":"2024-09-13T15:54:52.507267+0000","last_became_peered":"2024-09-13T15:54:52.507267+0000","last_unstale":"2024-09-13T15:55:42.219114+0000","last_undegraded":"2024-09-13T15:55:42.219114+0000","last_fullsized":"2024-09-13T15:55:42.219114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:56.093402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217526+0000","last_change":"2024-09-13T15:54:56.961499+0000","last_active":"2024-09-13T15:55:42.217526+0000","last_peered":"2024-09-13T15:55:42.217526+0000","last_clean":"2024-09-13T15:55:42.217526+0000","last_became_active":"2024-09-13T15:54:56.961032+0000","last_became_peered":"2024-09-13T15:54:56.961032+0000","last_unstale":"2024-09-13T15:55:42.217526+0000","last_undegraded":"2024-09-13T15:55:42.217526+0000","last_fullsized":"2024-09-13T15:55:42.217526+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:28.937286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.222810+0000","last_change":"2024-09-13T15:54:52.951517+0000","last_active":"2024-09-13T15:55:42.222810+0000","last_peered":"2024-09-13T15:55:42.222810+0000","last_clean":"2024-09-13T15:55:42.222810+0000","last_became_active":"2024-09-13T15:54:52.951205+0000","last_became_peered":"2024-09-13T15:54:52.951205+0000","last_unstale":"2024-09-13T15:55:42.222810+0000","last_undegraded":"2024-09-13T15:55:42.222810+0000","last_fullsized":"2024-09-13T15:55:42.222810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:36.936826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'6","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217977+0000","last_change":"2024-09-13T15:54:52.518580+0000","last_active":"2024-09-13T15:55:42.217977+0000","last_peered":"2024-09-13T15:55:42.217977+0000","last_clean":"2024-09-13T15:55:42.217977+0000","last_became_active":"2024-09-13T15:54:52.518277+0000","last_became_peered":"2024-09-13T15:54:52.518277+0000","last_unstale":"2024-09-13T15:55:42.217977+0000","last_undegraded":"2024-09-13T15:55:42.217977+0000","last_fullsized":"2024-09-13T15:55:42.217977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:10.842369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221500+0000","last_change":"2024-09-13T15:54:57.082786+0000","last_active":"2024-09-13T15:55:42.221500+0000","last_peered":"2024-09-13T15:55:42.221500+0000","last_clean":"2024-09-13T15:55:42.221500+0000","last_became_active":"2024-09-13T15:54:57.082357+0000","last_became_peered":"2024-09-13T15:54:57.082357+0000","last_unstale":"2024-09-13T15:55:42.221500+0000","last_undegraded":"2024-09-13T15:55:42.221500+0000","last_fullsized":"2024-09-13T15:55:42.221500+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:40.867554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221069+0000","last_change":"2024-09-13T15:54:52.944433+0000","last_active":"2024-09-13T15:55:42.221069+0000","last_peered":"2024-09-13T15:55:42.221069+0000","last_clean":"2024-09-13T15:55:42.221069+0000","last_became_active":"2024-09-13T15:54:52.943624+0000","last_became_peered":"2024-09-13T15:54:52.943624+0000","last_unstale":"2024-09-13T15:55:42.221069+0000","last_undegraded":"2024-09-13T15:55:42.221069+0000","last_fullsized":"2024-09-13T15:55:42.221069+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:49.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223426+0000","last_change":"2024-09-13T15:54:52.525629+0000","last_active":"2024-09-13T15:55:42.223426+0000","last_peered":"2024-09-13T15:55:42.223426+0000","last_clean":"2024-09-13T15:55:42.223426+0000","last_became_active":"2024-09-13T15:54:52.525311+0000","last_became_peered":"2024-09-13T15:54:52.525311+0000","last_unstale":"2024-09-13T15:55:42.223426+0000","last_undegraded":"2024-09-13T15:55:42.223426+0000","last_fullsized":"2024-09-13T15:55:42.223426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:25.856415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223196+0000","last_change":"2024-09-13T15:54:56.971608+0000","last_active":"2024-09-13T15:55:42.223196+0000","last_peered":"2024-09-13T15:55:42.223196+0000","last_clean":"2024-09-13T15:55:42.223196+0000","last_became_active":"2024-09-13T15:54:56.971185+0000","last_became_peered":"2024-09-13T15:54:56.971185+0000","last_unstale":"2024-09-13T15:55:42.223196+0000","last_undegraded":"2024-09-13T15:55:42.223196+0000","last_fullsized":"2024-09-13T15:55:42.223196+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:46.098922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221063+0000","last_change":"2024-09-13T15:54:52.958843+0000","last_active":"2024-09-13T15:55:42.221063+0000","last_peered":"2024-09-13T15:55:42.221063+0000","last_clean":"2024-09-13T15:55:42.221063+0000","last_became_active":"2024-09-13T15:54:52.958534+0000","last_became_peered":"2024-09-13T15:54:52.958534+0000","last_unstale":"2024-09-13T15:55:42.221063+0000","last_undegraded":"2024-09-13T15:55:42.221063+0000","last_fullsized":"2024-09-13T15:55:42.221063+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:34.721886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217320+0000","last_change":"2024-09-13T15:54:52.524043+0000","last_active":"2024-09-13T15:55:42.217320+0000","last_peered":"2024-09-13T15:55:42.217320+0000","last_clean":"2024-09-13T15:55:42.217320+0000","last_became_active":"2024-09-13T15:54:52.523681+0000","last_became_peered":"2024-09-13T15:54:52.523681+0000","last_unstale":"2024-09-13T15:55:42.217320+0000","last_undegraded":"2024-09-13T15:55:42.217320+0000","last_fullsized":"2024-09-13T15:55:42.217320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:21.164458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221416+0000","last_change":"2024-09-13T15:54:57.083066+0000","last_active":"2024-09-13T15:55:42.221416+0000","last_peered":"2024-09-13T15:55:42.221416+0000","last_clean":"2024-09-13T15:55:42.221416+0000","last_became_active":"2024-09-13T15:54:57.082664+0000","last_became_peered":"2024-09-13T15:54:57.082664+0000","last_unstale":"2024-09-13T15:55:42.221416+0000","last_undegraded":"2024-09-13T15:55:42.221416+0000","last_fullsized":"2024-09-13T15:55:42.221416+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:54.872482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.220899+0000","last_change":"2024-09-13T15:54:52.957428+0000","last_active":"2024-09-13T15:55:42.220899+0000","last_peered":"2024-09-13T15:55:42.220899+0000","last_clean":"2024-09-13T15:55:42.220899+0000","last_became_active":"2024-09-13T15:54:52.957121+0000","last_became_peered":"2024-09-13T15:54:52.957121+0000","last_unstale":"2024-09-13T15:55:42.220899+0000","last_undegraded":"2024-09-13T15:55:42.220899+0000","last_fullsized":"2024-09-13T15:55:42.220899+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:40.821503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.226965+0000","last_change":"2024-09-13T15:54:52.509101+0000","last_active":"2024-09-13T15:55:42.226965+0000","last_peered":"2024-09-13T15:55:42.226965+0000","last_clean":"2024-09-13T15:55:42.226965+0000","last_became_active":"2024-09-13T15:54:52.508808+0000","last_became_peered":"2024-09-13T15:54:52.508808+0000","last_unstale":"2024-09-13T15:55:42.226965+0000","last_undegraded":"2024-09-13T15:55:42.226965+0000","last_fullsized":"2024-09-13T15:55:42.226965+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.181340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.220828+0000","last_change":"2024-09-13T15:54:56.976153+0000","last_active":"2024-09-13T15:55:42.220828+0000","last_peered":"2024-09-13T15:55:42.220828+0000","last_clean":"2024-09-13T15:55:42.220828+0000","last_became_active":"2024-09-13T15:54:56.975727+0000","last_became_peered":"2024-09-13T15:54:56.975727+0000","last_unstale":"2024-09-13T15:55:42.220828+0000","last_undegraded":"2024-09-13T15:55:42.220828+0000","last_fullsized":"2024-09-13T15:55:42.220828+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:12:19.431484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221998+0000","last_change":"2024-09-13T15:54:52.958321+0000","last_active":"2024-09-13T15:55:42.221998+0000","last_peered":"2024-09-13T15:55:42.221998+0000","last_clean":"2024-09-13T15:55:42.221998+0000","last_became_active":"2024-09-13T15:54:52.958030+0000","last_became_peered":"2024-09-13T15:54:52.958030+0000","last_unstale":"2024-09-13T15:55:42.221998+0000","last_undegraded":"2024-09-13T15:55:42.221998+0000","last_fullsized":"2024-09-13T15:55:42.221998+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:15.159807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'4","reported_seq":99,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:56:31.398116+0000","last_change":"2024-09-13T15:54:52.519475+0000","last_active":"2024-09-13T15:56:31.398116+0000","last_peered":"2024-09-13T15:56:31.398116+0000","last_clean":"2024-09-13T15:56:31.398116+0000","last_became_active":"2024-09-13T15:54:52.519144+0000","last_became_peered":"2024-09-13T15:54:52.519144+0000","last_unstale":"2024-09-13T15:56:31.398116+0000","last_undegraded":"2024-09-13T15:56:31.398116+0000","last_fullsized":"2024-09-13T15:56:31.398116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:07.085691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221037+0000","last_change":"2024-09-13T15:54:57.083036+0000","last_active":"2024-09-13T15:55:42.221037+0000","last_peered":"2024-09-13T15:55:42.221037+0000","last_clean":"2024-09-13T15:55:42.221037+0000","last_became_active":"2024-09-13T15:54:57.082577+0000","last_became_peered":"2024-09-13T15:54:57.082577+0000","last_unstale":"2024-09-13T15:55:42.221037+0000","last_undegraded":"2024-09-13T15:55:42.221037+0000","last_fullsized":"2024-09-13T15:55:42.221037+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:06.309671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.220621+0000","last_change":"2024-09-13T15:54:52.950494+0000","last_active":"2024-09-13T15:55:42.220621+0000","last_peered":"2024-09-13T15:55:42.220621+0000","last_clean":"2024-09-13T15:55:42.220621+0000","last_became_active":"2024-09-13T15:54:52.950160+0000","last_became_peered":"2024-09-13T15:54:52.950160+0000","last_unstale":"2024-09-13T15:55:42.220621+0000","last_undegraded":"2024-09-13T15:55:42.220621+0000","last_fullsized":"2024-09-13T15:55:42.220621+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:59.070083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.226727+0000","last_change":"2024-09-13T15:54:52.511717+0000","last_active":"2024-09-13T15:55:42.226727+0000","last_peered":"2024-09-13T15:55:42.226727+0000","last_clean":"2024-09-13T15:55:42.226727+0000","last_became_active":"2024-09-13T15:54:52.511421+0000","last_became_peered":"2024-09-13T15:54:52.511421+0000","last_unstale":"2024-09-13T15:55:42.226727+0000","last_undegraded":"2024-09-13T15:55:42.226727+0000","last_fullsized":"2024-09-13T15:55:42.226727+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:30:03.037852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.222651+0000","last_change":"2024-09-13T15:54:57.083707+0000","last_active":"2024-09-13T15:55:42.222651+0000","last_peered":"2024-09-13T15:55:42.222651+0000","last_clean":"2024-09-13T15:55:42.222651+0000","last_became_active":"2024-09-13T15:54:57.083351+0000","last_became_peered":"2024-09-13T15:54:57.083351+0000","last_unstale":"2024-09-13T15:55:42.222651+0000","last_undegraded":"2024-09-13T15:55:42.222651+0000","last_fullsized":"2024-09-13T15:55:42.222651+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:42.058114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.222111+0000","last_change":"2024-09-13T15:54:52.955696+0000","last_active":"2024-09-13T15:55:42.222111+0000","last_peered":"2024-09-13T15:55:42.222111+0000","last_clean":"2024-09-13T15:55:42.222111+0000","last_became_active":"2024-09-13T15:54:52.955271+0000","last_became_peered":"2024-09-13T15:54:52.955271+0000","last_unstale":"2024-09-13T15:55:42.222111+0000","last_undegraded":"2024-09-13T15:55:42.222111+0000","last_fullsized":"2024-09-13T15:55:42.222111+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:16.904541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.218105+0000","last_change":"2024-09-13T15:54:52.507152+0000","last_active":"2024-09-13T15:55:42.218105+0000","last_peered":"2024-09-13T15:55:42.218105+0000","last_clean":"2024-09-13T15:55:42.218105+0000","last_became_active":"2024-09-13T15:54:52.506805+0000","last_became_peered":"2024-09-13T15:54:52.506805+0000","last_unstale":"2024-09-13T15:55:42.218105+0000","last_undegraded":"2024-09-13T15:55:42.218105+0000","last_fullsized":"2024-09-13T15:55:42.218105+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:51.221341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":332,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:55:44.054526+0000","last_change":"2024-09-13T15:53:37.322379+0000","last_active":"2024-09-13T15:55:44.054526+0000","last_peered":"2024-09-13T15:55:44.054526+0000","last_clean":"2024-09-13T15:55:44.054526+0000","last_became_active":"2024-09-13T15:53:37.321987+0000","last_became_peered":"2024-09-13T15:53:37.321987+0000","last_unstale":"2024-09-13T15:55:44.054526+0000","last_undegraded":"2024-09-13T15:55:44.054526+0000","last_fullsized":"2024-09-13T15:55:44.054526+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:50:10.707150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:50:10.707150+0000","last_clean_scrub_stamp":"2024-09-13T15:50:10.707150+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:16.244946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.226981+0000","last_change":"2024-09-13T15:54:56.964729+0000","last_active":"2024-09-13T15:55:42.226981+0000","last_peered":"2024-09-13T15:55:42.226981+0000","last_clean":"2024-09-13T15:55:42.226981+0000","last_became_active":"2024-09-13T15:54:56.964385+0000","last_became_peered":"2024-09-13T15:54:56.964385+0000","last_unstale":"2024-09-13T15:55:42.226981+0000","last_undegraded":"2024-09-13T15:55:42.226981+0000","last_fullsized":"2024-09-13T15:55:42.226981+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:11.884248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.227204+0000","last_change":"2024-09-13T15:54:52.960069+0000","last_active":"2024-09-13T15:55:42.227204+0000","last_peered":"2024-09-13T15:55:42.227204+0000","last_clean":"2024-09-13T15:55:42.227204+0000","last_became_active":"2024-09-13T15:54:52.959762+0000","last_became_peered":"2024-09-13T15:54:52.959762+0000","last_unstale":"2024-09-13T15:55:42.227204+0000","last_undegraded":"2024-09-13T15:55:42.227204+0000","last_fullsized":"2024-09-13T15:55:42.227204+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:18.506596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217915+0000","last_change":"2024-09-13T15:54:52.524137+0000","last_active":"2024-09-13T15:55:42.217915+0000","last_peered":"2024-09-13T15:55:42.217915+0000","last_clean":"2024-09-13T15:55:42.217915+0000","last_became_active":"2024-09-13T15:54:52.523781+0000","last_became_peered":"2024-09-13T15:54:52.523781+0000","last_unstale":"2024-09-13T15:55:42.217915+0000","last_undegraded":"2024-09-13T15:55:42.217915+0000","last_fullsized":"2024-09-13T15:55:42.217915+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:04.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223179+0000","last_change":"2024-09-13T15:54:56.967557+0000","last_active":"2024-09-13T15:55:42.223179+0000","last_peered":"2024-09-13T15:55:42.223179+0000","last_clean":"2024-09-13T15:55:42.223179+0000","last_became_active":"2024-09-13T15:54:56.967190+0000","last_became_peered":"2024-09-13T15:54:56.967190+0000","last_unstale":"2024-09-13T15:55:42.223179+0000","last_undegraded":"2024-09-13T15:55:42.223179+0000","last_fullsized":"2024-09-13T15:55:42.223179+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:45.630557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.227041+0000","last_change":"2024-09-13T15:54:52.955587+0000","last_active":"2024-09-13T15:55:42.227041+0000","last_peered":"2024-09-13T15:55:42.227041+0000","last_clean":"2024-09-13T15:55:42.227041+0000","last_became_active":"2024-09-13T15:54:52.955270+0000","last_became_peered":"2024-09-13T15:54:52.955270+0000","last_unstale":"2024-09-13T15:55:42.227041+0000","last_undegraded":"2024-09-13T15:55:42.227041+0000","last_fullsized":"2024-09-13T15:55:42.227041+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:59.425468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223941+0000","last_change":"2024-09-13T15:54:52.518617+0000","last_active":"2024-09-13T15:55:42.223941+0000","last_peered":"2024-09-13T15:55:42.223941+0000","last_clean":"2024-09-13T15:55:42.223941+0000","last_became_active":"2024-09-13T15:54:52.518292+0000","last_became_peered":"2024-09-13T15:54:52.518292+0000","last_unstale":"2024-09-13T15:55:42.223941+0000","last_undegraded":"2024-09-13T15:55:42.223941+0000","last_fullsized":"2024-09-13T15:55:42.223941+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:06.890484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.224869+0000","last_change":"2024-09-13T15:54:56.978521+0000","last_active":"2024-09-13T15:55:42.224869+0000","last_peered":"2024-09-13T15:55:42.224869+0000","last_clean":"2024-09-13T15:55:42.224869+0000","last_became_active":"2024-09-13T15:54:56.977938+0000","last_became_peered":"2024-09-13T15:54:56.977938+0000","last_unstale":"2024-09-13T15:55:42.224869+0000","last_undegraded":"2024-09-13T15:55:42.224869+0000","last_fullsized":"2024-09-13T15:55:42.224869+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:26.251881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.227324+0000","last_change":"2024-09-13T15:54:52.954992+0000","last_active":"2024-09-13T15:55:42.227324+0000","last_peered":"2024-09-13T15:55:42.227324+0000","last_clean":"2024-09-13T15:55:42.227324+0000","last_became_active":"2024-09-13T15:54:52.954646+0000","last_became_peered":"2024-09-13T15:54:52.954646+0000","last_unstale":"2024-09-13T15:55:42.227324+0000","last_undegraded":"2024-09-13T15:55:42.227324+0000","last_fullsized":"2024-09-13T15:55:42.227324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:28.362703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.222173+0000","last_change":"2024-09-13T15:54:52.509976+0000","last_active":"2024-09-13T15:55:42.222173+0000","last_peered":"2024-09-13T15:55:42.222173+0000","last_clean":"2024-09-13T15:55:42.222173+0000","last_became_active":"2024-09-13T15:54:52.509669+0000","last_became_peered":"2024-09-13T15:54:52.509669+0000","last_unstale":"2024-09-13T15:55:42.222173+0000","last_undegraded":"2024-09-13T15:55:42.222173+0000","last_fullsized":"2024-09-13T15:55:42.222173+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:06:02.622401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223387+0000","last_change":"2024-09-13T15:54:56.966090+0000","last_active":"2024-09-13T15:55:42.223387+0000","last_peered":"2024-09-13T15:55:42.223387+0000","last_clean":"2024-09-13T15:55:42.223387+0000","last_became_active":"2024-09-13T15:54:56.965671+0000","last_became_peered":"2024-09-13T15:54:56.965671+0000","last_unstale":"2024-09-13T15:55:42.223387+0000","last_undegraded":"2024-09-13T15:55:42.223387+0000","last_fullsized":"2024-09-13T15:55:42.223387+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:20.318451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:55:43.229763+0000","last_change":"2024-09-13T15:55:43.229763+0000","last_active":"2024-09-13T15:55:43.229763+0000","last_peered":"2024-09-13T15:55:43.229763+0000","last_clean":"2024-09-13T15:55:43.229763+0000","last_became_active":"2024-09-13T15:55:43.229373+0000","last_became_peered":"2024-09-13T15:55:43.229373+0000","last_unstale":"2024-09-13T15:55:43.229763+0000","last_undegraded":"2024-09-13T15:55:43.229763+0000","last_fullsized":"2024-09-13T15:55:43.229763+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:09.917779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.224008+0000","last_change":"2024-09-13T15:54:52.512258+0000","last_active":"2024-09-13T15:55:42.224008+0000","last_peered":"2024-09-13T15:55:42.224008+0000","last_clean":"2024-09-13T15:55:42.224008+0000","last_became_active":"2024-09-13T15:54:52.511585+0000","last_became_peered":"2024-09-13T15:54:52.511585+0000","last_unstale":"2024-09-13T15:55:42.224008+0000","last_undegraded":"2024-09-13T15:55:42.224008+0000","last_fullsized":"2024-09-13T15:55:42.224008+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:41.717042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221296+0000","last_change":"2024-09-13T15:54:56.975391+0000","last_active":"2024-09-13T15:55:42.221296+0000","last_peered":"2024-09-13T15:55:42.221296+0000","last_clean":"2024-09-13T15:55:42.221296+0000","last_became_active":"2024-09-13T15:54:56.975110+0000","last_became_peered":"2024-09-13T15:54:56.975110+0000","last_unstale":"2024-09-13T15:55:42.221296+0000","last_undegraded":"2024-09-13T15:55:42.221296+0000","last_fullsized":"2024-09-13T15:55:42.221296+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:41.001352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221361+0000","last_change":"2024-09-13T15:54:52.962697+0000","last_active":"2024-09-13T15:55:42.221361+0000","last_peered":"2024-09-13T15:55:42.221361+0000","last_clean":"2024-09-13T15:55:42.221361+0000","last_became_active":"2024-09-13T15:54:52.962202+0000","last_became_peered":"2024-09-13T15:54:52.962202+0000","last_unstale":"2024-09-13T15:55:42.221361+0000","last_undegraded":"2024-09-13T15:55:42.221361+0000","last_fullsized":"2024-09-13T15:55:42.221361+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:18.993166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:55:43.263033+0000","last_change":"2024-09-13T15:55:43.262658+0000","last_active":"2024-09-13T15:55:43.263033+0000","last_peered":"2024-09-13T15:55:43.263033+0000","last_clean":"2024-09-13T15:55:43.263033+0000","last_became_active":"2024-09-13T15:55:43.240153+0000","last_became_peered":"2024-09-13T15:55:43.240153+0000","last_unstale":"2024-09-13T15:55:43.263033+0000","last_undegraded":"2024-09-13T15:55:43.263033+0000","last_fullsized":"2024-09-13T15:55:43.263033+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:28.035649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:55:43.237249+0000","last_change":"2024-09-13T15:55:43.237249+0000","last_active":"2024-09-13T15:55:43.237249+0000","last_peered":"2024-09-13T15:55:43.237249+0000","last_clean":"2024-09-13T15:55:43.237249+0000","last_became_active":"2024-09-13T15:55:43.236754+0000","last_became_peered":"2024-09-13T15:55:43.236754+0000","last_unstale":"2024-09-13T15:55:43.237249+0000","last_undegraded":"2024-09-13T15:55:43.237249+0000","last_fullsized":"2024-09-13T15:55:43.237249+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:24.327721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.226615+0000","last_change":"2024-09-13T15:54:52.952927+0000","last_active":"2024-09-13T15:55:42.226615+0000","last_peered":"2024-09-13T15:55:42.226615+0000","last_clean":"2024-09-13T15:55:42.226615+0000","last_became_active":"2024-09-13T15:54:52.952647+0000","last_became_peered":"2024-09-13T15:54:52.952647+0000","last_unstale":"2024-09-13T15:55:42.226615+0000","last_undegraded":"2024-09-13T15:55:42.226615+0000","last_fullsized":"2024-09-13T15:55:42.226615+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:47.085104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'4","reported_seq":100,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:56:29.395438+0000","last_change":"2024-09-13T15:54:52.502696+0000","last_active":"2024-09-13T15:56:29.395438+0000","last_peered":"2024-09-13T15:56:29.395438+0000","last_clean":"2024-09-13T15:56:29.395438+0000","last_became_active":"2024-09-13T15:54:52.502352+0000","last_became_peered":"2024-09-13T15:54:52.502352+0000","last_unstale":"2024-09-13T15:56:29.395438+0000","last_undegraded":"2024-09-13T15:56:29.395438+0000","last_fullsized":"2024-09-13T15:56:29.395438+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:55.899194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":932,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":79,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:55:44.056139+0000","last_change":"2024-09-13T15:55:44.055693+0000","last_active":"2024-09-13T15:55:44.056139+0000","last_peered":"2024-09-13T15:55:44.056139+0000","last_clean":"2024-09-13T15:55:44.056139+0000","last_became_active":"2024-09-13T15:55:44.055338+0000","last_became_peered":"2024-09-13T15:55:44.055338+0000","last_unstale":"2024-09-13T15:55:44.056139+0000","last_undegraded":"2024-09-13T15:55:44.056139+0000","last_fullsized":"2024-09-13T15:55:44.056139+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:37:50.466488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.227079+0000","last_change":"2024-09-13T15:54:52.950419+0000","last_active":"2024-09-13T15:55:42.227079+0000","last_peered":"2024-09-13T15:55:42.227079+0000","last_clean":"2024-09-13T15:55:42.227079+0000","last_became_active":"2024-09-13T15:54:52.950111+0000","last_became_peered":"2024-09-13T15:54:52.950111+0000","last_unstale":"2024-09-13T15:55:42.227079+0000","last_undegraded":"2024-09-13T15:55:42.227079+0000","last_fullsized":"2024-09-13T15:55:42.227079+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:02:14.424589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221309+0000","last_change":"2024-09-13T15:54:52.520700+0000","last_active":"2024-09-13T15:55:42.221309+0000","last_peered":"2024-09-13T15:55:42.221309+0000","last_clean":"2024-09-13T15:55:42.221309+0000","last_became_active":"2024-09-13T15:54:52.520438+0000","last_became_peered":"2024-09-13T15:54:52.520438+0000","last_unstale":"2024-09-13T15:55:42.221309+0000","last_undegraded":"2024-09-13T15:55:42.221309+0000","last_fullsized":"2024-09-13T15:55:42.221309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:45.740101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223689+0000","last_change":"2024-09-13T15:54:56.971469+0000","last_active":"2024-09-13T15:55:42.223689+0000","last_peered":"2024-09-13T15:55:42.223689+0000","last_clean":"2024-09-13T15:55:42.223689+0000","last_became_active":"2024-09-13T15:54:56.971018+0000","last_became_peered":"2024-09-13T15:54:56.971018+0000","last_unstale":"2024-09-13T15:55:42.223689+0000","last_undegraded":"2024-09-13T15:55:42.223689+0000","last_fullsized":"2024-09-13T15:55:42.223689+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:48.980523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.220801+0000","last_change":"2024-09-13T15:54:52.953776+0000","last_active":"2024-09-13T15:55:42.220801+0000","last_peered":"2024-09-13T15:55:42.220801+0000","last_clean":"2024-09-13T15:55:42.220801+0000","last_became_active":"2024-09-13T15:54:52.950879+0000","last_became_peered":"2024-09-13T15:54:52.950879+0000","last_unstale":"2024-09-13T15:55:42.220801+0000","last_undegraded":"2024-09-13T15:55:42.220801+0000","last_fullsized":"2024-09-13T15:55:42.220801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:15:12.817499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217874+0000","last_change":"2024-09-13T15:54:52.519322+0000","last_active":"2024-09-13T15:55:42.217874+0000","last_peered":"2024-09-13T15:55:42.217874+0000","last_clean":"2024-09-13T15:55:42.217874+0000","last_became_active":"2024-09-13T15:54:52.518751+0000","last_became_peered":"2024-09-13T15:54:52.518751+0000","last_unstale":"2024-09-13T15:55:42.217874+0000","last_undegraded":"2024-09-13T15:55:42.217874+0000","last_fullsized":"2024-09-13T15:55:42.217874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:10.835566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223711+0000","last_change":"2024-09-13T15:54:56.974091+0000","last_active":"2024-09-13T15:55:42.223711+0000","last_peered":"2024-09-13T15:55:42.223711+0000","last_clean":"2024-09-13T15:55:42.223711+0000","last_became_active":"2024-09-13T15:54:56.973717+0000","last_became_peered":"2024-09-13T15:54:56.973717+0000","last_unstale":"2024-09-13T15:55:42.223711+0000","last_undegraded":"2024-09-13T15:55:42.223711+0000","last_fullsized":"2024-09-13T15:55:42.223711+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:17:22.158270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223186+0000","last_change":"2024-09-13T15:54:52.954562+0000","last_active":"2024-09-13T15:55:42.223186+0000","last_peered":"2024-09-13T15:55:42.223186+0000","last_clean":"2024-09-13T15:55:42.223186+0000","last_became_active":"2024-09-13T15:54:52.954228+0000","last_became_peered":"2024-09-13T15:54:52.954228+0000","last_unstale":"2024-09-13T15:55:42.223186+0000","last_undegraded":"2024-09-13T15:55:42.223186+0000","last_fullsized":"2024-09-13T15:55:42.223186+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:57.833958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"92'34","reported_seq":227,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:56:29.299324+0000","last_change":"2024-09-13T15:55:43.233620+0000","last_active":"2024-09-13T15:56:29.299324+0000","last_peered":"2024-09-13T15:56:29.299324+0000","last_clean":"2024-09-13T15:56:29.299324+0000","last_became_active":"2024-09-13T15:55:43.224535+0000","last_became_peered":"2024-09-13T15:55:43.224535+0000","last_unstale":"2024-09-13T15:56:29.299324+0000","last_undegraded":"2024-09-13T15:56:29.299324+0000","last_fullsized":"2024-09-13T15:56:29.299324+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:33.332196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62287,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":152,"num_read_kb":136,"num_write":35,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":60635,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.216966+0000","last_change":"2024-09-13T15:54:56.977311+0000","last_active":"2024-09-13T15:55:42.216966+0000","last_peered":"2024-09-13T15:55:42.216966+0000","last_clean":"2024-09-13T15:55:42.216966+0000","last_became_active":"2024-09-13T15:54:56.972677+0000","last_became_peered":"2024-09-13T15:54:56.972677+0000","last_unstale":"2024-09-13T15:55:42.216966+0000","last_undegraded":"2024-09-13T15:55:42.216966+0000","last_fullsized":"2024-09-13T15:55:42.216966+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:03.162029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223543+0000","last_change":"2024-09-13T15:54:52.952983+0000","last_active":"2024-09-13T15:55:42.223543+0000","last_peered":"2024-09-13T15:55:42.223543+0000","last_clean":"2024-09-13T15:55:42.223543+0000","last_became_active":"2024-09-13T15:54:52.952710+0000","last_became_peered":"2024-09-13T15:54:52.952710+0000","last_unstale":"2024-09-13T15:55:42.223543+0000","last_undegraded":"2024-09-13T15:55:42.223543+0000","last_fullsized":"2024-09-13T15:55:42.223543+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:07.006629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223841+0000","last_change":"2024-09-13T15:54:52.514710+0000","last_active":"2024-09-13T15:55:42.223841+0000","last_peered":"2024-09-13T15:55:42.223841+0000","last_clean":"2024-09-13T15:55:42.223841+0000","last_became_active":"2024-09-13T15:54:52.514377+0000","last_became_peered":"2024-09-13T15:54:52.514377+0000","last_unstale":"2024-09-13T15:55:42.223841+0000","last_undegraded":"2024-09-13T15:55:42.223841+0000","last_fullsized":"2024-09-13T15:55:42.223841+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:07.434722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217665+0000","last_change":"2024-09-13T15:54:56.963704+0000","last_active":"2024-09-13T15:55:42.217665+0000","last_peered":"2024-09-13T15:55:42.217665+0000","last_clean":"2024-09-13T15:55:42.217665+0000","last_became_active":"2024-09-13T15:54:56.963249+0000","last_became_peered":"2024-09-13T15:54:56.963249+0000","last_unstale":"2024-09-13T15:55:42.217665+0000","last_undegraded":"2024-09-13T15:55:42.217665+0000","last_fullsized":"2024-09-13T15:55:42.217665+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:36.983366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.225761+0000","last_change":"2024-09-13T15:54:52.960772+0000","last_active":"2024-09-13T15:55:42.225761+0000","last_peered":"2024-09-13T15:55:42.225761+0000","last_clean":"2024-09-13T15:55:42.225761+0000","last_became_active":"2024-09-13T15:54:52.957092+0000","last_became_peered":"2024-09-13T15:54:52.957092+0000","last_unstale":"2024-09-13T15:55:42.225761+0000","last_undegraded":"2024-09-13T15:55:42.225761+0000","last_fullsized":"2024-09-13T15:55:42.225761+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:02.563773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.227163+0000","last_change":"2024-09-13T15:54:52.507815+0000","last_active":"2024-09-13T15:55:42.227163+0000","last_peered":"2024-09-13T15:55:42.227163+0000","last_clean":"2024-09-13T15:55:42.227163+0000","last_became_active":"2024-09-13T15:54:52.507340+0000","last_became_peered":"2024-09-13T15:54:52.507340+0000","last_unstale":"2024-09-13T15:55:42.227163+0000","last_undegraded":"2024-09-13T15:55:42.227163+0000","last_fullsized":"2024-09-13T15:55:42.227163+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:58.896215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.216899+0000","last_change":"2024-09-13T15:54:56.977240+0000","last_active":"2024-09-13T15:55:42.216899+0000","last_peered":"2024-09-13T15:55:42.216899+0000","last_clean":"2024-09-13T15:55:42.216899+0000","last_became_active":"2024-09-13T15:54:56.976848+0000","last_became_peered":"2024-09-13T15:54:56.976848+0000","last_unstale":"2024-09-13T15:55:42.216899+0000","last_undegraded":"2024-09-13T15:55:42.216899+0000","last_fullsized":"2024-09-13T15:55:42.216899+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:48.223930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223622+0000","last_change":"2024-09-13T15:54:52.956493+0000","last_active":"2024-09-13T15:55:42.223622+0000","last_peered":"2024-09-13T15:55:42.223622+0000","last_clean":"2024-09-13T15:55:42.223622+0000","last_became_active":"2024-09-13T15:54:52.955994+0000","last_became_peered":"2024-09-13T15:54:52.955994+0000","last_unstale":"2024-09-13T15:55:42.223622+0000","last_undegraded":"2024-09-13T15:55:42.223622+0000","last_fullsized":"2024-09-13T15:55:42.223622+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:14.515253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'3","reported_seq":95,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:56:28.367621+0000","last_change":"2024-09-13T15:54:52.507394+0000","last_active":"2024-09-13T15:56:28.367621+0000","last_peered":"2024-09-13T15:56:28.367621+0000","last_clean":"2024-09-13T15:56:28.367621+0000","last_became_active":"2024-09-13T15:54:52.507104+0000","last_became_peered":"2024-09-13T15:54:52.507104+0000","last_unstale":"2024-09-13T15:56:28.367621+0000","last_undegraded":"2024-09-13T15:56:28.367621+0000","last_fullsized":"2024-09-13T15:56:28.367621+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:57.442678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":74,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221747+0000","last_change":"2024-09-13T15:54:56.971867+0000","last_active":"2024-09-13T15:55:42.221747+0000","last_peered":"2024-09-13T15:55:42.221747+0000","last_clean":"2024-09-13T15:55:42.221747+0000","last_became_active":"2024-09-13T15:54:56.970041+0000","last_became_peered":"2024-09-13T15:54:56.970041+0000","last_unstale":"2024-09-13T15:55:42.221747+0000","last_undegraded":"2024-09-13T15:55:42.221747+0000","last_fullsized":"2024-09-13T15:55:42.221747+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:02.478595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.224925+0000","last_change":"2024-09-13T15:54:56.974886+0000","last_active":"2024-09-13T15:55:42.224925+0000","last_peered":"2024-09-13T15:55:42.224925+0000","last_clean":"2024-09-13T15:55:42.224925+0000","last_became_active":"2024-09-13T15:54:56.972879+0000","last_became_peered":"2024-09-13T15:54:56.972879+0000","last_unstale":"2024-09-13T15:55:42.224925+0000","last_undegraded":"2024-09-13T15:55:42.224925+0000","last_fullsized":"2024-09-13T15:55:42.224925+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:59.869941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.216970+0000","last_change":"2024-09-13T15:54:52.956887+0000","last_active":"2024-09-13T15:55:42.216970+0000","last_peered":"2024-09-13T15:55:42.216970+0000","last_clean":"2024-09-13T15:55:42.216970+0000","last_became_active":"2024-09-13T15:54:52.951413+0000","last_became_peered":"2024-09-13T15:54:52.951413+0000","last_unstale":"2024-09-13T15:55:42.216970+0000","last_undegraded":"2024-09-13T15:55:42.216970+0000","last_fullsized":"2024-09-13T15:55:42.216970+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:05.664170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.222088+0000","last_change":"2024-09-13T15:54:52.509235+0000","last_active":"2024-09-13T15:55:42.222088+0000","last_peered":"2024-09-13T15:55:42.222088+0000","last_clean":"2024-09-13T15:55:42.222088+0000","last_became_active":"2024-09-13T15:54:52.508956+0000","last_became_peered":"2024-09-13T15:54:52.508956+0000","last_unstale":"2024-09-13T15:55:42.222088+0000","last_undegraded":"2024-09-13T15:55:42.222088+0000","last_fullsized":"2024-09-13T15:55:42.222088+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:52.884396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:55:43.240640+0000","last_change":"2024-09-13T15:55:43.240640+0000","last_active":"2024-09-13T15:55:43.240640+0000","last_peered":"2024-09-13T15:55:43.240640+0000","last_clean":"2024-09-13T15:55:43.240640+0000","last_became_active":"2024-09-13T15:55:43.240195+0000","last_became_peered":"2024-09-13T15:55:43.240195+0000","last_unstale":"2024-09-13T15:55:43.240640+0000","last_undegraded":"2024-09-13T15:55:43.240640+0000","last_fullsized":"2024-09-13T15:55:43.240640+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:04.991220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,10,0],"acting":[11,4,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221710+0000","last_change":"2024-09-13T15:54:52.956422+0000","last_active":"2024-09-13T15:55:42.221710+0000","last_peered":"2024-09-13T15:55:42.221710+0000","last_clean":"2024-09-13T15:55:42.221710+0000","last_became_active":"2024-09-13T15:54:52.956083+0000","last_became_peered":"2024-09-13T15:54:52.956083+0000","last_unstale":"2024-09-13T15:55:42.221710+0000","last_undegraded":"2024-09-13T15:55:42.221710+0000","last_fullsized":"2024-09-13T15:55:42.221710+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:17.057214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.220725+0000","last_change":"2024-09-13T15:54:52.507204+0000","last_active":"2024-09-13T15:55:42.220725+0000","last_peered":"2024-09-13T15:55:42.220725+0000","last_clean":"2024-09-13T15:55:42.220725+0000","last_became_active":"2024-09-13T15:54:52.506827+0000","last_became_peered":"2024-09-13T15:54:52.506827+0000","last_unstale":"2024-09-13T15:55:42.220725+0000","last_undegraded":"2024-09-13T15:55:42.220725+0000","last_fullsized":"2024-09-13T15:55:42.220725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:03.960238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"90'3","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.220899+0000","last_change":"2024-09-13T15:54:52.511748+0000","last_active":"2024-09-13T15:55:42.220899+0000","last_peered":"2024-09-13T15:55:42.220899+0000","last_clean":"2024-09-13T15:55:42.220899+0000","last_became_active":"2024-09-13T15:54:52.511252+0000","last_became_peered":"2024-09-13T15:54:52.511252+0000","last_unstale":"2024-09-13T15:55:42.220899+0000","last_undegraded":"2024-09-13T15:55:42.220899+0000","last_fullsized":"2024-09-13T15:55:42.220899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:13.141009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221473+0000","last_change":"2024-09-13T15:54:52.961880+0000","last_active":"2024-09-13T15:55:42.221473+0000","last_peered":"2024-09-13T15:55:42.221473+0000","last_clean":"2024-09-13T15:55:42.221473+0000","last_became_active":"2024-09-13T15:54:52.961450+0000","last_became_peered":"2024-09-13T15:54:52.961450+0000","last_unstale":"2024-09-13T15:55:42.221473+0000","last_undegraded":"2024-09-13T15:55:42.221473+0000","last_fullsized":"2024-09-13T15:55:42.221473+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:14.060479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217527+0000","last_change":"2024-09-13T15:54:56.965541+0000","last_active":"2024-09-13T15:55:42.217527+0000","last_peered":"2024-09-13T15:55:42.217527+0000","last_clean":"2024-09-13T15:55:42.217527+0000","last_became_active":"2024-09-13T15:54:56.965185+0000","last_became_peered":"2024-09-13T15:54:56.965185+0000","last_unstale":"2024-09-13T15:55:42.217527+0000","last_undegraded":"2024-09-13T15:55:42.217527+0000","last_fullsized":"2024-09-13T15:55:42.217527+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:38:44.356201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":103,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:56:32.374080+0000","last_change":"2024-09-13T15:54:52.507878+0000","last_active":"2024-09-13T15:56:32.374080+0000","last_peered":"2024-09-13T15:56:32.374080+0000","last_clean":"2024-09-13T15:56:32.374080+0000","last_became_active":"2024-09-13T15:54:52.507564+0000","last_became_peered":"2024-09-13T15:54:52.507564+0000","last_unstale":"2024-09-13T15:56:32.374080+0000","last_undegraded":"2024-09-13T15:56:32.374080+0000","last_fullsized":"2024-09-13T15:56:32.374080+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:55:31.921870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221563+0000","last_change":"2024-09-13T15:54:52.951596+0000","last_active":"2024-09-13T15:55:42.221563+0000","last_peered":"2024-09-13T15:55:42.221563+0000","last_clean":"2024-09-13T15:55:42.221563+0000","last_became_active":"2024-09-13T15:54:52.951202+0000","last_became_peered":"2024-09-13T15:54:52.951202+0000","last_unstale":"2024-09-13T15:55:42.221563+0000","last_undegraded":"2024-09-13T15:55:42.221563+0000","last_fullsized":"2024-09-13T15:55:42.221563+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:04.421318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217640+0000","last_change":"2024-09-13T15:54:56.964449+0000","last_active":"2024-09-13T15:55:42.217640+0000","last_peered":"2024-09-13T15:55:42.217640+0000","last_clean":"2024-09-13T15:55:42.217640+0000","last_became_active":"2024-09-13T15:54:56.964025+0000","last_became_peered":"2024-09-13T15:54:56.964025+0000","last_unstale":"2024-09-13T15:55:42.217640+0000","last_undegraded":"2024-09-13T15:55:42.217640+0000","last_fullsized":"2024-09-13T15:55:42.217640+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:06.337648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223733+0000","last_change":"2024-09-13T15:54:52.953460+0000","last_active":"2024-09-13T15:55:42.223733+0000","last_peered":"2024-09-13T15:55:42.223733+0000","last_clean":"2024-09-13T15:55:42.223733+0000","last_became_active":"2024-09-13T15:54:52.953112+0000","last_became_peered":"2024-09-13T15:54:52.953112+0000","last_unstale":"2024-09-13T15:55:42.223733+0000","last_undegraded":"2024-09-13T15:55:42.223733+0000","last_fullsized":"2024-09-13T15:55:42.223733+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:56.676237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217749+0000","last_change":"2024-09-13T15:54:52.955844+0000","last_active":"2024-09-13T15:55:42.217749+0000","last_peered":"2024-09-13T15:55:42.217749+0000","last_clean":"2024-09-13T15:55:42.217749+0000","last_became_active":"2024-09-13T15:54:52.954217+0000","last_became_peered":"2024-09-13T15:54:52.954217+0000","last_unstale":"2024-09-13T15:55:42.217749+0000","last_undegraded":"2024-09-13T15:55:42.217749+0000","last_fullsized":"2024-09-13T15:55:42.217749+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:21.601680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217403+0000","last_change":"2024-09-13T15:54:52.950686+0000","last_active":"2024-09-13T15:55:42.217403+0000","last_peered":"2024-09-13T15:55:42.217403+0000","last_clean":"2024-09-13T15:55:42.217403+0000","last_became_active":"2024-09-13T15:54:52.950380+0000","last_became_peered":"2024-09-13T15:54:52.950380+0000","last_unstale":"2024-09-13T15:55:42.217403+0000","last_undegraded":"2024-09-13T15:55:42.217403+0000","last_fullsized":"2024-09-13T15:55:42.217403+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:44.181584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.224989+0000","last_change":"2024-09-13T15:54:52.956522+0000","last_active":"2024-09-13T15:55:42.224989+0000","last_peered":"2024-09-13T15:55:42.224989+0000","last_clean":"2024-09-13T15:55:42.224989+0000","last_became_active":"2024-09-13T15:54:52.956243+0000","last_became_peered":"2024-09-13T15:54:52.956243+0000","last_unstale":"2024-09-13T15:55:42.224989+0000","last_undegraded":"2024-09-13T15:55:42.224989+0000","last_fullsized":"2024-09-13T15:55:42.224989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:50.633743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.220979+0000","last_change":"2024-09-13T15:54:52.951515+0000","last_active":"2024-09-13T15:55:42.220979+0000","last_peered":"2024-09-13T15:55:42.220979+0000","last_clean":"2024-09-13T15:55:42.220979+0000","last_became_active":"2024-09-13T15:54:52.951244+0000","last_became_peered":"2024-09-13T15:54:52.951244+0000","last_unstale":"2024-09-13T15:55:42.220979+0000","last_undegraded":"2024-09-13T15:55:42.220979+0000","last_fullsized":"2024-09-13T15:55:42.220979+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:30.834271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.224292+0000","last_change":"2024-09-13T15:54:52.951749+0000","last_active":"2024-09-13T15:55:42.224292+0000","last_peered":"2024-09-13T15:55:42.224292+0000","last_clean":"2024-09-13T15:55:42.224292+0000","last_became_active":"2024-09-13T15:54:52.951451+0000","last_became_peered":"2024-09-13T15:54:52.951451+0000","last_unstale":"2024-09-13T15:55:42.224292+0000","last_undegraded":"2024-09-13T15:55:42.224292+0000","last_fullsized":"2024-09-13T15:55:42.224292+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:32.628282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.218403+0000","last_change":"2024-09-13T15:54:52.947562+0000","last_active":"2024-09-13T15:55:42.218403+0000","last_peered":"2024-09-13T15:55:42.218403+0000","last_clean":"2024-09-13T15:55:42.218403+0000","last_became_active":"2024-09-13T15:54:52.947246+0000","last_became_peered":"2024-09-13T15:54:52.947246+0000","last_unstale":"2024-09-13T15:55:42.218403+0000","last_undegraded":"2024-09-13T15:55:42.218403+0000","last_fullsized":"2024-09-13T15:55:42.218403+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:12.595329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:55:43.237026+0000","last_change":"2024-09-13T15:55:43.237026+0000","last_active":"2024-09-13T15:55:43.237026+0000","last_peered":"2024-09-13T15:55:43.237026+0000","last_clean":"2024-09-13T15:55:43.237026+0000","last_became_active":"2024-09-13T15:55:43.236621+0000","last_became_peered":"2024-09-13T15:55:43.236621+0000","last_unstale":"2024-09-13T15:55:43.237026+0000","last_undegraded":"2024-09-13T15:55:43.237026+0000","last_fullsized":"2024-09-13T15:55:43.237026+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:59.364764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221914+0000","last_change":"2024-09-13T15:54:52.957616+0000","last_active":"2024-09-13T15:55:42.221914+0000","last_peered":"2024-09-13T15:55:42.221914+0000","last_clean":"2024-09-13T15:55:42.221914+0000","last_became_active":"2024-09-13T15:54:52.957290+0000","last_became_peered":"2024-09-13T15:54:52.957290+0000","last_unstale":"2024-09-13T15:55:42.221914+0000","last_undegraded":"2024-09-13T15:55:42.221914+0000","last_fullsized":"2024-09-13T15:55:42.221914+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:40.262838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221810+0000","last_change":"2024-09-13T15:54:52.947816+0000","last_active":"2024-09-13T15:55:42.221810+0000","last_peered":"2024-09-13T15:55:42.221810+0000","last_clean":"2024-09-13T15:55:42.221810+0000","last_became_active":"2024-09-13T15:54:52.947480+0000","last_became_peered":"2024-09-13T15:54:52.947480+0000","last_unstale":"2024-09-13T15:55:42.221810+0000","last_undegraded":"2024-09-13T15:55:42.221810+0000","last_fullsized":"2024-09-13T15:55:42.221810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:23.643741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223297+0000","last_change":"2024-09-13T15:54:52.952203+0000","last_active":"2024-09-13T15:55:42.223297+0000","last_peered":"2024-09-13T15:55:42.223297+0000","last_clean":"2024-09-13T15:55:42.223297+0000","last_became_active":"2024-09-13T15:54:52.951913+0000","last_became_peered":"2024-09-13T15:54:52.951913+0000","last_unstale":"2024-09-13T15:55:42.223297+0000","last_undegraded":"2024-09-13T15:55:42.223297+0000","last_fullsized":"2024-09-13T15:55:42.223297+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:18.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221130+0000","last_change":"2024-09-13T15:54:52.953810+0000","last_active":"2024-09-13T15:55:42.221130+0000","last_peered":"2024-09-13T15:55:42.221130+0000","last_clean":"2024-09-13T15:55:42.221130+0000","last_became_active":"2024-09-13T15:54:52.952774+0000","last_became_peered":"2024-09-13T15:54:52.952774+0000","last_unstale":"2024-09-13T15:55:42.221130+0000","last_undegraded":"2024-09-13T15:55:42.221130+0000","last_fullsized":"2024-09-13T15:55:42.221130+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:37.836176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223781+0000","last_change":"2024-09-13T15:54:52.953545+0000","last_active":"2024-09-13T15:55:42.223781+0000","last_peered":"2024-09-13T15:55:42.223781+0000","last_clean":"2024-09-13T15:55:42.223781+0000","last_became_active":"2024-09-13T15:54:52.953189+0000","last_became_peered":"2024-09-13T15:54:52.953189+0000","last_unstale":"2024-09-13T15:55:42.223781+0000","last_undegraded":"2024-09-13T15:55:42.223781+0000","last_fullsized":"2024-09-13T15:55:42.223781+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:34.130870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.218158+0000","last_change":"2024-09-13T15:54:52.953671+0000","last_active":"2024-09-13T15:55:42.218158+0000","last_peered":"2024-09-13T15:55:42.218158+0000","last_clean":"2024-09-13T15:55:42.218158+0000","last_became_active":"2024-09-13T15:54:52.952550+0000","last_became_peered":"2024-09-13T15:54:52.952550+0000","last_unstale":"2024-09-13T15:55:42.218158+0000","last_undegraded":"2024-09-13T15:55:42.218158+0000","last_fullsized":"2024-09-13T15:55:42.218158+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:48.525059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217963+0000","last_change":"2024-09-13T15:54:52.951561+0000","last_active":"2024-09-13T15:55:42.217963+0000","last_peered":"2024-09-13T15:55:42.217963+0000","last_clean":"2024-09-13T15:55:42.217963+0000","last_became_active":"2024-09-13T15:54:52.951185+0000","last_became_peered":"2024-09-13T15:54:52.951185+0000","last_unstale":"2024-09-13T15:55:42.217963+0000","last_undegraded":"2024-09-13T15:55:42.217963+0000","last_fullsized":"2024-09-13T15:55:42.217963+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:07.698614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223463+0000","last_change":"2024-09-13T15:54:52.965016+0000","last_active":"2024-09-13T15:55:42.223463+0000","last_peered":"2024-09-13T15:55:42.223463+0000","last_clean":"2024-09-13T15:55:42.223463+0000","last_became_active":"2024-09-13T15:54:52.964684+0000","last_became_peered":"2024-09-13T15:54:52.964684+0000","last_unstale":"2024-09-13T15:55:42.223463+0000","last_undegraded":"2024-09-13T15:55:42.223463+0000","last_fullsized":"2024-09-13T15:55:42.223463+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:28.491075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223043+0000","last_change":"2024-09-13T15:54:52.953679+0000","last_active":"2024-09-13T15:55:42.223043+0000","last_peered":"2024-09-13T15:55:42.223043+0000","last_clean":"2024-09-13T15:55:42.223043+0000","last_became_active":"2024-09-13T15:54:52.953409+0000","last_became_peered":"2024-09-13T15:54:52.953409+0000","last_unstale":"2024-09-13T15:55:42.223043+0000","last_undegraded":"2024-09-13T15:55:42.223043+0000","last_fullsized":"2024-09-13T15:55:42.223043+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:53.296327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.224680+0000","last_change":"2024-09-13T15:54:52.962219+0000","last_active":"2024-09-13T15:55:42.224680+0000","last_peered":"2024-09-13T15:55:42.224680+0000","last_clean":"2024-09-13T15:55:42.224680+0000","last_became_active":"2024-09-13T15:54:52.957640+0000","last_became_peered":"2024-09-13T15:54:52.957640+0000","last_unstale":"2024-09-13T15:55:42.224680+0000","last_undegraded":"2024-09-13T15:55:42.224680+0000","last_fullsized":"2024-09-13T15:55:42.224680+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:46.162478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.224736+0000","last_change":"2024-09-13T15:54:52.959852+0000","last_active":"2024-09-13T15:55:42.224736+0000","last_peered":"2024-09-13T15:55:42.224736+0000","last_clean":"2024-09-13T15:55:42.224736+0000","last_became_active":"2024-09-13T15:54:52.959495+0000","last_became_peered":"2024-09-13T15:54:52.959495+0000","last_unstale":"2024-09-13T15:55:42.224736+0000","last_undegraded":"2024-09-13T15:55:42.224736+0000","last_fullsized":"2024-09-13T15:55:42.224736+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:31.035977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221087+0000","last_change":"2024-09-13T15:54:52.954059+0000","last_active":"2024-09-13T15:55:42.221087+0000","last_peered":"2024-09-13T15:55:42.221087+0000","last_clean":"2024-09-13T15:55:42.221087+0000","last_became_active":"2024-09-13T15:54:52.953500+0000","last_became_peered":"2024-09-13T15:54:52.953500+0000","last_unstale":"2024-09-13T15:55:42.221087+0000","last_undegraded":"2024-09-13T15:55:42.221087+0000","last_fullsized":"2024-09-13T15:55:42.221087+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:07.156723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.218032+0000","last_change":"2024-09-13T15:54:52.954236+0000","last_active":"2024-09-13T15:55:42.218032+0000","last_peered":"2024-09-13T15:55:42.218032+0000","last_clean":"2024-09-13T15:55:42.218032+0000","last_became_active":"2024-09-13T15:54:52.951975+0000","last_became_peered":"2024-09-13T15:54:52.951975+0000","last_unstale":"2024-09-13T15:55:42.218032+0000","last_undegraded":"2024-09-13T15:55:42.218032+0000","last_fullsized":"2024-09-13T15:55:42.218032+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:24.261419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.227168+0000","last_change":"2024-09-13T15:54:52.960090+0000","last_active":"2024-09-13T15:55:42.227168+0000","last_peered":"2024-09-13T15:55:42.227168+0000","last_clean":"2024-09-13T15:55:42.227168+0000","last_became_active":"2024-09-13T15:54:52.959804+0000","last_became_peered":"2024-09-13T15:54:52.959804+0000","last_unstale":"2024-09-13T15:55:42.227168+0000","last_undegraded":"2024-09-13T15:55:42.227168+0000","last_fullsized":"2024-09-13T15:55:42.227168+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:27.467154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221722+0000","last_change":"2024-09-13T15:54:52.957541+0000","last_active":"2024-09-13T15:55:42.221722+0000","last_peered":"2024-09-13T15:55:42.221722+0000","last_clean":"2024-09-13T15:55:42.221722+0000","last_became_active":"2024-09-13T15:54:52.957252+0000","last_became_peered":"2024-09-13T15:54:52.957252+0000","last_unstale":"2024-09-13T15:55:42.221722+0000","last_undegraded":"2024-09-13T15:55:42.221722+0000","last_fullsized":"2024-09-13T15:55:42.221722+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.768018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223620+0000","last_change":"2024-09-13T15:54:52.951048+0000","last_active":"2024-09-13T15:55:42.223620+0000","last_peered":"2024-09-13T15:55:42.223620+0000","last_clean":"2024-09-13T15:55:42.223620+0000","last_became_active":"2024-09-13T15:54:52.948798+0000","last_became_peered":"2024-09-13T15:54:52.948798+0000","last_unstale":"2024-09-13T15:55:42.223620+0000","last_undegraded":"2024-09-13T15:55:42.223620+0000","last_fullsized":"2024-09-13T15:55:42.223620+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:48.081213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221621+0000","last_change":"2024-09-13T15:54:52.952456+0000","last_active":"2024-09-13T15:55:42.221621+0000","last_peered":"2024-09-13T15:55:42.221621+0000","last_clean":"2024-09-13T15:55:42.221621+0000","last_became_active":"2024-09-13T15:54:52.951983+0000","last_became_peered":"2024-09-13T15:54:52.951983+0000","last_unstale":"2024-09-13T15:55:42.221621+0000","last_undegraded":"2024-09-13T15:55:42.221621+0000","last_fullsized":"2024-09-13T15:55:42.221621+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:06.748567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.226813+0000","last_change":"2024-09-13T15:54:52.950155+0000","last_active":"2024-09-13T15:55:42.226813+0000","last_peered":"2024-09-13T15:55:42.226813+0000","last_clean":"2024-09-13T15:55:42.226813+0000","last_became_active":"2024-09-13T15:54:52.949758+0000","last_became_peered":"2024-09-13T15:54:52.949758+0000","last_unstale":"2024-09-13T15:55:42.226813+0000","last_undegraded":"2024-09-13T15:55:42.226813+0000","last_fullsized":"2024-09-13T15:55:42.226813+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:49.117434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.220777+0000","last_change":"2024-09-13T15:54:52.953741+0000","last_active":"2024-09-13T15:55:42.220777+0000","last_peered":"2024-09-13T15:55:42.220777+0000","last_clean":"2024-09-13T15:55:42.220777+0000","last_became_active":"2024-09-13T15:54:52.952648+0000","last_became_peered":"2024-09-13T15:54:52.952648+0000","last_unstale":"2024-09-13T15:55:42.220777+0000","last_undegraded":"2024-09-13T15:55:42.220777+0000","last_fullsized":"2024-09-13T15:55:42.220777+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:56:46.640480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.222382+0000","last_change":"2024-09-13T15:54:52.948822+0000","last_active":"2024-09-13T15:55:42.222382+0000","last_peered":"2024-09-13T15:55:42.222382+0000","last_clean":"2024-09-13T15:55:42.222382+0000","last_became_active":"2024-09-13T15:54:52.948528+0000","last_became_peered":"2024-09-13T15:54:52.948528+0000","last_unstale":"2024-09-13T15:55:42.222382+0000","last_undegraded":"2024-09-13T15:55:42.222382+0000","last_fullsized":"2024-09-13T15:55:42.222382+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:28:25.700799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217938+0000","last_change":"2024-09-13T15:54:52.950609+0000","last_active":"2024-09-13T15:55:42.217938+0000","last_peered":"2024-09-13T15:55:42.217938+0000","last_clean":"2024-09-13T15:55:42.217938+0000","last_became_active":"2024-09-13T15:54:52.949481+0000","last_became_peered":"2024-09-13T15:54:52.949481+0000","last_unstale":"2024-09-13T15:55:42.217938+0000","last_undegraded":"2024-09-13T15:55:42.217938+0000","last_fullsized":"2024-09-13T15:55:42.217938+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:59.272557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.224821+0000","last_change":"2024-09-13T15:54:52.950857+0000","last_active":"2024-09-13T15:55:42.224821+0000","last_peered":"2024-09-13T15:55:42.224821+0000","last_clean":"2024-09-13T15:55:42.224821+0000","last_became_active":"2024-09-13T15:54:52.948553+0000","last_became_peered":"2024-09-13T15:54:52.948553+0000","last_unstale":"2024-09-13T15:55:42.224821+0000","last_undegraded":"2024-09-13T15:55:42.224821+0000","last_fullsized":"2024-09-13T15:55:42.224821+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:33.644131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.225013+0000","last_change":"2024-09-13T15:54:52.965573+0000","last_active":"2024-09-13T15:55:42.225013+0000","last_peered":"2024-09-13T15:55:42.225013+0000","last_clean":"2024-09-13T15:55:42.225013+0000","last_became_active":"2024-09-13T15:54:52.961538+0000","last_became_peered":"2024-09-13T15:54:52.961538+0000","last_unstale":"2024-09-13T15:55:42.225013+0000","last_undegraded":"2024-09-13T15:55:42.225013+0000","last_fullsized":"2024-09-13T15:55:42.225013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:12.887939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223440+0000","last_change":"2024-09-13T15:54:52.964064+0000","last_active":"2024-09-13T15:55:42.223440+0000","last_peered":"2024-09-13T15:55:42.223440+0000","last_clean":"2024-09-13T15:55:42.223440+0000","last_became_active":"2024-09-13T15:54:52.963770+0000","last_became_peered":"2024-09-13T15:54:52.963770+0000","last_unstale":"2024-09-13T15:55:42.223440+0000","last_undegraded":"2024-09-13T15:55:42.223440+0000","last_fullsized":"2024-09-13T15:55:42.223440+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:28.967227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66193,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":474,"num_read_kb":305,"num_write":158,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":60747,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":198579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351009,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":1036288,"data_stored":503190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36043205},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.71799999999999997,"15min":0.748},"min":{"1min":0.41799999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79700000000000004,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.44,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78400000000000003,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.53700000000000003}]},{"osd":1,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.501},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.34200000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67200000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.38700000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45500000000000002,"15min":0.45000000000000001},"min":{"1min":0.32500000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.42599999999999999,"15min":0.41799999999999998},"min":{"1min":0.312,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":4,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.40500000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.622},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.753,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60899999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.497,"15min":0.49099999999999999},"min":{"1min":0.36699999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.84899999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.68500000000000005}]},{"osd":6,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.80600000000000005,"15min":0.83999999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.77600000000000002,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97499999999999998,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.66400000000000003,"15min":0.65800000000000003},"min":{"1min":0.496,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89500000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.754},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.51100000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81799999999999995,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.52800000000000002}]},{"osd":8,"last update":"Fri Sep 13 15:55:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.73099999999999998}]},{"osd":9,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.73799999999999999,"15min":0.73299999999999998},"min":{"1min":0.56799999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.006,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.74399999999999999,"15min":0.74099999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.78600000000000003}]},{"osd":10,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66200000000000003,"15min":0.65500000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.87,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.70699999999999996,"15min":0.69899999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.94499999999999995,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.76900000000000002}]}]},{"osd":10,"up_from":73,"seq":313532612645,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28704,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716448,"statfs":{"total":95995035648,"available":95965642752,"internally_reserved":0,"allocated":1720320,"data_stored":1152977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:55:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:55:44 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.501,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.317,"5min":0.254,"15min":0.254},"max":{"1min":0.51800000000000002,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.33400000000000002}]},{"osd":2,"last update":"Fri Sep 13 15:55:44 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.38900000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76700000000000002,"5min":0.872,"15min":0.872},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.82199999999999995,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.60299999999999998}]},{"osd":3,"last update":"Fri Sep 13 15:55:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.65500000000000003,"15min":0.66500000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.499},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47299999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80900000000000005,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.56399999999999995}]},{"osd":4,"last update":"Fri Sep 13 15:55:44 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.52000000000000002,"15min":0.52900000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59099999999999997,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.38},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.55400000000000005,"15min":0.57099999999999995},"min":{"1min":0.30199999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69399999999999995,"5min":0.87,"15min":0.87},"last":0.40300000000000002}]},{"osd":5,"last update":"Fri Sep 13 15:55:44 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.439,"5min":0.379,"15min":0.379},"max":{"1min":0.748,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.626},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.46999999999999997,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.79200000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.52700000000000002}]},{"osd":6,"last update":"Fri Sep 13 15:55:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.745,"15min":0.76000000000000001},"min":{"1min":0.52300000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.82399999999999995,"5min":1.387,"15min":1.387},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.83099999999999996,"5min":1.081,"15min":1.081},"last":0.755}]},{"osd":7,"last update":"Fri Sep 13 15:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.49299999999999999}]},{"osd":8,"last update":"Fri Sep 13 15:55:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80200000000000005,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.72199999999999998,"15min":0.73199999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.81000000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.59099999999999997}]},{"osd":9,"last update":"Fri Sep 13 15:55:44 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.78900000000000003,"15min":0.80900000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.80800000000000005,"5min":1.256,"15min":1.256},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.80200000000000005,"15min":0.82299999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.85999999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.73799999999999999}]},{"osd":11,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.53500000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.81599999999999995,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.84799999999999998,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.77600000000000002}]}]},{"osd":9,"up_from":68,"seq":292057776172,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1048576,"data_stored":507410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:56:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.53400000000000003,"15min":0.55600000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73799999999999999,"5min":1.012,"15min":1.012},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.59799999999999998,"5min":1.044,"15min":1.044},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:56:13 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.73499999999999999,"15min":0.75900000000000001},"min":{"1min":0.48499999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.84399999999999997,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.82299999999999995,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58599999999999997}]},{"osd":2,"last update":"Fri Sep 13 15:56:13 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.78400000000000003,"15min":0.81000000000000005},"min":{"1min":0.53700000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86099999999999999,"5min":1.335,"15min":1.335},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.754,"15min":0.77200000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.84899999999999998,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.60299999999999998}]},{"osd":3,"last update":"Fri Sep 13 15:56:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.71899999999999997,"15min":0.76300000000000001},"min":{"1min":0.41499999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83499999999999996,"5min":1.089,"15min":1.089},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.70599999999999996,"15min":0.75900000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80900000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.37}]},{"osd":4,"last update":"Fri Sep 13 15:56:13 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.68000000000000005,"15min":0.70199999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83099999999999996,"5min":1.071,"15min":1.071},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.79700000000000004,"15min":0.83299999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.90500000000000003,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:56:13 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.84799999999999998,"15min":0.89000000000000001},"min":{"1min":0.59399999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96099999999999997,"5min":1.353,"15min":1.353},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.84999999999999998,"15min":0.88600000000000001},"min":{"1min":0.51400000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93400000000000005,"5min":1.264,"15min":1.264},"last":0.95299999999999996}]},{"osd":6,"last update":"Fri Sep 13 15:54:12 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.0349999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:56:13 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.91400000000000003,"15min":0.97399999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.90700000000000003,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.88600000000000001,"15min":0.93300000000000005},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0309999999999999,"5min":1.325,"15min":1.325},"last":0.65600000000000003}]},{"osd":8,"last update":"Fri Sep 13 15:56:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.93200000000000005,"15min":0.97899999999999998},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.0029999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.81399999999999995,"15min":0.85299999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.86799999999999999,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.66600000000000004}]},{"osd":10,"last update":"Fri Sep 13 15:55:36 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.94199999999999995,"15min":0.96399999999999997},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.2290000000000001,"5min":1.298,"15min":1.298},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.93799999999999994,"15min":0.95799999999999996},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.306,"5min":1.363,"15min":1.363},"last":0.92200000000000004}]},{"osd":11,"last update":"Fri Sep 13 15:55:57 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.627}]}]},{"osd":8,"up_from":60,"seq":257698037809,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":502791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:55:46 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39700000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81599999999999995,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.58099999999999996,"15min":0.59499999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75800000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.55700000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:55:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51500000000000001,"15min":0.497},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79100000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.5},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78500000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.52600000000000002}]},{"osd":2,"last update":"Fri Sep 13 15:55:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.39300000000000002,"15min":0.38700000000000001},"min":{"1min":0.30599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.53000000000000003,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.38},"min":{"1min":0.25800000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.33100000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:55:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.60599999999999998,"15min":0.61799999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77600000000000002,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.62,"15min":0.622},"min":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77800000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.54100000000000004}]},{"osd":4,"last update":"Fri Sep 13 15:55:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.53600000000000003,"15min":0.52900000000000003},"min":{"1min":0.433,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.53700000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.71999999999999997}]},{"osd":5,"last update":"Fri Sep 13 15:55:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.46899999999999997,"15min":0.45100000000000001},"min":{"1min":0.372,"5min":0.307,"15min":0.307},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.46700000000000003,"15min":0.45600000000000002},"min":{"1min":0.35899999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.40699999999999997}]},{"osd":6,"last update":"Fri Sep 13 15:55:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.51600000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.875,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68300000000000005,"15min":0.67700000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Sep 13 15:55:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.61799999999999999,"15min":0.60199999999999998},"min":{"1min":0.40899999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.48499999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.51400000000000001}]},{"osd":9,"last update":"Fri Sep 13 15:56:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.748,"15min":0.71399999999999997},"min":{"1min":0.55500000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":5.8890000000000002,"5min":5.8890000000000002,"15min":5.8890000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.77100000000000002,"15min":0.73299999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":5.9020000000000001,"5min":5.9020000000000001,"15min":5.9020000000000001},"last":0.745}]},{"osd":10,"last update":"Fri Sep 13 15:55:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.68500000000000005,"15min":0.67300000000000004},"min":{"1min":0.58099999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.67300000000000004,"15min":0.66200000000000003},"min":{"1min":0.54900000000000004,"5min":0.439,"15min":0.439},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.59799999999999998}]},{"osd":11,"last update":"Fri Sep 13 15:55:54 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.66300000000000003}]}]},{"osd":7,"up_from":52,"seq":223338299445,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36808,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708344,"statfs":{"total":95995035648,"available":95957344256,"internally_reserved":0,"allocated":1634304,"data_stored":1098717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36043211},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80700000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79400000000000004,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.39600000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:56:25 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38700000000000001,"15min":0.38300000000000001},"min":{"1min":0.312,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.50800000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.38500000000000001},"min":{"1min":0.27500000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.59699999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.61899999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:56:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54900000000000004,"15min":0.53600000000000003},"min":{"1min":0.36299999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69199999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.71499999999999997}]},{"osd":3,"last update":"Fri Sep 13 15:56:25 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.44500000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76600000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.44900000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:56:25 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.44600000000000001,"15min":0.44500000000000001},"min":{"1min":0.33100000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54100000000000004,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45900000000000002,"15min":0.47499999999999998},"min":{"1min":0.29699999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Sep 13 15:56:25 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.58899999999999997,"15min":0.57599999999999996},"min":{"1min":0.46500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.745,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.40899999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.64800000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.75900000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:56:25 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64700000000000002,"15min":0.66400000000000003},"min":{"1min":0.44500000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.84099999999999997,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.53500000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80600000000000005,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.81799999999999995}]},{"osd":8,"last update":"Fri Sep 13 15:55:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.434,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77600000000000002,"5min":0.878,"15min":0.878},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.48499999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93899999999999995,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.78200000000000003}]},{"osd":9,"last update":"Fri Sep 13 15:56:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.56899999999999995,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92600000000000005,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70299999999999996,"15min":0.71099999999999997},"min":{"1min":0.56299999999999994,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.88800000000000001,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.68500000000000005}]},{"osd":10,"last update":"Fri Sep 13 15:55:35 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.66000000000000003,"15min":0.66600000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89100000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.83399999999999996}]},{"osd":11,"last update":"Fri Sep 13 15:55:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.873}]}]},{"osd":6,"up_from":47,"seq":201863462972,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":1024000,"data_stored":498490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36043207},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.505,"15min":0.5},"min":{"1min":0.315,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.501,"5min":0.52200000000000002,"15min":0.54100000000000004},"min":{"1min":0.33500000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.85899999999999999,"5min":1.008,"15min":1.008},"last":0.67800000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65600000000000003,"15min":0.67100000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.97699999999999998,"5min":1.113,"15min":1.113},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.86799999999999999,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.84399999999999997}]},{"osd":2,"last update":"Fri Sep 13 15:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.50700000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88300000000000001,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.72199999999999998,"15min":0.72699999999999998},"min":{"1min":0.45400000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94499999999999995,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65100000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.64900000000000002,"15min":0.66500000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0169999999999999,"5min":1.121,"15min":1.121},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.66100000000000003,"15min":0.67200000000000004},"min":{"1min":0.499,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63100000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68600000000000005,"15min":0.72199999999999998},"min":{"1min":0.47499999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.82599999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.753,"15min":0.751},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.056,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.80300000000000005}]},{"osd":5,"last update":"Fri Sep 13 15:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.53000000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.88200000000000001,"5min":1.032,"15min":1.032},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.76100000000000001,"15min":0.79900000000000004},"min":{"1min":0.53600000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92600000000000005,"5min":1.236,"15min":1.236},"last":0.82299999999999995}]},{"osd":7,"last update":"Fri Sep 13 15:56:19 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.57899999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.91200000000000003,"5min":1.056,"15min":1.056},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78700000000000003,"15min":0.76700000000000002},"min":{"1min":0.60399999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.0329999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.875}]},{"osd":8,"last update":"Fri Sep 13 15:55:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.83799999999999997,"15min":0.86099999999999999},"min":{"1min":0.61599999999999999,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.077,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.81699999999999995,"15min":0.82699999999999996},"min":{"1min":0.60499999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.81499999999999995}]},{"osd":9,"last update":"Fri Sep 13 15:56:13 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.874,"15min":0.91200000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.98599999999999999,"5min":1.222,"15min":1.222},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.872,"15min":0.89200000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96999999999999997,"5min":1.3,"15min":1.3},"last":0.86499999999999999}]},{"osd":10,"last update":"Fri Sep 13 15:55:39 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.68600000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.91000000000000003,"15min":0.91200000000000003},"min":{"1min":0.69299999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.95299999999999996}]},{"osd":11,"last update":"Fri Sep 13 15:55:56 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":1.022},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.92300000000000004}]}]},{"osd":5,"up_from":39,"seq":167503724608,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1646592,"data_stored":1094292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:55:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.56100000000000005,"15min":0.54700000000000004},"min":{"1min":0.38600000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.78500000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65000000000000002,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.34499999999999997}]},{"osd":1,"last update":"Fri Sep 13 15:55:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.503,"15min":0.49199999999999999},"min":{"1min":0.36399999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.51400000000000001,"15min":0.49199999999999999},"min":{"1min":0.34899999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.497}]},{"osd":2,"last update":"Fri Sep 13 15:55:32 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.378,"15min":0.37},"min":{"1min":0.28299999999999997,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.25,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60199999999999998,"5min":0.749,"15min":0.749},"last":0.434}]},{"osd":3,"last update":"Fri Sep 13 15:55:32 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.56699999999999995,"15min":0.58599999999999997},"min":{"1min":0.372,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80700000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.433,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.70099999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri Sep 13 15:55:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.53800000000000003},"min":{"1min":0.45600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75900000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54700000000000004,"15min":0.53100000000000003},"min":{"1min":0.42099999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.47499999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:55:58 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.62,"15min":0.60499999999999998},"min":{"1min":0.46300000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81599999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.624},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.47499999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84499999999999997,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.59099999999999997}]},{"osd":7,"last update":"Fri Sep 13 15:56:20 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.60099999999999998,"15min":0.57599999999999996},"min":{"1min":0.48799999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85899999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.58699999999999997,"15min":0.56899999999999995},"min":{"1min":0.45800000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.55800000000000005}]},{"osd":8,"last update":"Fri Sep 13 15:55:44 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51700000000000002,"15min":0.53000000000000003},"min":{"1min":0.35299999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73299999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57799999999999996,"15min":0.59799999999999998},"min":{"1min":0.32300000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.80000000000000004,"5min":1.024,"15min":1.024},"last":0.57799999999999996}]},{"osd":9,"last update":"Fri Sep 13 15:56:16 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68899999999999995,"15min":0.69499999999999995},"min":{"1min":0.54100000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.83399999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.58799999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.80300000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.56799999999999995}]},{"osd":10,"last update":"Fri Sep 13 15:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.64100000000000001,"15min":0.63},"min":{"1min":0.49099999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.62,"15min":0.60399999999999998},"min":{"1min":0.495,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.63900000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888132,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1110016,"data_stored":565771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:54:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.55000000000000004,"15min":0.53300000000000003},"min":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.83199999999999996,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.41299999999999998}]},{"osd":1,"last update":"Fri Sep 13 15:56:11 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.377,"15min":0.35299999999999998},"min":{"1min":0.27800000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.50800000000000001,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.379,"15min":0.35999999999999999},"min":{"1min":0.31,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52700000000000002,"5min":0.629,"15min":0.629},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:56:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53300000000000003,"15min":0.51100000000000001},"min":{"1min":0.39300000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.77600000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.52400000000000002},"min":{"1min":0.44400000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.65000000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.64200000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:56:11 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.56200000000000006},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.79600000000000004,"5min":0.878,"15min":0.878},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60999999999999999,"15min":0.56299999999999994},"min":{"1min":0.38100000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79300000000000004,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":0.47999999999999998}]},{"osd":5,"last update":"Fri Sep 13 15:56:28 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60599999999999998,"15min":0.57899999999999996},"min":{"1min":0.432,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83999999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60899999999999999,"15min":0.57299999999999995},"min":{"1min":0.45700000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79300000000000004,"5min":0.995,"15min":0.995},"last":0.68700000000000006}]},{"osd":6,"last update":"Fri Sep 13 15:55:57 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.627,"15min":0.61699999999999999},"min":{"1min":0.44700000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80800000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.627},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63600000000000001,"15min":0.63200000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86399999999999999,"5min":0.873,"15min":0.873},"last":0.42699999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:56:22 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.34399999999999997,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77400000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.51700000000000002},"min":{"1min":0.372,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84099999999999997,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.495}]},{"osd":8,"last update":"Fri Sep 13 15:55:44 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.621,"15min":0.61299999999999999},"min":{"1min":0.46899999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88800000000000001,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.61799999999999999,"15min":0.60199999999999998},"min":{"1min":0.52400000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.85999999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.67300000000000004}]},{"osd":9,"last update":"Fri Sep 13 15:56:15 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.72099999999999997},"min":{"1min":0.55400000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94799999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71299999999999997,"15min":0.72099999999999997},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91500000000000004,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.59499999999999997}]},{"osd":10,"last update":"Fri Sep 13 15:55:36 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.86199999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.68100000000000005,"15min":0.68700000000000006},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.71699999999999997}]},{"osd":11,"last update":"Fri Sep 13 15:55:51 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.74299999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149770,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":1032192,"data_stored":498403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:55:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.48699999999999999,"15min":0.42499999999999999},"min":{"1min":0.31900000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":3.8069999999999999,"5min":3.8069999999999999,"15min":3.8069999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.49399999999999999,"15min":0.438},"min":{"1min":0.30399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":4.0590000000000002,"5min":4.0590000000000002,"15min":4.0590000000000002},"last":0.40899999999999997}]},{"osd":1,"last update":"Fri Sep 13 15:55:49 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.69399999999999995,"15min":0.61699999999999999},"min":{"1min":0.55000000000000004,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.7330000000000001,"5min":3.7330000000000001,"15min":3.7330000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.68600000000000005,"15min":0.61399999999999999},"min":{"1min":0.46500000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":3.8820000000000001,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":0.76400000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:55:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65700000000000003,"15min":0.621},"min":{"1min":0.45800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.70199999999999996,"15min":0.67200000000000004},"min":{"1min":0.42299999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":3.6560000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":0.60499999999999998}]},{"osd":4,"last update":"Fri Sep 13 15:56:09 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.72399999999999998,"15min":0.65700000000000003},"min":{"1min":0.497,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.79,"5min":3.79,"15min":3.79},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.68000000000000005,"15min":0.63300000000000001},"min":{"1min":0.504,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1879999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.80600000000000005}]},{"osd":5,"last update":"Fri Sep 13 15:56:30 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.74299999999999999,"15min":0.66800000000000004},"min":{"1min":0.51100000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":3.6989999999999998,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.70499999999999996,"15min":0.64700000000000002},"min":{"1min":0.54700000000000004,"5min":0.436,"15min":0.436},"max":{"1min":3.9470000000000001,"5min":3.9470000000000001,"15min":3.9470000000000001},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Sep 13 15:55:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.69099999999999995,"15min":0.64700000000000002},"min":{"1min":0.47799999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":4.0910000000000002,"5min":4.0910000000000002,"15min":4.0910000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.745,"15min":0.72299999999999998},"min":{"1min":0.54200000000000004,"5min":0.374,"15min":0.374},"max":{"1min":3.5249999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri Sep 13 15:56:26 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":0.84899999999999998,"15min":0.79500000000000004},"min":{"1min":0.56599999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":3.762,"5min":3.762,"15min":3.762},"last":0.871},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.77200000000000002,"15min":0.72999999999999998},"min":{"1min":0.53600000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":3.847,"5min":3.847,"15min":3.847},"last":0.79100000000000004}]},{"osd":8,"last update":"Fri Sep 13 15:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.75600000000000001,"15min":0.753},"min":{"1min":0.54700000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.044,"5min":1.079,"15min":1.079},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.61699999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1899999999999999,"5min":1.466,"15min":1.466},"last":0.627}]},{"osd":9,"last update":"Fri Sep 13 15:56:18 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":0.84499999999999997,"15min":0.82099999999999995},"min":{"1min":0.56999999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":4.1219999999999999,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.02,"5min":0.91400000000000003,"15min":0.90400000000000003},"min":{"1min":0.625,"5min":0.495,"15min":0.495},"max":{"1min":3.5699999999999998,"5min":3.5699999999999998,"15min":3.5699999999999998},"last":0.91000000000000003}]},{"osd":10,"last update":"Fri Sep 13 15:55:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.95599999999999996,"15min":0.93899999999999995},"min":{"1min":0.75800000000000001,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":3.8210000000000002,"5min":3.8210000000000002,"15min":3.8210000000000002},"last":0.748},{"interface":"front","average":{"1min":0.995,"5min":0.81299999999999994,"15min":0.78300000000000003},"min":{"1min":0.60899999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":3.9140000000000001,"5min":3.9140000000000001,"15min":3.9140000000000001},"last":0.84099999999999997}]},{"osd":11,"last update":"Fri Sep 13 15:55:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":3.9769999999999999,"5min":3.9769999999999999,"15min":3.9769999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":4.0270000000000001,"5min":4.0270000000000001,"15min":4.0270000000000001},"last":0.77800000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":499702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:56:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55500000000000005,"15min":0.52700000000000002},"min":{"1min":0.373,"5min":0.30499999999999999,"15min":0.29799999999999999},"max":{"1min":0.82199999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53600000000000003,"15min":0.51400000000000001},"min":{"1min":0.35599999999999998,"5min":0.34499999999999997,"15min":0.26900000000000002},"max":{"1min":0.68999999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.39500000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:56:23 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.53300000000000003,"15min":0.48099999999999998},"min":{"1min":0.40600000000000003,"5min":0.29499999999999998,"15min":0.23899999999999999},"max":{"1min":0.73999999999999999,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.53600000000000003,"15min":0.498},"min":{"1min":0.38200000000000001,"5min":0.32800000000000001,"15min":0.249},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.55100000000000005}]},{"osd":3,"last update":"Fri Sep 13 15:55:48 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.57199999999999995,"15min":0.55200000000000005},"min":{"1min":0.35799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.374,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.56799999999999995}]},{"osd":4,"last update":"Fri Sep 13 15:55:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Sep 13 15:56:32 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41499999999999998,"15min":0.40799999999999997},"min":{"1min":0.34899999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.63500000000000001,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.38},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.436,"15min":0.41399999999999998},"min":{"1min":0.32100000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.70099999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.51400000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.62,"15min":0.59399999999999997},"min":{"1min":0.44600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.626,"15min":0.61499999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.71799999999999997}]},{"osd":8,"last update":"Fri Sep 13 15:55:48 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52600000000000002,"15min":0.52100000000000002},"min":{"1min":0.33200000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.57499999999999996,"15min":0.56100000000000005},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.65000000000000002}]},{"osd":9,"last update":"Fri Sep 13 15:56:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66400000000000003,"15min":0.65300000000000002},"min":{"1min":0.51900000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.626},{"interface":"front","average":{"1min":0.755,"5min":0.70199999999999996,"15min":0.69399999999999995},"min":{"1min":0.52200000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.66500000000000004}]},{"osd":10,"last update":"Fri Sep 13 15:55:39 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.63200000000000001,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.65600000000000003,"15min":0.64200000000000002},"min":{"1min":0.46800000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.79600000000000004}]},{"osd":11,"last update":"Fri Sep 13 15:55:54 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.72699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":560414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:56:01 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.55800000000000005,"15min":0.496},"min":{"1min":0.42699999999999999,"5min":0.317,"15min":0.253},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.56999999999999995,"15min":0.51500000000000001},"min":{"1min":0.40699999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.81499999999999995,"5min":1.2,"15min":1.2},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Sep 13 15:55:28 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.56699999999999995,"15min":0.51300000000000001},"min":{"1min":0.34300000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":5.1790000000000003,"5min":5.1790000000000003,"15min":5.1790000000000003},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.503,"15min":0.47699999999999998},"min":{"1min":0.38200000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.80400000000000005}]},{"osd":3,"last update":"Fri Sep 13 15:55:45 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56899999999999995,"15min":0.53500000000000003},"min":{"1min":0.40000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.96199999999999997,"5min":1.087,"15min":1.087},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53600000000000003,"15min":0.52000000000000002},"min":{"1min":0.34300000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Sep 13 15:56:06 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.42599999999999999,"15min":0.378},"min":{"1min":0.33000000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.71799999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.442,"15min":0.39800000000000002},"min":{"1min":0.33900000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.58899999999999997}]},{"osd":5,"last update":"Fri Sep 13 15:55:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.58999999999999997,"15min":0.54100000000000004},"min":{"1min":0.46800000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.63700000000000001,"15min":0.55500000000000005},"min":{"1min":0.495,"5min":0.374,"15min":0.374},"max":{"1min":5.194,"5min":5.194,"15min":5.194},"last":0.85699999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:56:01 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.63900000000000001,"15min":0.61499999999999999},"min":{"1min":0.504,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92800000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67300000000000004,"15min":0.64900000000000002},"min":{"1min":0.56000000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0349999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Fri Sep 13 15:55:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.52700000000000002,"15min":0.50800000000000001},"min":{"1min":0.35599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.57699999999999996,"15min":0.55400000000000005},"min":{"1min":0.433,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91200000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.84499999999999997}]},{"osd":8,"last update":"Fri Sep 13 15:55:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.69599999999999995,"15min":0.64000000000000001},"min":{"1min":0.55100000000000005,"5min":0.372,"15min":0.372},"max":{"1min":1.0169999999999999,"5min":5.2149999999999999,"15min":5.2149999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.40999999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85799999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.69699999999999995}]},{"osd":9,"last update":"Fri Sep 13 15:56:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.58299999999999996,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.04,"5min":1.111,"15min":1.111},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.76900000000000002,"15min":0.76500000000000001},"min":{"1min":0.59599999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0209999999999999,"5min":1.325,"15min":1.325},"last":0.89900000000000002}]},{"osd":10,"last update":"Fri Sep 13 15:55:36 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.68799999999999994,"15min":0.68000000000000005},"min":{"1min":0.46000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97899999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.88800000000000001}]},{"osd":11,"last update":"Fri Sep 13 15:55:55 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.876},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.91500000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":499878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65000000000000002,"15min":0.61199999999999999},"min":{"1min":0.503,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.96899999999999997,"5min":1.304,"15min":1.6870000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.67700000000000005,"15min":0.60299999999999998},"min":{"1min":0.52100000000000002,"5min":0.41399999999999998,"15min":0.41299999999999998},"max":{"1min":0.93799999999999994,"5min":1.081,"15min":1.081},"last":0.89500000000000002}]},{"osd":2,"last update":"Fri Sep 13 15:56:21 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68300000000000005,"15min":0.61399999999999999},"min":{"1min":0.45300000000000001,"5min":0.40100000000000002,"15min":0.37},"max":{"1min":0.93500000000000005,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70699999999999996,"15min":0.63100000000000001},"min":{"1min":0.42999999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86799999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":1.0820000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:55:53 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.98399999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:56:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67700000000000005,"15min":0.58199999999999996},"min":{"1min":0.499,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92400000000000004,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.63900000000000001,"15min":0.57699999999999996},"min":{"1min":0.47399999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93899999999999995,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri Sep 13 15:55:39 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.64500000000000002},"min":{"1min":0.46000000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.88600000000000001,"5min":1.018,"15min":1.018},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.70599999999999996,"15min":0.67000000000000004},"min":{"1min":0.52700000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95699999999999996,"5min":1.167,"15min":1.167},"last":1.0609999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.627,"15min":0.64700000000000002},"min":{"1min":0.36299999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90100000000000002,"5min":1.151,"15min":1.151},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47399999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.91200000000000003,"5min":1.125,"15min":1.125},"last":0.54900000000000004}]},{"osd":7,"last update":"Fri Sep 13 15:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.94799999999999995}]},{"osd":8,"last update":"Fri Sep 13 15:55:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.60199999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.997,"5min":1.224,"15min":1.224},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.81200000000000006,"15min":0.81799999999999995},"min":{"1min":0.56399999999999995,"5min":0.438,"15min":0.438},"max":{"1min":1.111,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.88}]},{"osd":9,"last update":"Fri Sep 13 15:56:13 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.86199999999999999,"15min":0.89000000000000001},"min":{"1min":0.55500000000000005,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0940000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90500000000000003,"15min":0.93899999999999995},"min":{"1min":0.50700000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1619999999999999,"5min":1.419,"15min":1.419},"last":0.83799999999999997}]},{"osd":10,"last update":"Fri Sep 13 15:55:39 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.94099999999999995,"15min":0.94899999999999995},"min":{"1min":0.59899999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.109,"5min":1.391,"15min":1.391},"last":1.034},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.89700000000000002,"15min":0.90800000000000003},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.159,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.64100000000000001}]},{"osd":11,"last update":"Fri Sep 13 15:56:02 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.87,"15min":0.871},"min":{"1min":0.748,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.054,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":1.004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.90000000000000002,"15min":0.90800000000000003},"min":{"1min":0.60499999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.82299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":64209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:56:36.413 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T15:56:36.742 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:56:37.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:37 smithi193 ceph-mon[35248]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T15:56:37.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:37 smithi193 ceph-mon[35248]: pgmap v349: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:37.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:37 smithi017 ceph-mon[30494]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T15:56:37.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:37 smithi017 ceph-mon[30494]: pgmap v349: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:37.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:37 smithi189 ceph-mon[34790]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T15:56:37.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:37 smithi189 ceph-mon[34790]: pgmap v349: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:38.367 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:38 smithi017 ceph-mon[30494]: pgmap v350: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:38.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:38 smithi193 ceph-mon[35248]: pgmap v350: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:38.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:38 smithi189 ceph-mon[34790]: pgmap v350: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:38.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.760+0000 7f3768e00640 1 -- 172.21.15.17:0/2596481853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3764102bb0 msgr2=0x7f3764106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:38.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.760+0000 7f3768e00640 1 --2- 172.21.15.17:0/2596481853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3764102bb0 0x7f3764106c00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f374c009930 tx=0x7f374c02a420 comp rx=0 tx=0).stop 2024-09-13T15:56:38.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.761+0000 7f3768e00640 1 -- 172.21.15.17:0/2596481853 shutdown_connections 2024-09-13T15:56:38.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.761+0000 7f3768e00640 1 --2- 172.21.15.17:0/2596481853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3764107330 0x7f376410eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:38.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.761+0000 7f3768e00640 1 --2- 172.21.15.17:0/2596481853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3764102bb0 0x7f3764106c00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:38.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.761+0000 7f3768e00640 1 --2- 172.21.15.17:0/2596481853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3764102200 0x7f37641025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:38.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.761+0000 7f3768e00640 1 -- 172.21.15.17:0/2596481853 >> 172.21.15.17:0/2596481853 conn(0x7f37640fdc60 msgr2=0x7f3764100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:38.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.761+0000 7f3768e00640 1 -- 172.21.15.17:0/2596481853 shutdown_connections 2024-09-13T15:56:38.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.761+0000 7f3768e00640 1 -- 172.21.15.17:0/2596481853 wait complete. 2024-09-13T15:56:38.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.762+0000 7f3768e00640 1 Processor -- start 2024-09-13T15:56:38.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.762+0000 7f3768e00640 1 -- start start 2024-09-13T15:56:38.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.762+0000 7f3768e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3764102200 0x7f3764198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:38.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.762+0000 7f3768e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3764102bb0 0x7f3764198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:38.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.762+0000 7f3768e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3764107330 0x7f376419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:38.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.762+0000 7f3768e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376419d460 con 0x7f3764107330 2024-09-13T15:56:38.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.762+0000 7f3768e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376419d5d0 con 0x7f3764102bb0 2024-09-13T15:56:38.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.762+0000 7f3768e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376419d740 con 0x7f3764102200 2024-09-13T15:56:38.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.763+0000 7f3761e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3764102200 0x7f3764198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:38.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.763+0000 7f3761e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3764102200 0x7f3764198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:37644/0 (socket says 172.21.15.17:37644) 2024-09-13T15:56:38.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.763+0000 7f3761e00640 1 -- 172.21.15.17:0/1809911965 learned_addr learned my addr 172.21.15.17:0/1809911965 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:38.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.763+0000 7f3762800640 1 --2- 172.21.15.17:0/1809911965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3764107330 0x7f376419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:38.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.763+0000 7f3759400640 1 --2- 172.21.15.17:0/1809911965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3764102bb0 0x7f3764198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:38.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.763+0000 7f3761e00640 1 -- 172.21.15.17:0/1809911965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3764102bb0 msgr2=0x7f3764198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:38.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.763+0000 7f3761e00640 1 --2- 172.21.15.17:0/1809911965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3764102bb0 0x7f3764198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:38.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.763+0000 7f3761e00640 1 -- 172.21.15.17:0/1809911965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3764107330 msgr2=0x7f376419ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:38.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.763+0000 7f3761e00640 1 --2- 172.21.15.17:0/1809911965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3764107330 0x7f376419ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:38.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.763+0000 7f3761e00640 1 -- 172.21.15.17:0/1809911965 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c009560 con 0x7f3764102200 2024-09-13T15:56:38.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.763+0000 7f3759400640 1 --2- 172.21.15.17:0/1809911965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3764102bb0 0x7f3764198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:38.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.763+0000 7f3762800640 1 --2- 172.21.15.17:0/1809911965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3764107330 0x7f376419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:38.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.763+0000 7f3761e00640 1 --2- 172.21.15.17:0/1809911965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3764102200 0x7f3764198520 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f375400eb90 tx=0x7f375400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:38.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.764+0000 7f375b400640 1 -- 172.21.15.17:0/1809911965 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37540099b0 con 0x7f3764102200 2024-09-13T15:56:38.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.764+0000 7f375b400640 1 -- 172.21.15.17:0/1809911965 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f375400ee90 con 0x7f3764102200 2024-09-13T15:56:38.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.764+0000 7f375b400640 1 -- 172.21.15.17:0/1809911965 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3754010670 con 0x7f3764102200 2024-09-13T15:56:38.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.764+0000 7f3768e00640 1 -- 172.21.15.17:0/1809911965 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376419da20 con 0x7f3764102200 2024-09-13T15:56:38.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.764+0000 7f3768e00640 1 -- 172.21.15.17:0/1809911965 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376419dcd0 con 0x7f3764102200 2024-09-13T15:56:38.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.765+0000 7f3768e00640 1 -- 172.21.15.17:0/1809911965 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37641036e0 con 0x7f3764102200 2024-09-13T15:56:38.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.767+0000 7f375b400640 1 -- 172.21.15.17:0/1809911965 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f3754004f20 con 0x7f3764102200 2024-09-13T15:56:38.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.768+0000 7f375b400640 1 --2- 172.21.15.17:0/1809911965 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f37480a1190 0x7f37480a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:38.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.768+0000 7f375b400640 1 -- 172.21.15.17:0/1809911965 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f3754014070 con 0x7f3764102200 2024-09-13T15:56:38.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.769+0000 7f3759400640 1 --2- 172.21.15.17:0/1809911965 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f37480a1190 0x7f37480a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:38.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.769+0000 7f3759400640 1 --2- 172.21.15.17:0/1809911965 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f37480a1190 0x7f37480a3650 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f374c031440 tx=0x7f374c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:38.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.770+0000 7f375b400640 1 -- 172.21.15.17:0/1809911965 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f37540966a0 con 0x7f3764102200 2024-09-13T15:56:38.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.948+0000 7f3768e00640 1 -- 172.21.15.17:0/1809911965 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f376419dcd0 con 0x7f37480a1190 2024-09-13T15:56:38.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.963+0000 7f375b400640 1 -- 172.21.15.17:0/1809911965 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427862 (secure 0 0 0) 0x7f376419dcd0 con 0x7f37480a1190 2024-09-13T15:56:38.970 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:56:38.972 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-13T15:56:38.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.968+0000 7f3768e00640 1 -- 172.21.15.17:0/1809911965 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f37480a1190 msgr2=0x7f37480a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:38.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.968+0000 7f3768e00640 1 --2- 172.21.15.17:0/1809911965 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f37480a1190 0x7f37480a3650 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f374c031440 tx=0x7f374c005a20 comp rx=0 tx=0).stop 2024-09-13T15:56:38.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.968+0000 7f3768e00640 1 -- 172.21.15.17:0/1809911965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3764102200 msgr2=0x7f3764198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:38.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.968+0000 7f3768e00640 1 --2- 172.21.15.17:0/1809911965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3764102200 0x7f3764198520 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f375400eb90 tx=0x7f375400c6a0 comp rx=0 tx=0).stop 2024-09-13T15:56:38.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.968+0000 7f3768e00640 1 -- 172.21.15.17:0/1809911965 shutdown_connections 2024-09-13T15:56:38.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.968+0000 7f3768e00640 1 --2- 172.21.15.17:0/1809911965 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f37480a1190 0x7f37480a3650 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:38.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.968+0000 7f3768e00640 1 --2- 172.21.15.17:0/1809911965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3764107330 0x7f376419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:38.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.968+0000 7f3768e00640 1 --2- 172.21.15.17:0/1809911965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3764102bb0 0x7f3764198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:38.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.968+0000 7f3768e00640 1 --2- 172.21.15.17:0/1809911965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3764102200 0x7f3764198520 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:38.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.968+0000 7f3768e00640 1 -- 172.21.15.17:0/1809911965 >> 172.21.15.17:0/1809911965 conn(0x7f37640fdc60 msgr2=0x7f37640ff0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:38.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.968+0000 7f3768e00640 1 -- 172.21.15.17:0/1809911965 shutdown_connections 2024-09-13T15:56:38.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:38.968+0000 7f3768e00640 1 -- 172.21.15.17:0/1809911965 wait complete. 2024-09-13T15:56:39.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:39 smithi193 ceph-mon[35248]: from='client.25066 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T15:56:39.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:39 smithi017 ceph-mon[30494]: from='client.25066 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T15:56:39.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:39 smithi189 ceph-mon[34790]: from='client.25066 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T15:56:39.853 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":350,"stamp":"2024-09-13T15:56:38.167153+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656795,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":625,"num_read_kb":429,"num_write":341,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1241483,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":371160,"kb_used_data":14128,"kb_used_omap":18,"kb_used_meta":356845,"kb_avail":1124570664,"statfs":{"total":1151940427776,"available":1151560359936,"internally_reserved":0,"allocated":14467072,"data_stored":7982035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19130,"internal_metadata":365409606},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003269"},"pg_stats":[{"pgid":"2.1f","version":"90'9","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.218140+0000","last_change":"2024-09-13T15:54:52.516551+0000","last_active":"2024-09-13T15:55:42.218140+0000","last_peered":"2024-09-13T15:55:42.218140+0000","last_clean":"2024-09-13T15:55:42.218140+0000","last_became_active":"2024-09-13T15:54:52.516112+0000","last_became_peered":"2024-09-13T15:54:52.516112+0000","last_unstale":"2024-09-13T15:55:42.218140+0000","last_undegraded":"2024-09-13T15:55:42.218140+0000","last_fullsized":"2024-09-13T15:55:42.218140+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:55.147164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.222332+0000","last_change":"2024-09-13T15:54:52.954466+0000","last_active":"2024-09-13T15:55:42.222332+0000","last_peered":"2024-09-13T15:55:42.222332+0000","last_clean":"2024-09-13T15:55:42.222332+0000","last_became_active":"2024-09-13T15:54:52.953991+0000","last_became_peered":"2024-09-13T15:54:52.953991+0000","last_unstale":"2024-09-13T15:55:42.222332+0000","last_undegraded":"2024-09-13T15:55:42.222332+0000","last_fullsized":"2024-09-13T15:55:42.222332+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:17.702395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217322+0000","last_change":"2024-09-13T15:54:56.970987+0000","last_active":"2024-09-13T15:55:42.217322+0000","last_peered":"2024-09-13T15:55:42.217322+0000","last_clean":"2024-09-13T15:55:42.217322+0000","last_became_active":"2024-09-13T15:54:56.970594+0000","last_became_peered":"2024-09-13T15:54:56.970594+0000","last_unstale":"2024-09-13T15:55:42.217322+0000","last_undegraded":"2024-09-13T15:55:42.217322+0000","last_fullsized":"2024-09-13T15:55:42.217322+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:56.833427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.222759+0000","last_change":"2024-09-13T15:54:52.517608+0000","last_active":"2024-09-13T15:55:42.222759+0000","last_peered":"2024-09-13T15:55:42.222759+0000","last_clean":"2024-09-13T15:55:42.222759+0000","last_became_active":"2024-09-13T15:54:52.517001+0000","last_became_peered":"2024-09-13T15:54:52.517001+0000","last_unstale":"2024-09-13T15:55:42.222759+0000","last_undegraded":"2024-09-13T15:55:42.222759+0000","last_fullsized":"2024-09-13T15:55:42.222759+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:51.459179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.225666+0000","last_change":"2024-09-13T15:54:52.944713+0000","last_active":"2024-09-13T15:55:42.225666+0000","last_peered":"2024-09-13T15:55:42.225666+0000","last_clean":"2024-09-13T15:55:42.225666+0000","last_became_active":"2024-09-13T15:54:52.943602+0000","last_became_peered":"2024-09-13T15:54:52.943602+0000","last_unstale":"2024-09-13T15:55:42.225666+0000","last_undegraded":"2024-09-13T15:55:42.225666+0000","last_fullsized":"2024-09-13T15:55:42.225666+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:59.305153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217485+0000","last_change":"2024-09-13T15:54:56.981923+0000","last_active":"2024-09-13T15:55:42.217485+0000","last_peered":"2024-09-13T15:55:42.217485+0000","last_clean":"2024-09-13T15:55:42.217485+0000","last_became_active":"2024-09-13T15:54:56.981640+0000","last_became_peered":"2024-09-13T15:54:56.981640+0000","last_unstale":"2024-09-13T15:55:42.217485+0000","last_undegraded":"2024-09-13T15:55:42.217485+0000","last_fullsized":"2024-09-13T15:55:42.217485+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:42.158619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223335+0000","last_change":"2024-09-13T15:54:52.512700+0000","last_active":"2024-09-13T15:55:42.223335+0000","last_peered":"2024-09-13T15:55:42.223335+0000","last_clean":"2024-09-13T15:55:42.223335+0000","last_became_active":"2024-09-13T15:54:52.512378+0000","last_became_peered":"2024-09-13T15:54:52.512378+0000","last_unstale":"2024-09-13T15:55:42.223335+0000","last_undegraded":"2024-09-13T15:55:42.223335+0000","last_fullsized":"2024-09-13T15:55:42.223335+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:43:23.573164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223416+0000","last_change":"2024-09-13T15:54:52.957314+0000","last_active":"2024-09-13T15:55:42.223416+0000","last_peered":"2024-09-13T15:55:42.223416+0000","last_clean":"2024-09-13T15:55:42.223416+0000","last_became_active":"2024-09-13T15:54:52.956836+0000","last_became_peered":"2024-09-13T15:54:52.956836+0000","last_unstale":"2024-09-13T15:55:42.223416+0000","last_undegraded":"2024-09-13T15:55:42.223416+0000","last_fullsized":"2024-09-13T15:55:42.223416+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:06.088700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217775+0000","last_change":"2024-09-13T15:54:56.970777+0000","last_active":"2024-09-13T15:55:42.217775+0000","last_peered":"2024-09-13T15:55:42.217775+0000","last_clean":"2024-09-13T15:55:42.217775+0000","last_became_active":"2024-09-13T15:54:56.970424+0000","last_became_peered":"2024-09-13T15:54:56.970424+0000","last_unstale":"2024-09-13T15:55:42.217775+0000","last_undegraded":"2024-09-13T15:55:42.217775+0000","last_fullsized":"2024-09-13T15:55:42.217775+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:00.045336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.222977+0000","last_change":"2024-09-13T15:54:52.511776+0000","last_active":"2024-09-13T15:55:42.222977+0000","last_peered":"2024-09-13T15:55:42.222977+0000","last_clean":"2024-09-13T15:55:42.222977+0000","last_became_active":"2024-09-13T15:54:52.511412+0000","last_became_peered":"2024-09-13T15:54:52.511412+0000","last_unstale":"2024-09-13T15:55:42.222977+0000","last_undegraded":"2024-09-13T15:55:42.222977+0000","last_fullsized":"2024-09-13T15:55:42.222977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:18.162778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:55:43.230825+0000","last_change":"2024-09-13T15:55:43.230825+0000","last_active":"2024-09-13T15:55:43.230825+0000","last_peered":"2024-09-13T15:55:43.230825+0000","last_clean":"2024-09-13T15:55:43.230825+0000","last_became_active":"2024-09-13T15:55:43.230406+0000","last_became_peered":"2024-09-13T15:55:43.230406+0000","last_unstale":"2024-09-13T15:55:43.230825+0000","last_undegraded":"2024-09-13T15:55:43.230825+0000","last_fullsized":"2024-09-13T15:55:43.230825+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:21:46.579479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217541+0000","last_change":"2024-09-13T15:54:56.973334+0000","last_active":"2024-09-13T15:55:42.217541+0000","last_peered":"2024-09-13T15:55:42.217541+0000","last_clean":"2024-09-13T15:55:42.217541+0000","last_became_active":"2024-09-13T15:54:56.973087+0000","last_became_peered":"2024-09-13T15:54:56.973087+0000","last_unstale":"2024-09-13T15:55:42.217541+0000","last_undegraded":"2024-09-13T15:55:42.217541+0000","last_fullsized":"2024-09-13T15:55:42.217541+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:19.727601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.226964+0000","last_change":"2024-09-13T15:54:52.955223+0000","last_active":"2024-09-13T15:55:42.226964+0000","last_peered":"2024-09-13T15:55:42.226964+0000","last_clean":"2024-09-13T15:55:42.226964+0000","last_became_active":"2024-09-13T15:54:52.954848+0000","last_became_peered":"2024-09-13T15:54:52.954848+0000","last_unstale":"2024-09-13T15:55:42.226964+0000","last_undegraded":"2024-09-13T15:55:42.226964+0000","last_fullsized":"2024-09-13T15:55:42.226964+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:36.921666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.222483+0000","last_change":"2024-09-13T15:54:52.513484+0000","last_active":"2024-09-13T15:55:42.222483+0000","last_peered":"2024-09-13T15:55:42.222483+0000","last_clean":"2024-09-13T15:55:42.222483+0000","last_became_active":"2024-09-13T15:54:52.513143+0000","last_became_peered":"2024-09-13T15:54:52.513143+0000","last_unstale":"2024-09-13T15:55:42.222483+0000","last_undegraded":"2024-09-13T15:55:42.222483+0000","last_fullsized":"2024-09-13T15:55:42.222483+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:31.735280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217896+0000","last_change":"2024-09-13T15:54:57.082924+0000","last_active":"2024-09-13T15:55:42.217896+0000","last_peered":"2024-09-13T15:55:42.217896+0000","last_clean":"2024-09-13T15:55:42.217896+0000","last_became_active":"2024-09-13T15:54:57.082552+0000","last_became_peered":"2024-09-13T15:54:57.082552+0000","last_unstale":"2024-09-13T15:55:42.217896+0000","last_undegraded":"2024-09-13T15:55:42.217896+0000","last_fullsized":"2024-09-13T15:55:42.217896+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:05.144646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.222288+0000","last_change":"2024-09-13T15:54:52.954909+0000","last_active":"2024-09-13T15:55:42.222288+0000","last_peered":"2024-09-13T15:55:42.222288+0000","last_clean":"2024-09-13T15:55:42.222288+0000","last_became_active":"2024-09-13T15:54:52.954639+0000","last_became_peered":"2024-09-13T15:54:52.954639+0000","last_unstale":"2024-09-13T15:55:42.222288+0000","last_undegraded":"2024-09-13T15:55:42.222288+0000","last_fullsized":"2024-09-13T15:55:42.222288+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:35.984856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:55:43.234021+0000","last_change":"2024-09-13T15:55:43.233689+0000","last_active":"2024-09-13T15:55:43.234021+0000","last_peered":"2024-09-13T15:55:43.234021+0000","last_clean":"2024-09-13T15:55:43.234021+0000","last_became_active":"2024-09-13T15:55:43.230745+0000","last_became_peered":"2024-09-13T15:55:43.230745+0000","last_unstale":"2024-09-13T15:55:43.234021+0000","last_undegraded":"2024-09-13T15:55:43.234021+0000","last_fullsized":"2024-09-13T15:55:43.234021+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:32.428515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217673+0000","last_change":"2024-09-13T15:54:56.963815+0000","last_active":"2024-09-13T15:55:42.217673+0000","last_peered":"2024-09-13T15:55:42.217673+0000","last_clean":"2024-09-13T15:55:42.217673+0000","last_became_active":"2024-09-13T15:54:56.963311+0000","last_became_peered":"2024-09-13T15:54:56.963311+0000","last_unstale":"2024-09-13T15:55:42.217673+0000","last_undegraded":"2024-09-13T15:55:42.217673+0000","last_fullsized":"2024-09-13T15:55:42.217673+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:56.464599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223837+0000","last_change":"2024-09-13T15:54:52.963277+0000","last_active":"2024-09-13T15:55:42.223837+0000","last_peered":"2024-09-13T15:55:42.223837+0000","last_clean":"2024-09-13T15:55:42.223837+0000","last_became_active":"2024-09-13T15:54:52.962941+0000","last_became_peered":"2024-09-13T15:54:52.962941+0000","last_unstale":"2024-09-13T15:55:42.223837+0000","last_undegraded":"2024-09-13T15:55:42.223837+0000","last_fullsized":"2024-09-13T15:55:42.223837+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:11.843307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221898+0000","last_change":"2024-09-13T15:54:52.518703+0000","last_active":"2024-09-13T15:55:42.221898+0000","last_peered":"2024-09-13T15:55:42.221898+0000","last_clean":"2024-09-13T15:55:42.221898+0000","last_became_active":"2024-09-13T15:54:52.518384+0000","last_became_peered":"2024-09-13T15:54:52.518384+0000","last_unstale":"2024-09-13T15:55:42.221898+0000","last_undegraded":"2024-09-13T15:55:42.221898+0000","last_fullsized":"2024-09-13T15:55:42.221898+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:39:48.117161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217382+0000","last_change":"2024-09-13T15:54:56.977372+0000","last_active":"2024-09-13T15:55:42.217382+0000","last_peered":"2024-09-13T15:55:42.217382+0000","last_clean":"2024-09-13T15:55:42.217382+0000","last_became_active":"2024-09-13T15:54:56.976980+0000","last_became_peered":"2024-09-13T15:54:56.976980+0000","last_unstale":"2024-09-13T15:55:42.217382+0000","last_undegraded":"2024-09-13T15:55:42.217382+0000","last_fullsized":"2024-09-13T15:55:42.217382+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:51.597228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221291+0000","last_change":"2024-09-13T15:54:52.958598+0000","last_active":"2024-09-13T15:55:42.221291+0000","last_peered":"2024-09-13T15:55:42.221291+0000","last_clean":"2024-09-13T15:55:42.221291+0000","last_became_active":"2024-09-13T15:54:52.958272+0000","last_became_peered":"2024-09-13T15:54:52.958272+0000","last_unstale":"2024-09-13T15:55:42.221291+0000","last_undegraded":"2024-09-13T15:55:42.221291+0000","last_fullsized":"2024-09-13T15:55:42.221291+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:28.174228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223236+0000","last_change":"2024-09-13T15:54:52.507028+0000","last_active":"2024-09-13T15:55:42.223236+0000","last_peered":"2024-09-13T15:55:42.223236+0000","last_clean":"2024-09-13T15:55:42.223236+0000","last_became_active":"2024-09-13T15:54:52.506229+0000","last_became_peered":"2024-09-13T15:54:52.506229+0000","last_unstale":"2024-09-13T15:55:42.223236+0000","last_undegraded":"2024-09-13T15:55:42.223236+0000","last_fullsized":"2024-09-13T15:55:42.223236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:35:02.793140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:55:43.225668+0000","last_change":"2024-09-13T15:55:43.225668+0000","last_active":"2024-09-13T15:55:43.225668+0000","last_peered":"2024-09-13T15:55:43.225668+0000","last_clean":"2024-09-13T15:55:43.225668+0000","last_became_active":"2024-09-13T15:55:43.225200+0000","last_became_peered":"2024-09-13T15:55:43.225200+0000","last_unstale":"2024-09-13T15:55:43.225668+0000","last_undegraded":"2024-09-13T15:55:43.225668+0000","last_fullsized":"2024-09-13T15:55:43.225668+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:55.815724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.225004+0000","last_change":"2024-09-13T15:54:52.961897+0000","last_active":"2024-09-13T15:55:42.225004+0000","last_peered":"2024-09-13T15:55:42.225004+0000","last_clean":"2024-09-13T15:55:42.225004+0000","last_became_active":"2024-09-13T15:54:52.957467+0000","last_became_peered":"2024-09-13T15:54:52.957467+0000","last_unstale":"2024-09-13T15:55:42.225004+0000","last_undegraded":"2024-09-13T15:55:42.225004+0000","last_fullsized":"2024-09-13T15:55:42.225004+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:57:04.150561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.219114+0000","last_change":"2024-09-13T15:54:52.507564+0000","last_active":"2024-09-13T15:55:42.219114+0000","last_peered":"2024-09-13T15:55:42.219114+0000","last_clean":"2024-09-13T15:55:42.219114+0000","last_became_active":"2024-09-13T15:54:52.507267+0000","last_became_peered":"2024-09-13T15:54:52.507267+0000","last_unstale":"2024-09-13T15:55:42.219114+0000","last_undegraded":"2024-09-13T15:55:42.219114+0000","last_fullsized":"2024-09-13T15:55:42.219114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:56.093402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217526+0000","last_change":"2024-09-13T15:54:56.961499+0000","last_active":"2024-09-13T15:55:42.217526+0000","last_peered":"2024-09-13T15:55:42.217526+0000","last_clean":"2024-09-13T15:55:42.217526+0000","last_became_active":"2024-09-13T15:54:56.961032+0000","last_became_peered":"2024-09-13T15:54:56.961032+0000","last_unstale":"2024-09-13T15:55:42.217526+0000","last_undegraded":"2024-09-13T15:55:42.217526+0000","last_fullsized":"2024-09-13T15:55:42.217526+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:28.937286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.222810+0000","last_change":"2024-09-13T15:54:52.951517+0000","last_active":"2024-09-13T15:55:42.222810+0000","last_peered":"2024-09-13T15:55:42.222810+0000","last_clean":"2024-09-13T15:55:42.222810+0000","last_became_active":"2024-09-13T15:54:52.951205+0000","last_became_peered":"2024-09-13T15:54:52.951205+0000","last_unstale":"2024-09-13T15:55:42.222810+0000","last_undegraded":"2024-09-13T15:55:42.222810+0000","last_fullsized":"2024-09-13T15:55:42.222810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:36.936826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'6","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217977+0000","last_change":"2024-09-13T15:54:52.518580+0000","last_active":"2024-09-13T15:55:42.217977+0000","last_peered":"2024-09-13T15:55:42.217977+0000","last_clean":"2024-09-13T15:55:42.217977+0000","last_became_active":"2024-09-13T15:54:52.518277+0000","last_became_peered":"2024-09-13T15:54:52.518277+0000","last_unstale":"2024-09-13T15:55:42.217977+0000","last_undegraded":"2024-09-13T15:55:42.217977+0000","last_fullsized":"2024-09-13T15:55:42.217977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:10.842369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221500+0000","last_change":"2024-09-13T15:54:57.082786+0000","last_active":"2024-09-13T15:55:42.221500+0000","last_peered":"2024-09-13T15:55:42.221500+0000","last_clean":"2024-09-13T15:55:42.221500+0000","last_became_active":"2024-09-13T15:54:57.082357+0000","last_became_peered":"2024-09-13T15:54:57.082357+0000","last_unstale":"2024-09-13T15:55:42.221500+0000","last_undegraded":"2024-09-13T15:55:42.221500+0000","last_fullsized":"2024-09-13T15:55:42.221500+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:40.867554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221069+0000","last_change":"2024-09-13T15:54:52.944433+0000","last_active":"2024-09-13T15:55:42.221069+0000","last_peered":"2024-09-13T15:55:42.221069+0000","last_clean":"2024-09-13T15:55:42.221069+0000","last_became_active":"2024-09-13T15:54:52.943624+0000","last_became_peered":"2024-09-13T15:54:52.943624+0000","last_unstale":"2024-09-13T15:55:42.221069+0000","last_undegraded":"2024-09-13T15:55:42.221069+0000","last_fullsized":"2024-09-13T15:55:42.221069+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:49.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223426+0000","last_change":"2024-09-13T15:54:52.525629+0000","last_active":"2024-09-13T15:55:42.223426+0000","last_peered":"2024-09-13T15:55:42.223426+0000","last_clean":"2024-09-13T15:55:42.223426+0000","last_became_active":"2024-09-13T15:54:52.525311+0000","last_became_peered":"2024-09-13T15:54:52.525311+0000","last_unstale":"2024-09-13T15:55:42.223426+0000","last_undegraded":"2024-09-13T15:55:42.223426+0000","last_fullsized":"2024-09-13T15:55:42.223426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:25.856415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223196+0000","last_change":"2024-09-13T15:54:56.971608+0000","last_active":"2024-09-13T15:55:42.223196+0000","last_peered":"2024-09-13T15:55:42.223196+0000","last_clean":"2024-09-13T15:55:42.223196+0000","last_became_active":"2024-09-13T15:54:56.971185+0000","last_became_peered":"2024-09-13T15:54:56.971185+0000","last_unstale":"2024-09-13T15:55:42.223196+0000","last_undegraded":"2024-09-13T15:55:42.223196+0000","last_fullsized":"2024-09-13T15:55:42.223196+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:46.098922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221063+0000","last_change":"2024-09-13T15:54:52.958843+0000","last_active":"2024-09-13T15:55:42.221063+0000","last_peered":"2024-09-13T15:55:42.221063+0000","last_clean":"2024-09-13T15:55:42.221063+0000","last_became_active":"2024-09-13T15:54:52.958534+0000","last_became_peered":"2024-09-13T15:54:52.958534+0000","last_unstale":"2024-09-13T15:55:42.221063+0000","last_undegraded":"2024-09-13T15:55:42.221063+0000","last_fullsized":"2024-09-13T15:55:42.221063+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:34.721886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217320+0000","last_change":"2024-09-13T15:54:52.524043+0000","last_active":"2024-09-13T15:55:42.217320+0000","last_peered":"2024-09-13T15:55:42.217320+0000","last_clean":"2024-09-13T15:55:42.217320+0000","last_became_active":"2024-09-13T15:54:52.523681+0000","last_became_peered":"2024-09-13T15:54:52.523681+0000","last_unstale":"2024-09-13T15:55:42.217320+0000","last_undegraded":"2024-09-13T15:55:42.217320+0000","last_fullsized":"2024-09-13T15:55:42.217320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:21.164458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221416+0000","last_change":"2024-09-13T15:54:57.083066+0000","last_active":"2024-09-13T15:55:42.221416+0000","last_peered":"2024-09-13T15:55:42.221416+0000","last_clean":"2024-09-13T15:55:42.221416+0000","last_became_active":"2024-09-13T15:54:57.082664+0000","last_became_peered":"2024-09-13T15:54:57.082664+0000","last_unstale":"2024-09-13T15:55:42.221416+0000","last_undegraded":"2024-09-13T15:55:42.221416+0000","last_fullsized":"2024-09-13T15:55:42.221416+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:54.872482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.220899+0000","last_change":"2024-09-13T15:54:52.957428+0000","last_active":"2024-09-13T15:55:42.220899+0000","last_peered":"2024-09-13T15:55:42.220899+0000","last_clean":"2024-09-13T15:55:42.220899+0000","last_became_active":"2024-09-13T15:54:52.957121+0000","last_became_peered":"2024-09-13T15:54:52.957121+0000","last_unstale":"2024-09-13T15:55:42.220899+0000","last_undegraded":"2024-09-13T15:55:42.220899+0000","last_fullsized":"2024-09-13T15:55:42.220899+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:40.821503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.226965+0000","last_change":"2024-09-13T15:54:52.509101+0000","last_active":"2024-09-13T15:55:42.226965+0000","last_peered":"2024-09-13T15:55:42.226965+0000","last_clean":"2024-09-13T15:55:42.226965+0000","last_became_active":"2024-09-13T15:54:52.508808+0000","last_became_peered":"2024-09-13T15:54:52.508808+0000","last_unstale":"2024-09-13T15:55:42.226965+0000","last_undegraded":"2024-09-13T15:55:42.226965+0000","last_fullsized":"2024-09-13T15:55:42.226965+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.181340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.220828+0000","last_change":"2024-09-13T15:54:56.976153+0000","last_active":"2024-09-13T15:55:42.220828+0000","last_peered":"2024-09-13T15:55:42.220828+0000","last_clean":"2024-09-13T15:55:42.220828+0000","last_became_active":"2024-09-13T15:54:56.975727+0000","last_became_peered":"2024-09-13T15:54:56.975727+0000","last_unstale":"2024-09-13T15:55:42.220828+0000","last_undegraded":"2024-09-13T15:55:42.220828+0000","last_fullsized":"2024-09-13T15:55:42.220828+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:12:19.431484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221998+0000","last_change":"2024-09-13T15:54:52.958321+0000","last_active":"2024-09-13T15:55:42.221998+0000","last_peered":"2024-09-13T15:55:42.221998+0000","last_clean":"2024-09-13T15:55:42.221998+0000","last_became_active":"2024-09-13T15:54:52.958030+0000","last_became_peered":"2024-09-13T15:54:52.958030+0000","last_unstale":"2024-09-13T15:55:42.221998+0000","last_undegraded":"2024-09-13T15:55:42.221998+0000","last_fullsized":"2024-09-13T15:55:42.221998+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:15.159807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'4","reported_seq":104,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:56:36.407603+0000","last_change":"2024-09-13T15:54:52.519475+0000","last_active":"2024-09-13T15:56:36.407603+0000","last_peered":"2024-09-13T15:56:36.407603+0000","last_clean":"2024-09-13T15:56:36.407603+0000","last_became_active":"2024-09-13T15:54:52.519144+0000","last_became_peered":"2024-09-13T15:54:52.519144+0000","last_unstale":"2024-09-13T15:56:36.407603+0000","last_undegraded":"2024-09-13T15:56:36.407603+0000","last_fullsized":"2024-09-13T15:56:36.407603+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:07.085691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221037+0000","last_change":"2024-09-13T15:54:57.083036+0000","last_active":"2024-09-13T15:55:42.221037+0000","last_peered":"2024-09-13T15:55:42.221037+0000","last_clean":"2024-09-13T15:55:42.221037+0000","last_became_active":"2024-09-13T15:54:57.082577+0000","last_became_peered":"2024-09-13T15:54:57.082577+0000","last_unstale":"2024-09-13T15:55:42.221037+0000","last_undegraded":"2024-09-13T15:55:42.221037+0000","last_fullsized":"2024-09-13T15:55:42.221037+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:06.309671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.220621+0000","last_change":"2024-09-13T15:54:52.950494+0000","last_active":"2024-09-13T15:55:42.220621+0000","last_peered":"2024-09-13T15:55:42.220621+0000","last_clean":"2024-09-13T15:55:42.220621+0000","last_became_active":"2024-09-13T15:54:52.950160+0000","last_became_peered":"2024-09-13T15:54:52.950160+0000","last_unstale":"2024-09-13T15:55:42.220621+0000","last_undegraded":"2024-09-13T15:55:42.220621+0000","last_fullsized":"2024-09-13T15:55:42.220621+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:59.070083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.226727+0000","last_change":"2024-09-13T15:54:52.511717+0000","last_active":"2024-09-13T15:55:42.226727+0000","last_peered":"2024-09-13T15:55:42.226727+0000","last_clean":"2024-09-13T15:55:42.226727+0000","last_became_active":"2024-09-13T15:54:52.511421+0000","last_became_peered":"2024-09-13T15:54:52.511421+0000","last_unstale":"2024-09-13T15:55:42.226727+0000","last_undegraded":"2024-09-13T15:55:42.226727+0000","last_fullsized":"2024-09-13T15:55:42.226727+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:30:03.037852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.222651+0000","last_change":"2024-09-13T15:54:57.083707+0000","last_active":"2024-09-13T15:55:42.222651+0000","last_peered":"2024-09-13T15:55:42.222651+0000","last_clean":"2024-09-13T15:55:42.222651+0000","last_became_active":"2024-09-13T15:54:57.083351+0000","last_became_peered":"2024-09-13T15:54:57.083351+0000","last_unstale":"2024-09-13T15:55:42.222651+0000","last_undegraded":"2024-09-13T15:55:42.222651+0000","last_fullsized":"2024-09-13T15:55:42.222651+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:42.058114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.222111+0000","last_change":"2024-09-13T15:54:52.955696+0000","last_active":"2024-09-13T15:55:42.222111+0000","last_peered":"2024-09-13T15:55:42.222111+0000","last_clean":"2024-09-13T15:55:42.222111+0000","last_became_active":"2024-09-13T15:54:52.955271+0000","last_became_peered":"2024-09-13T15:54:52.955271+0000","last_unstale":"2024-09-13T15:55:42.222111+0000","last_undegraded":"2024-09-13T15:55:42.222111+0000","last_fullsized":"2024-09-13T15:55:42.222111+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:16.904541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.218105+0000","last_change":"2024-09-13T15:54:52.507152+0000","last_active":"2024-09-13T15:55:42.218105+0000","last_peered":"2024-09-13T15:55:42.218105+0000","last_clean":"2024-09-13T15:55:42.218105+0000","last_became_active":"2024-09-13T15:54:52.506805+0000","last_became_peered":"2024-09-13T15:54:52.506805+0000","last_unstale":"2024-09-13T15:55:42.218105+0000","last_undegraded":"2024-09-13T15:55:42.218105+0000","last_fullsized":"2024-09-13T15:55:42.218105+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:51.221341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":332,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:55:44.054526+0000","last_change":"2024-09-13T15:53:37.322379+0000","last_active":"2024-09-13T15:55:44.054526+0000","last_peered":"2024-09-13T15:55:44.054526+0000","last_clean":"2024-09-13T15:55:44.054526+0000","last_became_active":"2024-09-13T15:53:37.321987+0000","last_became_peered":"2024-09-13T15:53:37.321987+0000","last_unstale":"2024-09-13T15:55:44.054526+0000","last_undegraded":"2024-09-13T15:55:44.054526+0000","last_fullsized":"2024-09-13T15:55:44.054526+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:50:10.707150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:50:10.707150+0000","last_clean_scrub_stamp":"2024-09-13T15:50:10.707150+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:16.244946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.226981+0000","last_change":"2024-09-13T15:54:56.964729+0000","last_active":"2024-09-13T15:55:42.226981+0000","last_peered":"2024-09-13T15:55:42.226981+0000","last_clean":"2024-09-13T15:55:42.226981+0000","last_became_active":"2024-09-13T15:54:56.964385+0000","last_became_peered":"2024-09-13T15:54:56.964385+0000","last_unstale":"2024-09-13T15:55:42.226981+0000","last_undegraded":"2024-09-13T15:55:42.226981+0000","last_fullsized":"2024-09-13T15:55:42.226981+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:11.884248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.227204+0000","last_change":"2024-09-13T15:54:52.960069+0000","last_active":"2024-09-13T15:55:42.227204+0000","last_peered":"2024-09-13T15:55:42.227204+0000","last_clean":"2024-09-13T15:55:42.227204+0000","last_became_active":"2024-09-13T15:54:52.959762+0000","last_became_peered":"2024-09-13T15:54:52.959762+0000","last_unstale":"2024-09-13T15:55:42.227204+0000","last_undegraded":"2024-09-13T15:55:42.227204+0000","last_fullsized":"2024-09-13T15:55:42.227204+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:18.506596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217915+0000","last_change":"2024-09-13T15:54:52.524137+0000","last_active":"2024-09-13T15:55:42.217915+0000","last_peered":"2024-09-13T15:55:42.217915+0000","last_clean":"2024-09-13T15:55:42.217915+0000","last_became_active":"2024-09-13T15:54:52.523781+0000","last_became_peered":"2024-09-13T15:54:52.523781+0000","last_unstale":"2024-09-13T15:55:42.217915+0000","last_undegraded":"2024-09-13T15:55:42.217915+0000","last_fullsized":"2024-09-13T15:55:42.217915+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:04.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223179+0000","last_change":"2024-09-13T15:54:56.967557+0000","last_active":"2024-09-13T15:55:42.223179+0000","last_peered":"2024-09-13T15:55:42.223179+0000","last_clean":"2024-09-13T15:55:42.223179+0000","last_became_active":"2024-09-13T15:54:56.967190+0000","last_became_peered":"2024-09-13T15:54:56.967190+0000","last_unstale":"2024-09-13T15:55:42.223179+0000","last_undegraded":"2024-09-13T15:55:42.223179+0000","last_fullsized":"2024-09-13T15:55:42.223179+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:45.630557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.227041+0000","last_change":"2024-09-13T15:54:52.955587+0000","last_active":"2024-09-13T15:55:42.227041+0000","last_peered":"2024-09-13T15:55:42.227041+0000","last_clean":"2024-09-13T15:55:42.227041+0000","last_became_active":"2024-09-13T15:54:52.955270+0000","last_became_peered":"2024-09-13T15:54:52.955270+0000","last_unstale":"2024-09-13T15:55:42.227041+0000","last_undegraded":"2024-09-13T15:55:42.227041+0000","last_fullsized":"2024-09-13T15:55:42.227041+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:59.425468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223941+0000","last_change":"2024-09-13T15:54:52.518617+0000","last_active":"2024-09-13T15:55:42.223941+0000","last_peered":"2024-09-13T15:55:42.223941+0000","last_clean":"2024-09-13T15:55:42.223941+0000","last_became_active":"2024-09-13T15:54:52.518292+0000","last_became_peered":"2024-09-13T15:54:52.518292+0000","last_unstale":"2024-09-13T15:55:42.223941+0000","last_undegraded":"2024-09-13T15:55:42.223941+0000","last_fullsized":"2024-09-13T15:55:42.223941+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:06.890484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.224869+0000","last_change":"2024-09-13T15:54:56.978521+0000","last_active":"2024-09-13T15:55:42.224869+0000","last_peered":"2024-09-13T15:55:42.224869+0000","last_clean":"2024-09-13T15:55:42.224869+0000","last_became_active":"2024-09-13T15:54:56.977938+0000","last_became_peered":"2024-09-13T15:54:56.977938+0000","last_unstale":"2024-09-13T15:55:42.224869+0000","last_undegraded":"2024-09-13T15:55:42.224869+0000","last_fullsized":"2024-09-13T15:55:42.224869+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:26.251881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.227324+0000","last_change":"2024-09-13T15:54:52.954992+0000","last_active":"2024-09-13T15:55:42.227324+0000","last_peered":"2024-09-13T15:55:42.227324+0000","last_clean":"2024-09-13T15:55:42.227324+0000","last_became_active":"2024-09-13T15:54:52.954646+0000","last_became_peered":"2024-09-13T15:54:52.954646+0000","last_unstale":"2024-09-13T15:55:42.227324+0000","last_undegraded":"2024-09-13T15:55:42.227324+0000","last_fullsized":"2024-09-13T15:55:42.227324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:28.362703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.222173+0000","last_change":"2024-09-13T15:54:52.509976+0000","last_active":"2024-09-13T15:55:42.222173+0000","last_peered":"2024-09-13T15:55:42.222173+0000","last_clean":"2024-09-13T15:55:42.222173+0000","last_became_active":"2024-09-13T15:54:52.509669+0000","last_became_peered":"2024-09-13T15:54:52.509669+0000","last_unstale":"2024-09-13T15:55:42.222173+0000","last_undegraded":"2024-09-13T15:55:42.222173+0000","last_fullsized":"2024-09-13T15:55:42.222173+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:06:02.622401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223387+0000","last_change":"2024-09-13T15:54:56.966090+0000","last_active":"2024-09-13T15:55:42.223387+0000","last_peered":"2024-09-13T15:55:42.223387+0000","last_clean":"2024-09-13T15:55:42.223387+0000","last_became_active":"2024-09-13T15:54:56.965671+0000","last_became_peered":"2024-09-13T15:54:56.965671+0000","last_unstale":"2024-09-13T15:55:42.223387+0000","last_undegraded":"2024-09-13T15:55:42.223387+0000","last_fullsized":"2024-09-13T15:55:42.223387+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:20.318451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:55:43.229763+0000","last_change":"2024-09-13T15:55:43.229763+0000","last_active":"2024-09-13T15:55:43.229763+0000","last_peered":"2024-09-13T15:55:43.229763+0000","last_clean":"2024-09-13T15:55:43.229763+0000","last_became_active":"2024-09-13T15:55:43.229373+0000","last_became_peered":"2024-09-13T15:55:43.229373+0000","last_unstale":"2024-09-13T15:55:43.229763+0000","last_undegraded":"2024-09-13T15:55:43.229763+0000","last_fullsized":"2024-09-13T15:55:43.229763+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:09.917779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.224008+0000","last_change":"2024-09-13T15:54:52.512258+0000","last_active":"2024-09-13T15:55:42.224008+0000","last_peered":"2024-09-13T15:55:42.224008+0000","last_clean":"2024-09-13T15:55:42.224008+0000","last_became_active":"2024-09-13T15:54:52.511585+0000","last_became_peered":"2024-09-13T15:54:52.511585+0000","last_unstale":"2024-09-13T15:55:42.224008+0000","last_undegraded":"2024-09-13T15:55:42.224008+0000","last_fullsized":"2024-09-13T15:55:42.224008+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:41.717042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221296+0000","last_change":"2024-09-13T15:54:56.975391+0000","last_active":"2024-09-13T15:55:42.221296+0000","last_peered":"2024-09-13T15:55:42.221296+0000","last_clean":"2024-09-13T15:55:42.221296+0000","last_became_active":"2024-09-13T15:54:56.975110+0000","last_became_peered":"2024-09-13T15:54:56.975110+0000","last_unstale":"2024-09-13T15:55:42.221296+0000","last_undegraded":"2024-09-13T15:55:42.221296+0000","last_fullsized":"2024-09-13T15:55:42.221296+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:41.001352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221361+0000","last_change":"2024-09-13T15:54:52.962697+0000","last_active":"2024-09-13T15:55:42.221361+0000","last_peered":"2024-09-13T15:55:42.221361+0000","last_clean":"2024-09-13T15:55:42.221361+0000","last_became_active":"2024-09-13T15:54:52.962202+0000","last_became_peered":"2024-09-13T15:54:52.962202+0000","last_unstale":"2024-09-13T15:55:42.221361+0000","last_undegraded":"2024-09-13T15:55:42.221361+0000","last_fullsized":"2024-09-13T15:55:42.221361+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:18.993166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:55:43.263033+0000","last_change":"2024-09-13T15:55:43.262658+0000","last_active":"2024-09-13T15:55:43.263033+0000","last_peered":"2024-09-13T15:55:43.263033+0000","last_clean":"2024-09-13T15:55:43.263033+0000","last_became_active":"2024-09-13T15:55:43.240153+0000","last_became_peered":"2024-09-13T15:55:43.240153+0000","last_unstale":"2024-09-13T15:55:43.263033+0000","last_undegraded":"2024-09-13T15:55:43.263033+0000","last_fullsized":"2024-09-13T15:55:43.263033+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:28.035649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:55:43.237249+0000","last_change":"2024-09-13T15:55:43.237249+0000","last_active":"2024-09-13T15:55:43.237249+0000","last_peered":"2024-09-13T15:55:43.237249+0000","last_clean":"2024-09-13T15:55:43.237249+0000","last_became_active":"2024-09-13T15:55:43.236754+0000","last_became_peered":"2024-09-13T15:55:43.236754+0000","last_unstale":"2024-09-13T15:55:43.237249+0000","last_undegraded":"2024-09-13T15:55:43.237249+0000","last_fullsized":"2024-09-13T15:55:43.237249+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:24.327721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.226615+0000","last_change":"2024-09-13T15:54:52.952927+0000","last_active":"2024-09-13T15:55:42.226615+0000","last_peered":"2024-09-13T15:55:42.226615+0000","last_clean":"2024-09-13T15:55:42.226615+0000","last_became_active":"2024-09-13T15:54:52.952647+0000","last_became_peered":"2024-09-13T15:54:52.952647+0000","last_unstale":"2024-09-13T15:55:42.226615+0000","last_undegraded":"2024-09-13T15:55:42.226615+0000","last_fullsized":"2024-09-13T15:55:42.226615+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:47.085104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'4","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:56:34.404534+0000","last_change":"2024-09-13T15:54:52.502696+0000","last_active":"2024-09-13T15:56:34.404534+0000","last_peered":"2024-09-13T15:56:34.404534+0000","last_clean":"2024-09-13T15:56:34.404534+0000","last_became_active":"2024-09-13T15:54:52.502352+0000","last_became_peered":"2024-09-13T15:54:52.502352+0000","last_unstale":"2024-09-13T15:56:34.404534+0000","last_undegraded":"2024-09-13T15:56:34.404534+0000","last_fullsized":"2024-09-13T15:56:34.404534+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:55.899194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":932,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:55:44.056139+0000","last_change":"2024-09-13T15:55:44.055693+0000","last_active":"2024-09-13T15:55:44.056139+0000","last_peered":"2024-09-13T15:55:44.056139+0000","last_clean":"2024-09-13T15:55:44.056139+0000","last_became_active":"2024-09-13T15:55:44.055338+0000","last_became_peered":"2024-09-13T15:55:44.055338+0000","last_unstale":"2024-09-13T15:55:44.056139+0000","last_undegraded":"2024-09-13T15:55:44.056139+0000","last_fullsized":"2024-09-13T15:55:44.056139+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:37:50.466488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.227079+0000","last_change":"2024-09-13T15:54:52.950419+0000","last_active":"2024-09-13T15:55:42.227079+0000","last_peered":"2024-09-13T15:55:42.227079+0000","last_clean":"2024-09-13T15:55:42.227079+0000","last_became_active":"2024-09-13T15:54:52.950111+0000","last_became_peered":"2024-09-13T15:54:52.950111+0000","last_unstale":"2024-09-13T15:55:42.227079+0000","last_undegraded":"2024-09-13T15:55:42.227079+0000","last_fullsized":"2024-09-13T15:55:42.227079+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:02:14.424589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221309+0000","last_change":"2024-09-13T15:54:52.520700+0000","last_active":"2024-09-13T15:55:42.221309+0000","last_peered":"2024-09-13T15:55:42.221309+0000","last_clean":"2024-09-13T15:55:42.221309+0000","last_became_active":"2024-09-13T15:54:52.520438+0000","last_became_peered":"2024-09-13T15:54:52.520438+0000","last_unstale":"2024-09-13T15:55:42.221309+0000","last_undegraded":"2024-09-13T15:55:42.221309+0000","last_fullsized":"2024-09-13T15:55:42.221309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:45.740101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223689+0000","last_change":"2024-09-13T15:54:56.971469+0000","last_active":"2024-09-13T15:55:42.223689+0000","last_peered":"2024-09-13T15:55:42.223689+0000","last_clean":"2024-09-13T15:55:42.223689+0000","last_became_active":"2024-09-13T15:54:56.971018+0000","last_became_peered":"2024-09-13T15:54:56.971018+0000","last_unstale":"2024-09-13T15:55:42.223689+0000","last_undegraded":"2024-09-13T15:55:42.223689+0000","last_fullsized":"2024-09-13T15:55:42.223689+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:48.980523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.220801+0000","last_change":"2024-09-13T15:54:52.953776+0000","last_active":"2024-09-13T15:55:42.220801+0000","last_peered":"2024-09-13T15:55:42.220801+0000","last_clean":"2024-09-13T15:55:42.220801+0000","last_became_active":"2024-09-13T15:54:52.950879+0000","last_became_peered":"2024-09-13T15:54:52.950879+0000","last_unstale":"2024-09-13T15:55:42.220801+0000","last_undegraded":"2024-09-13T15:55:42.220801+0000","last_fullsized":"2024-09-13T15:55:42.220801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:15:12.817499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217874+0000","last_change":"2024-09-13T15:54:52.519322+0000","last_active":"2024-09-13T15:55:42.217874+0000","last_peered":"2024-09-13T15:55:42.217874+0000","last_clean":"2024-09-13T15:55:42.217874+0000","last_became_active":"2024-09-13T15:54:52.518751+0000","last_became_peered":"2024-09-13T15:54:52.518751+0000","last_unstale":"2024-09-13T15:55:42.217874+0000","last_undegraded":"2024-09-13T15:55:42.217874+0000","last_fullsized":"2024-09-13T15:55:42.217874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:10.835566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223711+0000","last_change":"2024-09-13T15:54:56.974091+0000","last_active":"2024-09-13T15:55:42.223711+0000","last_peered":"2024-09-13T15:55:42.223711+0000","last_clean":"2024-09-13T15:55:42.223711+0000","last_became_active":"2024-09-13T15:54:56.973717+0000","last_became_peered":"2024-09-13T15:54:56.973717+0000","last_unstale":"2024-09-13T15:55:42.223711+0000","last_undegraded":"2024-09-13T15:55:42.223711+0000","last_fullsized":"2024-09-13T15:55:42.223711+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:17:22.158270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223186+0000","last_change":"2024-09-13T15:54:52.954562+0000","last_active":"2024-09-13T15:55:42.223186+0000","last_peered":"2024-09-13T15:55:42.223186+0000","last_clean":"2024-09-13T15:55:42.223186+0000","last_became_active":"2024-09-13T15:54:52.954228+0000","last_became_peered":"2024-09-13T15:54:52.954228+0000","last_unstale":"2024-09-13T15:55:42.223186+0000","last_undegraded":"2024-09-13T15:55:42.223186+0000","last_fullsized":"2024-09-13T15:55:42.223186+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:57.833958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"92'34","reported_seq":237,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:56:34.306651+0000","last_change":"2024-09-13T15:55:43.233620+0000","last_active":"2024-09-13T15:56:34.306651+0000","last_peered":"2024-09-13T15:56:34.306651+0000","last_clean":"2024-09-13T15:56:34.306651+0000","last_became_active":"2024-09-13T15:55:43.224535+0000","last_became_peered":"2024-09-13T15:55:43.224535+0000","last_unstale":"2024-09-13T15:56:34.306651+0000","last_undegraded":"2024-09-13T15:56:34.306651+0000","last_fullsized":"2024-09-13T15:56:34.306651+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:33.332196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62287,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":162,"num_read_kb":141,"num_write":35,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":60635,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.216966+0000","last_change":"2024-09-13T15:54:56.977311+0000","last_active":"2024-09-13T15:55:42.216966+0000","last_peered":"2024-09-13T15:55:42.216966+0000","last_clean":"2024-09-13T15:55:42.216966+0000","last_became_active":"2024-09-13T15:54:56.972677+0000","last_became_peered":"2024-09-13T15:54:56.972677+0000","last_unstale":"2024-09-13T15:55:42.216966+0000","last_undegraded":"2024-09-13T15:55:42.216966+0000","last_fullsized":"2024-09-13T15:55:42.216966+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:03.162029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223543+0000","last_change":"2024-09-13T15:54:52.952983+0000","last_active":"2024-09-13T15:55:42.223543+0000","last_peered":"2024-09-13T15:55:42.223543+0000","last_clean":"2024-09-13T15:55:42.223543+0000","last_became_active":"2024-09-13T15:54:52.952710+0000","last_became_peered":"2024-09-13T15:54:52.952710+0000","last_unstale":"2024-09-13T15:55:42.223543+0000","last_undegraded":"2024-09-13T15:55:42.223543+0000","last_fullsized":"2024-09-13T15:55:42.223543+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:07.006629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223841+0000","last_change":"2024-09-13T15:54:52.514710+0000","last_active":"2024-09-13T15:55:42.223841+0000","last_peered":"2024-09-13T15:55:42.223841+0000","last_clean":"2024-09-13T15:55:42.223841+0000","last_became_active":"2024-09-13T15:54:52.514377+0000","last_became_peered":"2024-09-13T15:54:52.514377+0000","last_unstale":"2024-09-13T15:55:42.223841+0000","last_undegraded":"2024-09-13T15:55:42.223841+0000","last_fullsized":"2024-09-13T15:55:42.223841+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:07.434722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217665+0000","last_change":"2024-09-13T15:54:56.963704+0000","last_active":"2024-09-13T15:55:42.217665+0000","last_peered":"2024-09-13T15:55:42.217665+0000","last_clean":"2024-09-13T15:55:42.217665+0000","last_became_active":"2024-09-13T15:54:56.963249+0000","last_became_peered":"2024-09-13T15:54:56.963249+0000","last_unstale":"2024-09-13T15:55:42.217665+0000","last_undegraded":"2024-09-13T15:55:42.217665+0000","last_fullsized":"2024-09-13T15:55:42.217665+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:36.983366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.225761+0000","last_change":"2024-09-13T15:54:52.960772+0000","last_active":"2024-09-13T15:55:42.225761+0000","last_peered":"2024-09-13T15:55:42.225761+0000","last_clean":"2024-09-13T15:55:42.225761+0000","last_became_active":"2024-09-13T15:54:52.957092+0000","last_became_peered":"2024-09-13T15:54:52.957092+0000","last_unstale":"2024-09-13T15:55:42.225761+0000","last_undegraded":"2024-09-13T15:55:42.225761+0000","last_fullsized":"2024-09-13T15:55:42.225761+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:02.563773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.227163+0000","last_change":"2024-09-13T15:54:52.507815+0000","last_active":"2024-09-13T15:55:42.227163+0000","last_peered":"2024-09-13T15:55:42.227163+0000","last_clean":"2024-09-13T15:55:42.227163+0000","last_became_active":"2024-09-13T15:54:52.507340+0000","last_became_peered":"2024-09-13T15:54:52.507340+0000","last_unstale":"2024-09-13T15:55:42.227163+0000","last_undegraded":"2024-09-13T15:55:42.227163+0000","last_fullsized":"2024-09-13T15:55:42.227163+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:58.896215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.216899+0000","last_change":"2024-09-13T15:54:56.977240+0000","last_active":"2024-09-13T15:55:42.216899+0000","last_peered":"2024-09-13T15:55:42.216899+0000","last_clean":"2024-09-13T15:55:42.216899+0000","last_became_active":"2024-09-13T15:54:56.976848+0000","last_became_peered":"2024-09-13T15:54:56.976848+0000","last_unstale":"2024-09-13T15:55:42.216899+0000","last_undegraded":"2024-09-13T15:55:42.216899+0000","last_fullsized":"2024-09-13T15:55:42.216899+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:48.223930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223622+0000","last_change":"2024-09-13T15:54:52.956493+0000","last_active":"2024-09-13T15:55:42.223622+0000","last_peered":"2024-09-13T15:55:42.223622+0000","last_clean":"2024-09-13T15:55:42.223622+0000","last_became_active":"2024-09-13T15:54:52.955994+0000","last_became_peered":"2024-09-13T15:54:52.955994+0000","last_unstale":"2024-09-13T15:55:42.223622+0000","last_undegraded":"2024-09-13T15:55:42.223622+0000","last_fullsized":"2024-09-13T15:55:42.223622+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:14.515253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'3","reported_seq":100,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:56:33.374833+0000","last_change":"2024-09-13T15:54:52.507394+0000","last_active":"2024-09-13T15:56:33.374833+0000","last_peered":"2024-09-13T15:56:33.374833+0000","last_clean":"2024-09-13T15:56:33.374833+0000","last_became_active":"2024-09-13T15:54:52.507104+0000","last_became_peered":"2024-09-13T15:54:52.507104+0000","last_unstale":"2024-09-13T15:56:33.374833+0000","last_undegraded":"2024-09-13T15:56:33.374833+0000","last_fullsized":"2024-09-13T15:56:33.374833+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:57.442678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":79,"num_read_kb":79,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221747+0000","last_change":"2024-09-13T15:54:56.971867+0000","last_active":"2024-09-13T15:55:42.221747+0000","last_peered":"2024-09-13T15:55:42.221747+0000","last_clean":"2024-09-13T15:55:42.221747+0000","last_became_active":"2024-09-13T15:54:56.970041+0000","last_became_peered":"2024-09-13T15:54:56.970041+0000","last_unstale":"2024-09-13T15:55:42.221747+0000","last_undegraded":"2024-09-13T15:55:42.221747+0000","last_fullsized":"2024-09-13T15:55:42.221747+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:02.478595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.224925+0000","last_change":"2024-09-13T15:54:56.974886+0000","last_active":"2024-09-13T15:55:42.224925+0000","last_peered":"2024-09-13T15:55:42.224925+0000","last_clean":"2024-09-13T15:55:42.224925+0000","last_became_active":"2024-09-13T15:54:56.972879+0000","last_became_peered":"2024-09-13T15:54:56.972879+0000","last_unstale":"2024-09-13T15:55:42.224925+0000","last_undegraded":"2024-09-13T15:55:42.224925+0000","last_fullsized":"2024-09-13T15:55:42.224925+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:59.869941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.216970+0000","last_change":"2024-09-13T15:54:52.956887+0000","last_active":"2024-09-13T15:55:42.216970+0000","last_peered":"2024-09-13T15:55:42.216970+0000","last_clean":"2024-09-13T15:55:42.216970+0000","last_became_active":"2024-09-13T15:54:52.951413+0000","last_became_peered":"2024-09-13T15:54:52.951413+0000","last_unstale":"2024-09-13T15:55:42.216970+0000","last_undegraded":"2024-09-13T15:55:42.216970+0000","last_fullsized":"2024-09-13T15:55:42.216970+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:05.664170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.222088+0000","last_change":"2024-09-13T15:54:52.509235+0000","last_active":"2024-09-13T15:55:42.222088+0000","last_peered":"2024-09-13T15:55:42.222088+0000","last_clean":"2024-09-13T15:55:42.222088+0000","last_became_active":"2024-09-13T15:54:52.508956+0000","last_became_peered":"2024-09-13T15:54:52.508956+0000","last_unstale":"2024-09-13T15:55:42.222088+0000","last_undegraded":"2024-09-13T15:55:42.222088+0000","last_fullsized":"2024-09-13T15:55:42.222088+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:52.884396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:55:43.240640+0000","last_change":"2024-09-13T15:55:43.240640+0000","last_active":"2024-09-13T15:55:43.240640+0000","last_peered":"2024-09-13T15:55:43.240640+0000","last_clean":"2024-09-13T15:55:43.240640+0000","last_became_active":"2024-09-13T15:55:43.240195+0000","last_became_peered":"2024-09-13T15:55:43.240195+0000","last_unstale":"2024-09-13T15:55:43.240640+0000","last_undegraded":"2024-09-13T15:55:43.240640+0000","last_fullsized":"2024-09-13T15:55:43.240640+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:04.991220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,10,0],"acting":[11,4,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221710+0000","last_change":"2024-09-13T15:54:52.956422+0000","last_active":"2024-09-13T15:55:42.221710+0000","last_peered":"2024-09-13T15:55:42.221710+0000","last_clean":"2024-09-13T15:55:42.221710+0000","last_became_active":"2024-09-13T15:54:52.956083+0000","last_became_peered":"2024-09-13T15:54:52.956083+0000","last_unstale":"2024-09-13T15:55:42.221710+0000","last_undegraded":"2024-09-13T15:55:42.221710+0000","last_fullsized":"2024-09-13T15:55:42.221710+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:17.057214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.220725+0000","last_change":"2024-09-13T15:54:52.507204+0000","last_active":"2024-09-13T15:55:42.220725+0000","last_peered":"2024-09-13T15:55:42.220725+0000","last_clean":"2024-09-13T15:55:42.220725+0000","last_became_active":"2024-09-13T15:54:52.506827+0000","last_became_peered":"2024-09-13T15:54:52.506827+0000","last_unstale":"2024-09-13T15:55:42.220725+0000","last_undegraded":"2024-09-13T15:55:42.220725+0000","last_fullsized":"2024-09-13T15:55:42.220725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:03.960238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"90'3","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.220899+0000","last_change":"2024-09-13T15:54:52.511748+0000","last_active":"2024-09-13T15:55:42.220899+0000","last_peered":"2024-09-13T15:55:42.220899+0000","last_clean":"2024-09-13T15:55:42.220899+0000","last_became_active":"2024-09-13T15:54:52.511252+0000","last_became_peered":"2024-09-13T15:54:52.511252+0000","last_unstale":"2024-09-13T15:55:42.220899+0000","last_undegraded":"2024-09-13T15:55:42.220899+0000","last_fullsized":"2024-09-13T15:55:42.220899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:13.141009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221473+0000","last_change":"2024-09-13T15:54:52.961880+0000","last_active":"2024-09-13T15:55:42.221473+0000","last_peered":"2024-09-13T15:55:42.221473+0000","last_clean":"2024-09-13T15:55:42.221473+0000","last_became_active":"2024-09-13T15:54:52.961450+0000","last_became_peered":"2024-09-13T15:54:52.961450+0000","last_unstale":"2024-09-13T15:55:42.221473+0000","last_undegraded":"2024-09-13T15:55:42.221473+0000","last_fullsized":"2024-09-13T15:55:42.221473+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:14.060479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217527+0000","last_change":"2024-09-13T15:54:56.965541+0000","last_active":"2024-09-13T15:55:42.217527+0000","last_peered":"2024-09-13T15:55:42.217527+0000","last_clean":"2024-09-13T15:55:42.217527+0000","last_became_active":"2024-09-13T15:54:56.965185+0000","last_became_peered":"2024-09-13T15:54:56.965185+0000","last_unstale":"2024-09-13T15:55:42.217527+0000","last_undegraded":"2024-09-13T15:55:42.217527+0000","last_fullsized":"2024-09-13T15:55:42.217527+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:38:44.356201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":103,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:56:32.374080+0000","last_change":"2024-09-13T15:54:52.507878+0000","last_active":"2024-09-13T15:56:32.374080+0000","last_peered":"2024-09-13T15:56:32.374080+0000","last_clean":"2024-09-13T15:56:32.374080+0000","last_became_active":"2024-09-13T15:54:52.507564+0000","last_became_peered":"2024-09-13T15:54:52.507564+0000","last_unstale":"2024-09-13T15:56:32.374080+0000","last_undegraded":"2024-09-13T15:56:32.374080+0000","last_fullsized":"2024-09-13T15:56:32.374080+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:51.486624+0000","last_clean_scrub_stamp":"2024-09-13T15:54:51.486624+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:55:31.921870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221563+0000","last_change":"2024-09-13T15:54:52.951596+0000","last_active":"2024-09-13T15:55:42.221563+0000","last_peered":"2024-09-13T15:55:42.221563+0000","last_clean":"2024-09-13T15:55:42.221563+0000","last_became_active":"2024-09-13T15:54:52.951202+0000","last_became_peered":"2024-09-13T15:54:52.951202+0000","last_unstale":"2024-09-13T15:55:42.221563+0000","last_undegraded":"2024-09-13T15:55:42.221563+0000","last_fullsized":"2024-09-13T15:55:42.221563+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:04.421318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217640+0000","last_change":"2024-09-13T15:54:56.964449+0000","last_active":"2024-09-13T15:55:42.217640+0000","last_peered":"2024-09-13T15:55:42.217640+0000","last_clean":"2024-09-13T15:55:42.217640+0000","last_became_active":"2024-09-13T15:54:56.964025+0000","last_became_peered":"2024-09-13T15:54:56.964025+0000","last_unstale":"2024-09-13T15:55:42.217640+0000","last_undegraded":"2024-09-13T15:55:42.217640+0000","last_fullsized":"2024-09-13T15:55:42.217640+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:55.943302+0000","last_clean_scrub_stamp":"2024-09-13T15:54:55.943302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:06.337648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223733+0000","last_change":"2024-09-13T15:54:52.953460+0000","last_active":"2024-09-13T15:55:42.223733+0000","last_peered":"2024-09-13T15:55:42.223733+0000","last_clean":"2024-09-13T15:55:42.223733+0000","last_became_active":"2024-09-13T15:54:52.953112+0000","last_became_peered":"2024-09-13T15:54:52.953112+0000","last_unstale":"2024-09-13T15:55:42.223733+0000","last_undegraded":"2024-09-13T15:55:42.223733+0000","last_fullsized":"2024-09-13T15:55:42.223733+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:56.676237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217749+0000","last_change":"2024-09-13T15:54:52.955844+0000","last_active":"2024-09-13T15:55:42.217749+0000","last_peered":"2024-09-13T15:55:42.217749+0000","last_clean":"2024-09-13T15:55:42.217749+0000","last_became_active":"2024-09-13T15:54:52.954217+0000","last_became_peered":"2024-09-13T15:54:52.954217+0000","last_unstale":"2024-09-13T15:55:42.217749+0000","last_undegraded":"2024-09-13T15:55:42.217749+0000","last_fullsized":"2024-09-13T15:55:42.217749+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:21.601680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217403+0000","last_change":"2024-09-13T15:54:52.950686+0000","last_active":"2024-09-13T15:55:42.217403+0000","last_peered":"2024-09-13T15:55:42.217403+0000","last_clean":"2024-09-13T15:55:42.217403+0000","last_became_active":"2024-09-13T15:54:52.950380+0000","last_became_peered":"2024-09-13T15:54:52.950380+0000","last_unstale":"2024-09-13T15:55:42.217403+0000","last_undegraded":"2024-09-13T15:55:42.217403+0000","last_fullsized":"2024-09-13T15:55:42.217403+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:44.181584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.224989+0000","last_change":"2024-09-13T15:54:52.956522+0000","last_active":"2024-09-13T15:55:42.224989+0000","last_peered":"2024-09-13T15:55:42.224989+0000","last_clean":"2024-09-13T15:55:42.224989+0000","last_became_active":"2024-09-13T15:54:52.956243+0000","last_became_peered":"2024-09-13T15:54:52.956243+0000","last_unstale":"2024-09-13T15:55:42.224989+0000","last_undegraded":"2024-09-13T15:55:42.224989+0000","last_fullsized":"2024-09-13T15:55:42.224989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:50.633743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.220979+0000","last_change":"2024-09-13T15:54:52.951515+0000","last_active":"2024-09-13T15:55:42.220979+0000","last_peered":"2024-09-13T15:55:42.220979+0000","last_clean":"2024-09-13T15:55:42.220979+0000","last_became_active":"2024-09-13T15:54:52.951244+0000","last_became_peered":"2024-09-13T15:54:52.951244+0000","last_unstale":"2024-09-13T15:55:42.220979+0000","last_undegraded":"2024-09-13T15:55:42.220979+0000","last_fullsized":"2024-09-13T15:55:42.220979+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:30.834271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.224292+0000","last_change":"2024-09-13T15:54:52.951749+0000","last_active":"2024-09-13T15:55:42.224292+0000","last_peered":"2024-09-13T15:55:42.224292+0000","last_clean":"2024-09-13T15:55:42.224292+0000","last_became_active":"2024-09-13T15:54:52.951451+0000","last_became_peered":"2024-09-13T15:54:52.951451+0000","last_unstale":"2024-09-13T15:55:42.224292+0000","last_undegraded":"2024-09-13T15:55:42.224292+0000","last_fullsized":"2024-09-13T15:55:42.224292+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:32.628282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.218403+0000","last_change":"2024-09-13T15:54:52.947562+0000","last_active":"2024-09-13T15:55:42.218403+0000","last_peered":"2024-09-13T15:55:42.218403+0000","last_clean":"2024-09-13T15:55:42.218403+0000","last_became_active":"2024-09-13T15:54:52.947246+0000","last_became_peered":"2024-09-13T15:54:52.947246+0000","last_unstale":"2024-09-13T15:55:42.218403+0000","last_undegraded":"2024-09-13T15:55:42.218403+0000","last_fullsized":"2024-09-13T15:55:42.218403+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:12.595329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T15:55:43.237026+0000","last_change":"2024-09-13T15:55:43.237026+0000","last_active":"2024-09-13T15:55:43.237026+0000","last_peered":"2024-09-13T15:55:43.237026+0000","last_clean":"2024-09-13T15:55:43.237026+0000","last_became_active":"2024-09-13T15:55:43.236621+0000","last_became_peered":"2024-09-13T15:55:43.236621+0000","last_unstale":"2024-09-13T15:55:43.237026+0000","last_undegraded":"2024-09-13T15:55:43.237026+0000","last_fullsized":"2024-09-13T15:55:43.237026+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:59.364764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221914+0000","last_change":"2024-09-13T15:54:52.957616+0000","last_active":"2024-09-13T15:55:42.221914+0000","last_peered":"2024-09-13T15:55:42.221914+0000","last_clean":"2024-09-13T15:55:42.221914+0000","last_became_active":"2024-09-13T15:54:52.957290+0000","last_became_peered":"2024-09-13T15:54:52.957290+0000","last_unstale":"2024-09-13T15:55:42.221914+0000","last_undegraded":"2024-09-13T15:55:42.221914+0000","last_fullsized":"2024-09-13T15:55:42.221914+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:40.262838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221810+0000","last_change":"2024-09-13T15:54:52.947816+0000","last_active":"2024-09-13T15:55:42.221810+0000","last_peered":"2024-09-13T15:55:42.221810+0000","last_clean":"2024-09-13T15:55:42.221810+0000","last_became_active":"2024-09-13T15:54:52.947480+0000","last_became_peered":"2024-09-13T15:54:52.947480+0000","last_unstale":"2024-09-13T15:55:42.221810+0000","last_undegraded":"2024-09-13T15:55:42.221810+0000","last_fullsized":"2024-09-13T15:55:42.221810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:23.643741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223297+0000","last_change":"2024-09-13T15:54:52.952203+0000","last_active":"2024-09-13T15:55:42.223297+0000","last_peered":"2024-09-13T15:55:42.223297+0000","last_clean":"2024-09-13T15:55:42.223297+0000","last_became_active":"2024-09-13T15:54:52.951913+0000","last_became_peered":"2024-09-13T15:54:52.951913+0000","last_unstale":"2024-09-13T15:55:42.223297+0000","last_undegraded":"2024-09-13T15:55:42.223297+0000","last_fullsized":"2024-09-13T15:55:42.223297+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:18.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221130+0000","last_change":"2024-09-13T15:54:52.953810+0000","last_active":"2024-09-13T15:55:42.221130+0000","last_peered":"2024-09-13T15:55:42.221130+0000","last_clean":"2024-09-13T15:55:42.221130+0000","last_became_active":"2024-09-13T15:54:52.952774+0000","last_became_peered":"2024-09-13T15:54:52.952774+0000","last_unstale":"2024-09-13T15:55:42.221130+0000","last_undegraded":"2024-09-13T15:55:42.221130+0000","last_fullsized":"2024-09-13T15:55:42.221130+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:37.836176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223781+0000","last_change":"2024-09-13T15:54:52.953545+0000","last_active":"2024-09-13T15:55:42.223781+0000","last_peered":"2024-09-13T15:55:42.223781+0000","last_clean":"2024-09-13T15:55:42.223781+0000","last_became_active":"2024-09-13T15:54:52.953189+0000","last_became_peered":"2024-09-13T15:54:52.953189+0000","last_unstale":"2024-09-13T15:55:42.223781+0000","last_undegraded":"2024-09-13T15:55:42.223781+0000","last_fullsized":"2024-09-13T15:55:42.223781+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:34.130870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.218158+0000","last_change":"2024-09-13T15:54:52.953671+0000","last_active":"2024-09-13T15:55:42.218158+0000","last_peered":"2024-09-13T15:55:42.218158+0000","last_clean":"2024-09-13T15:55:42.218158+0000","last_became_active":"2024-09-13T15:54:52.952550+0000","last_became_peered":"2024-09-13T15:54:52.952550+0000","last_unstale":"2024-09-13T15:55:42.218158+0000","last_undegraded":"2024-09-13T15:55:42.218158+0000","last_fullsized":"2024-09-13T15:55:42.218158+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:48.525059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217963+0000","last_change":"2024-09-13T15:54:52.951561+0000","last_active":"2024-09-13T15:55:42.217963+0000","last_peered":"2024-09-13T15:55:42.217963+0000","last_clean":"2024-09-13T15:55:42.217963+0000","last_became_active":"2024-09-13T15:54:52.951185+0000","last_became_peered":"2024-09-13T15:54:52.951185+0000","last_unstale":"2024-09-13T15:55:42.217963+0000","last_undegraded":"2024-09-13T15:55:42.217963+0000","last_fullsized":"2024-09-13T15:55:42.217963+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:07.698614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223463+0000","last_change":"2024-09-13T15:54:52.965016+0000","last_active":"2024-09-13T15:55:42.223463+0000","last_peered":"2024-09-13T15:55:42.223463+0000","last_clean":"2024-09-13T15:55:42.223463+0000","last_became_active":"2024-09-13T15:54:52.964684+0000","last_became_peered":"2024-09-13T15:54:52.964684+0000","last_unstale":"2024-09-13T15:55:42.223463+0000","last_undegraded":"2024-09-13T15:55:42.223463+0000","last_fullsized":"2024-09-13T15:55:42.223463+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:28.491075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223043+0000","last_change":"2024-09-13T15:54:52.953679+0000","last_active":"2024-09-13T15:55:42.223043+0000","last_peered":"2024-09-13T15:55:42.223043+0000","last_clean":"2024-09-13T15:55:42.223043+0000","last_became_active":"2024-09-13T15:54:52.953409+0000","last_became_peered":"2024-09-13T15:54:52.953409+0000","last_unstale":"2024-09-13T15:55:42.223043+0000","last_undegraded":"2024-09-13T15:55:42.223043+0000","last_fullsized":"2024-09-13T15:55:42.223043+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:53.296327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.224680+0000","last_change":"2024-09-13T15:54:52.962219+0000","last_active":"2024-09-13T15:55:42.224680+0000","last_peered":"2024-09-13T15:55:42.224680+0000","last_clean":"2024-09-13T15:55:42.224680+0000","last_became_active":"2024-09-13T15:54:52.957640+0000","last_became_peered":"2024-09-13T15:54:52.957640+0000","last_unstale":"2024-09-13T15:55:42.224680+0000","last_undegraded":"2024-09-13T15:55:42.224680+0000","last_fullsized":"2024-09-13T15:55:42.224680+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:46.162478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.224736+0000","last_change":"2024-09-13T15:54:52.959852+0000","last_active":"2024-09-13T15:55:42.224736+0000","last_peered":"2024-09-13T15:55:42.224736+0000","last_clean":"2024-09-13T15:55:42.224736+0000","last_became_active":"2024-09-13T15:54:52.959495+0000","last_became_peered":"2024-09-13T15:54:52.959495+0000","last_unstale":"2024-09-13T15:55:42.224736+0000","last_undegraded":"2024-09-13T15:55:42.224736+0000","last_fullsized":"2024-09-13T15:55:42.224736+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:31.035977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221087+0000","last_change":"2024-09-13T15:54:52.954059+0000","last_active":"2024-09-13T15:55:42.221087+0000","last_peered":"2024-09-13T15:55:42.221087+0000","last_clean":"2024-09-13T15:55:42.221087+0000","last_became_active":"2024-09-13T15:54:52.953500+0000","last_became_peered":"2024-09-13T15:54:52.953500+0000","last_unstale":"2024-09-13T15:55:42.221087+0000","last_undegraded":"2024-09-13T15:55:42.221087+0000","last_fullsized":"2024-09-13T15:55:42.221087+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:07.156723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.218032+0000","last_change":"2024-09-13T15:54:52.954236+0000","last_active":"2024-09-13T15:55:42.218032+0000","last_peered":"2024-09-13T15:55:42.218032+0000","last_clean":"2024-09-13T15:55:42.218032+0000","last_became_active":"2024-09-13T15:54:52.951975+0000","last_became_peered":"2024-09-13T15:54:52.951975+0000","last_unstale":"2024-09-13T15:55:42.218032+0000","last_undegraded":"2024-09-13T15:55:42.218032+0000","last_fullsized":"2024-09-13T15:55:42.218032+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:24.261419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.227168+0000","last_change":"2024-09-13T15:54:52.960090+0000","last_active":"2024-09-13T15:55:42.227168+0000","last_peered":"2024-09-13T15:55:42.227168+0000","last_clean":"2024-09-13T15:55:42.227168+0000","last_became_active":"2024-09-13T15:54:52.959804+0000","last_became_peered":"2024-09-13T15:54:52.959804+0000","last_unstale":"2024-09-13T15:55:42.227168+0000","last_undegraded":"2024-09-13T15:55:42.227168+0000","last_fullsized":"2024-09-13T15:55:42.227168+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:27.467154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221722+0000","last_change":"2024-09-13T15:54:52.957541+0000","last_active":"2024-09-13T15:55:42.221722+0000","last_peered":"2024-09-13T15:55:42.221722+0000","last_clean":"2024-09-13T15:55:42.221722+0000","last_became_active":"2024-09-13T15:54:52.957252+0000","last_became_peered":"2024-09-13T15:54:52.957252+0000","last_unstale":"2024-09-13T15:55:42.221722+0000","last_undegraded":"2024-09-13T15:55:42.221722+0000","last_fullsized":"2024-09-13T15:55:42.221722+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:39.768018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223620+0000","last_change":"2024-09-13T15:54:52.951048+0000","last_active":"2024-09-13T15:55:42.223620+0000","last_peered":"2024-09-13T15:55:42.223620+0000","last_clean":"2024-09-13T15:55:42.223620+0000","last_became_active":"2024-09-13T15:54:52.948798+0000","last_became_peered":"2024-09-13T15:54:52.948798+0000","last_unstale":"2024-09-13T15:55:42.223620+0000","last_undegraded":"2024-09-13T15:55:42.223620+0000","last_fullsized":"2024-09-13T15:55:42.223620+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:48.081213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.221621+0000","last_change":"2024-09-13T15:54:52.952456+0000","last_active":"2024-09-13T15:55:42.221621+0000","last_peered":"2024-09-13T15:55:42.221621+0000","last_clean":"2024-09-13T15:55:42.221621+0000","last_became_active":"2024-09-13T15:54:52.951983+0000","last_became_peered":"2024-09-13T15:54:52.951983+0000","last_unstale":"2024-09-13T15:55:42.221621+0000","last_undegraded":"2024-09-13T15:55:42.221621+0000","last_fullsized":"2024-09-13T15:55:42.221621+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:06.748567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.226813+0000","last_change":"2024-09-13T15:54:52.950155+0000","last_active":"2024-09-13T15:55:42.226813+0000","last_peered":"2024-09-13T15:55:42.226813+0000","last_clean":"2024-09-13T15:55:42.226813+0000","last_became_active":"2024-09-13T15:54:52.949758+0000","last_became_peered":"2024-09-13T15:54:52.949758+0000","last_unstale":"2024-09-13T15:55:42.226813+0000","last_undegraded":"2024-09-13T15:55:42.226813+0000","last_fullsized":"2024-09-13T15:55:42.226813+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:49.117434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.220777+0000","last_change":"2024-09-13T15:54:52.953741+0000","last_active":"2024-09-13T15:55:42.220777+0000","last_peered":"2024-09-13T15:55:42.220777+0000","last_clean":"2024-09-13T15:55:42.220777+0000","last_became_active":"2024-09-13T15:54:52.952648+0000","last_became_peered":"2024-09-13T15:54:52.952648+0000","last_unstale":"2024-09-13T15:55:42.220777+0000","last_undegraded":"2024-09-13T15:55:42.220777+0000","last_fullsized":"2024-09-13T15:55:42.220777+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:56:46.640480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.222382+0000","last_change":"2024-09-13T15:54:52.948822+0000","last_active":"2024-09-13T15:55:42.222382+0000","last_peered":"2024-09-13T15:55:42.222382+0000","last_clean":"2024-09-13T15:55:42.222382+0000","last_became_active":"2024-09-13T15:54:52.948528+0000","last_became_peered":"2024-09-13T15:54:52.948528+0000","last_unstale":"2024-09-13T15:55:42.222382+0000","last_undegraded":"2024-09-13T15:55:42.222382+0000","last_fullsized":"2024-09-13T15:55:42.222382+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:28:25.700799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.217938+0000","last_change":"2024-09-13T15:54:52.950609+0000","last_active":"2024-09-13T15:55:42.217938+0000","last_peered":"2024-09-13T15:55:42.217938+0000","last_clean":"2024-09-13T15:55:42.217938+0000","last_became_active":"2024-09-13T15:54:52.949481+0000","last_became_peered":"2024-09-13T15:54:52.949481+0000","last_unstale":"2024-09-13T15:55:42.217938+0000","last_undegraded":"2024-09-13T15:55:42.217938+0000","last_fullsized":"2024-09-13T15:55:42.217938+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:59.272557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.224821+0000","last_change":"2024-09-13T15:54:52.950857+0000","last_active":"2024-09-13T15:55:42.224821+0000","last_peered":"2024-09-13T15:55:42.224821+0000","last_clean":"2024-09-13T15:55:42.224821+0000","last_became_active":"2024-09-13T15:54:52.948553+0000","last_became_peered":"2024-09-13T15:54:52.948553+0000","last_unstale":"2024-09-13T15:55:42.224821+0000","last_undegraded":"2024-09-13T15:55:42.224821+0000","last_fullsized":"2024-09-13T15:55:42.224821+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:33.644131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.225013+0000","last_change":"2024-09-13T15:54:52.965573+0000","last_active":"2024-09-13T15:55:42.225013+0000","last_peered":"2024-09-13T15:55:42.225013+0000","last_clean":"2024-09-13T15:55:42.225013+0000","last_became_active":"2024-09-13T15:54:52.961538+0000","last_became_peered":"2024-09-13T15:54:52.961538+0000","last_unstale":"2024-09-13T15:55:42.225013+0000","last_undegraded":"2024-09-13T15:55:42.225013+0000","last_fullsized":"2024-09-13T15:55:42.225013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:12.887939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T15:55:42.223440+0000","last_change":"2024-09-13T15:54:52.964064+0000","last_active":"2024-09-13T15:55:42.223440+0000","last_peered":"2024-09-13T15:55:42.223440+0000","last_clean":"2024-09-13T15:55:42.223440+0000","last_became_active":"2024-09-13T15:54:52.963770+0000","last_became_peered":"2024-09-13T15:54:52.963770+0000","last_unstale":"2024-09-13T15:55:42.223440+0000","last_undegraded":"2024-09-13T15:55:42.223440+0000","last_fullsized":"2024-09-13T15:55:42.223440+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:54:52.488575+0000","last_clean_scrub_stamp":"2024-09-13T15:54:52.488575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:28.967227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66193,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":499,"num_read_kb":320,"num_write":158,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":60747,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":198579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351010,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":1036288,"data_stored":503190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36043205},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.71799999999999997,"15min":0.748},"min":{"1min":0.41799999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79700000000000004,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.44,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78400000000000003,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.57099999999999995}]},{"osd":1,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.34200000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67200000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.628}]},{"osd":2,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45500000000000002,"15min":0.45000000000000001},"min":{"1min":0.32500000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.42599999999999999,"15min":0.41799999999999998},"min":{"1min":0.312,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":4,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.40500000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.753,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.497,"15min":0.49099999999999999},"min":{"1min":0.36699999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.84899999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.5}]},{"osd":6,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.80600000000000005,"15min":0.83999999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.77600000000000002,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97499999999999998,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.73999999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.66400000000000003,"15min":0.65800000000000003},"min":{"1min":0.496,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89500000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.753},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.51100000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81799999999999995,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.67300000000000004}]},{"osd":8,"last update":"Fri Sep 13 15:55:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.77800000000000002}]},{"osd":9,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.73799999999999999,"15min":0.73299999999999998},"min":{"1min":0.56799999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.006,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.74399999999999999,"15min":0.74099999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.81200000000000006}]},{"osd":10,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66200000000000003,"15min":0.65500000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.87,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.70699999999999996,"15min":0.69899999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.94499999999999995,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.82299999999999995}]}]},{"osd":10,"up_from":73,"seq":313532612646,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28704,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716448,"statfs":{"total":95995035648,"available":95965642752,"internally_reserved":0,"allocated":1720320,"data_stored":1152977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:55:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.46400000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:55:44 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.501,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.317,"5min":0.254,"15min":0.254},"max":{"1min":0.51800000000000002,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.28799999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:55:44 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.38900000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76700000000000002,"5min":0.872,"15min":0.872},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.82199999999999995,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.64200000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:55:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.65500000000000003,"15min":0.66500000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47299999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80900000000000005,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.52500000000000002}]},{"osd":4,"last update":"Fri Sep 13 15:55:44 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.52000000000000002,"15min":0.52900000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59099999999999997,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.55400000000000005,"15min":0.57099999999999995},"min":{"1min":0.30199999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69399999999999995,"5min":0.87,"15min":0.87},"last":0.40200000000000002}]},{"osd":5,"last update":"Fri Sep 13 15:55:44 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.439,"5min":0.379,"15min":0.379},"max":{"1min":0.748,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.624},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.46999999999999997,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.79200000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.59699999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:55:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.745,"15min":0.76000000000000001},"min":{"1min":0.52300000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.82399999999999995,"5min":1.387,"15min":1.387},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.83099999999999996,"5min":1.081,"15min":1.081},"last":0.432}]},{"osd":7,"last update":"Fri Sep 13 15:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.49299999999999999}]},{"osd":8,"last update":"Fri Sep 13 15:55:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80200000000000005,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.72199999999999998,"15min":0.73199999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.81000000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.66100000000000003}]},{"osd":9,"last update":"Fri Sep 13 15:55:44 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.78900000000000003,"15min":0.80900000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.80800000000000005,"5min":1.256,"15min":1.256},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.80200000000000005,"15min":0.82299999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.85999999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.57899999999999996}]},{"osd":11,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.53500000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.81599999999999995,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.84799999999999998,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.751}]}]},{"osd":9,"up_from":68,"seq":292057776173,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1048576,"data_stored":507410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:56:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.53400000000000003,"15min":0.55600000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73799999999999999,"5min":1.012,"15min":1.012},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.59799999999999998,"5min":1.044,"15min":1.044},"last":0.39500000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:56:13 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.73499999999999999,"15min":0.75900000000000001},"min":{"1min":0.48499999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.84399999999999997,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.82299999999999995,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.44}]},{"osd":2,"last update":"Fri Sep 13 15:56:13 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.78400000000000003,"15min":0.81000000000000005},"min":{"1min":0.53700000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86099999999999999,"5min":1.335,"15min":1.335},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.754,"15min":0.77200000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.84899999999999998,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.68000000000000005}]},{"osd":3,"last update":"Fri Sep 13 15:56:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.71899999999999997,"15min":0.76300000000000001},"min":{"1min":0.41499999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83499999999999996,"5min":1.089,"15min":1.089},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.70599999999999996,"15min":0.75900000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80900000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.58899999999999997}]},{"osd":4,"last update":"Fri Sep 13 15:56:13 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.68000000000000005,"15min":0.70199999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83099999999999996,"5min":1.071,"15min":1.071},"last":0.495},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.79700000000000004,"15min":0.83299999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.90500000000000003,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.54600000000000004}]},{"osd":5,"last update":"Fri Sep 13 15:56:13 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.84799999999999998,"15min":0.89000000000000001},"min":{"1min":0.59399999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96099999999999997,"5min":1.353,"15min":1.353},"last":0.755},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.84999999999999998,"15min":0.88600000000000001},"min":{"1min":0.51400000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93400000000000005,"5min":1.264,"15min":1.264},"last":0.81399999999999995}]},{"osd":6,"last update":"Fri Sep 13 15:54:12 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.0349999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:56:13 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.91400000000000003,"15min":0.97399999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.90700000000000003,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.88600000000000001,"15min":0.93300000000000005},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0309999999999999,"5min":1.325,"15min":1.325},"last":0.63700000000000001}]},{"osd":8,"last update":"Fri Sep 13 15:56:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.93200000000000005,"15min":0.97899999999999998},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.0029999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.81399999999999995,"15min":0.85299999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.86799999999999999,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.73299999999999998}]},{"osd":10,"last update":"Fri Sep 13 15:55:36 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.94199999999999995,"15min":0.96399999999999997},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.2290000000000001,"5min":1.298,"15min":1.298},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.93799999999999994,"15min":0.95799999999999996},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.306,"5min":1.363,"15min":1.363},"last":0.72299999999999998}]},{"osd":11,"last update":"Fri Sep 13 15:55:57 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.79500000000000004}]}]},{"osd":8,"up_from":60,"seq":257698037810,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":502791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:55:46 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39700000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81599999999999995,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.58099999999999996,"15min":0.59499999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75800000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.65500000000000003}]},{"osd":1,"last update":"Fri Sep 13 15:55:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51500000000000001,"15min":0.497},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79100000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78500000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.57299999999999995}]},{"osd":2,"last update":"Fri Sep 13 15:55:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.39300000000000002,"15min":0.38700000000000001},"min":{"1min":0.30599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.53000000000000003,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.38},"min":{"1min":0.25800000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.36499999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:55:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.60599999999999998,"15min":0.61799999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77600000000000002,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.62,"15min":0.622},"min":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77800000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.61599999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:55:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.53600000000000003,"15min":0.52900000000000003},"min":{"1min":0.433,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.53700000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.55500000000000005}]},{"osd":5,"last update":"Fri Sep 13 15:55:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.46899999999999997,"15min":0.45100000000000001},"min":{"1min":0.372,"5min":0.307,"15min":0.307},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.5},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.46700000000000003,"15min":0.45600000000000002},"min":{"1min":0.35899999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.53300000000000003}]},{"osd":6,"last update":"Fri Sep 13 15:55:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.51600000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.875,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68300000000000005,"15min":0.67700000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Sep 13 15:55:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.61799999999999999,"15min":0.60199999999999998},"min":{"1min":0.40899999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.48499999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.70199999999999996}]},{"osd":9,"last update":"Fri Sep 13 15:56:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.748,"15min":0.71399999999999997},"min":{"1min":0.55500000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":5.8890000000000002,"5min":5.8890000000000002,"15min":5.8890000000000002},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.77100000000000002,"15min":0.73299999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":5.9020000000000001,"5min":5.9020000000000001,"15min":5.9020000000000001},"last":0.71499999999999997}]},{"osd":10,"last update":"Fri Sep 13 15:55:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.68500000000000005,"15min":0.67300000000000004},"min":{"1min":0.58099999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.67300000000000004,"15min":0.66200000000000003},"min":{"1min":0.54900000000000004,"5min":0.439,"15min":0.439},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.67600000000000005}]},{"osd":11,"last update":"Fri Sep 13 15:55:54 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.80000000000000004}]}]},{"osd":7,"up_from":52,"seq":223338299446,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36808,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708344,"statfs":{"total":95995035648,"available":95957344256,"internally_reserved":0,"allocated":1634304,"data_stored":1098717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36043211},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80700000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79400000000000004,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.39600000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:56:25 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38700000000000001,"15min":0.38300000000000001},"min":{"1min":0.312,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.50800000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.38500000000000001},"min":{"1min":0.27500000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.59699999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.45800000000000002}]},{"osd":2,"last update":"Fri Sep 13 15:56:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54900000000000004,"15min":0.53600000000000003},"min":{"1min":0.36299999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69199999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.49299999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:56:25 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.44500000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76600000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.44900000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.70299999999999996}]},{"osd":4,"last update":"Fri Sep 13 15:56:25 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.44600000000000001,"15min":0.44500000000000001},"min":{"1min":0.33100000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54100000000000004,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45900000000000002,"15min":0.47499999999999998},"min":{"1min":0.29699999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.41699999999999998}]},{"osd":5,"last update":"Fri Sep 13 15:56:25 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.58899999999999997,"15min":0.57599999999999996},"min":{"1min":0.46500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.745,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.40899999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.64800000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Fri Sep 13 15:56:25 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64700000000000002,"15min":0.66400000000000003},"min":{"1min":0.44500000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.84099999999999997,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.623},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.53500000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80600000000000005,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.78600000000000003}]},{"osd":8,"last update":"Fri Sep 13 15:55:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.434,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77600000000000002,"5min":0.878,"15min":0.878},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.48499999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93899999999999995,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.65100000000000002}]},{"osd":9,"last update":"Fri Sep 13 15:56:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.56899999999999995,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92600000000000005,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70299999999999996,"15min":0.71099999999999997},"min":{"1min":0.56299999999999994,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.88800000000000001,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.58899999999999997}]},{"osd":10,"last update":"Fri Sep 13 15:56:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65900000000000003,"15min":0.66500000000000004},"min":{"1min":0.47499999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91000000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.622,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83399999999999996,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.63300000000000001}]},{"osd":11,"last update":"Fri Sep 13 15:55:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.66800000000000004}]}]},{"osd":6,"up_from":47,"seq":201863462973,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":1024000,"data_stored":498490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36043207},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.505,"15min":0.5},"min":{"1min":0.315,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.52200000000000002,"15min":0.54100000000000004},"min":{"1min":0.33500000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.85899999999999999,"5min":1.008,"15min":1.008},"last":0.67100000000000004}]},{"osd":1,"last update":"Fri Sep 13 15:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65600000000000003,"15min":0.67100000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.97699999999999998,"5min":1.113,"15min":1.113},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.86799999999999999,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68799999999999994}]},{"osd":2,"last update":"Fri Sep 13 15:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.50700000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88300000000000001,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.72199999999999998,"15min":0.72699999999999998},"min":{"1min":0.45400000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94499999999999995,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.74299999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.64900000000000002,"15min":0.66500000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0169999999999999,"5min":1.121,"15min":1.121},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.66100000000000003,"15min":0.67200000000000004},"min":{"1min":0.499,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.61899999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68600000000000005,"15min":0.72199999999999998},"min":{"1min":0.47499999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.82599999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.753,"15min":0.751},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.056,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.79000000000000004}]},{"osd":5,"last update":"Fri Sep 13 15:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.53000000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.88200000000000001,"5min":1.032,"15min":1.032},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.76100000000000001,"15min":0.79900000000000004},"min":{"1min":0.53600000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92600000000000005,"5min":1.236,"15min":1.236},"last":0.75600000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:56:19 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.57899999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.91200000000000003,"5min":1.056,"15min":1.056},"last":1.002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78700000000000003,"15min":0.76700000000000002},"min":{"1min":0.60399999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.0329999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.97099999999999997}]},{"osd":8,"last update":"Fri Sep 13 15:55:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.83799999999999997,"15min":0.86099999999999999},"min":{"1min":0.61599999999999999,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.077,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.81699999999999995,"15min":0.82699999999999996},"min":{"1min":0.60499999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.66100000000000003}]},{"osd":9,"last update":"Fri Sep 13 15:56:13 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.874,"15min":0.91200000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.98599999999999999,"5min":1.222,"15min":1.222},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.872,"15min":0.89200000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96999999999999997,"5min":1.3,"15min":1.3},"last":0.73199999999999998}]},{"osd":10,"last update":"Fri Sep 13 15:55:39 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.68600000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.91000000000000003,"15min":0.91200000000000003},"min":{"1min":0.69299999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.81699999999999995}]},{"osd":11,"last update":"Fri Sep 13 15:55:56 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.88600000000000001}]}]},{"osd":5,"up_from":39,"seq":167503724608,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1646592,"data_stored":1094292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:55:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.56100000000000005,"15min":0.54700000000000004},"min":{"1min":0.38600000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.78500000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65000000000000002,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.34499999999999997}]},{"osd":1,"last update":"Fri Sep 13 15:55:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.503,"15min":0.49199999999999999},"min":{"1min":0.36399999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.51400000000000001,"15min":0.49199999999999999},"min":{"1min":0.34899999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.497}]},{"osd":2,"last update":"Fri Sep 13 15:55:32 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.378,"15min":0.37},"min":{"1min":0.28299999999999997,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.25,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60199999999999998,"5min":0.749,"15min":0.749},"last":0.434}]},{"osd":3,"last update":"Fri Sep 13 15:55:32 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.56699999999999995,"15min":0.58599999999999997},"min":{"1min":0.372,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80700000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.433,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.70099999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri Sep 13 15:55:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.53800000000000003},"min":{"1min":0.45600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75900000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54700000000000004,"15min":0.53100000000000003},"min":{"1min":0.42099999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.47499999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:55:58 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.62,"15min":0.60499999999999998},"min":{"1min":0.46300000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81599999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.624},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.47499999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84499999999999997,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.59099999999999997}]},{"osd":7,"last update":"Fri Sep 13 15:56:20 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.60099999999999998,"15min":0.57599999999999996},"min":{"1min":0.48799999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85899999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.58699999999999997,"15min":0.56899999999999995},"min":{"1min":0.45800000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.55800000000000005}]},{"osd":8,"last update":"Fri Sep 13 15:55:44 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51700000000000002,"15min":0.53000000000000003},"min":{"1min":0.35299999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73299999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57799999999999996,"15min":0.59799999999999998},"min":{"1min":0.32300000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.80000000000000004,"5min":1.024,"15min":1.024},"last":0.57799999999999996}]},{"osd":9,"last update":"Fri Sep 13 15:56:16 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68899999999999995,"15min":0.69499999999999995},"min":{"1min":0.54100000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.83399999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.58799999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.80300000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.56799999999999995}]},{"osd":10,"last update":"Fri Sep 13 15:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.64100000000000001,"15min":0.63},"min":{"1min":0.49099999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.62,"15min":0.60399999999999998},"min":{"1min":0.495,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.63900000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888133,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1110016,"data_stored":565771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:54:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.55000000000000004,"15min":0.53300000000000003},"min":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.83199999999999996,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.41299999999999998}]},{"osd":1,"last update":"Fri Sep 13 15:56:11 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.377,"15min":0.35299999999999998},"min":{"1min":0.27800000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.50800000000000001,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.379,"15min":0.35999999999999999},"min":{"1min":0.31,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52700000000000002,"5min":0.629,"15min":0.629},"last":0.35399999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:56:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53300000000000003,"15min":0.51100000000000001},"min":{"1min":0.39300000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.77600000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.52400000000000002},"min":{"1min":0.44400000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.65000000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.53900000000000003}]},{"osd":3,"last update":"Fri Sep 13 15:56:11 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.56200000000000006},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.79600000000000004,"5min":0.878,"15min":0.878},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60999999999999999,"15min":0.56299999999999994},"min":{"1min":0.38100000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79300000000000004,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":0.505}]},{"osd":5,"last update":"Fri Sep 13 15:56:28 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60599999999999998,"15min":0.57899999999999996},"min":{"1min":0.432,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83999999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.437},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60899999999999999,"15min":0.57299999999999995},"min":{"1min":0.45700000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79300000000000004,"5min":0.995,"15min":0.995},"last":0.52400000000000002}]},{"osd":6,"last update":"Fri Sep 13 15:55:57 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.627,"15min":0.61699999999999999},"min":{"1min":0.44700000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80800000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63600000000000001,"15min":0.63200000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86399999999999999,"5min":0.873,"15min":0.873},"last":0.55900000000000005}]},{"osd":7,"last update":"Fri Sep 13 15:56:22 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.34399999999999997,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77400000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.51700000000000002},"min":{"1min":0.372,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84099999999999997,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.57799999999999996}]},{"osd":8,"last update":"Fri Sep 13 15:55:44 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.621,"15min":0.61299999999999999},"min":{"1min":0.46899999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88800000000000001,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.61799999999999999,"15min":0.60199999999999998},"min":{"1min":0.52400000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.85999999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.64300000000000002}]},{"osd":9,"last update":"Fri Sep 13 15:56:15 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.72099999999999997},"min":{"1min":0.55400000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94799999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71299999999999997,"15min":0.72099999999999997},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91500000000000004,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.67900000000000005}]},{"osd":10,"last update":"Fri Sep 13 15:55:36 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.86199999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.68100000000000005,"15min":0.68700000000000006},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.628}]},{"osd":11,"last update":"Fri Sep 13 15:55:51 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.66300000000000003}]}]},{"osd":3,"up_from":26,"seq":111669149771,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":1032192,"data_stored":498403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:55:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.48699999999999999,"15min":0.42499999999999999},"min":{"1min":0.31900000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":3.8069999999999999,"5min":3.8069999999999999,"15min":3.8069999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.49399999999999999,"15min":0.438},"min":{"1min":0.30399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":4.0590000000000002,"5min":4.0590000000000002,"15min":4.0590000000000002},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:55:49 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.69399999999999995,"15min":0.61699999999999999},"min":{"1min":0.55000000000000004,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.7330000000000001,"5min":3.7330000000000001,"15min":3.7330000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.68600000000000005,"15min":0.61399999999999999},"min":{"1min":0.46500000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":3.8820000000000001,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":0.87}]},{"osd":2,"last update":"Fri Sep 13 15:55:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65700000000000003,"15min":0.621},"min":{"1min":0.45800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.70199999999999996,"15min":0.67200000000000004},"min":{"1min":0.42299999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":3.6560000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":0.69299999999999995}]},{"osd":4,"last update":"Fri Sep 13 15:56:09 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.72399999999999998,"15min":0.65700000000000003},"min":{"1min":0.497,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.79,"5min":3.79,"15min":3.79},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.68000000000000005,"15min":0.63300000000000001},"min":{"1min":0.504,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1879999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Sep 13 15:56:30 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.74299999999999999,"15min":0.66800000000000004},"min":{"1min":0.51100000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":3.6989999999999998,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.70499999999999996,"15min":0.64700000000000002},"min":{"1min":0.54700000000000004,"5min":0.436,"15min":0.436},"max":{"1min":3.9470000000000001,"5min":3.9470000000000001,"15min":3.9470000000000001},"last":0.67300000000000004}]},{"osd":6,"last update":"Fri Sep 13 15:55:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.69099999999999995,"15min":0.64700000000000002},"min":{"1min":0.47799999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":4.0910000000000002,"5min":4.0910000000000002,"15min":4.0910000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.745,"15min":0.72299999999999998},"min":{"1min":0.54200000000000004,"5min":0.374,"15min":0.374},"max":{"1min":3.5249999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.54100000000000004}]},{"osd":7,"last update":"Fri Sep 13 15:56:26 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":0.84899999999999998,"15min":0.79500000000000004},"min":{"1min":0.56599999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":3.762,"5min":3.762,"15min":3.762},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.77200000000000002,"15min":0.72999999999999998},"min":{"1min":0.53600000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":3.847,"5min":3.847,"15min":3.847},"last":0.89100000000000001}]},{"osd":8,"last update":"Fri Sep 13 15:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.75600000000000001,"15min":0.753},"min":{"1min":0.54700000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.044,"5min":1.079,"15min":1.079},"last":0.747},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.61699999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1899999999999999,"5min":1.466,"15min":1.466},"last":0.64200000000000002}]},{"osd":9,"last update":"Fri Sep 13 15:56:18 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":0.84499999999999997,"15min":0.82099999999999995},"min":{"1min":0.56999999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":4.1219999999999999,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.02,"5min":0.91400000000000003,"15min":0.90400000000000003},"min":{"1min":0.625,"5min":0.495,"15min":0.495},"max":{"1min":3.5699999999999998,"5min":3.5699999999999998,"15min":3.5699999999999998},"last":0.82699999999999996}]},{"osd":10,"last update":"Fri Sep 13 15:55:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.95599999999999996,"15min":0.93899999999999995},"min":{"1min":0.75800000000000001,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":3.8210000000000002,"5min":3.8210000000000002,"15min":3.8210000000000002},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.995,"5min":0.81299999999999994,"15min":0.78300000000000003},"min":{"1min":0.60899999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":3.9140000000000001,"5min":3.9140000000000001,"15min":3.9140000000000001},"last":0.83899999999999997}]},{"osd":11,"last update":"Fri Sep 13 15:55:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":3.9769999999999999,"5min":3.9769999999999999,"15min":3.9769999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":4.0270000000000001,"5min":4.0270000000000001,"15min":4.0270000000000001},"last":0.77700000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":499702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:56:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55500000000000005,"15min":0.52700000000000002},"min":{"1min":0.373,"5min":0.30499999999999999,"15min":0.29799999999999999},"max":{"1min":0.82199999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53600000000000003,"15min":0.51400000000000001},"min":{"1min":0.35599999999999998,"5min":0.34499999999999997,"15min":0.26900000000000002},"max":{"1min":0.68999999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.39500000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:56:23 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.53300000000000003,"15min":0.48099999999999998},"min":{"1min":0.40600000000000003,"5min":0.29499999999999998,"15min":0.23899999999999999},"max":{"1min":0.73999999999999999,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.53600000000000003,"15min":0.498},"min":{"1min":0.38200000000000001,"5min":0.32800000000000001,"15min":0.249},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.55100000000000005}]},{"osd":3,"last update":"Fri Sep 13 15:55:48 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.57199999999999995,"15min":0.55200000000000005},"min":{"1min":0.35799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.374,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.56799999999999995}]},{"osd":4,"last update":"Fri Sep 13 15:55:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Sep 13 15:56:32 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41499999999999998,"15min":0.40799999999999997},"min":{"1min":0.34899999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.63500000000000001,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.38},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.436,"15min":0.41399999999999998},"min":{"1min":0.32100000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.70099999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.51400000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.62,"15min":0.59399999999999997},"min":{"1min":0.44600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.626,"15min":0.61499999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.71799999999999997}]},{"osd":8,"last update":"Fri Sep 13 15:55:48 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52600000000000002,"15min":0.52100000000000002},"min":{"1min":0.33200000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.57499999999999996,"15min":0.56100000000000005},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.65000000000000002}]},{"osd":9,"last update":"Fri Sep 13 15:56:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66400000000000003,"15min":0.65300000000000002},"min":{"1min":0.51900000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.626},{"interface":"front","average":{"1min":0.755,"5min":0.70199999999999996,"15min":0.69399999999999995},"min":{"1min":0.52200000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.66500000000000004}]},{"osd":10,"last update":"Fri Sep 13 15:55:39 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.63200000000000001,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.65600000000000003,"15min":0.64200000000000002},"min":{"1min":0.46800000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.79600000000000004}]},{"osd":11,"last update":"Fri Sep 13 15:55:54 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.72699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":560414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:56:01 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.55800000000000005,"15min":0.496},"min":{"1min":0.42699999999999999,"5min":0.317,"15min":0.253},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.56999999999999995,"15min":0.51500000000000001},"min":{"1min":0.40699999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.81499999999999995,"5min":1.2,"15min":1.2},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri Sep 13 15:56:33 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59399999999999997,"15min":0.52200000000000002},"min":{"1min":0.46300000000000002,"5min":0.31,"15min":0.27000000000000002},"max":{"1min":0.92700000000000005,"5min":5.1790000000000003,"15min":5.1790000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.53200000000000003,"15min":0.48699999999999999},"min":{"1min":0.46800000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.5}]},{"osd":3,"last update":"Fri Sep 13 15:55:45 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56899999999999995,"15min":0.53500000000000003},"min":{"1min":0.40000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.96199999999999997,"5min":1.087,"15min":1.087},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53600000000000003,"15min":0.52000000000000002},"min":{"1min":0.34300000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Sep 13 15:56:06 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.42599999999999999,"15min":0.378},"min":{"1min":0.33000000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.71799999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.498,"5min":0.442,"15min":0.39800000000000002},"min":{"1min":0.33900000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.81299999999999994}]},{"osd":5,"last update":"Fri Sep 13 15:56:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.629,"15min":0.55400000000000005},"min":{"1min":0.48499999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.98599999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67000000000000004,"15min":0.56599999999999995},"min":{"1min":0.56899999999999995,"5min":0.374,"15min":0.374},"max":{"1min":0.85699999999999998,"5min":5.194,"15min":5.194},"last":0.75600000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:56:01 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.63900000000000001,"15min":0.61499999999999999},"min":{"1min":0.504,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92800000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67300000000000004,"15min":0.64900000000000002},"min":{"1min":0.56000000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0349999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.91300000000000003}]},{"osd":7,"last update":"Fri Sep 13 15:56:33 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54200000000000004,"15min":0.51300000000000001},"min":{"1min":0.40400000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.59899999999999998,"15min":0.56100000000000005},"min":{"1min":0.43099999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.93300000000000005}]},{"osd":8,"last update":"Fri Sep 13 15:55:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.69599999999999995,"15min":0.64000000000000001},"min":{"1min":0.55100000000000005,"5min":0.372,"15min":0.372},"max":{"1min":1.0169999999999999,"5min":5.2149999999999999,"15min":5.2149999999999999},"last":0.87},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.40999999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85799999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.61399999999999999}]},{"osd":9,"last update":"Fri Sep 13 15:56:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.58299999999999996,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.04,"5min":1.111,"15min":1.111},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.76900000000000002,"15min":0.76500000000000001},"min":{"1min":0.59599999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0209999999999999,"5min":1.325,"15min":1.325},"last":0.95399999999999996}]},{"osd":10,"last update":"Fri Sep 13 15:55:36 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.68799999999999994,"15min":0.68000000000000005},"min":{"1min":0.46000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97899999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.79800000000000004}]},{"osd":11,"last update":"Fri Sep 13 15:55:55 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.82999999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":499878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65000000000000002,"15min":0.61199999999999999},"min":{"1min":0.503,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.96899999999999997,"5min":1.304,"15min":1.6870000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.67700000000000005,"15min":0.60299999999999998},"min":{"1min":0.52100000000000002,"5min":0.41399999999999998,"15min":0.41299999999999998},"max":{"1min":0.93799999999999994,"5min":1.081,"15min":1.081},"last":0.89500000000000002}]},{"osd":2,"last update":"Fri Sep 13 15:56:21 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68300000000000005,"15min":0.61399999999999999},"min":{"1min":0.45300000000000001,"5min":0.40100000000000002,"15min":0.37},"max":{"1min":0.93500000000000005,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70699999999999996,"15min":0.63100000000000001},"min":{"1min":0.42999999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86799999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":1.0820000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:55:53 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.98399999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:56:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67700000000000005,"15min":0.58199999999999996},"min":{"1min":0.499,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92400000000000004,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.63900000000000001,"15min":0.57699999999999996},"min":{"1min":0.47399999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93899999999999995,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri Sep 13 15:55:39 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.64500000000000002},"min":{"1min":0.46000000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.88600000000000001,"5min":1.018,"15min":1.018},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.70599999999999996,"15min":0.67000000000000004},"min":{"1min":0.52700000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95699999999999996,"5min":1.167,"15min":1.167},"last":1.0609999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.627,"15min":0.64700000000000002},"min":{"1min":0.36299999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90100000000000002,"5min":1.151,"15min":1.151},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47399999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.91200000000000003,"5min":1.125,"15min":1.125},"last":0.54900000000000004}]},{"osd":7,"last update":"Fri Sep 13 15:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.94799999999999995}]},{"osd":8,"last update":"Fri Sep 13 15:55:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.60199999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.997,"5min":1.224,"15min":1.224},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.81200000000000006,"15min":0.81799999999999995},"min":{"1min":0.56399999999999995,"5min":0.438,"15min":0.438},"max":{"1min":1.111,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.88}]},{"osd":9,"last update":"Fri Sep 13 15:56:13 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.86199999999999999,"15min":0.89000000000000001},"min":{"1min":0.55500000000000005,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0940000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90500000000000003,"15min":0.93899999999999995},"min":{"1min":0.50700000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1619999999999999,"5min":1.419,"15min":1.419},"last":0.83799999999999997}]},{"osd":10,"last update":"Fri Sep 13 15:55:39 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.94099999999999995,"15min":0.94899999999999995},"min":{"1min":0.59899999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.109,"5min":1.391,"15min":1.391},"last":1.034},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.89700000000000002,"15min":0.90800000000000003},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.159,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.64100000000000001}]},{"osd":11,"last update":"Fri Sep 13 15:56:02 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.87,"15min":0.871},"min":{"1min":0.748,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.054,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":1.004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.90000000000000002,"15min":0.90800000000000003},"min":{"1min":0.60499999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.82299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":64209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:56:39.860 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-13T15:56:39.860 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T15:56:39.861 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-13T15:56:39.861 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-13T15:56:40.184 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:56:40.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:40 smithi193 ceph-mon[35248]: pgmap v351: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:56:40.510 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:40 smithi017 ceph-mon[30494]: pgmap v351: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:56:40.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:40 smithi189 ceph-mon[34790]: pgmap v351: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:56:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.362+0000 7f8430c00640 1 -- 172.21.15.17:0/4106672835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f842c107330 msgr2=0x7f842c10eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.362+0000 7f8430c00640 1 --2- 172.21.15.17:0/4106672835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f842c107330 0x7f842c10eeb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8424009cd0 tx=0x7f842402a8f0 comp rx=0 tx=0).stop 2024-09-13T15:56:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.362+0000 7f8430c00640 1 -- 172.21.15.17:0/4106672835 shutdown_connections 2024-09-13T15:56:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.362+0000 7f8430c00640 1 --2- 172.21.15.17:0/4106672835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f842c107330 0x7f842c10eeb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.362+0000 7f8430c00640 1 --2- 172.21.15.17:0/4106672835 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f842c102bb0 0x7f842c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.362+0000 7f8430c00640 1 --2- 172.21.15.17:0/4106672835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f842c102200 0x7f842c1025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.362+0000 7f8430c00640 1 -- 172.21.15.17:0/4106672835 >> 172.21.15.17:0/4106672835 conn(0x7f842c0fdc60 msgr2=0x7f842c100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.362+0000 7f8430c00640 1 -- 172.21.15.17:0/4106672835 shutdown_connections 2024-09-13T15:56:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.362+0000 7f8430c00640 1 -- 172.21.15.17:0/4106672835 wait complete. 2024-09-13T15:56:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.363+0000 7f8430c00640 1 Processor -- start 2024-09-13T15:56:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.363+0000 7f8430c00640 1 -- start start 2024-09-13T15:56:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.363+0000 7f8430c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f842c102200 0x7f842c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.363+0000 7f8430c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f842c102bb0 0x7f842c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.363+0000 7f8430c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f842c107330 0x7f842c19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.363+0000 7f8430c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c19d380 con 0x7f842c102bb0 2024-09-13T15:56:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.363+0000 7f8430c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c19d4f0 con 0x7f842c102200 2024-09-13T15:56:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.363+0000 7f8430c00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c19d660 con 0x7f842c107330 2024-09-13T15:56:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.364+0000 7f8429e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f842c102200 0x7f842c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.364+0000 7f8429400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f842c102bb0 0x7f842c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.364+0000 7f8429e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f842c102200 0x7f842c198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:50978/0 (socket says 172.21.15.17:50978) 2024-09-13T15:56:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.364+0000 7f8429e00640 1 -- 172.21.15.17:0/1277587313 learned_addr learned my addr 172.21.15.17:0/1277587313 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.364+0000 7f842a800640 1 --2- 172.21.15.17:0/1277587313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f842c107330 0x7f842c19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.364+0000 7f8429400640 1 -- 172.21.15.17:0/1277587313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f842c107330 msgr2=0x7f842c19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.364+0000 7f8429400640 1 --2- 172.21.15.17:0/1277587313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f842c107330 0x7f842c19cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.364+0000 7f8429400640 1 -- 172.21.15.17:0/1277587313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f842c102200 msgr2=0x7f842c198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.364+0000 7f8429400640 1 --2- 172.21.15.17:0/1277587313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f842c102200 0x7f842c198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.364+0000 7f8429400640 1 -- 172.21.15.17:0/1277587313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8418009490 con 0x7f842c102bb0 2024-09-13T15:56:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.364+0000 7f8429400640 1 --2- 172.21.15.17:0/1277587313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f842c102bb0 0x7f842c198980 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f841800e9f0 tx=0x7f841800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.365+0000 7f8422a00640 1 -- 172.21.15.17:0/1277587313 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841800cd80 con 0x7f842c102bb0 2024-09-13T15:56:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.365+0000 7f8422a00640 1 -- 172.21.15.17:0/1277587313 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84180035f0 con 0x7f842c102bb0 2024-09-13T15:56:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.365+0000 7f8430c00640 1 -- 172.21.15.17:0/1277587313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8424009900 con 0x7f842c102bb0 2024-09-13T15:56:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.365+0000 7f8422a00640 1 -- 172.21.15.17:0/1277587313 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84180044e0 con 0x7f842c102bb0 2024-09-13T15:56:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.365+0000 7f8430c00640 1 -- 172.21.15.17:0/1277587313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842c1a5030 con 0x7f842c102bb0 2024-09-13T15:56:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.366+0000 7f8430c00640 1 -- 172.21.15.17:0/1277587313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f842c1036e0 con 0x7f842c102bb0 2024-09-13T15:56:42.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.368+0000 7f8422a00640 1 -- 172.21.15.17:0/1277587313 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f8418003a60 con 0x7f842c102bb0 2024-09-13T15:56:42.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.369+0000 7f8422a00640 1 --2- 172.21.15.17:0/1277587313 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f84100a1110 0x7f84100a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:42.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.369+0000 7f8422a00640 1 -- 172.21.15.17:0/1277587313 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f8418014070 con 0x7f842c102bb0 2024-09-13T15:56:42.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.369+0000 7f8429e00640 1 --2- 172.21.15.17:0/1277587313 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f84100a1110 0x7f84100a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:42.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.370+0000 7f8429e00640 1 --2- 172.21.15.17:0/1277587313 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f84100a1110 0x7f84100a35d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f841c009c90 tx=0x7f841c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:42.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.373+0000 7f8422a00640 1 -- 172.21.15.17:0/1277587313 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8418096460 con 0x7f842c102bb0 2024-09-13T15:56:42.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.590+0000 7f8430c00640 1 -- 172.21.15.17:0/1277587313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f842c1025e0 con 0x7f842c102bb0 2024-09-13T15:56:42.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.590+0000 7f8422a00640 1 -- 172.21.15.17:0/1277587313 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8418099a80 con 0x7f842c102bb0 2024-09-13T15:56:42.592 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:56:42.592 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T15:56:42.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.593+0000 7f8430c00640 1 -- 172.21.15.17:0/1277587313 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f84100a1110 msgr2=0x7f84100a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:42.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.593+0000 7f8430c00640 1 --2- 172.21.15.17:0/1277587313 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f84100a1110 0x7f84100a35d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f841c009c90 tx=0x7f841c005f90 comp rx=0 tx=0).stop 2024-09-13T15:56:42.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.593+0000 7f8430c00640 1 -- 172.21.15.17:0/1277587313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f842c102bb0 msgr2=0x7f842c198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:42.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.593+0000 7f8430c00640 1 --2- 172.21.15.17:0/1277587313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f842c102bb0 0x7f842c198980 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f841800e9f0 tx=0x7f841800eeb0 comp rx=0 tx=0).stop 2024-09-13T15:56:42.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.593+0000 7f8430c00640 1 -- 172.21.15.17:0/1277587313 shutdown_connections 2024-09-13T15:56:42.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.593+0000 7f8430c00640 1 --2- 172.21.15.17:0/1277587313 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f84100a1110 0x7f84100a35d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:42.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.593+0000 7f8430c00640 1 --2- 172.21.15.17:0/1277587313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f842c107330 0x7f842c19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:42.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.593+0000 7f8430c00640 1 --2- 172.21.15.17:0/1277587313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f842c102bb0 0x7f842c198980 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:42.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.593+0000 7f8430c00640 1 --2- 172.21.15.17:0/1277587313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f842c102200 0x7f842c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:42.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.593+0000 7f8430c00640 1 -- 172.21.15.17:0/1277587313 >> 172.21.15.17:0/1277587313 conn(0x7f842c0fdc60 msgr2=0x7f842c0ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:42.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.593+0000 7f8430c00640 1 -- 172.21.15.17:0/1277587313 shutdown_connections 2024-09-13T15:56:42.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:42.593+0000 7f8430c00640 1 -- 172.21.15.17:0/1277587313 wait complete. 2024-09-13T15:56:43.466 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:43 smithi017 ceph-mon[30494]: pgmap v352: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:43.466 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]: dispatch 2024-09-13T15:56:43.466 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8, 3, 9]}]: dispatch 2024-09-13T15:56:43.466 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-13T15:56:43.466 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:43 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1277587313' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T15:56:43.494 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-13T15:56:43.495 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:56:43.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:43 smithi193 ceph-mon[35248]: pgmap v352: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:43.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]: dispatch 2024-09-13T15:56:43.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8, 3, 9]}]: dispatch 2024-09-13T15:56:43.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-13T15:56:43.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:43 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1277587313' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T15:56:43.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:43 smithi189 ceph-mon[34790]: pgmap v352: 129 pgs: 129 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:56:43.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]: dispatch 2024-09-13T15:56:43.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8, 3, 9]}]: dispatch 2024-09-13T15:56:43.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-13T15:56:43.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:43 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1277587313' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T15:56:43.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.654+0000 7f6d4fa00640 1 -- 172.21.15.17:0/2126134116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d480ffda0 msgr2=0x7f6d481001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:43.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.654+0000 7f6d4fa00640 1 --2- 172.21.15.17:0/2126134116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d480ffda0 0x7f6d481001a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009900 tx=0x7f6d3c02a400 comp rx=0 tx=0).stop 2024-09-13T15:56:43.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.654+0000 7f6d4fa00640 1 -- 172.21.15.17:0/2126134116 shutdown_connections 2024-09-13T15:56:43.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.654+0000 7f6d4fa00640 1 --2- 172.21.15.17:0/2126134116 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d48101950 0x7f6d481081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:43.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.654+0000 7f6d4fa00640 1 --2- 172.21.15.17:0/2126134116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d48100f90 0x7f6d48101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:43.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.654+0000 7f6d4fa00640 1 --2- 172.21.15.17:0/2126134116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d480ffda0 0x7f6d481001a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:43.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.654+0000 7f6d4fa00640 1 -- 172.21.15.17:0/2126134116 >> 172.21.15.17:0/2126134116 conn(0x7f6d480fb520 msgr2=0x7f6d480fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:43.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.654+0000 7f6d4fa00640 1 -- 172.21.15.17:0/2126134116 shutdown_connections 2024-09-13T15:56:43.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.654+0000 7f6d4fa00640 1 -- 172.21.15.17:0/2126134116 wait complete. 2024-09-13T15:56:43.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.655+0000 7f6d4fa00640 1 Processor -- start 2024-09-13T15:56:43.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.655+0000 7f6d4fa00640 1 -- start start 2024-09-13T15:56:43.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.656+0000 7f6d4fa00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d480ffda0 0x7f6d48198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.656+0000 7f6d4fa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d48100f90 0x7f6d48198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.656+0000 7f6d4fa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d48101950 0x7f6d4819f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.656+0000 7f6d4fa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4819fb10 con 0x7f6d48100f90 2024-09-13T15:56:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.656+0000 7f6d4fa00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4819fc80 con 0x7f6d48101950 2024-09-13T15:56:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.656+0000 7f6d4fa00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4819fe40 con 0x7f6d480ffda0 2024-09-13T15:56:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.656+0000 7f6d47e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d48100f90 0x7f6d48198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.656+0000 7f6d4d000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d480ffda0 0x7f6d48198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.656+0000 7f6d4d000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d480ffda0 0x7f6d48198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:37638/0 (socket says 172.21.15.17:37638) 2024-09-13T15:56:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.656+0000 7f6d4d000640 1 -- 172.21.15.17:0/941400152 learned_addr learned my addr 172.21.15.17:0/941400152 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.656+0000 7f6d4da00640 1 --2- 172.21.15.17:0/941400152 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d48101950 0x7f6d4819f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.656+0000 7f6d4d000640 1 -- 172.21.15.17:0/941400152 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d48101950 msgr2=0x7f6d4819f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:43.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.657+0000 7f6d4d000640 1 --2- 172.21.15.17:0/941400152 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d48101950 0x7f6d4819f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:43.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.657+0000 7f6d4d000640 1 -- 172.21.15.17:0/941400152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d48100f90 msgr2=0x7f6d48198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:43.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.657+0000 7f6d4d000640 1 --2- 172.21.15.17:0/941400152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d48100f90 0x7f6d48198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:43.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.657+0000 7f6d4d000640 1 -- 172.21.15.17:0/941400152 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c009560 con 0x7f6d480ffda0 2024-09-13T15:56:43.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.657+0000 7f6d47e00640 1 --2- 172.21.15.17:0/941400152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d48100f90 0x7f6d48198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:43.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.657+0000 7f6d4d000640 1 --2- 172.21.15.17:0/941400152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d480ffda0 0x7f6d48198020 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c031500 tx=0x7f6d3c003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:43.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.657+0000 7f6d45600640 1 -- 172.21.15.17:0/941400152 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c003e00 con 0x7f6d480ffda0 2024-09-13T15:56:43.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.657+0000 7f6d4fa00640 1 -- 172.21.15.17:0/941400152 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d481a00c0 con 0x7f6d480ffda0 2024-09-13T15:56:43.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.657+0000 7f6d45600640 1 -- 172.21.15.17:0/941400152 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d3c031c70 con 0x7f6d480ffda0 2024-09-13T15:56:43.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.657+0000 7f6d4fa00640 1 -- 172.21.15.17:0/941400152 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d481a05c0 con 0x7f6d480ffda0 2024-09-13T15:56:43.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.657+0000 7f6d45600640 1 -- 172.21.15.17:0/941400152 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c03bc00 con 0x7f6d480ffda0 2024-09-13T15:56:43.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.658+0000 7f6d4fa00640 1 -- 172.21.15.17:0/941400152 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4810b6b0 con 0x7f6d480ffda0 2024-09-13T15:56:43.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.660+0000 7f6d45600640 1 -- 172.21.15.17:0/941400152 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6d3c03b460 con 0x7f6d480ffda0 2024-09-13T15:56:43.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.662+0000 7f6d45600640 1 --2- 172.21.15.17:0/941400152 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6d300a1090 0x7f6d300a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:43.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.662+0000 7f6d45600640 1 -- 172.21.15.17:0/941400152 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f6d3c0ed8d0 con 0x7f6d480ffda0 2024-09-13T15:56:43.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.662+0000 7f6d47e00640 1 --2- 172.21.15.17:0/941400152 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6d300a1090 0x7f6d300a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:43.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.663+0000 7f6d47e00640 1 --2- 172.21.15.17:0/941400152 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6d300a1090 0x7f6d300a3550 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6d48199530 tx=0x7f6d34005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:43.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.664+0000 7f6d45600640 1 -- 172.21.15.17:0/941400152 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6d3c0b6d60 con 0x7f6d480ffda0 2024-09-13T15:56:43.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.847+0000 7f6d4fa00640 1 -- 172.21.15.17:0/941400152 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d481a0940 con 0x7f6d480ffda0 2024-09-13T15:56:43.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.850+0000 7f6d45600640 1 -- 172.21.15.17:0/941400152 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+24575 (secure 0 0 0) 0x7f6d3c0ba380 con 0x7f6d480ffda0 2024-09-13T15:56:43.851 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:56:43.852 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":93,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","created":"2024-09-13T15:46:50.475750+0000","modified":"2024-09-13T15:56:43.222102+0000","last_up_change":"2024-09-13T15:53:59.138985+0000","last_in_change":"2024-09-13T15:53:39.220264+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:50:10.657011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:54:51.436469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:54:52.427930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:54:55.478058+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5d39d6af-15e6-463b-b9ff-a9a5dd94e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6803","nonce":158651212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6805","nonce":158651212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6809","nonce":158651212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6807","nonce":158651212}]},"public_addr":"172.21.15.17:6803/158651212","cluster_addr":"172.21.15.17:6805/158651212","heartbeat_back_addr":"172.21.15.17:6809/158651212","heartbeat_front_addr":"172.21.15.17:6807/158651212","state":["exists","up"]},{"osd":1,"uuid":"0da621c7-645b-44ae-ba7c-a573861c3aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6801","nonce":964319421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6803","nonce":964319421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6807","nonce":964319421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6805","nonce":964319421}]},"public_addr":"172.21.15.189:6801/964319421","cluster_addr":"172.21.15.189:6803/964319421","heartbeat_back_addr":"172.21.15.189:6807/964319421","heartbeat_front_addr":"172.21.15.189:6805/964319421","state":["exists","up"]},{"osd":2,"uuid":"fa95af60-1486-4a29-8c79-8a73a4146552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6801","nonce":138468002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6803","nonce":138468002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6807","nonce":138468002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6805","nonce":138468002}]},"public_addr":"172.21.15.193:6801/138468002","cluster_addr":"172.21.15.193:6803/138468002","heartbeat_back_addr":"172.21.15.193:6807/138468002","heartbeat_front_addr":"172.21.15.193:6805/138468002","state":["exists","up"]},{"osd":3,"uuid":"90428e5f-dfd4-4cda-b240-fdb9079bcb7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6811","nonce":919913803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6813","nonce":919913803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6817","nonce":919913803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6815","nonce":919913803}]},"public_addr":"172.21.15.17:6811/919913803","cluster_addr":"172.21.15.17:6813/919913803","heartbeat_back_addr":"172.21.15.17:6817/919913803","heartbeat_front_addr":"172.21.15.17:6815/919913803","state":["exists","up"]},{"osd":4,"uuid":"e1c537b6-98d2-4b66-b15a-65fe70b0ce25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6809","nonce":2310375565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6811","nonce":2310375565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6815","nonce":2310375565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6813","nonce":2310375565}]},"public_addr":"172.21.15.189:6809/2310375565","cluster_addr":"172.21.15.189:6811/2310375565","heartbeat_back_addr":"172.21.15.189:6815/2310375565","heartbeat_front_addr":"172.21.15.189:6813/2310375565","state":["exists","up"]},{"osd":5,"uuid":"48522fd7-d781-4447-873f-174dabd1e33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6809","nonce":1330877824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6811","nonce":1330877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6815","nonce":1330877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6813","nonce":1330877824}]},"public_addr":"172.21.15.193:6809/1330877824","cluster_addr":"172.21.15.193:6811/1330877824","heartbeat_back_addr":"172.21.15.193:6815/1330877824","heartbeat_front_addr":"172.21.15.193:6813/1330877824","state":["exists","up"]},{"osd":6,"uuid":"47bea191-fb53-40a7-8563-8ebf17dd5bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6819","nonce":3930545382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6821","nonce":3930545382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6825","nonce":3930545382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6823","nonce":3930545382}]},"public_addr":"172.21.15.17:6819/3930545382","cluster_addr":"172.21.15.17:6821/3930545382","heartbeat_back_addr":"172.21.15.17:6825/3930545382","heartbeat_front_addr":"172.21.15.17:6823/3930545382","state":["exists","up"]},{"osd":7,"uuid":"a98f36f9-0a19-4c9a-8ed1-615c4a6e7658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6817","nonce":3691677495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6819","nonce":3691677495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6823","nonce":3691677495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6821","nonce":3691677495}]},"public_addr":"172.21.15.189:6817/3691677495","cluster_addr":"172.21.15.189:6819/3691677495","heartbeat_back_addr":"172.21.15.189:6823/3691677495","heartbeat_front_addr":"172.21.15.189:6821/3691677495","state":["exists","up"]},{"osd":8,"uuid":"7a372d9f-c40f-4ead-87da-2f3a570c1373","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6817","nonce":4112907498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6819","nonce":4112907498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6823","nonce":4112907498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6821","nonce":4112907498}]},"public_addr":"172.21.15.193:6817/4112907498","cluster_addr":"172.21.15.193:6819/4112907498","heartbeat_back_addr":"172.21.15.193:6823/4112907498","heartbeat_front_addr":"172.21.15.193:6821/4112907498","state":["exists","up"]},{"osd":9,"uuid":"ac3d983c-c5e7-456b-8271-7c4e6169de61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6827","nonce":663424274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6829","nonce":663424274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6833","nonce":663424274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6831","nonce":663424274}]},"public_addr":"172.21.15.17:6827/663424274","cluster_addr":"172.21.15.17:6829/663424274","heartbeat_back_addr":"172.21.15.17:6833/663424274","heartbeat_front_addr":"172.21.15.17:6831/663424274","state":["exists","up"]},{"osd":10,"uuid":"08dcae02-6c79-4a06-ae88-6eb6e6941cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6825","nonce":3153990375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6827","nonce":3153990375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6831","nonce":3153990375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6829","nonce":3153990375}]},"public_addr":"172.21.15.189:6825/3153990375","cluster_addr":"172.21.15.189:6827/3153990375","heartbeat_back_addr":"172.21.15.189:6831/3153990375","heartbeat_front_addr":"172.21.15.189:6829/3153990375","state":["exists","up"]},{"osd":11,"uuid":"a4ebcf41-d805-4d44-b112-13ae84d51868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6825","nonce":4088053907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6827","nonce":4088053907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6831","nonce":4088053907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6829","nonce":4088053907}]},"public_addr":"172.21.15.193:6825/4088053907","cluster_addr":"172.21.15.193:6827/4088053907","heartbeat_back_addr":"172.21.15.193:6831/4088053907","heartbeat_front_addr":"172.21.15.193:6829/4088053907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:22.172370+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:44.802224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:06.641435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:34.536515+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:58.789324+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:22.189862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:50.382257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:14.678047+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:38.581105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:07.258150+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:32.261383+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:56.739338+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8},{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/1550067038":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/3360683829":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/634066188":"2024-09-14T15:47:42.048005+0000","172.21.15.17:6801/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1945536687":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/2214214377":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1224386591":"2024-09-14T15:47:14.996424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:56:43.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.851+0000 7f6d4fa00640 1 -- 172.21.15.17:0/941400152 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6d300a1090 msgr2=0x7f6d300a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:43.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.851+0000 7f6d4fa00640 1 --2- 172.21.15.17:0/941400152 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6d300a1090 0x7f6d300a3550 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6d48199530 tx=0x7f6d34005f90 comp rx=0 tx=0).stop 2024-09-13T15:56:43.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.851+0000 7f6d4fa00640 1 -- 172.21.15.17:0/941400152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d480ffda0 msgr2=0x7f6d48198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:43.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.851+0000 7f6d4fa00640 1 --2- 172.21.15.17:0/941400152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d480ffda0 0x7f6d48198020 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c031500 tx=0x7f6d3c003c10 comp rx=0 tx=0).stop 2024-09-13T15:56:43.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.851+0000 7f6d4fa00640 1 -- 172.21.15.17:0/941400152 shutdown_connections 2024-09-13T15:56:43.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.851+0000 7f6d4fa00640 1 --2- 172.21.15.17:0/941400152 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6d300a1090 0x7f6d300a3550 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:43.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.851+0000 7f6d4fa00640 1 --2- 172.21.15.17:0/941400152 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d48101950 0x7f6d4819f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:43.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.851+0000 7f6d4fa00640 1 --2- 172.21.15.17:0/941400152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d48100f90 0x7f6d48198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:43.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.851+0000 7f6d4fa00640 1 --2- 172.21.15.17:0/941400152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d480ffda0 0x7f6d48198020 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:43.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.851+0000 7f6d4fa00640 1 -- 172.21.15.17:0/941400152 >> 172.21.15.17:0/941400152 conn(0x7f6d480fb520 msgr2=0x7f6d481067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:43.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.851+0000 7f6d4fa00640 1 -- 172.21.15.17:0/941400152 shutdown_connections 2024-09-13T15:56:43.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:43.851+0000 7f6d4fa00640 1 -- 172.21.15.17:0/941400152 wait complete. 2024-09-13T15:56:43.869 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:50:10.657011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:54:51.436469+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:54:52.427930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:54:55.478058+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:56:43.869 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:56:44.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.027+0000 7f12f2400640 1 -- 172.21.15.17:0/1682979631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12ec074ad0 msgr2=0x7f12ec074f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:44.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.027+0000 7f12f2400640 1 --2- 172.21.15.17:0/1682979631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12ec074ad0 0x7f12ec074f30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009900 tx=0x7f12d802a410 comp rx=0 tx=0).stop 2024-09-13T15:56:44.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.028+0000 7f12f2400640 1 -- 172.21.15.17:0/1682979631 shutdown_connections 2024-09-13T15:56:44.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.028+0000 7f12f2400640 1 --2- 172.21.15.17:0/1682979631 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12ec075470 0x7f12ec0772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.028+0000 7f12f2400640 1 --2- 172.21.15.17:0/1682979631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12ec074ad0 0x7f12ec074f30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.028+0000 7f12f2400640 1 --2- 172.21.15.17:0/1682979631 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12ec076550 0x7f12ec076950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.028+0000 7f12f2400640 1 -- 172.21.15.17:0/1682979631 >> 172.21.15.17:0/1682979631 conn(0x7f12ec0fd580 msgr2=0x7f12ec0ff9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:44.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.028+0000 7f12f2400640 1 -- 172.21.15.17:0/1682979631 shutdown_connections 2024-09-13T15:56:44.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.028+0000 7f12f2400640 1 -- 172.21.15.17:0/1682979631 wait complete. 2024-09-13T15:56:44.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.029+0000 7f12f2400640 1 Processor -- start 2024-09-13T15:56:44.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.029+0000 7f12f2400640 1 -- start start 2024-09-13T15:56:44.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.029+0000 7f12f2400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12ec074ad0 0x7f12ec19c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:44.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.029+0000 7f12f2400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12ec075470 0x7f12ec19c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:44.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.029+0000 7f12f2400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12ec076550 0x7f12ec1a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:44.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.029+0000 7f12f2400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec1a3e50 con 0x7f12ec074ad0 2024-09-13T15:56:44.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.029+0000 7f12f2400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec1a3fc0 con 0x7f12ec076550 2024-09-13T15:56:44.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.029+0000 7f12f2400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec1a4180 con 0x7f12ec075470 2024-09-13T15:56:44.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.029+0000 7f12f1000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12ec074ad0 0x7f12ec19c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:44.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.029+0000 7f12f1000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12ec074ad0 0x7f12ec19c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49558/0 (socket says 172.21.15.17:49558) 2024-09-13T15:56:44.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.029+0000 7f12f1000640 1 -- 172.21.15.17:0/3904603066 learned_addr learned my addr 172.21.15.17:0/3904603066 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:44.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.029+0000 7f12f1a00640 1 --2- 172.21.15.17:0/3904603066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12ec076550 0x7f12ec1a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:44.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.029+0000 7f12ebe00640 1 --2- 172.21.15.17:0/3904603066 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12ec075470 0x7f12ec19c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:44.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.030+0000 7f12f1000640 1 -- 172.21.15.17:0/3904603066 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12ec075470 msgr2=0x7f12ec19c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:44.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.030+0000 7f12f1000640 1 --2- 172.21.15.17:0/3904603066 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12ec075470 0x7f12ec19c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.030+0000 7f12f1000640 1 -- 172.21.15.17:0/3904603066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12ec076550 msgr2=0x7f12ec1a3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:44.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.030+0000 7f12f1000640 1 --2- 172.21.15.17:0/3904603066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12ec076550 0x7f12ec1a3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.030+0000 7f12f1000640 1 -- 172.21.15.17:0/3904603066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d8009560 con 0x7f12ec074ad0 2024-09-13T15:56:44.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.030+0000 7f12f1000640 1 --2- 172.21.15.17:0/3904603066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12ec074ad0 0x7f12ec19c360 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f12e000e9f0 tx=0x7f12e000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:44.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.030+0000 7f12e9600640 1 -- 172.21.15.17:0/3904603066 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e0009700 con 0x7f12ec074ad0 2024-09-13T15:56:44.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.030+0000 7f12f2400640 1 -- 172.21.15.17:0/3904603066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ec1a4460 con 0x7f12ec074ad0 2024-09-13T15:56:44.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.030+0000 7f12e9600640 1 -- 172.21.15.17:0/3904603066 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f12e000cd80 con 0x7f12ec074ad0 2024-09-13T15:56:44.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.030+0000 7f12f2400640 1 -- 172.21.15.17:0/3904603066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ec1a4940 con 0x7f12ec074ad0 2024-09-13T15:56:44.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.030+0000 7f12e9600640 1 -- 172.21.15.17:0/3904603066 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e0018800 con 0x7f12ec074ad0 2024-09-13T15:56:44.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.032+0000 7f12f2400640 1 -- 172.21.15.17:0/3904603066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12ec0772f0 con 0x7f12ec074ad0 2024-09-13T15:56:44.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.033+0000 7f12e9600640 1 -- 172.21.15.17:0/3904603066 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f12e0010430 con 0x7f12ec074ad0 2024-09-13T15:56:44.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.035+0000 7f12e9600640 1 --2- 172.21.15.17:0/3904603066 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f12d40a1090 0x7f12d40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:44.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.035+0000 7f12e9600640 1 -- 172.21.15.17:0/3904603066 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f12e0014070 con 0x7f12ec074ad0 2024-09-13T15:56:44.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.035+0000 7f12ebe00640 1 --2- 172.21.15.17:0/3904603066 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f12d40a1090 0x7f12d40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:44.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.036+0000 7f12ebe00640 1 --2- 172.21.15.17:0/3904603066 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f12d40a1090 0x7f12d40a3550 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f12d8005ab0 tx=0x7f12d8005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:44.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.038+0000 7f12e9600640 1 -- 172.21.15.17:0/3904603066 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f12e0052e20 con 0x7f12ec074ad0 2024-09-13T15:56:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.219+0000 7f12f2400640 1 -- 172.21.15.17:0/3904603066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f12ec02c3e0 con 0x7f12ec074ad0 2024-09-13T15:56:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.219+0000 7f12e9600640 1 -- 172.21.15.17:0/3904603066 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7f12e0096440 con 0x7f12ec074ad0 2024-09-13T15:56:44.221 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-13T15:56:44.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.221+0000 7f12f2400640 1 -- 172.21.15.17:0/3904603066 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f12d40a1090 msgr2=0x7f12d40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:44.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.221+0000 7f12f2400640 1 --2- 172.21.15.17:0/3904603066 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f12d40a1090 0x7f12d40a3550 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f12d8005ab0 tx=0x7f12d8005780 comp rx=0 tx=0).stop 2024-09-13T15:56:44.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.221+0000 7f12f2400640 1 -- 172.21.15.17:0/3904603066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12ec074ad0 msgr2=0x7f12ec19c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:44.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.221+0000 7f12f2400640 1 --2- 172.21.15.17:0/3904603066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12ec074ad0 0x7f12ec19c360 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f12e000e9f0 tx=0x7f12e000eeb0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.221+0000 7f12f2400640 1 -- 172.21.15.17:0/3904603066 shutdown_connections 2024-09-13T15:56:44.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.221+0000 7f12f2400640 1 --2- 172.21.15.17:0/3904603066 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f12d40a1090 0x7f12d40a3550 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.221+0000 7f12f2400640 1 --2- 172.21.15.17:0/3904603066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12ec076550 0x7f12ec1a3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.221+0000 7f12f2400640 1 --2- 172.21.15.17:0/3904603066 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12ec075470 0x7f12ec19c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.221+0000 7f12f2400640 1 --2- 172.21.15.17:0/3904603066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12ec074ad0 0x7f12ec19c360 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.221+0000 7f12f2400640 1 -- 172.21.15.17:0/3904603066 >> 172.21.15.17:0/3904603066 conn(0x7f12ec0fd580 msgr2=0x7f12ec0ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:44.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.222+0000 7f12f2400640 1 -- 172.21.15.17:0/3904603066 shutdown_connections 2024-09-13T15:56:44.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.222+0000 7f12f2400640 1 -- 172.21.15.17:0/3904603066 wait complete. 2024-09-13T15:56:44.245 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:56:44.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.404+0000 7f9cd3a00640 1 -- 172.21.15.17:0/838564473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ccc101f80 msgr2=0x7f9ccc102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:44.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.404+0000 7f9cd3a00640 1 --2- 172.21.15.17:0/838564473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ccc101f80 0x7f9ccc102380 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc009900 tx=0x7f9cbc02a410 comp rx=0 tx=0).stop 2024-09-13T15:56:44.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.404+0000 7f9cd3a00640 1 -- 172.21.15.17:0/838564473 shutdown_connections 2024-09-13T15:56:44.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.404+0000 7f9cd3a00640 1 --2- 172.21.15.17:0/838564473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ccc103b30 0x7f9ccc10a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.404+0000 7f9cd3a00640 1 --2- 172.21.15.17:0/838564473 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9ccc103170 0x7f9ccc1035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.404+0000 7f9cd3a00640 1 --2- 172.21.15.17:0/838564473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ccc101f80 0x7f9ccc102380 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.404+0000 7f9cd3a00640 1 -- 172.21.15.17:0/838564473 >> 172.21.15.17:0/838564473 conn(0x7f9ccc0fd700 msgr2=0x7f9ccc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:44.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.404+0000 7f9cd3a00640 1 -- 172.21.15.17:0/838564473 shutdown_connections 2024-09-13T15:56:44.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.404+0000 7f9cd3a00640 1 -- 172.21.15.17:0/838564473 wait complete. 2024-09-13T15:56:44.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.405+0000 7f9cd3a00640 1 Processor -- start 2024-09-13T15:56:44.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.405+0000 7f9cd3a00640 1 -- start start 2024-09-13T15:56:44.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.406+0000 7f9cd3a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ccc101f80 0x7f9ccc198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:44.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.406+0000 7f9cd3a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ccc103170 0x7f9ccc198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:44.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.406+0000 7f9cd3a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9ccc103b30 0x7f9ccc19f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:44.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.406+0000 7f9cd3a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc19fa80 con 0x7f9ccc103170 2024-09-13T15:56:44.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.406+0000 7f9cd3a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc19fbf0 con 0x7f9ccc101f80 2024-09-13T15:56:44.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.406+0000 7f9cd3a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc19fdb0 con 0x7f9ccc103b30 2024-09-13T15:56:44.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.406+0000 7f9ccbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ccc103170 0x7f9ccc198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:44.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.406+0000 7f9cd1000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ccc101f80 0x7f9ccc198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:44.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.406+0000 7f9cd1a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9ccc103b30 0x7f9ccc19f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:44.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.406+0000 7f9ccbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ccc103170 0x7f9ccc198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49578/0 (socket says 172.21.15.17:49578) 2024-09-13T15:56:44.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.406+0000 7f9ccbe00640 1 -- 172.21.15.17:0/529182968 learned_addr learned my addr 172.21.15.17:0/529182968 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:44.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.406+0000 7f9ccbe00640 1 -- 172.21.15.17:0/529182968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9ccc103b30 msgr2=0x7f9ccc19f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:44.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.406+0000 7f9ccbe00640 1 --2- 172.21.15.17:0/529182968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9ccc103b30 0x7f9ccc19f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.406+0000 7f9ccbe00640 1 -- 172.21.15.17:0/529182968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ccc101f80 msgr2=0x7f9ccc198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:44.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.406+0000 7f9ccbe00640 1 --2- 172.21.15.17:0/529182968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ccc101f80 0x7f9ccc198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.406+0000 7f9ccbe00640 1 -- 172.21.15.17:0/529182968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cbc009560 con 0x7f9ccc103170 2024-09-13T15:56:44.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.407+0000 7f9ccbe00640 1 --2- 172.21.15.17:0/529182968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ccc103170 0x7f9ccc198570 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800e9f0 tx=0x7f9cb800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:44.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.407+0000 7f9cc9600640 1 -- 172.21.15.17:0/529182968 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8009720 con 0x7f9ccc103170 2024-09-13T15:56:44.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.407+0000 7f9cc9600640 1 -- 172.21.15.17:0/529182968 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9cb800cd80 con 0x7f9ccc103170 2024-09-13T15:56:44.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.407+0000 7f9cc9600640 1 -- 172.21.15.17:0/529182968 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8010430 con 0x7f9ccc103170 2024-09-13T15:56:44.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.407+0000 7f9cd3a00640 1 -- 172.21.15.17:0/529182968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ccc1a0090 con 0x7f9ccc103170 2024-09-13T15:56:44.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.407+0000 7f9cd3a00640 1 -- 172.21.15.17:0/529182968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ccc1a0550 con 0x7f9ccc103170 2024-09-13T15:56:44.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.408+0000 7f9cd3a00640 1 -- 172.21.15.17:0/529182968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ccc109410 con 0x7f9ccc103170 2024-09-13T15:56:44.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.410+0000 7f9cc9600640 1 -- 172.21.15.17:0/529182968 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9cb8005020 con 0x7f9ccc103170 2024-09-13T15:56:44.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.411+0000 7f9cc9600640 1 --2- 172.21.15.17:0/529182968 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9cb00a1090 0x7f9cb00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:44.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.411+0000 7f9cc9600640 1 -- 172.21.15.17:0/529182968 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f9cb8014070 con 0x7f9ccc103170 2024-09-13T15:56:44.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.411+0000 7f9cd1000640 1 --2- 172.21.15.17:0/529182968 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9cb00a1090 0x7f9cb00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:44.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.412+0000 7f9cd1000640 1 --2- 172.21.15.17:0/529182968 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9cb00a1090 0x7f9cb00a3550 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc005ab0 tx=0x7f9cbc0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:44.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.415+0000 7f9cc9600640 1 -- 172.21.15.17:0/529182968 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9cb80963f0 con 0x7f9ccc103170 2024-09-13T15:56:44.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:44 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-09-13T15:56:44.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:44 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8, 3, 9]}]': finished 2024-09-13T15:56:44.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:44 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-13T15:56:44.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:44 smithi193 ceph-mon[35248]: osdmap e93: 12 total, 12 up, 12 in 2024-09-13T15:56:44.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:44 smithi193 ceph-mon[35248]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-13T15:56:44.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:44 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/941400152' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:56:44.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:44 smithi193 ceph-mon[35248]: pgmap v354: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-13T15:56:44.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:44 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3904603066' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:56:44.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:44 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-09-13T15:56:44.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:44 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8, 3, 9]}]': finished 2024-09-13T15:56:44.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:44 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-13T15:56:44.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:44 smithi017 ceph-mon[30494]: osdmap e93: 12 total, 12 up, 12 in 2024-09-13T15:56:44.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:44 smithi017 ceph-mon[30494]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-13T15:56:44.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:44 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/941400152' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:56:44.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:44 smithi017 ceph-mon[30494]: pgmap v354: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-13T15:56:44.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:44 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3904603066' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:56:44.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.598+0000 7f9cd3a00640 1 -- 172.21.15.17:0/529182968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ccc108e80 con 0x7f9ccc103170 2024-09-13T15:56:44.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.599+0000 7f9cc9600640 1 -- 172.21.15.17:0/529182968 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9cb8099a10 con 0x7f9ccc103170 2024-09-13T15:56:44.600 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-13T15:56:44.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.601+0000 7f9cd3a00640 1 -- 172.21.15.17:0/529182968 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9cb00a1090 msgr2=0x7f9cb00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:44.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.601+0000 7f9cd3a00640 1 --2- 172.21.15.17:0/529182968 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9cb00a1090 0x7f9cb00a3550 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc005ab0 tx=0x7f9cbc0314a0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.601+0000 7f9cd3a00640 1 -- 172.21.15.17:0/529182968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ccc103170 msgr2=0x7f9ccc198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:44.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.601+0000 7f9cd3a00640 1 --2- 172.21.15.17:0/529182968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ccc103170 0x7f9ccc198570 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800e9f0 tx=0x7f9cb800edf0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.601+0000 7f9cd3a00640 1 -- 172.21.15.17:0/529182968 shutdown_connections 2024-09-13T15:56:44.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.601+0000 7f9cd3a00640 1 --2- 172.21.15.17:0/529182968 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9cb00a1090 0x7f9cb00a3550 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.601+0000 7f9cd3a00640 1 --2- 172.21.15.17:0/529182968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9ccc103b30 0x7f9ccc19f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.601+0000 7f9cd3a00640 1 --2- 172.21.15.17:0/529182968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ccc103170 0x7f9ccc198570 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.601+0000 7f9cd3a00640 1 --2- 172.21.15.17:0/529182968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ccc101f80 0x7f9ccc198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.601+0000 7f9cd3a00640 1 -- 172.21.15.17:0/529182968 >> 172.21.15.17:0/529182968 conn(0x7f9ccc0fd700 msgr2=0x7f9ccc1065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:44.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.601+0000 7f9cd3a00640 1 -- 172.21.15.17:0/529182968 shutdown_connections 2024-09-13T15:56:44.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.601+0000 7f9cd3a00640 1 -- 172.21.15.17:0/529182968 wait complete. 2024-09-13T15:56:44.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:44 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-09-13T15:56:44.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:44 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8, 3, 9]}]': finished 2024-09-13T15:56:44.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:44 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-13T15:56:44.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:44 smithi189 ceph-mon[34790]: osdmap e93: 12 total, 12 up, 12 in 2024-09-13T15:56:44.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:44 smithi189 ceph-mon[34790]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-13T15:56:44.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:44 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/941400152' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:56:44.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:44 smithi189 ceph-mon[34790]: pgmap v354: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-13T15:56:44.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:44 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3904603066' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:56:44.620 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:56:44.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.778+0000 7f1a87a00640 1 -- 172.21.15.17:0/1767302176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a80072f10 msgr2=0x7f1a80073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:44.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.778+0000 7f1a87a00640 1 --2- 172.21.15.17:0/1767302176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a80072f10 0x7f1a80073370 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009900 tx=0x7f1a6802a410 comp rx=0 tx=0).stop 2024-09-13T15:56:44.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.778+0000 7f1a87a00640 1 -- 172.21.15.17:0/1767302176 shutdown_connections 2024-09-13T15:56:44.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.778+0000 7f1a87a00640 1 --2- 172.21.15.17:0/1767302176 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a8010c340 0x7f1a8010e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.778+0000 7f1a87a00640 1 --2- 172.21.15.17:0/1767302176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a80072f10 0x7f1a80073370 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.778+0000 7f1a87a00640 1 --2- 172.21.15.17:0/1767302176 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a800744f0 0x7f1a80072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.778+0000 7f1a87a00640 1 -- 172.21.15.17:0/1767302176 >> 172.21.15.17:0/1767302176 conn(0x7f1a800fb4d0 msgr2=0x7f1a800fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:44.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.778+0000 7f1a87a00640 1 -- 172.21.15.17:0/1767302176 shutdown_connections 2024-09-13T15:56:44.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.778+0000 7f1a87a00640 1 -- 172.21.15.17:0/1767302176 wait complete. 2024-09-13T15:56:44.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.779+0000 7f1a87a00640 1 Processor -- start 2024-09-13T15:56:44.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.779+0000 7f1a87a00640 1 -- start start 2024-09-13T15:56:44.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.780+0000 7f1a87a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a80072f10 0x7f1a8019c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:44.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.780+0000 7f1a87a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a800744f0 0x7f1a8019c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:44.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.780+0000 7f1a87a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a8010c340 0x7f1a801a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:44.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.780+0000 7f1a87a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a801a3e50 con 0x7f1a80072f10 2024-09-13T15:56:44.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.780+0000 7f1a87a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a801a3fc0 con 0x7f1a8010c340 2024-09-13T15:56:44.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.780+0000 7f1a87a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a801a4180 con 0x7f1a800744f0 2024-09-13T15:56:44.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.780+0000 7f1a85000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a80072f10 0x7f1a8019c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:44.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.780+0000 7f1a85000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a80072f10 0x7f1a8019c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49594/0 (socket says 172.21.15.17:49594) 2024-09-13T15:56:44.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.780+0000 7f1a85000640 1 -- 172.21.15.17:0/1243030950 learned_addr learned my addr 172.21.15.17:0/1243030950 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:44.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.780+0000 7f1a85a00640 1 --2- 172.21.15.17:0/1243030950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a8010c340 0x7f1a801a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:44.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.780+0000 7f1a77e00640 1 --2- 172.21.15.17:0/1243030950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a800744f0 0x7f1a8019c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:44.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.780+0000 7f1a85000640 1 -- 172.21.15.17:0/1243030950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a800744f0 msgr2=0x7f1a8019c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:44.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.780+0000 7f1a85000640 1 --2- 172.21.15.17:0/1243030950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a800744f0 0x7f1a8019c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.780+0000 7f1a85000640 1 -- 172.21.15.17:0/1243030950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a8010c340 msgr2=0x7f1a801a3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:44.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.780+0000 7f1a85000640 1 --2- 172.21.15.17:0/1243030950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a8010c340 0x7f1a801a3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.780+0000 7f1a85000640 1 -- 172.21.15.17:0/1243030950 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a68009560 con 0x7f1a80072f10 2024-09-13T15:56:44.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.780+0000 7f1a85a00640 1 --2- 172.21.15.17:0/1243030950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a8010c340 0x7f1a801a3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:56:44.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.781+0000 7f1a85000640 1 --2- 172.21.15.17:0/1243030950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a80072f10 0x7f1a8019c360 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000e9f0 tx=0x7f1a7000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:44.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.781+0000 7f1a7e000640 1 -- 172.21.15.17:0/1243030950 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70009720 con 0x7f1a80072f10 2024-09-13T15:56:44.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.781+0000 7f1a87a00640 1 -- 172.21.15.17:0/1243030950 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a801a4460 con 0x7f1a80072f10 2024-09-13T15:56:44.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.781+0000 7f1a7e000640 1 -- 172.21.15.17:0/1243030950 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a7000cd80 con 0x7f1a80072f10 2024-09-13T15:56:44.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.781+0000 7f1a7e000640 1 -- 172.21.15.17:0/1243030950 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70010430 con 0x7f1a80072f10 2024-09-13T15:56:44.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.781+0000 7f1a87a00640 1 -- 172.21.15.17:0/1243030950 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a801a48f0 con 0x7f1a80072f10 2024-09-13T15:56:44.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.782+0000 7f1a87a00640 1 -- 172.21.15.17:0/1243030950 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a80101ce0 con 0x7f1a80072f10 2024-09-13T15:56:44.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.784+0000 7f1a7e000640 1 -- 172.21.15.17:0/1243030950 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1a70005020 con 0x7f1a80072f10 2024-09-13T15:56:44.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.785+0000 7f1a7e000640 1 --2- 172.21.15.17:0/1243030950 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1a640a1090 0x7f1a640a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:44.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.785+0000 7f1a7e000640 1 -- 172.21.15.17:0/1243030950 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f1a70014070 con 0x7f1a80072f10 2024-09-13T15:56:44.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.785+0000 7f1a77e00640 1 --2- 172.21.15.17:0/1243030950 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1a640a1090 0x7f1a640a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:44.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.786+0000 7f1a77e00640 1 --2- 172.21.15.17:0/1243030950 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1a640a1090 0x7f1a640a3550 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1a68000c00 tx=0x7f1a680314c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:44.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.789+0000 7f1a7e000640 1 -- 172.21.15.17:0/1243030950 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1a70096550 con 0x7f1a80072f10 2024-09-13T15:56:44.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.974+0000 7f1a87a00640 1 -- 172.21.15.17:0/1243030950 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a80101750 con 0x7f1a80072f10 2024-09-13T15:56:44.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.974+0000 7f1a7e000640 1 -- 172.21.15.17:0/1243030950 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1a70099b70 con 0x7f1a80072f10 2024-09-13T15:56:44.976 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-09-13T15:56:44.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.976+0000 7f1a87a00640 1 -- 172.21.15.17:0/1243030950 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1a640a1090 msgr2=0x7f1a640a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:44.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.976+0000 7f1a87a00640 1 --2- 172.21.15.17:0/1243030950 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1a640a1090 0x7f1a640a3550 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1a68000c00 tx=0x7f1a680314c0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.976+0000 7f1a87a00640 1 -- 172.21.15.17:0/1243030950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a80072f10 msgr2=0x7f1a8019c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:44.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.976+0000 7f1a87a00640 1 --2- 172.21.15.17:0/1243030950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a80072f10 0x7f1a8019c360 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000e9f0 tx=0x7f1a7000edf0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.976+0000 7f1a87a00640 1 -- 172.21.15.17:0/1243030950 shutdown_connections 2024-09-13T15:56:44.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.976+0000 7f1a87a00640 1 --2- 172.21.15.17:0/1243030950 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1a640a1090 0x7f1a640a3550 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.976+0000 7f1a87a00640 1 --2- 172.21.15.17:0/1243030950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a8010c340 0x7f1a801a3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.976+0000 7f1a87a00640 1 --2- 172.21.15.17:0/1243030950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a800744f0 0x7f1a8019c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.976+0000 7f1a87a00640 1 --2- 172.21.15.17:0/1243030950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a80072f10 0x7f1a8019c360 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:44.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.976+0000 7f1a87a00640 1 -- 172.21.15.17:0/1243030950 >> 172.21.15.17:0/1243030950 conn(0x7f1a800fb4d0 msgr2=0x7f1a800fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:44.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.976+0000 7f1a87a00640 1 -- 172.21.15.17:0/1243030950 shutdown_connections 2024-09-13T15:56:44.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:44.976+0000 7f1a87a00640 1 -- 172.21.15.17:0/1243030950 wait complete. 2024-09-13T15:56:44.994 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:56:45.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.153+0000 7fbd81400640 1 -- 172.21.15.17:0/3599309884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd7c103080 msgr2=0x7fbd7c103500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:45.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.153+0000 7fbd81400640 1 --2- 172.21.15.17:0/3599309884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd7c103080 0x7fbd7c103500 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbd64009900 tx=0x7fbd6402a410 comp rx=0 tx=0).stop 2024-09-13T15:56:45.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.154+0000 7fbd81400640 1 -- 172.21.15.17:0/3599309884 shutdown_connections 2024-09-13T15:56:45.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.154+0000 7fbd81400640 1 --2- 172.21.15.17:0/3599309884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd7c103a40 0x7fbd7c10a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.154+0000 7fbd81400640 1 --2- 172.21.15.17:0/3599309884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd7c103080 0x7fbd7c103500 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.154+0000 7fbd81400640 1 --2- 172.21.15.17:0/3599309884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd7c101ea0 0x7fbd7c1022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.154+0000 7fbd81400640 1 -- 172.21.15.17:0/3599309884 >> 172.21.15.17:0/3599309884 conn(0x7fbd7c0fd670 msgr2=0x7fbd7c0ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:45.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.154+0000 7fbd81400640 1 -- 172.21.15.17:0/3599309884 shutdown_connections 2024-09-13T15:56:45.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.154+0000 7fbd81400640 1 -- 172.21.15.17:0/3599309884 wait complete. 2024-09-13T15:56:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.155+0000 7fbd81400640 1 Processor -- start 2024-09-13T15:56:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.155+0000 7fbd81400640 1 -- start start 2024-09-13T15:56:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.155+0000 7fbd81400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd7c101ea0 0x7fbd7c197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.155+0000 7fbd81400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd7c103080 0x7fbd7c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.155+0000 7fbd81400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd7c103a40 0x7fbd7c19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.155+0000 7fbd81400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c19f9d0 con 0x7fbd7c103080 2024-09-13T15:56:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.155+0000 7fbd81400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c19fb40 con 0x7fbd7c103a40 2024-09-13T15:56:45.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.155+0000 7fbd81400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c19fd00 con 0x7fbd7c101ea0 2024-09-13T15:56:45.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.155+0000 7fbd73e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd7c103080 0x7fbd7c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:45.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.155+0000 7fbd7be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd7c101ea0 0x7fbd7c197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:45.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.155+0000 7fbd73e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd7c103080 0x7fbd7c198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49624/0 (socket says 172.21.15.17:49624) 2024-09-13T15:56:45.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.156+0000 7fbd80a00640 1 --2- 172.21.15.17:0/3311068933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd7c103a40 0x7fbd7c19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:45.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.156+0000 7fbd73e00640 1 -- 172.21.15.17:0/3311068933 learned_addr learned my addr 172.21.15.17:0/3311068933 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:45.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.156+0000 7fbd7be00640 1 -- 172.21.15.17:0/3311068933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd7c103a40 msgr2=0x7fbd7c19f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:45.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.156+0000 7fbd7be00640 1 --2- 172.21.15.17:0/3311068933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd7c103a40 0x7fbd7c19f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.156+0000 7fbd7be00640 1 -- 172.21.15.17:0/3311068933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd7c103080 msgr2=0x7fbd7c198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:45.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.156+0000 7fbd7be00640 1 --2- 172.21.15.17:0/3311068933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd7c103080 0x7fbd7c198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.156+0000 7fbd7be00640 1 -- 172.21.15.17:0/3311068933 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd64009560 con 0x7fbd7c101ea0 2024-09-13T15:56:45.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.156+0000 7fbd7be00640 1 --2- 172.21.15.17:0/3311068933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd7c101ea0 0x7fbd7c197ee0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c00e9c0 tx=0x7fbd6c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:45.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.157+0000 7fbd79600640 1 -- 172.21.15.17:0/3311068933 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c00ccc0 con 0x7fbd7c101ea0 2024-09-13T15:56:45.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.157+0000 7fbd81400640 1 -- 172.21.15.17:0/3311068933 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd7c19ffe0 con 0x7fbd7c101ea0 2024-09-13T15:56:45.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.157+0000 7fbd79600640 1 -- 172.21.15.17:0/3311068933 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd6c0044e0 con 0x7fbd7c101ea0 2024-09-13T15:56:45.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.157+0000 7fbd79600640 1 -- 172.21.15.17:0/3311068933 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c003e70 con 0x7fbd7c101ea0 2024-09-13T15:56:45.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.157+0000 7fbd81400640 1 -- 172.21.15.17:0/3311068933 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd7c1a0410 con 0x7fbd7c101ea0 2024-09-13T15:56:45.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.158+0000 7fbd81400640 1 -- 172.21.15.17:0/3311068933 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7c1093a0 con 0x7fbd7c101ea0 2024-09-13T15:56:45.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.160+0000 7fbd79600640 1 -- 172.21.15.17:0/3311068933 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fbd6c004000 con 0x7fbd7c101ea0 2024-09-13T15:56:45.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.161+0000 7fbd79600640 1 --2- 172.21.15.17:0/3311068933 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbd600a1110 0x7fbd600a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:45.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.161+0000 7fbd79600640 1 -- 172.21.15.17:0/3311068933 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fbd6c014070 con 0x7fbd7c101ea0 2024-09-13T15:56:45.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.161+0000 7fbd73e00640 1 --2- 172.21.15.17:0/3311068933 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbd600a1110 0x7fbd600a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:45.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.162+0000 7fbd73e00640 1 --2- 172.21.15.17:0/3311068933 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbd600a1110 0x7fbd600a35d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c1993f0 tx=0x7fbd64005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:45.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.163+0000 7fbd79600640 1 -- 172.21.15.17:0/3311068933 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbd6c0964f0 con 0x7fbd7c101ea0 2024-09-13T15:56:45.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:45 smithi017 ceph-mon[30494]: osdmap e94: 12 total, 12 up, 12 in 2024-09-13T15:56:45.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:45 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/529182968' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T15:56:45.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:45 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1243030950' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T15:56:45.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.345+0000 7fbd81400640 1 -- 172.21.15.17:0/3311068933 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbd7c02c3e0 con 0x7fbd7c101ea0 2024-09-13T15:56:45.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.346+0000 7fbd79600640 1 -- 172.21.15.17:0/3311068933 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbd6c099b10 con 0x7fbd7c101ea0 2024-09-13T15:56:45.347 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-13T15:56:45.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.348+0000 7fbd81400640 1 -- 172.21.15.17:0/3311068933 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbd600a1110 msgr2=0x7fbd600a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:45.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.348+0000 7fbd81400640 1 --2- 172.21.15.17:0/3311068933 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbd600a1110 0x7fbd600a35d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c1993f0 tx=0x7fbd64005780 comp rx=0 tx=0).stop 2024-09-13T15:56:45.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.348+0000 7fbd81400640 1 -- 172.21.15.17:0/3311068933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd7c101ea0 msgr2=0x7fbd7c197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:45.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.348+0000 7fbd81400640 1 --2- 172.21.15.17:0/3311068933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd7c101ea0 0x7fbd7c197ee0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c00e9c0 tx=0x7fbd6c00ee80 comp rx=0 tx=0).stop 2024-09-13T15:56:45.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.348+0000 7fbd81400640 1 -- 172.21.15.17:0/3311068933 shutdown_connections 2024-09-13T15:56:45.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.348+0000 7fbd81400640 1 --2- 172.21.15.17:0/3311068933 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbd600a1110 0x7fbd600a35d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.348+0000 7fbd81400640 1 --2- 172.21.15.17:0/3311068933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd7c103a40 0x7fbd7c19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.348+0000 7fbd81400640 1 --2- 172.21.15.17:0/3311068933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd7c103080 0x7fbd7c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.348+0000 7fbd81400640 1 --2- 172.21.15.17:0/3311068933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd7c101ea0 0x7fbd7c197ee0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.348+0000 7fbd81400640 1 -- 172.21.15.17:0/3311068933 >> 172.21.15.17:0/3311068933 conn(0x7fbd7c0fd670 msgr2=0x7fbd7c106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:45.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.348+0000 7fbd81400640 1 -- 172.21.15.17:0/3311068933 shutdown_connections 2024-09-13T15:56:45.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.348+0000 7fbd81400640 1 -- 172.21.15.17:0/3311068933 wait complete. 2024-09-13T15:56:45.367 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:56:45.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:45 smithi193 ceph-mon[35248]: osdmap e94: 12 total, 12 up, 12 in 2024-09-13T15:56:45.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:45 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/529182968' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T15:56:45.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:45 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1243030950' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T15:56:45.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.524+0000 7f1ddc200640 1 -- 172.21.15.17:0/146567926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dd410c370 msgr2=0x7f1dd410e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:45.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.524+0000 7f1ddc200640 1 --2- 172.21.15.17:0/146567926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dd410c370 0x7f1dd410e760 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009ca0 tx=0x7f1dcc02a8c0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.524+0000 7f1ddc200640 1 -- 172.21.15.17:0/146567926 shutdown_connections 2024-09-13T15:56:45.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.524+0000 7f1ddc200640 1 --2- 172.21.15.17:0/146567926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dd410c370 0x7f1dd410e760 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.524+0000 7f1ddc200640 1 --2- 172.21.15.17:0/146567926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dd4072f10 0x7f1dd4073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.524+0000 7f1ddc200640 1 --2- 172.21.15.17:0/146567926 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1dd40744f0 0x7f1dd4072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.524+0000 7f1ddc200640 1 -- 172.21.15.17:0/146567926 >> 172.21.15.17:0/146567926 conn(0x7f1dd40fb520 msgr2=0x7f1dd40fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:45.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.524+0000 7f1ddc200640 1 -- 172.21.15.17:0/146567926 shutdown_connections 2024-09-13T15:56:45.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.524+0000 7f1ddc200640 1 -- 172.21.15.17:0/146567926 wait complete. 2024-09-13T15:56:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.525+0000 7f1ddc200640 1 Processor -- start 2024-09-13T15:56:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.525+0000 7f1ddc200640 1 -- start start 2024-09-13T15:56:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.526+0000 7f1ddc200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dd4072f10 0x7f1dd419c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.526+0000 7f1ddc200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1dd40744f0 0x7f1dd419c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.526+0000 7f1ddc200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dd410c370 0x7f1dd41a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.526+0000 7f1ddc200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd41a3df0 con 0x7f1dd410c370 2024-09-13T15:56:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.526+0000 7f1ddc200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd41a3f60 con 0x7f1dd4072f10 2024-09-13T15:56:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.526+0000 7f1ddc200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd41a4120 con 0x7f1dd40744f0 2024-09-13T15:56:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.526+0000 7f1dda200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dd410c370 0x7f1dd41a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.526+0000 7f1dda200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dd410c370 0x7f1dd41a38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49638/0 (socket says 172.21.15.17:49638) 2024-09-13T15:56:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.526+0000 7f1dd9800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dd4072f10 0x7f1dd419c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.526+0000 7f1dda200640 1 -- 172.21.15.17:0/2513975743 learned_addr learned my addr 172.21.15.17:0/2513975743 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.526+0000 7f1dd8e00640 1 --2- 172.21.15.17:0/2513975743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1dd40744f0 0x7f1dd419c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.527+0000 7f1dd9800640 1 -- 172.21.15.17:0/2513975743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1dd40744f0 msgr2=0x7f1dd419c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.527+0000 7f1dd9800640 1 --2- 172.21.15.17:0/2513975743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1dd40744f0 0x7f1dd419c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.527+0000 7f1dd9800640 1 -- 172.21.15.17:0/2513975743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dd410c370 msgr2=0x7f1dd41a38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.527+0000 7f1dd9800640 1 --2- 172.21.15.17:0/2513975743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dd410c370 0x7f1dd41a38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.527+0000 7f1dd9800640 1 -- 172.21.15.17:0/2513975743 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc009900 con 0x7f1dd4072f10 2024-09-13T15:56:45.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.527+0000 7f1dda200640 1 --2- 172.21.15.17:0/2513975743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dd410c370 0x7f1dd41a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:45.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.527+0000 7f1dd9800640 1 --2- 172.21.15.17:0/2513975743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dd4072f10 0x7f1dd419c300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8005fd0 tx=0x7f1dc800dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:45.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.527+0000 7f1dd2000640 1 -- 172.21.15.17:0/2513975743 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8009c30 con 0x7f1dd4072f10 2024-09-13T15:56:45.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.527+0000 7f1dd2000640 1 -- 172.21.15.17:0/2513975743 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1dc80044f0 con 0x7f1dd4072f10 2024-09-13T15:56:45.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.527+0000 7f1dd2000640 1 -- 172.21.15.17:0/2513975743 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8003db0 con 0x7f1dd4072f10 2024-09-13T15:56:45.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.527+0000 7f1ddc200640 1 -- 172.21.15.17:0/2513975743 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd41a4400 con 0x7f1dd4072f10 2024-09-13T15:56:45.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.527+0000 7f1ddc200640 1 -- 172.21.15.17:0/2513975743 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd41a48c0 con 0x7f1dd4072f10 2024-09-13T15:56:45.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.528+0000 7f1ddc200640 1 -- 172.21.15.17:0/2513975743 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd4101d10 con 0x7f1dd4072f10 2024-09-13T15:56:45.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.530+0000 7f1dd2000640 1 -- 172.21.15.17:0/2513975743 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1dc8003f10 con 0x7f1dd4072f10 2024-09-13T15:56:45.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.531+0000 7f1dd2000640 1 --2- 172.21.15.17:0/2513975743 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1dbc0a1090 0x7f1dbc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:45.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.532+0000 7f1dd2000640 1 -- 172.21.15.17:0/2513975743 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f1dc80cc720 con 0x7f1dd4072f10 2024-09-13T15:56:45.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.532+0000 7f1dd8e00640 1 --2- 172.21.15.17:0/2513975743 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1dbc0a1090 0x7f1dbc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:45.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.532+0000 7f1dd8e00640 1 --2- 172.21.15.17:0/2513975743 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1dbc0a1090 0x7f1dbc0a3550 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1dd419d810 tx=0x7f1dc0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:45.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.534+0000 7f1dd2000640 1 -- 172.21.15.17:0/2513975743 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1dc8095bb0 con 0x7f1dd4072f10 2024-09-13T15:56:45.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:45 smithi189 ceph-mon[34790]: osdmap e94: 12 total, 12 up, 12 in 2024-09-13T15:56:45.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:45 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/529182968' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T15:56:45.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:45 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1243030950' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T15:56:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.748+0000 7f1ddc200640 1 -- 172.21.15.17:0/2513975743 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1dd4111c90 con 0x7f1dd4072f10 2024-09-13T15:56:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.749+0000 7f1dd2000640 1 -- 172.21.15.17:0/2513975743 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10879 (secure 0 0 0) 0x7f1dc8020090 con 0x7f1dd4072f10 2024-09-13T15:56:45.751 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:56:45.751 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1730156534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1730156534},{"type":"v1","addr":"172.21.15.17:6837","nonce":1730156534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/1295854211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1295854211},{"type":"v1","addr":"172.21.15.17:6841","nonce":1295854211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2888593680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2888593680},{"type":"v1","addr":"172.21.15.17:6835","nonce":2888593680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4135454212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4135454212},{"type":"v1","addr":"172.21.15.189:6835","nonce":4135454212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T15:54:52.929867+0000","modified":"2024-09-13T15:55:16.253229+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24565,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24520":{"gid":24520,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/4049465204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":4049465204},{"type":"v1","addr":"172.21.15.193:6835","nonce":4049465204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/2079181485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2079181485},{"type":"v1","addr":"172.21.15.189:6837","nonce":2079181485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24532":{"gid":24532,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/792056943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":792056943},{"type":"v1","addr":"172.21.15.193:6837","nonce":792056943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24553":{"gid":24553,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6839/3012199875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":3012199875},{"type":"v1","addr":"172.21.15.193:6839","nonce":3012199875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24565":{"gid":24565,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.17:6839/3750040765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3750040765},{"type":"v1","addr":"172.21.15.17:6839","nonce":3750040765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6839/2624723395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2624723395},{"type":"v1","addr":"172.21.15.189:6839","nonce":2624723395}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:56:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-13T15:56:45.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.751+0000 7f1ddc200640 1 -- 172.21.15.17:0/2513975743 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1dbc0a1090 msgr2=0x7f1dbc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:45.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.751+0000 7f1ddc200640 1 --2- 172.21.15.17:0/2513975743 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1dbc0a1090 0x7f1dbc0a3550 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1dd419d810 tx=0x7f1dc0005f90 comp rx=0 tx=0).stop 2024-09-13T15:56:45.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.751+0000 7f1ddc200640 1 -- 172.21.15.17:0/2513975743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dd4072f10 msgr2=0x7f1dd419c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:45.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.751+0000 7f1ddc200640 1 --2- 172.21.15.17:0/2513975743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dd4072f10 0x7f1dd419c300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8005fd0 tx=0x7f1dc800dde0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.752+0000 7f1ddc200640 1 -- 172.21.15.17:0/2513975743 shutdown_connections 2024-09-13T15:56:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.752+0000 7f1ddc200640 1 --2- 172.21.15.17:0/2513975743 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1dbc0a1090 0x7f1dbc0a3550 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.752+0000 7f1ddc200640 1 --2- 172.21.15.17:0/2513975743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dd410c370 0x7f1dd41a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.752+0000 7f1ddc200640 1 --2- 172.21.15.17:0/2513975743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1dd40744f0 0x7f1dd419c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.752+0000 7f1ddc200640 1 --2- 172.21.15.17:0/2513975743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dd4072f10 0x7f1dd419c300 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.752+0000 7f1ddc200640 1 -- 172.21.15.17:0/2513975743 >> 172.21.15.17:0/2513975743 conn(0x7f1dd40fb520 msgr2=0x7f1dd40fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.752+0000 7f1ddc200640 1 -- 172.21.15.17:0/2513975743 shutdown_connections 2024-09-13T15:56:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.752+0000 7f1ddc200640 1 -- 172.21.15.17:0/2513975743 wait complete. 2024-09-13T15:56:45.769 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:56:45.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.926+0000 7fc21cc00640 1 -- 172.21.15.17:0/2550126194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc218100820 msgr2=0x7fc218102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:45.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.926+0000 7fc21cc00640 1 --2- 172.21.15.17:0/2550126194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc218100820 0x7fc218102c10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc208009860 tx=0x7fc20802a340 comp rx=0 tx=0).stop 2024-09-13T15:56:45.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.926+0000 7fc21cc00640 1 -- 172.21.15.17:0/2550126194 shutdown_connections 2024-09-13T15:56:45.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.926+0000 7fc21cc00640 1 --2- 172.21.15.17:0/2550126194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc218105a80 0x7fc218107ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.926+0000 7fc21cc00640 1 --2- 172.21.15.17:0/2550126194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc218103150 0x7fc218105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.926+0000 7fc21cc00640 1 --2- 172.21.15.17:0/2550126194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc218100820 0x7fc218102c10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.926+0000 7fc21cc00640 1 -- 172.21.15.17:0/2550126194 >> 172.21.15.17:0/2550126194 conn(0x7fc2180fa420 msgr2=0x7fc2180fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:45.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.927+0000 7fc21cc00640 1 -- 172.21.15.17:0/2550126194 shutdown_connections 2024-09-13T15:56:45.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.927+0000 7fc21cc00640 1 -- 172.21.15.17:0/2550126194 wait complete. 2024-09-13T15:56:45.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.927+0000 7fc21cc00640 1 Processor -- start 2024-09-13T15:56:45.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.927+0000 7fc21cc00640 1 -- start start 2024-09-13T15:56:45.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.928+0000 7fc21cc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc218100820 0x7fc218100190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:45.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.928+0000 7fc21cc00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc218103150 0x7fc2180fe7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:45.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.928+0000 7fc21cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc218105a80 0x7fc2180fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:45.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.928+0000 7fc21cc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2180ff470 con 0x7fc218105a80 2024-09-13T15:56:45.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.928+0000 7fc21cc00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2180ff5e0 con 0x7fc218100820 2024-09-13T15:56:45.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.928+0000 7fc21cc00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21819ff20 con 0x7fc218103150 2024-09-13T15:56:45.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.928+0000 7fc216800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc218105a80 0x7fc2180fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:45.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.928+0000 7fc216800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc218105a80 0x7fc2180fed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49668/0 (socket says 172.21.15.17:49668) 2024-09-13T15:56:45.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.928+0000 7fc216800640 1 -- 172.21.15.17:0/4175037132 learned_addr learned my addr 172.21.15.17:0/4175037132 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:45.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.928+0000 7fc215e00640 1 --2- 172.21.15.17:0/4175037132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc218100820 0x7fc218100190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:45.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.928+0000 7fc20fe00640 1 --2- 172.21.15.17:0/4175037132 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc218103150 0x7fc2180fe7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:45.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.929+0000 7fc216800640 1 -- 172.21.15.17:0/4175037132 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc218103150 msgr2=0x7fc2180fe7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:45.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.929+0000 7fc216800640 1 --2- 172.21.15.17:0/4175037132 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc218103150 0x7fc2180fe7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.929+0000 7fc216800640 1 -- 172.21.15.17:0/4175037132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc218100820 msgr2=0x7fc218100190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:45.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.929+0000 7fc216800640 1 --2- 172.21.15.17:0/4175037132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc218100820 0x7fc218100190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:45.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.929+0000 7fc216800640 1 -- 172.21.15.17:0/4175037132 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc200009560 con 0x7fc218105a80 2024-09-13T15:56:45.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.929+0000 7fc216800640 1 --2- 172.21.15.17:0/4175037132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc218105a80 0x7fc2180fed10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc21000daf0 tx=0x7fc21000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:45.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.929+0000 7fc20ea00640 1 -- 172.21.15.17:0/4175037132 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21000bea0 con 0x7fc218105a80 2024-09-13T15:56:45.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.929+0000 7fc21cc00640 1 -- 172.21.15.17:0/4175037132 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc208009490 con 0x7fc218105a80 2024-09-13T15:56:45.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.929+0000 7fc20ea00640 1 -- 172.21.15.17:0/4175037132 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc210003e30 con 0x7fc218105a80 2024-09-13T15:56:45.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.929+0000 7fc20ea00640 1 -- 172.21.15.17:0/4175037132 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc210010660 con 0x7fc218105a80 2024-09-13T15:56:45.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.929+0000 7fc21cc00640 1 -- 172.21.15.17:0/4175037132 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2181a0500 con 0x7fc218105a80 2024-09-13T15:56:45.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.930+0000 7fc21cc00640 1 -- 172.21.15.17:0/4175037132 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2180fbf10 con 0x7fc218105a80 2024-09-13T15:56:45.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.932+0000 7fc20ea00640 1 -- 172.21.15.17:0/4175037132 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc210003970 con 0x7fc218105a80 2024-09-13T15:56:45.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.934+0000 7fc20ea00640 1 --2- 172.21.15.17:0/4175037132 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1fc0a1090 0x7fc1fc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:45.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.934+0000 7fc20ea00640 1 -- 172.21.15.17:0/4175037132 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fc2100cc9e0 con 0x7fc218105a80 2024-09-13T15:56:45.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.935+0000 7fc215e00640 1 --2- 172.21.15.17:0/4175037132 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1fc0a1090 0x7fc1fc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:45.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.935+0000 7fc215e00640 1 --2- 172.21.15.17:0/4175037132 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1fc0a1090 0x7fc1fc0a3550 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc208000c00 tx=0x7fc2080305a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:45.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:45.938+0000 7fc20ea00640 1 -- 172.21.15.17:0/4175037132 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc210095e70 con 0x7fc218105a80 2024-09-13T15:56:46.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.120+0000 7fc21cc00640 1 -- 172.21.15.17:0/4175037132 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc21802c410 con 0x7fc218105a80 2024-09-13T15:56:46.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.122+0000 7fc20ea00640 1 -- 172.21.15.17:0/4175037132 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24575 (secure 0 0 0) 0x7fc210020090 con 0x7fc218105a80 2024-09-13T15:56:46.124 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:56:46.124 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":94,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","created":"2024-09-13T15:46:50.475750+0000","modified":"2024-09-13T15:56:44.228817+0000","last_up_change":"2024-09-13T15:53:59.138985+0000","last_in_change":"2024-09-13T15:53:39.220264+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:50:10.657011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:54:51.436469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:54:52.427930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:54:55.478058+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5d39d6af-15e6-463b-b9ff-a9a5dd94e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6803","nonce":158651212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6805","nonce":158651212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6809","nonce":158651212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6807","nonce":158651212}]},"public_addr":"172.21.15.17:6803/158651212","cluster_addr":"172.21.15.17:6805/158651212","heartbeat_back_addr":"172.21.15.17:6809/158651212","heartbeat_front_addr":"172.21.15.17:6807/158651212","state":["exists","up"]},{"osd":1,"uuid":"0da621c7-645b-44ae-ba7c-a573861c3aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6801","nonce":964319421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6803","nonce":964319421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6807","nonce":964319421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6805","nonce":964319421}]},"public_addr":"172.21.15.189:6801/964319421","cluster_addr":"172.21.15.189:6803/964319421","heartbeat_back_addr":"172.21.15.189:6807/964319421","heartbeat_front_addr":"172.21.15.189:6805/964319421","state":["exists","up"]},{"osd":2,"uuid":"fa95af60-1486-4a29-8c79-8a73a4146552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6801","nonce":138468002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6803","nonce":138468002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6807","nonce":138468002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6805","nonce":138468002}]},"public_addr":"172.21.15.193:6801/138468002","cluster_addr":"172.21.15.193:6803/138468002","heartbeat_back_addr":"172.21.15.193:6807/138468002","heartbeat_front_addr":"172.21.15.193:6805/138468002","state":["exists","up"]},{"osd":3,"uuid":"90428e5f-dfd4-4cda-b240-fdb9079bcb7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6811","nonce":919913803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6813","nonce":919913803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6817","nonce":919913803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6815","nonce":919913803}]},"public_addr":"172.21.15.17:6811/919913803","cluster_addr":"172.21.15.17:6813/919913803","heartbeat_back_addr":"172.21.15.17:6817/919913803","heartbeat_front_addr":"172.21.15.17:6815/919913803","state":["exists","up"]},{"osd":4,"uuid":"e1c537b6-98d2-4b66-b15a-65fe70b0ce25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6809","nonce":2310375565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6811","nonce":2310375565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6815","nonce":2310375565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6813","nonce":2310375565}]},"public_addr":"172.21.15.189:6809/2310375565","cluster_addr":"172.21.15.189:6811/2310375565","heartbeat_back_addr":"172.21.15.189:6815/2310375565","heartbeat_front_addr":"172.21.15.189:6813/2310375565","state":["exists","up"]},{"osd":5,"uuid":"48522fd7-d781-4447-873f-174dabd1e33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6809","nonce":1330877824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6811","nonce":1330877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6815","nonce":1330877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6813","nonce":1330877824}]},"public_addr":"172.21.15.193:6809/1330877824","cluster_addr":"172.21.15.193:6811/1330877824","heartbeat_back_addr":"172.21.15.193:6815/1330877824","heartbeat_front_addr":"172.21.15.193:6813/1330877824","state":["exists","up"]},{"osd":6,"uuid":"47bea191-fb53-40a7-8563-8ebf17dd5bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6819","nonce":3930545382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6821","nonce":3930545382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6825","nonce":3930545382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6823","nonce":3930545382}]},"public_addr":"172.21.15.17:6819/3930545382","cluster_addr":"172.21.15.17:6821/3930545382","heartbeat_back_addr":"172.21.15.17:6825/3930545382","heartbeat_front_addr":"172.21.15.17:6823/3930545382","state":["exists","up"]},{"osd":7,"uuid":"a98f36f9-0a19-4c9a-8ed1-615c4a6e7658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6817","nonce":3691677495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6819","nonce":3691677495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6823","nonce":3691677495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6821","nonce":3691677495}]},"public_addr":"172.21.15.189:6817/3691677495","cluster_addr":"172.21.15.189:6819/3691677495","heartbeat_back_addr":"172.21.15.189:6823/3691677495","heartbeat_front_addr":"172.21.15.189:6821/3691677495","state":["exists","up"]},{"osd":8,"uuid":"7a372d9f-c40f-4ead-87da-2f3a570c1373","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6817","nonce":4112907498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6819","nonce":4112907498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6823","nonce":4112907498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6821","nonce":4112907498}]},"public_addr":"172.21.15.193:6817/4112907498","cluster_addr":"172.21.15.193:6819/4112907498","heartbeat_back_addr":"172.21.15.193:6823/4112907498","heartbeat_front_addr":"172.21.15.193:6821/4112907498","state":["exists","up"]},{"osd":9,"uuid":"ac3d983c-c5e7-456b-8271-7c4e6169de61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6827","nonce":663424274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6829","nonce":663424274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6833","nonce":663424274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6831","nonce":663424274}]},"public_addr":"172.21.15.17:6827/663424274","cluster_addr":"172.21.15.17:6829/663424274","heartbeat_back_addr":"172.21.15.17:6833/663424274","heartbeat_front_addr":"172.21.15.17:6831/663424274","state":["exists","up"]},{"osd":10,"uuid":"08dcae02-6c79-4a06-ae88-6eb6e6941cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6825","nonce":3153990375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6827","nonce":3153990375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6831","nonce":3153990375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6829","nonce":3153990375}]},"public_addr":"172.21.15.189:6825/3153990375","cluster_addr":"172.21.15.189:6827/3153990375","heartbeat_back_addr":"172.21.15.189:6831/3153990375","heartbeat_front_addr":"172.21.15.189:6829/3153990375","state":["exists","up"]},{"osd":11,"uuid":"a4ebcf41-d805-4d44-b112-13ae84d51868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6825","nonce":4088053907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6827","nonce":4088053907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6831","nonce":4088053907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6829","nonce":4088053907}]},"public_addr":"172.21.15.193:6825/4088053907","cluster_addr":"172.21.15.193:6827/4088053907","heartbeat_back_addr":"172.21.15.193:6831/4088053907","heartbeat_front_addr":"172.21.15.193:6829/4088053907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:22.172370+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:44.802224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:06.641435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:34.536515+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:58.789324+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:22.189862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:50.382257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:14.678047+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:38.581105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:07.258150+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:32.261383+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:56.739338+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8},{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/1550067038":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/3360683829":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/634066188":"2024-09-14T15:47:42.048005+0000","172.21.15.17:6801/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1945536687":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/2214214377":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1224386591":"2024-09-14T15:47:14.996424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:56:46.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.124+0000 7fc21cc00640 1 -- 172.21.15.17:0/4175037132 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1fc0a1090 msgr2=0x7fc1fc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:46.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.124+0000 7fc21cc00640 1 --2- 172.21.15.17:0/4175037132 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1fc0a1090 0x7fc1fc0a3550 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc208000c00 tx=0x7fc2080305a0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.124+0000 7fc21cc00640 1 -- 172.21.15.17:0/4175037132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc218105a80 msgr2=0x7fc2180fed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:46.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.124+0000 7fc21cc00640 1 --2- 172.21.15.17:0/4175037132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc218105a80 0x7fc2180fed10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc21000daf0 tx=0x7fc21000b260 comp rx=0 tx=0).stop 2024-09-13T15:56:46.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.124+0000 7fc21cc00640 1 -- 172.21.15.17:0/4175037132 shutdown_connections 2024-09-13T15:56:46.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.124+0000 7fc21cc00640 1 --2- 172.21.15.17:0/4175037132 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1fc0a1090 0x7fc1fc0a3550 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.124+0000 7fc21cc00640 1 --2- 172.21.15.17:0/4175037132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc218105a80 0x7fc2180fed10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.124+0000 7fc21cc00640 1 --2- 172.21.15.17:0/4175037132 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc218103150 0x7fc2180fe7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.124+0000 7fc21cc00640 1 --2- 172.21.15.17:0/4175037132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc218100820 0x7fc218100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.124+0000 7fc21cc00640 1 -- 172.21.15.17:0/4175037132 >> 172.21.15.17:0/4175037132 conn(0x7fc2180fa420 msgr2=0x7fc218101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:46.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.125+0000 7fc21cc00640 1 -- 172.21.15.17:0/4175037132 shutdown_connections 2024-09-13T15:56:46.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.125+0000 7fc21cc00640 1 -- 172.21.15.17:0/4175037132 wait complete. 2024-09-13T15:56:46.143 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:50:10.657011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:54:51.436469+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:54:52.427930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:54:55.478058+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:56:46.144 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:56:46.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.303+0000 7f30dcc00640 1 -- 172.21.15.17:0/1057873770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30d8103940 msgr2=0x7f30d810a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:46.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.303+0000 7f30dcc00640 1 --2- 172.21.15.17:0/1057873770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30d8103940 0x7f30d810a260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009ca0 tx=0x7f30d002a8b0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.304+0000 7f30dcc00640 1 -- 172.21.15.17:0/1057873770 shutdown_connections 2024-09-13T15:56:46.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.304+0000 7f30dcc00640 1 --2- 172.21.15.17:0/1057873770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30d8103940 0x7f30d810a260 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.304+0000 7f30dcc00640 1 --2- 172.21.15.17:0/1057873770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d8102f80 0x7f30d8103400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.304+0000 7f30dcc00640 1 --2- 172.21.15.17:0/1057873770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f30d8101e30 0x7f30d8102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.304+0000 7f30dcc00640 1 -- 172.21.15.17:0/1057873770 >> 172.21.15.17:0/1057873770 conn(0x7f30d80fd5b0 msgr2=0x7f30d80ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:46.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.304+0000 7f30dcc00640 1 -- 172.21.15.17:0/1057873770 shutdown_connections 2024-09-13T15:56:46.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.304+0000 7f30dcc00640 1 -- 172.21.15.17:0/1057873770 wait complete. 2024-09-13T15:56:46.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.305+0000 7f30dcc00640 1 Processor -- start 2024-09-13T15:56:46.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.305+0000 7f30dcc00640 1 -- start start 2024-09-13T15:56:46.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.305+0000 7f30dcc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d8101e30 0x7f30d8197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:46.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.305+0000 7f30dcc00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f30d8102f80 0x7f30d8198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.305+0000 7f30dcc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30d8103940 0x7f30d819f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.305+0000 7f30dcc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d819f8b0 con 0x7f30d8101e30 2024-09-13T15:56:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.305+0000 7f30dcc00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d819fa20 con 0x7f30d8103940 2024-09-13T15:56:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.305+0000 7f30dcc00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d819fbe0 con 0x7f30d8102f80 2024-09-13T15:56:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.305+0000 7f30d7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d8101e30 0x7f30d8197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.305+0000 7f30d7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d8101e30 0x7f30d8197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49686/0 (socket says 172.21.15.17:49686) 2024-09-13T15:56:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.305+0000 7f30d7400640 1 -- 172.21.15.17:0/1834803467 learned_addr learned my addr 172.21.15.17:0/1834803467 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.305+0000 7f30cfe00640 1 --2- 172.21.15.17:0/1834803467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f30d8102f80 0x7f30d8198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.305+0000 7f30d7e00640 1 --2- 172.21.15.17:0/1834803467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30d8103940 0x7f30d819f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.306+0000 7f30d7400640 1 -- 172.21.15.17:0/1834803467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f30d8102f80 msgr2=0x7f30d8198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.306+0000 7f30d7400640 1 --2- 172.21.15.17:0/1834803467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f30d8102f80 0x7f30d8198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.306+0000 7f30d7400640 1 -- 172.21.15.17:0/1834803467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30d8103940 msgr2=0x7f30d819f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.306+0000 7f30d7400640 1 --2- 172.21.15.17:0/1834803467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30d8103940 0x7f30d819f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.306+0000 7f30d7400640 1 -- 172.21.15.17:0/1834803467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d0009900 con 0x7f30d8101e30 2024-09-13T15:56:46.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.306+0000 7f30d7e00640 1 --2- 172.21.15.17:0/1834803467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30d8103940 0x7f30d819f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:56:46.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.306+0000 7f30d7400640 1 --2- 172.21.15.17:0/1834803467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d8101e30 0x7f30d8197dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f30c800d950 tx=0x7f30c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:46.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.306+0000 7f30d4c00640 1 -- 172.21.15.17:0/1834803467 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c8009c30 con 0x7f30d8101e30 2024-09-13T15:56:46.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.306+0000 7f30d4c00640 1 -- 172.21.15.17:0/1834803467 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30c8009d90 con 0x7f30d8101e30 2024-09-13T15:56:46.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.306+0000 7f30dcc00640 1 -- 172.21.15.17:0/1834803467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d819fec0 con 0x7f30d8101e30 2024-09-13T15:56:46.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.306+0000 7f30d4c00640 1 -- 172.21.15.17:0/1834803467 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c800f740 con 0x7f30d8101e30 2024-09-13T15:56:46.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.307+0000 7f30dcc00640 1 -- 172.21.15.17:0/1834803467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d81a02e0 con 0x7f30d8101e30 2024-09-13T15:56:46.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.307+0000 7f30dcc00640 1 -- 172.21.15.17:0/1834803467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d8102230 con 0x7f30d8101e30 2024-09-13T15:56:46.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.309+0000 7f30d4c00640 1 -- 172.21.15.17:0/1834803467 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f30c8010a20 con 0x7f30d8101e30 2024-09-13T15:56:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.310+0000 7f30d4c00640 1 --2- 172.21.15.17:0/1834803467 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30bc0a1090 0x7f30bc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.311+0000 7f30d4c00640 1 -- 172.21.15.17:0/1834803467 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f30c80cc8f0 con 0x7f30d8101e30 2024-09-13T15:56:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.311+0000 7f30cfe00640 1 --2- 172.21.15.17:0/1834803467 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30bc0a1090 0x7f30bc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:46.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.311+0000 7f30cfe00640 1 --2- 172.21.15.17:0/1834803467 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30bc0a1090 0x7f30bc0a3550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f30d81992d0 tx=0x7f30c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:46.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.314+0000 7f30d4c00640 1 -- 172.21.15.17:0/1834803467 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f30c8095cd0 con 0x7f30d8101e30 2024-09-13T15:56:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.495+0000 7f30dcc00640 1 -- 172.21.15.17:0/1834803467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f30d810da10 con 0x7f30d8101e30 2024-09-13T15:56:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.496+0000 7f30d4c00640 1 -- 172.21.15.17:0/1834803467 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f30c80992f0 con 0x7f30d8101e30 2024-09-13T15:56:46.498 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-13T15:56:46.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.498+0000 7f30dcc00640 1 -- 172.21.15.17:0/1834803467 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30bc0a1090 msgr2=0x7f30bc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:46.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.498+0000 7f30dcc00640 1 --2- 172.21.15.17:0/1834803467 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30bc0a1090 0x7f30bc0a3550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f30d81992d0 tx=0x7f30c0005f90 comp rx=0 tx=0).stop 2024-09-13T15:56:46.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.498+0000 7f30dcc00640 1 -- 172.21.15.17:0/1834803467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d8101e30 msgr2=0x7f30d8197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:46.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.498+0000 7f30dcc00640 1 --2- 172.21.15.17:0/1834803467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d8101e30 0x7f30d8197dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f30c800d950 tx=0x7f30c800de10 comp rx=0 tx=0).stop 2024-09-13T15:56:46.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.498+0000 7f30dcc00640 1 -- 172.21.15.17:0/1834803467 shutdown_connections 2024-09-13T15:56:46.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.498+0000 7f30dcc00640 1 --2- 172.21.15.17:0/1834803467 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f30bc0a1090 0x7f30bc0a3550 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.498+0000 7f30dcc00640 1 --2- 172.21.15.17:0/1834803467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30d8103940 0x7f30d819f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.498+0000 7f30dcc00640 1 --2- 172.21.15.17:0/1834803467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f30d8102f80 0x7f30d8198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.498+0000 7f30dcc00640 1 --2- 172.21.15.17:0/1834803467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d8101e30 0x7f30d8197dc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.498+0000 7f30dcc00640 1 -- 172.21.15.17:0/1834803467 >> 172.21.15.17:0/1834803467 conn(0x7f30d80fd5b0 msgr2=0x7f30d81063e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:46.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.499+0000 7f30dcc00640 1 -- 172.21.15.17:0/1834803467 shutdown_connections 2024-09-13T15:56:46.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.499+0000 7f30dcc00640 1 -- 172.21.15.17:0/1834803467 wait complete. 2024-09-13T15:56:46.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:46 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3311068933' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T15:56:46.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:46 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/2513975743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:56:46.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:46 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/4175037132' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:56:46.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:46 smithi193 ceph-mon[35248]: pgmap v356: 129 pgs: 1 peering, 128 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 7 op/s 2024-09-13T15:56:46.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:46 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3311068933' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T15:56:46.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:46 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/2513975743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:56:46.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:46 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/4175037132' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:56:46.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:46 smithi017 ceph-mon[30494]: pgmap v356: 129 pgs: 1 peering, 128 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 7 op/s 2024-09-13T15:56:46.516 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:56:46.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:46 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3311068933' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T15:56:46.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:46 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/2513975743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:56:46.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:46 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/4175037132' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:56:46.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:46 smithi189 ceph-mon[34790]: pgmap v356: 129 pgs: 1 peering, 128 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 7 op/s 2024-09-13T15:56:46.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.679+0000 7f29a1800640 1 -- 172.21.15.17:0/3021468338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f299c101ea0 msgr2=0x7f299c1022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:46.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.679+0000 7f29a1800640 1 --2- 172.21.15.17:0/3021468338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f299c101ea0 0x7f299c1022a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f298c009900 tx=0x7f298c02a3f0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.679+0000 7f29a1800640 1 -- 172.21.15.17:0/3021468338 shutdown_connections 2024-09-13T15:56:46.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.679+0000 7f29a1800640 1 --2- 172.21.15.17:0/3021468338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f299c103a40 0x7f299c10a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.679+0000 7f29a1800640 1 --2- 172.21.15.17:0/3021468338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f299c103080 0x7f299c103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.679+0000 7f29a1800640 1 --2- 172.21.15.17:0/3021468338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f299c101ea0 0x7f299c1022a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.679+0000 7f29a1800640 1 -- 172.21.15.17:0/3021468338 >> 172.21.15.17:0/3021468338 conn(0x7f299c0fd670 msgr2=0x7f299c0ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:46.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.679+0000 7f29a1800640 1 -- 172.21.15.17:0/3021468338 shutdown_connections 2024-09-13T15:56:46.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.679+0000 7f29a1800640 1 -- 172.21.15.17:0/3021468338 wait complete. 2024-09-13T15:56:46.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.680+0000 7f29a1800640 1 Processor -- start 2024-09-13T15:56:46.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.680+0000 7f29a1800640 1 -- start start 2024-09-13T15:56:46.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.680+0000 7f29a1800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f299c101ea0 0x7f299c197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:46.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.680+0000 7f29a1800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f299c103080 0x7f299c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:46.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.680+0000 7f29a1800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f299c103a40 0x7f299c19f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:46.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.680+0000 7f29a1800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c19f9c0 con 0x7f299c103a40 2024-09-13T15:56:46.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.680+0000 7f29a1800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c19fb30 con 0x7f299c103080 2024-09-13T15:56:46.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.680+0000 7f29a1800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c19fcf0 con 0x7f299c101ea0 2024-09-13T15:56:46.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.680+0000 7f29a0e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f299c103a40 0x7f299c19f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:46.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.680+0000 7f29a0e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f299c103a40 0x7f299c19f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49696/0 (socket says 172.21.15.17:49696) 2024-09-13T15:56:46.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.680+0000 7f29a0e00640 1 -- 172.21.15.17:0/3275709092 learned_addr learned my addr 172.21.15.17:0/3275709092 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:46.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.680+0000 7f2993400640 1 --2- 172.21.15.17:0/3275709092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f299c103080 0x7f299c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:46.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.680+0000 7f299be00640 1 --2- 172.21.15.17:0/3275709092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f299c101ea0 0x7f299c197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:46.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.681+0000 7f29a0e00640 1 -- 172.21.15.17:0/3275709092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f299c101ea0 msgr2=0x7f299c197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:46.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.681+0000 7f29a0e00640 1 --2- 172.21.15.17:0/3275709092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f299c101ea0 0x7f299c197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.681+0000 7f29a0e00640 1 -- 172.21.15.17:0/3275709092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f299c103080 msgr2=0x7f299c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:46.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.681+0000 7f29a0e00640 1 --2- 172.21.15.17:0/3275709092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f299c103080 0x7f299c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.681+0000 7f29a0e00640 1 -- 172.21.15.17:0/3275709092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c009560 con 0x7f299c103a40 2024-09-13T15:56:46.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.681+0000 7f29a0e00640 1 --2- 172.21.15.17:0/3275709092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f299c103a40 0x7f299c19f480 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f299400eb10 tx=0x7f299400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:46.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.681+0000 7f2999600640 1 -- 172.21.15.17:0/3275709092 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994004b20 con 0x7f299c103a40 2024-09-13T15:56:46.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.681+0000 7f2999600640 1 -- 172.21.15.17:0/3275709092 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2994004c80 con 0x7f299c103a40 2024-09-13T15:56:46.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.681+0000 7f2999600640 1 -- 172.21.15.17:0/3275709092 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994010690 con 0x7f299c103a40 2024-09-13T15:56:46.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.681+0000 7f29a1800640 1 -- 172.21.15.17:0/3275709092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299c19ffd0 con 0x7f299c103a40 2024-09-13T15:56:46.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.682+0000 7f29a1800640 1 -- 172.21.15.17:0/3275709092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c1a0450 con 0x7f299c103a40 2024-09-13T15:56:46.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.683+0000 7f29a1800640 1 -- 172.21.15.17:0/3275709092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299c1093a0 con 0x7f299c103a40 2024-09-13T15:56:46.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.685+0000 7f2999600640 1 -- 172.21.15.17:0/3275709092 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2994005020 con 0x7f299c103a40 2024-09-13T15:56:46.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.687+0000 7f2999600640 1 --2- 172.21.15.17:0/3275709092 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f29800a1110 0x7f29800a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:46.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.687+0000 7f2999600640 1 -- 172.21.15.17:0/3275709092 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f2994014070 con 0x7f299c103a40 2024-09-13T15:56:46.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.687+0000 7f299be00640 1 --2- 172.21.15.17:0/3275709092 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f29800a1110 0x7f29800a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:46.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.688+0000 7f299be00640 1 --2- 172.21.15.17:0/3275709092 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f29800a1110 0x7f29800a35d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f298c005ab0 tx=0x7f298c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:46.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.691+0000 7f2999600640 1 -- 172.21.15.17:0/3275709092 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2994096560 con 0x7f299c103a40 2024-09-13T15:56:46.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.871+0000 7f29a1800640 1 -- 172.21.15.17:0/3275709092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f299c108e10 con 0x7f299c103a40 2024-09-13T15:56:46.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.872+0000 7f2999600640 1 -- 172.21.15.17:0/3275709092 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2994099b80 con 0x7f299c103a40 2024-09-13T15:56:46.874 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-13T15:56:46.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.874+0000 7f29a1800640 1 -- 172.21.15.17:0/3275709092 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f29800a1110 msgr2=0x7f29800a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:46.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.874+0000 7f29a1800640 1 --2- 172.21.15.17:0/3275709092 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f29800a1110 0x7f29800a35d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f298c005ab0 tx=0x7f298c0314a0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.874+0000 7f29a1800640 1 -- 172.21.15.17:0/3275709092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f299c103a40 msgr2=0x7f299c19f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:46.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.874+0000 7f29a1800640 1 --2- 172.21.15.17:0/3275709092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f299c103a40 0x7f299c19f480 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f299400eb10 tx=0x7f299400c2d0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.874+0000 7f29a1800640 1 -- 172.21.15.17:0/3275709092 shutdown_connections 2024-09-13T15:56:46.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.874+0000 7f29a1800640 1 --2- 172.21.15.17:0/3275709092 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f29800a1110 0x7f29800a35d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.874+0000 7f29a1800640 1 --2- 172.21.15.17:0/3275709092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f299c103a40 0x7f299c19f480 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.874+0000 7f29a1800640 1 --2- 172.21.15.17:0/3275709092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f299c103080 0x7f299c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.874+0000 7f29a1800640 1 --2- 172.21.15.17:0/3275709092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f299c101ea0 0x7f299c197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:46.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.874+0000 7f29a1800640 1 -- 172.21.15.17:0/3275709092 >> 172.21.15.17:0/3275709092 conn(0x7f299c0fd670 msgr2=0x7f299c106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:46.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.874+0000 7f29a1800640 1 -- 172.21.15.17:0/3275709092 shutdown_connections 2024-09-13T15:56:46.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:46.875+0000 7f29a1800640 1 -- 172.21.15.17:0/3275709092 wait complete. 2024-09-13T15:56:46.892 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:56:47.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.049+0000 7f39dda00640 1 -- 172.21.15.17:0/1738080059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39d8076a50 msgr2=0x7f39d80772f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:47.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.050+0000 7f39dda00640 1 --2- 172.21.15.17:0/1738080059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39d8076a50 0x7f39d80772f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009be0 tx=0x7f39d002a6c0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.050+0000 7f39dda00640 1 -- 172.21.15.17:0/1738080059 shutdown_connections 2024-09-13T15:56:47.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.050+0000 7f39dda00640 1 --2- 172.21.15.17:0/1738080059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39d8076a50 0x7f39d80772f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.050+0000 7f39dda00640 1 --2- 172.21.15.17:0/1738080059 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39d80760b0 0x7f39d8076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.050+0000 7f39dda00640 1 --2- 172.21.15.17:0/1738080059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39d8074e70 0x7f39d8075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.050+0000 7f39dda00640 1 -- 172.21.15.17:0/1738080059 >> 172.21.15.17:0/1738080059 conn(0x7f39d80fd670 msgr2=0x7f39d80ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:47.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.050+0000 7f39dda00640 1 -- 172.21.15.17:0/1738080059 shutdown_connections 2024-09-13T15:56:47.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.050+0000 7f39dda00640 1 -- 172.21.15.17:0/1738080059 wait complete. 2024-09-13T15:56:47.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.051+0000 7f39dda00640 1 Processor -- start 2024-09-13T15:56:47.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.051+0000 7f39dda00640 1 -- start start 2024-09-13T15:56:47.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.051+0000 7f39dda00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39d8074e70 0x7f39d819c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:47.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.051+0000 7f39dda00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39d80760b0 0x7f39d819c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:47.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.051+0000 7f39dda00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39d8076a50 0x7f39d81a38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:47.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.051+0000 7f39dda00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d81a3e20 con 0x7f39d8076a50 2024-09-13T15:56:47.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.051+0000 7f39dda00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d81a3f90 con 0x7f39d80760b0 2024-09-13T15:56:47.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.051+0000 7f39dda00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d81a4150 con 0x7f39d8074e70 2024-09-13T15:56:47.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.051+0000 7f39d7e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39d8074e70 0x7f39d819c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:47.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.051+0000 7f39dd000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39d8076a50 0x7f39d81a38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:47.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.051+0000 7f39cfe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39d80760b0 0x7f39d819c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:47.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.051+0000 7f39d7e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39d8074e70 0x7f39d819c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:37778/0 (socket says 172.21.15.17:37778) 2024-09-13T15:56:47.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.051+0000 7f39d7e00640 1 -- 172.21.15.17:0/865399094 learned_addr learned my addr 172.21.15.17:0/865399094 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:47.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.052+0000 7f39d7e00640 1 -- 172.21.15.17:0/865399094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39d80760b0 msgr2=0x7f39d819c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:47.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.052+0000 7f39d7e00640 1 --2- 172.21.15.17:0/865399094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39d80760b0 0x7f39d819c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.052+0000 7f39d7e00640 1 -- 172.21.15.17:0/865399094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39d8076a50 msgr2=0x7f39d81a38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:47.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.052+0000 7f39d7e00640 1 --2- 172.21.15.17:0/865399094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39d8076a50 0x7f39d81a38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.052+0000 7f39d7e00640 1 -- 172.21.15.17:0/865399094 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c8009560 con 0x7f39d8074e70 2024-09-13T15:56:47.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.052+0000 7f39cfe00640 1 --2- 172.21.15.17:0/865399094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39d80760b0 0x7f39d819c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:47.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.052+0000 7f39d7e00640 1 --2- 172.21.15.17:0/865399094 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39d8074e70 0x7f39d819c330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f39c800e9c0 tx=0x7f39c800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:47.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.052+0000 7f39d5600640 1 -- 172.21.15.17:0/865399094 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c800cde0 con 0x7f39d8074e70 2024-09-13T15:56:47.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.052+0000 7f39dda00640 1 -- 172.21.15.17:0/865399094 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d0009840 con 0x7f39d8074e70 2024-09-13T15:56:47.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.052+0000 7f39d5600640 1 -- 172.21.15.17:0/865399094 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f39c80035f0 con 0x7f39d8074e70 2024-09-13T15:56:47.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.053+0000 7f39d5600640 1 -- 172.21.15.17:0/865399094 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c80044e0 con 0x7f39d8074e70 2024-09-13T15:56:47.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.053+0000 7f39dda00640 1 -- 172.21.15.17:0/865399094 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d81a47b0 con 0x7f39d8074e70 2024-09-13T15:56:47.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.053+0000 7f39dda00640 1 -- 172.21.15.17:0/865399094 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d810ea60 con 0x7f39d8074e70 2024-09-13T15:56:47.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.056+0000 7f39d5600640 1 -- 172.21.15.17:0/865399094 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f39c8003760 con 0x7f39d8074e70 2024-09-13T15:56:47.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.057+0000 7f39d5600640 1 --2- 172.21.15.17:0/865399094 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f39bc0a1090 0x7f39bc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:47.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.057+0000 7f39d5600640 1 -- 172.21.15.17:0/865399094 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f39c8014070 con 0x7f39d8074e70 2024-09-13T15:56:47.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.057+0000 7f39cfe00640 1 --2- 172.21.15.17:0/865399094 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f39bc0a1090 0x7f39bc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:47.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.058+0000 7f39cfe00640 1 --2- 172.21.15.17:0/865399094 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f39bc0a1090 0x7f39bc0a3550 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f39d819d840 tx=0x7f39c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:47.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.059+0000 7f39d5600640 1 -- 172.21.15.17:0/865399094 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f39c8096680 con 0x7f39d8074e70 2024-09-13T15:56:47.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.253+0000 7f39dda00640 1 -- 172.21.15.17:0/865399094 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f39d810e4d0 con 0x7f39d8074e70 2024-09-13T15:56:47.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.254+0000 7f39d5600640 1 -- 172.21.15.17:0/865399094 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f39c8099ca0 con 0x7f39d8074e70 2024-09-13T15:56:47.255 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-09-13T15:56:47.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.256+0000 7f39dda00640 1 -- 172.21.15.17:0/865399094 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f39bc0a1090 msgr2=0x7f39bc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:47.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.256+0000 7f39dda00640 1 --2- 172.21.15.17:0/865399094 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f39bc0a1090 0x7f39bc0a3550 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f39d819d840 tx=0x7f39c0005f90 comp rx=0 tx=0).stop 2024-09-13T15:56:47.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.256+0000 7f39dda00640 1 -- 172.21.15.17:0/865399094 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39d8074e70 msgr2=0x7f39d819c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:47.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.256+0000 7f39dda00640 1 --2- 172.21.15.17:0/865399094 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39d8074e70 0x7f39d819c330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f39c800e9c0 tx=0x7f39c800ee80 comp rx=0 tx=0).stop 2024-09-13T15:56:47.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.256+0000 7f39dda00640 1 -- 172.21.15.17:0/865399094 shutdown_connections 2024-09-13T15:56:47.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.256+0000 7f39dda00640 1 --2- 172.21.15.17:0/865399094 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f39bc0a1090 0x7f39bc0a3550 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.256+0000 7f39dda00640 1 --2- 172.21.15.17:0/865399094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39d8076a50 0x7f39d81a38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.256+0000 7f39dda00640 1 --2- 172.21.15.17:0/865399094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39d80760b0 0x7f39d819c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.256+0000 7f39dda00640 1 --2- 172.21.15.17:0/865399094 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39d8074e70 0x7f39d819c330 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.256+0000 7f39dda00640 1 -- 172.21.15.17:0/865399094 >> 172.21.15.17:0/865399094 conn(0x7f39d80fd670 msgr2=0x7f39d80fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:47.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.256+0000 7f39dda00640 1 -- 172.21.15.17:0/865399094 shutdown_connections 2024-09-13T15:56:47.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.256+0000 7f39dda00640 1 -- 172.21.15.17:0/865399094 wait complete. 2024-09-13T15:56:47.274 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:56:47.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.433+0000 7f3fe8a00640 1 -- 172.21.15.17:0/1866728721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fe40760b0 msgr2=0x7f3fe4076510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:47.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.433+0000 7f3fe8a00640 1 --2- 172.21.15.17:0/1866728721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fe40760b0 0x7f3fe4076510 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009900 tx=0x7f3fd002a410 comp rx=0 tx=0).stop 2024-09-13T15:56:47.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.433+0000 7f3fe8a00640 1 -- 172.21.15.17:0/1866728721 shutdown_connections 2024-09-13T15:56:47.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.433+0000 7f3fe8a00640 1 --2- 172.21.15.17:0/1866728721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3fe4076a50 0x7f3fe40772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.433+0000 7f3fe8a00640 1 --2- 172.21.15.17:0/1866728721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fe40760b0 0x7f3fe4076510 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.433+0000 7f3fe8a00640 1 --2- 172.21.15.17:0/1866728721 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fe4074e70 0x7f3fe4075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.433+0000 7f3fe8a00640 1 -- 172.21.15.17:0/1866728721 >> 172.21.15.17:0/1866728721 conn(0x7f3fe40fd670 msgr2=0x7f3fe40ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:47.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.433+0000 7f3fe8a00640 1 -- 172.21.15.17:0/1866728721 shutdown_connections 2024-09-13T15:56:47.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.433+0000 7f3fe8a00640 1 -- 172.21.15.17:0/1866728721 wait complete. 2024-09-13T15:56:47.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.434+0000 7f3fe8a00640 1 Processor -- start 2024-09-13T15:56:47.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.434+0000 7f3fe8a00640 1 -- start start 2024-09-13T15:56:47.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.434+0000 7f3fe8a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3fe4074e70 0x7f3fe419c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:47.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.434+0000 7f3fe8a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fe40760b0 0x7f3fe419c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:47.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.434+0000 7f3fe8a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fe4076a50 0x7f3fe41a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:47.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.434+0000 7f3fe8a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe41a3e30 con 0x7f3fe40760b0 2024-09-13T15:56:47.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.434+0000 7f3fe8a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe41a3fa0 con 0x7f3fe4076a50 2024-09-13T15:56:47.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.434+0000 7f3fe8a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe41a4160 con 0x7f3fe4074e70 2024-09-13T15:56:47.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.435+0000 7f3fe2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fe40760b0 0x7f3fe419c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:47.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.435+0000 7f3fe3400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3fe4074e70 0x7f3fe419c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:47.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.435+0000 7f3fe2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fe40760b0 0x7f3fe419c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49734/0 (socket says 172.21.15.17:49734) 2024-09-13T15:56:47.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.435+0000 7f3fe2a00640 1 -- 172.21.15.17:0/222163151 learned_addr learned my addr 172.21.15.17:0/222163151 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:47.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.435+0000 7f3fe3e00640 1 --2- 172.21.15.17:0/222163151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fe4076a50 0x7f3fe41a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:47.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.435+0000 7f3fe2a00640 1 -- 172.21.15.17:0/222163151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3fe4074e70 msgr2=0x7f3fe419c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:47.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.435+0000 7f3fe2a00640 1 --2- 172.21.15.17:0/222163151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3fe4074e70 0x7f3fe419c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.435+0000 7f3fe2a00640 1 -- 172.21.15.17:0/222163151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fe4076a50 msgr2=0x7f3fe41a38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:47.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.435+0000 7f3fe2a00640 1 --2- 172.21.15.17:0/222163151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fe4076a50 0x7f3fe41a38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.435+0000 7f3fe2a00640 1 -- 172.21.15.17:0/222163151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd0009560 con 0x7f3fe40760b0 2024-09-13T15:56:47.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.435+0000 7f3fe3400640 1 --2- 172.21.15.17:0/222163151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3fe4074e70 0x7f3fe419c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:47.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.435+0000 7f3fe3e00640 1 --2- 172.21.15.17:0/222163151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fe4076a50 0x7f3fe41a38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:47.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.435+0000 7f3fe2a00640 1 --2- 172.21.15.17:0/222163151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fe40760b0 0x7f3fe419c8d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0031500 tx=0x7f3fd0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:47.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.436+0000 7f3fdbe00640 1 -- 172.21.15.17:0/222163151 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0003e00 con 0x7f3fe40760b0 2024-09-13T15:56:47.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.436+0000 7f3fdbe00640 1 -- 172.21.15.17:0/222163151 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3fd0031c70 con 0x7f3fe40760b0 2024-09-13T15:56:47.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.436+0000 7f3fe8a00640 1 -- 172.21.15.17:0/222163151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe41a43e0 con 0x7f3fe40760b0 2024-09-13T15:56:47.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.436+0000 7f3fdbe00640 1 -- 172.21.15.17:0/222163151 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd003bc20 con 0x7f3fe40760b0 2024-09-13T15:56:47.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.436+0000 7f3fe8a00640 1 -- 172.21.15.17:0/222163151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe41a4840 con 0x7f3fe40760b0 2024-09-13T15:56:47.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.437+0000 7f3fe8a00640 1 -- 172.21.15.17:0/222163151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe410eaf0 con 0x7f3fe40760b0 2024-09-13T15:56:47.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.439+0000 7f3fdbe00640 1 -- 172.21.15.17:0/222163151 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3fd00317b0 con 0x7f3fe40760b0 2024-09-13T15:56:47.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.440+0000 7f3fdbe00640 1 --2- 172.21.15.17:0/222163151 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3fc80a1090 0x7f3fc80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:47.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.440+0000 7f3fdbe00640 1 -- 172.21.15.17:0/222163151 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f3fd00ed500 con 0x7f3fe40760b0 2024-09-13T15:56:47.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.440+0000 7f3fe3400640 1 --2- 172.21.15.17:0/222163151 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3fc80a1090 0x7f3fc80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:47.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.441+0000 7f3fe3400640 1 --2- 172.21.15.17:0/222163151 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3fc80a1090 0x7f3fc80a3550 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4009fc0 tx=0x7f3fd4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:47.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.444+0000 7f3fdbe00640 1 -- 172.21.15.17:0/222163151 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3fd00b6990 con 0x7f3fe40760b0 2024-09-13T15:56:47.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:47 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1834803467' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:56:47.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:47 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3275709092' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T15:56:47.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:47 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1834803467' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:56:47.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:47 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3275709092' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T15:56:47.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:47 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1834803467' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:56:47.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:47 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3275709092' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T15:56:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.622+0000 7f3fe8a00640 1 -- 172.21.15.17:0/222163151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3fe4111c50 con 0x7f3fe40760b0 2024-09-13T15:56:47.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.622+0000 7f3fdbe00640 1 -- 172.21.15.17:0/222163151 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3fe4111c50 con 0x7f3fe40760b0 2024-09-13T15:56:47.624 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-13T15:56:47.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.624+0000 7f3fe8a00640 1 -- 172.21.15.17:0/222163151 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3fc80a1090 msgr2=0x7f3fc80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:47.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.624+0000 7f3fe8a00640 1 --2- 172.21.15.17:0/222163151 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3fc80a1090 0x7f3fc80a3550 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4009fc0 tx=0x7f3fd4005f90 comp rx=0 tx=0).stop 2024-09-13T15:56:47.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.624+0000 7f3fe8a00640 1 -- 172.21.15.17:0/222163151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fe40760b0 msgr2=0x7f3fe419c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:47.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.624+0000 7f3fe8a00640 1 --2- 172.21.15.17:0/222163151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fe40760b0 0x7f3fe419c8d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0031500 tx=0x7f3fd0003c10 comp rx=0 tx=0).stop 2024-09-13T15:56:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.624+0000 7f3fe8a00640 1 -- 172.21.15.17:0/222163151 shutdown_connections 2024-09-13T15:56:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.624+0000 7f3fe8a00640 1 --2- 172.21.15.17:0/222163151 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3fc80a1090 0x7f3fc80a3550 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.624+0000 7f3fe8a00640 1 --2- 172.21.15.17:0/222163151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fe4076a50 0x7f3fe41a38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.624+0000 7f3fe8a00640 1 --2- 172.21.15.17:0/222163151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fe40760b0 0x7f3fe419c8d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.624+0000 7f3fe8a00640 1 --2- 172.21.15.17:0/222163151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3fe4074e70 0x7f3fe419c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.624+0000 7f3fe8a00640 1 -- 172.21.15.17:0/222163151 >> 172.21.15.17:0/222163151 conn(0x7f3fe40fd670 msgr2=0x7f3fe40feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.625+0000 7f3fe8a00640 1 -- 172.21.15.17:0/222163151 shutdown_connections 2024-09-13T15:56:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.625+0000 7f3fe8a00640 1 -- 172.21.15.17:0/222163151 wait complete. 2024-09-13T15:56:47.643 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:56:47.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.799+0000 7fcb8b200640 1 -- 172.21.15.17:0/3609576628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb84101fb0 msgr2=0x7fcb841023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:47.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.799+0000 7fcb8b200640 1 --2- 172.21.15.17:0/3609576628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb84101fb0 0x7fcb841023b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009900 tx=0x7fcb7402a410 comp rx=0 tx=0).stop 2024-09-13T15:56:47.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.799+0000 7fcb8b200640 1 -- 172.21.15.17:0/3609576628 shutdown_connections 2024-09-13T15:56:47.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.799+0000 7fcb8b200640 1 --2- 172.21.15.17:0/3609576628 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb84103b60 0x7fcb8410a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.799+0000 7fcb8b200640 1 --2- 172.21.15.17:0/3609576628 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb841031a0 0x7fcb84103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.799+0000 7fcb8b200640 1 --2- 172.21.15.17:0/3609576628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb84101fb0 0x7fcb841023b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.799+0000 7fcb8b200640 1 -- 172.21.15.17:0/3609576628 >> 172.21.15.17:0/3609576628 conn(0x7fcb840fd730 msgr2=0x7fcb840ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:47.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.799+0000 7fcb8b200640 1 -- 172.21.15.17:0/3609576628 shutdown_connections 2024-09-13T15:56:47.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.799+0000 7fcb8b200640 1 -- 172.21.15.17:0/3609576628 wait complete. 2024-09-13T15:56:47.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.800+0000 7fcb8b200640 1 Processor -- start 2024-09-13T15:56:47.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.800+0000 7fcb8b200640 1 -- start start 2024-09-13T15:56:47.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.800+0000 7fcb8b200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb84101fb0 0x7fcb84197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:47.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.800+0000 7fcb8b200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb841031a0 0x7fcb841984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:47.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.800+0000 7fcb8b200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb84103b60 0x7fcb8419f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:47.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.800+0000 7fcb8b200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8419faa0 con 0x7fcb84103b60 2024-09-13T15:56:47.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.800+0000 7fcb8b200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8419fc10 con 0x7fcb841031a0 2024-09-13T15:56:47.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.800+0000 7fcb8b200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8419fdd0 con 0x7fcb84101fb0 2024-09-13T15:56:47.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.800+0000 7fcb89200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb84103b60 0x7fcb8419f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:47.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.800+0000 7fcb83e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb84101fb0 0x7fcb84197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:47.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.801+0000 7fcb89200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb84103b60 0x7fcb8419f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49748/0 (socket says 172.21.15.17:49748) 2024-09-13T15:56:47.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.801+0000 7fcb89200640 1 -- 172.21.15.17:0/3647209657 learned_addr learned my addr 172.21.15.17:0/3647209657 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:47.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.801+0000 7fcb7be00640 1 --2- 172.21.15.17:0/3647209657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb841031a0 0x7fcb841984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:47.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.801+0000 7fcb89200640 1 -- 172.21.15.17:0/3647209657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb84101fb0 msgr2=0x7fcb84197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:47.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.801+0000 7fcb89200640 1 --2- 172.21.15.17:0/3647209657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb84101fb0 0x7fcb84197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.801+0000 7fcb89200640 1 -- 172.21.15.17:0/3647209657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb841031a0 msgr2=0x7fcb841984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:47.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.801+0000 7fcb89200640 1 --2- 172.21.15.17:0/3647209657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb841031a0 0x7fcb841984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:47.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.801+0000 7fcb89200640 1 -- 172.21.15.17:0/3647209657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6c009490 con 0x7fcb84103b60 2024-09-13T15:56:47.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.801+0000 7fcb89200640 1 --2- 172.21.15.17:0/3647209657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb84103b60 0x7fcb8419f560 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00eb10 tx=0x7fcb7c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:47.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.801+0000 7fcb81600640 1 -- 172.21.15.17:0/3647209657 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c004b20 con 0x7fcb84103b60 2024-09-13T15:56:47.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.801+0000 7fcb81600640 1 -- 172.21.15.17:0/3647209657 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb7c004c80 con 0x7fcb84103b60 2024-09-13T15:56:47.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.801+0000 7fcb8b200640 1 -- 172.21.15.17:0/3647209657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb74009560 con 0x7fcb84103b60 2024-09-13T15:56:47.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.801+0000 7fcb81600640 1 -- 172.21.15.17:0/3647209657 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c010690 con 0x7fcb84103b60 2024-09-13T15:56:47.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.802+0000 7fcb8b200640 1 -- 172.21.15.17:0/3647209657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb841a0430 con 0x7fcb84103b60 2024-09-13T15:56:47.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.803+0000 7fcb8b200640 1 -- 172.21.15.17:0/3647209657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb84109460 con 0x7fcb84103b60 2024-09-13T15:56:47.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.804+0000 7fcb81600640 1 -- 172.21.15.17:0/3647209657 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fcb7c005020 con 0x7fcb84103b60 2024-09-13T15:56:47.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.806+0000 7fcb81600640 1 --2- 172.21.15.17:0/3647209657 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcb680a1110 0x7fcb680a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:47.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.806+0000 7fcb81600640 1 -- 172.21.15.17:0/3647209657 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fcb7c014070 con 0x7fcb84103b60 2024-09-13T15:56:47.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.806+0000 7fcb83e00640 1 --2- 172.21.15.17:0/3647209657 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcb680a1110 0x7fcb680a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:47.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.807+0000 7fcb83e00640 1 --2- 172.21.15.17:0/3647209657 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcb680a1110 0x7fcb680a35d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcb74031500 tx=0x7fcb74005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:47.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:47.810+0000 7fcb81600640 1 -- 172.21.15.17:0/3647209657 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcb7c096590 con 0x7fcb84103b60 2024-09-13T15:56:48.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.031+0000 7fcb8b200640 1 -- 172.21.15.17:0/3647209657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb8410d8a0 con 0x7fcb84103b60 2024-09-13T15:56:48.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.032+0000 7fcb81600640 1 -- 172.21.15.17:0/3647209657 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10879 (secure 0 0 0) 0x7fcb7c094e60 con 0x7fcb84103b60 2024-09-13T15:56:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:56:48.033 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1730156534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1730156534},{"type":"v1","addr":"172.21.15.17:6837","nonce":1730156534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/1295854211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1295854211},{"type":"v1","addr":"172.21.15.17:6841","nonce":1295854211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2888593680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2888593680},{"type":"v1","addr":"172.21.15.17:6835","nonce":2888593680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4135454212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4135454212},{"type":"v1","addr":"172.21.15.189:6835","nonce":4135454212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T15:54:52.929867+0000","modified":"2024-09-13T15:55:16.253229+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24565,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24520":{"gid":24520,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/4049465204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":4049465204},{"type":"v1","addr":"172.21.15.193:6835","nonce":4049465204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/2079181485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2079181485},{"type":"v1","addr":"172.21.15.189:6837","nonce":2079181485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24532":{"gid":24532,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/792056943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":792056943},{"type":"v1","addr":"172.21.15.193:6837","nonce":792056943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24553":{"gid":24553,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6839/3012199875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":3012199875},{"type":"v1","addr":"172.21.15.193:6839","nonce":3012199875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24565":{"gid":24565,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.17:6839/3750040765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3750040765},{"type":"v1","addr":"172.21.15.17:6839","nonce":3750040765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6839/2624723395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2624723395},{"type":"v1","addr":"172.21.15.189:6839","nonce":2624723395}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:56:48.034 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-13T15:56:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.034+0000 7fcb8b200640 1 -- 172.21.15.17:0/3647209657 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcb680a1110 msgr2=0x7fcb680a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.034+0000 7fcb8b200640 1 --2- 172.21.15.17:0/3647209657 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcb680a1110 0x7fcb680a35d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcb74031500 tx=0x7fcb74005780 comp rx=0 tx=0).stop 2024-09-13T15:56:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.034+0000 7fcb8b200640 1 -- 172.21.15.17:0/3647209657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb84103b60 msgr2=0x7fcb8419f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.034+0000 7fcb8b200640 1 --2- 172.21.15.17:0/3647209657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb84103b60 0x7fcb8419f560 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00eb10 tx=0x7fcb7c00c2d0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.034+0000 7fcb8b200640 1 -- 172.21.15.17:0/3647209657 shutdown_connections 2024-09-13T15:56:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.034+0000 7fcb8b200640 1 --2- 172.21.15.17:0/3647209657 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcb680a1110 0x7fcb680a35d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.034+0000 7fcb8b200640 1 --2- 172.21.15.17:0/3647209657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb84103b60 0x7fcb8419f560 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.034+0000 7fcb8b200640 1 --2- 172.21.15.17:0/3647209657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb841031a0 0x7fcb841984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.034+0000 7fcb8b200640 1 --2- 172.21.15.17:0/3647209657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb84101fb0 0x7fcb84197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.034+0000 7fcb8b200640 1 -- 172.21.15.17:0/3647209657 >> 172.21.15.17:0/3647209657 conn(0x7fcb840fd730 msgr2=0x7fcb84106630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.034+0000 7fcb8b200640 1 -- 172.21.15.17:0/3647209657 shutdown_connections 2024-09-13T15:56:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.034+0000 7fcb8b200640 1 -- 172.21.15.17:0/3647209657 wait complete. 2024-09-13T15:56:48.052 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:56:48.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.207+0000 7f536e600640 1 -- 172.21.15.17:0/3974150228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5368107e00 msgr2=0x7f536810a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:48.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.207+0000 7f536e600640 1 --2- 172.21.15.17:0/3974150228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5368107e00 0x7f536810a1f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5360009ca0 tx=0x7f536002a8b0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.207+0000 7f536e600640 1 -- 172.21.15.17:0/3974150228 shutdown_connections 2024-09-13T15:56:48.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.207+0000 7f536e600640 1 --2- 172.21.15.17:0/3974150228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5368107e00 0x7f536810a1f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.207+0000 7f536e600640 1 --2- 172.21.15.17:0/3974150228 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5368073280 0x7f53681078c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.207+0000 7f536e600640 1 --2- 172.21.15.17:0/3974150228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5368072940 0x7f5368072d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.207+0000 7f536e600640 1 -- 172.21.15.17:0/3974150228 >> 172.21.15.17:0/3974150228 conn(0x7f53680fb240 msgr2=0x7f53680fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:48.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.208+0000 7f536e600640 1 -- 172.21.15.17:0/3974150228 shutdown_connections 2024-09-13T15:56:48.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.208+0000 7f536e600640 1 -- 172.21.15.17:0/3974150228 wait complete. 2024-09-13T15:56:48.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.208+0000 7f536e600640 1 Processor -- start 2024-09-13T15:56:48.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.209+0000 7f536e600640 1 -- start start 2024-09-13T15:56:48.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.209+0000 7f536e600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5368072940 0x7f5368197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:48.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.209+0000 7f536e600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5368073280 0x7f53681982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:48.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.209+0000 7f536e600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5368107e00 0x7f536819f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:48.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.209+0000 7f536e600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536819f890 con 0x7f5368072940 2024-09-13T15:56:48.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.209+0000 7f536e600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536819fa00 con 0x7f5368073280 2024-09-13T15:56:48.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.209+0000 7f536e600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536819fbc0 con 0x7f5368107e00 2024-09-13T15:56:48.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.209+0000 7f536d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5368072940 0x7f5368197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:48.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.209+0000 7f536d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5368072940 0x7f5368197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49764/0 (socket says 172.21.15.17:49764) 2024-09-13T15:56:48.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.209+0000 7f536d200640 1 -- 172.21.15.17:0/836916481 learned_addr learned my addr 172.21.15.17:0/836916481 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:48.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.209+0000 7f536dc00640 1 --2- 172.21.15.17:0/836916481 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5368107e00 0x7f536819f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:48.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.209+0000 7f5367e00640 1 --2- 172.21.15.17:0/836916481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5368073280 0x7f53681982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:48.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.209+0000 7f536d200640 1 -- 172.21.15.17:0/836916481 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5368107e00 msgr2=0x7f536819f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:48.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.209+0000 7f536d200640 1 --2- 172.21.15.17:0/836916481 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5368107e00 0x7f536819f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.210+0000 7f536d200640 1 -- 172.21.15.17:0/836916481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5368073280 msgr2=0x7f53681982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:48.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.210+0000 7f536d200640 1 --2- 172.21.15.17:0/836916481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5368073280 0x7f53681982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.210+0000 7f536d200640 1 -- 172.21.15.17:0/836916481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5360009900 con 0x7f5368072940 2024-09-13T15:56:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.210+0000 7f5367e00640 1 --2- 172.21.15.17:0/836916481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5368073280 0x7f53681982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:56:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.210+0000 7f536d200640 1 --2- 172.21.15.17:0/836916481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5368072940 0x7f5368197db0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f535c00e9f0 tx=0x7f535c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.210+0000 7f5365600640 1 -- 172.21.15.17:0/836916481 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c009700 con 0x7f5368072940 2024-09-13T15:56:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.210+0000 7f5365600640 1 -- 172.21.15.17:0/836916481 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f535c00cd80 con 0x7f5368072940 2024-09-13T15:56:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.210+0000 7f5365600640 1 -- 172.21.15.17:0/836916481 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c018860 con 0x7f5368072940 2024-09-13T15:56:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.210+0000 7f536e600640 1 -- 172.21.15.17:0/836916481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f536819fea0 con 0x7f5368072940 2024-09-13T15:56:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.210+0000 7f536e600640 1 -- 172.21.15.17:0/836916481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53681a02c0 con 0x7f5368072940 2024-09-13T15:56:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.211+0000 7f536e600640 1 -- 172.21.15.17:0/836916481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5368072d40 con 0x7f5368072940 2024-09-13T15:56:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.213+0000 7f5365600640 1 -- 172.21.15.17:0/836916481 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f535c0189c0 con 0x7f5368072940 2024-09-13T15:56:48.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.214+0000 7f5365600640 1 --2- 172.21.15.17:0/836916481 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f53500a1110 0x7f53500a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:48.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.214+0000 7f5365600640 1 -- 172.21.15.17:0/836916481 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f535c014070 con 0x7f5368072940 2024-09-13T15:56:48.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.215+0000 7f5367e00640 1 --2- 172.21.15.17:0/836916481 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f53500a1110 0x7f53500a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:48.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.215+0000 7f5367e00640 1 --2- 172.21.15.17:0/836916481 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f53500a1110 0x7f53500a35d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f53540058c0 tx=0x7f5354005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:48.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.218+0000 7f5365600640 1 -- 172.21.15.17:0/836916481 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f535c052e20 con 0x7f5368072940 2024-09-13T15:56:48.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.400+0000 7f536e600640 1 -- 172.21.15.17:0/836916481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53681066d0 con 0x7f5368072940 2024-09-13T15:56:48.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.402+0000 7f5365600640 1 -- 172.21.15.17:0/836916481 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24575 (secure 0 0 0) 0x7f535c096390 con 0x7f5368072940 2024-09-13T15:56:48.404 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:56:48.404 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":94,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","created":"2024-09-13T15:46:50.475750+0000","modified":"2024-09-13T15:56:44.228817+0000","last_up_change":"2024-09-13T15:53:59.138985+0000","last_in_change":"2024-09-13T15:53:39.220264+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:50:10.657011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:54:51.436469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:54:52.427930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:54:55.478058+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5d39d6af-15e6-463b-b9ff-a9a5dd94e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6803","nonce":158651212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6805","nonce":158651212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6809","nonce":158651212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6807","nonce":158651212}]},"public_addr":"172.21.15.17:6803/158651212","cluster_addr":"172.21.15.17:6805/158651212","heartbeat_back_addr":"172.21.15.17:6809/158651212","heartbeat_front_addr":"172.21.15.17:6807/158651212","state":["exists","up"]},{"osd":1,"uuid":"0da621c7-645b-44ae-ba7c-a573861c3aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6801","nonce":964319421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6803","nonce":964319421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6807","nonce":964319421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6805","nonce":964319421}]},"public_addr":"172.21.15.189:6801/964319421","cluster_addr":"172.21.15.189:6803/964319421","heartbeat_back_addr":"172.21.15.189:6807/964319421","heartbeat_front_addr":"172.21.15.189:6805/964319421","state":["exists","up"]},{"osd":2,"uuid":"fa95af60-1486-4a29-8c79-8a73a4146552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6801","nonce":138468002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6803","nonce":138468002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6807","nonce":138468002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6805","nonce":138468002}]},"public_addr":"172.21.15.193:6801/138468002","cluster_addr":"172.21.15.193:6803/138468002","heartbeat_back_addr":"172.21.15.193:6807/138468002","heartbeat_front_addr":"172.21.15.193:6805/138468002","state":["exists","up"]},{"osd":3,"uuid":"90428e5f-dfd4-4cda-b240-fdb9079bcb7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6811","nonce":919913803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6813","nonce":919913803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6817","nonce":919913803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6815","nonce":919913803}]},"public_addr":"172.21.15.17:6811/919913803","cluster_addr":"172.21.15.17:6813/919913803","heartbeat_back_addr":"172.21.15.17:6817/919913803","heartbeat_front_addr":"172.21.15.17:6815/919913803","state":["exists","up"]},{"osd":4,"uuid":"e1c537b6-98d2-4b66-b15a-65fe70b0ce25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6809","nonce":2310375565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6811","nonce":2310375565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6815","nonce":2310375565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6813","nonce":2310375565}]},"public_addr":"172.21.15.189:6809/2310375565","cluster_addr":"172.21.15.189:6811/2310375565","heartbeat_back_addr":"172.21.15.189:6815/2310375565","heartbeat_front_addr":"172.21.15.189:6813/2310375565","state":["exists","up"]},{"osd":5,"uuid":"48522fd7-d781-4447-873f-174dabd1e33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6809","nonce":1330877824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6811","nonce":1330877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6815","nonce":1330877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6813","nonce":1330877824}]},"public_addr":"172.21.15.193:6809/1330877824","cluster_addr":"172.21.15.193:6811/1330877824","heartbeat_back_addr":"172.21.15.193:6815/1330877824","heartbeat_front_addr":"172.21.15.193:6813/1330877824","state":["exists","up"]},{"osd":6,"uuid":"47bea191-fb53-40a7-8563-8ebf17dd5bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6819","nonce":3930545382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6821","nonce":3930545382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6825","nonce":3930545382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6823","nonce":3930545382}]},"public_addr":"172.21.15.17:6819/3930545382","cluster_addr":"172.21.15.17:6821/3930545382","heartbeat_back_addr":"172.21.15.17:6825/3930545382","heartbeat_front_addr":"172.21.15.17:6823/3930545382","state":["exists","up"]},{"osd":7,"uuid":"a98f36f9-0a19-4c9a-8ed1-615c4a6e7658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6817","nonce":3691677495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6819","nonce":3691677495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6823","nonce":3691677495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6821","nonce":3691677495}]},"public_addr":"172.21.15.189:6817/3691677495","cluster_addr":"172.21.15.189:6819/3691677495","heartbeat_back_addr":"172.21.15.189:6823/3691677495","heartbeat_front_addr":"172.21.15.189:6821/3691677495","state":["exists","up"]},{"osd":8,"uuid":"7a372d9f-c40f-4ead-87da-2f3a570c1373","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6817","nonce":4112907498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6819","nonce":4112907498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6823","nonce":4112907498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6821","nonce":4112907498}]},"public_addr":"172.21.15.193:6817/4112907498","cluster_addr":"172.21.15.193:6819/4112907498","heartbeat_back_addr":"172.21.15.193:6823/4112907498","heartbeat_front_addr":"172.21.15.193:6821/4112907498","state":["exists","up"]},{"osd":9,"uuid":"ac3d983c-c5e7-456b-8271-7c4e6169de61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6827","nonce":663424274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6829","nonce":663424274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6833","nonce":663424274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6831","nonce":663424274}]},"public_addr":"172.21.15.17:6827/663424274","cluster_addr":"172.21.15.17:6829/663424274","heartbeat_back_addr":"172.21.15.17:6833/663424274","heartbeat_front_addr":"172.21.15.17:6831/663424274","state":["exists","up"]},{"osd":10,"uuid":"08dcae02-6c79-4a06-ae88-6eb6e6941cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6825","nonce":3153990375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6827","nonce":3153990375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6831","nonce":3153990375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6829","nonce":3153990375}]},"public_addr":"172.21.15.189:6825/3153990375","cluster_addr":"172.21.15.189:6827/3153990375","heartbeat_back_addr":"172.21.15.189:6831/3153990375","heartbeat_front_addr":"172.21.15.189:6829/3153990375","state":["exists","up"]},{"osd":11,"uuid":"a4ebcf41-d805-4d44-b112-13ae84d51868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6825","nonce":4088053907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6827","nonce":4088053907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6831","nonce":4088053907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6829","nonce":4088053907}]},"public_addr":"172.21.15.193:6825/4088053907","cluster_addr":"172.21.15.193:6827/4088053907","heartbeat_back_addr":"172.21.15.193:6831/4088053907","heartbeat_front_addr":"172.21.15.193:6829/4088053907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:22.172370+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:44.802224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:06.641435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:34.536515+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:58.789324+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:22.189862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:50.382257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:14.678047+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:38.581105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:07.258150+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:32.261383+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:56.739338+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8},{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/1550067038":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/3360683829":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/634066188":"2024-09-14T15:47:42.048005+0000","172.21.15.17:6801/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1945536687":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/2214214377":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1224386591":"2024-09-14T15:47:14.996424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:56:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.404+0000 7f536e600640 1 -- 172.21.15.17:0/836916481 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f53500a1110 msgr2=0x7f53500a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.404+0000 7f536e600640 1 --2- 172.21.15.17:0/836916481 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f53500a1110 0x7f53500a35d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f53540058c0 tx=0x7f5354005850 comp rx=0 tx=0).stop 2024-09-13T15:56:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.404+0000 7f536e600640 1 -- 172.21.15.17:0/836916481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5368072940 msgr2=0x7f5368197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.404+0000 7f536e600640 1 --2- 172.21.15.17:0/836916481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5368072940 0x7f5368197db0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f535c00e9f0 tx=0x7f535c00eeb0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.404+0000 7f536e600640 1 -- 172.21.15.17:0/836916481 shutdown_connections 2024-09-13T15:56:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.404+0000 7f536e600640 1 --2- 172.21.15.17:0/836916481 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f53500a1110 0x7f53500a35d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.404+0000 7f536e600640 1 --2- 172.21.15.17:0/836916481 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5368107e00 0x7f536819f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.404+0000 7f536e600640 1 --2- 172.21.15.17:0/836916481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5368073280 0x7f53681982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.404+0000 7f536e600640 1 --2- 172.21.15.17:0/836916481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5368072940 0x7f5368197db0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.404+0000 7f536e600640 1 -- 172.21.15.17:0/836916481 >> 172.21.15.17:0/836916481 conn(0x7f53680fb240 msgr2=0x7f53681038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.404+0000 7f536e600640 1 -- 172.21.15.17:0/836916481 shutdown_connections 2024-09-13T15:56:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.404+0000 7f536e600640 1 -- 172.21.15.17:0/836916481 wait complete. 2024-09-13T15:56:48.419 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:48 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/865399094' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T15:56:48.420 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:48 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/222163151' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T15:56:48.420 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:48 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3647209657' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:56:48.420 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:48 smithi017 ceph-mon[30494]: pgmap v357: 129 pgs: 1 peering, 128 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 639 B/s wr, 7 op/s 2024-09-13T15:56:48.422 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:56:48.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.577+0000 7fc032800640 1 -- 172.21.15.17:0/1470205492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc02c103960 msgr2=0x7fc02c10a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:48.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.577+0000 7fc032800640 1 --2- 172.21.15.17:0/1470205492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc02c103960 0x7fc02c10a1f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc024009ca0 tx=0x7fc02402a8c0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.578+0000 7fc032800640 1 -- 172.21.15.17:0/1470205492 shutdown_connections 2024-09-13T15:56:48.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.578+0000 7fc032800640 1 --2- 172.21.15.17:0/1470205492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc02c103960 0x7fc02c10a1f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.578+0000 7fc032800640 1 --2- 172.21.15.17:0/1470205492 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc02c102fa0 0x7fc02c103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.578+0000 7fc032800640 1 --2- 172.21.15.17:0/1470205492 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc02c101db0 0x7fc02c1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.578+0000 7fc032800640 1 -- 172.21.15.17:0/1470205492 >> 172.21.15.17:0/1470205492 conn(0x7fc02c0fd530 msgr2=0x7fc02c0ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:48.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.578+0000 7fc032800640 1 -- 172.21.15.17:0/1470205492 shutdown_connections 2024-09-13T15:56:48.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.578+0000 7fc032800640 1 -- 172.21.15.17:0/1470205492 wait complete. 2024-09-13T15:56:48.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.579+0000 7fc032800640 1 Processor -- start 2024-09-13T15:56:48.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.579+0000 7fc032800640 1 -- start start 2024-09-13T15:56:48.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.579+0000 7fc032800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc02c101db0 0x7fc02c197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:48.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.579+0000 7fc032800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc02c102fa0 0x7fc02c198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:48.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.579+0000 7fc032800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc02c103960 0x7fc02c19f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:48.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.579+0000 7fc032800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c19f830 con 0x7fc02c103960 2024-09-13T15:56:48.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.579+0000 7fc032800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c19f9a0 con 0x7fc02c102fa0 2024-09-13T15:56:48.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.579+0000 7fc032800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c19fb60 con 0x7fc02c101db0 2024-09-13T15:56:48.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.579+0000 7fc031e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc02c103960 0x7fc02c19f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:48.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.579+0000 7fc031e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc02c103960 0x7fc02c19f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49784/0 (socket says 172.21.15.17:49784) 2024-09-13T15:56:48.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.579+0000 7fc031e00640 1 -- 172.21.15.17:0/4170274557 learned_addr learned my addr 172.21.15.17:0/4170274557 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:48.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.579+0000 7fc031400640 1 --2- 172.21.15.17:0/4170274557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc02c101db0 0x7fc02c197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:48.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.579+0000 7fc030a00640 1 --2- 172.21.15.17:0/4170274557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc02c102fa0 0x7fc02c198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:48.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.580+0000 7fc031e00640 1 -- 172.21.15.17:0/4170274557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc02c101db0 msgr2=0x7fc02c197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:48.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.580+0000 7fc031e00640 1 --2- 172.21.15.17:0/4170274557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc02c101db0 0x7fc02c197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.580+0000 7fc031e00640 1 -- 172.21.15.17:0/4170274557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc02c102fa0 msgr2=0x7fc02c198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:48.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.580+0000 7fc031e00640 1 --2- 172.21.15.17:0/4170274557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc02c102fa0 0x7fc02c198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.580+0000 7fc031e00640 1 -- 172.21.15.17:0/4170274557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc024009900 con 0x7fc02c103960 2024-09-13T15:56:48.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.580+0000 7fc031e00640 1 --2- 172.21.15.17:0/4170274557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc02c103960 0x7fc02c19f2f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc02402aeb0 tx=0x7fc024003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:48.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.580+0000 7fc02a000640 1 -- 172.21.15.17:0/4170274557 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0240307c0 con 0x7fc02c103960 2024-09-13T15:56:48.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.580+0000 7fc02a000640 1 -- 172.21.15.17:0/4170274557 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc024040070 con 0x7fc02c103960 2024-09-13T15:56:48.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.580+0000 7fc032800640 1 -- 172.21.15.17:0/4170274557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc02c19fde0 con 0x7fc02c103960 2024-09-13T15:56:48.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.580+0000 7fc02a000640 1 -- 172.21.15.17:0/4170274557 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0240044a0 con 0x7fc02c103960 2024-09-13T15:56:48.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.581+0000 7fc032800640 1 -- 172.21.15.17:0/4170274557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02c1a0260 con 0x7fc02c103960 2024-09-13T15:56:48.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.582+0000 7fc032800640 1 -- 172.21.15.17:0/4170274557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc02c109240 con 0x7fc02c103960 2024-09-13T15:56:48.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.583+0000 7fc02a000640 1 -- 172.21.15.17:0/4170274557 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc024042030 con 0x7fc02c103960 2024-09-13T15:56:48.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.585+0000 7fc02a000640 1 --2- 172.21.15.17:0/4170274557 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc0140a1090 0x7fc0140a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:48.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.585+0000 7fc02a000640 1 -- 172.21.15.17:0/4170274557 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fc0240ee3b0 con 0x7fc02c103960 2024-09-13T15:56:48.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.585+0000 7fc031400640 1 --2- 172.21.15.17:0/4170274557 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc0140a1090 0x7fc0140a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:48.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.586+0000 7fc031400640 1 --2- 172.21.15.17:0/4170274557 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc0140a1090 0x7fc0140a3550 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc02c102e00 tx=0x7fc020005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:48.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.586+0000 7fc02a000640 1 -- 172.21.15.17:0/4170274557 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc0240b7790 con 0x7fc02c103960 2024-09-13T15:56:48.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:48 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/865399094' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T15:56:48.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:48 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/222163151' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T15:56:48.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:48 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3647209657' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:56:48.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:48 smithi189 ceph-mon[34790]: pgmap v357: 129 pgs: 1 peering, 128 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 639 B/s wr, 7 op/s 2024-09-13T15:56:48.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:48 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/865399094' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T15:56:48.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:48 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/222163151' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T15:56:48.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:48 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3647209657' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:56:48.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:48 smithi193 ceph-mon[35248]: pgmap v357: 129 pgs: 1 peering, 128 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 639 B/s wr, 7 op/s 2024-09-13T15:56:48.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.806+0000 7fc032800640 1 -- 172.21.15.17:0/4170274557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc02c10d670 con 0x7fc02c103960 2024-09-13T15:56:48.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.807+0000 7fc02a000640 1 -- 172.21.15.17:0/4170274557 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10879 (secure 0 0 0) 0x7fc0240badb0 con 0x7fc02c103960 2024-09-13T15:56:48.808 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:56:48.808 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1730156534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1730156534},{"type":"v1","addr":"172.21.15.17:6837","nonce":1730156534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/1295854211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1295854211},{"type":"v1","addr":"172.21.15.17:6841","nonce":1295854211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2888593680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2888593680},{"type":"v1","addr":"172.21.15.17:6835","nonce":2888593680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4135454212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4135454212},{"type":"v1","addr":"172.21.15.189:6835","nonce":4135454212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T15:54:52.929867+0000","modified":"2024-09-13T15:55:16.253229+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24565,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24520":{"gid":24520,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/4049465204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":4049465204},{"type":"v1","addr":"172.21.15.193:6835","nonce":4049465204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/2079181485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2079181485},{"type":"v1","addr":"172.21.15.189:6837","nonce":2079181485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24532":{"gid":24532,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/792056943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":792056943},{"type":"v1","addr":"172.21.15.193:6837","nonce":792056943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24553":{"gid":24553,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6839/3012199875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":3012199875},{"type":"v1","addr":"172.21.15.193:6839","nonce":3012199875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24565":{"gid":24565,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.17:6839/3750040765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3750040765},{"type":"v1","addr":"172.21.15.17:6839","nonce":3750040765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6839/2624723395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2624723395},{"type":"v1","addr":"172.21.15.189:6839","nonce":2624723395}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:56:48.809 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-13T15:56:48.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.809+0000 7fc032800640 1 -- 172.21.15.17:0/4170274557 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc0140a1090 msgr2=0x7fc0140a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:48.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.809+0000 7fc032800640 1 --2- 172.21.15.17:0/4170274557 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc0140a1090 0x7fc0140a3550 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc02c102e00 tx=0x7fc020005f90 comp rx=0 tx=0).stop 2024-09-13T15:56:48.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.809+0000 7fc032800640 1 -- 172.21.15.17:0/4170274557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc02c103960 msgr2=0x7fc02c19f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:48.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.809+0000 7fc032800640 1 --2- 172.21.15.17:0/4170274557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc02c103960 0x7fc02c19f2f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc02402aeb0 tx=0x7fc024003c20 comp rx=0 tx=0).stop 2024-09-13T15:56:48.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.809+0000 7fc032800640 1 -- 172.21.15.17:0/4170274557 shutdown_connections 2024-09-13T15:56:48.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.809+0000 7fc032800640 1 --2- 172.21.15.17:0/4170274557 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc0140a1090 0x7fc0140a3550 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.809+0000 7fc032800640 1 --2- 172.21.15.17:0/4170274557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc02c103960 0x7fc02c19f2f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.809+0000 7fc032800640 1 --2- 172.21.15.17:0/4170274557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc02c102fa0 0x7fc02c198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.809+0000 7fc032800640 1 --2- 172.21.15.17:0/4170274557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc02c101db0 0x7fc02c197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.809+0000 7fc032800640 1 -- 172.21.15.17:0/4170274557 >> 172.21.15.17:0/4170274557 conn(0x7fc02c0fd530 msgr2=0x7fc02c106410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:48.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.809+0000 7fc032800640 1 -- 172.21.15.17:0/4170274557 shutdown_connections 2024-09-13T15:56:48.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.809+0000 7fc032800640 1 -- 172.21.15.17:0/4170274557 wait complete. 2024-09-13T15:56:48.827 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-13T15:54:52.929867+0000', 'modified': '2024-09-13T15:55:16.253229+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24578, 'mds_1': 24565, 'mds_2': 24553}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24520': {'gid': 24520, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.193:6835/4049465204', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6834', 'nonce': 4049465204}, {'type': 'v1', 'addr': '172.21.15.193:6835', 'nonce': 4049465204}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24524': {'gid': 24524, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6837/2079181485', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6836', 'nonce': 2079181485}, {'type': 'v1', 'addr': '172.21.15.189:6837', 'nonce': 2079181485}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24532': {'gid': 24532, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.193:6837/792056943', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6836', 'nonce': 792056943}, {'type': 'v1', 'addr': '172.21.15.193:6837', 'nonce': 792056943}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24553': {'gid': 24553, 'name': 'i', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.193:6839/3012199875', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6838', 'nonce': 3012199875}, {'type': 'v1', 'addr': '172.21.15.193:6839', 'nonce': 3012199875}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24565': {'gid': 24565, 'name': 'g', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.17:6839/3750040765', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6838', 'nonce': 3750040765}, {'type': 'v1', 'addr': '172.21.15.17:6839', 'nonce': 3750040765}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24578': {'gid': 24578, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.189:6839/2624723395', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 2624723395}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 2624723395}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T15:56:48.828 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-13T15:56:48.828 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-09-13T15:56:48.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.986+0000 7f246f200640 1 -- 172.21.15.17:0/2548828561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2470101d80 msgr2=0x7f2470102180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:48.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.986+0000 7f246f200640 1 --2- 172.21.15.17:0/2548828561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2470101d80 0x7f2470102180 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2460009900 tx=0x7f246002a410 comp rx=0 tx=0).stop 2024-09-13T15:56:48.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.986+0000 7f246f200640 1 -- 172.21.15.17:0/2548828561 shutdown_connections 2024-09-13T15:56:48.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.986+0000 7f246f200640 1 --2- 172.21.15.17:0/2548828561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2470103930 0x7f247010a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.986+0000 7f246f200640 1 --2- 172.21.15.17:0/2548828561 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2470102f70 0x7f24701033f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.986+0000 7f246f200640 1 --2- 172.21.15.17:0/2548828561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2470101d80 0x7f2470102180 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.986+0000 7f246f200640 1 -- 172.21.15.17:0/2548828561 >> 172.21.15.17:0/2548828561 conn(0x7f24700fd500 msgr2=0x7f24700ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:48.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.986+0000 7f246f200640 1 -- 172.21.15.17:0/2548828561 shutdown_connections 2024-09-13T15:56:48.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.986+0000 7f246f200640 1 -- 172.21.15.17:0/2548828561 wait complete. 2024-09-13T15:56:48.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.987+0000 7f246f200640 1 Processor -- start 2024-09-13T15:56:48.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.987+0000 7f246f200640 1 -- start start 2024-09-13T15:56:48.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.987+0000 7f246f200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2470101d80 0x7f2470197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:48.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.987+0000 7f246f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2470102f70 0x7f24701982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:48.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.987+0000 7f246f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2470103930 0x7f247019f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:48.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.987+0000 7f246f200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247019f860 con 0x7f2470102f70 2024-09-13T15:56:48.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.987+0000 7f246f200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247019f9d0 con 0x7f2470103930 2024-09-13T15:56:48.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.987+0000 7f246f200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247019fb90 con 0x7f2470101d80 2024-09-13T15:56:48.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.987+0000 7f246d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2470102f70 0x7f24701982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:48.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.988+0000 7f246d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2470102f70 0x7f24701982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54104/0 (socket says 172.21.15.17:54104) 2024-09-13T15:56:48.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.988+0000 7f246d400640 1 -- 172.21.15.17:0/1594827357 learned_addr learned my addr 172.21.15.17:0/1594827357 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:48.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.988+0000 7f246e800640 1 --2- 172.21.15.17:0/1594827357 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2470103930 0x7f247019f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:48.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.988+0000 7f246de00640 1 --2- 172.21.15.17:0/1594827357 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2470101d80 0x7f2470197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:48.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.988+0000 7f246d400640 1 -- 172.21.15.17:0/1594827357 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2470101d80 msgr2=0x7f2470197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:48.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.988+0000 7f246d400640 1 --2- 172.21.15.17:0/1594827357 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2470101d80 0x7f2470197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.988+0000 7f246d400640 1 -- 172.21.15.17:0/1594827357 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2470103930 msgr2=0x7f247019f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:48.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.988+0000 7f246d400640 1 --2- 172.21.15.17:0/1594827357 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2470103930 0x7f247019f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.988+0000 7f246d400640 1 -- 172.21.15.17:0/1594827357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2460009560 con 0x7f2470102f70 2024-09-13T15:56:48.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.988+0000 7f246d400640 1 --2- 172.21.15.17:0/1594827357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2470102f70 0x7f24701982b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f245c00e9f0 tx=0x7f245c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:48.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.989+0000 7f2466a00640 1 -- 172.21.15.17:0/1594827357 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c009700 con 0x7f2470102f70 2024-09-13T15:56:48.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.989+0000 7f2466a00640 1 -- 172.21.15.17:0/1594827357 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f245c00cd80 con 0x7f2470102f70 2024-09-13T15:56:48.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.989+0000 7f2466a00640 1 -- 172.21.15.17:0/1594827357 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c018860 con 0x7f2470102f70 2024-09-13T15:56:48.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.989+0000 7f246f200640 1 -- 172.21.15.17:0/1594827357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f247019fe70 con 0x7f2470102f70 2024-09-13T15:56:48.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.989+0000 7f246f200640 1 -- 172.21.15.17:0/1594827357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24701a02a0 con 0x7f2470102f70 2024-09-13T15:56:48.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.992+0000 7f247807d740 1 Processor -- start 2024-09-13T15:56:48.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.992+0000 7f2466a00640 1 -- 172.21.15.17:0/1594827357 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f245c0189c0 con 0x7f2470102f70 2024-09-13T15:56:48.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.992+0000 7f247807d740 1 -- start start 2024-09-13T15:56:48.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.992+0000 7f247807d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604fa04eca0 0x5604fa04f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:48.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.992+0000 7f247807d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa04f5e0 0x5604fa0540a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:48.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.992+0000 7f247807d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa054670 0x5604fa056b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:48.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.992+0000 7f247807d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f9fb8ab0 con 0x5604fa04f5e0 2024-09-13T15:56:48.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.992+0000 7f247807d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f9fb6240 con 0x5604fa04eca0 2024-09-13T15:56:48.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.992+0000 7f247807d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f9fb1b30 con 0x5604fa054670 2024-09-13T15:56:48.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.992+0000 7f246de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa04f5e0 0x5604fa0540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:48.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.992+0000 7f246e800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604fa04eca0 0x5604fa04f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:48.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.992+0000 7f246de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa04f5e0 0x5604fa0540a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54116/0 (socket says 172.21.15.17:54116) 2024-09-13T15:56:48.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.993+0000 7f246de00640 1 -- 172.21.15.17:0/2670811619 learned_addr learned my addr 172.21.15.17:0/2670811619 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:48.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.993+0000 7f246d400640 1 --2- 172.21.15.17:0/2670811619 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa054670 0x5604fa056b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:48.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.993+0000 7f246de00640 1 -- 172.21.15.17:0/2670811619 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa054670 msgr2=0x5604fa056b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:48.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.993+0000 7f246de00640 1 --2- 172.21.15.17:0/2670811619 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa054670 0x5604fa056b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.993+0000 7f246de00640 1 -- 172.21.15.17:0/2670811619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604fa04eca0 msgr2=0x5604fa04f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:48.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.993+0000 7f246de00640 1 --2- 172.21.15.17:0/2670811619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604fa04eca0 0x5604fa04f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:48.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.993+0000 7f246de00640 1 -- 172.21.15.17:0/2670811619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604f9f7cbd0 con 0x5604fa04f5e0 2024-09-13T15:56:48.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.993+0000 7f246de00640 1 --2- 172.21.15.17:0/2670811619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa04f5e0 0x5604fa0540a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2460000c00 tx=0x7f2460004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d877df73ea22b1d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:48.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.993+0000 7f2466a00640 1 --2- 172.21.15.17:0/1594827357 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f24540a1110 0x7f24540a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:48.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.993+0000 7f2466a00640 1 -- 172.21.15.17:0/1594827357 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f245c014070 con 0x7f2470102f70 2024-09-13T15:56:48.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.993+0000 7f245b400640 1 -- 172.21.15.17:0/2670811619 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2460004430 con 0x5604fa04f5e0 2024-09-13T15:56:48.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.994+0000 7f245b400640 1 -- 172.21.15.17:0/2670811619 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2460040070 con 0x5604fa04f5e0 2024-09-13T15:56:48.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.994+0000 7f245b400640 1 -- 172.21.15.17:0/2670811619 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2460031990 con 0x5604fa04f5e0 2024-09-13T15:56:48.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.994+0000 7f246e800640 1 --2- 172.21.15.17:0/1594827357 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f24540a1110 0x7f24540a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.994+0000 7f247807d740 1 -- 172.21.15.17:0/2670811619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa04f5e0 msgr2=0x5604fa0540a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.994+0000 7f247807d740 1 --2- 172.21.15.17:0/2670811619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa04f5e0 0x5604fa0540a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2460000c00 tx=0x7f2460004040 comp rx=0 tx=0).stop 2024-09-13T15:56:49.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.994+0000 7f246e800640 1 --2- 172.21.15.17:0/1594827357 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f24540a1110 0x7f24540a35d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2468005fd0 tx=0x7f2468009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:49.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.995+0000 7f247807d740 1 -- 172.21.15.17:0/2670811619 shutdown_connections 2024-09-13T15:56:49.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.995+0000 7f247807d740 1 --2- 172.21.15.17:0/2670811619 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa054670 0x5604fa056b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.995+0000 7f247807d740 1 --2- 172.21.15.17:0/2670811619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa04f5e0 0x5604fa0540a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.995+0000 7f247807d740 1 --2- 172.21.15.17:0/2670811619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604fa04eca0 0x5604fa04f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.995+0000 7f247807d740 1 -- 172.21.15.17:0/2670811619 >> 172.21.15.17:0/2670811619 conn(0x5604fa04a310 msgr2=0x5604fa04a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:49.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.995+0000 7f247807d740 1 -- 172.21.15.17:0/2670811619 shutdown_connections 2024-09-13T15:56:49.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.995+0000 7f247807d740 1 -- 172.21.15.17:0/2670811619 wait complete. 2024-09-13T15:56:49.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.995+0000 7f247807d740 1 -- start start 2024-09-13T15:56:49.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.995+0000 7f247807d740 1 Processor -- start 2024-09-13T15:56:49.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.996+0000 7f247807d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa04eca0 0x5604fa058800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.996+0000 7f247807d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa04f5e0 0x5604fa058d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.996+0000 7f247807d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604fa054670 0x5604fa05fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.996+0000 7f247807d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f9f53260 con 0x5604fa04eca0 2024-09-13T15:56:49.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.996+0000 7f247807d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f9f52f00 con 0x5604fa054670 2024-09-13T15:56:49.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.996+0000 7f247807d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f9d18f20 con 0x5604fa04f5e0 2024-09-13T15:56:49.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.996+0000 7f247807d740 10 client.0 _ll_register_callbacks cb 0x5604f9fab1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:56:49.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.996+0000 7f246de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa04eca0 0x5604fa058800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.996+0000 7f246d400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa04f5e0 0x5604fa058d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.996+0000 7f246de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa04eca0 0x5604fa058800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54124/0 (socket says 172.21.15.17:54124) 2024-09-13T15:56:49.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.996+0000 7f246de00640 1 -- 172.21.15.17:0/1208289179 learned_addr learned my addr 172.21.15.17:0/1208289179 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:49.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.996+0000 7f246e800640 1 --2- 172.21.15.17:0/1208289179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604fa054670 0x5604fa05fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.996+0000 7f246de00640 1 -- 172.21.15.17:0/1208289179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa04f5e0 msgr2=0x5604fa058d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:49.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.996+0000 7f246de00640 1 --2- 172.21.15.17:0/1208289179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa04f5e0 0x5604fa058d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.996+0000 7f246de00640 1 -- 172.21.15.17:0/1208289179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604fa054670 msgr2=0x5604fa05fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:49.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.996+0000 7f246de00640 1 --2- 172.21.15.17:0/1208289179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604fa054670 0x5604fa05fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.996+0000 7f246de00640 1 -- 172.21.15.17:0/1208289179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247010aac0 con 0x5604fa04eca0 2024-09-13T15:56:49.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.996+0000 7f246d400640 1 --2- 172.21.15.17:0/1208289179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa04f5e0 0x5604fa058d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:49.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.997+0000 7f246de00640 1 --2- 172.21.15.17:0/1208289179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa04eca0 0x5604fa058800 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2460009900 tx=0x7f24600044a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e805951c6cee6fdf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:49.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.997+0000 7f244fe00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T15:56:49.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.997+0000 7f244fe00640 1 -- 172.21.15.17:0/1208289179 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2460032a20 con 0x5604fa04eca0 2024-09-13T15:56:49.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.997+0000 7f244fe00640 1 -- 172.21.15.17:0/1208289179 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f2460032b80 con 0x5604fa04eca0 2024-09-13T15:56:49.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.997+0000 7f247807d740 1 -- 172.21.15.17:0/1208289179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604f9fdbcd0 con 0x5604fa04eca0 2024-09-13T15:56:49.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.997+0000 7f244fe00640 1 -- 172.21.15.17:0/1208289179 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2460032d40 con 0x5604fa04eca0 2024-09-13T15:56:49.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.997+0000 7f247807d740 10 client.15111 fetch_fsmap learned FSMap version 24 2024-09-13T15:56:49.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.997+0000 7f247807d740 1 -- 172.21.15.17:0/1208289179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5604f9fb01b0 con 0x5604fa04eca0 2024-09-13T15:56:49.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.997+0000 7f244fe00640 1 -- 172.21.15.17:0/1208289179 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5604f9fdbcd0 con 0x5604fa04eca0 2024-09-13T15:56:49.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.998+0000 7f244fe00640 1 -- 172.21.15.17:0/1208289179 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f246003c710 con 0x5604fa04eca0 2024-09-13T15:56:49.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.998+0000 7f247807d740 10 client.15111 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T15:56:49.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.998+0000 7f247807d740 10 client.15111 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-13T15:56:49.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.998+0000 7f247807d740 20 client.15111 populate_metadata read hostname 'smithi017' 2024-09-13T15:56:49.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.998+0000 7f247807d740 1 --2- 172.21.15.17:0/1208289179 >> [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] conn(0x5604fa064af0 0x5604fa068c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.998+0000 7f247807d740 4 client.15111 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:56:49.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.998+0000 7f247807d740 1 -- 172.21.15.17:0/1208289179 --> [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604f9ca53c0 con 0x5604fa064af0 2024-09-13T15:56:49.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.998+0000 7f246d400640 1 --2- 172.21.15.17:0/1208289179 >> [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] conn(0x5604fa064af0 0x5604fa068c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.999+0000 7f246d400640 1 --2- 172.21.15.17:0/1208289179 >> [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] conn(0x5604fa064af0 0x5604fa068c90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e161a5229dbe1ccb server_cookie=c0533299aaf482a3 in_seq=0 out_seq=0 2024-09-13T15:56:49.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.999+0000 7f244fe00640 10 client.15111 ms_handle_connect on v2:172.21.15.193:6838/3012199875 2024-09-13T15:56:49.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.999+0000 7f244fe00640 1 -- 172.21.15.17:0/1208289179 <== mds.2 v2:172.21.15.193:6838/3012199875 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5604f9ca53c0 con 0x5604fa064af0 2024-09-13T15:56:49.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.999+0000 7f244fe00640 10 client.15111 handle_command_reply: tid=0 2024-09-13T15:56:49.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:48.999+0000 7f247807d740 1 client.15111 shutdown 2024-09-13T15:56:49.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.000+0000 7f247807d740 1 -- 172.21.15.17:0/1208289179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa04eca0 msgr2=0x5604fa058800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.000+0000 7f247807d740 1 --2- 172.21.15.17:0/1208289179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa04eca0 0x5604fa058800 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2460009900 tx=0x7f24600044a0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.000+0000 7f247807d740 1 -- 172.21.15.17:0/1208289179 shutdown_connections 2024-09-13T15:56:49.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.000+0000 7f247807d740 1 --2- 172.21.15.17:0/1208289179 >> [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] conn(0x5604fa064af0 0x5604fa068c90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.000+0000 7f247807d740 1 --2- 172.21.15.17:0/1208289179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604fa054670 0x5604fa05fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.000+0000 7f247807d740 1 --2- 172.21.15.17:0/1208289179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa04f5e0 0x5604fa058d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.000+0000 7f247807d740 1 --2- 172.21.15.17:0/1208289179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa04eca0 0x5604fa058800 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.000+0000 7f244fe00640 0 client.15111 ms_handle_reset on v2:172.21.15.193:6838/3012199875 2024-09-13T15:56:49.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.000+0000 7f247807d740 1 -- 172.21.15.17:0/1208289179 >> 172.21.15.17:0/1208289179 conn(0x5604fa04a310 msgr2=0x5604fa049650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:49.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.000+0000 7f247807d740 1 -- 172.21.15.17:0/1208289179 shutdown_connections 2024-09-13T15:56:49.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.000+0000 7f247807d740 1 -- 172.21.15.17:0/1208289179 wait complete. 2024-09-13T15:56:49.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.000+0000 7f247807d740 20 client.15111 trim_cache size 0 max 16384 2024-09-13T15:56:49.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.015+0000 7f247807d740 1 Processor -- start 2024-09-13T15:56:49.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.016+0000 7f247807d740 1 -- start start 2024-09-13T15:56:49.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.016+0000 7f247807d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604fa04eca0 0x5604fa04f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.016+0000 7f247807d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa04f5e0 0x5604fa05fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.016+0000 7f247807d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa054670 0x5604fa058cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.016+0000 7f247807d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f9fdbd00 con 0x5604fa054670 2024-09-13T15:56:49.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.016+0000 7f247807d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604fa046170 con 0x5604fa04eca0 2024-09-13T15:56:49.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.016+0000 7f247807d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604fa04c1a0 con 0x5604fa04f5e0 2024-09-13T15:56:49.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.016+0000 7f246e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa054670 0x5604fa058cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.016+0000 7f246e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa054670 0x5604fa058cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54136/0 (socket says 172.21.15.17:54136) 2024-09-13T15:56:49.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.016+0000 7f246e800640 1 -- 172.21.15.17:0/3537897405 learned_addr learned my addr 172.21.15.17:0/3537897405 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:49.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.016+0000 7f246de00640 1 --2- 172.21.15.17:0/3537897405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604fa04eca0 0x5604fa04f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.016+0000 7f246d400640 1 --2- 172.21.15.17:0/3537897405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa04f5e0 0x5604fa05fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.017+0000 7f246e800640 1 -- 172.21.15.17:0/3537897405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa04f5e0 msgr2=0x5604fa05fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:49.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.017+0000 7f246e800640 1 --2- 172.21.15.17:0/3537897405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa04f5e0 0x5604fa05fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.017+0000 7f246e800640 1 -- 172.21.15.17:0/3537897405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604fa04eca0 msgr2=0x5604fa04f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:49.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.017+0000 7f246e800640 1 --2- 172.21.15.17:0/3537897405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604fa04eca0 0x5604fa04f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.017+0000 7f246e800640 1 -- 172.21.15.17:0/3537897405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604f9f52470 con 0x5604fa054670 2024-09-13T15:56:49.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.017+0000 7f246de00640 1 --2- 172.21.15.17:0/3537897405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604fa04eca0 0x5604fa04f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:49.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.017+0000 7f246e800640 1 --2- 172.21.15.17:0/3537897405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa054670 0x5604fa058cc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2468003e40 tx=0x7f246801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453884d26e4f69f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:49.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.017+0000 7f245be00640 1 -- 172.21.15.17:0/3537897405 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468024040 con 0x5604fa054670 2024-09-13T15:56:49.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.017+0000 7f245be00640 1 -- 172.21.15.17:0/3537897405 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f246800fa20 con 0x5604fa054670 2024-09-13T15:56:49.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.017+0000 7f245be00640 1 -- 172.21.15.17:0/3537897405 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468016070 con 0x5604fa054670 2024-09-13T15:56:49.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.018+0000 7f247807d740 1 -- 172.21.15.17:0/3537897405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa054670 msgr2=0x5604fa058cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.018+0000 7f247807d740 1 --2- 172.21.15.17:0/3537897405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa054670 0x5604fa058cc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2468003e40 tx=0x7f246801a000 comp rx=0 tx=0).stop 2024-09-13T15:56:49.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.018+0000 7f247807d740 1 -- 172.21.15.17:0/3537897405 shutdown_connections 2024-09-13T15:56:49.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.018+0000 7f247807d740 1 --2- 172.21.15.17:0/3537897405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa054670 0x5604fa058cc0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.018+0000 7f247807d740 1 --2- 172.21.15.17:0/3537897405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa04f5e0 0x5604fa05fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.018+0000 7f247807d740 1 --2- 172.21.15.17:0/3537897405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604fa04eca0 0x5604fa04f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.018+0000 7f247807d740 1 -- 172.21.15.17:0/3537897405 >> 172.21.15.17:0/3537897405 conn(0x5604fa04a310 msgr2=0x5604fa0585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:49.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.018+0000 7f247807d740 1 -- 172.21.15.17:0/3537897405 shutdown_connections 2024-09-13T15:56:49.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.018+0000 7f247807d740 1 -- 172.21.15.17:0/3537897405 wait complete. 2024-09-13T15:56:49.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.018+0000 7f247807d740 1 -- start start 2024-09-13T15:56:49.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.018+0000 7f247807d740 1 Processor -- start 2024-09-13T15:56:49.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.019+0000 7f247807d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa04eca0 0x5604fa05ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.019+0000 7f247807d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604fa04f5e0 0x5604fa05d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.019+0000 7f247807d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa054670 0x5604fa05e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.019+0000 7f247807d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604fa05e740 con 0x5604fa054670 2024-09-13T15:56:49.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.019+0000 7f247807d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604fa05e8b0 con 0x5604fa04f5e0 2024-09-13T15:56:49.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.019+0000 7f247807d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604fa05ea70 con 0x5604fa04eca0 2024-09-13T15:56:49.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.019+0000 7f247807d740 10 client.0 _ll_register_callbacks cb 0x7f2468009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:56:49.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.019+0000 7f246de00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa04eca0 0x5604fa05ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.019+0000 7f246e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa054670 0x5604fa05e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.019+0000 7f246de00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa04eca0 0x5604fa05ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:49560/0 (socket says 172.21.15.17:49560) 2024-09-13T15:56:49.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.019+0000 7f246de00640 1 -- 172.21.15.17:0/566757718 learned_addr learned my addr 172.21.15.17:0/566757718 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:49.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.019+0000 7f246d400640 1 --2- 172.21.15.17:0/566757718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604fa04f5e0 0x5604fa05d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.020+0000 7f246de00640 1 -- 172.21.15.17:0/566757718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604fa04f5e0 msgr2=0x5604fa05d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:49.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.020+0000 7f246de00640 1 --2- 172.21.15.17:0/566757718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604fa04f5e0 0x5604fa05d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.020+0000 7f246de00640 1 -- 172.21.15.17:0/566757718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa054670 msgr2=0x5604fa05e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:49.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.020+0000 7f246de00640 1 --2- 172.21.15.17:0/566757718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa054670 0x5604fa05e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.020+0000 7f246de00640 1 -- 172.21.15.17:0/566757718 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5604f9fb01b0 con 0x5604fa04eca0 2024-09-13T15:56:49.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.020+0000 7f246de00640 1 --2- 172.21.15.17:0/566757718 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa04eca0 0x5604fa05ccb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2460000c00 tx=0x7f246003ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58b9d65bbe6a6c34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:49.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.020+0000 7f244fe00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T15:56:49.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.020+0000 7f244fe00640 1 -- 172.21.15.17:0/566757718 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246003c850 con 0x5604fa04eca0 2024-09-13T15:56:49.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.020+0000 7f247807d740 1 -- 172.21.15.17:0/566757718 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2460040070 con 0x5604fa04eca0 2024-09-13T15:56:49.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.020+0000 7f244fe00640 1 -- 172.21.15.17:0/566757718 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f2460000e40 con 0x5604fa04eca0 2024-09-13T15:56:49.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.020+0000 7f244fe00640 1 -- 172.21.15.17:0/566757718 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24600315a0 con 0x5604fa04eca0 2024-09-13T15:56:49.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.020+0000 7f247807d740 10 client.25174 fetch_fsmap learned FSMap version 24 2024-09-13T15:56:49.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.020+0000 7f247807d740 1 -- 172.21.15.17:0/566757718 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f2468003b80 con 0x5604fa04eca0 2024-09-13T15:56:49.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.021+0000 7f244fe00640 1 -- 172.21.15.17:0/566757718 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2460040070 con 0x5604fa04eca0 2024-09-13T15:56:49.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.021+0000 7f244fe00640 1 -- 172.21.15.17:0/566757718 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f24600456a0 con 0x5604fa04eca0 2024-09-13T15:56:49.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.021+0000 7f247807d740 10 client.25174 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T15:56:49.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.021+0000 7f247807d740 10 client.25174 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-13T15:56:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.021+0000 7f247807d740 20 client.25174 populate_metadata read hostname 'smithi017' 2024-09-13T15:56:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.021+0000 7f247807d740 1 --2- 172.21.15.17:0/566757718 >> [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] conn(0x5604fa0bfb40 0x5604fa0bc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.021+0000 7f247807d740 4 client.25174 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:56:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.021+0000 7f247807d740 1 -- 172.21.15.17:0/566757718 --> [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5604f9cb66c0 con 0x5604fa0bfb40 2024-09-13T15:56:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.021+0000 7f246d400640 1 --2- 172.21.15.17:0/566757718 >> [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] conn(0x5604fa0bfb40 0x5604fa0bc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.022+0000 7f246d400640 1 --2- 172.21.15.17:0/566757718 >> [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] conn(0x5604fa0bfb40 0x5604fa0bc960 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3be8fa708980b6c5 server_cookie=296b60faebab2757 in_seq=0 out_seq=0 2024-09-13T15:56:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.022+0000 7f244fe00640 10 client.25174 ms_handle_connect on v2:172.21.15.193:6838/3012199875 2024-09-13T15:56:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.022+0000 7f244fe00640 1 -- 172.21.15.17:0/566757718 <== mds.2 v2:172.21.15.193:6838/3012199875 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5604f9cb66c0 con 0x5604fa0bfb40 2024-09-13T15:56:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.022+0000 7f244fe00640 10 client.25174 handle_command_reply: tid=0 2024-09-13T15:56:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.022+0000 7f247807d740 1 client.25174 shutdown 2024-09-13T15:56:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.022+0000 7f247807d740 1 -- 172.21.15.17:0/566757718 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa04eca0 msgr2=0x5604fa05ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.022+0000 7f247807d740 1 --2- 172.21.15.17:0/566757718 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa04eca0 0x5604fa05ccb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2460000c00 tx=0x7f246003ced0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.022+0000 7f247807d740 1 -- 172.21.15.17:0/566757718 shutdown_connections 2024-09-13T15:56:49.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.022+0000 7f247807d740 1 --2- 172.21.15.17:0/566757718 >> [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] conn(0x5604fa0bfb40 0x5604fa0bc960 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.022+0000 7f247807d740 1 --2- 172.21.15.17:0/566757718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604fa054670 0x5604fa05e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.022+0000 7f247807d740 1 --2- 172.21.15.17:0/566757718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604fa04f5e0 0x5604fa05d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.022+0000 7f247807d740 1 --2- 172.21.15.17:0/566757718 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5604fa04eca0 0x5604fa05ccb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.022+0000 7f244fe00640 0 client.25174 ms_handle_reset on v2:172.21.15.193:6838/3012199875 2024-09-13T15:56:49.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.022+0000 7f247807d740 1 -- 172.21.15.17:0/566757718 >> 172.21.15.17:0/566757718 conn(0x5604fa04a310 msgr2=0x5604fa06ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:49.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.023+0000 7f247807d740 1 -- 172.21.15.17:0/566757718 shutdown_connections 2024-09-13T15:56:49.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.023+0000 7f247807d740 1 -- 172.21.15.17:0/566757718 wait complete. 2024-09-13T15:56:49.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.023+0000 7f247807d740 20 client.25174 trim_cache size 0 max 16384 2024-09-13T15:56:49.030 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-13T15:56:49.030 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "3334a620-71e7-11ef-bceb-c7b262605968", 2024-09-13T15:56:49.030 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 2, 2024-09-13T15:56:49.030 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24553, 2024-09-13T15:56:49.030 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-13T15:56:49.030 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-13T15:56:49.030 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-13T15:56:49.031 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 93.777158095000004, 2024-09-13T15:56:49.031 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 24, 2024-09-13T15:56:49.031 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 94, 2024-09-13T15:56:49.031 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 90, 2024-09-13T15:56:49.031 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 130.70157889199999 2024-09-13T15:56:49.031 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-13T15:56:49.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.023+0000 7f246f200640 1 -- 172.21.15.17:0/1594827357 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f24540a1110 msgr2=0x7f24540a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.023+0000 7f246f200640 1 --2- 172.21.15.17:0/1594827357 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f24540a1110 0x7f24540a35d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2468005fd0 tx=0x7f2468009500 comp rx=0 tx=0).stop 2024-09-13T15:56:49.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.023+0000 7f246f200640 1 -- 172.21.15.17:0/1594827357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2470102f70 msgr2=0x7f24701982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.023+0000 7f246f200640 1 --2- 172.21.15.17:0/1594827357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2470102f70 0x7f24701982b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f245c00e9f0 tx=0x7f245c00eeb0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.023+0000 7f246f200640 1 -- 172.21.15.17:0/1594827357 shutdown_connections 2024-09-13T15:56:49.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.023+0000 7f246f200640 1 --2- 172.21.15.17:0/1594827357 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f24540a1110 0x7f24540a35d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.023+0000 7f246f200640 1 --2- 172.21.15.17:0/1594827357 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2470103930 0x7f247019f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.023+0000 7f246f200640 1 --2- 172.21.15.17:0/1594827357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2470102f70 0x7f24701982b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.023+0000 7f246f200640 1 --2- 172.21.15.17:0/1594827357 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2470101d80 0x7f2470197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.023+0000 7f246f200640 1 -- 172.21.15.17:0/1594827357 >> 172.21.15.17:0/1594827357 conn(0x7f24700fd500 msgr2=0x7f2470106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:49.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.023+0000 7f246f200640 1 -- 172.21.15.17:0/1594827357 shutdown_connections 2024-09-13T15:56:49.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.023+0000 7f246f200640 1 -- 172.21.15.17:0/1594827357 wait complete. 2024-09-13T15:56:49.040 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.g status 2024-09-13T15:56:49.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.200+0000 7f2ea2c00640 1 -- 172.21.15.17:0/235694747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e9c103180 msgr2=0x7f2e9c103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.200+0000 7f2ea2c00640 1 --2- 172.21.15.17:0/235694747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e9c103180 0x7f2e9c103600 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009900 tx=0x7f2e8802a3f0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.200+0000 7f2ea2c00640 1 -- 172.21.15.17:0/235694747 shutdown_connections 2024-09-13T15:56:49.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.200+0000 7f2ea2c00640 1 --2- 172.21.15.17:0/235694747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e9c103b40 0x7f2e9c10a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.200+0000 7f2ea2c00640 1 --2- 172.21.15.17:0/235694747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e9c103180 0x7f2e9c103600 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.200+0000 7f2ea2c00640 1 --2- 172.21.15.17:0/235694747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e9c101f90 0x7f2e9c102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.200+0000 7f2ea2c00640 1 -- 172.21.15.17:0/235694747 >> 172.21.15.17:0/235694747 conn(0x7f2e9c0fd6d0 msgr2=0x7f2e9c0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:49.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.200+0000 7f2ea2c00640 1 -- 172.21.15.17:0/235694747 shutdown_connections 2024-09-13T15:56:49.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.200+0000 7f2ea2c00640 1 -- 172.21.15.17:0/235694747 wait complete. 2024-09-13T15:56:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.201+0000 7f2ea2c00640 1 Processor -- start 2024-09-13T15:56:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.201+0000 7f2ea2c00640 1 -- start start 2024-09-13T15:56:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.201+0000 7f2ea2c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e9c101f90 0x7f2e9c197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.202+0000 7f2ea2c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e9c103180 0x7f2e9c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.202+0000 7f2ea2c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e9c103b40 0x7f2e9c19f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.202+0000 7f2ea2c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c19fa10 con 0x7f2e9c101f90 2024-09-13T15:56:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.202+0000 7f2ea2c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c19fb80 con 0x7f2e9c103180 2024-09-13T15:56:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.202+0000 7f2ea2c00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c19fd40 con 0x7f2e9c103b40 2024-09-13T15:56:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.202+0000 7f2e9be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e9c101f90 0x7f2e9c197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.202+0000 7f2e9be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e9c101f90 0x7f2e9c197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54164/0 (socket says 172.21.15.17:54164) 2024-09-13T15:56:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.202+0000 7f2e9be00640 1 -- 172.21.15.17:0/3726745702 learned_addr learned my addr 172.21.15.17:0/3726745702 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.202+0000 7f2e9b400640 1 --2- 172.21.15.17:0/3726745702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e9c103180 0x7f2e9c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.202+0000 7f2ea0c00640 1 --2- 172.21.15.17:0/3726745702 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e9c103b40 0x7f2e9c19f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.202+0000 7f2e9be00640 1 -- 172.21.15.17:0/3726745702 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e9c103b40 msgr2=0x7f2e9c19f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.202+0000 7f2e9be00640 1 --2- 172.21.15.17:0/3726745702 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e9c103b40 0x7f2e9c19f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.202+0000 7f2e9be00640 1 -- 172.21.15.17:0/3726745702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e9c103180 msgr2=0x7f2e9c198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.202+0000 7f2e9be00640 1 --2- 172.21.15.17:0/3726745702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e9c103180 0x7f2e9c198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.202+0000 7f2e9be00640 1 -- 172.21.15.17:0/3726745702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e88009560 con 0x7f2e9c101f90 2024-09-13T15:56:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.202+0000 7f2e9b400640 1 --2- 172.21.15.17:0/3726745702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e9c103180 0x7f2e9c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.203+0000 7f2e9be00640 1 --2- 172.21.15.17:0/3726745702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e9c101f90 0x7f2e9c197f20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00e9c0 tx=0x7f2e8c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.203+0000 7f2e98c00640 1 -- 172.21.15.17:0/3726745702 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c009700 con 0x7f2e9c101f90 2024-09-13T15:56:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.203+0000 7f2e98c00640 1 -- 172.21.15.17:0/3726745702 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e8c0044e0 con 0x7f2e9c101f90 2024-09-13T15:56:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.203+0000 7f2ea2c00640 1 -- 172.21.15.17:0/3726745702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9c19ffc0 con 0x7f2e9c101f90 2024-09-13T15:56:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.203+0000 7f2e98c00640 1 -- 172.21.15.17:0/3726745702 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c010430 con 0x7f2e9c101f90 2024-09-13T15:56:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.203+0000 7f2ea2c00640 1 -- 172.21.15.17:0/3726745702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9c1a0440 con 0x7f2e9c101f90 2024-09-13T15:56:49.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.206+0000 7f2ea5a86740 1 Processor -- start 2024-09-13T15:56:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.206+0000 7f2ea5a86740 1 -- start start 2024-09-13T15:56:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.206+0000 7f2ea5a86740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdbb30 0x55a775fdbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.206+0000 7f2ea5a86740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a775fdc470 0x55a775fe0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.206+0000 7f2ea5a86740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fe1500 0x55a775fe39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.206+0000 7f2ea5a86740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a775f45ab0 con 0x55a775fdbb30 2024-09-13T15:56:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.206+0000 7f2ea5a86740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a775f43240 con 0x55a775fdc470 2024-09-13T15:56:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.206+0000 7f2ea5a86740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a775f3eb30 con 0x55a775fe1500 2024-09-13T15:56:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.207+0000 7f2ea0c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdbb30 0x55a775fdbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.207+0000 7f2ea0c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdbb30 0x55a775fdbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54174/0 (socket says 172.21.15.17:54174) 2024-09-13T15:56:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.207+0000 7f2ea0c00640 1 -- 172.21.15.17:0/404279773 learned_addr learned my addr 172.21.15.17:0/404279773 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.207+0000 7f2e9b400640 1 --2- 172.21.15.17:0/404279773 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fe1500 0x55a775fe39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.207+0000 7f2ea0c00640 1 -- 172.21.15.17:0/404279773 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fe1500 msgr2=0x55a775fe39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.207+0000 7f2ea0c00640 1 --2- 172.21.15.17:0/404279773 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fe1500 0x55a775fe39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.207+0000 7f2ea0c00640 1 -- 172.21.15.17:0/404279773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a775fdc470 msgr2=0x55a775fe0f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:56:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.207+0000 7f2ea0c00640 1 --2- 172.21.15.17:0/404279773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a775fdc470 0x55a775fe0f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.207+0000 7f2ea0c00640 1 -- 172.21.15.17:0/404279773 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a775f09bd0 con 0x55a775fdbb30 2024-09-13T15:56:49.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.207+0000 7f2ea0c00640 1 --2- 172.21.15.17:0/404279773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdbb30 0x55a775fdbf30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2e94009fd0 tx=0x7f2e940118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24a985d958a9730 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:49.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.208+0000 7f2e91600640 1 -- 172.21.15.17:0/404279773 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e94004d20 con 0x55a775fdbb30 2024-09-13T15:56:49.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.208+0000 7f2e91600640 1 -- 172.21.15.17:0/404279773 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e94004e80 con 0x55a775fdbb30 2024-09-13T15:56:49.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.208+0000 7f2e98c00640 1 -- 172.21.15.17:0/3726745702 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2e8c003f60 con 0x7f2e9c101f90 2024-09-13T15:56:49.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.208+0000 7f2e91600640 1 -- 172.21.15.17:0/404279773 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e94005280 con 0x55a775fdbb30 2024-09-13T15:56:49.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.208+0000 7f2ea5a86740 1 -- 172.21.15.17:0/404279773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdbb30 msgr2=0x55a775fdbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.208+0000 7f2ea5a86740 1 --2- 172.21.15.17:0/404279773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdbb30 0x55a775fdbf30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2e94009fd0 tx=0x7f2e940118d0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.209+0000 7f2ea5a86740 1 -- 172.21.15.17:0/404279773 shutdown_connections 2024-09-13T15:56:49.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.209+0000 7f2ea5a86740 1 --2- 172.21.15.17:0/404279773 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fe1500 0x55a775fe39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.209+0000 7f2ea5a86740 1 --2- 172.21.15.17:0/404279773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a775fdc470 0x55a775fe0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.209+0000 7f2ea5a86740 1 --2- 172.21.15.17:0/404279773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdbb30 0x55a775fdbf30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.209+0000 7f2ea5a86740 1 -- 172.21.15.17:0/404279773 >> 172.21.15.17:0/404279773 conn(0x55a775fd71a0 msgr2=0x55a775fd75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:49.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.209+0000 7f2ea5a86740 1 -- 172.21.15.17:0/404279773 shutdown_connections 2024-09-13T15:56:49.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.209+0000 7f2ea5a86740 1 -- 172.21.15.17:0/404279773 wait complete. 2024-09-13T15:56:49.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.209+0000 7f2ea5a86740 1 -- start start 2024-09-13T15:56:49.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.209+0000 7f2e98c00640 1 --2- 172.21.15.17:0/3726745702 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2e800a0fa0 0x7f2e800a3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.209+0000 7f2ea5a86740 1 Processor -- start 2024-09-13T15:56:49.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.210+0000 7f2e98c00640 1 -- 172.21.15.17:0/3726745702 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f2e8c014070 con 0x7f2e9c101f90 2024-09-13T15:56:49.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.210+0000 7f2ea0c00640 1 --2- 172.21.15.17:0/3726745702 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2e800a0fa0 0x7f2e800a3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.210+0000 7f2ea5a86740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdbb30 0x55a775fe57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.210+0000 7f2ea5a86740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a775fdc470 0x55a775fe5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.210+0000 7f2ea5a86740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fe1500 0x55a775fecd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.210+0000 7f2ea5a86740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a775ee0260 con 0x55a775fdbb30 2024-09-13T15:56:49.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.210+0000 7f2ea5a86740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a775edff00 con 0x55a775fdc470 2024-09-13T15:56:49.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.210+0000 7f2ea5a86740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a775ca5f20 con 0x55a775fe1500 2024-09-13T15:56:49.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.210+0000 7f2ea5a86740 10 client.0 _ll_register_callbacks cb 0x55a775f381a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:56:49.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.210+0000 7f2e9be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdbb30 0x55a775fe57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.210+0000 7f2e9be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdbb30 0x55a775fe57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54188/0 (socket says 172.21.15.17:54188) 2024-09-13T15:56:49.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.210+0000 7f2e9be00640 1 -- 172.21.15.17:0/2913218958 learned_addr learned my addr 172.21.15.17:0/2913218958 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:49.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.210+0000 7f2e9b400640 1 --2- 172.21.15.17:0/2913218958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a775fdc470 0x55a775fe5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.211+0000 7f2ea0c00640 1 --2- 172.21.15.17:0/3726745702 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2e800a0fa0 0x7f2e800a3460 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2e94011dd0 tx=0x7f2e94005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:49.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.211+0000 7f2e9be00640 1 -- 172.21.15.17:0/2913218958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fe1500 msgr2=0x55a775fecd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:49.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.211+0000 7f2ea0c00640 1 --2- 172.21.15.17:0/2913218958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fe1500 0x55a775fecd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.211+0000 7f2e9be00640 1 --2- 172.21.15.17:0/2913218958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fe1500 0x55a775fecd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.211+0000 7f2e9be00640 1 -- 172.21.15.17:0/2913218958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a775fdc470 msgr2=0x55a775fe5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.211+0000 7f2e9be00640 1 --2- 172.21.15.17:0/2913218958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a775fdc470 0x55a775fe5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.211+0000 7f2e9be00640 1 -- 172.21.15.17:0/2913218958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e94009c80 con 0x55a775fdbb30 2024-09-13T15:56:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.211+0000 7f2e9b400640 1 --2- 172.21.15.17:0/2913218958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a775fdc470 0x55a775fe5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.211+0000 7f2ea0c00640 1 --2- 172.21.15.17:0/2913218958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fe1500 0x55a775fecd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:56:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.211+0000 7f2e9be00640 1 --2- 172.21.15.17:0/2913218958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdbb30 0x55a775fe57d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0058c0 tx=0x7f2e8c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33edb268a501c445 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.211+0000 7f2e86000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T15:56:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.211+0000 7f2e86000640 1 -- 172.21.15.17:0/2913218958 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c09dfa0 con 0x55a775fdbb30 2024-09-13T15:56:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.211+0000 7f2e86000640 1 -- 172.21.15.17:0/2913218958 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f2e8c0a25f0 con 0x55a775fdbb30 2024-09-13T15:56:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.211+0000 7f2ea5a86740 1 -- 172.21.15.17:0/2913218958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a775c323c0 con 0x55a775fdbb30 2024-09-13T15:56:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.212+0000 7f2e86000640 1 -- 172.21.15.17:0/2913218958 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e8c098510 con 0x55a775fdbb30 2024-09-13T15:56:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.212+0000 7f2ea5a86740 10 client.15129 fetch_fsmap learned FSMap version 24 2024-09-13T15:56:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.212+0000 7f2ea5a86740 1 -- 172.21.15.17:0/2913218958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55a775f3d1b0 con 0x55a775fdbb30 2024-09-13T15:56:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.212+0000 7f2e86000640 1 -- 172.21.15.17:0/2913218958 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a775c323c0 con 0x55a775fdbb30 2024-09-13T15:56:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.212+0000 7f2e86000640 1 -- 172.21.15.17:0/2913218958 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2e8c0b2d20 con 0x55a775fdbb30 2024-09-13T15:56:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.212+0000 7f2ea5a86740 10 client.15129 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T15:56:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.212+0000 7f2ea5a86740 10 client.15129 resolve_mds: resolved name 'g' to daemon mds.g 2024-09-13T15:56:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.212+0000 7f2ea5a86740 20 client.15129 populate_metadata read hostname 'smithi017' 2024-09-13T15:56:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.212+0000 7f2ea5a86740 1 --2- 172.21.15.17:0/2913218958 >> [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] conn(0x55a775ff1ba0 0x55a775ff5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.212+0000 7f2ea5a86740 4 client.15129 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:56:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.212+0000 7f2ea5a86740 1 -- 172.21.15.17:0/2913218958 --> [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a775c436c0 con 0x55a775ff1ba0 2024-09-13T15:56:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.213+0000 7f2e9b400640 1 --2- 172.21.15.17:0/2913218958 >> [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] conn(0x55a775ff1ba0 0x55a775ff5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.213+0000 7f2e9b400640 1 --2- 172.21.15.17:0/2913218958 >> [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] conn(0x55a775ff1ba0 0x55a775ff5cc0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cec22a7a1fe019d6 server_cookie=738ba37fdb0981c4 in_seq=0 out_seq=0 2024-09-13T15:56:49.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.213+0000 7f2e86000640 10 client.15129 ms_handle_connect on v2:172.21.15.17:6838/3750040765 2024-09-13T15:56:49.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.214+0000 7f2e86000640 1 -- 172.21.15.17:0/2913218958 <== mds.1 v2:172.21.15.17:6838/3750040765 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a775c436c0 con 0x55a775ff1ba0 2024-09-13T15:56:49.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.214+0000 7f2e86000640 10 client.15129 handle_command_reply: tid=0 2024-09-13T15:56:49.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.214+0000 7f2ea5a86740 1 client.15129 shutdown 2024-09-13T15:56:49.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.214+0000 7f2ea5a86740 1 -- 172.21.15.17:0/2913218958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdbb30 msgr2=0x55a775fe57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.214+0000 7f2ea5a86740 1 --2- 172.21.15.17:0/2913218958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdbb30 0x55a775fe57d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0058c0 tx=0x7f2e8c00cd80 comp rx=0 tx=0).stop 2024-09-13T15:56:49.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.214+0000 7f2ea5a86740 1 -- 172.21.15.17:0/2913218958 shutdown_connections 2024-09-13T15:56:49.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.214+0000 7f2ea5a86740 1 --2- 172.21.15.17:0/2913218958 >> [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] conn(0x55a775ff1ba0 0x55a775ff5cc0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.214+0000 7f2ea5a86740 1 --2- 172.21.15.17:0/2913218958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fe1500 0x55a775fecd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.214+0000 7f2ea5a86740 1 --2- 172.21.15.17:0/2913218958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a775fdc470 0x55a775fe5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.214+0000 7f2ea5a86740 1 --2- 172.21.15.17:0/2913218958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdbb30 0x55a775fe57d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.214+0000 7f2e86000640 0 client.15129 ms_handle_reset on v2:172.21.15.17:6838/3750040765 2024-09-13T15:56:49.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.214+0000 7f2ea5a86740 1 -- 172.21.15.17:0/2913218958 >> 172.21.15.17:0/2913218958 conn(0x55a775fd71a0 msgr2=0x55a775fd89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:49.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.215+0000 7f2ea5a86740 1 -- 172.21.15.17:0/2913218958 shutdown_connections 2024-09-13T15:56:49.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.215+0000 7f2ea5a86740 1 -- 172.21.15.17:0/2913218958 wait complete. 2024-09-13T15:56:49.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.215+0000 7f2ea5a86740 20 client.15129 trim_cache size 0 max 16384 2024-09-13T15:56:49.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.230+0000 7f2ea5a86740 1 Processor -- start 2024-09-13T15:56:49.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.230+0000 7f2ea5a86740 1 -- start start 2024-09-13T15:56:49.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.230+0000 7f2ea5a86740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdbb30 0x55a775fdbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.230+0000 7f2ea5a86740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fdc470 0x55a775feccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.230+0000 7f2ea5a86740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a775fe1500 0x55a775fe5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.230+0000 7f2ea5a86740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a775fd29d0 con 0x55a775fdbb30 2024-09-13T15:56:49.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.230+0000 7f2ea5a86740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a775efc7e0 con 0x55a775fe1500 2024-09-13T15:56:49.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.230+0000 7f2ea5a86740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a775f378d0 con 0x55a775fdc470 2024-09-13T15:56:49.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.231+0000 7f2e9be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdbb30 0x55a775fdbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.231+0000 7f2ea0c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a775fe1500 0x55a775fe5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.231+0000 7f2e9be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdbb30 0x55a775fdbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54202/0 (socket says 172.21.15.17:54202) 2024-09-13T15:56:49.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.231+0000 7f2e9b400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fdc470 0x55a775feccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.231+0000 7f2e9be00640 1 -- 172.21.15.17:0/2255264007 learned_addr learned my addr 172.21.15.17:0/2255264007 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:49.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.231+0000 7f2e9be00640 1 -- 172.21.15.17:0/2255264007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fdc470 msgr2=0x55a775feccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:49.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.231+0000 7f2e9be00640 1 --2- 172.21.15.17:0/2255264007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fdc470 0x55a775feccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.231+0000 7f2e9be00640 1 -- 172.21.15.17:0/2255264007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a775fe1500 msgr2=0x55a775fe5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:49.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.231+0000 7f2e9be00640 1 --2- 172.21.15.17:0/2255264007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a775fe1500 0x55a775fe5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.231+0000 7f2e9be00640 1 -- 172.21.15.17:0/2255264007 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a775edf470 con 0x55a775fdbb30 2024-09-13T15:56:49.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.231+0000 7f2e9b400640 1 --2- 172.21.15.17:0/2255264007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fdc470 0x55a775feccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:49.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.232+0000 7f2e9be00640 1 --2- 172.21.15.17:0/2255264007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdbb30 0x55a775fdbf10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0ca870 tx=0x7f2e8c00efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f790055c427e5dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:49.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.232+0000 7f2e92000640 1 -- 172.21.15.17:0/2255264007 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0a25f0 con 0x55a775fdbb30 2024-09-13T15:56:49.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.232+0000 7f2e92000640 1 -- 172.21.15.17:0/2255264007 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e8c0b1070 con 0x55a775fdbb30 2024-09-13T15:56:49.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.232+0000 7f2e92000640 1 -- 172.21.15.17:0/2255264007 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0b8560 con 0x55a775fdbb30 2024-09-13T15:56:49.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2ea5a86740 1 -- 172.21.15.17:0/2255264007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdbb30 msgr2=0x55a775fdbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2ea5a86740 1 --2- 172.21.15.17:0/2255264007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdbb30 0x55a775fdbf10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0ca870 tx=0x7f2e8c00efd0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2ea5a86740 1 -- 172.21.15.17:0/2255264007 shutdown_connections 2024-09-13T15:56:49.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2ea5a86740 1 --2- 172.21.15.17:0/2255264007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a775fe1500 0x55a775fe5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2ea5a86740 1 --2- 172.21.15.17:0/2255264007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fdc470 0x55a775feccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2ea5a86740 1 --2- 172.21.15.17:0/2255264007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdbb30 0x55a775fdbf10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2ea5a86740 1 -- 172.21.15.17:0/2255264007 >> 172.21.15.17:0/2255264007 conn(0x55a775fd71a0 msgr2=0x55a775fdd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2ea5a86740 1 -- 172.21.15.17:0/2255264007 shutdown_connections 2024-09-13T15:56:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2ea5a86740 1 -- 172.21.15.17:0/2255264007 wait complete. 2024-09-13T15:56:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2ea5a86740 1 -- start start 2024-09-13T15:56:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2ea5a86740 1 Processor -- start 2024-09-13T15:56:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2ea5a86740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fdbb30 0x55a775fe74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2ea5a86740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdc470 0x55a775feca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2ea5a86740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a775fe1500 0x55a775fe79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2ea5a86740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a775fe7f30 con 0x55a775fdc470 2024-09-13T15:56:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2ea5a86740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a775fe80a0 con 0x55a775fe1500 2024-09-13T15:56:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2ea5a86740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a776047980 con 0x55a775fdbb30 2024-09-13T15:56:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2ea5a86740 10 client.0 _ll_register_callbacks cb 0x7f2e8c003880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:56:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2e9b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdc470 0x55a775feca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2e9be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fdbb30 0x55a775fe74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2e9b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdc470 0x55a775feca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54206/0 (socket says 172.21.15.17:54206) 2024-09-13T15:56:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2e9b400640 1 -- 172.21.15.17:0/1965201817 learned_addr learned my addr 172.21.15.17:0/1965201817 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.234+0000 7f2ea0c00640 1 --2- 172.21.15.17:0/1965201817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a775fe1500 0x55a775fe79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.235+0000 7f2e9be00640 1 -- 172.21.15.17:0/1965201817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a775fe1500 msgr2=0x55a775fe79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.235+0000 7f2e9be00640 1 --2- 172.21.15.17:0/1965201817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a775fe1500 0x55a775fe79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.235+0000 7f2e9be00640 1 -- 172.21.15.17:0/1965201817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdc470 msgr2=0x55a775feca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.235+0000 7f2e9be00640 1 --2- 172.21.15.17:0/1965201817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdc470 0x55a775feca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.235+0000 7f2e9be00640 1 -- 172.21.15.17:0/1965201817 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9c10acd0 con 0x55a775fdbb30 2024-09-13T15:56:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.235+0000 7f2e9b400640 1 --2- 172.21.15.17:0/1965201817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdc470 0x55a775feca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.235+0000 7f2e9be00640 1 --2- 172.21.15.17:0/1965201817 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fdbb30 0x55a775fe74b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c096b90 tx=0x7f2e8c09a870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ccfedc15ac6764b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.235+0000 7f2e86000640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T15:56:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.235+0000 7f2e86000640 1 -- 172.21.15.17:0/1965201817 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0a25f0 con 0x55a775fdbb30 2024-09-13T15:56:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.235+0000 7f2ea5a86740 1 -- 172.21.15.17:0/1965201817 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a775f68cd0 con 0x55a775fdbb30 2024-09-13T15:56:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.235+0000 7f2e86000640 1 -- 172.21.15.17:0/1965201817 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f2e8c09dfa0 con 0x55a775fdbb30 2024-09-13T15:56:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.235+0000 7f2e86000640 1 -- 172.21.15.17:0/1965201817 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e8c0035f0 con 0x55a775fdbb30 2024-09-13T15:56:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.236+0000 7f2ea5a86740 10 client.25189 fetch_fsmap learned FSMap version 24 2024-09-13T15:56:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.236+0000 7f2ea5a86740 1 -- 172.21.15.17:0/1965201817 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55a775f3d1b0 con 0x55a775fdbb30 2024-09-13T15:56:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.236+0000 7f2e86000640 1 -- 172.21.15.17:0/1965201817 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a775f68cd0 con 0x55a775fdbb30 2024-09-13T15:56:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.236+0000 7f2e86000640 1 -- 172.21.15.17:0/1965201817 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2e8c0b2d20 con 0x55a775fdbb30 2024-09-13T15:56:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.236+0000 7f2ea5a86740 10 client.25189 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T15:56:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.236+0000 7f2ea5a86740 10 client.25189 resolve_mds: resolved name 'g' to daemon mds.g 2024-09-13T15:56:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.236+0000 7f2ea5a86740 20 client.25189 populate_metadata read hostname 'smithi017' 2024-09-13T15:56:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.236+0000 7f2ea5a86740 1 --2- 172.21.15.17:0/1965201817 >> [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] conn(0x55a77604bfa0 0x55a776048c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.236+0000 7f2ea5a86740 4 client.25189 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:56:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.236+0000 7f2ea5a86740 1 -- 172.21.15.17:0/1965201817 --> [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a775c96d10 con 0x55a77604bfa0 2024-09-13T15:56:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.237+0000 7f2e9b400640 1 --2- 172.21.15.17:0/1965201817 >> [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] conn(0x55a77604bfa0 0x55a776048c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.237+0000 7f2e9b400640 1 --2- 172.21.15.17:0/1965201817 >> [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] conn(0x55a77604bfa0 0x55a776048c70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eb1e4da77882ec3a server_cookie=6cd14fe910670c37 in_seq=0 out_seq=0 2024-09-13T15:56:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.237+0000 7f2e86000640 10 client.25189 ms_handle_connect on v2:172.21.15.17:6838/3750040765 2024-09-13T15:56:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.237+0000 7f2e86000640 1 -- 172.21.15.17:0/1965201817 <== mds.1 v2:172.21.15.17:6838/3750040765 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55a775c96d10 con 0x55a77604bfa0 2024-09-13T15:56:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.237+0000 7f2e86000640 10 client.25189 handle_command_reply: tid=0 2024-09-13T15:56:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.237+0000 7f2ea5a86740 1 client.25189 shutdown 2024-09-13T15:56:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.238+0000 7f2ea5a86740 1 -- 172.21.15.17:0/1965201817 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fdbb30 msgr2=0x55a775fe74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.238+0000 7f2ea5a86740 1 --2- 172.21.15.17:0/1965201817 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fdbb30 0x55a775fe74b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c096b90 tx=0x7f2e8c09a870 comp rx=0 tx=0).stop 2024-09-13T15:56:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.238+0000 7f2ea5a86740 1 -- 172.21.15.17:0/1965201817 shutdown_connections 2024-09-13T15:56:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.238+0000 7f2ea5a86740 1 --2- 172.21.15.17:0/1965201817 >> [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] conn(0x55a77604bfa0 0x55a776048c70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.238+0000 7f2ea5a86740 1 --2- 172.21.15.17:0/1965201817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a775fe1500 0x55a775fe79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.238+0000 7f2ea5a86740 1 --2- 172.21.15.17:0/1965201817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a775fdc470 0x55a775feca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.238+0000 7f2e86000640 0 client.25189 ms_handle_reset on v2:172.21.15.17:6838/3750040765 2024-09-13T15:56:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.238+0000 7f2ea5a86740 1 --2- 172.21.15.17:0/1965201817 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a775fdbb30 0x55a775fe74b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.238+0000 7f2ea5a86740 1 -- 172.21.15.17:0/1965201817 >> 172.21.15.17:0/1965201817 conn(0x55a775fd71a0 msgr2=0x55a775fe5580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.238+0000 7f2ea5a86740 1 -- 172.21.15.17:0/1965201817 shutdown_connections 2024-09-13T15:56:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.238+0000 7f2ea5a86740 1 -- 172.21.15.17:0/1965201817 wait complete. 2024-09-13T15:56:49.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.238+0000 7f2ea5a86740 20 client.25189 trim_cache size 0 max 16384 2024-09-13T15:56:49.244 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-13T15:56:49.244 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "3334a620-71e7-11ef-bceb-c7b262605968", 2024-09-13T15:56:49.244 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 1, 2024-09-13T15:56:49.244 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24565, 2024-09-13T15:56:49.244 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-13T15:56:49.244 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-13T15:56:49.244 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-13T15:56:49.244 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 94.999413755999996, 2024-09-13T15:56:49.244 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 24, 2024-09-13T15:56:49.245 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 94, 2024-09-13T15:56:49.245 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 90, 2024-09-13T15:56:49.245 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 127.606186063 2024-09-13T15:56:49.245 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-13T15:56:49.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.239+0000 7f2ea2c00640 1 -- 172.21.15.17:0/3726745702 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2e800a0fa0 msgr2=0x7f2e800a3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.239+0000 7f2ea2c00640 1 --2- 172.21.15.17:0/3726745702 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2e800a0fa0 0x7f2e800a3460 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2e94011dd0 tx=0x7f2e94005fd0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.239+0000 7f2ea2c00640 1 -- 172.21.15.17:0/3726745702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e9c101f90 msgr2=0x7f2e9c197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.239+0000 7f2ea2c00640 1 --2- 172.21.15.17:0/3726745702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e9c101f90 0x7f2e9c197f20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00e9c0 tx=0x7f2e8c00ee80 comp rx=0 tx=0).stop 2024-09-13T15:56:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.239+0000 7f2ea2c00640 1 -- 172.21.15.17:0/3726745702 shutdown_connections 2024-09-13T15:56:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.239+0000 7f2ea2c00640 1 --2- 172.21.15.17:0/3726745702 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2e800a0fa0 0x7f2e800a3460 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.239+0000 7f2ea2c00640 1 --2- 172.21.15.17:0/3726745702 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e9c103b40 0x7f2e9c19f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.239+0000 7f2ea2c00640 1 --2- 172.21.15.17:0/3726745702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e9c103180 0x7f2e9c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.239+0000 7f2ea2c00640 1 --2- 172.21.15.17:0/3726745702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e9c101f90 0x7f2e9c197f20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.239+0000 7f2ea2c00640 1 -- 172.21.15.17:0/3726745702 >> 172.21.15.17:0/3726745702 conn(0x7f2e9c0fd6d0 msgr2=0x7f2e9c1065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.239+0000 7f2ea2c00640 1 -- 172.21.15.17:0/3726745702 shutdown_connections 2024-09-13T15:56:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.239+0000 7f2ea2c00640 1 -- 172.21.15.17:0/3726745702 wait complete. 2024-09-13T15:56:49.256 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T15:56:49.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.418+0000 7f1364400640 1 -- 172.21.15.17:0/828357790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c101f90 msgr2=0x7f135c102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.418+0000 7f1364400640 1 --2- 172.21.15.17:0/828357790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c101f90 0x7f135c102390 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1350009900 tx=0x7f135002a410 comp rx=0 tx=0).stop 2024-09-13T15:56:49.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.418+0000 7f1364400640 1 -- 172.21.15.17:0/828357790 shutdown_connections 2024-09-13T15:56:49.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.418+0000 7f1364400640 1 --2- 172.21.15.17:0/828357790 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f135c103b40 0x7f135c10a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.418+0000 7f1364400640 1 --2- 172.21.15.17:0/828357790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f135c103180 0x7f135c103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.418+0000 7f1364400640 1 --2- 172.21.15.17:0/828357790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c101f90 0x7f135c102390 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.418+0000 7f1364400640 1 -- 172.21.15.17:0/828357790 >> 172.21.15.17:0/828357790 conn(0x7f135c0fd6d0 msgr2=0x7f135c0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:49.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.418+0000 7f1364400640 1 -- 172.21.15.17:0/828357790 shutdown_connections 2024-09-13T15:56:49.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.418+0000 7f1364400640 1 -- 172.21.15.17:0/828357790 wait complete. 2024-09-13T15:56:49.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.419+0000 7f1364400640 1 Processor -- start 2024-09-13T15:56:49.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.420+0000 7f1364400640 1 -- start start 2024-09-13T15:56:49.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.420+0000 7f1364400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f135c101f90 0x7f135c197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.420+0000 7f1364400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f135c103180 0x7f135c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.420+0000 7f1364400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c103b40 0x7f135c19f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.420+0000 7f1364400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c19fa20 con 0x7f135c103b40 2024-09-13T15:56:49.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.420+0000 7f1364400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c19fb90 con 0x7f135c101f90 2024-09-13T15:56:49.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.420+0000 7f1364400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c19fd50 con 0x7f135c103180 2024-09-13T15:56:49.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.420+0000 7f1361a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f135c101f90 0x7f135c197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.420+0000 7f1361000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f135c103180 0x7f135c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.420+0000 7f1362400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c103b40 0x7f135c19f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.420+0000 7f1361000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f135c103180 0x7f135c198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:49640/0 (socket says 172.21.15.17:49640) 2024-09-13T15:56:49.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.420+0000 7f1361a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f135c101f90 0x7f135c197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:43702/0 (socket says 172.21.15.17:43702) 2024-09-13T15:56:49.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.420+0000 7f1361000640 1 -- 172.21.15.17:0/3094901315 learned_addr learned my addr 172.21.15.17:0/3094901315 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:49.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.420+0000 7f1362400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c103b40 0x7f135c19f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54224/0 (socket says 172.21.15.17:54224) 2024-09-13T15:56:49.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.421+0000 7f1361000640 1 -- 172.21.15.17:0/3094901315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f135c101f90 msgr2=0x7f135c197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.421+0000 7f1361000640 1 --2- 172.21.15.17:0/3094901315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f135c101f90 0x7f135c197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.421+0000 7f1361000640 1 -- 172.21.15.17:0/3094901315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c103b40 msgr2=0x7f135c19f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.421+0000 7f1361000640 1 --2- 172.21.15.17:0/3094901315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c103b40 0x7f135c19f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.421+0000 7f1361000640 1 -- 172.21.15.17:0/3094901315 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1350009560 con 0x7f135c103180 2024-09-13T15:56:49.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.421+0000 7f1362400640 1 --2- 172.21.15.17:0/3094901315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c103b40 0x7f135c19f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.421+0000 7f1361000640 1 --2- 172.21.15.17:0/3094901315 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f135c103180 0x7f135c198470 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f134800e9f0 tx=0x7f134800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.421+0000 7f135a000640 1 -- 172.21.15.17:0/3094901315 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348009700 con 0x7f135c103180 2024-09-13T15:56:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.421+0000 7f135a000640 1 -- 172.21.15.17:0/3094901315 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f134800cd80 con 0x7f135c103180 2024-09-13T15:56:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.421+0000 7f135a000640 1 -- 172.21.15.17:0/3094901315 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348018860 con 0x7f135c103180 2024-09-13T15:56:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.422+0000 7f1364400640 1 -- 172.21.15.17:0/3094901315 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135c19ffd0 con 0x7f135c103180 2024-09-13T15:56:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.422+0000 7f1364400640 1 -- 172.21.15.17:0/3094901315 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135c1a0460 con 0x7f135c103180 2024-09-13T15:56:49.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.425+0000 7f13671dc740 1 Processor -- start 2024-09-13T15:56:49.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.425+0000 7f135a000640 1 -- 172.21.15.17:0/3094901315 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f13480189c0 con 0x7f135c103180 2024-09-13T15:56:49.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.425+0000 7f13671dc740 1 -- start start 2024-09-13T15:56:49.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.425+0000 7f13671dc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cea2097b30 0x55cea2097f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.425+0000 7f13671dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cea2098470 0x55cea209cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.425+0000 7f13671dc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea209d500 0x55cea209f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.425+0000 7f13671dc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea2001ab0 con 0x55cea209d500 2024-09-13T15:56:49.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.425+0000 7f13671dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea1fff240 con 0x55cea2098470 2024-09-13T15:56:49.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.425+0000 7f13671dc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea1ffab30 con 0x55cea2097b30 2024-09-13T15:56:49.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.425+0000 7f1361000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea209d500 0x55cea209f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.425+0000 7f1362400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cea2097b30 0x55cea2097f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.425+0000 7f1361a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cea2098470 0x55cea209cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.425+0000 7f1361000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea209d500 0x55cea209f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54230/0 (socket says 172.21.15.17:54230) 2024-09-13T15:56:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.425+0000 7f1361000640 1 -- 172.21.15.17:0/3291327431 learned_addr learned my addr 172.21.15.17:0/3291327431 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.426+0000 7f1362400640 1 -- 172.21.15.17:0/3291327431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cea2098470 msgr2=0x55cea209cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.426+0000 7f1362400640 1 --2- 172.21.15.17:0/3291327431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cea2098470 0x55cea209cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.426+0000 7f1362400640 1 -- 172.21.15.17:0/3291327431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea209d500 msgr2=0x55cea209f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.426+0000 7f1362400640 1 --2- 172.21.15.17:0/3291327431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea209d500 0x55cea209f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.426+0000 7f1362400640 1 -- 172.21.15.17:0/3291327431 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cea1fc5bd0 con 0x55cea2097b30 2024-09-13T15:56:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.426+0000 7f1362400640 1 --2- 172.21.15.17:0/3291327431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cea2097b30 0x55cea2097f30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1354005fd0 tx=0x7f1354011bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12ea90f8fffda808 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.426+0000 7f135a000640 1 --2- 172.21.15.17:0/3094901315 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f13440a1090 0x7f13440a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.426+0000 7f135a000640 1 -- 172.21.15.17:0/3094901315 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f1348014070 con 0x7f135c103180 2024-09-13T15:56:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.426+0000 7f134ea00640 1 -- 172.21.15.17:0/3291327431 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1354004d20 con 0x55cea2097b30 2024-09-13T15:56:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.427+0000 7f1361a00640 1 --2- 172.21.15.17:0/3094901315 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f13440a1090 0x7f13440a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.427+0000 7f134ea00640 1 -- 172.21.15.17:0/3291327431 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1354004e80 con 0x55cea2097b30 2024-09-13T15:56:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.427+0000 7f134ea00640 1 -- 172.21.15.17:0/3291327431 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13540043e0 con 0x55cea2097b30 2024-09-13T15:56:49.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.427+0000 7f13671dc740 1 -- 172.21.15.17:0/3291327431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cea2097b30 msgr2=0x55cea2097f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.427+0000 7f13671dc740 1 --2- 172.21.15.17:0/3291327431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cea2097b30 0x55cea2097f30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1354005fd0 tx=0x7f1354011bf0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.427+0000 7f1361a00640 1 --2- 172.21.15.17:0/3094901315 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f13440a1090 0x7f13440a3550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1350005ab0 tx=0x7f13500314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:49.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.427+0000 7f13671dc740 1 -- 172.21.15.17:0/3291327431 shutdown_connections 2024-09-13T15:56:49.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.427+0000 7f13671dc740 1 --2- 172.21.15.17:0/3291327431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea209d500 0x55cea209f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.427+0000 7f13671dc740 1 --2- 172.21.15.17:0/3291327431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cea2098470 0x55cea209cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.427+0000 7f13671dc740 1 --2- 172.21.15.17:0/3291327431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cea2097b30 0x55cea2097f30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.427+0000 7f13671dc740 1 -- 172.21.15.17:0/3291327431 >> 172.21.15.17:0/3291327431 conn(0x55cea20931a0 msgr2=0x55cea20935a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:49.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.428+0000 7f13671dc740 1 -- 172.21.15.17:0/3291327431 shutdown_connections 2024-09-13T15:56:49.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.428+0000 7f13671dc740 1 -- 172.21.15.17:0/3291327431 wait complete. 2024-09-13T15:56:49.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.428+0000 7f13671dc740 1 -- start start 2024-09-13T15:56:49.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.428+0000 7f13671dc740 1 Processor -- start 2024-09-13T15:56:49.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.429+0000 7f13671dc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cea2097b30 0x55cea20a1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.429+0000 7f13671dc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea2098470 0x55cea20a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.429+0000 7f13671dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cea209d500 0x55cea20a8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.429+0000 7f13671dc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea1f9c260 con 0x55cea2098470 2024-09-13T15:56:49.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.429+0000 7f13671dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea1f9bf00 con 0x55cea209d500 2024-09-13T15:56:49.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.429+0000 7f13671dc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea1d61f20 con 0x55cea2097b30 2024-09-13T15:56:49.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.429+0000 7f13671dc740 10 client.0 _ll_register_callbacks cb 0x55cea1ff41a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:56:49.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.429+0000 7f1361000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea2098470 0x55cea20a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.429+0000 7f1361000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea2098470 0x55cea20a1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54238/0 (socket says 172.21.15.17:54238) 2024-09-13T15:56:49.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.429+0000 7f1361000640 1 -- 172.21.15.17:0/1474186800 learned_addr learned my addr 172.21.15.17:0/1474186800 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:49.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.429+0000 7f1361a00640 1 --2- 172.21.15.17:0/1474186800 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cea2097b30 0x55cea20a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.429+0000 7f1362400640 1 --2- 172.21.15.17:0/1474186800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cea209d500 0x55cea20a8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.429+0000 7f1361000640 1 -- 172.21.15.17:0/1474186800 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cea2097b30 msgr2=0x55cea20a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.429+0000 7f1361000640 1 --2- 172.21.15.17:0/1474186800 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cea2097b30 0x55cea20a1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.429+0000 7f1361000640 1 -- 172.21.15.17:0/1474186800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cea209d500 msgr2=0x55cea20a8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.429+0000 7f1361000640 1 --2- 172.21.15.17:0/1474186800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cea209d500 0x55cea20a8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.429+0000 7f1361000640 1 -- 172.21.15.17:0/1474186800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1354011440 con 0x55cea2098470 2024-09-13T15:56:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.429+0000 7f1362400640 1 --2- 172.21.15.17:0/1474186800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cea209d500 0x55cea20a8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:56:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.430+0000 7f1361000640 1 --2- 172.21.15.17:0/1474186800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea2098470 0x55cea20a1ca0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1348000c00 tx=0x7f1348096410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8f716e1c85782a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.430+0000 7f1343400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T15:56:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.430+0000 7f1343400640 1 -- 172.21.15.17:0/1474186800 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348099a30 con 0x55cea2098470 2024-09-13T15:56:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.430+0000 7f1343400640 1 -- 172.21.15.17:0/1474186800 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f134809a0d0 con 0x55cea2098470 2024-09-13T15:56:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.430+0000 7f13671dc740 1 -- 172.21.15.17:0/1474186800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cea1cee3c0 con 0x55cea2098470 2024-09-13T15:56:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.430+0000 7f1343400640 1 -- 172.21.15.17:0/1474186800 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f134809de50 con 0x55cea2098470 2024-09-13T15:56:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.430+0000 7f13671dc740 10 client.15147 fetch_fsmap learned FSMap version 24 2024-09-13T15:56:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.430+0000 7f13671dc740 1 -- 172.21.15.17:0/1474186800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55cea1ff91b0 con 0x55cea2098470 2024-09-13T15:56:49.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.431+0000 7f1343400640 1 -- 172.21.15.17:0/1474186800 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13480b6080 con 0x55cea2098470 2024-09-13T15:56:49.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.431+0000 7f1343400640 1 -- 172.21.15.17:0/1474186800 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f13480cab90 con 0x55cea2098470 2024-09-13T15:56:49.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.431+0000 7f13671dc740 10 client.15147 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T15:56:49.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.431+0000 7f13671dc740 10 client.15147 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T15:56:49.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.431+0000 7f13671dc740 20 client.15147 populate_metadata read hostname 'smithi017' 2024-09-13T15:56:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.431+0000 7f13671dc740 1 --2- 172.21.15.17:0/1474186800 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55cea20adb50 0x55cea20b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.431+0000 7f13671dc740 4 client.15147 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:56:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.431+0000 7f13671dc740 1 -- 172.21.15.17:0/1474186800 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cea1cff6c0 con 0x55cea20adb50 2024-09-13T15:56:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.431+0000 7f1361a00640 1 --2- 172.21.15.17:0/1474186800 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55cea20adb50 0x55cea20b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.432+0000 7f1361a00640 1 --2- 172.21.15.17:0/1474186800 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55cea20adb50 0x55cea20b1cb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=618daab5314fa3a1 server_cookie=f7d179d053e6b81b in_seq=0 out_seq=0 2024-09-13T15:56:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.432+0000 7f1343400640 10 client.15147 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:56:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.433+0000 7f1343400640 1 -- 172.21.15.17:0/1474186800 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cea1cff6c0 con 0x55cea20adb50 2024-09-13T15:56:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.433+0000 7f1343400640 10 client.15147 handle_command_reply: tid=0 2024-09-13T15:56:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.433+0000 7f13671dc740 1 client.15147 shutdown 2024-09-13T15:56:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.433+0000 7f13671dc740 1 -- 172.21.15.17:0/1474186800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea2098470 msgr2=0x55cea20a1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.433+0000 7f13671dc740 1 --2- 172.21.15.17:0/1474186800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea2098470 0x55cea20a1ca0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1348000c00 tx=0x7f1348096410 comp rx=0 tx=0).stop 2024-09-13T15:56:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.433+0000 7f13671dc740 1 -- 172.21.15.17:0/1474186800 shutdown_connections 2024-09-13T15:56:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.433+0000 7f13671dc740 1 --2- 172.21.15.17:0/1474186800 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55cea20adb50 0x55cea20b1cb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.433+0000 7f13671dc740 1 --2- 172.21.15.17:0/1474186800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cea209d500 0x55cea20a8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.433+0000 7f13671dc740 1 --2- 172.21.15.17:0/1474186800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea2098470 0x55cea20a1ca0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.433+0000 7f13671dc740 1 --2- 172.21.15.17:0/1474186800 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cea2097b30 0x55cea20a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.433+0000 7f1343400640 0 client.15147 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:56:49.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.433+0000 7f13671dc740 1 -- 172.21.15.17:0/1474186800 >> 172.21.15.17:0/1474186800 conn(0x55cea20931a0 msgr2=0x55cea20949b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:49.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.433+0000 7f13671dc740 1 -- 172.21.15.17:0/1474186800 shutdown_connections 2024-09-13T15:56:49.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.433+0000 7f13671dc740 1 -- 172.21.15.17:0/1474186800 wait complete. 2024-09-13T15:56:49.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.434+0000 7f13671dc740 20 client.15147 trim_cache size 0 max 16384 2024-09-13T15:56:49.445 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:49 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/836916481' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:56:49.445 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:49 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/4170274557' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:56:49.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.449+0000 7f13671dc740 1 Processor -- start 2024-09-13T15:56:49.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.449+0000 7f13671dc740 1 -- start start 2024-09-13T15:56:49.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.450+0000 7f13671dc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cea20931a0 0x55cea20992c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.450+0000 7f13671dc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea2097b30 0x55cea20a8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.450+0000 7f13671dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cea2098470 0x55cea2099800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.450+0000 7f13671dc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea2093e30 con 0x55cea2097b30 2024-09-13T15:56:49.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.450+0000 7f13671dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea1cff6c0 con 0x55cea2098470 2024-09-13T15:56:49.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.450+0000 7f13671dc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea20a2950 con 0x55cea20931a0 2024-09-13T15:56:49.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.450+0000 7f1361000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea2097b30 0x55cea20a8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.450+0000 7f1361000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea2097b30 0x55cea20a8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54242/0 (socket says 172.21.15.17:54242) 2024-09-13T15:56:49.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.450+0000 7f1361000640 1 -- 172.21.15.17:0/2505674946 learned_addr learned my addr 172.21.15.17:0/2505674946 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:49.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.450+0000 7f1361a00640 1 --2- 172.21.15.17:0/2505674946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cea20931a0 0x55cea20992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.450+0000 7f1362400640 1 --2- 172.21.15.17:0/2505674946 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cea2098470 0x55cea2099800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.450+0000 7f1361a00640 1 -- 172.21.15.17:0/2505674946 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cea2098470 msgr2=0x55cea2099800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:49.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.450+0000 7f1361a00640 1 --2- 172.21.15.17:0/2505674946 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cea2098470 0x55cea2099800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.450+0000 7f1361a00640 1 -- 172.21.15.17:0/2505674946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea2097b30 msgr2=0x55cea20a8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:49.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.450+0000 7f1361a00640 1 --2- 172.21.15.17:0/2505674946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea2097b30 0x55cea20a8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.450+0000 7f1361a00640 1 -- 172.21.15.17:0/2505674946 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cea1f9b470 con 0x55cea20931a0 2024-09-13T15:56:49.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.450+0000 7f1361000640 1 --2- 172.21.15.17:0/2505674946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea2097b30 0x55cea20a8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:49.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.451+0000 7f1361a00640 1 --2- 172.21.15.17:0/2505674946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cea20931a0 0x55cea20992c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1350009230 tx=0x7f1350041000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1b6d90f8ff1042c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:49.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.451+0000 7f134f400640 1 -- 172.21.15.17:0/2505674946 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135004e040 con 0x55cea20931a0 2024-09-13T15:56:49.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.451+0000 7f134f400640 1 -- 172.21.15.17:0/2505674946 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13500548e0 con 0x55cea20931a0 2024-09-13T15:56:49.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.451+0000 7f134f400640 1 -- 172.21.15.17:0/2505674946 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350003850 con 0x55cea20931a0 2024-09-13T15:56:49.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.452+0000 7f13671dc740 1 -- 172.21.15.17:0/2505674946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cea20931a0 msgr2=0x55cea20992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.452+0000 7f13671dc740 1 --2- 172.21.15.17:0/2505674946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cea20931a0 0x55cea20992c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1350009230 tx=0x7f1350041000 comp rx=0 tx=0).stop 2024-09-13T15:56:49.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.452+0000 7f13671dc740 1 -- 172.21.15.17:0/2505674946 shutdown_connections 2024-09-13T15:56:49.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.452+0000 7f13671dc740 1 --2- 172.21.15.17:0/2505674946 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cea2098470 0x55cea2099800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.452+0000 7f13671dc740 1 --2- 172.21.15.17:0/2505674946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea2097b30 0x55cea20a8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.452+0000 7f13671dc740 1 --2- 172.21.15.17:0/2505674946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cea20931a0 0x55cea20992c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.452+0000 7f13671dc740 1 -- 172.21.15.17:0/2505674946 >> 172.21.15.17:0/2505674946 conn(0x55cea209fc60 msgr2=0x55cea209c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:49.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.452+0000 7f13671dc740 1 -- 172.21.15.17:0/2505674946 shutdown_connections 2024-09-13T15:56:49.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.452+0000 7f13671dc740 1 -- 172.21.15.17:0/2505674946 wait complete. 2024-09-13T15:56:49.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.452+0000 7f13671dc740 1 -- start start 2024-09-13T15:56:49.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.452+0000 7f13671dc740 1 Processor -- start 2024-09-13T15:56:49.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.453+0000 7f13671dc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea20931a0 0x55cea20a5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.453+0000 7f13671dc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cea2097b30 0x55cea20a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.453+0000 7f13671dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cea2098470 0x55cea2103970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.453+0000 7f13671dc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea20a8db0 con 0x55cea20931a0 2024-09-13T15:56:49.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.453+0000 7f13671dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea20a8f20 con 0x55cea2098470 2024-09-13T15:56:49.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.453+0000 7f13671dc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea20a90e0 con 0x55cea2097b30 2024-09-13T15:56:49.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.453+0000 7f13671dc740 10 client.0 _ll_register_callbacks cb 0x7f13480d04b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:56:49.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.453+0000 7f1361a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea20931a0 0x55cea20a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.453+0000 7f1361a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea20931a0 0x55cea20a5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54252/0 (socket says 172.21.15.17:54252) 2024-09-13T15:56:49.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.453+0000 7f1361a00640 1 -- 172.21.15.17:0/212029689 learned_addr learned my addr 172.21.15.17:0/212029689 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:49.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.453+0000 7f1361000640 1 --2- 172.21.15.17:0/212029689 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cea2097b30 0x55cea20a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.453+0000 7f1362400640 1 --2- 172.21.15.17:0/212029689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cea2098470 0x55cea2103970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.453+0000 7f1361a00640 1 -- 172.21.15.17:0/212029689 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cea2097b30 msgr2=0x55cea20a5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:49.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.453+0000 7f1361a00640 1 --2- 172.21.15.17:0/212029689 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cea2097b30 0x55cea20a5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.453+0000 7f1361a00640 1 -- 172.21.15.17:0/212029689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cea2098470 msgr2=0x55cea2103970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:56:49.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.453+0000 7f1361a00640 1 --2- 172.21.15.17:0/212029689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cea2098470 0x55cea2103970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.453+0000 7f1361a00640 1 -- 172.21.15.17:0/212029689 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cea1ff91b0 con 0x55cea20931a0 2024-09-13T15:56:49.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.454+0000 7f1361a00640 1 --2- 172.21.15.17:0/212029689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea20931a0 0x55cea20a5850 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1350009900 tx=0x7f1350004d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e514ec17ef9903 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:49.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.454+0000 7f1343400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T15:56:49.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.454+0000 7f1343400640 1 -- 172.21.15.17:0/212029689 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135004e040 con 0x55cea20931a0 2024-09-13T15:56:49.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.454+0000 7f13671dc740 1 -- 172.21.15.17:0/212029689 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cea2024cd0 con 0x55cea20931a0 2024-09-13T15:56:49.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.454+0000 7f1343400640 1 -- 172.21.15.17:0/212029689 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f13500048c0 con 0x55cea20931a0 2024-09-13T15:56:49.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.454+0000 7f1343400640 1 -- 172.21.15.17:0/212029689 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1350054420 con 0x55cea20931a0 2024-09-13T15:56:49.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.454+0000 7f13671dc740 10 client.15153 fetch_fsmap learned FSMap version 24 2024-09-13T15:56:49.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.454+0000 7f13671dc740 1 -- 172.21.15.17:0/212029689 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f135c10acd0 con 0x55cea20931a0 2024-09-13T15:56:49.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.455+0000 7f1343400640 1 -- 172.21.15.17:0/212029689 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cea2024cd0 con 0x55cea20931a0 2024-09-13T15:56:49.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.455+0000 7f1343400640 1 -- 172.21.15.17:0/212029689 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1350031760 con 0x55cea20931a0 2024-09-13T15:56:49.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.455+0000 7f13671dc740 10 client.15153 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T15:56:49.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.455+0000 7f13671dc740 10 client.15153 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T15:56:49.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.455+0000 7f13671dc740 20 client.15153 populate_metadata read hostname 'smithi017' 2024-09-13T15:56:49.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.455+0000 7f13671dc740 1 --2- 172.21.15.17:0/212029689 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55cea209d500 0x55cea2105350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:49.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.455+0000 7f13671dc740 4 client.15153 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:56:49.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.455+0000 7f13671dc740 1 -- 172.21.15.17:0/212029689 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cea1d52d10 con 0x55cea209d500 2024-09-13T15:56:49.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.457+0000 7f1361000640 1 --2- 172.21.15.17:0/212029689 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55cea209d500 0x55cea2105350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:49.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.457+0000 7f1361000640 1 --2- 172.21.15.17:0/212029689 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55cea209d500 0x55cea2105350 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3d89ee2f5ef6fff server_cookie=a1a6c5e4917bd48e in_seq=0 out_seq=0 2024-09-13T15:56:49.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.457+0000 7f1343400640 10 client.15153 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:56:49.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.457+0000 7f1343400640 1 -- 172.21.15.17:0/212029689 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x55cea1d52d10 con 0x55cea209d500 2024-09-13T15:56:49.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.457+0000 7f1343400640 10 client.15153 handle_command_reply: tid=0 2024-09-13T15:56:49.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.457+0000 7f13671dc740 1 client.15153 shutdown 2024-09-13T15:56:49.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.457+0000 7f13671dc740 1 -- 172.21.15.17:0/212029689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea20931a0 msgr2=0x55cea20a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.457+0000 7f13671dc740 1 --2- 172.21.15.17:0/212029689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea20931a0 0x55cea20a5850 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1350009900 tx=0x7f1350004d60 comp rx=0 tx=0).stop 2024-09-13T15:56:49.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.457+0000 7f13671dc740 1 -- 172.21.15.17:0/212029689 shutdown_connections 2024-09-13T15:56:49.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.457+0000 7f13671dc740 1 --2- 172.21.15.17:0/212029689 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55cea209d500 0x55cea2105350 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.457+0000 7f13671dc740 1 --2- 172.21.15.17:0/212029689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cea2098470 0x55cea2103970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.457+0000 7f1343400640 0 client.15153 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:56:49.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.457+0000 7f13671dc740 1 --2- 172.21.15.17:0/212029689 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cea2097b30 0x55cea20a5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.457+0000 7f13671dc740 1 --2- 172.21.15.17:0/212029689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cea20931a0 0x55cea20a5850 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.457+0000 7f13671dc740 1 -- 172.21.15.17:0/212029689 >> 172.21.15.17:0/212029689 conn(0x55cea209fc60 msgr2=0x55cea20a1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:49.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.457+0000 7f13671dc740 1 -- 172.21.15.17:0/212029689 shutdown_connections 2024-09-13T15:56:49.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.457+0000 7f13671dc740 1 -- 172.21.15.17:0/212029689 wait complete. 2024-09-13T15:56:49.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.457+0000 7f13671dc740 20 client.15153 trim_cache size 0 max 16384 2024-09-13T15:56:49.467 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-13T15:56:49.467 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "3334a620-71e7-11ef-bceb-c7b262605968", 2024-09-13T15:56:49.467 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-13T15:56:49.467 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24578, 2024-09-13T15:56:49.467 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-13T15:56:49.467 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-13T15:56:49.467 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-13T15:56:49.467 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 116.524666931, 2024-09-13T15:56:49.467 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 24, 2024-09-13T15:56:49.467 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 94, 2024-09-13T15:56:49.467 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 90, 2024-09-13T15:56:49.467 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 121.854826554 2024-09-13T15:56:49.467 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-13T15:56:49.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.457+0000 7f1364400640 1 -- 172.21.15.17:0/3094901315 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f13440a1090 msgr2=0x7f13440a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.457+0000 7f1364400640 1 --2- 172.21.15.17:0/3094901315 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f13440a1090 0x7f13440a3550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1350005ab0 tx=0x7f13500314a0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.457+0000 7f1364400640 1 -- 172.21.15.17:0/3094901315 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f135c103180 msgr2=0x7f135c198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:49.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.457+0000 7f1364400640 1 --2- 172.21.15.17:0/3094901315 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f135c103180 0x7f135c198470 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f134800e9f0 tx=0x7f134800eeb0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.458+0000 7f1364400640 1 -- 172.21.15.17:0/3094901315 shutdown_connections 2024-09-13T15:56:49.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.458+0000 7f1364400640 1 --2- 172.21.15.17:0/3094901315 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f13440a1090 0x7f13440a3550 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.458+0000 7f1364400640 1 --2- 172.21.15.17:0/3094901315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c103b40 0x7f135c19f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.458+0000 7f1364400640 1 --2- 172.21.15.17:0/3094901315 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f135c103180 0x7f135c198470 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.458+0000 7f1364400640 1 --2- 172.21.15.17:0/3094901315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f135c101f90 0x7f135c197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:49.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.458+0000 7f1364400640 1 -- 172.21.15.17:0/3094901315 >> 172.21.15.17:0/3094901315 conn(0x7f135c0fd6d0 msgr2=0x7f135c106640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:49.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.458+0000 7f1364400640 1 -- 172.21.15.17:0/3094901315 shutdown_connections 2024-09-13T15:56:49.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:49.458+0000 7f1364400640 1 -- 172.21.15.17:0/3094901315 wait complete. 2024-09-13T15:56:49.475 INFO:tasks.cephadm:Setup complete, yielding 2024-09-13T15:56:49.475 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T15:56:49.486 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-13T15:56:49.486 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-13T15:56:49.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:49 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/836916481' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:56:49.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:49 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/4170274557' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:56:49.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:49 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/836916481' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:56:49.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:49 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/4170274557' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:56:49.843 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:56:50.404 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:50 smithi017 ceph-mon[30494]: pgmap v358: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 639 B/s wr, 6 op/s 2024-09-13T15:56:50.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:50 smithi189 ceph-mon[34790]: pgmap v358: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 639 B/s wr, 6 op/s 2024-09-13T15:56:50.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:50 smithi193 ceph-mon[35248]: pgmap v358: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 639 B/s wr, 6 op/s 2024-09-13T15:56:52.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.089+0000 7f686bc00640 1 -- 172.21.15.17:0/3900239916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864101920 msgr2=0x7f6864108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:52.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.089+0000 7f686bc00640 1 --2- 172.21.15.17:0/3900239916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864101920 0x7f6864108240 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f685c009ca0 tx=0x7f685c02a8c0 comp rx=0 tx=0).stop 2024-09-13T15:56:52.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.089+0000 7f686bc00640 1 -- 172.21.15.17:0/3900239916 shutdown_connections 2024-09-13T15:56:52.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.089+0000 7f686bc00640 1 --2- 172.21.15.17:0/3900239916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864101920 0x7f6864108240 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:52.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.089+0000 7f686bc00640 1 --2- 172.21.15.17:0/3900239916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6864100f60 0x7f68641013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:52.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.089+0000 7f686bc00640 1 --2- 172.21.15.17:0/3900239916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68640ffe00 0x7f6864100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:52.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.089+0000 7f686bc00640 1 -- 172.21.15.17:0/3900239916 >> 172.21.15.17:0/3900239916 conn(0x7f68640fb590 msgr2=0x7f68640fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:52.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.089+0000 7f686bc00640 1 -- 172.21.15.17:0/3900239916 shutdown_connections 2024-09-13T15:56:52.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.089+0000 7f686bc00640 1 -- 172.21.15.17:0/3900239916 wait complete. 2024-09-13T15:56:52.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.090+0000 7f686bc00640 1 Processor -- start 2024-09-13T15:56:52.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.090+0000 7f686bc00640 1 -- start start 2024-09-13T15:56:52.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.091+0000 7f686bc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68640ffe00 0x7f6864197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:52.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.091+0000 7f686bc00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6864100f60 0x7f68641984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:52.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.091+0000 7f686bc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864101920 0x7f686419f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:52.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.091+0000 7f686bc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686419faa0 con 0x7f6864101920 2024-09-13T15:56:52.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.091+0000 7f686bc00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686419fc10 con 0x7f68640ffe00 2024-09-13T15:56:52.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.091+0000 7f686bc00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686419fdd0 con 0x7f6864100f60 2024-09-13T15:56:52.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.091+0000 7f6869200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68640ffe00 0x7f6864197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:52.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.091+0000 7f6869200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68640ffe00 0x7f6864197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:43752/0 (socket says 172.21.15.17:43752) 2024-09-13T15:56:52.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.091+0000 7f6869200640 1 -- 172.21.15.17:0/3066830455 learned_addr learned my addr 172.21.15.17:0/3066830455 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:52.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.091+0000 7f6869c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864101920 0x7f686419f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:52.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.091+0000 7f6863e00640 1 --2- 172.21.15.17:0/3066830455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6864100f60 0x7f68641984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:52.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.091+0000 7f6869200640 1 -- 172.21.15.17:0/3066830455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6864100f60 msgr2=0x7f68641984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:52.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.091+0000 7f6869200640 1 --2- 172.21.15.17:0/3066830455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6864100f60 0x7f68641984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:52.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.091+0000 7f6869200640 1 -- 172.21.15.17:0/3066830455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864101920 msgr2=0x7f686419f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:52.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.091+0000 7f6869200640 1 --2- 172.21.15.17:0/3066830455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864101920 0x7f686419f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:52.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.091+0000 7f6869200640 1 -- 172.21.15.17:0/3066830455 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c009900 con 0x7f68640ffe00 2024-09-13T15:56:52.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.092+0000 7f6869200640 1 --2- 172.21.15.17:0/3066830455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68640ffe00 0x7f6864197fa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f685800d950 tx=0x7f685800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:52.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.092+0000 7f6861600640 1 -- 172.21.15.17:0/3066830455 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6858004020 con 0x7f68640ffe00 2024-09-13T15:56:52.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.092+0000 7f6861600640 1 -- 172.21.15.17:0/3066830455 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68580099b0 con 0x7f68640ffe00 2024-09-13T15:56:52.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.092+0000 7f686bc00640 1 -- 172.21.15.17:0/3066830455 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68641a00b0 con 0x7f68640ffe00 2024-09-13T15:56:52.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.092+0000 7f6861600640 1 -- 172.21.15.17:0/3066830455 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68580047a0 con 0x7f68640ffe00 2024-09-13T15:56:52.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.092+0000 7f686bc00640 1 -- 172.21.15.17:0/3066830455 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68641a05b0 con 0x7f68640ffe00 2024-09-13T15:56:52.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.093+0000 7f686bc00640 1 -- 172.21.15.17:0/3066830455 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686410b6f0 con 0x7f68640ffe00 2024-09-13T15:56:52.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.095+0000 7f6861600640 1 -- 172.21.15.17:0/3066830455 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6858009b20 con 0x7f68640ffe00 2024-09-13T15:56:52.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.097+0000 7f6861600640 1 --2- 172.21.15.17:0/3066830455 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f684c0a1100 0x7f684c0a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:52.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.097+0000 7f6861600640 1 -- 172.21.15.17:0/3066830455 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f68580ccc30 con 0x7f68640ffe00 2024-09-13T15:56:52.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.097+0000 7f6863e00640 1 --2- 172.21.15.17:0/3066830455 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f684c0a1100 0x7f684c0a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:52.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.098+0000 7f6863e00640 1 --2- 172.21.15.17:0/3066830455 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f684c0a1100 0x7f684c0a35c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f68641994c0 tx=0x7f6850005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:52.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.099+0000 7f6861600640 1 -- 172.21.15.17:0/3066830455 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6858096010 con 0x7f68640ffe00 2024-09-13T15:56:52.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.298+0000 7f686bc00640 1 -- 172.21.15.17:0/3066830455 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6864107ee0 con 0x7f684c0a1100 2024-09-13T15:56:52.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.299+0000 7f6861600640 1 -- 172.21.15.17:0/3066830455 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f6864107ee0 con 0x7f684c0a1100 2024-09-13T15:56:52.300 INFO:teuthology.orchestra.run.smithi017.stdout:Backend: cephadm 2024-09-13T15:56:52.300 INFO:teuthology.orchestra.run.smithi017.stdout:Available: Yes 2024-09-13T15:56:52.300 INFO:teuthology.orchestra.run.smithi017.stdout:Paused: No 2024-09-13T15:56:52.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.302+0000 7f686bc00640 1 -- 172.21.15.17:0/3066830455 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f684c0a1100 msgr2=0x7f684c0a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:52.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.302+0000 7f686bc00640 1 --2- 172.21.15.17:0/3066830455 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f684c0a1100 0x7f684c0a35c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f68641994c0 tx=0x7f6850005f90 comp rx=0 tx=0).stop 2024-09-13T15:56:52.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.302+0000 7f686bc00640 1 -- 172.21.15.17:0/3066830455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68640ffe00 msgr2=0x7f6864197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:52.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.302+0000 7f686bc00640 1 --2- 172.21.15.17:0/3066830455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68640ffe00 0x7f6864197fa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f685800d950 tx=0x7f685800de10 comp rx=0 tx=0).stop 2024-09-13T15:56:52.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.302+0000 7f686bc00640 1 -- 172.21.15.17:0/3066830455 shutdown_connections 2024-09-13T15:56:52.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.302+0000 7f686bc00640 1 --2- 172.21.15.17:0/3066830455 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f684c0a1100 0x7f684c0a35c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:52.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.302+0000 7f686bc00640 1 --2- 172.21.15.17:0/3066830455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864101920 0x7f686419f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:52.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.302+0000 7f686bc00640 1 --2- 172.21.15.17:0/3066830455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6864100f60 0x7f68641984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:52.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.302+0000 7f686bc00640 1 --2- 172.21.15.17:0/3066830455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68640ffe00 0x7f6864197fa0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:52.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.302+0000 7f686bc00640 1 -- 172.21.15.17:0/3066830455 >> 172.21.15.17:0/3066830455 conn(0x7f68640fb590 msgr2=0x7f68641067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:52.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.302+0000 7f686bc00640 1 -- 172.21.15.17:0/3066830455 shutdown_connections 2024-09-13T15:56:52.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:52.302+0000 7f686bc00640 1 -- 172.21.15.17:0/3066830455 wait complete. 2024-09-13T15:56:53.075 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-13T15:56:53.401 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:56:53.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:53 smithi193 ceph-mon[35248]: pgmap v359: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 458 B/s wr, 7 op/s 2024-09-13T15:56:53.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:53 smithi017 ceph-mon[30494]: pgmap v359: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 458 B/s wr, 7 op/s 2024-09-13T15:56:53.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:53 smithi189 ceph-mon[34790]: pgmap v359: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 458 B/s wr, 7 op/s 2024-09-13T15:56:54.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:54 smithi193 ceph-mon[35248]: from='client.25193 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:56:54.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:54 smithi017 ceph-mon[30494]: from='client.25193 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:56:54.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:54 smithi189 ceph-mon[34790]: from='client.25193 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:56:55.436 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:55 smithi017 ceph-mon[30494]: pgmap v360: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 409 B/s wr, 6 op/s 2024-09-13T15:56:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.435+0000 7fe9a9000640 1 -- 172.21.15.17:0/1187842134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a4100730 msgr2=0x7fe9a4102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.435+0000 7fe9a9000640 1 --2- 172.21.15.17:0/1187842134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a4100730 0x7fe9a4102b20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe994009900 tx=0x7fe99402a3f0 comp rx=0 tx=0).stop 2024-09-13T15:56:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.435+0000 7fe9a9000640 1 -- 172.21.15.17:0/1187842134 shutdown_connections 2024-09-13T15:56:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.435+0000 7fe9a9000640 1 --2- 172.21.15.17:0/1187842134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9a4105990 0x7fe9a4107de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.435+0000 7fe9a9000640 1 --2- 172.21.15.17:0/1187842134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9a4103060 0x7fe9a4105450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.435+0000 7fe9a9000640 1 --2- 172.21.15.17:0/1187842134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a4100730 0x7fe9a4102b20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.435+0000 7fe9a9000640 1 -- 172.21.15.17:0/1187842134 >> 172.21.15.17:0/1187842134 conn(0x7fe9a40fa350 msgr2=0x7fe9a40fc770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.435+0000 7fe9a9000640 1 -- 172.21.15.17:0/1187842134 shutdown_connections 2024-09-13T15:56:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.435+0000 7fe9a9000640 1 -- 172.21.15.17:0/1187842134 wait complete. 2024-09-13T15:56:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.436+0000 7fe9a9000640 1 Processor -- start 2024-09-13T15:56:55.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.437+0000 7fe9a9000640 1 -- start start 2024-09-13T15:56:55.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.437+0000 7fe9a9000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a4100730 0x7fe9a4195c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:55.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.437+0000 7fe9a9000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9a4103060 0x7fe9a4196160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:55.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.437+0000 7fe9a9000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9a4105990 0x7fe9a419d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:55.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.437+0000 7fe9a9000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a419d710 con 0x7fe9a4100730 2024-09-13T15:56:55.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.437+0000 7fe9a9000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a419d880 con 0x7fe9a4105990 2024-09-13T15:56:55.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.437+0000 7fe9a9000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a419da40 con 0x7fe9a4103060 2024-09-13T15:56:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.437+0000 7fe9a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a4100730 0x7fe9a4195c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.437+0000 7fe9a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a4100730 0x7fe9a4195c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54292/0 (socket says 172.21.15.17:54292) 2024-09-13T15:56:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.437+0000 7fe9a3400640 1 -- 172.21.15.17:0/238563685 learned_addr learned my addr 172.21.15.17:0/238563685 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.437+0000 7fe99be00640 1 --2- 172.21.15.17:0/238563685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9a4103060 0x7fe9a4196160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.438+0000 7fe9a3e00640 1 --2- 172.21.15.17:0/238563685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9a4105990 0x7fe9a419d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.438+0000 7fe99be00640 1 -- 172.21.15.17:0/238563685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9a4105990 msgr2=0x7fe9a419d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.438+0000 7fe99be00640 1 --2- 172.21.15.17:0/238563685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9a4105990 0x7fe9a419d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.438+0000 7fe99be00640 1 -- 172.21.15.17:0/238563685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a4100730 msgr2=0x7fe9a4195c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.438+0000 7fe99be00640 1 --2- 172.21.15.17:0/238563685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a4100730 0x7fe9a4195c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.438+0000 7fe99be00640 1 -- 172.21.15.17:0/238563685 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c009490 con 0x7fe9a4103060 2024-09-13T15:56:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.438+0000 7fe9a3400640 1 --2- 172.21.15.17:0/238563685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a4100730 0x7fe9a4195c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:56:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.438+0000 7fe9a3e00640 1 --2- 172.21.15.17:0/238563685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9a4105990 0x7fe9a419d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:56:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.438+0000 7fe99be00640 1 --2- 172.21.15.17:0/238563685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9a4103060 0x7fe9a4196160 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe98c00e9c0 tx=0x7fe98c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.438+0000 7fe9a0c00640 1 -- 172.21.15.17:0/238563685 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c00cd80 con 0x7fe9a4103060 2024-09-13T15:56:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.438+0000 7fe9a9000640 1 -- 172.21.15.17:0/238563685 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe994009560 con 0x7fe9a4103060 2024-09-13T15:56:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.438+0000 7fe9a0c00640 1 -- 172.21.15.17:0/238563685 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe98c0035f0 con 0x7fe9a4103060 2024-09-13T15:56:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.439+0000 7fe9a0c00640 1 -- 172.21.15.17:0/238563685 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c0044e0 con 0x7fe9a4103060 2024-09-13T15:56:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.439+0000 7fe9a9000640 1 -- 172.21.15.17:0/238563685 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a419e090 con 0x7fe9a4103060 2024-09-13T15:56:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.440+0000 7fe9a9000640 1 -- 172.21.15.17:0/238563685 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a40fbe40 con 0x7fe9a4103060 2024-09-13T15:56:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.442+0000 7fe9a0c00640 1 -- 172.21.15.17:0/238563685 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe98c003a60 con 0x7fe9a4103060 2024-09-13T15:56:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.443+0000 7fe9a0c00640 1 --2- 172.21.15.17:0/238563685 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe9880a1070 0x7fe9880a3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.444+0000 7fe9a0c00640 1 -- 172.21.15.17:0/238563685 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fe98c014070 con 0x7fe9a4103060 2024-09-13T15:56:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.444+0000 7fe9a3400640 1 --2- 172.21.15.17:0/238563685 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe9880a1070 0x7fe9880a3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.444+0000 7fe9a3400640 1 --2- 172.21.15.17:0/238563685 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe9880a1070 0x7fe9880a3530 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe994004650 tx=0x7fe994005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.445+0000 7fe9a0c00640 1 -- 172.21.15.17:0/238563685 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe98c096cd0 con 0x7fe9a4103060 2024-09-13T15:56:55.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:55 smithi193 ceph-mon[35248]: pgmap v360: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 409 B/s wr, 6 op/s 2024-09-13T15:56:55.507 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:55 smithi189 ceph-mon[34790]: pgmap v360: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 409 B/s wr, 6 op/s 2024-09-13T15:56:55.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.633+0000 7fe9a9000640 1 -- 172.21.15.17:0/238563685 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9a402c450 con 0x7fe9880a1070 2024-09-13T15:56:55.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.645+0000 7fe9a0c00640 1 -- 172.21.15.17:0/238563685 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4061 (secure 0 0 0) 0x7fe9a402c450 con 0x7fe9880a1070 2024-09-13T15:56:55.646 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T15:56:55.646 INFO:teuthology.orchestra.run.smithi017.stdout:mds.a smithi017 running (2m) 24s ago 2m 12.5M - 18.2.4-850-g50bbe7f3 152d8bc6b19e bd97b9a2c4b3 2024-09-13T15:56:55.646 INFO:teuthology.orchestra.run.smithi017.stdout:mds.b smithi189 running (2m) 61s ago 2m 26.0M - 18.2.4-850-g50bbe7f3 152d8bc6b19e bc454ee82547 2024-09-13T15:56:55.647 INFO:teuthology.orchestra.run.smithi017.stdout:mds.c smithi193 running (2m) 61s ago 2m 17.3M - 18.2.4-850-g50bbe7f3 152d8bc6b19e b39c8b57f39f 2024-09-13T15:56:55.647 INFO:teuthology.orchestra.run.smithi017.stdout:mds.d smithi017 running (2m) 24s ago 2m 12.7M - 18.2.4-850-g50bbe7f3 152d8bc6b19e b08731d97bbb 2024-09-13T15:56:55.647 INFO:teuthology.orchestra.run.smithi017.stdout:mds.e smithi189 running (2m) 61s ago 2m 15.7M - 18.2.4-850-g50bbe7f3 152d8bc6b19e cd9adcd13e9c 2024-09-13T15:56:55.647 INFO:teuthology.orchestra.run.smithi017.stdout:mds.f smithi193 running (2m) 61s ago 2m 17.8M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 526cecdd5fe9 2024-09-13T15:56:55.647 INFO:teuthology.orchestra.run.smithi017.stdout:mds.g smithi017 running (2m) 24s ago 2m 15.9M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 7d5f25adab6e 2024-09-13T15:56:55.647 INFO:teuthology.orchestra.run.smithi017.stdout:mds.h smithi189 running (2m) 61s ago 2m 17.8M - 18.2.4-850-g50bbe7f3 152d8bc6b19e ec4d76c37ef1 2024-09-13T15:56:55.647 INFO:teuthology.orchestra.run.smithi017.stdout:mds.i smithi193 running (2m) 61s ago 2m 17.0M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 47a924b6838e 2024-09-13T15:56:55.647 INFO:teuthology.orchestra.run.smithi017.stdout:mds.j smithi017 running (2m) 24s ago 2m 12.6M - 18.2.4-850-g50bbe7f3 152d8bc6b19e ff6c25f0daf6 2024-09-13T15:56:55.647 INFO:teuthology.orchestra.run.smithi017.stdout:mds.k smithi189 running (2m) 61s ago 2m 14.3M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 6f78886a39d7 2024-09-13T15:56:55.647 INFO:teuthology.orchestra.run.smithi017.stdout:mds.l smithi193 running (2m) 61s ago 2m 14.1M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 83eb180d4af2 2024-09-13T15:56:55.647 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.x smithi017 *:9283,8765 running (9m) 24s ago 9m 496M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 3d6d82a23b12 2024-09-13T15:56:55.648 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.y smithi189 *:8443,8765 running (7m) 61s ago 7m 439M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 7de588e4c513 2024-09-13T15:56:55.648 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.z smithi193 *:8443,8765 running (8m) 61s ago 8m 440M - 18.2.4-850-g50bbe7f3 152d8bc6b19e 6190eecc54c9 2024-09-13T15:56:55.648 INFO:teuthology.orchestra.run.smithi017.stdout:mon.a smithi017 running (9m) 24s ago 10m 48.2M 2048M 18.2.4-850-g50bbe7f3 152d8bc6b19e 14945298a984 2024-09-13T15:56:55.648 INFO:teuthology.orchestra.run.smithi017.stdout:mon.b smithi189 running (8m) 61s ago 8m 40.7M 2048M 18.2.4-850-g50bbe7f3 152d8bc6b19e 57064e1ca85e 2024-09-13T15:56:55.648 INFO:teuthology.orchestra.run.smithi017.stdout:mon.c smithi193 running (8m) 61s ago 8m 42.0M 2048M 18.2.4-850-g50bbe7f3 152d8bc6b19e 8652ef6e8fe5 2024-09-13T15:56:55.648 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (7m) 24s ago 7m 47.0M 4273M 18.2.4-850-g50bbe7f3 152d8bc6b19e 7c94656ec270 2024-09-13T15:56:55.648 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi189 running (7m) 61s ago 7m 47.5M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e 21b3d4764a2d 2024-09-13T15:56:55.648 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi193 running (6m) 61s ago 6m 46.5M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e 261ff178af76 2024-09-13T15:56:55.648 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi017 running (6m) 24s ago 6m 51.2M 4273M 18.2.4-850-g50bbe7f3 152d8bc6b19e 05b49605f961 2024-09-13T15:56:55.648 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi189 running (6m) 61s ago 6m 43.1M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e 625bb6080eef 2024-09-13T15:56:55.648 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi193 running (5m) 61s ago 5m 45.7M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e e6be28a1813b 2024-09-13T15:56:55.648 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 smithi017 running (5m) 24s ago 5m 49.1M 4273M 18.2.4-850-g50bbe7f3 152d8bc6b19e 47ff242672ef 2024-09-13T15:56:55.648 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 smithi189 running (4m) 61s ago 4m 52.3M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e 59937874497a 2024-09-13T15:56:55.649 INFO:teuthology.orchestra.run.smithi017.stdout:osd.8 smithi193 running (4m) 61s ago 4m 46.9M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e 1a72f2c27639 2024-09-13T15:56:55.649 INFO:teuthology.orchestra.run.smithi017.stdout:osd.9 smithi017 running (3m) 24s ago 3m 42.2M 4273M 18.2.4-850-g50bbe7f3 152d8bc6b19e f942766c8714 2024-09-13T15:56:55.649 INFO:teuthology.orchestra.run.smithi017.stdout:osd.10 smithi189 running (3m) 61s ago 3m 44.0M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e ec8e606ae643 2024-09-13T15:56:55.649 INFO:teuthology.orchestra.run.smithi017.stdout:osd.11 smithi193 running (3m) 61s ago 3m 49.0M 4272M 18.2.4-850-g50bbe7f3 152d8bc6b19e 68d1f3a3c412 2024-09-13T15:56:55.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.647+0000 7fe9a9000640 1 -- 172.21.15.17:0/238563685 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe9880a1070 msgr2=0x7fe9880a3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:55.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.647+0000 7fe9a9000640 1 --2- 172.21.15.17:0/238563685 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe9880a1070 0x7fe9880a3530 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe994004650 tx=0x7fe994005780 comp rx=0 tx=0).stop 2024-09-13T15:56:55.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.647+0000 7fe9a9000640 1 -- 172.21.15.17:0/238563685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9a4103060 msgr2=0x7fe9a4196160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:55.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.647+0000 7fe9a9000640 1 --2- 172.21.15.17:0/238563685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9a4103060 0x7fe9a4196160 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe98c00e9c0 tx=0x7fe98c00ee80 comp rx=0 tx=0).stop 2024-09-13T15:56:55.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.648+0000 7fe9a9000640 1 -- 172.21.15.17:0/238563685 shutdown_connections 2024-09-13T15:56:55.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.648+0000 7fe9a9000640 1 --2- 172.21.15.17:0/238563685 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe9880a1070 0x7fe9880a3530 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:55.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.648+0000 7fe9a9000640 1 --2- 172.21.15.17:0/238563685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9a4105990 0x7fe9a419d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:55.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.648+0000 7fe9a9000640 1 --2- 172.21.15.17:0/238563685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9a4103060 0x7fe9a4196160 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:55.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.648+0000 7fe9a9000640 1 --2- 172.21.15.17:0/238563685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a4100730 0x7fe9a4195c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:55.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.648+0000 7fe9a9000640 1 -- 172.21.15.17:0/238563685 >> 172.21.15.17:0/238563685 conn(0x7fe9a40fa350 msgr2=0x7fe9a41010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:55.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.648+0000 7fe9a9000640 1 -- 172.21.15.17:0/238563685 shutdown_connections 2024-09-13T15:56:55.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:55.648+0000 7fe9a9000640 1 -- 172.21.15.17:0/238563685 wait complete. 2024-09-13T15:56:56.419 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:56 smithi017 ceph-mon[30494]: from='client.25219 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:56:56.419 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:56 smithi017 ceph-mon[30494]: pgmap v361: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 343 B/s wr, 7 op/s 2024-09-13T15:56:56.455 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-13T15:56:56.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:56 smithi193 ceph-mon[35248]: from='client.25219 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:56:56.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:56 smithi193 ceph-mon[35248]: pgmap v361: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 343 B/s wr, 7 op/s 2024-09-13T15:56:56.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:56 smithi189 ceph-mon[34790]: from='client.25219 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:56:56.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:56 smithi189 ceph-mon[34790]: pgmap v361: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 343 B/s wr, 7 op/s 2024-09-13T15:56:56.778 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:56:58.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.753+0000 7fe7dfe00640 1 -- 172.21.15.17:0/3330554702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7d8103bd0 msgr2=0x7fe7d810a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:58.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.753+0000 7fe7dfe00640 1 --2- 172.21.15.17:0/3330554702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7d8103bd0 0x7fe7d810a460 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0009be0 tx=0x7fe7d002a6c0 comp rx=0 tx=0).stop 2024-09-13T15:56:58.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.753+0000 7fe7dfe00640 1 -- 172.21.15.17:0/3330554702 shutdown_connections 2024-09-13T15:56:58.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.753+0000 7fe7dfe00640 1 --2- 172.21.15.17:0/3330554702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7d8103bd0 0x7fe7d810a460 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:58.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.753+0000 7fe7dfe00640 1 --2- 172.21.15.17:0/3330554702 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7d8103210 0x7fe7d8103690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:58.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.754+0000 7fe7dfe00640 1 --2- 172.21.15.17:0/3330554702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7d8102010 0x7fe7d8102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:58.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.754+0000 7fe7dfe00640 1 -- 172.21.15.17:0/3330554702 >> 172.21.15.17:0/3330554702 conn(0x7fe7d80fd7a0 msgr2=0x7fe7d80ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:58.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.754+0000 7fe7dfe00640 1 -- 172.21.15.17:0/3330554702 shutdown_connections 2024-09-13T15:56:58.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.754+0000 7fe7dfe00640 1 -- 172.21.15.17:0/3330554702 wait complete. 2024-09-13T15:56:58.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.754+0000 7fe7dfe00640 1 Processor -- start 2024-09-13T15:56:58.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.755+0000 7fe7dfe00640 1 -- start start 2024-09-13T15:56:58.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.755+0000 7fe7dfe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7d8102010 0x7fe7d8198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:58.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.755+0000 7fe7dfe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7d8103210 0x7fe7d8198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:58.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.755+0000 7fe7dfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7d8103bd0 0x7fe7d819f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:58.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.755+0000 7fe7dfe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d819fb00 con 0x7fe7d8103bd0 2024-09-13T15:56:58.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.755+0000 7fe7dfe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d819fc70 con 0x7fe7d8103210 2024-09-13T15:56:58.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.755+0000 7fe7dfe00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d819fe30 con 0x7fe7d8102010 2024-09-13T15:56:58.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.755+0000 7fe7dd400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7d8102010 0x7fe7d8198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:58.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.755+0000 7fe7dde00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7d8103bd0 0x7fe7d819f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:58.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.755+0000 7fe7dd400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7d8102010 0x7fe7d8198000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:49740/0 (socket says 172.21.15.17:49740) 2024-09-13T15:56:58.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.755+0000 7fe7dd400640 1 -- 172.21.15.17:0/818694495 learned_addr learned my addr 172.21.15.17:0/818694495 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:56:58.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.755+0000 7fe7dca00640 1 --2- 172.21.15.17:0/818694495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7d8103210 0x7fe7d8198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:58.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.756+0000 7fe7dd400640 1 -- 172.21.15.17:0/818694495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7d8103210 msgr2=0x7fe7d8198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:58.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.756+0000 7fe7dd400640 1 --2- 172.21.15.17:0/818694495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7d8103210 0x7fe7d8198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:58.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.756+0000 7fe7dd400640 1 -- 172.21.15.17:0/818694495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7d8103bd0 msgr2=0x7fe7d819f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:58.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.756+0000 7fe7dd400640 1 --2- 172.21.15.17:0/818694495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7d8103bd0 0x7fe7d819f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:58.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.756+0000 7fe7dd400640 1 -- 172.21.15.17:0/818694495 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc009560 con 0x7fe7d8102010 2024-09-13T15:56:58.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.756+0000 7fe7dd400640 1 --2- 172.21.15.17:0/818694495 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7d8102010 0x7fe7d8198000 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00e9a0 tx=0x7fe7cc00ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:58.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.756+0000 7fe7d6000640 1 -- 172.21.15.17:0/818694495 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc00cd80 con 0x7fe7d8102010 2024-09-13T15:56:58.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.757+0000 7fe7d6000640 1 -- 172.21.15.17:0/818694495 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7cc0108f0 con 0x7fe7d8102010 2024-09-13T15:56:58.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.757+0000 7fe7d6000640 1 -- 172.21.15.17:0/818694495 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc018960 con 0x7fe7d8102010 2024-09-13T15:56:58.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.757+0000 7fe7dfe00640 1 -- 172.21.15.17:0/818694495 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d0009840 con 0x7fe7d8102010 2024-09-13T15:56:58.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.757+0000 7fe7dfe00640 1 -- 172.21.15.17:0/818694495 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d81a0430 con 0x7fe7d8102010 2024-09-13T15:56:58.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.758+0000 7fe7dfe00640 1 -- 172.21.15.17:0/818694495 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d8102410 con 0x7fe7d8102010 2024-09-13T15:56:58.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.760+0000 7fe7d6000640 1 -- 172.21.15.17:0/818694495 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe7cc010a60 con 0x7fe7d8102010 2024-09-13T15:56:58.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.761+0000 7fe7d6000640 1 --2- 172.21.15.17:0/818694495 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe7c00a1130 0x7fe7c00a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:56:58.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.762+0000 7fe7d6000640 1 -- 172.21.15.17:0/818694495 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fe7cc014070 con 0x7fe7d8102010 2024-09-13T15:56:58.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.762+0000 7fe7dca00640 1 --2- 172.21.15.17:0/818694495 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe7c00a1130 0x7fe7c00a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:56:58.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.762+0000 7fe7dca00640 1 --2- 172.21.15.17:0/818694495 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe7c00a1130 0x7fe7c00a35f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8199520 tx=0x7fe7c4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:56:58.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.763+0000 7fe7d6000640 1 -- 172.21.15.17:0/818694495 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe7cc096bb0 con 0x7fe7d8102010 2024-09-13T15:56:58.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.950+0000 7fe7dfe00640 1 -- 172.21.15.17:0/818694495 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7d802c450 con 0x7fe7c00a1130 2024-09-13T15:56:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.955+0000 7fe7d6000640 1 -- 172.21.15.17:0/818694495 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7fe7d802c450 con 0x7fe7c00a1130 2024-09-13T15:56:58.956 INFO:teuthology.orchestra.run.smithi017.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-13T15:56:58.956 INFO:teuthology.orchestra.run.smithi017.stdout:mds.all 12/12 64s ago 2m smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi189=b;smithi189=e;smithi189=h;smithi189=k;smithi193=c;smithi193=f;smithi193=i;smithi193=l;count:12 2024-09-13T15:56:58.956 INFO:teuthology.orchestra.run.smithi017.stdout:mgr 3/3 64s ago 8m smithi017=x;smithi189=y;smithi193=z;count:3 2024-09-13T15:56:58.956 INFO:teuthology.orchestra.run.smithi017.stdout:mon 3/3 64s ago 8m smithi017:172.21.15.17=a;smithi189:172.21.15.189=b;smithi193:172.21.15.193=c;count:3 2024-09-13T15:56:58.956 INFO:teuthology.orchestra.run.smithi017.stdout:osd 12 64s ago - 2024-09-13T15:56:58.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.958+0000 7fe7dfe00640 1 -- 172.21.15.17:0/818694495 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe7c00a1130 msgr2=0x7fe7c00a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:58.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.958+0000 7fe7dfe00640 1 --2- 172.21.15.17:0/818694495 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe7c00a1130 0x7fe7c00a35f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8199520 tx=0x7fe7c4005f90 comp rx=0 tx=0).stop 2024-09-13T15:56:58.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.958+0000 7fe7dfe00640 1 -- 172.21.15.17:0/818694495 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7d8102010 msgr2=0x7fe7d8198000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:56:58.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.958+0000 7fe7dfe00640 1 --2- 172.21.15.17:0/818694495 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7d8102010 0x7fe7d8198000 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00e9a0 tx=0x7fe7cc00ee60 comp rx=0 tx=0).stop 2024-09-13T15:56:58.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.958+0000 7fe7dfe00640 1 -- 172.21.15.17:0/818694495 shutdown_connections 2024-09-13T15:56:58.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.958+0000 7fe7dfe00640 1 --2- 172.21.15.17:0/818694495 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe7c00a1130 0x7fe7c00a35f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:58.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.958+0000 7fe7dfe00640 1 --2- 172.21.15.17:0/818694495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7d8103bd0 0x7fe7d819f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:58.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.958+0000 7fe7dfe00640 1 --2- 172.21.15.17:0/818694495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7d8103210 0x7fe7d8198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:58.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.958+0000 7fe7dfe00640 1 --2- 172.21.15.17:0/818694495 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7d8102010 0x7fe7d8198000 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:56:58.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.958+0000 7fe7dfe00640 1 -- 172.21.15.17:0/818694495 >> 172.21.15.17:0/818694495 conn(0x7fe7d80fd7a0 msgr2=0x7fe7d81066a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:56:58.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.958+0000 7fe7dfe00640 1 -- 172.21.15.17:0/818694495 shutdown_connections 2024-09-13T15:56:58.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:56:58.958+0000 7fe7dfe00640 1 -- 172.21.15.17:0/818694495 wait complete. 2024-09-13T15:56:59.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:56:59 smithi193 ceph-mon[35248]: pgmap v362: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:59.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:56:59 smithi017 ceph-mon[30494]: pgmap v362: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:59.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:56:59 smithi189 ceph-mon[34790]: pgmap v362: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:56:59.691 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-13T15:57:00.013 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:57:00.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:00 smithi017 ceph-mon[30494]: from='client.25225 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:57:00.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:00 smithi017 ceph-mon[30494]: pgmap v363: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:57:00.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:00 smithi193 ceph-mon[35248]: from='client.25225 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:57:00.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:00 smithi193 ceph-mon[35248]: pgmap v363: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:57:00.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:00 smithi189 ceph-mon[34790]: from='client.25225 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:57:00.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:00 smithi189 ceph-mon[34790]: pgmap v363: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:57:02.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.040+0000 7f4592200640 1 -- 172.21.15.17:0/3738695072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f458c076a50 msgr2=0x7f458c0772f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:02.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.040+0000 7f4592200640 1 --2- 172.21.15.17:0/3738695072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f458c076a50 0x7f458c0772f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4584009ca0 tx=0x7f458402a8c0 comp rx=0 tx=0).stop 2024-09-13T15:57:02.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.040+0000 7f4592200640 1 -- 172.21.15.17:0/3738695072 shutdown_connections 2024-09-13T15:57:02.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.040+0000 7f4592200640 1 --2- 172.21.15.17:0/3738695072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f458c076a50 0x7f458c0772f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:02.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.040+0000 7f4592200640 1 --2- 172.21.15.17:0/3738695072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f458c0760b0 0x7f458c076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:02.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.040+0000 7f4592200640 1 --2- 172.21.15.17:0/3738695072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f458c074e60 0x7f458c075260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:02.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.040+0000 7f4592200640 1 -- 172.21.15.17:0/3738695072 >> 172.21.15.17:0/3738695072 conn(0x7f458c0fd790 msgr2=0x7f458c0ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:02.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.040+0000 7f4592200640 1 -- 172.21.15.17:0/3738695072 shutdown_connections 2024-09-13T15:57:02.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.040+0000 7f4592200640 1 -- 172.21.15.17:0/3738695072 wait complete. 2024-09-13T15:57:02.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.041+0000 7f4592200640 1 Processor -- start 2024-09-13T15:57:02.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.041+0000 7f4592200640 1 -- start start 2024-09-13T15:57:02.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.041+0000 7f4592200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f458c074e60 0x7f458c19c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:02.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.041+0000 7f4592200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f458c0760b0 0x7f458c19c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:02.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.041+0000 7f4592200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f458c076a50 0x7f458c1a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:02.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.041+0000 7f4592200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c1a3e80 con 0x7f458c0760b0 2024-09-13T15:57:02.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.041+0000 7f4592200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c1a3ff0 con 0x7f458c074e60 2024-09-13T15:57:02.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.041+0000 7f4592200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c1a41b0 con 0x7f458c076a50 2024-09-13T15:57:02.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.041+0000 7f4583e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f458c0760b0 0x7f458c19c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:02.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.042+0000 7f4583e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f458c0760b0 0x7f458c19c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57702/0 (socket says 172.21.15.17:57702) 2024-09-13T15:57:02.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.042+0000 7f4583e00640 1 -- 172.21.15.17:0/2958927096 learned_addr learned my addr 172.21.15.17:0/2958927096 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:02.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.042+0000 7f458be00640 1 --2- 172.21.15.17:0/2958927096 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f458c076a50 0x7f458c1a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:02.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.042+0000 7f458b400640 1 --2- 172.21.15.17:0/2958927096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f458c074e60 0x7f458c19c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:02.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.042+0000 7f4583e00640 1 -- 172.21.15.17:0/2958927096 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f458c076a50 msgr2=0x7f458c1a3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:02.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.042+0000 7f4583e00640 1 --2- 172.21.15.17:0/2958927096 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f458c076a50 0x7f458c1a3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:02.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.042+0000 7f4583e00640 1 -- 172.21.15.17:0/2958927096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f458c074e60 msgr2=0x7f458c19c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:02.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.042+0000 7f4583e00640 1 --2- 172.21.15.17:0/2958927096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f458c074e60 0x7f458c19c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:02.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.042+0000 7f4583e00640 1 -- 172.21.15.17:0/2958927096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457c009490 con 0x7f458c0760b0 2024-09-13T15:57:02.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.042+0000 7f4583e00640 1 --2- 172.21.15.17:0/2958927096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f458c0760b0 0x7f458c19c8c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f457400ea60 tx=0x7f457400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:02.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.042+0000 7f4588c00640 1 -- 172.21.15.17:0/2958927096 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457400cde0 con 0x7f458c0760b0 2024-09-13T15:57:02.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.043+0000 7f4592200640 1 -- 172.21.15.17:0/2958927096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4574009490 con 0x7f458c0760b0 2024-09-13T15:57:02.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.043+0000 7f4588c00640 1 -- 172.21.15.17:0/2958927096 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45740035f0 con 0x7f458c0760b0 2024-09-13T15:57:02.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.043+0000 7f4588c00640 1 -- 172.21.15.17:0/2958927096 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45740044e0 con 0x7f458c0760b0 2024-09-13T15:57:02.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.043+0000 7f4592200640 1 -- 172.21.15.17:0/2958927096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4584009900 con 0x7f458c0760b0 2024-09-13T15:57:02.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.044+0000 7f4592200640 1 -- 172.21.15.17:0/2958927096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f458c10e980 con 0x7f458c0760b0 2024-09-13T15:57:02.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.045+0000 7f4588c00640 1 -- 172.21.15.17:0/2958927096 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4574003a60 con 0x7f458c0760b0 2024-09-13T15:57:02.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.047+0000 7f4588c00640 1 --2- 172.21.15.17:0/2958927096 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f45700a10b0 0x7f45700a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:02.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.047+0000 7f4588c00640 1 -- 172.21.15.17:0/2958927096 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f4574014070 con 0x7f458c0760b0 2024-09-13T15:57:02.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.047+0000 7f458b400640 1 --2- 172.21.15.17:0/2958927096 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f45700a10b0 0x7f45700a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:02.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.048+0000 7f458b400640 1 --2- 172.21.15.17:0/2958927096 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f45700a10b0 0x7f45700a3570 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f457c009d60 tx=0x7f457c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:02.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.051+0000 7f4588c00640 1 -- 172.21.15.17:0/2958927096 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f45740963f0 con 0x7f458c0760b0 2024-09-13T15:57:02.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.239+0000 7f4592200640 1 -- 172.21.15.17:0/2958927096 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f458c02c450 con 0x7f45700a10b0 2024-09-13T15:57:02.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.241+0000 7f4588c00640 1 -- 172.21.15.17:0/2958927096 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f458c02c450 con 0x7f45700a10b0 2024-09-13T15:57:02.243 INFO:teuthology.orchestra.run.smithi017.stdout:HOST ADDR LABELS STATUS 2024-09-13T15:57:02.243 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017 172.21.15.17 2024-09-13T15:57:02.243 INFO:teuthology.orchestra.run.smithi017.stdout:smithi189 172.21.15.189 2024-09-13T15:57:02.243 INFO:teuthology.orchestra.run.smithi017.stdout:smithi193 172.21.15.193 2024-09-13T15:57:02.243 INFO:teuthology.orchestra.run.smithi017.stdout:3 hosts in cluster 2024-09-13T15:57:02.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.243+0000 7f4592200640 1 -- 172.21.15.17:0/2958927096 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f45700a10b0 msgr2=0x7f45700a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:02.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.243+0000 7f4592200640 1 --2- 172.21.15.17:0/2958927096 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f45700a10b0 0x7f45700a3570 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f457c009d60 tx=0x7f457c005f90 comp rx=0 tx=0).stop 2024-09-13T15:57:02.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.243+0000 7f4592200640 1 -- 172.21.15.17:0/2958927096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f458c0760b0 msgr2=0x7f458c19c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:02.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.243+0000 7f4592200640 1 --2- 172.21.15.17:0/2958927096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f458c0760b0 0x7f458c19c8c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f457400ea60 tx=0x7f457400ef20 comp rx=0 tx=0).stop 2024-09-13T15:57:02.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.243+0000 7f4592200640 1 -- 172.21.15.17:0/2958927096 shutdown_connections 2024-09-13T15:57:02.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.243+0000 7f4592200640 1 --2- 172.21.15.17:0/2958927096 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f45700a10b0 0x7f45700a3570 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:02.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.243+0000 7f4592200640 1 --2- 172.21.15.17:0/2958927096 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f458c076a50 0x7f458c1a3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:02.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.243+0000 7f4592200640 1 --2- 172.21.15.17:0/2958927096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f458c0760b0 0x7f458c19c8c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:02.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.243+0000 7f4592200640 1 --2- 172.21.15.17:0/2958927096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f458c074e60 0x7f458c19c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:02.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.243+0000 7f4592200640 1 -- 172.21.15.17:0/2958927096 >> 172.21.15.17:0/2958927096 conn(0x7f458c0fd790 msgr2=0x7f458c0ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:02.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.243+0000 7f4592200640 1 -- 172.21.15.17:0/2958927096 shutdown_connections 2024-09-13T15:57:02.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:02.244+0000 7f4592200640 1 -- 172.21.15.17:0/2958927096 wait complete. 2024-09-13T15:57:02.976 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-13T15:57:03.309 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:57:03.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:03 smithi193 ceph-mon[35248]: pgmap v364: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:57:03.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:03 smithi017 ceph-mon[30494]: pgmap v364: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:57:03.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:03 smithi189 ceph-mon[34790]: pgmap v364: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:57:04.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:04 smithi193 ceph-mon[35248]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:57:04.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:04 smithi193 ceph-mon[35248]: pgmap v365: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:57:04.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:04 smithi017 ceph-mon[30494]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:57:04.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:04 smithi017 ceph-mon[30494]: pgmap v365: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:57:04.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:04 smithi189 ceph-mon[34790]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:57:04.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:04 smithi189 ceph-mon[34790]: pgmap v365: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:57:05.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.221+0000 7fec46a00640 1 -- 172.21.15.17:0/1389359947 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec400ffde0 msgr2=0x7fec401001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:05.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.221+0000 7fec46a00640 1 --2- 172.21.15.17:0/1389359947 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec400ffde0 0x7fec401001e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fec30009900 tx=0x7fec3002a3f0 comp rx=0 tx=0).stop 2024-09-13T15:57:05.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.221+0000 7fec46a00640 1 -- 172.21.15.17:0/1389359947 shutdown_connections 2024-09-13T15:57:05.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.221+0000 7fec46a00640 1 --2- 172.21.15.17:0/1389359947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec401019a0 0x7fec40108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:05.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.221+0000 7fec46a00640 1 --2- 172.21.15.17:0/1389359947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec40100fe0 0x7fec40101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:05.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.221+0000 7fec46a00640 1 --2- 172.21.15.17:0/1389359947 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec400ffde0 0x7fec401001e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:05.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.221+0000 7fec46a00640 1 -- 172.21.15.17:0/1389359947 >> 172.21.15.17:0/1389359947 conn(0x7fec400fb590 msgr2=0x7fec400fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:05.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.221+0000 7fec46a00640 1 -- 172.21.15.17:0/1389359947 shutdown_connections 2024-09-13T15:57:05.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.221+0000 7fec46a00640 1 -- 172.21.15.17:0/1389359947 wait complete. 2024-09-13T15:57:05.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.222+0000 7fec46a00640 1 Processor -- start 2024-09-13T15:57:05.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.222+0000 7fec46a00640 1 -- start start 2024-09-13T15:57:05.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.223+0000 7fec46a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec400ffde0 0x7fec40195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:05.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.223+0000 7fec46a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec40100fe0 0x7fec401962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:05.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.223+0000 7fec46a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec401019a0 0x7fec4019d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:05.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.223+0000 7fec46a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4019d8b0 con 0x7fec40100fe0 2024-09-13T15:57:05.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.223+0000 7fec46a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4019da20 con 0x7fec400ffde0 2024-09-13T15:57:05.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.223+0000 7fec46a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4019dbe0 con 0x7fec401019a0 2024-09-13T15:57:05.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.223+0000 7fec37400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec40100fe0 0x7fec401962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:05.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.223+0000 7fec37400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec40100fe0 0x7fec401962f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57734/0 (socket says 172.21.15.17:57734) 2024-09-13T15:57:05.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.223+0000 7fec37400640 1 -- 172.21.15.17:0/10602531 learned_addr learned my addr 172.21.15.17:0/10602531 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:05.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.223+0000 7fec44a00640 1 --2- 172.21.15.17:0/10602531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec401019a0 0x7fec4019d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:05.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.223+0000 7fec3fe00640 1 --2- 172.21.15.17:0/10602531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec400ffde0 0x7fec40195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:05.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.224+0000 7fec37400640 1 -- 172.21.15.17:0/10602531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec401019a0 msgr2=0x7fec4019d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:05.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.224+0000 7fec37400640 1 --2- 172.21.15.17:0/10602531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec401019a0 0x7fec4019d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:05.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.224+0000 7fec37400640 1 -- 172.21.15.17:0/10602531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec400ffde0 msgr2=0x7fec40195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:05.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.224+0000 7fec37400640 1 --2- 172.21.15.17:0/10602531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec400ffde0 0x7fec40195db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:05.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.224+0000 7fec37400640 1 -- 172.21.15.17:0/10602531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec30009560 con 0x7fec40100fe0 2024-09-13T15:57:05.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.224+0000 7fec37400640 1 --2- 172.21.15.17:0/10602531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec40100fe0 0x7fec401962f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fec2800d950 tx=0x7fec2800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:05.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.224+0000 7fec3d600640 1 -- 172.21.15.17:0/10602531 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28009a30 con 0x7fec40100fe0 2024-09-13T15:57:05.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.224+0000 7fec3d600640 1 -- 172.21.15.17:0/10602531 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec28009b90 con 0x7fec40100fe0 2024-09-13T15:57:05.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.224+0000 7fec46a00640 1 -- 172.21.15.17:0/10602531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4019dec0 con 0x7fec40100fe0 2024-09-13T15:57:05.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.224+0000 7fec3d600640 1 -- 172.21.15.17:0/10602531 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec280047a0 con 0x7fec40100fe0 2024-09-13T15:57:05.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.224+0000 7fec46a00640 1 -- 172.21.15.17:0/10602531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4019e380 con 0x7fec40100fe0 2024-09-13T15:57:05.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.225+0000 7fec46a00640 1 -- 172.21.15.17:0/10602531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec40107280 con 0x7fec40100fe0 2024-09-13T15:57:05.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.227+0000 7fec3d600640 1 -- 172.21.15.17:0/10602531 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fec28009d00 con 0x7fec40100fe0 2024-09-13T15:57:05.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.228+0000 7fec3d600640 1 --2- 172.21.15.17:0/10602531 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fec240a1130 0x7fec240a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:05.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.229+0000 7fec3d600640 1 -- 172.21.15.17:0/10602531 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fec280cc680 con 0x7fec40100fe0 2024-09-13T15:57:05.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.229+0000 7fec3fe00640 1 --2- 172.21.15.17:0/10602531 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fec240a1130 0x7fec240a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:05.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.229+0000 7fec3fe00640 1 --2- 172.21.15.17:0/10602531 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fec240a1130 0x7fec240a35f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fec30005ab0 tx=0x7fec300314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:05.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.232+0000 7fec3d600640 1 -- 172.21.15.17:0/10602531 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fec28095a60 con 0x7fec40100fe0 2024-09-13T15:57:05.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.419+0000 7fec46a00640 1 -- 172.21.15.17:0/10602531 --> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fec4002c4f0 con 0x7fec240a1130 2024-09-13T15:57:05.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.421+0000 7fec3d600640 1 -- 172.21.15.17:0/10602531 <== mgr.14150 v2:172.21.15.17:6800/1039314076 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7fec4002c4f0 con 0x7fec240a1130 2024-09-13T15:57:05.422 INFO:teuthology.orchestra.run.smithi017.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-13T15:57:05.422 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7473003Q480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-13T15:57:05.422 INFO:teuthology.orchestra.run.smithi017.stdout:smithi189 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6232004L400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-13T15:57:05.422 INFO:teuthology.orchestra.run.smithi017.stdout:smithi193 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500HB400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-13T15:57:05.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.423+0000 7fec46a00640 1 -- 172.21.15.17:0/10602531 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fec240a1130 msgr2=0x7fec240a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:05.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.423+0000 7fec46a00640 1 --2- 172.21.15.17:0/10602531 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fec240a1130 0x7fec240a35f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fec30005ab0 tx=0x7fec300314a0 comp rx=0 tx=0).stop 2024-09-13T15:57:05.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.423+0000 7fec46a00640 1 -- 172.21.15.17:0/10602531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec40100fe0 msgr2=0x7fec401962f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:05.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.423+0000 7fec46a00640 1 --2- 172.21.15.17:0/10602531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec40100fe0 0x7fec401962f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fec2800d950 tx=0x7fec2800de10 comp rx=0 tx=0).stop 2024-09-13T15:57:05.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.423+0000 7fec46a00640 1 -- 172.21.15.17:0/10602531 shutdown_connections 2024-09-13T15:57:05.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.423+0000 7fec46a00640 1 --2- 172.21.15.17:0/10602531 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fec240a1130 0x7fec240a35f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:05.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.423+0000 7fec46a00640 1 --2- 172.21.15.17:0/10602531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec401019a0 0x7fec4019d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:05.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.423+0000 7fec46a00640 1 --2- 172.21.15.17:0/10602531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec40100fe0 0x7fec401962f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:05.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.423+0000 7fec46a00640 1 --2- 172.21.15.17:0/10602531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec400ffde0 0x7fec40195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:05.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.423+0000 7fec46a00640 1 -- 172.21.15.17:0/10602531 >> 172.21.15.17:0/10602531 conn(0x7fec400fb590 msgr2=0x7fec40104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:05.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.424+0000 7fec46a00640 1 -- 172.21.15.17:0/10602531 shutdown_connections 2024-09-13T15:57:05.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:05.424+0000 7fec46a00640 1 -- 172.21.15.17:0/10602531 wait complete. 2024-09-13T15:57:06.168 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T15:57:06.178 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-13T15:57:06.178 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T15:57:06.502 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:57:06.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:06 smithi017 ceph-mon[30494]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:57:06.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:06 smithi017 ceph-mon[30494]: pgmap v366: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:57:06.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:06 smithi189 ceph-mon[34790]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:57:06.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:06 smithi189 ceph-mon[34790]: pgmap v366: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:57:06.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:06 smithi193 ceph-mon[35248]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T15:57:06.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:06 smithi193 ceph-mon[35248]: pgmap v366: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:57:08.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:08 smithi017 ceph-mon[30494]: pgmap v367: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:57:08.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.472+0000 7f868f200640 1 -- 172.21.15.17:0/3489204605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8688103960 msgr2=0x7f8688103e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:08.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.472+0000 7f868f200640 1 --2- 172.21.15.17:0/3489204605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8688103960 0x7f8688103e10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8680009ca0 tx=0x7f868002a8c0 comp rx=0 tx=0).stop 2024-09-13T15:57:08.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.472+0000 7f868f200640 1 -- 172.21.15.17:0/3489204605 shutdown_connections 2024-09-13T15:57:08.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.472+0000 7f868f200640 1 --2- 172.21.15.17:0/3489204605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8688103960 0x7f8688103e10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:08.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.472+0000 7f868f200640 1 --2- 172.21.15.17:0/3489204605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8688100fb0 0x7f8688103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:08.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.472+0000 7f868f200640 1 --2- 172.21.15.17:0/3489204605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86880fe660 0x7f8688100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:08.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.472+0000 7f868f200640 1 -- 172.21.15.17:0/3489204605 >> 172.21.15.17:0/3489204605 conn(0x7f86880fa470 msgr2=0x7f86880fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:08.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.472+0000 7f868f200640 1 -- 172.21.15.17:0/3489204605 shutdown_connections 2024-09-13T15:57:08.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.472+0000 7f868f200640 1 -- 172.21.15.17:0/3489204605 wait complete. 2024-09-13T15:57:08.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.473+0000 7f868f200640 1 Processor -- start 2024-09-13T15:57:08.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.473+0000 7f868f200640 1 -- start start 2024-09-13T15:57:08.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.473+0000 7f868f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86880fe660 0x7f868819c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:08.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.473+0000 7f868f200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8688100fb0 0x7f868819c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:08.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.473+0000 7f868f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8688103960 0x7f86881a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.473+0000 7f868f200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86881a3de0 con 0x7f8688103960 2024-09-13T15:57:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.473+0000 7f868f200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86881a3f50 con 0x7f86880fe660 2024-09-13T15:57:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.473+0000 7f868f200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86881a4110 con 0x7f8688100fb0 2024-09-13T15:57:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.474+0000 7f868d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8688103960 0x7f86881a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.474+0000 7f868d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8688103960 0x7f86881a38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57756/0 (socket says 172.21.15.17:57756) 2024-09-13T15:57:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.474+0000 7f868d200640 1 -- 172.21.15.17:0/1451126632 learned_addr learned my addr 172.21.15.17:0/1451126632 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.474+0000 7f8687e00640 1 --2- 172.21.15.17:0/1451126632 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86880fe660 0x7f868819c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.474+0000 7f867fe00640 1 --2- 172.21.15.17:0/1451126632 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8688100fb0 0x7f868819c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.474+0000 7f868d200640 1 -- 172.21.15.17:0/1451126632 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8688100fb0 msgr2=0x7f868819c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.474+0000 7f868d200640 1 --2- 172.21.15.17:0/1451126632 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8688100fb0 0x7f868819c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.474+0000 7f868d200640 1 -- 172.21.15.17:0/1451126632 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86880fe660 msgr2=0x7f868819c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.474+0000 7f868d200640 1 --2- 172.21.15.17:0/1451126632 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86880fe660 0x7f868819c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.474+0000 7f868d200640 1 -- 172.21.15.17:0/1451126632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8680009900 con 0x7f8688103960 2024-09-13T15:57:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.474+0000 7f8687e00640 1 --2- 172.21.15.17:0/1451126632 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86880fe660 0x7f868819c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:57:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.474+0000 7f868d200640 1 --2- 172.21.15.17:0/1451126632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8688103960 0x7f86881a38a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f868002aeb0 tx=0x7f8680003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.475+0000 7f8685600640 1 -- 172.21.15.17:0/1451126632 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86800307c0 con 0x7f8688103960 2024-09-13T15:57:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.475+0000 7f8685600640 1 -- 172.21.15.17:0/1451126632 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8680040070 con 0x7f8688103960 2024-09-13T15:57:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.475+0000 7f868f200640 1 -- 172.21.15.17:0/1451126632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86881a4390 con 0x7f8688103960 2024-09-13T15:57:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.475+0000 7f8685600640 1 -- 172.21.15.17:0/1451126632 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86800044a0 con 0x7f8688103960 2024-09-13T15:57:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.475+0000 7f868f200640 1 -- 172.21.15.17:0/1451126632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86881a48e0 con 0x7f8688103960 2024-09-13T15:57:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.476+0000 7f868f200640 1 -- 172.21.15.17:0/1451126632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86880fbf60 con 0x7f8688103960 2024-09-13T15:57:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.478+0000 7f8685600640 1 -- 172.21.15.17:0/1451126632 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8680042030 con 0x7f8688103960 2024-09-13T15:57:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.480+0000 7f8685600640 1 --2- 172.21.15.17:0/1451126632 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f866c0a1130 0x7f866c0a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.480+0000 7f8685600640 1 -- 172.21.15.17:0/1451126632 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f86800ee200 con 0x7f8688103960 2024-09-13T15:57:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.480+0000 7f8687e00640 1 --2- 172.21.15.17:0/1451126632 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f866c0a1130 0x7f866c0a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.481+0000 7f8687e00640 1 --2- 172.21.15.17:0/1451126632 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f866c0a1130 0x7f866c0a35f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8678009fc0 tx=0x7f8678005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:08.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.484+0000 7f8685600640 1 -- 172.21.15.17:0/1451126632 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f86800b75e0 con 0x7f8688103960 2024-09-13T15:57:08.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:08 smithi189 ceph-mon[34790]: pgmap v367: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:57:08.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.703+0000 7f868f200640 1 -- 172.21.15.17:0/1451126632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8688111cd0 con 0x7f8688103960 2024-09-13T15:57:08.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.704+0000 7f8685600640 1 -- 172.21.15.17:0/1451126632 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+2907 (secure 0 0 0) 0x7f86800bac00 con 0x7f8688103960 2024-09-13T15:57:08.706 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-13T15:57:08.706 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T15:57:08.706 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T15:57:08.706 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-13T15:57:08.707 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:08.707 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-13T15:57:08.707 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-13T15:57:08.707 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 24 2024-09-13T15:57:08.707 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T15:57:08.708 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-13T15:54:52.929867+0000 2024-09-13T15:57:08.708 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-13T15:55:16.253229+0000 2024-09-13T15:57:08.708 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-13T15:57:08.708 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-13T15:57:08.708 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 300 2024-09-13T15:57:08.708 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-13T15:57:08.709 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-13T15:57:08.709 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-13T15:57:08.709 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-13T15:57:08.709 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-13T15:57:08.709 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 0 2024-09-13T15:57:08.710 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T15:57:08.710 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 3 2024-09-13T15:57:08.710 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1,2 2024-09-13T15:57:08.710 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=24578,1=24565,2=24553} 2024-09-13T15:57:08.710 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-09-13T15:57:08.710 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-13T15:57:08.711 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-13T15:57:08.711 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3,4] 2024-09-13T15:57:08.711 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-13T15:57:08.711 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data disabled 2024-09-13T15:57:08.711 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-13T15:57:08.711 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-13T15:57:08.712 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 0 2024-09-13T15:57:08.712 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b{0:24578} state up:active seq 3 addr [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T15:57:08.712 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c{0:24532} state up:standby-replay seq 1 addr [v2:172.21.15.193:6836/792056943,v1:172.21.15.193:6837/792056943] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T15:57:08.712 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.g{1:24565} state up:active seq 10 addr [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T15:57:08.712 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.h{1:24524} state up:standby-replay seq 1 addr [v2:172.21.15.189:6836/2079181485,v1:172.21.15.189:6837/2079181485] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T15:57:08.713 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.i{2:24553} state up:active seq 11 addr [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T15:57:08.713 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.f{2:24520} state up:standby-replay seq 1 addr [v2:172.21.15.193:6834/4049465204,v1:172.21.15.193:6835/4049465204] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T15:57:08.713 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:08.713 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:08.713 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-13T15:57:08.714 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:08.714 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d{-1:14466} state up:standby seq 1 addr [v2:172.21.15.17:6836/1730156534,v1:172.21.15.17:6837/1730156534] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T15:57:08.714 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a{-1:14529} state up:standby seq 1 addr [v2:172.21.15.17:6840/1295854211,v1:172.21.15.17:6841/1295854211] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T15:57:08.714 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.k{-1:24455} state up:standby seq 1 addr [v2:172.21.15.189:6832/3777024343,v1:172.21.15.189:6833/3777024343] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T15:57:08.714 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.l{-1:24457} state up:standby seq 1 addr [v2:172.21.15.193:6832/2264195842,v1:172.21.15.193:6833/2264195842] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T15:57:08.714 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.j{-1:24467} state up:standby seq 1 addr [v2:172.21.15.17:6834/2888593680,v1:172.21.15.17:6835/2888593680] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T15:57:08.715 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.e{-1:24497} state up:standby seq 1 addr [v2:172.21.15.189:6834/4135454212,v1:172.21.15.189:6835/4135454212] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T15:57:08.716 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-13T15:57:08.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.707+0000 7f868f200640 1 -- 172.21.15.17:0/1451126632 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f866c0a1130 msgr2=0x7f866c0a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:08.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.707+0000 7f868f200640 1 --2- 172.21.15.17:0/1451126632 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f866c0a1130 0x7f866c0a35f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8678009fc0 tx=0x7f8678005f90 comp rx=0 tx=0).stop 2024-09-13T15:57:08.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.707+0000 7f868f200640 1 -- 172.21.15.17:0/1451126632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8688103960 msgr2=0x7f86881a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:08.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.707+0000 7f868f200640 1 --2- 172.21.15.17:0/1451126632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8688103960 0x7f86881a38a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f868002aeb0 tx=0x7f8680003c20 comp rx=0 tx=0).stop 2024-09-13T15:57:08.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.707+0000 7f868f200640 1 -- 172.21.15.17:0/1451126632 shutdown_connections 2024-09-13T15:57:08.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.707+0000 7f868f200640 1 --2- 172.21.15.17:0/1451126632 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f866c0a1130 0x7f866c0a35f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:08.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.707+0000 7f868f200640 1 --2- 172.21.15.17:0/1451126632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8688103960 0x7f86881a38a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:08.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.707+0000 7f868f200640 1 --2- 172.21.15.17:0/1451126632 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8688100fb0 0x7f868819c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:08.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.707+0000 7f868f200640 1 --2- 172.21.15.17:0/1451126632 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86880fe660 0x7f868819c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:08.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.707+0000 7f868f200640 1 -- 172.21.15.17:0/1451126632 >> 172.21.15.17:0/1451126632 conn(0x7f86880fa470 msgr2=0x7f86880ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:08.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.707+0000 7f868f200640 1 -- 172.21.15.17:0/1451126632 shutdown_connections 2024-09-13T15:57:08.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:08.707+0000 7f868f200640 1 -- 172.21.15.17:0/1451126632 wait complete. 2024-09-13T15:57:08.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:08 smithi193 ceph-mon[35248]: pgmap v367: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:57:09.463 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:09 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1451126632' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T15:57:09.494 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-13T15:57:09.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:09 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1451126632' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T15:57:09.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:09 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1451126632' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T15:57:09.816 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:57:10.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:10 smithi017 ceph-mon[30494]: pgmap v368: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:57:10.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:10 smithi189 ceph-mon[34790]: pgmap v368: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:57:10.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:10 smithi193 ceph-mon[35248]: pgmap v368: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:57:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.729+0000 7f9b1f200640 1 -- 172.21.15.17:0/3733536758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b201017f0 msgr2=0x7f9b20108080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.729+0000 7f9b1f200640 1 --2- 172.21.15.17:0/3733536758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b201017f0 0x7f9b20108080 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9b18009ca0 tx=0x7f9b1802a8c0 comp rx=0 tx=0).stop 2024-09-13T15:57:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.729+0000 7f9b1f200640 1 -- 172.21.15.17:0/3733536758 shutdown_connections 2024-09-13T15:57:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.729+0000 7f9b1f200640 1 --2- 172.21.15.17:0/3733536758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b201017f0 0x7f9b20108080 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:11.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.729+0000 7f9b1f200640 1 --2- 172.21.15.17:0/3733536758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b20100e30 0x7f9b201012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:11.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.729+0000 7f9b1f200640 1 --2- 172.21.15.17:0/3733536758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b200ffc30 0x7f9b20100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:11.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.729+0000 7f9b1f200640 1 -- 172.21.15.17:0/3733536758 >> 172.21.15.17:0/3733536758 conn(0x7f9b200fb3c0 msgr2=0x7f9b200fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:11.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.729+0000 7f9b1f200640 1 -- 172.21.15.17:0/3733536758 shutdown_connections 2024-09-13T15:57:11.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.729+0000 7f9b1f200640 1 -- 172.21.15.17:0/3733536758 wait complete. 2024-09-13T15:57:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.730+0000 7f9b1f200640 1 Processor -- start 2024-09-13T15:57:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.730+0000 7f9b1f200640 1 -- start start 2024-09-13T15:57:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.731+0000 7f9b1f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b200ffc30 0x7f9b20197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.731+0000 7f9b1f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b20100e30 0x7f9b20198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.731+0000 7f9b1f200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b201017f0 0x7f9b2019f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.731+0000 7f9b1f200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2019f830 con 0x7f9b20100e30 2024-09-13T15:57:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.731+0000 7f9b1f200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2019f9a0 con 0x7f9b200ffc30 2024-09-13T15:57:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.731+0000 7f9b1f200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2019fb60 con 0x7f9b201017f0 2024-09-13T15:57:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.731+0000 7f9b17e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b20100e30 0x7f9b20198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.731+0000 7f9b1de00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b200ffc30 0x7f9b20197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.731+0000 7f9b1de00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b200ffc30 0x7f9b20197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:58042/0 (socket says 172.21.15.17:58042) 2024-09-13T15:57:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.731+0000 7f9b1de00640 1 -- 172.21.15.17:0/1430981204 learned_addr learned my addr 172.21.15.17:0/1430981204 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.731+0000 7f9b17e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b20100e30 0x7f9b20198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52798/0 (socket says 172.21.15.17:52798) 2024-09-13T15:57:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.731+0000 7f9b1e800640 1 --2- 172.21.15.17:0/1430981204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b201017f0 0x7f9b2019f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.731+0000 7f9b17e00640 1 -- 172.21.15.17:0/1430981204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b201017f0 msgr2=0x7f9b2019f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.731+0000 7f9b17e00640 1 --2- 172.21.15.17:0/1430981204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b201017f0 0x7f9b2019f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.731+0000 7f9b17e00640 1 -- 172.21.15.17:0/1430981204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b200ffc30 msgr2=0x7f9b20197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.731+0000 7f9b17e00640 1 --2- 172.21.15.17:0/1430981204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b200ffc30 0x7f9b20197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.731+0000 7f9b17e00640 1 -- 172.21.15.17:0/1430981204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b18009900 con 0x7f9b20100e30 2024-09-13T15:57:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.732+0000 7f9b17e00640 1 --2- 172.21.15.17:0/1430981204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b20100e30 0x7f9b20198270 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800e9f0 tx=0x7f9b0800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:11.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.732+0000 7f9b16a00640 1 -- 172.21.15.17:0/1430981204 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0800ccc0 con 0x7f9b20100e30 2024-09-13T15:57:11.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.732+0000 7f9b16a00640 1 -- 172.21.15.17:0/1430981204 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b0800ce20 con 0x7f9b20100e30 2024-09-13T15:57:11.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.732+0000 7f9b1f200640 1 -- 172.21.15.17:0/1430981204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b2019fe40 con 0x7f9b20100e30 2024-09-13T15:57:11.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.732+0000 7f9b16a00640 1 -- 172.21.15.17:0/1430981204 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b080187e0 con 0x7f9b20100e30 2024-09-13T15:57:11.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.732+0000 7f9b1f200640 1 -- 172.21.15.17:0/1430981204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b201a02b0 con 0x7f9b20100e30 2024-09-13T15:57:11.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.733+0000 7f9b1f200640 1 -- 172.21.15.17:0/1430981204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2010b4d0 con 0x7f9b20100e30 2024-09-13T15:57:11.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.735+0000 7f9b16a00640 1 -- 172.21.15.17:0/1430981204 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9b08010430 con 0x7f9b20100e30 2024-09-13T15:57:11.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.737+0000 7f9b16a00640 1 --2- 172.21.15.17:0/1430981204 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9b040a10a0 0x7f9b040a3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:11.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.737+0000 7f9b16a00640 1 -- 172.21.15.17:0/1430981204 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f9b08014070 con 0x7f9b20100e30 2024-09-13T15:57:11.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.737+0000 7f9b1de00640 1 --2- 172.21.15.17:0/1430981204 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9b040a10a0 0x7f9b040a3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:11.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.738+0000 7f9b1de00640 1 --2- 172.21.15.17:0/1430981204 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9b040a10a0 0x7f9b040a3560 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000bc80 tx=0x7f9b1000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:11.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.740+0000 7f9b16a00640 1 -- 172.21.15.17:0/1430981204 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9b08052e20 con 0x7f9b20100e30 2024-09-13T15:57:11.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.923+0000 7f9b1f200640 1 -- 172.21.15.17:0/1430981204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f9b201a04a0 con 0x7f9b20100e30 2024-09-13T15:57:11.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.924+0000 7f9b16a00640 1 -- 172.21.15.17:0/1430981204 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v94) v1 ==== 56+0+5649 (secure 0 0 0) 0x7f9b08096370 con 0x7f9b20100e30 2024-09-13T15:57:11.926 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 94 2024-09-13T15:57:11.926 INFO:teuthology.orchestra.run.smithi017.stdout:fsid 3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T15:57:11.926 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-13T15:46:50.475750+0000 2024-09-13T15:57:11.926 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-13T15:56:44.228817+0000 2024-09-13T15:57:11.926 INFO:teuthology.orchestra.run.smithi017.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-13T15:57:11.927 INFO:teuthology.orchestra.run.smithi017.stdout:crush_version 27 2024-09-13T15:57:11.927 INFO:teuthology.orchestra.run.smithi017.stdout:full_ratio 0.95 2024-09-13T15:57:11.927 INFO:teuthology.orchestra.run.smithi017.stdout:backfillfull_ratio 0.9 2024-09-13T15:57:11.927 INFO:teuthology.orchestra.run.smithi017.stdout:nearfull_ratio 0.85 2024-09-13T15:57:11.927 INFO:teuthology.orchestra.run.smithi017.stdout:require_min_compat_client luminous 2024-09-13T15:57:11.927 INFO:teuthology.orchestra.run.smithi017.stdout:min_compat_client luminous 2024-09-13T15:57:11.927 INFO:teuthology.orchestra.run.smithi017.stdout:require_osd_release reef 2024-09-13T15:57:11.927 INFO:teuthology.orchestra.run.smithi017.stdout:stretch_mode_enabled false 2024-09-13T15:57:11.927 INFO:teuthology.orchestra.run.smithi017.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-13T15:57:11.927 INFO:teuthology.orchestra.run.smithi017.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-13T15:57:11.927 INFO:teuthology.orchestra.run.smithi017.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 86 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-13T15:57:11.927 INFO:teuthology.orchestra.run.smithi017.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 90 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-13T15:57:11.927 INFO:teuthology.orchestra.run.smithi017.stdout:max_osd 12 2024-09-13T15:57:11.928 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 up in weight 1 up_from 8 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6802/158651212,v1:172.21.15.17:6803/158651212] [v2:172.21.15.17:6804/158651212,v1:172.21.15.17:6805/158651212] exists,up 5d39d6af-15e6-463b-b9ff-a9a5dd94e839 2024-09-13T15:57:11.928 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 up in weight 1 up_from 13 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6800/964319421,v1:172.21.15.189:6801/964319421] [v2:172.21.15.189:6802/964319421,v1:172.21.15.189:6803/964319421] exists,up 0da621c7-645b-44ae-ba7c-a573861c3aae 2024-09-13T15:57:11.928 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 up in weight 1 up_from 18 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6800/138468002,v1:172.21.15.193:6801/138468002] [v2:172.21.15.193:6802/138468002,v1:172.21.15.193:6803/138468002] exists,up fa95af60-1486-4a29-8c79-8a73a4146552 2024-09-13T15:57:11.928 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 up in weight 1 up_from 26 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6810/919913803,v1:172.21.15.17:6811/919913803] [v2:172.21.15.17:6812/919913803,v1:172.21.15.17:6813/919913803] exists,up 90428e5f-dfd4-4cda-b240-fdb9079bcb7f 2024-09-13T15:57:11.928 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 up in weight 1 up_from 34 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6808/2310375565,v1:172.21.15.189:6809/2310375565] [v2:172.21.15.189:6810/2310375565,v1:172.21.15.189:6811/2310375565] exists,up e1c537b6-98d2-4b66-b15a-65fe70b0ce25 2024-09-13T15:57:11.928 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 up in weight 1 up_from 39 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6808/1330877824,v1:172.21.15.193:6809/1330877824] [v2:172.21.15.193:6810/1330877824,v1:172.21.15.193:6811/1330877824] exists,up 48522fd7-d781-4447-873f-174dabd1e33a 2024-09-13T15:57:11.928 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 up in weight 1 up_from 47 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6818/3930545382,v1:172.21.15.17:6819/3930545382] [v2:172.21.15.17:6820/3930545382,v1:172.21.15.17:6821/3930545382] exists,up 47bea191-fb53-40a7-8563-8ebf17dd5bf7 2024-09-13T15:57:11.928 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 up in weight 1 up_from 52 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6816/3691677495,v1:172.21.15.189:6817/3691677495] [v2:172.21.15.189:6818/3691677495,v1:172.21.15.189:6819/3691677495] exists,up a98f36f9-0a19-4c9a-8ed1-615c4a6e7658 2024-09-13T15:57:11.928 INFO:teuthology.orchestra.run.smithi017.stdout:osd.8 up in weight 1 up_from 60 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6816/4112907498,v1:172.21.15.193:6817/4112907498] [v2:172.21.15.193:6818/4112907498,v1:172.21.15.193:6819/4112907498] exists,up 7a372d9f-c40f-4ead-87da-2f3a570c1373 2024-09-13T15:57:11.928 INFO:teuthology.orchestra.run.smithi017.stdout:osd.9 up in weight 1 up_from 68 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6826/663424274,v1:172.21.15.17:6827/663424274] [v2:172.21.15.17:6828/663424274,v1:172.21.15.17:6829/663424274] exists,up ac3d983c-c5e7-456b-8271-7c4e6169de61 2024-09-13T15:57:11.928 INFO:teuthology.orchestra.run.smithi017.stdout:osd.10 up in weight 1 up_from 73 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6824/3153990375,v1:172.21.15.189:6825/3153990375] [v2:172.21.15.189:6826/3153990375,v1:172.21.15.189:6827/3153990375] exists,up 08dcae02-6c79-4a06-ae88-6eb6e6941cc0 2024-09-13T15:57:11.928 INFO:teuthology.orchestra.run.smithi017.stdout:osd.11 up in weight 1 up_from 81 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6824/4088053907,v1:172.21.15.193:6825/4088053907] [v2:172.21.15.193:6826/4088053907,v1:172.21.15.193:6827/4088053907] exists,up a4ebcf41-d805-4d44-b112-13ae84d51868 2024-09-13T15:57:11.928 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.a [2,11] 2024-09-13T15:57:11.929 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.10 [8,11] 2024-09-13T15:57:11.929 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.14 [2,4] 2024-09-13T15:57:11.929 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.e [5,9] 2024-09-13T15:57:11.929 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.1d [4,6] 2024-09-13T15:57:11.929 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.23 [4,7] 2024-09-13T15:57:11.929 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.27 [4,8,3,9] 2024-09-13T15:57:11.929 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.33 [5,9] 2024-09-13T15:57:11.929 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 4.e [5,8] 2024-09-13T15:57:11.929 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 4.16 [9,8] 2024-09-13T15:57:11.929 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 4.17 [9,8] 2024-09-13T15:57:11.929 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 4.1f [9,10] 2024-09-13T15:57:11.929 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6801/386837955 expires 2024-09-14T15:47:42.048005+0000 2024-09-13T15:57:11.929 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/1550067038 expires 2024-09-14T15:47:42.048005+0000 2024-09-13T15:57:11.929 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/3360683829 expires 2024-09-14T15:47:42.048005+0000 2024-09-13T15:57:11.929 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/634066188 expires 2024-09-14T15:47:42.048005+0000 2024-09-13T15:57:11.930 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6801/1047258336 expires 2024-09-14T15:47:14.996424+0000 2024-09-13T15:57:11.930 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6800/1047258336 expires 2024-09-14T15:47:14.996424+0000 2024-09-13T15:57:11.930 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/1945536687 expires 2024-09-14T15:47:14.996424+0000 2024-09-13T15:57:11.930 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6800/386837955 expires 2024-09-14T15:47:42.048005+0000 2024-09-13T15:57:11.930 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/2214214377 expires 2024-09-14T15:47:14.996424+0000 2024-09-13T15:57:11.930 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/1224386591 expires 2024-09-14T15:47:14.996424+0000 2024-09-13T15:57:11.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.927+0000 7f9b1f200640 1 -- 172.21.15.17:0/1430981204 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9b040a10a0 msgr2=0x7f9b040a3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:11.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.927+0000 7f9b1f200640 1 --2- 172.21.15.17:0/1430981204 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9b040a10a0 0x7f9b040a3560 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000bc80 tx=0x7f9b1000b410 comp rx=0 tx=0).stop 2024-09-13T15:57:11.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.927+0000 7f9b1f200640 1 -- 172.21.15.17:0/1430981204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b20100e30 msgr2=0x7f9b20198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:11.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.927+0000 7f9b1f200640 1 --2- 172.21.15.17:0/1430981204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b20100e30 0x7f9b20198270 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800e9f0 tx=0x7f9b0800eeb0 comp rx=0 tx=0).stop 2024-09-13T15:57:11.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.927+0000 7f9b1f200640 1 -- 172.21.15.17:0/1430981204 shutdown_connections 2024-09-13T15:57:11.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.927+0000 7f9b1f200640 1 --2- 172.21.15.17:0/1430981204 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9b040a10a0 0x7f9b040a3560 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:11.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.927+0000 7f9b1f200640 1 --2- 172.21.15.17:0/1430981204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b201017f0 0x7f9b2019f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:11.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.927+0000 7f9b1f200640 1 --2- 172.21.15.17:0/1430981204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b20100e30 0x7f9b20198270 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:11.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.927+0000 7f9b1f200640 1 --2- 172.21.15.17:0/1430981204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b200ffc30 0x7f9b20197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:11.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.927+0000 7f9b1f200640 1 -- 172.21.15.17:0/1430981204 >> 172.21.15.17:0/1430981204 conn(0x7f9b200fb3c0 msgr2=0x7f9b200726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:11.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.927+0000 7f9b1f200640 1 -- 172.21.15.17:0/1430981204 shutdown_connections 2024-09-13T15:57:11.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:11.927+0000 7f9b1f200640 1 -- 172.21.15.17:0/1430981204 wait complete. 2024-09-13T15:57:12.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:11 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1430981204' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-13T15:57:12.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:11 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1430981204' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-13T15:57:12.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:11 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1430981204' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-13T15:57:12.653 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-13T15:57:12.665 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:57:12.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.823+0000 7f9169e00640 1 -- 172.21.15.17:0/2141060321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9164103b50 msgr2=0x7f916410a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:12.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.823+0000 7f9169e00640 1 --2- 172.21.15.17:0/2141060321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9164103b50 0x7f916410a3e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f915c009ca0 tx=0x7f915c02a8b0 comp rx=0 tx=0).stop 2024-09-13T15:57:12.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.823+0000 7f9169e00640 1 -- 172.21.15.17:0/2141060321 shutdown_connections 2024-09-13T15:57:12.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.823+0000 7f9169e00640 1 --2- 172.21.15.17:0/2141060321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9164103b50 0x7f916410a3e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:12.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.823+0000 7f9169e00640 1 --2- 172.21.15.17:0/2141060321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9164103190 0x7f9164103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:12.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.823+0000 7f9169e00640 1 --2- 172.21.15.17:0/2141060321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9164101fa0 0x7f91641023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:12.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.823+0000 7f9169e00640 1 -- 172.21.15.17:0/2141060321 >> 172.21.15.17:0/2141060321 conn(0x7f91640fd700 msgr2=0x7f91640ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:12.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.823+0000 7f9169e00640 1 -- 172.21.15.17:0/2141060321 shutdown_connections 2024-09-13T15:57:12.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.823+0000 7f9169e00640 1 -- 172.21.15.17:0/2141060321 wait complete. 2024-09-13T15:57:12.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.824+0000 7f9169e00640 1 Processor -- start 2024-09-13T15:57:12.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.824+0000 7f9169e00640 1 -- start start 2024-09-13T15:57:12.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.825+0000 7f9169e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9164101fa0 0x7f9164197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:12.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.825+0000 7f9169e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9164103190 0x7f9164198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:12.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.825+0000 7f9169e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9164103b50 0x7f916419f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:12.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.825+0000 7f9169e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916419f9e0 con 0x7f9164103b50 2024-09-13T15:57:12.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.825+0000 7f9169e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916419fb50 con 0x7f9164101fa0 2024-09-13T15:57:12.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.825+0000 7f9169e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916419fd10 con 0x7f9164103190 2024-09-13T15:57:12.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.825+0000 7f9163400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9164103b50 0x7f916419f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:12.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.825+0000 7f9163400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9164103b50 0x7f916419f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52808/0 (socket says 172.21.15.17:52808) 2024-09-13T15:57:12.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.825+0000 7f9163400640 1 -- 172.21.15.17:0/3052412435 learned_addr learned my addr 172.21.15.17:0/3052412435 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:12.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.825+0000 7f9162a00640 1 --2- 172.21.15.17:0/3052412435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9164101fa0 0x7f9164197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:12.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.825+0000 7f9162000640 1 --2- 172.21.15.17:0/3052412435 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9164103190 0x7f9164198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:12.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.825+0000 7f9163400640 1 -- 172.21.15.17:0/3052412435 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9164103190 msgr2=0x7f9164198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:12.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.825+0000 7f9163400640 1 --2- 172.21.15.17:0/3052412435 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9164103190 0x7f9164198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:12.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.825+0000 7f9163400640 1 -- 172.21.15.17:0/3052412435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9164101fa0 msgr2=0x7f9164197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:12.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.825+0000 7f9163400640 1 --2- 172.21.15.17:0/3052412435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9164101fa0 0x7f9164197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:12.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.825+0000 7f9163400640 1 -- 172.21.15.17:0/3052412435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915c009900 con 0x7f9164103b50 2024-09-13T15:57:12.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.825+0000 7f9162a00640 1 --2- 172.21.15.17:0/3052412435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9164101fa0 0x7f9164197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:57:12.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.826+0000 7f9163400640 1 --2- 172.21.15.17:0/3052412435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9164103b50 0x7f916419f4a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f915c02aea0 tx=0x7f915c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:12.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.826+0000 7f9168a00640 1 -- 172.21.15.17:0/3052412435 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c004450 con 0x7f9164103b50 2024-09-13T15:57:12.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.826+0000 7f9168a00640 1 -- 172.21.15.17:0/3052412435 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f915c003e40 con 0x7f9164103b50 2024-09-13T15:57:12.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.826+0000 7f9168a00640 1 -- 172.21.15.17:0/3052412435 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c045e70 con 0x7f9164103b50 2024-09-13T15:57:12.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.826+0000 7f9169e00640 1 -- 172.21.15.17:0/3052412435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916419ff90 con 0x7f9164103b50 2024-09-13T15:57:12.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.826+0000 7f9169e00640 1 -- 172.21.15.17:0/3052412435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91641a03c0 con 0x7f9164103b50 2024-09-13T15:57:12.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.827+0000 7f9169e00640 1 -- 172.21.15.17:0/3052412435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9164109390 con 0x7f9164103b50 2024-09-13T15:57:12.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.829+0000 7f9168a00640 1 -- 172.21.15.17:0/3052412435 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f915c042070 con 0x7f9164103b50 2024-09-13T15:57:12.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.830+0000 7f9168a00640 1 --2- 172.21.15.17:0/3052412435 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f91480a1110 0x7f91480a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:12.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.830+0000 7f9168a00640 1 -- 172.21.15.17:0/3052412435 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f915c0ee080 con 0x7f9164103b50 2024-09-13T15:57:12.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.831+0000 7f9162a00640 1 --2- 172.21.15.17:0/3052412435 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f91480a1110 0x7f91480a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:12.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.831+0000 7f9162a00640 1 --2- 172.21.15.17:0/3052412435 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f91480a1110 0x7f91480a35d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9164102ff0 tx=0x7f9154005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:12.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:12.834+0000 7f9168a00640 1 -- 172.21.15.17:0/3052412435 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f915c0b7580 con 0x7f9164103b50 2024-09-13T15:57:13.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.022+0000 7f9169e00640 1 -- 172.21.15.17:0/3052412435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f916402c410 con 0x7f9164103b50 2024-09-13T15:57:13.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.023+0000 7f9168a00640 1 -- 172.21.15.17:0/3052412435 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24575 (secure 0 0 0) 0x7f915c0baba0 con 0x7f9164103b50 2024-09-13T15:57:13.026 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:13.026 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":94,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","created":"2024-09-13T15:46:50.475750+0000","modified":"2024-09-13T15:56:44.228817+0000","last_up_change":"2024-09-13T15:53:59.138985+0000","last_in_change":"2024-09-13T15:53:39.220264+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:50:10.657011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:54:51.436469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:54:52.427930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:54:55.478058+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5d39d6af-15e6-463b-b9ff-a9a5dd94e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6803","nonce":158651212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6805","nonce":158651212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6809","nonce":158651212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6807","nonce":158651212}]},"public_addr":"172.21.15.17:6803/158651212","cluster_addr":"172.21.15.17:6805/158651212","heartbeat_back_addr":"172.21.15.17:6809/158651212","heartbeat_front_addr":"172.21.15.17:6807/158651212","state":["exists","up"]},{"osd":1,"uuid":"0da621c7-645b-44ae-ba7c-a573861c3aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6801","nonce":964319421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6803","nonce":964319421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6807","nonce":964319421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6805","nonce":964319421}]},"public_addr":"172.21.15.189:6801/964319421","cluster_addr":"172.21.15.189:6803/964319421","heartbeat_back_addr":"172.21.15.189:6807/964319421","heartbeat_front_addr":"172.21.15.189:6805/964319421","state":["exists","up"]},{"osd":2,"uuid":"fa95af60-1486-4a29-8c79-8a73a4146552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6801","nonce":138468002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6803","nonce":138468002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6807","nonce":138468002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6805","nonce":138468002}]},"public_addr":"172.21.15.193:6801/138468002","cluster_addr":"172.21.15.193:6803/138468002","heartbeat_back_addr":"172.21.15.193:6807/138468002","heartbeat_front_addr":"172.21.15.193:6805/138468002","state":["exists","up"]},{"osd":3,"uuid":"90428e5f-dfd4-4cda-b240-fdb9079bcb7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6811","nonce":919913803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6813","nonce":919913803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6817","nonce":919913803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6815","nonce":919913803}]},"public_addr":"172.21.15.17:6811/919913803","cluster_addr":"172.21.15.17:6813/919913803","heartbeat_back_addr":"172.21.15.17:6817/919913803","heartbeat_front_addr":"172.21.15.17:6815/919913803","state":["exists","up"]},{"osd":4,"uuid":"e1c537b6-98d2-4b66-b15a-65fe70b0ce25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6809","nonce":2310375565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6811","nonce":2310375565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6815","nonce":2310375565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6813","nonce":2310375565}]},"public_addr":"172.21.15.189:6809/2310375565","cluster_addr":"172.21.15.189:6811/2310375565","heartbeat_back_addr":"172.21.15.189:6815/2310375565","heartbeat_front_addr":"172.21.15.189:6813/2310375565","state":["exists","up"]},{"osd":5,"uuid":"48522fd7-d781-4447-873f-174dabd1e33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6809","nonce":1330877824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6811","nonce":1330877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6815","nonce":1330877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6813","nonce":1330877824}]},"public_addr":"172.21.15.193:6809/1330877824","cluster_addr":"172.21.15.193:6811/1330877824","heartbeat_back_addr":"172.21.15.193:6815/1330877824","heartbeat_front_addr":"172.21.15.193:6813/1330877824","state":["exists","up"]},{"osd":6,"uuid":"47bea191-fb53-40a7-8563-8ebf17dd5bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6819","nonce":3930545382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6821","nonce":3930545382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6825","nonce":3930545382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6823","nonce":3930545382}]},"public_addr":"172.21.15.17:6819/3930545382","cluster_addr":"172.21.15.17:6821/3930545382","heartbeat_back_addr":"172.21.15.17:6825/3930545382","heartbeat_front_addr":"172.21.15.17:6823/3930545382","state":["exists","up"]},{"osd":7,"uuid":"a98f36f9-0a19-4c9a-8ed1-615c4a6e7658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6817","nonce":3691677495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6819","nonce":3691677495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6823","nonce":3691677495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6821","nonce":3691677495}]},"public_addr":"172.21.15.189:6817/3691677495","cluster_addr":"172.21.15.189:6819/3691677495","heartbeat_back_addr":"172.21.15.189:6823/3691677495","heartbeat_front_addr":"172.21.15.189:6821/3691677495","state":["exists","up"]},{"osd":8,"uuid":"7a372d9f-c40f-4ead-87da-2f3a570c1373","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6817","nonce":4112907498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6819","nonce":4112907498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6823","nonce":4112907498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6821","nonce":4112907498}]},"public_addr":"172.21.15.193:6817/4112907498","cluster_addr":"172.21.15.193:6819/4112907498","heartbeat_back_addr":"172.21.15.193:6823/4112907498","heartbeat_front_addr":"172.21.15.193:6821/4112907498","state":["exists","up"]},{"osd":9,"uuid":"ac3d983c-c5e7-456b-8271-7c4e6169de61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6827","nonce":663424274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6829","nonce":663424274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6833","nonce":663424274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6831","nonce":663424274}]},"public_addr":"172.21.15.17:6827/663424274","cluster_addr":"172.21.15.17:6829/663424274","heartbeat_back_addr":"172.21.15.17:6833/663424274","heartbeat_front_addr":"172.21.15.17:6831/663424274","state":["exists","up"]},{"osd":10,"uuid":"08dcae02-6c79-4a06-ae88-6eb6e6941cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6825","nonce":3153990375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6827","nonce":3153990375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6831","nonce":3153990375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6829","nonce":3153990375}]},"public_addr":"172.21.15.189:6825/3153990375","cluster_addr":"172.21.15.189:6827/3153990375","heartbeat_back_addr":"172.21.15.189:6831/3153990375","heartbeat_front_addr":"172.21.15.189:6829/3153990375","state":["exists","up"]},{"osd":11,"uuid":"a4ebcf41-d805-4d44-b112-13ae84d51868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6825","nonce":4088053907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6827","nonce":4088053907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6831","nonce":4088053907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6829","nonce":4088053907}]},"public_addr":"172.21.15.193:6825/4088053907","cluster_addr":"172.21.15.193:6827/4088053907","heartbeat_back_addr":"172.21.15.193:6831/4088053907","heartbeat_front_addr":"172.21.15.193:6829/4088053907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:22.172370+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:44.802224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:06.641435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:34.536515+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:58.789324+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:22.189862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:50.382257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:14.678047+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:38.581105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:07.258150+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:32.261383+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:56.739338+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8},{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/1550067038":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/3360683829":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/634066188":"2024-09-14T15:47:42.048005+0000","172.21.15.17:6801/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1945536687":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/2214214377":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1224386591":"2024-09-14T15:47:14.996424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:57:13.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.026+0000 7f9169e00640 1 -- 172.21.15.17:0/3052412435 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f91480a1110 msgr2=0x7f91480a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:13.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.026+0000 7f9169e00640 1 --2- 172.21.15.17:0/3052412435 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f91480a1110 0x7f91480a35d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9164102ff0 tx=0x7f9154005f90 comp rx=0 tx=0).stop 2024-09-13T15:57:13.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.026+0000 7f9169e00640 1 -- 172.21.15.17:0/3052412435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9164103b50 msgr2=0x7f916419f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:13.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.026+0000 7f9169e00640 1 --2- 172.21.15.17:0/3052412435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9164103b50 0x7f916419f4a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f915c02aea0 tx=0x7f915c003c20 comp rx=0 tx=0).stop 2024-09-13T15:57:13.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.026+0000 7f9169e00640 1 -- 172.21.15.17:0/3052412435 shutdown_connections 2024-09-13T15:57:13.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.026+0000 7f9169e00640 1 --2- 172.21.15.17:0/3052412435 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f91480a1110 0x7f91480a35d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.026+0000 7f9169e00640 1 --2- 172.21.15.17:0/3052412435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9164103b50 0x7f916419f4a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.026+0000 7f9169e00640 1 --2- 172.21.15.17:0/3052412435 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9164103190 0x7f9164198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.026+0000 7f9169e00640 1 --2- 172.21.15.17:0/3052412435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9164101fa0 0x7f9164197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.026+0000 7f9169e00640 1 -- 172.21.15.17:0/3052412435 >> 172.21.15.17:0/3052412435 conn(0x7f91640fd700 msgr2=0x7f9164106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:13.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.026+0000 7f9169e00640 1 -- 172.21.15.17:0/3052412435 shutdown_connections 2024-09-13T15:57:13.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.026+0000 7f9169e00640 1 -- 172.21.15.17:0/3052412435 wait complete. 2024-09-13T15:57:13.044 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:50:10.657011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:54:51.436469+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:54:52.427930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:54:55.478058+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:57:13.045 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:57:13.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.205+0000 7f4032c00640 1 -- 172.21.15.17:0/3960771382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f402c1074b0 msgr2=0x7f402c107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:13.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.205+0000 7f4032c00640 1 --2- 172.21.15.17:0/3960771382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f402c1074b0 0x7f402c107930 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4018009930 tx=0x7f401802a420 comp rx=0 tx=0).stop 2024-09-13T15:57:13.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.205+0000 7f4032c00640 1 -- 172.21.15.17:0/3960771382 shutdown_connections 2024-09-13T15:57:13.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.205+0000 7f4032c00640 1 --2- 172.21.15.17:0/3960771382 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f402c107e70 0x7f402c112c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.205+0000 7f4032c00640 1 --2- 172.21.15.17:0/3960771382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f402c1074b0 0x7f402c107930 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.205+0000 7f4032c00640 1 --2- 172.21.15.17:0/3960771382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f402c071500 0x7f402c071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.205+0000 7f4032c00640 1 -- 172.21.15.17:0/3960771382 >> 172.21.15.17:0/3960771382 conn(0x7f402c06cfd0 msgr2=0x7f402c06f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:13.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.205+0000 7f4032c00640 1 -- 172.21.15.17:0/3960771382 shutdown_connections 2024-09-13T15:57:13.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.205+0000 7f4032c00640 1 -- 172.21.15.17:0/3960771382 wait complete. 2024-09-13T15:57:13.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.206+0000 7f4032c00640 1 Processor -- start 2024-09-13T15:57:13.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.206+0000 7f4032c00640 1 -- start start 2024-09-13T15:57:13.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.206+0000 7f4032c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f402c071500 0x7f402c1a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:13.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.206+0000 7f4032c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f402c1074b0 0x7f402c1a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:13.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.206+0000 7f4032c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f402c107e70 0x7f402c1a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:13.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.206+0000 7f4032c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c1a81e0 con 0x7f402c107e70 2024-09-13T15:57:13.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.206+0000 7f4032c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c1a8350 con 0x7f402c071500 2024-09-13T15:57:13.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.206+0000 7f4032c00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c1a8510 con 0x7f402c1074b0 2024-09-13T15:57:13.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.207+0000 7f4032200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f402c107e70 0x7f402c1a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:13.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.207+0000 7f4030e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f402c1074b0 0x7f402c1a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:13.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.207+0000 7f4031800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f402c071500 0x7f402c1a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:13.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.207+0000 7f4032200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f402c107e70 0x7f402c1a7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52828/0 (socket says 172.21.15.17:52828) 2024-09-13T15:57:13.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.207+0000 7f4030e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f402c1074b0 0x7f402c1a0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:45654/0 (socket says 172.21.15.17:45654) 2024-09-13T15:57:13.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.207+0000 7f4032200640 1 -- 172.21.15.17:0/4230888679 learned_addr learned my addr 172.21.15.17:0/4230888679 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:13.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.207+0000 7f4031800640 1 --2- 172.21.15.17:0/4230888679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f402c071500 0x7f402c1a0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:58092/0 (socket says 172.21.15.17:58092) 2024-09-13T15:57:13.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.207+0000 7f4031800640 1 -- 172.21.15.17:0/4230888679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f402c1074b0 msgr2=0x7f402c1a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:13.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.207+0000 7f4031800640 1 --2- 172.21.15.17:0/4230888679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f402c1074b0 0x7f402c1a0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.207+0000 7f4031800640 1 -- 172.21.15.17:0/4230888679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f402c107e70 msgr2=0x7f402c1a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:13.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.207+0000 7f4031800640 1 --2- 172.21.15.17:0/4230888679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f402c107e70 0x7f402c1a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.207+0000 7f4031800640 1 -- 172.21.15.17:0/4230888679 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4018009560 con 0x7f402c071500 2024-09-13T15:57:13.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.207+0000 7f4032200640 1 --2- 172.21.15.17:0/4230888679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f402c107e70 0x7f402c1a7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:57:13.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.207+0000 7f4031800640 1 --2- 172.21.15.17:0/4230888679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f402c071500 0x7f402c1a0740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f402000e9c0 tx=0x7f402000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:13.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.208+0000 7f402a000640 1 -- 172.21.15.17:0/4230888679 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402000ccc0 con 0x7f402c071500 2024-09-13T15:57:13.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.208+0000 7f402a000640 1 -- 172.21.15.17:0/4230888679 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f40200044f0 con 0x7f402c071500 2024-09-13T15:57:13.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.208+0000 7f402a000640 1 -- 172.21.15.17:0/4230888679 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4020010430 con 0x7f402c071500 2024-09-13T15:57:13.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.208+0000 7f4032c00640 1 -- 172.21.15.17:0/4230888679 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f402c1a87f0 con 0x7f402c071500 2024-09-13T15:57:13.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.208+0000 7f4032c00640 1 -- 172.21.15.17:0/4230888679 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402c1a8c80 con 0x7f402c071500 2024-09-13T15:57:13.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.209+0000 7f4032c00640 1 -- 172.21.15.17:0/4230888679 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f402c115f80 con 0x7f402c071500 2024-09-13T15:57:13.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.211+0000 7f402a000640 1 -- 172.21.15.17:0/4230888679 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4020003f30 con 0x7f402c071500 2024-09-13T15:57:13.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.212+0000 7f402a000640 1 --2- 172.21.15.17:0/4230888679 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f40140a1090 0x7f40140a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:13.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.212+0000 7f402a000640 1 -- 172.21.15.17:0/4230888679 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f4020014070 con 0x7f402c071500 2024-09-13T15:57:13.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.212+0000 7f4030e00640 1 --2- 172.21.15.17:0/4230888679 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f40140a1090 0x7f40140a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:13.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.213+0000 7f4030e00640 1 --2- 172.21.15.17:0/4230888679 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f40140a1090 0x7f40140a3550 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4018031500 tx=0x7f4018005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:13.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.214+0000 7f402a000640 1 -- 172.21.15.17:0/4230888679 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f40200967a0 con 0x7f402c071500 2024-09-13T15:57:13.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:12 smithi193 ceph-mon[35248]: pgmap v369: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:57:13.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:12 smithi017 ceph-mon[30494]: pgmap v369: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:57:13.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:12 smithi189 ceph-mon[34790]: pgmap v369: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:57:13.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.394+0000 7f4032c00640 1 -- 172.21.15.17:0/4230888679 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f402c1a8f00 con 0x7f402c071500 2024-09-13T15:57:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.395+0000 7f402a000640 1 -- 172.21.15.17:0/4230888679 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4020099dc0 con 0x7f402c071500 2024-09-13T15:57:13.396 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-13T15:57:13.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.397+0000 7f4032c00640 1 -- 172.21.15.17:0/4230888679 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f40140a1090 msgr2=0x7f40140a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:13.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.397+0000 7f4032c00640 1 --2- 172.21.15.17:0/4230888679 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f40140a1090 0x7f40140a3550 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4018031500 tx=0x7f4018005780 comp rx=0 tx=0).stop 2024-09-13T15:57:13.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.397+0000 7f4032c00640 1 -- 172.21.15.17:0/4230888679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f402c071500 msgr2=0x7f402c1a0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.397+0000 7f4032c00640 1 --2- 172.21.15.17:0/4230888679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f402c071500 0x7f402c1a0740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f402000e9c0 tx=0x7f402000ee80 comp rx=0 tx=0).stop 2024-09-13T15:57:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.397+0000 7f4032c00640 1 -- 172.21.15.17:0/4230888679 shutdown_connections 2024-09-13T15:57:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.397+0000 7f4032c00640 1 --2- 172.21.15.17:0/4230888679 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f40140a1090 0x7f40140a3550 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.397+0000 7f4032c00640 1 --2- 172.21.15.17:0/4230888679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f402c107e70 0x7f402c1a7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.397+0000 7f4032c00640 1 --2- 172.21.15.17:0/4230888679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f402c1074b0 0x7f402c1a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.397+0000 7f4032c00640 1 --2- 172.21.15.17:0/4230888679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f402c071500 0x7f402c1a0740 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.397+0000 7f4032c00640 1 -- 172.21.15.17:0/4230888679 >> 172.21.15.17:0/4230888679 conn(0x7f402c06cfd0 msgr2=0x7f402c06dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.397+0000 7f4032c00640 1 -- 172.21.15.17:0/4230888679 shutdown_connections 2024-09-13T15:57:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.397+0000 7f4032c00640 1 -- 172.21.15.17:0/4230888679 wait complete. 2024-09-13T15:57:13.415 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:57:13.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.574+0000 7f061f200640 1 -- 172.21.15.17:0/2464901905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0620101890 msgr2=0x7f0620108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:13.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.574+0000 7f061f200640 1 --2- 172.21.15.17:0/2464901905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0620101890 0x7f0620108120 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0618009ca0 tx=0x7f061802a8c0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.574+0000 7f061f200640 1 -- 172.21.15.17:0/2464901905 shutdown_connections 2024-09-13T15:57:13.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.574+0000 7f061f200640 1 --2- 172.21.15.17:0/2464901905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0620101890 0x7f0620108120 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.574+0000 7f061f200640 1 --2- 172.21.15.17:0/2464901905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0620100ed0 0x7f0620101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.574+0000 7f061f200640 1 --2- 172.21.15.17:0/2464901905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06200ffce0 0x7f06201000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.574+0000 7f061f200640 1 -- 172.21.15.17:0/2464901905 >> 172.21.15.17:0/2464901905 conn(0x7f06200fb480 msgr2=0x7f06200fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:13.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.574+0000 7f061f200640 1 -- 172.21.15.17:0/2464901905 shutdown_connections 2024-09-13T15:57:13.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.574+0000 7f061f200640 1 -- 172.21.15.17:0/2464901905 wait complete. 2024-09-13T15:57:13.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.575+0000 7f061f200640 1 Processor -- start 2024-09-13T15:57:13.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.575+0000 7f061f200640 1 -- start start 2024-09-13T15:57:13.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.575+0000 7f061f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06200ffce0 0x7f0620074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:13.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.575+0000 7f061f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0620100ed0 0x7f06200728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:13.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.575+0000 7f061f200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0620101890 0x7f0620072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:13.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.575+0000 7f061f200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0620073540 con 0x7f0620100ed0 2024-09-13T15:57:13.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.575+0000 7f061f200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06200736b0 con 0x7f06200ffce0 2024-09-13T15:57:13.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.575+0000 7f061f200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062019fce0 con 0x7f0620101890 2024-09-13T15:57:13.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.575+0000 7f0617e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0620100ed0 0x7f06200728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:13.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.575+0000 7f061e800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0620101890 0x7f0620072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:13.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.575+0000 7f0617e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0620100ed0 0x7f06200728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52852/0 (socket says 172.21.15.17:52852) 2024-09-13T15:57:13.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.575+0000 7f061e800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0620101890 0x7f0620072de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:45682/0 (socket says 172.21.15.17:45682) 2024-09-13T15:57:13.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.575+0000 7f0617e00640 1 -- 172.21.15.17:0/1803586083 learned_addr learned my addr 172.21.15.17:0/1803586083 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:13.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.575+0000 7f061de00640 1 --2- 172.21.15.17:0/1803586083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06200ffce0 0x7f0620074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:13.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.576+0000 7f061e800640 1 -- 172.21.15.17:0/1803586083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06200ffce0 msgr2=0x7f0620074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:13.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.576+0000 7f061e800640 1 --2- 172.21.15.17:0/1803586083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06200ffce0 0x7f0620074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.576+0000 7f061e800640 1 -- 172.21.15.17:0/1803586083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0620100ed0 msgr2=0x7f06200728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:13.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.576+0000 7f061e800640 1 --2- 172.21.15.17:0/1803586083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0620100ed0 0x7f06200728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.576+0000 7f061e800640 1 -- 172.21.15.17:0/1803586083 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0618009900 con 0x7f0620101890 2024-09-13T15:57:13.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.576+0000 7f0617e00640 1 --2- 172.21.15.17:0/1803586083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0620100ed0 0x7f06200728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:57:13.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.576+0000 7f061de00640 1 --2- 172.21.15.17:0/1803586083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06200ffce0 0x7f0620074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:57:13.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.576+0000 7f061e800640 1 --2- 172.21.15.17:0/1803586083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0620101890 0x7f0620072de0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f061802ade0 tx=0x7f0618032f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:13.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.577+0000 7f0616a00640 1 -- 172.21.15.17:0/1803586083 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618003b70 con 0x7f0620101890 2024-09-13T15:57:13.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.577+0000 7f061f200640 1 -- 172.21.15.17:0/1803586083 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f062019ff30 con 0x7f0620101890 2024-09-13T15:57:13.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.577+0000 7f0616a00640 1 -- 172.21.15.17:0/1803586083 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0618040070 con 0x7f0620101890 2024-09-13T15:57:13.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.577+0000 7f0616a00640 1 -- 172.21.15.17:0/1803586083 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06180043c0 con 0x7f0620101890 2024-09-13T15:57:13.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.577+0000 7f061f200640 1 -- 172.21.15.17:0/1803586083 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06201a0400 con 0x7f0620101890 2024-09-13T15:57:13.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.578+0000 7f061f200640 1 -- 172.21.15.17:0/1803586083 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0620107110 con 0x7f0620101890 2024-09-13T15:57:13.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.580+0000 7f0616a00640 1 -- 172.21.15.17:0/1803586083 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0618042030 con 0x7f0620101890 2024-09-13T15:57:13.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.581+0000 7f0616a00640 1 --2- 172.21.15.17:0/1803586083 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f06040a1090 0x7f06040a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:13.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.581+0000 7f0616a00640 1 -- 172.21.15.17:0/1803586083 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f06180ee0e0 con 0x7f0620101890 2024-09-13T15:57:13.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.581+0000 7f061de00640 1 --2- 172.21.15.17:0/1803586083 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f06040a1090 0x7f06040a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:13.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.582+0000 7f061de00640 1 --2- 172.21.15.17:0/1803586083 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f06040a1090 0x7f06040a3550 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0620100d30 tx=0x7f0610005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:13.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.583+0000 7f0616a00640 1 -- 172.21.15.17:0/1803586083 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f06180b7550 con 0x7f0620101890 2024-09-13T15:57:13.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.762+0000 7f061f200640 1 -- 172.21.15.17:0/1803586083 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0620106b80 con 0x7f0620101890 2024-09-13T15:57:13.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.763+0000 7f0616a00640 1 -- 172.21.15.17:0/1803586083 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f06180bab70 con 0x7f0620101890 2024-09-13T15:57:13.765 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-13T15:57:13.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.765+0000 7f061f200640 1 -- 172.21.15.17:0/1803586083 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f06040a1090 msgr2=0x7f06040a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:13.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.765+0000 7f061f200640 1 --2- 172.21.15.17:0/1803586083 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f06040a1090 0x7f06040a3550 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0620100d30 tx=0x7f0610005f90 comp rx=0 tx=0).stop 2024-09-13T15:57:13.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.765+0000 7f061f200640 1 -- 172.21.15.17:0/1803586083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0620101890 msgr2=0x7f0620072de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:13.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.765+0000 7f061f200640 1 --2- 172.21.15.17:0/1803586083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0620101890 0x7f0620072de0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f061802ade0 tx=0x7f0618032f20 comp rx=0 tx=0).stop 2024-09-13T15:57:13.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.765+0000 7f061f200640 1 -- 172.21.15.17:0/1803586083 shutdown_connections 2024-09-13T15:57:13.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.765+0000 7f061f200640 1 --2- 172.21.15.17:0/1803586083 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f06040a1090 0x7f06040a3550 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.765+0000 7f061f200640 1 --2- 172.21.15.17:0/1803586083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0620101890 0x7f0620072de0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.765+0000 7f061f200640 1 --2- 172.21.15.17:0/1803586083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0620100ed0 0x7f06200728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.765+0000 7f061f200640 1 --2- 172.21.15.17:0/1803586083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06200ffce0 0x7f0620074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.765+0000 7f061f200640 1 -- 172.21.15.17:0/1803586083 >> 172.21.15.17:0/1803586083 conn(0x7f06200fb480 msgr2=0x7f06201042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:13.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.765+0000 7f061f200640 1 -- 172.21.15.17:0/1803586083 shutdown_connections 2024-09-13T15:57:13.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.765+0000 7f061f200640 1 -- 172.21.15.17:0/1803586083 wait complete. 2024-09-13T15:57:13.784 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:57:13.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.943+0000 7fed46400640 1 -- 172.21.15.17:0/2990982628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed40103080 msgr2=0x7fed40103500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:13.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.943+0000 7fed46400640 1 --2- 172.21.15.17:0/2990982628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed40103080 0x7fed40103500 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fed2c009900 tx=0x7fed2c02a3f0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.944+0000 7fed46400640 1 -- 172.21.15.17:0/2990982628 shutdown_connections 2024-09-13T15:57:13.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.944+0000 7fed46400640 1 --2- 172.21.15.17:0/2990982628 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed40103a40 0x7fed4010a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.944+0000 7fed46400640 1 --2- 172.21.15.17:0/2990982628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed40103080 0x7fed40103500 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.944+0000 7fed46400640 1 --2- 172.21.15.17:0/2990982628 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed40101ea0 0x7fed401022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.944+0000 7fed46400640 1 -- 172.21.15.17:0/2990982628 >> 172.21.15.17:0/2990982628 conn(0x7fed400fd670 msgr2=0x7fed400ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:13.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.944+0000 7fed46400640 1 -- 172.21.15.17:0/2990982628 shutdown_connections 2024-09-13T15:57:13.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.944+0000 7fed46400640 1 -- 172.21.15.17:0/2990982628 wait complete. 2024-09-13T15:57:13.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.945+0000 7fed46400640 1 Processor -- start 2024-09-13T15:57:13.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.945+0000 7fed46400640 1 -- start start 2024-09-13T15:57:13.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.945+0000 7fed46400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed40101ea0 0x7fed40197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:13.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.945+0000 7fed46400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed40103080 0x7fed40198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:13.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.945+0000 7fed46400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed40103a40 0x7fed4019f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:13.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.945+0000 7fed46400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4019fa10 con 0x7fed40103080 2024-09-13T15:57:13.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.945+0000 7fed46400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4019fb80 con 0x7fed40103a40 2024-09-13T15:57:13.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.945+0000 7fed46400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4019fd40 con 0x7fed40101ea0 2024-09-13T15:57:13.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.945+0000 7fed3fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed40103080 0x7fed40198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:13.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.945+0000 7fed45a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed40103a40 0x7fed4019f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:13.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.945+0000 7fed45a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed40103a40 0x7fed4019f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:58118/0 (socket says 172.21.15.17:58118) 2024-09-13T15:57:13.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.945+0000 7fed45a00640 1 -- 172.21.15.17:0/1714715375 learned_addr learned my addr 172.21.15.17:0/1714715375 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:13.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.945+0000 7fed3fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed40103080 0x7fed40198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52876/0 (socket says 172.21.15.17:52876) 2024-09-13T15:57:13.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.945+0000 7fed45000640 1 --2- 172.21.15.17:0/1714715375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed40101ea0 0x7fed40197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:13.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.946+0000 7fed3fe00640 1 -- 172.21.15.17:0/1714715375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed40101ea0 msgr2=0x7fed40197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:13.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.946+0000 7fed3fe00640 1 --2- 172.21.15.17:0/1714715375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed40101ea0 0x7fed40197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.946+0000 7fed3fe00640 1 -- 172.21.15.17:0/1714715375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed40103a40 msgr2=0x7fed4019f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:13.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.946+0000 7fed3fe00640 1 --2- 172.21.15.17:0/1714715375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed40103a40 0x7fed4019f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:13.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.946+0000 7fed3fe00640 1 -- 172.21.15.17:0/1714715375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c009560 con 0x7fed40103080 2024-09-13T15:57:13.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.946+0000 7fed45a00640 1 --2- 172.21.15.17:0/1714715375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed40103a40 0x7fed4019f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:57:13.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.946+0000 7fed45000640 1 --2- 172.21.15.17:0/1714715375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed40101ea0 0x7fed40197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:57:13.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.946+0000 7fed3fe00640 1 --2- 172.21.15.17:0/1714715375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed40103080 0x7fed40198460 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fed2c02a910 tx=0x7fed2c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:13.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.946+0000 7fed3d600640 1 -- 172.21.15.17:0/1714715375 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c003e00 con 0x7fed40103080 2024-09-13T15:57:13.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.947+0000 7fed3d600640 1 -- 172.21.15.17:0/1714715375 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fed2c031c70 con 0x7fed40103080 2024-09-13T15:57:13.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.947+0000 7fed46400640 1 -- 172.21.15.17:0/1714715375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4019ffc0 con 0x7fed40103080 2024-09-13T15:57:13.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.947+0000 7fed3d600640 1 -- 172.21.15.17:0/1714715375 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c03bd30 con 0x7fed40103080 2024-09-13T15:57:13.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.947+0000 7fed46400640 1 -- 172.21.15.17:0/1714715375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed401a03e0 con 0x7fed40103080 2024-09-13T15:57:13.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.948+0000 7fed46400640 1 -- 172.21.15.17:0/1714715375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed401093a0 con 0x7fed40103080 2024-09-13T15:57:13.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.951+0000 7fed3d600640 1 -- 172.21.15.17:0/1714715375 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fed2c03b460 con 0x7fed40103080 2024-09-13T15:57:13.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.952+0000 7fed3d600640 1 --2- 172.21.15.17:0/1714715375 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fed280a1090 0x7fed280a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:13.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.952+0000 7fed3d600640 1 -- 172.21.15.17:0/1714715375 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fed2c0edb40 con 0x7fed40103080 2024-09-13T15:57:13.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.953+0000 7fed45000640 1 --2- 172.21.15.17:0/1714715375 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fed280a1090 0x7fed280a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:13.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.953+0000 7fed45000640 1 --2- 172.21.15.17:0/1714715375 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fed280a1090 0x7fed280a3550 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fed40102bf0 tx=0x7fed34005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:13.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:13.954+0000 7fed3d600640 1 -- 172.21.15.17:0/1714715375 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fed2c0b6fd0 con 0x7fed40103080 2024-09-13T15:57:14.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.135+0000 7fed46400640 1 -- 172.21.15.17:0/1714715375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fed40108e10 con 0x7fed40103080 2024-09-13T15:57:14.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.135+0000 7fed3d600640 1 -- 172.21.15.17:0/1714715375 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7fed2c035020 con 0x7fed40103080 2024-09-13T15:57:14.137 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-09-13T15:57:14.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.138+0000 7fed46400640 1 -- 172.21.15.17:0/1714715375 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fed280a1090 msgr2=0x7fed280a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:14.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.138+0000 7fed46400640 1 --2- 172.21.15.17:0/1714715375 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fed280a1090 0x7fed280a3550 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fed40102bf0 tx=0x7fed34005f90 comp rx=0 tx=0).stop 2024-09-13T15:57:14.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.138+0000 7fed46400640 1 -- 172.21.15.17:0/1714715375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed40103080 msgr2=0x7fed40198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:14.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.138+0000 7fed46400640 1 --2- 172.21.15.17:0/1714715375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed40103080 0x7fed40198460 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fed2c02a910 tx=0x7fed2c003c10 comp rx=0 tx=0).stop 2024-09-13T15:57:14.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.138+0000 7fed46400640 1 -- 172.21.15.17:0/1714715375 shutdown_connections 2024-09-13T15:57:14.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.138+0000 7fed46400640 1 --2- 172.21.15.17:0/1714715375 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fed280a1090 0x7fed280a3550 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.138+0000 7fed46400640 1 --2- 172.21.15.17:0/1714715375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed40103a40 0x7fed4019f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.138+0000 7fed46400640 1 --2- 172.21.15.17:0/1714715375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed40103080 0x7fed40198460 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.138+0000 7fed46400640 1 --2- 172.21.15.17:0/1714715375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed40101ea0 0x7fed40197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.138+0000 7fed46400640 1 -- 172.21.15.17:0/1714715375 >> 172.21.15.17:0/1714715375 conn(0x7fed400fd670 msgr2=0x7fed40106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:14.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.138+0000 7fed46400640 1 -- 172.21.15.17:0/1714715375 shutdown_connections 2024-09-13T15:57:14.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.138+0000 7fed46400640 1 -- 172.21.15.17:0/1714715375 wait complete. 2024-09-13T15:57:14.153 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:13 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3052412435' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:57:14.154 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:13 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/4230888679' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:57:14.154 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:13 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1803586083' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T15:57:14.155 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:57:14.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:13 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3052412435' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:57:14.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:13 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/4230888679' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:57:14.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:13 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1803586083' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T15:57:14.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.314+0000 7f895f200640 1 -- 172.21.15.17:0/1289317513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8958101f80 msgr2=0x7f8958102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:14.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.314+0000 7f895f200640 1 --2- 172.21.15.17:0/1289317513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8958101f80 0x7f8958102380 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8948009900 tx=0x7f894802a400 comp rx=0 tx=0).stop 2024-09-13T15:57:14.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.314+0000 7f895f200640 1 -- 172.21.15.17:0/1289317513 shutdown_connections 2024-09-13T15:57:14.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.314+0000 7f895f200640 1 --2- 172.21.15.17:0/1289317513 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8958103b30 0x7f895810a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.314+0000 7f895f200640 1 --2- 172.21.15.17:0/1289317513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8958103170 0x7f89581035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.314+0000 7f895f200640 1 --2- 172.21.15.17:0/1289317513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8958101f80 0x7f8958102380 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.314+0000 7f895f200640 1 -- 172.21.15.17:0/1289317513 >> 172.21.15.17:0/1289317513 conn(0x7f89580fd700 msgr2=0x7f89580ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:14.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.314+0000 7f895f200640 1 -- 172.21.15.17:0/1289317513 shutdown_connections 2024-09-13T15:57:14.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.314+0000 7f895f200640 1 -- 172.21.15.17:0/1289317513 wait complete. 2024-09-13T15:57:14.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.315+0000 7f895f200640 1 Processor -- start 2024-09-13T15:57:14.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.315+0000 7f895f200640 1 -- start start 2024-09-13T15:57:14.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.315+0000 7f895f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8958101f80 0x7f8958197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:14.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.315+0000 7f895f200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8958103170 0x7f8958198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:14.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.315+0000 7f895f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8958103b30 0x7f895819f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:14.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.315+0000 7f895f200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895819fa20 con 0x7f8958103b30 2024-09-13T15:57:14.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.315+0000 7f895f200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895819fb90 con 0x7f8958101f80 2024-09-13T15:57:14.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.315+0000 7f895f200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895819fd50 con 0x7f8958103170 2024-09-13T15:57:14.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.316+0000 7f895d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8958103b30 0x7f895819f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:14.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.316+0000 7f895d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8958103b30 0x7f895819f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52884/0 (socket says 172.21.15.17:52884) 2024-09-13T15:57:14.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.316+0000 7f895d200640 1 -- 172.21.15.17:0/2766886683 learned_addr learned my addr 172.21.15.17:0/2766886683 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:14.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.316+0000 7f8957e00640 1 --2- 172.21.15.17:0/2766886683 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8958101f80 0x7f8958197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:14.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.316+0000 7f894f400640 1 --2- 172.21.15.17:0/2766886683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8958103170 0x7f8958198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:14.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.316+0000 7f895d200640 1 -- 172.21.15.17:0/2766886683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8958103170 msgr2=0x7f8958198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:14.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.316+0000 7f895d200640 1 --2- 172.21.15.17:0/2766886683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8958103170 0x7f8958198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.316+0000 7f895d200640 1 -- 172.21.15.17:0/2766886683 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8958101f80 msgr2=0x7f8958197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:14.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.316+0000 7f895d200640 1 --2- 172.21.15.17:0/2766886683 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8958101f80 0x7f8958197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.316+0000 7f895d200640 1 -- 172.21.15.17:0/2766886683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8948009560 con 0x7f8958103b30 2024-09-13T15:57:14.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.316+0000 7f895d200640 1 --2- 172.21.15.17:0/2766886683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8958103b30 0x7f895819f4e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f895000eaa0 tx=0x7f895000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:14.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.317+0000 7f8955600640 1 -- 172.21.15.17:0/2766886683 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895000cdb0 con 0x7f8958103b30 2024-09-13T15:57:14.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.317+0000 7f8955600640 1 -- 172.21.15.17:0/2766886683 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8950005020 con 0x7f8958103b30 2024-09-13T15:57:14.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.317+0000 7f8955600640 1 -- 172.21.15.17:0/2766886683 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89500116d0 con 0x7f8958103b30 2024-09-13T15:57:14.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.317+0000 7f895f200640 1 -- 172.21.15.17:0/2766886683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895819ffd0 con 0x7f8958103b30 2024-09-13T15:57:14.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.317+0000 7f895f200640 1 -- 172.21.15.17:0/2766886683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89581a0460 con 0x7f8958103b30 2024-09-13T15:57:14.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.318+0000 7f895f200640 1 -- 172.21.15.17:0/2766886683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89581094b0 con 0x7f8958103b30 2024-09-13T15:57:14.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.320+0000 7f8955600640 1 -- 172.21.15.17:0/2766886683 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8950005190 con 0x7f8958103b30 2024-09-13T15:57:14.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.321+0000 7f8955600640 1 --2- 172.21.15.17:0/2766886683 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f893c0a1110 0x7f893c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:14.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.321+0000 7f8955600640 1 -- 172.21.15.17:0/2766886683 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f89500ccda0 con 0x7f8958103b30 2024-09-13T15:57:14.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.321+0000 7f8957e00640 1 --2- 172.21.15.17:0/2766886683 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f893c0a1110 0x7f893c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:14.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.322+0000 7f8957e00640 1 --2- 172.21.15.17:0/2766886683 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f893c0a1110 0x7f893c0a35d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8948031500 tx=0x7f8948005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:14.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.325+0000 7f8955600640 1 -- 172.21.15.17:0/2766886683 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8950096230 con 0x7f8958103b30 2024-09-13T15:57:14.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:13 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3052412435' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:57:14.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:13 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/4230888679' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:57:14.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:13 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1803586083' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T15:57:14.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.504+0000 7f895f200640 1 -- 172.21.15.17:0/2766886683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f895802c480 con 0x7f8958103b30 2024-09-13T15:57:14.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.505+0000 7f8955600640 1 -- 172.21.15.17:0/2766886683 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7f895001f020 con 0x7f8958103b30 2024-09-13T15:57:14.506 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-13T15:57:14.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.507+0000 7f895f200640 1 -- 172.21.15.17:0/2766886683 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f893c0a1110 msgr2=0x7f893c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:14.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.507+0000 7f895f200640 1 --2- 172.21.15.17:0/2766886683 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f893c0a1110 0x7f893c0a35d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8948031500 tx=0x7f8948005780 comp rx=0 tx=0).stop 2024-09-13T15:57:14.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.507+0000 7f895f200640 1 -- 172.21.15.17:0/2766886683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8958103b30 msgr2=0x7f895819f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:14.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.507+0000 7f895f200640 1 --2- 172.21.15.17:0/2766886683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8958103b30 0x7f895819f4e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f895000eaa0 tx=0x7f895000ef60 comp rx=0 tx=0).stop 2024-09-13T15:57:14.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.507+0000 7f895f200640 1 -- 172.21.15.17:0/2766886683 shutdown_connections 2024-09-13T15:57:14.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.507+0000 7f895f200640 1 --2- 172.21.15.17:0/2766886683 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f893c0a1110 0x7f893c0a35d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.507+0000 7f895f200640 1 --2- 172.21.15.17:0/2766886683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8958103b30 0x7f895819f4e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.507+0000 7f895f200640 1 --2- 172.21.15.17:0/2766886683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8958103170 0x7f8958198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.507+0000 7f895f200640 1 --2- 172.21.15.17:0/2766886683 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8958101f80 0x7f8958197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.507+0000 7f895f200640 1 -- 172.21.15.17:0/2766886683 >> 172.21.15.17:0/2766886683 conn(0x7f89580fd700 msgr2=0x7f8958106680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:14.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.507+0000 7f895f200640 1 -- 172.21.15.17:0/2766886683 shutdown_connections 2024-09-13T15:57:14.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.507+0000 7f895f200640 1 -- 172.21.15.17:0/2766886683 wait complete. 2024-09-13T15:57:14.526 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:57:14.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.682+0000 7fb6d0400640 1 -- 172.21.15.17:0/4125347238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6c8100f70 msgr2=0x7fb6c81013f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:14.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.682+0000 7fb6d0400640 1 --2- 172.21.15.17:0/4125347238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6c8100f70 0x7fb6c81013f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4009900 tx=0x7fb6b402a3f0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.682+0000 7fb6d0400640 1 -- 172.21.15.17:0/4125347238 shutdown_connections 2024-09-13T15:57:14.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.682+0000 7fb6d0400640 1 --2- 172.21.15.17:0/4125347238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6c8101930 0x7fb6c81081c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.682+0000 7fb6d0400640 1 --2- 172.21.15.17:0/4125347238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6c8100f70 0x7fb6c81013f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.682+0000 7fb6d0400640 1 --2- 172.21.15.17:0/4125347238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6c80ffd80 0x7fb6c8100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.682+0000 7fb6d0400640 1 -- 172.21.15.17:0/4125347238 >> 172.21.15.17:0/4125347238 conn(0x7fb6c80fb500 msgr2=0x7fb6c80fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:14.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.682+0000 7fb6d0400640 1 -- 172.21.15.17:0/4125347238 shutdown_connections 2024-09-13T15:57:14.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.682+0000 7fb6d0400640 1 -- 172.21.15.17:0/4125347238 wait complete. 2024-09-13T15:57:14.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.683+0000 7fb6d0400640 1 Processor -- start 2024-09-13T15:57:14.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.683+0000 7fb6d0400640 1 -- start start 2024-09-13T15:57:14.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.684+0000 7fb6d0400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6c80ffd80 0x7fb6c8074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:14.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.684+0000 7fb6d0400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6c8100f70 0x7fb6c80728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:14.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.684+0000 7fb6d0400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6c8101930 0x7fb6c8072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:14.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.684+0000 7fb6d0400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c8073540 con 0x7fb6c8101930 2024-09-13T15:57:14.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.684+0000 7fb6d0400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c80736b0 con 0x7fb6c8100f70 2024-09-13T15:57:14.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.684+0000 7fb6d0400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c819fe60 con 0x7fb6c80ffd80 2024-09-13T15:57:14.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.684+0000 7fb6ce400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6c8101930 0x7fb6c8072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:14.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.684+0000 7fb6ce400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6c8101930 0x7fb6c8072de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52900/0 (socket says 172.21.15.17:52900) 2024-09-13T15:57:14.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.684+0000 7fb6ce400640 1 -- 172.21.15.17:0/3535065532 learned_addr learned my addr 172.21.15.17:0/3535065532 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:14.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.684+0000 7fb6cd000640 1 --2- 172.21.15.17:0/3535065532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6c8100f70 0x7fb6c80728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:14.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.684+0000 7fb6cda00640 1 --2- 172.21.15.17:0/3535065532 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6c80ffd80 0x7fb6c8074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:14.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.684+0000 7fb6ce400640 1 -- 172.21.15.17:0/3535065532 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6c80ffd80 msgr2=0x7fb6c8074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:14.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.684+0000 7fb6ce400640 1 --2- 172.21.15.17:0/3535065532 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6c80ffd80 0x7fb6c8074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.684+0000 7fb6ce400640 1 -- 172.21.15.17:0/3535065532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6c8100f70 msgr2=0x7fb6c80728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:14.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.684+0000 7fb6ce400640 1 --2- 172.21.15.17:0/3535065532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6c8100f70 0x7fb6c80728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.684+0000 7fb6ce400640 1 -- 172.21.15.17:0/3535065532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c0009840 con 0x7fb6c8101930 2024-09-13T15:57:14.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.685+0000 7fb6ce400640 1 --2- 172.21.15.17:0/3535065532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6c8101930 0x7fb6c8072de0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0009cf0 tx=0x7fb6c000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:14.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.685+0000 7fb6c6000640 1 -- 172.21.15.17:0/3535065532 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0009b40 con 0x7fb6c8101930 2024-09-13T15:57:14.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.685+0000 7fb6c6000640 1 -- 172.21.15.17:0/3535065532 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6c0003b70 con 0x7fb6c8101930 2024-09-13T15:57:14.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.685+0000 7fb6c6000640 1 -- 172.21.15.17:0/3535065532 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0010850 con 0x7fb6c8101930 2024-09-13T15:57:14.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.685+0000 7fb6d0400640 1 -- 172.21.15.17:0/3535065532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b4009560 con 0x7fb6c8101930 2024-09-13T15:57:14.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.685+0000 7fb6d0400640 1 -- 172.21.15.17:0/3535065532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c81a0410 con 0x7fb6c8101930 2024-09-13T15:57:14.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.686+0000 7fb6d0400640 1 -- 172.21.15.17:0/3535065532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c81072b0 con 0x7fb6c8101930 2024-09-13T15:57:14.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.688+0000 7fb6c6000640 1 -- 172.21.15.17:0/3535065532 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb6c0003ce0 con 0x7fb6c8101930 2024-09-13T15:57:14.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.689+0000 7fb6c6000640 1 --2- 172.21.15.17:0/3535065532 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb6b00a1090 0x7fb6b00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:14.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.689+0000 7fb6c6000640 1 -- 172.21.15.17:0/3535065532 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fb6c0014070 con 0x7fb6c8101930 2024-09-13T15:57:14.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.689+0000 7fb6cda00640 1 --2- 172.21.15.17:0/3535065532 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb6b00a1090 0x7fb6b00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:14.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.690+0000 7fb6cda00640 1 --2- 172.21.15.17:0/3535065532 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb6b00a1090 0x7fb6b00a3550 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc005fd0 tx=0x7fb6bc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:14.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.693+0000 7fb6c6000640 1 -- 172.21.15.17:0/3535065532 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb6c0096660 con 0x7fb6c8101930 2024-09-13T15:57:14.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.910+0000 7fb6d0400640 1 -- 172.21.15.17:0/3535065532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6c810b670 con 0x7fb6c8101930 2024-09-13T15:57:14.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.911+0000 7fb6c6000640 1 -- 172.21.15.17:0/3535065532 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10879 (secure 0 0 0) 0x7fb6c0099c80 con 0x7fb6c8101930 2024-09-13T15:57:14.913 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:14.913 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1730156534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1730156534},{"type":"v1","addr":"172.21.15.17:6837","nonce":1730156534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/1295854211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1295854211},{"type":"v1","addr":"172.21.15.17:6841","nonce":1295854211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2888593680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2888593680},{"type":"v1","addr":"172.21.15.17:6835","nonce":2888593680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4135454212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4135454212},{"type":"v1","addr":"172.21.15.189:6835","nonce":4135454212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T15:54:52.929867+0000","modified":"2024-09-13T15:55:16.253229+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24565,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24520":{"gid":24520,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/4049465204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":4049465204},{"type":"v1","addr":"172.21.15.193:6835","nonce":4049465204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/2079181485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2079181485},{"type":"v1","addr":"172.21.15.189:6837","nonce":2079181485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24532":{"gid":24532,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/792056943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":792056943},{"type":"v1","addr":"172.21.15.193:6837","nonce":792056943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24553":{"gid":24553,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6839/3012199875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":3012199875},{"type":"v1","addr":"172.21.15.193:6839","nonce":3012199875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24565":{"gid":24565,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.17:6839/3750040765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3750040765},{"type":"v1","addr":"172.21.15.17:6839","nonce":3750040765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6839/2624723395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2624723395},{"type":"v1","addr":"172.21.15.189:6839","nonce":2624723395}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:57:14.913 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-13T15:57:14.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.913+0000 7fb6d0400640 1 -- 172.21.15.17:0/3535065532 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb6b00a1090 msgr2=0x7fb6b00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:14.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.913+0000 7fb6d0400640 1 --2- 172.21.15.17:0/3535065532 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb6b00a1090 0x7fb6b00a3550 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc005fd0 tx=0x7fb6bc00b410 comp rx=0 tx=0).stop 2024-09-13T15:57:14.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.913+0000 7fb6d0400640 1 -- 172.21.15.17:0/3535065532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6c8101930 msgr2=0x7fb6c8072de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:14.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.913+0000 7fb6d0400640 1 --2- 172.21.15.17:0/3535065532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6c8101930 0x7fb6c8072de0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0009cf0 tx=0x7fb6c000c6a0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.913+0000 7fb6d0400640 1 -- 172.21.15.17:0/3535065532 shutdown_connections 2024-09-13T15:57:14.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.913+0000 7fb6d0400640 1 --2- 172.21.15.17:0/3535065532 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb6b00a1090 0x7fb6b00a3550 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.913+0000 7fb6d0400640 1 --2- 172.21.15.17:0/3535065532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6c8101930 0x7fb6c8072de0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.913+0000 7fb6d0400640 1 --2- 172.21.15.17:0/3535065532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6c8100f70 0x7fb6c80728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.913+0000 7fb6d0400640 1 --2- 172.21.15.17:0/3535065532 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6c80ffd80 0x7fb6c8074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:14.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.913+0000 7fb6d0400640 1 -- 172.21.15.17:0/3535065532 >> 172.21.15.17:0/3535065532 conn(0x7fb6c80fb500 msgr2=0x7fb6c8104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:14.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.913+0000 7fb6d0400640 1 -- 172.21.15.17:0/3535065532 shutdown_connections 2024-09-13T15:57:14.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:14.913+0000 7fb6d0400640 1 -- 172.21.15.17:0/3535065532 wait complete. 2024-09-13T15:57:14.932 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:57:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.090+0000 7f163a200640 1 -- 172.21.15.17:0/1973328695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1634103b50 msgr2=0x7f163410a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.090+0000 7f163a200640 1 --2- 172.21.15.17:0/1973328695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1634103b50 0x7f163410a3e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f162c009ca0 tx=0x7f162c02a8c0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.090+0000 7f163a200640 1 -- 172.21.15.17:0/1973328695 shutdown_connections 2024-09-13T15:57:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.090+0000 7f163a200640 1 --2- 172.21.15.17:0/1973328695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1634103b50 0x7f163410a3e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.090+0000 7f163a200640 1 --2- 172.21.15.17:0/1973328695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1634103190 0x7f1634103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.090+0000 7f163a200640 1 --2- 172.21.15.17:0/1973328695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1634101fa0 0x7f16341023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.090+0000 7f163a200640 1 -- 172.21.15.17:0/1973328695 >> 172.21.15.17:0/1973328695 conn(0x7f16340fd700 msgr2=0x7f16340ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.090+0000 7f163a200640 1 -- 172.21.15.17:0/1973328695 shutdown_connections 2024-09-13T15:57:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.090+0000 7f163a200640 1 -- 172.21.15.17:0/1973328695 wait complete. 2024-09-13T15:57:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.091+0000 7f163a200640 1 Processor -- start 2024-09-13T15:57:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.091+0000 7f163a200640 1 -- start start 2024-09-13T15:57:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.091+0000 7f163a200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1634101fa0 0x7f1634197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.091+0000 7f163a200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1634103190 0x7f1634198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.091+0000 7f163a200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1634103b50 0x7f163419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.091+0000 7f163a200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163419fa30 con 0x7f1634101fa0 2024-09-13T15:57:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.091+0000 7f163a200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163419fba0 con 0x7f1634103190 2024-09-13T15:57:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.091+0000 7f163a200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163419fd60 con 0x7f1634103b50 2024-09-13T15:57:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.092+0000 7f1633400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1634101fa0 0x7f1634197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.092+0000 7f1633400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1634101fa0 0x7f1634197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52924/0 (socket says 172.21.15.17:52924) 2024-09-13T15:57:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.092+0000 7f1633400640 1 -- 172.21.15.17:0/3848280891 learned_addr learned my addr 172.21.15.17:0/3848280891 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.092+0000 7f1633e00640 1 --2- 172.21.15.17:0/3848280891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1634103b50 0x7f163419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.092+0000 7f162be00640 1 --2- 172.21.15.17:0/3848280891 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1634103190 0x7f1634198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.092+0000 7f1633400640 1 -- 172.21.15.17:0/3848280891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1634103b50 msgr2=0x7f163419f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.092+0000 7f1633400640 1 --2- 172.21.15.17:0/3848280891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1634103b50 0x7f163419f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.092+0000 7f1633400640 1 -- 172.21.15.17:0/3848280891 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1634103190 msgr2=0x7f1634198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.092+0000 7f1633400640 1 --2- 172.21.15.17:0/3848280891 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1634103190 0x7f1634198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.092+0000 7f1633400640 1 -- 172.21.15.17:0/3848280891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c009490 con 0x7f1634101fa0 2024-09-13T15:57:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.092+0000 7f1633400640 1 --2- 172.21.15.17:0/3848280891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1634101fa0 0x7f1634197f40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f162400e9c0 tx=0x7f162400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.093+0000 7f1630c00640 1 -- 172.21.15.17:0/3848280891 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16240096e0 con 0x7f1634101fa0 2024-09-13T15:57:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.093+0000 7f1630c00640 1 -- 172.21.15.17:0/3848280891 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16240044f0 con 0x7f1634101fa0 2024-09-13T15:57:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.093+0000 7f163a200640 1 -- 172.21.15.17:0/3848280891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162c009900 con 0x7f1634101fa0 2024-09-13T15:57:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.093+0000 7f1630c00640 1 -- 172.21.15.17:0/3848280891 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624010430 con 0x7f1634101fa0 2024-09-13T15:57:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.093+0000 7f163a200640 1 -- 172.21.15.17:0/3848280891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16341a0280 con 0x7f1634101fa0 2024-09-13T15:57:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.094+0000 7f163a200640 1 -- 172.21.15.17:0/3848280891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1634109390 con 0x7f1634101fa0 2024-09-13T15:57:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.096+0000 7f1630c00640 1 -- 172.21.15.17:0/3848280891 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f16240035f0 con 0x7f1634101fa0 2024-09-13T15:57:15.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.097+0000 7f1630c00640 1 --2- 172.21.15.17:0/3848280891 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f16180a1090 0x7f16180a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:15.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.097+0000 7f1630c00640 1 -- 172.21.15.17:0/3848280891 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f1624014070 con 0x7f1634101fa0 2024-09-13T15:57:15.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.097+0000 7f162be00640 1 --2- 172.21.15.17:0/3848280891 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f16180a1090 0x7f16180a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:15.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.098+0000 7f162be00640 1 --2- 172.21.15.17:0/3848280891 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f16180a1090 0x7f16180a3550 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1634199450 tx=0x7f161c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:15.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.101+0000 7f1630c00640 1 -- 172.21.15.17:0/3848280891 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1624096400 con 0x7f1634101fa0 2024-09-13T15:57:15.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:14 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1714715375' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T15:57:15.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:14 smithi193 ceph-mon[35248]: pgmap v370: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:57:15.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:14 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/2766886683' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T15:57:15.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:14 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3535065532' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:57:15.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:14 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1714715375' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T15:57:15.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:14 smithi017 ceph-mon[30494]: pgmap v370: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:57:15.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:14 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/2766886683' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T15:57:15.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:14 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3535065532' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:57:15.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.283+0000 7f163a200640 1 -- 172.21.15.17:0/3848280891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f163402c4e0 con 0x7f1634101fa0 2024-09-13T15:57:15.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.285+0000 7f1630c00640 1 -- 172.21.15.17:0/3848280891 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24575 (secure 0 0 0) 0x7f1624099a20 con 0x7f1634101fa0 2024-09-13T15:57:15.287 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:15.287 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":94,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","created":"2024-09-13T15:46:50.475750+0000","modified":"2024-09-13T15:56:44.228817+0000","last_up_change":"2024-09-13T15:53:59.138985+0000","last_in_change":"2024-09-13T15:53:39.220264+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:50:10.657011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:54:51.436469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:54:52.427930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:54:55.478058+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5d39d6af-15e6-463b-b9ff-a9a5dd94e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6803","nonce":158651212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6805","nonce":158651212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6809","nonce":158651212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6807","nonce":158651212}]},"public_addr":"172.21.15.17:6803/158651212","cluster_addr":"172.21.15.17:6805/158651212","heartbeat_back_addr":"172.21.15.17:6809/158651212","heartbeat_front_addr":"172.21.15.17:6807/158651212","state":["exists","up"]},{"osd":1,"uuid":"0da621c7-645b-44ae-ba7c-a573861c3aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6801","nonce":964319421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6803","nonce":964319421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6807","nonce":964319421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6805","nonce":964319421}]},"public_addr":"172.21.15.189:6801/964319421","cluster_addr":"172.21.15.189:6803/964319421","heartbeat_back_addr":"172.21.15.189:6807/964319421","heartbeat_front_addr":"172.21.15.189:6805/964319421","state":["exists","up"]},{"osd":2,"uuid":"fa95af60-1486-4a29-8c79-8a73a4146552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6801","nonce":138468002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6803","nonce":138468002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6807","nonce":138468002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6805","nonce":138468002}]},"public_addr":"172.21.15.193:6801/138468002","cluster_addr":"172.21.15.193:6803/138468002","heartbeat_back_addr":"172.21.15.193:6807/138468002","heartbeat_front_addr":"172.21.15.193:6805/138468002","state":["exists","up"]},{"osd":3,"uuid":"90428e5f-dfd4-4cda-b240-fdb9079bcb7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6811","nonce":919913803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6813","nonce":919913803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6817","nonce":919913803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6815","nonce":919913803}]},"public_addr":"172.21.15.17:6811/919913803","cluster_addr":"172.21.15.17:6813/919913803","heartbeat_back_addr":"172.21.15.17:6817/919913803","heartbeat_front_addr":"172.21.15.17:6815/919913803","state":["exists","up"]},{"osd":4,"uuid":"e1c537b6-98d2-4b66-b15a-65fe70b0ce25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6809","nonce":2310375565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6811","nonce":2310375565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6815","nonce":2310375565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6813","nonce":2310375565}]},"public_addr":"172.21.15.189:6809/2310375565","cluster_addr":"172.21.15.189:6811/2310375565","heartbeat_back_addr":"172.21.15.189:6815/2310375565","heartbeat_front_addr":"172.21.15.189:6813/2310375565","state":["exists","up"]},{"osd":5,"uuid":"48522fd7-d781-4447-873f-174dabd1e33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6809","nonce":1330877824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6811","nonce":1330877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6815","nonce":1330877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6813","nonce":1330877824}]},"public_addr":"172.21.15.193:6809/1330877824","cluster_addr":"172.21.15.193:6811/1330877824","heartbeat_back_addr":"172.21.15.193:6815/1330877824","heartbeat_front_addr":"172.21.15.193:6813/1330877824","state":["exists","up"]},{"osd":6,"uuid":"47bea191-fb53-40a7-8563-8ebf17dd5bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6819","nonce":3930545382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6821","nonce":3930545382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6825","nonce":3930545382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6823","nonce":3930545382}]},"public_addr":"172.21.15.17:6819/3930545382","cluster_addr":"172.21.15.17:6821/3930545382","heartbeat_back_addr":"172.21.15.17:6825/3930545382","heartbeat_front_addr":"172.21.15.17:6823/3930545382","state":["exists","up"]},{"osd":7,"uuid":"a98f36f9-0a19-4c9a-8ed1-615c4a6e7658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6817","nonce":3691677495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6819","nonce":3691677495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6823","nonce":3691677495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6821","nonce":3691677495}]},"public_addr":"172.21.15.189:6817/3691677495","cluster_addr":"172.21.15.189:6819/3691677495","heartbeat_back_addr":"172.21.15.189:6823/3691677495","heartbeat_front_addr":"172.21.15.189:6821/3691677495","state":["exists","up"]},{"osd":8,"uuid":"7a372d9f-c40f-4ead-87da-2f3a570c1373","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6817","nonce":4112907498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6819","nonce":4112907498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6823","nonce":4112907498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6821","nonce":4112907498}]},"public_addr":"172.21.15.193:6817/4112907498","cluster_addr":"172.21.15.193:6819/4112907498","heartbeat_back_addr":"172.21.15.193:6823/4112907498","heartbeat_front_addr":"172.21.15.193:6821/4112907498","state":["exists","up"]},{"osd":9,"uuid":"ac3d983c-c5e7-456b-8271-7c4e6169de61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6827","nonce":663424274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6829","nonce":663424274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6833","nonce":663424274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6831","nonce":663424274}]},"public_addr":"172.21.15.17:6827/663424274","cluster_addr":"172.21.15.17:6829/663424274","heartbeat_back_addr":"172.21.15.17:6833/663424274","heartbeat_front_addr":"172.21.15.17:6831/663424274","state":["exists","up"]},{"osd":10,"uuid":"08dcae02-6c79-4a06-ae88-6eb6e6941cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6825","nonce":3153990375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6827","nonce":3153990375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6831","nonce":3153990375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6829","nonce":3153990375}]},"public_addr":"172.21.15.189:6825/3153990375","cluster_addr":"172.21.15.189:6827/3153990375","heartbeat_back_addr":"172.21.15.189:6831/3153990375","heartbeat_front_addr":"172.21.15.189:6829/3153990375","state":["exists","up"]},{"osd":11,"uuid":"a4ebcf41-d805-4d44-b112-13ae84d51868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6825","nonce":4088053907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6827","nonce":4088053907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6831","nonce":4088053907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6829","nonce":4088053907}]},"public_addr":"172.21.15.193:6825/4088053907","cluster_addr":"172.21.15.193:6827/4088053907","heartbeat_back_addr":"172.21.15.193:6831/4088053907","heartbeat_front_addr":"172.21.15.193:6829/4088053907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:22.172370+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:44.802224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:06.641435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:34.536515+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:58.789324+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:22.189862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:50.382257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:14.678047+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:38.581105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:07.258150+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:32.261383+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:56.739338+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8},{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/1550067038":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/3360683829":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/634066188":"2024-09-14T15:47:42.048005+0000","172.21.15.17:6801/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1945536687":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/2214214377":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1224386591":"2024-09-14T15:47:14.996424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:57:15.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.287+0000 7f163a200640 1 -- 172.21.15.17:0/3848280891 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f16180a1090 msgr2=0x7f16180a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:15.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.287+0000 7f163a200640 1 --2- 172.21.15.17:0/3848280891 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f16180a1090 0x7f16180a3550 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1634199450 tx=0x7f161c005f90 comp rx=0 tx=0).stop 2024-09-13T15:57:15.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.287+0000 7f163a200640 1 -- 172.21.15.17:0/3848280891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1634101fa0 msgr2=0x7f1634197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:15.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.287+0000 7f163a200640 1 --2- 172.21.15.17:0/3848280891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1634101fa0 0x7f1634197f40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f162400e9c0 tx=0x7f162400ee80 comp rx=0 tx=0).stop 2024-09-13T15:57:15.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.287+0000 7f163a200640 1 -- 172.21.15.17:0/3848280891 shutdown_connections 2024-09-13T15:57:15.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.287+0000 7f163a200640 1 --2- 172.21.15.17:0/3848280891 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f16180a1090 0x7f16180a3550 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.287+0000 7f163a200640 1 --2- 172.21.15.17:0/3848280891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1634103b50 0x7f163419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.287+0000 7f163a200640 1 --2- 172.21.15.17:0/3848280891 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1634103190 0x7f1634198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.287+0000 7f163a200640 1 --2- 172.21.15.17:0/3848280891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1634101fa0 0x7f1634197f40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.287+0000 7f163a200640 1 -- 172.21.15.17:0/3848280891 >> 172.21.15.17:0/3848280891 conn(0x7f16340fd700 msgr2=0x7f1634106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:15.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.287+0000 7f163a200640 1 -- 172.21.15.17:0/3848280891 shutdown_connections 2024-09-13T15:57:15.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.288+0000 7f163a200640 1 -- 172.21.15.17:0/3848280891 wait complete. 2024-09-13T15:57:15.305 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:50:10.657011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:54:51.436469+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:54:52.427930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:54:55.478058+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:57:15.306 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:57:15.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:14 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1714715375' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T15:57:15.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:14 smithi189 ceph-mon[34790]: pgmap v370: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:57:15.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:14 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/2766886683' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T15:57:15.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:14 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3535065532' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:57:15.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.465+0000 7f3ff6800640 1 -- 172.21.15.17:0/1017918214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ff0101fa0 msgr2=0x7f3ff01023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:15.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.465+0000 7f3ff6800640 1 --2- 172.21.15.17:0/1017918214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ff0101fa0 0x7f3ff01023a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009900 tx=0x7f3fe002a3f0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.465+0000 7f3ff6800640 1 -- 172.21.15.17:0/1017918214 shutdown_connections 2024-09-13T15:57:15.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.465+0000 7f3ff6800640 1 --2- 172.21.15.17:0/1017918214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ff0103b50 0x7f3ff010a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.465+0000 7f3ff6800640 1 --2- 172.21.15.17:0/1017918214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ff0103190 0x7f3ff0103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.465+0000 7f3ff6800640 1 --2- 172.21.15.17:0/1017918214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ff0101fa0 0x7f3ff01023a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.465+0000 7f3ff6800640 1 -- 172.21.15.17:0/1017918214 >> 172.21.15.17:0/1017918214 conn(0x7f3ff00fd700 msgr2=0x7f3ff00ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:15.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.465+0000 7f3ff6800640 1 -- 172.21.15.17:0/1017918214 shutdown_connections 2024-09-13T15:57:15.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.465+0000 7f3ff6800640 1 -- 172.21.15.17:0/1017918214 wait complete. 2024-09-13T15:57:15.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.466+0000 7f3ff6800640 1 Processor -- start 2024-09-13T15:57:15.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.466+0000 7f3ff6800640 1 -- start start 2024-09-13T15:57:15.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.466+0000 7f3ff6800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ff0101fa0 0x7f3ff0197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:15.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.466+0000 7f3ff6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ff0103190 0x7f3ff01984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:15.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.466+0000 7f3ff6800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ff0103b50 0x7f3ff019f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:15.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.466+0000 7f3ff6800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff019fa60 con 0x7f3ff0103190 2024-09-13T15:57:15.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.466+0000 7f3ff6800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff019fbd0 con 0x7f3ff0103b50 2024-09-13T15:57:15.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.466+0000 7f3ff6800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff019fd90 con 0x7f3ff0101fa0 2024-09-13T15:57:15.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.467+0000 7f3fe7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ff0103190 0x7f3ff01984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:15.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.467+0000 7f3fe7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ff0103190 0x7f3ff01984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52936/0 (socket says 172.21.15.17:52936) 2024-09-13T15:57:15.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.467+0000 7f3fe7e00640 1 -- 172.21.15.17:0/3272831332 learned_addr learned my addr 172.21.15.17:0/3272831332 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:15.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.467+0000 7f3fef400640 1 --2- 172.21.15.17:0/3272831332 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ff0101fa0 0x7f3ff0197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:15.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.467+0000 7f3fefe00640 1 --2- 172.21.15.17:0/3272831332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ff0103b50 0x7f3ff019f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:15.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.467+0000 7f3fe7e00640 1 -- 172.21.15.17:0/3272831332 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ff0101fa0 msgr2=0x7f3ff0197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:15.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.467+0000 7f3fe7e00640 1 --2- 172.21.15.17:0/3272831332 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ff0101fa0 0x7f3ff0197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.467+0000 7f3fe7e00640 1 -- 172.21.15.17:0/3272831332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ff0103b50 msgr2=0x7f3ff019f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:15.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.467+0000 7f3fe7e00640 1 --2- 172.21.15.17:0/3272831332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ff0103b50 0x7f3ff019f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.467+0000 7f3fe7e00640 1 -- 172.21.15.17:0/3272831332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe0009560 con 0x7f3ff0103190 2024-09-13T15:57:15.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.467+0000 7f3fefe00640 1 --2- 172.21.15.17:0/3272831332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ff0103b50 0x7f3ff019f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:57:15.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.467+0000 7f3fe7e00640 1 --2- 172.21.15.17:0/3272831332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ff0103190 0x7f3ff01984b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800e9f0 tx=0x7f3fd800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:15.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.467+0000 7f3fecc00640 1 -- 172.21.15.17:0/3272831332 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8009720 con 0x7f3ff0103190 2024-09-13T15:57:15.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.467+0000 7f3fecc00640 1 -- 172.21.15.17:0/3272831332 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3fd800cd80 con 0x7f3ff0103190 2024-09-13T15:57:15.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.468+0000 7f3ff6800640 1 -- 172.21.15.17:0/3272831332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff01a0070 con 0x7f3ff0103190 2024-09-13T15:57:15.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.468+0000 7f3fecc00640 1 -- 172.21.15.17:0/3272831332 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8010430 con 0x7f3ff0103190 2024-09-13T15:57:15.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.468+0000 7f3ff6800640 1 -- 172.21.15.17:0/3272831332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff01a0580 con 0x7f3ff0103190 2024-09-13T15:57:15.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.469+0000 7f3ff6800640 1 -- 172.21.15.17:0/3272831332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff01094a0 con 0x7f3ff0103190 2024-09-13T15:57:15.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.471+0000 7f3fecc00640 1 -- 172.21.15.17:0/3272831332 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3fd8005020 con 0x7f3ff0103190 2024-09-13T15:57:15.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.472+0000 7f3fecc00640 1 --2- 172.21.15.17:0/3272831332 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3fd40a1110 0x7f3fd40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:15.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.472+0000 7f3fecc00640 1 -- 172.21.15.17:0/3272831332 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f3fd8014070 con 0x7f3ff0103190 2024-09-13T15:57:15.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.473+0000 7f3fef400640 1 --2- 172.21.15.17:0/3272831332 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3fd40a1110 0x7f3fd40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:15.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.473+0000 7f3fef400640 1 --2- 172.21.15.17:0/3272831332 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3fd40a1110 0x7f3fd40a35d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0006010 tx=0x7f3fe00314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:15.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.476+0000 7f3fecc00640 1 -- 172.21.15.17:0/3272831332 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3fd80964e0 con 0x7f3ff0103190 2024-09-13T15:57:15.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.657+0000 7f3ff6800640 1 -- 172.21.15.17:0/3272831332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3ff0108f10 con 0x7f3ff0103190 2024-09-13T15:57:15.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.657+0000 7f3fecc00640 1 -- 172.21.15.17:0/3272831332 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3fd8099b00 con 0x7f3ff0103190 2024-09-13T15:57:15.659 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-13T15:57:15.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.659+0000 7f3ff6800640 1 -- 172.21.15.17:0/3272831332 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3fd40a1110 msgr2=0x7f3fd40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:15.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.659+0000 7f3ff6800640 1 --2- 172.21.15.17:0/3272831332 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3fd40a1110 0x7f3fd40a35d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0006010 tx=0x7f3fe00314a0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.659+0000 7f3ff6800640 1 -- 172.21.15.17:0/3272831332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ff0103190 msgr2=0x7f3ff01984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:15.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.659+0000 7f3ff6800640 1 --2- 172.21.15.17:0/3272831332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ff0103190 0x7f3ff01984b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800e9f0 tx=0x7f3fd800edf0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.659+0000 7f3ff6800640 1 -- 172.21.15.17:0/3272831332 shutdown_connections 2024-09-13T15:57:15.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.659+0000 7f3ff6800640 1 --2- 172.21.15.17:0/3272831332 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3fd40a1110 0x7f3fd40a35d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.659+0000 7f3ff6800640 1 --2- 172.21.15.17:0/3272831332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ff0103b50 0x7f3ff019f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.659+0000 7f3ff6800640 1 --2- 172.21.15.17:0/3272831332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ff0103190 0x7f3ff01984b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.659+0000 7f3ff6800640 1 --2- 172.21.15.17:0/3272831332 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ff0101fa0 0x7f3ff0197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.659+0000 7f3ff6800640 1 -- 172.21.15.17:0/3272831332 >> 172.21.15.17:0/3272831332 conn(0x7f3ff00fd700 msgr2=0x7f3ff0106670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:15.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.660+0000 7f3ff6800640 1 -- 172.21.15.17:0/3272831332 shutdown_connections 2024-09-13T15:57:15.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.660+0000 7f3ff6800640 1 -- 172.21.15.17:0/3272831332 wait complete. 2024-09-13T15:57:15.677 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:57:15.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.835+0000 7f3a87200640 1 -- 172.21.15.17:0/550716264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a88100eb0 msgr2=0x7f3a88101330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:15.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.835+0000 7f3a87200640 1 --2- 172.21.15.17:0/550716264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a88100eb0 0x7f3a88101330 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009900 tx=0x7f3a7402a3f0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.836+0000 7f3a87200640 1 -- 172.21.15.17:0/550716264 shutdown_connections 2024-09-13T15:57:15.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.836+0000 7f3a87200640 1 --2- 172.21.15.17:0/550716264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a88101870 0x7f3a88108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.836+0000 7f3a87200640 1 --2- 172.21.15.17:0/550716264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a88100eb0 0x7f3a88101330 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.836+0000 7f3a87200640 1 --2- 172.21.15.17:0/550716264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a880ffcc0 0x7f3a881000c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.836+0000 7f3a87200640 1 -- 172.21.15.17:0/550716264 >> 172.21.15.17:0/550716264 conn(0x7f3a880fb420 msgr2=0x7f3a880fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:15.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.836+0000 7f3a87200640 1 -- 172.21.15.17:0/550716264 shutdown_connections 2024-09-13T15:57:15.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.836+0000 7f3a87200640 1 -- 172.21.15.17:0/550716264 wait complete. 2024-09-13T15:57:15.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.837+0000 7f3a87200640 1 Processor -- start 2024-09-13T15:57:15.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.837+0000 7f3a87200640 1 -- start start 2024-09-13T15:57:15.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.837+0000 7f3a87200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a880ffcc0 0x7f3a88195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:15.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.837+0000 7f3a87200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a88100eb0 0x7f3a881961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:15.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.837+0000 7f3a87200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a88101870 0x7f3a8819d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:15.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.837+0000 7f3a87200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8819d780 con 0x7f3a88101870 2024-09-13T15:57:15.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.837+0000 7f3a87200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8819d8f0 con 0x7f3a880ffcc0 2024-09-13T15:57:15.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.837+0000 7f3a87200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8819dab0 con 0x7f3a88100eb0 2024-09-13T15:57:15.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.837+0000 7f3a85e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a880ffcc0 0x7f3a88195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:15.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.837+0000 7f3a85e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a880ffcc0 0x7f3a88195c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:58216/0 (socket says 172.21.15.17:58216) 2024-09-13T15:57:15.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.837+0000 7f3a85e00640 1 -- 172.21.15.17:0/3931933073 learned_addr learned my addr 172.21.15.17:0/3931933073 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:15.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.837+0000 7f3a85400640 1 --2- 172.21.15.17:0/3931933073 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a88100eb0 0x7f3a881961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:15.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.837+0000 7f3a86800640 1 --2- 172.21.15.17:0/3931933073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a88101870 0x7f3a8819d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:15.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.838+0000 7f3a85e00640 1 -- 172.21.15.17:0/3931933073 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a88100eb0 msgr2=0x7f3a881961b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:15.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.838+0000 7f3a85e00640 1 --2- 172.21.15.17:0/3931933073 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a88100eb0 0x7f3a881961b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.838+0000 7f3a85e00640 1 -- 172.21.15.17:0/3931933073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a88101870 msgr2=0x7f3a8819d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:15.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.838+0000 7f3a85e00640 1 --2- 172.21.15.17:0/3931933073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a88101870 0x7f3a8819d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:15.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.838+0000 7f3a85e00640 1 -- 172.21.15.17:0/3931933073 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a78009490 con 0x7f3a880ffcc0 2024-09-13T15:57:15.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.838+0000 7f3a85e00640 1 --2- 172.21.15.17:0/3931933073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a880ffcc0 0x7f3a88195c70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3a7800e9c0 tx=0x7f3a7800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:15.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.838+0000 7f3a7ea00640 1 -- 172.21.15.17:0/3931933073 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7800cde0 con 0x7f3a880ffcc0 2024-09-13T15:57:15.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.838+0000 7f3a7ea00640 1 -- 172.21.15.17:0/3931933073 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a780108f0 con 0x7f3a880ffcc0 2024-09-13T15:57:15.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.838+0000 7f3a87200640 1 -- 172.21.15.17:0/3931933073 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a74009560 con 0x7f3a880ffcc0 2024-09-13T15:57:15.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.838+0000 7f3a7ea00640 1 -- 172.21.15.17:0/3931933073 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a780188c0 con 0x7f3a880ffcc0 2024-09-13T15:57:15.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.839+0000 7f3a87200640 1 -- 172.21.15.17:0/3931933073 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a8819e0e0 con 0x7f3a880ffcc0 2024-09-13T15:57:15.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.840+0000 7f3a87200640 1 -- 172.21.15.17:0/3931933073 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a88107170 con 0x7f3a880ffcc0 2024-09-13T15:57:15.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.841+0000 7f3a7ea00640 1 -- 172.21.15.17:0/3931933073 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3a78010a60 con 0x7f3a880ffcc0 2024-09-13T15:57:15.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.843+0000 7f3a7ea00640 1 --2- 172.21.15.17:0/3931933073 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3a6c0a1090 0x7f3a6c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:15.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.843+0000 7f3a7ea00640 1 -- 172.21.15.17:0/3931933073 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f3a78014070 con 0x7f3a880ffcc0 2024-09-13T15:57:15.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.843+0000 7f3a85400640 1 --2- 172.21.15.17:0/3931933073 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3a6c0a1090 0x7f3a6c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:15.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.844+0000 7f3a85400640 1 --2- 172.21.15.17:0/3931933073 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3a6c0a1090 0x7f3a6c0a3550 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3a7402a9e0 tx=0x7f3a740314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:15.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:15.845+0000 7f3a7ea00640 1 -- 172.21.15.17:0/3931933073 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3a78075e20 con 0x7f3a880ffcc0 2024-09-13T15:57:16.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.024+0000 7f3a87200640 1 -- 172.21.15.17:0/3931933073 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3a8810b560 con 0x7f3a880ffcc0 2024-09-13T15:57:16.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.025+0000 7f3a7ea00640 1 -- 172.21.15.17:0/3931933073 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3a780967c0 con 0x7f3a880ffcc0 2024-09-13T15:57:16.026 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-13T15:57:16.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.027+0000 7f3a87200640 1 -- 172.21.15.17:0/3931933073 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3a6c0a1090 msgr2=0x7f3a6c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:16.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.027+0000 7f3a87200640 1 --2- 172.21.15.17:0/3931933073 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3a6c0a1090 0x7f3a6c0a3550 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3a7402a9e0 tx=0x7f3a740314a0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.027+0000 7f3a87200640 1 -- 172.21.15.17:0/3931933073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a880ffcc0 msgr2=0x7f3a88195c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:16.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.027+0000 7f3a87200640 1 --2- 172.21.15.17:0/3931933073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a880ffcc0 0x7f3a88195c70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3a7800e9c0 tx=0x7f3a7800ee80 comp rx=0 tx=0).stop 2024-09-13T15:57:16.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.027+0000 7f3a87200640 1 -- 172.21.15.17:0/3931933073 shutdown_connections 2024-09-13T15:57:16.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.027+0000 7f3a87200640 1 --2- 172.21.15.17:0/3931933073 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3a6c0a1090 0x7f3a6c0a3550 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.027+0000 7f3a87200640 1 --2- 172.21.15.17:0/3931933073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a88101870 0x7f3a8819d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.027+0000 7f3a87200640 1 --2- 172.21.15.17:0/3931933073 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a88100eb0 0x7f3a881961b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.027+0000 7f3a87200640 1 --2- 172.21.15.17:0/3931933073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a880ffcc0 0x7f3a88195c70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.027+0000 7f3a87200640 1 -- 172.21.15.17:0/3931933073 >> 172.21.15.17:0/3931933073 conn(0x7f3a880fb420 msgr2=0x7f3a88104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:16.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.027+0000 7f3a87200640 1 -- 172.21.15.17:0/3931933073 shutdown_connections 2024-09-13T15:57:16.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.027+0000 7f3a87200640 1 -- 172.21.15.17:0/3931933073 wait complete. 2024-09-13T15:57:16.045 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:57:16.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.205+0000 7f89d0600640 1 -- 172.21.15.17:0/963094925 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f89c80760b0 msgr2=0x7f89c8076510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:16.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.205+0000 7f89d0600640 1 --2- 172.21.15.17:0/963094925 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f89c80760b0 0x7f89c8076510 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f89b4009900 tx=0x7f89b402a410 comp rx=0 tx=0).stop 2024-09-13T15:57:16.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.205+0000 7f89d0600640 1 -- 172.21.15.17:0/963094925 shutdown_connections 2024-09-13T15:57:16.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.205+0000 7f89d0600640 1 --2- 172.21.15.17:0/963094925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89c8076a50 0x7f89c80772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.205+0000 7f89d0600640 1 --2- 172.21.15.17:0/963094925 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f89c80760b0 0x7f89c8076510 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.205+0000 7f89d0600640 1 --2- 172.21.15.17:0/963094925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89c8074e70 0x7f89c8075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.205+0000 7f89d0600640 1 -- 172.21.15.17:0/963094925 >> 172.21.15.17:0/963094925 conn(0x7f89c80fd700 msgr2=0x7f89c80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:16.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.205+0000 7f89d0600640 1 -- 172.21.15.17:0/963094925 shutdown_connections 2024-09-13T15:57:16.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.205+0000 7f89d0600640 1 -- 172.21.15.17:0/963094925 wait complete. 2024-09-13T15:57:16.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.206+0000 7f89d0600640 1 Processor -- start 2024-09-13T15:57:16.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.206+0000 7f89d0600640 1 -- start start 2024-09-13T15:57:16.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.207+0000 7f89d0600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89c8074e70 0x7f89c819c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:16.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.207+0000 7f89d0600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89c80760b0 0x7f89c819c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:16.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.207+0000 7f89d0600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f89c8076a50 0x7f89c81a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:16.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.207+0000 7f89d0600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c81a3ee0 con 0x7f89c80760b0 2024-09-13T15:57:16.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.207+0000 7f89d0600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c81a4050 con 0x7f89c8074e70 2024-09-13T15:57:16.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.207+0000 7f89d0600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c81a4210 con 0x7f89c8076a50 2024-09-13T15:57:16.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.207+0000 7f89cdc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89c8074e70 0x7f89c819c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:16.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.207+0000 7f89cdc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89c8074e70 0x7f89c819c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:58236/0 (socket says 172.21.15.17:58236) 2024-09-13T15:57:16.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.207+0000 7f89cdc00640 1 -- 172.21.15.17:0/3334984433 learned_addr learned my addr 172.21.15.17:0/3334984433 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:16.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.207+0000 7f89cd200640 1 --2- 172.21.15.17:0/3334984433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89c80760b0 0x7f89c819c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:16.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.207+0000 7f89ce600640 1 --2- 172.21.15.17:0/3334984433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f89c8076a50 0x7f89c81a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:16.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.207+0000 7f89cdc00640 1 -- 172.21.15.17:0/3334984433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f89c8076a50 msgr2=0x7f89c81a39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:16.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.207+0000 7f89cdc00640 1 --2- 172.21.15.17:0/3334984433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f89c8076a50 0x7f89c81a39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.207+0000 7f89cdc00640 1 -- 172.21.15.17:0/3334984433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89c80760b0 msgr2=0x7f89c819c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:16.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.207+0000 7f89cdc00640 1 --2- 172.21.15.17:0/3334984433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89c80760b0 0x7f89c819c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.207+0000 7f89cdc00640 1 -- 172.21.15.17:0/3334984433 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b4009560 con 0x7f89c8074e70 2024-09-13T15:57:16.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.208+0000 7f89cdc00640 1 --2- 172.21.15.17:0/3334984433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89c8074e70 0x7f89c819c3f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00e9f0 tx=0x7f89bc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:16.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.208+0000 7f89c6000640 1 -- 172.21.15.17:0/3334984433 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc009700 con 0x7f89c8074e70 2024-09-13T15:57:16.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.208+0000 7f89d0600640 1 -- 172.21.15.17:0/3334984433 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c81a44f0 con 0x7f89c8074e70 2024-09-13T15:57:16.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.208+0000 7f89c6000640 1 -- 172.21.15.17:0/3334984433 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f89bc00cd80 con 0x7f89c8074e70 2024-09-13T15:57:16.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.208+0000 7f89c6000640 1 -- 172.21.15.17:0/3334984433 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc018860 con 0x7f89c8074e70 2024-09-13T15:57:16.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.208+0000 7f89d0600640 1 -- 172.21.15.17:0/3334984433 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c81a49d0 con 0x7f89c8074e70 2024-09-13T15:57:16.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.209+0000 7f89d0600640 1 -- 172.21.15.17:0/3334984433 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c810eb90 con 0x7f89c8074e70 2024-09-13T15:57:16.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.211+0000 7f89c6000640 1 -- 172.21.15.17:0/3334984433 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f89bc0189c0 con 0x7f89c8074e70 2024-09-13T15:57:16.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.212+0000 7f89c6000640 1 --2- 172.21.15.17:0/3334984433 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f89b00a1090 0x7f89b00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:16.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.212+0000 7f89c6000640 1 -- 172.21.15.17:0/3334984433 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f89bc014070 con 0x7f89c8074e70 2024-09-13T15:57:16.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.213+0000 7f89cd200640 1 --2- 172.21.15.17:0/3334984433 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f89b00a1090 0x7f89b00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:16.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.213+0000 7f89cd200640 1 --2- 172.21.15.17:0/3334984433 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f89b00a1090 0x7f89b00a3550 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f89b4005ab0 tx=0x7f89b4005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:16.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.214+0000 7f89c6000640 1 -- 172.21.15.17:0/3334984433 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f89bc0963f0 con 0x7f89c8074e70 2024-09-13T15:57:16.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:15 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3848280891' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:57:16.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:15 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3272831332' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:57:16.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:15 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3848280891' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:57:16.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:15 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3272831332' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:57:16.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:15 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3848280891' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:57:16.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:15 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3272831332' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T15:57:16.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.397+0000 7f89d0600640 1 -- 172.21.15.17:0/3334984433 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f89c8111ce0 con 0x7f89c8074e70 2024-09-13T15:57:16.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.398+0000 7f89c6000640 1 -- 172.21.15.17:0/3334984433 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f89bc099a10 con 0x7f89c8074e70 2024-09-13T15:57:16.400 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-09-13T15:57:16.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.401+0000 7f89d0600640 1 -- 172.21.15.17:0/3334984433 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f89b00a1090 msgr2=0x7f89b00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:16.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.401+0000 7f89d0600640 1 --2- 172.21.15.17:0/3334984433 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f89b00a1090 0x7f89b00a3550 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f89b4005ab0 tx=0x7f89b4005780 comp rx=0 tx=0).stop 2024-09-13T15:57:16.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.401+0000 7f89d0600640 1 -- 172.21.15.17:0/3334984433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89c8074e70 msgr2=0x7f89c819c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:16.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.401+0000 7f89d0600640 1 --2- 172.21.15.17:0/3334984433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89c8074e70 0x7f89c819c3f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00e9f0 tx=0x7f89bc00eeb0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.401+0000 7f89d0600640 1 -- 172.21.15.17:0/3334984433 shutdown_connections 2024-09-13T15:57:16.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.401+0000 7f89d0600640 1 --2- 172.21.15.17:0/3334984433 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f89b00a1090 0x7f89b00a3550 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.401+0000 7f89d0600640 1 --2- 172.21.15.17:0/3334984433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f89c8076a50 0x7f89c81a39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.401+0000 7f89d0600640 1 --2- 172.21.15.17:0/3334984433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89c80760b0 0x7f89c819c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.401+0000 7f89d0600640 1 --2- 172.21.15.17:0/3334984433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f89c8074e70 0x7f89c819c3f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.401+0000 7f89d0600640 1 -- 172.21.15.17:0/3334984433 >> 172.21.15.17:0/3334984433 conn(0x7f89c80fd700 msgr2=0x7f89c80feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:16.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.401+0000 7f89d0600640 1 -- 172.21.15.17:0/3334984433 shutdown_connections 2024-09-13T15:57:16.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.401+0000 7f89d0600640 1 -- 172.21.15.17:0/3334984433 wait complete. 2024-09-13T15:57:16.419 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:57:16.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.581+0000 7f1ea4200640 1 -- 172.21.15.17:0/2699525889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e9c0ffd70 msgr2=0x7f1e9c100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:16.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.581+0000 7f1ea4200640 1 --2- 172.21.15.17:0/2699525889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e9c0ffd70 0x7f1e9c100170 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009900 tx=0x7f1e9002a3f0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.581+0000 7f1ea4200640 1 -- 172.21.15.17:0/2699525889 shutdown_connections 2024-09-13T15:57:16.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.581+0000 7f1ea4200640 1 --2- 172.21.15.17:0/2699525889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e9c101920 0x7f1e9c1081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.581+0000 7f1ea4200640 1 --2- 172.21.15.17:0/2699525889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e9c100f60 0x7f1e9c1013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.581+0000 7f1ea4200640 1 --2- 172.21.15.17:0/2699525889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e9c0ffd70 0x7f1e9c100170 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.581+0000 7f1ea4200640 1 -- 172.21.15.17:0/2699525889 >> 172.21.15.17:0/2699525889 conn(0x7f1e9c0fb4d0 msgr2=0x7f1e9c0fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:16.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.581+0000 7f1ea4200640 1 -- 172.21.15.17:0/2699525889 shutdown_connections 2024-09-13T15:57:16.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.581+0000 7f1ea4200640 1 -- 172.21.15.17:0/2699525889 wait complete. 2024-09-13T15:57:16.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.582+0000 7f1ea4200640 1 Processor -- start 2024-09-13T15:57:16.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.582+0000 7f1ea4200640 1 -- start start 2024-09-13T15:57:16.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.582+0000 7f1ea4200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e9c0ffd70 0x7f1e9c074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:16.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.582+0000 7f1ea4200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e9c100f60 0x7f1e9c0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:16.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.582+0000 7f1ea4200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e9c101920 0x7f1e9c072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.582+0000 7f1ea4200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c073540 con 0x7f1e9c0ffd70 2024-09-13T15:57:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.582+0000 7f1ea4200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c0736b0 con 0x7f1e9c100f60 2024-09-13T15:57:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.582+0000 7f1ea4200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c19fe30 con 0x7f1e9c101920 2024-09-13T15:57:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.582+0000 7f1ea1800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e9c0ffd70 0x7f1e9c074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.583+0000 7f1ea1800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e9c0ffd70 0x7f1e9c074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52996/0 (socket says 172.21.15.17:52996) 2024-09-13T15:57:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.583+0000 7f1ea1800640 1 -- 172.21.15.17:0/18375490 learned_addr learned my addr 172.21.15.17:0/18375490 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.583+0000 7f1ea2200640 1 --2- 172.21.15.17:0/18375490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e9c101920 0x7f1e9c072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.583+0000 7f1ea0e00640 1 --2- 172.21.15.17:0/18375490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e9c100f60 0x7f1e9c0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.583+0000 7f1ea1800640 1 -- 172.21.15.17:0/18375490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e9c101920 msgr2=0x7f1e9c072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.583+0000 7f1ea1800640 1 --2- 172.21.15.17:0/18375490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e9c101920 0x7f1e9c072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.583+0000 7f1ea1800640 1 -- 172.21.15.17:0/18375490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e9c100f60 msgr2=0x7f1e9c0728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.583+0000 7f1ea1800640 1 --2- 172.21.15.17:0/18375490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e9c100f60 0x7f1e9c0728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.583+0000 7f1ea1800640 1 -- 172.21.15.17:0/18375490 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e88009490 con 0x7f1e9c0ffd70 2024-09-13T15:57:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.583+0000 7f1ea0e00640 1 --2- 172.21.15.17:0/18375490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e9c100f60 0x7f1e9c0728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:57:16.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.583+0000 7f1ea1800640 1 --2- 172.21.15.17:0/18375490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e9c0ffd70 0x7f1e9c074260 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1e9002a910 tx=0x7f1e90003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:16.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.584+0000 7f1e9a000640 1 -- 172.21.15.17:0/18375490 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e900315a0 con 0x7f1e9c0ffd70 2024-09-13T15:57:16.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.584+0000 7f1ea4200640 1 -- 172.21.15.17:0/18375490 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e90009560 con 0x7f1e9c0ffd70 2024-09-13T15:57:16.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.584+0000 7f1e9a000640 1 -- 172.21.15.17:0/18375490 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1e90031bc0 con 0x7f1e9c0ffd70 2024-09-13T15:57:16.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.584+0000 7f1e9a000640 1 -- 172.21.15.17:0/18375490 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9003bb80 con 0x7f1e9c0ffd70 2024-09-13T15:57:16.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.584+0000 7f1ea4200640 1 -- 172.21.15.17:0/18375490 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9c1a03f0 con 0x7f1e9c0ffd70 2024-09-13T15:57:16.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.585+0000 7f1ea4200640 1 -- 172.21.15.17:0/18375490 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e9c1071f0 con 0x7f1e9c0ffd70 2024-09-13T15:57:16.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.587+0000 7f1e9a000640 1 -- 172.21.15.17:0/18375490 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1e9003bce0 con 0x7f1e9c0ffd70 2024-09-13T15:57:16.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.588+0000 7f1e9a000640 1 --2- 172.21.15.17:0/18375490 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1e840a1110 0x7f1e840a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:16.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.588+0000 7f1e9a000640 1 -- 172.21.15.17:0/18375490 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f1e900ed900 con 0x7f1e9c0ffd70 2024-09-13T15:57:16.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.588+0000 7f1ea0e00640 1 --2- 172.21.15.17:0/18375490 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1e840a1110 0x7f1e840a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:16.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.589+0000 7f1ea0e00640 1 --2- 172.21.15.17:0/18375490 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1e840a1110 0x7f1e840a35d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c073fd0 tx=0x7f1e88005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.590+0000 7f1e9a000640 1 -- 172.21.15.17:0/18375490 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1e900b6ce0 con 0x7f1e9c0ffd70 2024-09-13T15:57:16.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.769+0000 7f1ea4200640 1 -- 172.21.15.17:0/18375490 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1e9c02c3e0 con 0x7f1e9c0ffd70 2024-09-13T15:57:16.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.769+0000 7f1e9a000640 1 -- 172.21.15.17:0/18375490 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1e900490a0 con 0x7f1e9c0ffd70 2024-09-13T15:57:16.771 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-13T15:57:16.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.772+0000 7f1ea4200640 1 -- 172.21.15.17:0/18375490 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1e840a1110 msgr2=0x7f1e840a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:16.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.772+0000 7f1ea4200640 1 --2- 172.21.15.17:0/18375490 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1e840a1110 0x7f1e840a35d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c073fd0 tx=0x7f1e88005f90 comp rx=0 tx=0).stop 2024-09-13T15:57:16.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.772+0000 7f1ea4200640 1 -- 172.21.15.17:0/18375490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e9c0ffd70 msgr2=0x7f1e9c074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:16.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.772+0000 7f1ea4200640 1 --2- 172.21.15.17:0/18375490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e9c0ffd70 0x7f1e9c074260 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1e9002a910 tx=0x7f1e90003c10 comp rx=0 tx=0).stop 2024-09-13T15:57:16.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.772+0000 7f1ea4200640 1 -- 172.21.15.17:0/18375490 shutdown_connections 2024-09-13T15:57:16.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.772+0000 7f1ea4200640 1 --2- 172.21.15.17:0/18375490 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1e840a1110 0x7f1e840a35d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.772+0000 7f1ea4200640 1 --2- 172.21.15.17:0/18375490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e9c101920 0x7f1e9c072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.772+0000 7f1ea4200640 1 --2- 172.21.15.17:0/18375490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e9c100f60 0x7f1e9c0728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.772+0000 7f1ea4200640 1 --2- 172.21.15.17:0/18375490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e9c0ffd70 0x7f1e9c074260 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.772+0000 7f1ea4200640 1 -- 172.21.15.17:0/18375490 >> 172.21.15.17:0/18375490 conn(0x7f1e9c0fb4d0 msgr2=0x7f1e9c1043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:16.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.772+0000 7f1ea4200640 1 -- 172.21.15.17:0/18375490 shutdown_connections 2024-09-13T15:57:16.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.772+0000 7f1ea4200640 1 -- 172.21.15.17:0/18375490 wait complete. 2024-09-13T15:57:16.789 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:57:16.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.946+0000 7f7777600640 1 -- 172.21.15.17:0/2223234961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7770101fa0 msgr2=0x7f77701023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:16.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.946+0000 7f7777600640 1 --2- 172.21.15.17:0/2223234961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7770101fa0 0x7f77701023a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7764009900 tx=0x7f776402a3f0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.946+0000 7f7777600640 1 -- 172.21.15.17:0/2223234961 shutdown_connections 2024-09-13T15:57:16.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.946+0000 7f7777600640 1 --2- 172.21.15.17:0/2223234961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7770103b50 0x7f777010a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.946+0000 7f7777600640 1 --2- 172.21.15.17:0/2223234961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7770103190 0x7f7770103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.946+0000 7f7777600640 1 --2- 172.21.15.17:0/2223234961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7770101fa0 0x7f77701023a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.946+0000 7f7777600640 1 -- 172.21.15.17:0/2223234961 >> 172.21.15.17:0/2223234961 conn(0x7f77700fd700 msgr2=0x7f77700ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:16.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.946+0000 7f7777600640 1 -- 172.21.15.17:0/2223234961 shutdown_connections 2024-09-13T15:57:16.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.946+0000 7f7777600640 1 -- 172.21.15.17:0/2223234961 wait complete. 2024-09-13T15:57:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.947+0000 7f7777600640 1 Processor -- start 2024-09-13T15:57:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.947+0000 7f7777600640 1 -- start start 2024-09-13T15:57:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.948+0000 7f7777600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7770101fa0 0x7f7770197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.948+0000 7f7777600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7770103190 0x7f77701984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.948+0000 7f7777600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7770103b50 0x7f777019f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.948+0000 7f7777600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777019fa60 con 0x7f7770103b50 2024-09-13T15:57:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.948+0000 7f7777600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777019fbd0 con 0x7f7770103190 2024-09-13T15:57:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.948+0000 7f7777600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777019fd90 con 0x7f7770101fa0 2024-09-13T15:57:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.948+0000 7f7774c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7770101fa0 0x7f7770197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.948+0000 7f776fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7770103190 0x7f77701984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.948+0000 7f7774c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7770101fa0 0x7f7770197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:45850/0 (socket says 172.21.15.17:45850) 2024-09-13T15:57:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.948+0000 7f7774c00640 1 -- 172.21.15.17:0/3147381913 learned_addr learned my addr 172.21.15.17:0/3147381913 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.948+0000 7f7775600640 1 --2- 172.21.15.17:0/3147381913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7770103b50 0x7f777019f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.948+0000 7f7774c00640 1 -- 172.21.15.17:0/3147381913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7770103190 msgr2=0x7f77701984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.948+0000 7f7774c00640 1 --2- 172.21.15.17:0/3147381913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7770103190 0x7f77701984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.948+0000 7f7774c00640 1 -- 172.21.15.17:0/3147381913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7770103b50 msgr2=0x7f777019f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.948+0000 7f7774c00640 1 --2- 172.21.15.17:0/3147381913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7770103b50 0x7f777019f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.948+0000 7f7774c00640 1 -- 172.21.15.17:0/3147381913 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7764009560 con 0x7f7770101fa0 2024-09-13T15:57:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.948+0000 7f776fe00640 1 --2- 172.21.15.17:0/3147381913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7770103190 0x7f77701984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:57:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.949+0000 7f7774c00640 1 --2- 172.21.15.17:0/3147381913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7770101fa0 0x7f7770197f70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f77640057c0 tx=0x7f77640055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:16.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.949+0000 7f776d600640 1 -- 172.21.15.17:0/3147381913 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764004b50 con 0x7f7770101fa0 2024-09-13T15:57:16.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.949+0000 7f776d600640 1 -- 172.21.15.17:0/3147381913 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7764004cb0 con 0x7f7770101fa0 2024-09-13T15:57:16.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.949+0000 7f776d600640 1 -- 172.21.15.17:0/3147381913 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764031ae0 con 0x7f7770101fa0 2024-09-13T15:57:16.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.949+0000 7f7777600640 1 -- 172.21.15.17:0/3147381913 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77701a0010 con 0x7f7770101fa0 2024-09-13T15:57:16.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.949+0000 7f7777600640 1 -- 172.21.15.17:0/3147381913 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77701a0470 con 0x7f7770101fa0 2024-09-13T15:57:16.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.950+0000 7f7777600640 1 -- 172.21.15.17:0/3147381913 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77701094d0 con 0x7f7770101fa0 2024-09-13T15:57:16.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.953+0000 7f776d600640 1 -- 172.21.15.17:0/3147381913 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7764003c40 con 0x7f7770101fa0 2024-09-13T15:57:16.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.955+0000 7f776d600640 1 --2- 172.21.15.17:0/3147381913 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f77580a1110 0x7f77580a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:16.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.955+0000 7f776d600640 1 -- 172.21.15.17:0/3147381913 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f77640ee0d0 con 0x7f7770101fa0 2024-09-13T15:57:16.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.955+0000 7f776fe00640 1 --2- 172.21.15.17:0/3147381913 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f77580a1110 0x7f77580a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:16.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.956+0000 7f776fe00640 1 --2- 172.21.15.17:0/3147381913 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f77580a1110 0x7f77580a35d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7770199480 tx=0x7f775c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:16.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:16.957+0000 7f776d600640 1 -- 172.21.15.17:0/3147381913 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f77640b7560 con 0x7f7770101fa0 2024-09-13T15:57:17.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.175+0000 7f7777600640 1 -- 172.21.15.17:0/3147381913 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f777010d840 con 0x7f7770101fa0 2024-09-13T15:57:17.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.177+0000 7f776d600640 1 -- 172.21.15.17:0/3147381913 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10879 (secure 0 0 0) 0x7f7764040090 con 0x7f7770101fa0 2024-09-13T15:57:17.178 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:17.179 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1730156534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1730156534},{"type":"v1","addr":"172.21.15.17:6837","nonce":1730156534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/1295854211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1295854211},{"type":"v1","addr":"172.21.15.17:6841","nonce":1295854211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2888593680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2888593680},{"type":"v1","addr":"172.21.15.17:6835","nonce":2888593680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4135454212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4135454212},{"type":"v1","addr":"172.21.15.189:6835","nonce":4135454212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T15:54:52.929867+0000","modified":"2024-09-13T15:55:16.253229+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24565,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24520":{"gid":24520,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/4049465204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":4049465204},{"type":"v1","addr":"172.21.15.193:6835","nonce":4049465204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/2079181485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2079181485},{"type":"v1","addr":"172.21.15.189:6837","nonce":2079181485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24532":{"gid":24532,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/792056943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":792056943},{"type":"v1","addr":"172.21.15.193:6837","nonce":792056943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24553":{"gid":24553,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6839/3012199875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":3012199875},{"type":"v1","addr":"172.21.15.193:6839","nonce":3012199875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24565":{"gid":24565,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.17:6839/3750040765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3750040765},{"type":"v1","addr":"172.21.15.17:6839","nonce":3750040765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6839/2624723395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2624723395},{"type":"v1","addr":"172.21.15.189:6839","nonce":2624723395}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:57:17.179 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-13T15:57:17.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.179+0000 7f7777600640 1 -- 172.21.15.17:0/3147381913 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f77580a1110 msgr2=0x7f77580a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.179+0000 7f7777600640 1 --2- 172.21.15.17:0/3147381913 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f77580a1110 0x7f77580a35d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7770199480 tx=0x7f775c005f90 comp rx=0 tx=0).stop 2024-09-13T15:57:17.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.179+0000 7f7777600640 1 -- 172.21.15.17:0/3147381913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7770101fa0 msgr2=0x7f7770197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.179+0000 7f7777600640 1 --2- 172.21.15.17:0/3147381913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7770101fa0 0x7f7770197f70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f77640057c0 tx=0x7f77640055a0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.179+0000 7f7777600640 1 -- 172.21.15.17:0/3147381913 shutdown_connections 2024-09-13T15:57:17.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.179+0000 7f7777600640 1 --2- 172.21.15.17:0/3147381913 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f77580a1110 0x7f77580a35d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.179+0000 7f7777600640 1 --2- 172.21.15.17:0/3147381913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7770103b50 0x7f777019f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.179+0000 7f7777600640 1 --2- 172.21.15.17:0/3147381913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7770103190 0x7f77701984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.179+0000 7f7777600640 1 --2- 172.21.15.17:0/3147381913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7770101fa0 0x7f7770197f70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.179+0000 7f7777600640 1 -- 172.21.15.17:0/3147381913 >> 172.21.15.17:0/3147381913 conn(0x7f77700fd700 msgr2=0x7f77701066a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:17.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.179+0000 7f7777600640 1 -- 172.21.15.17:0/3147381913 shutdown_connections 2024-09-13T15:57:17.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.179+0000 7f7777600640 1 -- 172.21.15.17:0/3147381913 wait complete. 2024-09-13T15:57:17.194 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:16 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3931933073' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T15:57:17.194 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:16 smithi017 ceph-mon[30494]: pgmap v371: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:57:17.195 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:16 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3334984433' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T15:57:17.195 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:16 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/18375490' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T15:57:17.197 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:57:17.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:16 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3931933073' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T15:57:17.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:16 smithi193 ceph-mon[35248]: pgmap v371: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:57:17.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:16 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3334984433' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T15:57:17.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:16 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/18375490' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T15:57:17.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.352+0000 7f7ae7e00640 1 -- 172.21.15.17:0/3461123062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae8100610 msgr2=0x7f7ae8102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.352+0000 7f7ae7e00640 1 --2- 172.21.15.17:0/3461123062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae8100610 0x7f7ae8102a00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8009900 tx=0x7f7ad802a3f0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.352+0000 7f7ae7e00640 1 -- 172.21.15.17:0/3461123062 shutdown_connections 2024-09-13T15:57:17.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.352+0000 7f7ae7e00640 1 --2- 172.21.15.17:0/3461123062 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ae8105870 0x7f7ae8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.352+0000 7f7ae7e00640 1 --2- 172.21.15.17:0/3461123062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ae8102f40 0x7f7ae8105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.352+0000 7f7ae7e00640 1 --2- 172.21.15.17:0/3461123062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae8100610 0x7f7ae8102a00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.352+0000 7f7ae7e00640 1 -- 172.21.15.17:0/3461123062 >> 172.21.15.17:0/3461123062 conn(0x7f7ae80fa1f0 msgr2=0x7f7ae80fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:17.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.352+0000 7f7ae7e00640 1 -- 172.21.15.17:0/3461123062 shutdown_connections 2024-09-13T15:57:17.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.352+0000 7f7ae7e00640 1 -- 172.21.15.17:0/3461123062 wait complete. 2024-09-13T15:57:17.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.353+0000 7f7ae7e00640 1 Processor -- start 2024-09-13T15:57:17.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.353+0000 7f7ae7e00640 1 -- start start 2024-09-13T15:57:17.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.353+0000 7f7ae7e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ae8100610 0x7f7ae8197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.353+0000 7f7ae7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae8102f40 0x7f7ae8198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.353+0000 7f7ae7e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ae8105870 0x7f7ae819f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.353+0000 7f7ae7e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae819f930 con 0x7f7ae8102f40 2024-09-13T15:57:17.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.353+0000 7f7ae7e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae819faa0 con 0x7f7ae8105870 2024-09-13T15:57:17.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.353+0000 7f7ae7e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae819fc60 con 0x7f7ae8100610 2024-09-13T15:57:17.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.354+0000 7f7adfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae8102f40 0x7f7ae8198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.354+0000 7f7ae7400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ae8105870 0x7f7ae819f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.354+0000 7f7adfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae8102f40 0x7f7ae8198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53050/0 (socket says 172.21.15.17:53050) 2024-09-13T15:57:17.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.354+0000 7f7adfe00640 1 -- 172.21.15.17:0/2951345596 learned_addr learned my addr 172.21.15.17:0/2951345596 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:17.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.354+0000 7f7ae6a00640 1 --2- 172.21.15.17:0/2951345596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ae8100610 0x7f7ae8197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.354+0000 7f7ae7400640 1 -- 172.21.15.17:0/2951345596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ae8100610 msgr2=0x7f7ae8197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.354+0000 7f7ae7400640 1 --2- 172.21.15.17:0/2951345596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ae8100610 0x7f7ae8197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.354+0000 7f7ae7400640 1 -- 172.21.15.17:0/2951345596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae8102f40 msgr2=0x7f7ae8198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.354+0000 7f7ae7400640 1 --2- 172.21.15.17:0/2951345596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae8102f40 0x7f7ae8198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.354+0000 7f7ae7400640 1 -- 172.21.15.17:0/2951345596 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad8009560 con 0x7f7ae8105870 2024-09-13T15:57:17.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.354+0000 7f7adfe00640 1 --2- 172.21.15.17:0/2951345596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae8102f40 0x7f7ae8198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:57:17.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.354+0000 7f7ae7400640 1 --2- 172.21.15.17:0/2951345596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ae8105870 0x7f7ae819f3f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0005fd0 tx=0x7f7ae000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:17.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.355+0000 7f7adf400640 1 -- 172.21.15.17:0/2951345596 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae000cdf0 con 0x7f7ae8105870 2024-09-13T15:57:17.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.355+0000 7f7adf400640 1 -- 172.21.15.17:0/2951345596 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ae0005020 con 0x7f7ae8105870 2024-09-13T15:57:17.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.355+0000 7f7adf400640 1 -- 172.21.15.17:0/2951345596 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0010670 con 0x7f7ae8105870 2024-09-13T15:57:17.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.355+0000 7f7ae7e00640 1 -- 172.21.15.17:0/2951345596 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae819ff40 con 0x7f7ae8105870 2024-09-13T15:57:17.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.355+0000 7f7ae7e00640 1 -- 172.21.15.17:0/2951345596 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae81a0370 con 0x7f7ae8105870 2024-09-13T15:57:17.359 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:16 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3931933073' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T15:57:17.359 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:16 smithi189 ceph-mon[34790]: pgmap v371: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:57:17.359 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:16 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3334984433' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T15:57:17.359 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:16 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/18375490' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T15:57:17.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.356+0000 7f7ae7e00640 1 -- 172.21.15.17:0/2951345596 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae81073b0 con 0x7f7ae8105870 2024-09-13T15:57:17.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.358+0000 7f7adf400640 1 -- 172.21.15.17:0/2951345596 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7ae0005450 con 0x7f7ae8105870 2024-09-13T15:57:17.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.359+0000 7f7adf400640 1 --2- 172.21.15.17:0/2951345596 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7acc0a1110 0x7f7acc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.359+0000 7f7adf400640 1 -- 172.21.15.17:0/2951345596 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f7ae0014070 con 0x7f7ae8105870 2024-09-13T15:57:17.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.359+0000 7f7ae6a00640 1 --2- 172.21.15.17:0/2951345596 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7acc0a1110 0x7f7acc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.360+0000 7f7ae6a00640 1 --2- 172.21.15.17:0/2951345596 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7acc0a1110 0x7f7acc0a35d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8005ab0 tx=0x7f7ad8005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:17.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.361+0000 7f7adf400640 1 -- 172.21.15.17:0/2951345596 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7ae00966c0 con 0x7f7ae8105870 2024-09-13T15:57:17.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.544+0000 7f7ae7e00640 1 -- 172.21.15.17:0/2951345596 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ae802c410 con 0x7f7ae8105870 2024-09-13T15:57:17.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.546+0000 7f7adf400640 1 -- 172.21.15.17:0/2951345596 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24575 (secure 0 0 0) 0x7f7ae0099ce0 con 0x7f7ae8105870 2024-09-13T15:57:17.547 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:17.548 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":94,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","created":"2024-09-13T15:46:50.475750+0000","modified":"2024-09-13T15:56:44.228817+0000","last_up_change":"2024-09-13T15:53:59.138985+0000","last_in_change":"2024-09-13T15:53:39.220264+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:50:10.657011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:54:51.436469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:54:52.427930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:54:55.478058+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5d39d6af-15e6-463b-b9ff-a9a5dd94e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6803","nonce":158651212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6805","nonce":158651212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6809","nonce":158651212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6807","nonce":158651212}]},"public_addr":"172.21.15.17:6803/158651212","cluster_addr":"172.21.15.17:6805/158651212","heartbeat_back_addr":"172.21.15.17:6809/158651212","heartbeat_front_addr":"172.21.15.17:6807/158651212","state":["exists","up"]},{"osd":1,"uuid":"0da621c7-645b-44ae-ba7c-a573861c3aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6801","nonce":964319421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6803","nonce":964319421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6807","nonce":964319421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6805","nonce":964319421}]},"public_addr":"172.21.15.189:6801/964319421","cluster_addr":"172.21.15.189:6803/964319421","heartbeat_back_addr":"172.21.15.189:6807/964319421","heartbeat_front_addr":"172.21.15.189:6805/964319421","state":["exists","up"]},{"osd":2,"uuid":"fa95af60-1486-4a29-8c79-8a73a4146552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6801","nonce":138468002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6803","nonce":138468002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6807","nonce":138468002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6805","nonce":138468002}]},"public_addr":"172.21.15.193:6801/138468002","cluster_addr":"172.21.15.193:6803/138468002","heartbeat_back_addr":"172.21.15.193:6807/138468002","heartbeat_front_addr":"172.21.15.193:6805/138468002","state":["exists","up"]},{"osd":3,"uuid":"90428e5f-dfd4-4cda-b240-fdb9079bcb7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6811","nonce":919913803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6813","nonce":919913803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6817","nonce":919913803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6815","nonce":919913803}]},"public_addr":"172.21.15.17:6811/919913803","cluster_addr":"172.21.15.17:6813/919913803","heartbeat_back_addr":"172.21.15.17:6817/919913803","heartbeat_front_addr":"172.21.15.17:6815/919913803","state":["exists","up"]},{"osd":4,"uuid":"e1c537b6-98d2-4b66-b15a-65fe70b0ce25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6809","nonce":2310375565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6811","nonce":2310375565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6815","nonce":2310375565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6813","nonce":2310375565}]},"public_addr":"172.21.15.189:6809/2310375565","cluster_addr":"172.21.15.189:6811/2310375565","heartbeat_back_addr":"172.21.15.189:6815/2310375565","heartbeat_front_addr":"172.21.15.189:6813/2310375565","state":["exists","up"]},{"osd":5,"uuid":"48522fd7-d781-4447-873f-174dabd1e33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6809","nonce":1330877824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6811","nonce":1330877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6815","nonce":1330877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6813","nonce":1330877824}]},"public_addr":"172.21.15.193:6809/1330877824","cluster_addr":"172.21.15.193:6811/1330877824","heartbeat_back_addr":"172.21.15.193:6815/1330877824","heartbeat_front_addr":"172.21.15.193:6813/1330877824","state":["exists","up"]},{"osd":6,"uuid":"47bea191-fb53-40a7-8563-8ebf17dd5bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6819","nonce":3930545382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6821","nonce":3930545382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6825","nonce":3930545382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6823","nonce":3930545382}]},"public_addr":"172.21.15.17:6819/3930545382","cluster_addr":"172.21.15.17:6821/3930545382","heartbeat_back_addr":"172.21.15.17:6825/3930545382","heartbeat_front_addr":"172.21.15.17:6823/3930545382","state":["exists","up"]},{"osd":7,"uuid":"a98f36f9-0a19-4c9a-8ed1-615c4a6e7658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6817","nonce":3691677495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6819","nonce":3691677495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6823","nonce":3691677495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6821","nonce":3691677495}]},"public_addr":"172.21.15.189:6817/3691677495","cluster_addr":"172.21.15.189:6819/3691677495","heartbeat_back_addr":"172.21.15.189:6823/3691677495","heartbeat_front_addr":"172.21.15.189:6821/3691677495","state":["exists","up"]},{"osd":8,"uuid":"7a372d9f-c40f-4ead-87da-2f3a570c1373","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6817","nonce":4112907498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6819","nonce":4112907498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6823","nonce":4112907498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6821","nonce":4112907498}]},"public_addr":"172.21.15.193:6817/4112907498","cluster_addr":"172.21.15.193:6819/4112907498","heartbeat_back_addr":"172.21.15.193:6823/4112907498","heartbeat_front_addr":"172.21.15.193:6821/4112907498","state":["exists","up"]},{"osd":9,"uuid":"ac3d983c-c5e7-456b-8271-7c4e6169de61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6827","nonce":663424274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6829","nonce":663424274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6833","nonce":663424274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6831","nonce":663424274}]},"public_addr":"172.21.15.17:6827/663424274","cluster_addr":"172.21.15.17:6829/663424274","heartbeat_back_addr":"172.21.15.17:6833/663424274","heartbeat_front_addr":"172.21.15.17:6831/663424274","state":["exists","up"]},{"osd":10,"uuid":"08dcae02-6c79-4a06-ae88-6eb6e6941cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6825","nonce":3153990375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6827","nonce":3153990375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6831","nonce":3153990375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6829","nonce":3153990375}]},"public_addr":"172.21.15.189:6825/3153990375","cluster_addr":"172.21.15.189:6827/3153990375","heartbeat_back_addr":"172.21.15.189:6831/3153990375","heartbeat_front_addr":"172.21.15.189:6829/3153990375","state":["exists","up"]},{"osd":11,"uuid":"a4ebcf41-d805-4d44-b112-13ae84d51868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6825","nonce":4088053907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6827","nonce":4088053907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6831","nonce":4088053907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6829","nonce":4088053907}]},"public_addr":"172.21.15.193:6825/4088053907","cluster_addr":"172.21.15.193:6827/4088053907","heartbeat_back_addr":"172.21.15.193:6831/4088053907","heartbeat_front_addr":"172.21.15.193:6829/4088053907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:22.172370+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:44.802224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:06.641435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:34.536515+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:58.789324+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:22.189862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:50.382257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:14.678047+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:38.581105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:07.258150+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:32.261383+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:56.739338+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8},{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/1550067038":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/3360683829":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/634066188":"2024-09-14T15:47:42.048005+0000","172.21.15.17:6801/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1945536687":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/2214214377":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1224386591":"2024-09-14T15:47:14.996424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:57:17.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.548+0000 7f7ae7e00640 1 -- 172.21.15.17:0/2951345596 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7acc0a1110 msgr2=0x7f7acc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.548+0000 7f7ae7e00640 1 --2- 172.21.15.17:0/2951345596 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7acc0a1110 0x7f7acc0a35d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8005ab0 tx=0x7f7ad8005780 comp rx=0 tx=0).stop 2024-09-13T15:57:17.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.548+0000 7f7ae7e00640 1 -- 172.21.15.17:0/2951345596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ae8105870 msgr2=0x7f7ae819f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.548+0000 7f7ae7e00640 1 --2- 172.21.15.17:0/2951345596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ae8105870 0x7f7ae819f3f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0005fd0 tx=0x7f7ae000ef10 comp rx=0 tx=0).stop 2024-09-13T15:57:17.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.548+0000 7f7ae7e00640 1 -- 172.21.15.17:0/2951345596 shutdown_connections 2024-09-13T15:57:17.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.548+0000 7f7ae7e00640 1 --2- 172.21.15.17:0/2951345596 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7acc0a1110 0x7f7acc0a35d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.548+0000 7f7ae7e00640 1 --2- 172.21.15.17:0/2951345596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ae8105870 0x7f7ae819f3f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.548+0000 7f7ae7e00640 1 --2- 172.21.15.17:0/2951345596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae8102f40 0x7f7ae8198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.548+0000 7f7ae7e00640 1 --2- 172.21.15.17:0/2951345596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ae8100610 0x7f7ae8197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.548+0000 7f7ae7e00640 1 -- 172.21.15.17:0/2951345596 >> 172.21.15.17:0/2951345596 conn(0x7f7ae80fa1f0 msgr2=0x7f7ae80ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:17.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.548+0000 7f7ae7e00640 1 -- 172.21.15.17:0/2951345596 shutdown_connections 2024-09-13T15:57:17.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.548+0000 7f7ae7e00640 1 -- 172.21.15.17:0/2951345596 wait complete. 2024-09-13T15:57:17.566 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-13T15:54:52.929867+0000', 'modified': '2024-09-13T15:55:16.253229+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24578, 'mds_1': 24565, 'mds_2': 24553}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24520': {'gid': 24520, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.193:6835/4049465204', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6834', 'nonce': 4049465204}, {'type': 'v1', 'addr': '172.21.15.193:6835', 'nonce': 4049465204}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24524': {'gid': 24524, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6837/2079181485', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6836', 'nonce': 2079181485}, {'type': 'v1', 'addr': '172.21.15.189:6837', 'nonce': 2079181485}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24532': {'gid': 24532, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.193:6837/792056943', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6836', 'nonce': 792056943}, {'type': 'v1', 'addr': '172.21.15.193:6837', 'nonce': 792056943}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24553': {'gid': 24553, 'name': 'i', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.193:6839/3012199875', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6838', 'nonce': 3012199875}, {'type': 'v1', 'addr': '172.21.15.193:6839', 'nonce': 3012199875}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24565': {'gid': 24565, 'name': 'g', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.17:6839/3750040765', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6838', 'nonce': 3750040765}, {'type': 'v1', 'addr': '172.21.15.17:6839', 'nonce': 3750040765}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24578': {'gid': 24578, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.189:6839/2624723395', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 2624723395}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 2624723395}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T15:57:17.567 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-13T15:57:17.567 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-09-13T15:57:17.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.723+0000 7ff839400640 1 -- 172.21.15.17:0/230809657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff834100f60 msgr2=0x7ff8341013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.723+0000 7ff839400640 1 --2- 172.21.15.17:0/230809657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff834100f60 0x7ff8341013e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff820009900 tx=0x7ff82002a3f0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.723+0000 7ff839400640 1 -- 172.21.15.17:0/230809657 shutdown_connections 2024-09-13T15:57:17.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.723+0000 7ff839400640 1 --2- 172.21.15.17:0/230809657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff834101920 0x7ff8341081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.723+0000 7ff839400640 1 --2- 172.21.15.17:0/230809657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff834100f60 0x7ff8341013e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.723+0000 7ff839400640 1 --2- 172.21.15.17:0/230809657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8340ffd70 0x7ff834100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.723+0000 7ff839400640 1 -- 172.21.15.17:0/230809657 >> 172.21.15.17:0/230809657 conn(0x7ff8340fb4d0 msgr2=0x7ff8340fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:17.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.723+0000 7ff839400640 1 -- 172.21.15.17:0/230809657 shutdown_connections 2024-09-13T15:57:17.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.723+0000 7ff839400640 1 -- 172.21.15.17:0/230809657 wait complete. 2024-09-13T15:57:17.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.724+0000 7ff839400640 1 Processor -- start 2024-09-13T15:57:17.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.724+0000 7ff839400640 1 -- start start 2024-09-13T15:57:17.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.724+0000 7ff839400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8340ffd70 0x7ff834195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.725+0000 7ff839400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff834100f60 0x7ff834196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.725+0000 7ff839400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff834101920 0x7ff83419d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.725+0000 7ff839400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83419d8b0 con 0x7ff834100f60 2024-09-13T15:57:17.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.725+0000 7ff839400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83419da20 con 0x7ff834101920 2024-09-13T15:57:17.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.725+0000 7ff839400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83419dbe0 con 0x7ff8340ffd70 2024-09-13T15:57:17.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.725+0000 7ff832800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8340ffd70 0x7ff834195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.725+0000 7ff831e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff834100f60 0x7ff834196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.725+0000 7ff832800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8340ffd70 0x7ff834195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:45892/0 (socket says 172.21.15.17:45892) 2024-09-13T15:57:17.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.725+0000 7ff832800640 1 -- 172.21.15.17:0/998973950 learned_addr learned my addr 172.21.15.17:0/998973950 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:17.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.725+0000 7ff833200640 1 --2- 172.21.15.17:0/998973950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff834101920 0x7ff83419d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.725+0000 7ff832800640 1 -- 172.21.15.17:0/998973950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff834101920 msgr2=0x7ff83419d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.725+0000 7ff832800640 1 --2- 172.21.15.17:0/998973950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff834101920 0x7ff83419d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.725+0000 7ff832800640 1 -- 172.21.15.17:0/998973950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff834100f60 msgr2=0x7ff834196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.725+0000 7ff832800640 1 --2- 172.21.15.17:0/998973950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff834100f60 0x7ff834196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.725+0000 7ff832800640 1 -- 172.21.15.17:0/998973950 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff820009560 con 0x7ff8340ffd70 2024-09-13T15:57:17.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.725+0000 7ff832800640 1 --2- 172.21.15.17:0/998973950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8340ffd70 0x7ff834195dc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff82400e9c0 tx=0x7ff82400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:17.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.726+0000 7ff82b400640 1 -- 172.21.15.17:0/998973950 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8240096e0 con 0x7ff8340ffd70 2024-09-13T15:57:17.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.726+0000 7ff82b400640 1 -- 172.21.15.17:0/998973950 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8240044f0 con 0x7ff8340ffd70 2024-09-13T15:57:17.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.726+0000 7ff839400640 1 -- 172.21.15.17:0/998973950 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83419dec0 con 0x7ff8340ffd70 2024-09-13T15:57:17.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.726+0000 7ff82b400640 1 -- 172.21.15.17:0/998973950 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff824010430 con 0x7ff8340ffd70 2024-09-13T15:57:17.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.726+0000 7ff839400640 1 -- 172.21.15.17:0/998973950 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83419e2e0 con 0x7ff8340ffd70 2024-09-13T15:57:17.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.729+0000 7ff83c23e740 1 Processor -- start 2024-09-13T15:57:17.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.729+0000 7ff83c23e740 1 -- start start 2024-09-13T15:57:17.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.729+0000 7ff82b400640 1 -- 172.21.15.17:0/998973950 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff8240035f0 con 0x7ff8340ffd70 2024-09-13T15:57:17.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.729+0000 7ff83c23e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd1bb30 0x5565bbd1bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.729+0000 7ff83c23e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd1c470 0x5565bbd20f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.729+0000 7ff83c23e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd21500 0x5565bbd239c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.729+0000 7ff83c23e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bbc85ab0 con 0x5565bbd1c470 2024-09-13T15:57:17.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.729+0000 7ff83c23e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bbc83240 con 0x5565bbd21500 2024-09-13T15:57:17.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.729+0000 7ff83c23e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bbc7eb30 con 0x5565bbd1bb30 2024-09-13T15:57:17.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.729+0000 7ff832800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd1c470 0x5565bbd20f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.729+0000 7ff832800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd1c470 0x5565bbd20f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53068/0 (socket says 172.21.15.17:53068) 2024-09-13T15:57:17.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.729+0000 7ff833200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd1bb30 0x5565bbd1bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.729+0000 7ff832800640 1 -- 172.21.15.17:0/691723065 learned_addr learned my addr 172.21.15.17:0/691723065 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:17.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.730+0000 7ff831e00640 1 --2- 172.21.15.17:0/691723065 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd21500 0x5565bbd239c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.730+0000 7ff832800640 1 -- 172.21.15.17:0/691723065 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd1bb30 msgr2=0x5565bbd1bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:17.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.730+0000 7ff832800640 1 --2- 172.21.15.17:0/691723065 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd1bb30 0x5565bbd1bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.730+0000 7ff832800640 1 -- 172.21.15.17:0/691723065 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd21500 msgr2=0x5565bbd239c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:17.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.730+0000 7ff832800640 1 --2- 172.21.15.17:0/691723065 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd21500 0x5565bbd239c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.730+0000 7ff832800640 1 -- 172.21.15.17:0/691723065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565bbc49bd0 con 0x5565bbd1c470 2024-09-13T15:57:17.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.730+0000 7ff833200640 1 --2- 172.21.15.17:0/691723065 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd1bb30 0x5565bbd1bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:57:17.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.730+0000 7ff832800640 1 --2- 172.21.15.17:0/691723065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd1c470 0x5565bbd20f30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff8240d0d60 tx=0x7ff8240d0e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59549a941d900ea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.730+0000 7ff81fe00640 1 -- 172.21.15.17:0/691723065 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8240de440 con 0x5565bbd1c470 2024-09-13T15:57:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.731+0000 7ff81fe00640 1 -- 172.21.15.17:0/691723065 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8240d28e0 con 0x5565bbd1c470 2024-09-13T15:57:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.731+0000 7ff82b400640 1 --2- 172.21.15.17:0/998973950 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff8180a1110 0x7ff8180a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.731+0000 7ff81fe00640 1 -- 172.21.15.17:0/691723065 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8240dd7b0 con 0x5565bbd1c470 2024-09-13T15:57:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.731+0000 7ff82b400640 1 -- 172.21.15.17:0/998973950 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7ff824014070 con 0x7ff8340ffd70 2024-09-13T15:57:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.731+0000 7ff833200640 1 --2- 172.21.15.17:0/998973950 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff8180a1110 0x7ff8180a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.731+0000 7ff83c23e740 1 -- 172.21.15.17:0/691723065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd1c470 msgr2=0x5565bbd20f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.731+0000 7ff83c23e740 1 --2- 172.21.15.17:0/691723065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd1c470 0x5565bbd20f30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff8240d0d60 tx=0x7ff8240d0e50 comp rx=0 tx=0).stop 2024-09-13T15:57:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.731+0000 7ff83c23e740 1 -- 172.21.15.17:0/691723065 shutdown_connections 2024-09-13T15:57:17.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.731+0000 7ff83c23e740 1 --2- 172.21.15.17:0/691723065 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd21500 0x5565bbd239c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.731+0000 7ff83c23e740 1 --2- 172.21.15.17:0/691723065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd1c470 0x5565bbd20f30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.731+0000 7ff83c23e740 1 --2- 172.21.15.17:0/691723065 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd1bb30 0x5565bbd1bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.731+0000 7ff83c23e740 1 -- 172.21.15.17:0/691723065 >> 172.21.15.17:0/691723065 conn(0x5565bbd171a0 msgr2=0x5565bbd175a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:17.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.731+0000 7ff83c23e740 1 -- 172.21.15.17:0/691723065 shutdown_connections 2024-09-13T15:57:17.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.732+0000 7ff83c23e740 1 -- 172.21.15.17:0/691723065 wait complete. 2024-09-13T15:57:17.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.732+0000 7ff833200640 1 --2- 172.21.15.17:0/998973950 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff8180a1110 0x7ff8180a35d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff82c005fd0 tx=0x7ff82c0096a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:17.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.732+0000 7ff83c23e740 1 -- start start 2024-09-13T15:57:17.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.732+0000 7ff83c23e740 1 Processor -- start 2024-09-13T15:57:17.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.733+0000 7ff83c23e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd1bb30 0x5565bbd29bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.733+0000 7ff83c23e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd1c470 0x5565bbd2a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.733+0000 7ff83c23e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd21500 0x5565bbd310f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.733+0000 7ff83c23e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bbc20260 con 0x5565bbd21500 2024-09-13T15:57:17.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.733+0000 7ff83c23e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bbc1ff00 con 0x5565bbd1bb30 2024-09-13T15:57:17.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.733+0000 7ff83c23e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bb9e5f20 con 0x5565bbd1c470 2024-09-13T15:57:17.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.733+0000 7ff83c23e740 10 client.0 _ll_register_callbacks cb 0x5565bbc781a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:57:17.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.733+0000 7ff831e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd1c470 0x5565bbd2a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.733+0000 7ff833200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd21500 0x5565bbd310f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.733+0000 7ff831e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd1c470 0x5565bbd2a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:45908/0 (socket says 172.21.15.17:45908) 2024-09-13T15:57:17.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.733+0000 7ff832800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd1bb30 0x5565bbd29bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.733+0000 7ff831e00640 1 -- 172.21.15.17:0/3384845961 learned_addr learned my addr 172.21.15.17:0/3384845961 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:17.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.733+0000 7ff832800640 1 -- 172.21.15.17:0/3384845961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd1c470 msgr2=0x5565bbd2a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:17.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.733+0000 7ff832800640 1 --2- 172.21.15.17:0/3384845961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd1c470 0x5565bbd2a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.733+0000 7ff832800640 1 -- 172.21.15.17:0/3384845961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd21500 msgr2=0x5565bbd310f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:17.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.733+0000 7ff832800640 1 --2- 172.21.15.17:0/3384845961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd21500 0x5565bbd310f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.733+0000 7ff832800640 1 -- 172.21.15.17:0/3384845961 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83419e2e0 con 0x5565bbd1bb30 2024-09-13T15:57:17.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.734+0000 7ff832800640 1 --2- 172.21.15.17:0/3384845961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd1bb30 0x5565bbd29bc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff824096560 tx=0x7ff8240d2e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ed339083f3fa04b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:17.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.734+0000 7ff81cc00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T15:57:17.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.734+0000 7ff81cc00640 1 -- 172.21.15.17:0/3384845961 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8240d0330 con 0x5565bbd1bb30 2024-09-13T15:57:17.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.734+0000 7ff83c23e740 1 -- 172.21.15.17:0/3384845961 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5565bbca8cd0 con 0x5565bbd1bb30 2024-09-13T15:57:17.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.734+0000 7ff81cc00640 1 -- 172.21.15.17:0/3384845961 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7ff82400cd80 con 0x5565bbd1bb30 2024-09-13T15:57:17.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.734+0000 7ff81cc00640 1 -- 172.21.15.17:0/3384845961 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8240963a0 con 0x5565bbd1bb30 2024-09-13T15:57:17.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.734+0000 7ff83c23e740 10 client.25319 fetch_fsmap learned FSMap version 24 2024-09-13T15:57:17.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.734+0000 7ff83c23e740 1 -- 172.21.15.17:0/3384845961 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5565bbc7d1b0 con 0x5565bbd1bb30 2024-09-13T15:57:17.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.734+0000 7ff81cc00640 1 -- 172.21.15.17:0/3384845961 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5565bbca8cd0 con 0x5565bbd1bb30 2024-09-13T15:57:17.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.734+0000 7ff81cc00640 1 -- 172.21.15.17:0/3384845961 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ff82401f060 con 0x5565bbd1bb30 2024-09-13T15:57:17.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.735+0000 7ff83c23e740 10 client.25319 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T15:57:17.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.735+0000 7ff83c23e740 10 client.25319 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-13T15:57:17.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.735+0000 7ff83c23e740 20 client.25319 populate_metadata read hostname 'smithi017' 2024-09-13T15:57:17.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.735+0000 7ff83c23e740 1 --2- 172.21.15.17:0/3384845961 >> [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] conn(0x5565bbd35ca0 0x5565bbd39e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.735+0000 7ff83c23e740 4 client.25319 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:57:17.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.735+0000 7ff83c23e740 1 -- 172.21.15.17:0/3384845961 --> [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5565bb9723c0 con 0x5565bbd35ca0 2024-09-13T15:57:17.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.735+0000 7ff831e00640 1 --2- 172.21.15.17:0/3384845961 >> [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] conn(0x5565bbd35ca0 0x5565bbd39e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.736+0000 7ff831e00640 1 --2- 172.21.15.17:0/3384845961 >> [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] conn(0x5565bbd35ca0 0x5565bbd39e20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5f1f121ae54074f9 server_cookie=f49e7dc4d02ff700 in_seq=0 out_seq=0 2024-09-13T15:57:17.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.736+0000 7ff81cc00640 10 client.25319 ms_handle_connect on v2:172.21.15.193:6838/3012199875 2024-09-13T15:57:17.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.736+0000 7ff81cc00640 1 -- 172.21.15.17:0/3384845961 <== mds.2 v2:172.21.15.193:6838/3012199875 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5565bb9723c0 con 0x5565bbd35ca0 2024-09-13T15:57:17.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.736+0000 7ff81cc00640 10 client.25319 handle_command_reply: tid=0 2024-09-13T15:57:17.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.736+0000 7ff83c23e740 1 client.25319 shutdown 2024-09-13T15:57:17.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.737+0000 7ff83c23e740 1 -- 172.21.15.17:0/3384845961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd1bb30 msgr2=0x5565bbd29bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.737+0000 7ff83c23e740 1 --2- 172.21.15.17:0/3384845961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd1bb30 0x5565bbd29bc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff824096560 tx=0x7ff8240d2e30 comp rx=0 tx=0).stop 2024-09-13T15:57:17.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.737+0000 7ff83c23e740 1 -- 172.21.15.17:0/3384845961 shutdown_connections 2024-09-13T15:57:17.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.737+0000 7ff83c23e740 1 --2- 172.21.15.17:0/3384845961 >> [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] conn(0x5565bbd35ca0 0x5565bbd39e20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.737+0000 7ff83c23e740 1 --2- 172.21.15.17:0/3384845961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd21500 0x5565bbd310f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.737+0000 7ff83c23e740 1 --2- 172.21.15.17:0/3384845961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd1c470 0x5565bbd2a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.737+0000 7ff83c23e740 1 --2- 172.21.15.17:0/3384845961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd1bb30 0x5565bbd29bc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.737+0000 7ff81cc00640 0 client.25319 ms_handle_reset on v2:172.21.15.193:6838/3012199875 2024-09-13T15:57:17.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.737+0000 7ff83c23e740 1 -- 172.21.15.17:0/3384845961 >> 172.21.15.17:0/3384845961 conn(0x5565bbd171a0 msgr2=0x5565bbd189b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:17.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.737+0000 7ff83c23e740 1 -- 172.21.15.17:0/3384845961 shutdown_connections 2024-09-13T15:57:17.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.737+0000 7ff83c23e740 1 -- 172.21.15.17:0/3384845961 wait complete. 2024-09-13T15:57:17.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.737+0000 7ff83c23e740 20 client.25319 trim_cache size 0 max 16384 2024-09-13T15:57:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.752+0000 7ff83c23e740 1 Processor -- start 2024-09-13T15:57:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.752+0000 7ff83c23e740 1 -- start start 2024-09-13T15:57:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.753+0000 7ff83c23e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd171a0 0x5565bbd16bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.753+0000 7ff83c23e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd1bb30 0x5565bbd2a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.753+0000 7ff83c23e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd1c470 0x5565bbd3de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.753+0000 7ff83c23e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bbca8cd0 con 0x5565bbd1c470 2024-09-13T15:57:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.753+0000 7ff83c23e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bbc3c7e0 con 0x5565bbd1bb30 2024-09-13T15:57:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.753+0000 7ff83c23e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bbc778d0 con 0x5565bbd171a0 2024-09-13T15:57:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.753+0000 7ff833200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd1c470 0x5565bbd3de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.753+0000 7ff833200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd1c470 0x5565bbd3de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53082/0 (socket says 172.21.15.17:53082) 2024-09-13T15:57:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.753+0000 7ff833200640 1 -- 172.21.15.17:0/3501049742 learned_addr learned my addr 172.21.15.17:0/3501049742 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.753+0000 7ff831e00640 1 --2- 172.21.15.17:0/3501049742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd1bb30 0x5565bbd2a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.753+0000 7ff832800640 1 --2- 172.21.15.17:0/3501049742 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd171a0 0x5565bbd16bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.753+0000 7ff833200640 1 -- 172.21.15.17:0/3501049742 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd171a0 msgr2=0x5565bbd16bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:17.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.753+0000 7ff833200640 1 --2- 172.21.15.17:0/3501049742 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd171a0 0x5565bbd16bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.753+0000 7ff833200640 1 -- 172.21.15.17:0/3501049742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd1bb30 msgr2=0x5565bbd2a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:17.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.753+0000 7ff833200640 1 --2- 172.21.15.17:0/3501049742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd1bb30 0x5565bbd2a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.753+0000 7ff833200640 1 -- 172.21.15.17:0/3501049742 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565bbc1f470 con 0x5565bbd1c470 2024-09-13T15:57:17.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.754+0000 7ff833200640 1 --2- 172.21.15.17:0/3501049742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd1c470 0x5565bbd3de40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff82c01e5c0 tx=0x7ff82c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88f85fd0b10a0c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:17.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.754+0000 7ff828c00640 1 -- 172.21.15.17:0/3501049742 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c024040 con 0x5565bbd1c470 2024-09-13T15:57:17.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.754+0000 7ff828c00640 1 -- 172.21.15.17:0/3501049742 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff82c011a20 con 0x5565bbd1c470 2024-09-13T15:57:17.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.754+0000 7ff828c00640 1 -- 172.21.15.17:0/3501049742 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c016070 con 0x5565bbd1c470 2024-09-13T15:57:17.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.754+0000 7ff83c23e740 1 -- 172.21.15.17:0/3501049742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd1c470 msgr2=0x5565bbd3de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.755+0000 7ff83c23e740 1 --2- 172.21.15.17:0/3501049742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd1c470 0x5565bbd3de40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff82c01e5c0 tx=0x7ff82c019000 comp rx=0 tx=0).stop 2024-09-13T15:57:17.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.755+0000 7ff83c23e740 1 -- 172.21.15.17:0/3501049742 shutdown_connections 2024-09-13T15:57:17.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.755+0000 7ff83c23e740 1 --2- 172.21.15.17:0/3501049742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd1c470 0x5565bbd3de40 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.755+0000 7ff83c23e740 1 --2- 172.21.15.17:0/3501049742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd1bb30 0x5565bbd2a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.755+0000 7ff83c23e740 1 --2- 172.21.15.17:0/3501049742 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd171a0 0x5565bbd16bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.755+0000 7ff83c23e740 1 -- 172.21.15.17:0/3501049742 >> 172.21.15.17:0/3501049742 conn(0x5565bbd12670 msgr2=0x5565bbd29970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:17.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.755+0000 7ff83c23e740 1 -- 172.21.15.17:0/3501049742 shutdown_connections 2024-09-13T15:57:17.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.755+0000 7ff83c23e740 1 -- 172.21.15.17:0/3501049742 wait complete. 2024-09-13T15:57:17.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.755+0000 7ff83c23e740 1 -- start start 2024-09-13T15:57:17.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.755+0000 7ff83c23e740 1 Processor -- start 2024-09-13T15:57:17.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.756+0000 7ff83c23e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd171a0 0x5565bbd26250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.756+0000 7ff83c23e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd1bb30 0x5565bbd26790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.756+0000 7ff83c23e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd1c470 0x5565bbd2f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.756+0000 7ff83c23e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bbd26ed0 con 0x5565bbd1bb30 2024-09-13T15:57:17.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.756+0000 7ff83c23e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bbd2f570 con 0x5565bbd171a0 2024-09-13T15:57:17.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.756+0000 7ff83c23e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bbd2f730 con 0x5565bbd1c470 2024-09-13T15:57:17.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.756+0000 7ff83c23e740 10 client.0 _ll_register_callbacks cb 0x7ff820009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:57:17.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.756+0000 7ff832800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd171a0 0x5565bbd26250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.756+0000 7ff831e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd1bb30 0x5565bbd26790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.756+0000 7ff832800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd171a0 0x5565bbd26250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:58358/0 (socket says 172.21.15.17:58358) 2024-09-13T15:57:17.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.756+0000 7ff832800640 1 -- 172.21.15.17:0/2271891648 learned_addr learned my addr 172.21.15.17:0/2271891648 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:17.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.756+0000 7ff833200640 1 --2- 172.21.15.17:0/2271891648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd1c470 0x5565bbd2f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.756+0000 7ff832800640 1 -- 172.21.15.17:0/2271891648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd1c470 msgr2=0x5565bbd2f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:17.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.756+0000 7ff832800640 1 --2- 172.21.15.17:0/2271891648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd1c470 0x5565bbd2f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.756+0000 7ff832800640 1 -- 172.21.15.17:0/2271891648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd1bb30 msgr2=0x5565bbd26790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.756+0000 7ff832800640 1 --2- 172.21.15.17:0/2271891648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd1bb30 0x5565bbd26790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.756+0000 7ff832800640 1 -- 172.21.15.17:0/2271891648 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82c003e60 con 0x5565bbd171a0 2024-09-13T15:57:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.756+0000 7ff833200640 1 --2- 172.21.15.17:0/2271891648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd1c470 0x5565bbd2f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:57:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.756+0000 7ff832800640 1 --2- 172.21.15.17:0/2271891648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd171a0 0x5565bbd26250 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff82400c6a0 tx=0x7ff8240b84d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69dda5da85f2757f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.756+0000 7ff81cc00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T15:57:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.757+0000 7ff81cc00640 1 -- 172.21.15.17:0/2271891648 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8240d0330 con 0x5565bbd171a0 2024-09-13T15:57:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.757+0000 7ff81cc00640 1 -- 172.21.15.17:0/2271891648 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7ff82400cd80 con 0x5565bbd171a0 2024-09-13T15:57:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.757+0000 7ff83c23e740 1 -- 172.21.15.17:0/2271891648 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff8240d28e0 con 0x5565bbd171a0 2024-09-13T15:57:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.757+0000 7ff81cc00640 1 -- 172.21.15.17:0/2271891648 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8240d5810 con 0x5565bbd171a0 2024-09-13T15:57:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.757+0000 7ff83c23e740 10 client.25325 fetch_fsmap learned FSMap version 24 2024-09-13T15:57:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.757+0000 7ff83c23e740 1 -- 172.21.15.17:0/2271891648 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5565bbc44980 con 0x5565bbd171a0 2024-09-13T15:57:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.757+0000 7ff81cc00640 1 -- 172.21.15.17:0/2271891648 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8240d28e0 con 0x5565bbd171a0 2024-09-13T15:57:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.757+0000 7ff81cc00640 1 -- 172.21.15.17:0/2271891648 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ff8240d7d90 con 0x5565bbd171a0 2024-09-13T15:57:17.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.757+0000 7ff83c23e740 10 client.25325 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T15:57:17.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.757+0000 7ff83c23e740 10 client.25325 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-13T15:57:17.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.757+0000 7ff83c23e740 20 client.25325 populate_metadata read hostname 'smithi017' 2024-09-13T15:57:17.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.757+0000 7ff83c23e740 1 --2- 172.21.15.17:0/2271891648 >> [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] conn(0x5565bbd21500 0x5565bbd922e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.757+0000 7ff83c23e740 4 client.25325 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:57:17.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.757+0000 7ff83c23e740 1 -- 172.21.15.17:0/2271891648 --> [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5565bb9836c0 con 0x5565bbd21500 2024-09-13T15:57:17.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.758+0000 7ff831e00640 1 --2- 172.21.15.17:0/2271891648 >> [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] conn(0x5565bbd21500 0x5565bbd922e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.758+0000 7ff831e00640 1 --2- 172.21.15.17:0/2271891648 >> [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] conn(0x5565bbd21500 0x5565bbd922e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c999a8d7e7d4b5b8 server_cookie=ab7411e5f4b89b8b in_seq=0 out_seq=0 2024-09-13T15:57:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.758+0000 7ff81cc00640 10 client.25325 ms_handle_connect on v2:172.21.15.193:6838/3012199875 2024-09-13T15:57:17.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.759+0000 7ff81cc00640 1 -- 172.21.15.17:0/2271891648 <== mds.2 v2:172.21.15.193:6838/3012199875 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x5565bb9836c0 con 0x5565bbd21500 2024-09-13T15:57:17.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.759+0000 7ff81cc00640 10 client.25325 handle_command_reply: tid=0 2024-09-13T15:57:17.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.759+0000 7ff83c23e740 1 client.25325 shutdown 2024-09-13T15:57:17.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.759+0000 7ff83c23e740 1 -- 172.21.15.17:0/2271891648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd171a0 msgr2=0x5565bbd26250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.759+0000 7ff83c23e740 1 --2- 172.21.15.17:0/2271891648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd171a0 0x5565bbd26250 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff82400c6a0 tx=0x7ff8240b84d0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.759+0000 7ff83c23e740 1 -- 172.21.15.17:0/2271891648 shutdown_connections 2024-09-13T15:57:17.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.759+0000 7ff83c23e740 1 --2- 172.21.15.17:0/2271891648 >> [v2:172.21.15.193:6838/3012199875,v1:172.21.15.193:6839/3012199875] conn(0x5565bbd21500 0x5565bbd922e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.759+0000 7ff83c23e740 1 --2- 172.21.15.17:0/2271891648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565bbd1c470 0x5565bbd2f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.759+0000 7ff83c23e740 1 --2- 172.21.15.17:0/2271891648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565bbd1bb30 0x5565bbd26790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.759+0000 7ff81cc00640 0 client.25325 ms_handle_reset on v2:172.21.15.193:6838/3012199875 2024-09-13T15:57:17.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.759+0000 7ff83c23e740 1 --2- 172.21.15.17:0/2271891648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5565bbd171a0 0x5565bbd26250 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.759+0000 7ff83c23e740 1 -- 172.21.15.17:0/2271891648 >> 172.21.15.17:0/2271891648 conn(0x5565bbd12670 msgr2=0x5565bbd3de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.759+0000 7ff83c23e740 1 -- 172.21.15.17:0/2271891648 shutdown_connections 2024-09-13T15:57:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.759+0000 7ff83c23e740 1 -- 172.21.15.17:0/2271891648 wait complete. 2024-09-13T15:57:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.759+0000 7ff83c23e740 20 client.25325 trim_cache size 0 max 16384 2024-09-13T15:57:17.766 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-13T15:57:17.766 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "3334a620-71e7-11ef-bceb-c7b262605968", 2024-09-13T15:57:17.766 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 2, 2024-09-13T15:57:17.766 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24553, 2024-09-13T15:57:17.766 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-13T15:57:17.767 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-13T15:57:17.767 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-13T15:57:17.767 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 122.513628168, 2024-09-13T15:57:17.767 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 24, 2024-09-13T15:57:17.767 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 94, 2024-09-13T15:57:17.767 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 90, 2024-09-13T15:57:17.767 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 159.438048732 2024-09-13T15:57:17.767 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-13T15:57:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.760+0000 7ff839400640 1 -- 172.21.15.17:0/998973950 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff8180a1110 msgr2=0x7ff8180a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.760+0000 7ff839400640 1 --2- 172.21.15.17:0/998973950 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff8180a1110 0x7ff8180a35d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff82c005fd0 tx=0x7ff82c0096a0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.760+0000 7ff839400640 1 -- 172.21.15.17:0/998973950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8340ffd70 msgr2=0x7ff834195dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.760+0000 7ff839400640 1 --2- 172.21.15.17:0/998973950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8340ffd70 0x7ff834195dc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff82400e9c0 tx=0x7ff82400ee80 comp rx=0 tx=0).stop 2024-09-13T15:57:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.760+0000 7ff839400640 1 -- 172.21.15.17:0/998973950 shutdown_connections 2024-09-13T15:57:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.760+0000 7ff839400640 1 --2- 172.21.15.17:0/998973950 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff8180a1110 0x7ff8180a35d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.760+0000 7ff839400640 1 --2- 172.21.15.17:0/998973950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff834101920 0x7ff83419d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.760+0000 7ff839400640 1 --2- 172.21.15.17:0/998973950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff834100f60 0x7ff834196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.760+0000 7ff839400640 1 --2- 172.21.15.17:0/998973950 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8340ffd70 0x7ff834195dc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.760+0000 7ff839400640 1 -- 172.21.15.17:0/998973950 >> 172.21.15.17:0/998973950 conn(0x7ff8340fb4d0 msgr2=0x7ff834104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.760+0000 7ff839400640 1 -- 172.21.15.17:0/998973950 shutdown_connections 2024-09-13T15:57:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.760+0000 7ff839400640 1 -- 172.21.15.17:0/998973950 wait complete. 2024-09-13T15:57:17.776 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.g status 2024-09-13T15:57:17.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.933+0000 7f9aa7200640 1 -- 172.21.15.17:0/3484243059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa0103180 msgr2=0x7f9aa0103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.933+0000 7f9aa7200640 1 --2- 172.21.15.17:0/3484243059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa0103180 0x7f9aa0103600 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9a88009900 tx=0x7f9a8802a410 comp rx=0 tx=0).stop 2024-09-13T15:57:17.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.933+0000 7f9aa7200640 1 -- 172.21.15.17:0/3484243059 shutdown_connections 2024-09-13T15:57:17.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.933+0000 7f9aa7200640 1 --2- 172.21.15.17:0/3484243059 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9aa0103b40 0x7f9aa010a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.933+0000 7f9aa7200640 1 --2- 172.21.15.17:0/3484243059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa0103180 0x7f9aa0103600 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.933+0000 7f9aa7200640 1 --2- 172.21.15.17:0/3484243059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9aa0101f90 0x7f9aa0102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.933+0000 7f9aa7200640 1 -- 172.21.15.17:0/3484243059 >> 172.21.15.17:0/3484243059 conn(0x7f9aa00fd6d0 msgr2=0x7f9aa00ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:17.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.934+0000 7f9aa7200640 1 -- 172.21.15.17:0/3484243059 shutdown_connections 2024-09-13T15:57:17.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.934+0000 7f9aa7200640 1 -- 172.21.15.17:0/3484243059 wait complete. 2024-09-13T15:57:17.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.934+0000 7f9aa7200640 1 Processor -- start 2024-09-13T15:57:17.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.935+0000 7f9aa7200640 1 -- start start 2024-09-13T15:57:17.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.935+0000 7f9aa7200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9aa0101f90 0x7f9aa0197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.935+0000 7f9aa7200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa0103180 0x7f9aa0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.935+0000 7f9aa7200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9aa0103b40 0x7f9aa019f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.935+0000 7f9aa7200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa019fa40 con 0x7f9aa0103180 2024-09-13T15:57:17.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.935+0000 7f9aa7200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa019fbb0 con 0x7f9aa0101f90 2024-09-13T15:57:17.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.935+0000 7f9aa7200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa019fd70 con 0x7f9aa0103b40 2024-09-13T15:57:17.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.935+0000 7f9a97e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa0103180 0x7f9aa0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.935+0000 7f9a97e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa0103180 0x7f9aa0198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53112/0 (socket says 172.21.15.17:53112) 2024-09-13T15:57:17.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.935+0000 7f9a97e00640 1 -- 172.21.15.17:0/1482391911 learned_addr learned my addr 172.21.15.17:0/1482391911 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:17.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.935+0000 7f9a9fe00640 1 --2- 172.21.15.17:0/1482391911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9aa0101f90 0x7f9aa0197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.935+0000 7f9aa5200640 1 --2- 172.21.15.17:0/1482391911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9aa0103b40 0x7f9aa019f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.936+0000 7f9a97e00640 1 -- 172.21.15.17:0/1482391911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9aa0103b40 msgr2=0x7f9aa019f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.936+0000 7f9a97e00640 1 --2- 172.21.15.17:0/1482391911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9aa0103b40 0x7f9aa019f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.936+0000 7f9a97e00640 1 -- 172.21.15.17:0/1482391911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9aa0101f90 msgr2=0x7f9aa0197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.936+0000 7f9a97e00640 1 --2- 172.21.15.17:0/1482391911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9aa0101f90 0x7f9aa0197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.936+0000 7f9a97e00640 1 -- 172.21.15.17:0/1482391911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a88009560 con 0x7f9aa0103180 2024-09-13T15:57:17.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.936+0000 7f9aa5200640 1 --2- 172.21.15.17:0/1482391911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9aa0103b40 0x7f9aa019f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:57:17.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.936+0000 7f9a97e00640 1 --2- 172.21.15.17:0/1482391911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa0103180 0x7f9aa0198490 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9a88031500 tx=0x7f9a88003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:17.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.936+0000 7f9a9d600640 1 -- 172.21.15.17:0/1482391911 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a88003e00 con 0x7f9aa0103180 2024-09-13T15:57:17.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.936+0000 7f9a9d600640 1 -- 172.21.15.17:0/1482391911 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a88031c70 con 0x7f9aa0103180 2024-09-13T15:57:17.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.936+0000 7f9a9d600640 1 -- 172.21.15.17:0/1482391911 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8803bc20 con 0x7f9aa0103180 2024-09-13T15:57:17.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.936+0000 7f9aa7200640 1 -- 172.21.15.17:0/1482391911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa019fff0 con 0x7f9aa0103180 2024-09-13T15:57:17.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.936+0000 7f9aa7200640 1 -- 172.21.15.17:0/1482391911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa01a0410 con 0x7f9aa0103180 2024-09-13T15:57:17.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.940+0000 7f9aaa0c3740 1 Processor -- start 2024-09-13T15:57:17.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.940+0000 7f9aaa0c3740 1 -- start start 2024-09-13T15:57:17.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.941+0000 7f9a9d600640 1 -- 172.21.15.17:0/1482391911 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9a880317b0 con 0x7f9aa0103180 2024-09-13T15:57:17.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.941+0000 7f9aaa0c3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4f4fe1b30 0x55b4f4fe1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.941+0000 7f9aaa0c3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe2470 0x55b4f4fe6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.941+0000 7f9aaa0c3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b4f4fe7500 0x55b4f4fe99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.941+0000 7f9aaa0c3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4f4f4bab0 con 0x55b4f4fe2470 2024-09-13T15:57:17.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.941+0000 7f9aaa0c3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4f4f49240 con 0x55b4f4fe7500 2024-09-13T15:57:17.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.941+0000 7f9aaa0c3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4f4f44b30 con 0x55b4f4fe1b30 2024-09-13T15:57:17.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.941+0000 7f9a9fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe2470 0x55b4f4fe6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.941+0000 7f9a97e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b4f4fe7500 0x55b4f4fe99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.941+0000 7f9aa5200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4f4fe1b30 0x55b4f4fe1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.941+0000 7f9a9fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe2470 0x55b4f4fe6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53124/0 (socket says 172.21.15.17:53124) 2024-09-13T15:57:17.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.941+0000 7f9a9fe00640 1 -- 172.21.15.17:0/3562046377 learned_addr learned my addr 172.21.15.17:0/3562046377 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:17.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.942+0000 7f9aa5200640 1 -- 172.21.15.17:0/3562046377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b4f4fe7500 msgr2=0x55b4f4fe99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:17.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.942+0000 7f9aa5200640 1 --2- 172.21.15.17:0/3562046377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b4f4fe7500 0x55b4f4fe99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.942+0000 7f9aa5200640 1 -- 172.21.15.17:0/3562046377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe2470 msgr2=0x55b4f4fe6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:17.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.942+0000 7f9aa5200640 1 --2- 172.21.15.17:0/3562046377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe2470 0x55b4f4fe6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.942+0000 7f9aa5200640 1 -- 172.21.15.17:0/3562046377 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4f4f0fbd0 con 0x55b4f4fe1b30 2024-09-13T15:57:17.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.942+0000 7f9a9fe00640 1 --2- 172.21.15.17:0/3562046377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe2470 0x55b4f4fe6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:57:17.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.942+0000 7f9aa5200640 1 --2- 172.21.15.17:0/3562046377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4f4fe1b30 0x55b4f4fe1f30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009f90 tx=0x7f9a98010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42f6812fff5e3329 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:17.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.942+0000 7f9a95600640 1 -- 172.21.15.17:0/3562046377 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98004d20 con 0x55b4f4fe1b30 2024-09-13T15:57:17.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.942+0000 7f9a95600640 1 -- 172.21.15.17:0/3562046377 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a98015070 con 0x55b4f4fe1b30 2024-09-13T15:57:17.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.942+0000 7f9a95600640 1 -- 172.21.15.17:0/3562046377 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a980053a0 con 0x55b4f4fe1b30 2024-09-13T15:57:17.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.942+0000 7f9a9d600640 1 --2- 172.21.15.17:0/1482391911 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9a840a1110 0x7f9a840a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.943+0000 7f9a9d600640 1 -- 172.21.15.17:0/1482391911 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f9a880ed4b0 con 0x7f9aa0103180 2024-09-13T15:57:17.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.943+0000 7f9a9fe00640 1 --2- 172.21.15.17:0/1482391911 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9a840a1110 0x7f9a840a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.943+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/3562046377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4f4fe1b30 msgr2=0x55b4f4fe1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.943+0000 7f9aaa0c3740 1 --2- 172.21.15.17:0/3562046377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4f4fe1b30 0x55b4f4fe1f30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009f90 tx=0x7f9a98010860 comp rx=0 tx=0).stop 2024-09-13T15:57:17.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.943+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/3562046377 shutdown_connections 2024-09-13T15:57:17.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.943+0000 7f9aaa0c3740 1 --2- 172.21.15.17:0/3562046377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b4f4fe7500 0x55b4f4fe99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.943+0000 7f9aaa0c3740 1 --2- 172.21.15.17:0/3562046377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe2470 0x55b4f4fe6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.943+0000 7f9aaa0c3740 1 --2- 172.21.15.17:0/3562046377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4f4fe1b30 0x55b4f4fe1f30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.943+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/3562046377 >> 172.21.15.17:0/3562046377 conn(0x55b4f4fdd1a0 msgr2=0x55b4f4fdd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:17.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.943+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/3562046377 shutdown_connections 2024-09-13T15:57:17.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.943+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/3562046377 wait complete. 2024-09-13T15:57:17.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.943+0000 7f9a9fe00640 1 --2- 172.21.15.17:0/1482391911 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9a840a1110 0x7f9a840a35d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55b4f4fe2ea0 tx=0x7f9a90005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:17.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.944+0000 7f9aaa0c3740 1 -- start start 2024-09-13T15:57:17.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.944+0000 7f9aaa0c3740 1 Processor -- start 2024-09-13T15:57:17.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.944+0000 7f9aaa0c3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4f4fe1b30 0x55b4f4feb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.944+0000 7f9aaa0c3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe2470 0x55b4f4febd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.944+0000 7f9aaa0c3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b4f4fe7500 0x55b4f4ff2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.944+0000 7f9aaa0c3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4f4ee6260 con 0x55b4f4fe2470 2024-09-13T15:57:17.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.944+0000 7f9aaa0c3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4f4ee5f00 con 0x55b4f4fe7500 2024-09-13T15:57:17.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.944+0000 7f9aaa0c3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4f4cabf20 con 0x55b4f4fe1b30 2024-09-13T15:57:17.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.944+0000 7f9aaa0c3740 10 client.0 _ll_register_callbacks cb 0x55b4f4f3e1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:57:17.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.945+0000 7f9a97e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe2470 0x55b4f4febd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.945+0000 7f9a97e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe2470 0x55b4f4febd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53130/0 (socket says 172.21.15.17:53130) 2024-09-13T15:57:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.945+0000 7f9a97e00640 1 -- 172.21.15.17:0/3901564756 learned_addr learned my addr 172.21.15.17:0/3901564756 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.945+0000 7f9aa5200640 1 --2- 172.21.15.17:0/3901564756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b4f4fe7500 0x55b4f4ff2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.945+0000 7f9a9fe00640 1 --2- 172.21.15.17:0/3901564756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4f4fe1b30 0x55b4f4feb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.945+0000 7f9a97e00640 1 -- 172.21.15.17:0/3901564756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4f4fe1b30 msgr2=0x55b4f4feb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.945+0000 7f9a97e00640 1 --2- 172.21.15.17:0/3901564756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4f4fe1b30 0x55b4f4feb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.945+0000 7f9a97e00640 1 -- 172.21.15.17:0/3901564756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b4f4fe7500 msgr2=0x55b4f4ff2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.945+0000 7f9a97e00640 1 --2- 172.21.15.17:0/3901564756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b4f4fe7500 0x55b4f4ff2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.945+0000 7f9a97e00640 1 -- 172.21.15.17:0/3901564756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a98009bf0 con 0x55b4f4fe2470 2024-09-13T15:57:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.945+0000 7f9aa5200640 1 --2- 172.21.15.17:0/3901564756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b4f4fe7500 0x55b4f4ff2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:57:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.945+0000 7f9a97e00640 1 --2- 172.21.15.17:0/3901564756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe2470 0x55b4f4febd90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9a880f0cf0 tx=0x7f9a8802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764c0e549d532383 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.945+0000 7f9a8e000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T15:57:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.946+0000 7f9a8e000640 1 -- 172.21.15.17:0/3901564756 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a880ba380 con 0x55b4f4fe2470 2024-09-13T15:57:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.946+0000 7f9a8e000640 1 -- 172.21.15.17:0/3901564756 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f9a880bacb0 con 0x55b4f4fe2470 2024-09-13T15:57:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.946+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/3901564756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b4f4f6ecd0 con 0x55b4f4fe2470 2024-09-13T15:57:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.946+0000 7f9a8e000640 1 -- 172.21.15.17:0/3901564756 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a880ba0f0 con 0x55b4f4fe2470 2024-09-13T15:57:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.946+0000 7f9aaa0c3740 10 client.15303 fetch_fsmap learned FSMap version 24 2024-09-13T15:57:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.946+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/3901564756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55b4f4f431b0 con 0x55b4f4fe2470 2024-09-13T15:57:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.946+0000 7f9a8e000640 1 -- 172.21.15.17:0/3901564756 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b4f4f6ecd0 con 0x55b4f4fe2470 2024-09-13T15:57:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.946+0000 7f9a8e000640 1 -- 172.21.15.17:0/3901564756 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9a880b6cc0 con 0x55b4f4fe2470 2024-09-13T15:57:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.946+0000 7f9aaa0c3740 10 client.15303 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T15:57:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.946+0000 7f9aaa0c3740 10 client.15303 resolve_mds: resolved name 'g' to daemon mds.g 2024-09-13T15:57:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.946+0000 7f9aaa0c3740 20 client.15303 populate_metadata read hostname 'smithi017' 2024-09-13T15:57:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.947+0000 7f9aaa0c3740 1 --2- 172.21.15.17:0/3901564756 >> [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] conn(0x55b4f4ff7b60 0x55b4f4ffbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.947+0000 7f9aaa0c3740 4 client.15303 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:57:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.947+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/3901564756 --> [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b4f4c383c0 con 0x55b4f4ff7b60 2024-09-13T15:57:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.947+0000 7f9a9fe00640 1 --2- 172.21.15.17:0/3901564756 >> [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] conn(0x55b4f4ff7b60 0x55b4f4ffbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.947+0000 7f9a9fe00640 1 --2- 172.21.15.17:0/3901564756 >> [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] conn(0x55b4f4ff7b60 0x55b4f4ffbcc0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d1281cb4fc4c525a server_cookie=e2b09abbe63e675c in_seq=0 out_seq=0 2024-09-13T15:57:17.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.947+0000 7f9a8e000640 10 client.15303 ms_handle_connect on v2:172.21.15.17:6838/3750040765 2024-09-13T15:57:17.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.948+0000 7f9a8e000640 1 -- 172.21.15.17:0/3901564756 <== mds.1 v2:172.21.15.17:6838/3750040765 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b4f4c383c0 con 0x55b4f4ff7b60 2024-09-13T15:57:17.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.948+0000 7f9a8e000640 10 client.15303 handle_command_reply: tid=0 2024-09-13T15:57:17.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.948+0000 7f9aaa0c3740 1 client.15303 shutdown 2024-09-13T15:57:17.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.948+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/3901564756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe2470 msgr2=0x55b4f4febd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.948+0000 7f9aaa0c3740 1 --2- 172.21.15.17:0/3901564756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe2470 0x55b4f4febd90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9a880f0cf0 tx=0x7f9a8802a410 comp rx=0 tx=0).stop 2024-09-13T15:57:17.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.948+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/3901564756 shutdown_connections 2024-09-13T15:57:17.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.948+0000 7f9aaa0c3740 1 --2- 172.21.15.17:0/3901564756 >> [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] conn(0x55b4f4ff7b60 0x55b4f4ffbcc0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.948+0000 7f9aaa0c3740 1 --2- 172.21.15.17:0/3901564756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b4f4fe7500 0x55b4f4ff2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.948+0000 7f9aaa0c3740 1 --2- 172.21.15.17:0/3901564756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe2470 0x55b4f4febd90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.948+0000 7f9aaa0c3740 1 --2- 172.21.15.17:0/3901564756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4f4fe1b30 0x55b4f4feb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.948+0000 7f9a8e000640 0 client.15303 ms_handle_reset on v2:172.21.15.17:6838/3750040765 2024-09-13T15:57:17.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.948+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/3901564756 >> 172.21.15.17:0/3901564756 conn(0x55b4f4fdd1a0 msgr2=0x55b4f4fde9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:17.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.948+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/3901564756 shutdown_connections 2024-09-13T15:57:17.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.949+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/3901564756 wait complete. 2024-09-13T15:57:17.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.949+0000 7f9aaa0c3740 20 client.15303 trim_cache size 0 max 16384 2024-09-13T15:57:17.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.964+0000 7f9aaa0c3740 1 Processor -- start 2024-09-13T15:57:17.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.964+0000 7f9aaa0c3740 1 -- start start 2024-09-13T15:57:17.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.964+0000 7f9aaa0c3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4f4fe1b30 0x55b4f4ff3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.964+0000 7f9aaa0c3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b4f4fe2470 0x55b4f4ff2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.964+0000 7f9aaa0c3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe7500 0x55b4f4feb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.964+0000 7f9aaa0c3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4f4ff4170 con 0x55b4f4fe7500 2024-09-13T15:57:17.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.964+0000 7f9aaa0c3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4f4fe2d30 con 0x55b4f4fe2470 2024-09-13T15:57:17.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.964+0000 7f9aaa0c3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4f4c383c0 con 0x55b4f4fe1b30 2024-09-13T15:57:17.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.965+0000 7f9aa5200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe7500 0x55b4f4feb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.965+0000 7f9aa5200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe7500 0x55b4f4feb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53142/0 (socket says 172.21.15.17:53142) 2024-09-13T15:57:17.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.965+0000 7f9aa5200640 1 -- 172.21.15.17:0/2171010533 learned_addr learned my addr 172.21.15.17:0/2171010533 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:17.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.965+0000 7f9a97e00640 1 --2- 172.21.15.17:0/2171010533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b4f4fe2470 0x55b4f4ff2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.965+0000 7f9a9fe00640 1 --2- 172.21.15.17:0/2171010533 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4f4fe1b30 0x55b4f4ff3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.965+0000 7f9aa5200640 1 -- 172.21.15.17:0/2171010533 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4f4fe1b30 msgr2=0x55b4f4ff3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:17.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.965+0000 7f9aa5200640 1 --2- 172.21.15.17:0/2171010533 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4f4fe1b30 0x55b4f4ff3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.965+0000 7f9aa5200640 1 -- 172.21.15.17:0/2171010533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b4f4fe2470 msgr2=0x55b4f4ff2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:17.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.965+0000 7f9aa5200640 1 --2- 172.21.15.17:0/2171010533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b4f4fe2470 0x55b4f4ff2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.965+0000 7f9aa5200640 1 -- 172.21.15.17:0/2171010533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4f4ee5470 con 0x55b4f4fe7500 2024-09-13T15:57:17.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.965+0000 7f9a9fe00640 1 --2- 172.21.15.17:0/2171010533 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4f4fe1b30 0x55b4f4ff3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:57:17.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.965+0000 7f9aa5200640 1 --2- 172.21.15.17:0/2171010533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe7500 0x55b4f4feb850 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9a9801a000 tx=0x7f9a98009760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42ed591ecd5e628 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:17.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.966+0000 7f9a96000640 1 -- 172.21.15.17:0/2171010533 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98011500 con 0x55b4f4fe7500 2024-09-13T15:57:17.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.966+0000 7f9a96000640 1 -- 172.21.15.17:0/2171010533 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a98020050 con 0x55b4f4fe7500 2024-09-13T15:57:17.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.966+0000 7f9a96000640 1 -- 172.21.15.17:0/2171010533 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98026bb0 con 0x55b4f4fe7500 2024-09-13T15:57:17.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.966+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/2171010533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe7500 msgr2=0x55b4f4feb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.966+0000 7f9aaa0c3740 1 --2- 172.21.15.17:0/2171010533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe7500 0x55b4f4feb850 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9a9801a000 tx=0x7f9a98009760 comp rx=0 tx=0).stop 2024-09-13T15:57:17.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.966+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/2171010533 shutdown_connections 2024-09-13T15:57:17.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.966+0000 7f9aaa0c3740 1 --2- 172.21.15.17:0/2171010533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe7500 0x55b4f4feb850 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.966+0000 7f9aaa0c3740 1 --2- 172.21.15.17:0/2171010533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b4f4fe2470 0x55b4f4ff2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.966+0000 7f9aaa0c3740 1 --2- 172.21.15.17:0/2171010533 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4f4fe1b30 0x55b4f4ff3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.966+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/2171010533 >> 172.21.15.17:0/2171010533 conn(0x55b4f4fdd1a0 msgr2=0x55b4f4fe3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:17.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.966+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/2171010533 shutdown_connections 2024-09-13T15:57:17.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.966+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/2171010533 wait complete. 2024-09-13T15:57:17.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.967+0000 7f9aaa0c3740 1 -- start start 2024-09-13T15:57:17.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.967+0000 7f9aaa0c3740 1 Processor -- start 2024-09-13T15:57:17.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.967+0000 7f9aaa0c3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe1b30 0x55b4f4ff2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.967+0000 7f9aaa0c3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b4f4fe2470 0x55b4f4fef8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.967+0000 7f9aaa0c3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4f4fe7500 0x55b4f4feff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.967+0000 7f9aaa0c3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4f5056190 con 0x55b4f4fe1b30 2024-09-13T15:57:17.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.967+0000 7f9aaa0c3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4f50562d0 con 0x55b4f4fe2470 2024-09-13T15:57:17.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.967+0000 7f9aaa0c3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4f5056410 con 0x55b4f4fe7500 2024-09-13T15:57:17.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.967+0000 7f9aaa0c3740 10 client.0 _ll_register_callbacks cb 0x7f9a90012f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:57:17.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.968+0000 7f9a9fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe1b30 0x55b4f4ff2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.968+0000 7f9a9fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe1b30 0x55b4f4ff2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53144/0 (socket says 172.21.15.17:53144) 2024-09-13T15:57:17.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.968+0000 7f9a9fe00640 1 -- 172.21.15.17:0/4170834130 learned_addr learned my addr 172.21.15.17:0/4170834130 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:17.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.968+0000 7f9a97e00640 1 --2- 172.21.15.17:0/4170834130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b4f4fe2470 0x55b4f4fef8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.968+0000 7f9aa5200640 1 --2- 172.21.15.17:0/4170834130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4f4fe7500 0x55b4f4feff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.968+0000 7f9a9fe00640 1 -- 172.21.15.17:0/4170834130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4f4fe7500 msgr2=0x55b4f4feff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:17.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.968+0000 7f9a9fe00640 1 --2- 172.21.15.17:0/4170834130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4f4fe7500 0x55b4f4feff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.968+0000 7f9a9fe00640 1 -- 172.21.15.17:0/4170834130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b4f4fe2470 msgr2=0x55b4f4fef8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:17.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.968+0000 7f9a9fe00640 1 --2- 172.21.15.17:0/4170834130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b4f4fe2470 0x55b4f4fef8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.968+0000 7f9a9fe00640 1 -- 172.21.15.17:0/4170834130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b4f4f0fbd0 con 0x55b4f4fe1b30 2024-09-13T15:57:17.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.968+0000 7f9a9fe00640 1 --2- 172.21.15.17:0/4170834130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe1b30 0x55b4f4ff2e40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9a90012d00 tx=0x7f9a900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2e3fea2616fb03 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:17.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.968+0000 7f9a8e000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T15:57:17.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.968+0000 7f9a8e000640 1 -- 172.21.15.17:0/4170834130 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a90023040 con 0x55b4f4fe1b30 2024-09-13T15:57:17.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.969+0000 7f9a8e000640 1 -- 172.21.15.17:0/4170834130 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f9a9000fd70 con 0x55b4f4fe1b30 2024-09-13T15:57:17.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.969+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/4170834130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9a98015070 con 0x55b4f4fe1b30 2024-09-13T15:57:17.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.969+0000 7f9a8e000640 1 -- 172.21.15.17:0/4170834130 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a90017070 con 0x55b4f4fe1b30 2024-09-13T15:57:17.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.969+0000 7f9aaa0c3740 10 client.15309 fetch_fsmap learned FSMap version 24 2024-09-13T15:57:17.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.969+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/4170834130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55b4f4f0a980 con 0x55b4f4fe1b30 2024-09-13T15:57:17.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.969+0000 7f9a8e000640 1 -- 172.21.15.17:0/4170834130 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a98015070 con 0x55b4f4fe1b30 2024-09-13T15:57:17.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.969+0000 7f9a8e000640 1 -- 172.21.15.17:0/4170834130 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9a9001dac0 con 0x55b4f4fe1b30 2024-09-13T15:57:17.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.969+0000 7f9aaa0c3740 10 client.15309 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T15:57:17.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.969+0000 7f9aaa0c3740 10 client.15309 resolve_mds: resolved name 'g' to daemon mds.g 2024-09-13T15:57:17.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.969+0000 7f9aaa0c3740 20 client.15309 populate_metadata read hostname 'smithi017' 2024-09-13T15:57:17.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.969+0000 7f9aaa0c3740 1 --2- 172.21.15.17:0/4170834130 >> [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] conn(0x55b4f505b2c0 0x55b4f5057bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:17.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.969+0000 7f9aaa0c3740 4 client.15309 mds_command: new command op to 24565 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:57:17.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.969+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/4170834130 --> [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b4f4c496c0 con 0x55b4f505b2c0 2024-09-13T15:57:17.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.970+0000 7f9a97e00640 1 --2- 172.21.15.17:0/4170834130 >> [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] conn(0x55b4f505b2c0 0x55b4f5057bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:17.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.970+0000 7f9a97e00640 1 --2- 172.21.15.17:0/4170834130 >> [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] conn(0x55b4f505b2c0 0x55b4f5057bf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d37a93725ae5a003 server_cookie=38056bd1f7be5d77 in_seq=0 out_seq=0 2024-09-13T15:57:17.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.970+0000 7f9a8e000640 10 client.15309 ms_handle_connect on v2:172.21.15.17:6838/3750040765 2024-09-13T15:57:17.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.970+0000 7f9a8e000640 1 -- 172.21.15.17:0/4170834130 <== mds.1 v2:172.21.15.17:6838/3750040765 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55b4f4c496c0 con 0x55b4f505b2c0 2024-09-13T15:57:17.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.970+0000 7f9a8e000640 10 client.15309 handle_command_reply: tid=0 2024-09-13T15:57:17.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.970+0000 7f9aaa0c3740 1 client.15309 shutdown 2024-09-13T15:57:17.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.971+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/4170834130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe1b30 msgr2=0x55b4f4ff2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.971+0000 7f9aaa0c3740 1 --2- 172.21.15.17:0/4170834130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe1b30 0x55b4f4ff2e40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9a90012d00 tx=0x7f9a900046c0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.971+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/4170834130 shutdown_connections 2024-09-13T15:57:17.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.971+0000 7f9aaa0c3740 1 --2- 172.21.15.17:0/4170834130 >> [v2:172.21.15.17:6838/3750040765,v1:172.21.15.17:6839/3750040765] conn(0x55b4f505b2c0 0x55b4f5057bf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.971+0000 7f9aaa0c3740 1 --2- 172.21.15.17:0/4170834130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b4f4fe7500 0x55b4f4feff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.971+0000 7f9aaa0c3740 1 --2- 172.21.15.17:0/4170834130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b4f4fe2470 0x55b4f4fef8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.971+0000 7f9aaa0c3740 1 --2- 172.21.15.17:0/4170834130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4f4fe1b30 0x55b4f4ff2e40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.971+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/4170834130 >> 172.21.15.17:0/4170834130 conn(0x55b4f4fdd1a0 msgr2=0x55b4f4feb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:17.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.971+0000 7f9a8e000640 0 client.15309 ms_handle_reset on v2:172.21.15.17:6838/3750040765 2024-09-13T15:57:17.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.971+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/4170834130 shutdown_connections 2024-09-13T15:57:17.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.971+0000 7f9aaa0c3740 1 -- 172.21.15.17:0/4170834130 wait complete. 2024-09-13T15:57:17.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.971+0000 7f9aaa0c3740 20 client.15309 trim_cache size 0 max 16384 2024-09-13T15:57:17.978 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-13T15:57:17.978 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "3334a620-71e7-11ef-bceb-c7b262605968", 2024-09-13T15:57:17.978 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 1, 2024-09-13T15:57:17.978 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24565, 2024-09-13T15:57:17.978 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-13T15:57:17.979 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-13T15:57:17.979 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-13T15:57:17.979 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 123.73250694399999, 2024-09-13T15:57:17.979 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 24, 2024-09-13T15:57:17.979 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 94, 2024-09-13T15:57:17.979 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 90, 2024-09-13T15:57:17.979 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 156.33927916600001 2024-09-13T15:57:17.979 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-13T15:57:17.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.971+0000 7f9aa7200640 1 -- 172.21.15.17:0/1482391911 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9a840a1110 msgr2=0x7f9a840a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.972+0000 7f9aa7200640 1 --2- 172.21.15.17:0/1482391911 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9a840a1110 0x7f9a840a35d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55b4f4fe2ea0 tx=0x7f9a90005f90 comp rx=0 tx=0).stop 2024-09-13T15:57:17.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.972+0000 7f9aa7200640 1 -- 172.21.15.17:0/1482391911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa0103180 msgr2=0x7f9aa0198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:17.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.972+0000 7f9aa7200640 1 --2- 172.21.15.17:0/1482391911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa0103180 0x7f9aa0198490 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9a88031500 tx=0x7f9a88003c10 comp rx=0 tx=0).stop 2024-09-13T15:57:17.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.972+0000 7f9aa7200640 1 -- 172.21.15.17:0/1482391911 shutdown_connections 2024-09-13T15:57:17.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.972+0000 7f9aa7200640 1 --2- 172.21.15.17:0/1482391911 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f9a840a1110 0x7f9a840a35d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.972+0000 7f9aa7200640 1 --2- 172.21.15.17:0/1482391911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9aa0103b40 0x7f9aa019f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.972+0000 7f9aa7200640 1 --2- 172.21.15.17:0/1482391911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa0103180 0x7f9aa0198490 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.972+0000 7f9aa7200640 1 --2- 172.21.15.17:0/1482391911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9aa0101f90 0x7f9aa0197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:17.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.972+0000 7f9aa7200640 1 -- 172.21.15.17:0/1482391911 >> 172.21.15.17:0/1482391911 conn(0x7f9aa00fd6d0 msgr2=0x7f9aa01065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:17.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.972+0000 7f9aa7200640 1 -- 172.21.15.17:0/1482391911 shutdown_connections 2024-09-13T15:57:17.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:17.972+0000 7f9aa7200640 1 -- 172.21.15.17:0/1482391911 wait complete. 2024-09-13T15:57:17.989 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T15:57:18.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.147+0000 7f8941a00640 1 -- 172.21.15.17:0/1594661728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f893c101730 msgr2=0x7f893c107fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:18.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.147+0000 7f8941a00640 1 --2- 172.21.15.17:0/1594661728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f893c101730 0x7f893c107fc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8934009ca0 tx=0x7f893402a8c0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.147+0000 7f8941a00640 1 -- 172.21.15.17:0/1594661728 shutdown_connections 2024-09-13T15:57:18.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.147+0000 7f8941a00640 1 --2- 172.21.15.17:0/1594661728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f893c101730 0x7f893c107fc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.147+0000 7f8941a00640 1 --2- 172.21.15.17:0/1594661728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f893c100d70 0x7f893c1011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.147+0000 7f8941a00640 1 --2- 172.21.15.17:0/1594661728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f893c0ffb80 0x7f893c0fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.147+0000 7f8941a00640 1 -- 172.21.15.17:0/1594661728 >> 172.21.15.17:0/1594661728 conn(0x7f893c0fb2c0 msgr2=0x7f893c0fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:18.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.147+0000 7f8941a00640 1 -- 172.21.15.17:0/1594661728 shutdown_connections 2024-09-13T15:57:18.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.147+0000 7f8941a00640 1 -- 172.21.15.17:0/1594661728 wait complete. 2024-09-13T15:57:18.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.148+0000 7f8941a00640 1 Processor -- start 2024-09-13T15:57:18.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.148+0000 7f8941a00640 1 -- start start 2024-09-13T15:57:18.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.148+0000 7f8941a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f893c0ffb80 0x7f893c197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:18.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.148+0000 7f8941a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f893c100d70 0x7f893c1982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:18.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.148+0000 7f8941a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f893c101730 0x7f893c19f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:18.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.148+0000 7f8941a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c19f850 con 0x7f893c100d70 2024-09-13T15:57:18.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.148+0000 7f8941a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c19f9c0 con 0x7f893c101730 2024-09-13T15:57:18.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.148+0000 7f8941a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c19fb80 con 0x7f893c0ffb80 2024-09-13T15:57:18.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.148+0000 7f893b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f893c100d70 0x7f893c1982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:18.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.148+0000 7f893b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f893c100d70 0x7f893c1982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53166/0 (socket says 172.21.15.17:53166) 2024-09-13T15:57:18.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.148+0000 7f893b400640 1 -- 172.21.15.17:0/2671247407 learned_addr learned my addr 172.21.15.17:0/2671247407 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:18.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.148+0000 7f893be00640 1 --2- 172.21.15.17:0/2671247407 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f893c0ffb80 0x7f893c197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:18.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.148+0000 7f8941000640 1 --2- 172.21.15.17:0/2671247407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f893c101730 0x7f893c19f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:18.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.149+0000 7f893b400640 1 -- 172.21.15.17:0/2671247407 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f893c0ffb80 msgr2=0x7f893c197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:18.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.149+0000 7f893b400640 1 --2- 172.21.15.17:0/2671247407 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f893c0ffb80 0x7f893c197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.149+0000 7f893b400640 1 -- 172.21.15.17:0/2671247407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f893c101730 msgr2=0x7f893c19f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:18.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.149+0000 7f893b400640 1 --2- 172.21.15.17:0/2671247407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f893c101730 0x7f893c19f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.149+0000 7f893b400640 1 -- 172.21.15.17:0/2671247407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8934009900 con 0x7f893c100d70 2024-09-13T15:57:18.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.149+0000 7f893b400640 1 --2- 172.21.15.17:0/2671247407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f893c100d70 0x7f893c1982a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f892800e9f0 tx=0x7f892800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:18.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.149+0000 7f8938c00640 1 -- 172.21.15.17:0/2671247407 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8928009700 con 0x7f893c100d70 2024-09-13T15:57:18.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.149+0000 7f8938c00640 1 -- 172.21.15.17:0/2671247407 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f892800cd80 con 0x7f893c100d70 2024-09-13T15:57:18.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.149+0000 7f8941a00640 1 -- 172.21.15.17:0/2671247407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f893c19fe60 con 0x7f893c100d70 2024-09-13T15:57:18.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.149+0000 7f8938c00640 1 -- 172.21.15.17:0/2671247407 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8928018860 con 0x7f893c100d70 2024-09-13T15:57:18.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.150+0000 7f8941a00640 1 -- 172.21.15.17:0/2671247407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893c1a0330 con 0x7f893c100d70 2024-09-13T15:57:18.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.152+0000 7f8945e6f740 1 Processor -- start 2024-09-13T15:57:18.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.153+0000 7f8945e6f740 1 -- start start 2024-09-13T15:57:18.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.153+0000 7f8938c00640 1 -- 172.21.15.17:0/2671247407 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f89280189c0 con 0x7f893c100d70 2024-09-13T15:57:18.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.153+0000 7f8945e6f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652504c0ca0 0x5652504c10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:18.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.153+0000 7f8945e6f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652504c15e0 0x5652504c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:18.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.153+0000 7f8945e6f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c6670 0x5652504c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:18.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.153+0000 7f8945e6f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56525042aab0 con 0x5652504c6670 2024-09-13T15:57:18.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.153+0000 7f8945e6f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x565250428240 con 0x5652504c0ca0 2024-09-13T15:57:18.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.153+0000 7f8945e6f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x565250423b30 con 0x5652504c15e0 2024-09-13T15:57:18.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.153+0000 7f893b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c6670 0x5652504c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:18.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.153+0000 7f893b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c6670 0x5652504c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53172/0 (socket says 172.21.15.17:53172) 2024-09-13T15:57:18.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.153+0000 7f893b400640 1 -- 172.21.15.17:0/2841580207 learned_addr learned my addr 172.21.15.17:0/2841580207 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:18.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.153+0000 7f893be00640 1 --2- 172.21.15.17:0/2841580207 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652504c15e0 0x5652504c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:18.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.153+0000 7f8941000640 1 --2- 172.21.15.17:0/2841580207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652504c0ca0 0x5652504c10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:18.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.154+0000 7f893be00640 1 -- 172.21.15.17:0/2841580207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652504c0ca0 msgr2=0x5652504c10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:18.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.154+0000 7f893be00640 1 --2- 172.21.15.17:0/2841580207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652504c0ca0 0x5652504c10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.154+0000 7f893be00640 1 -- 172.21.15.17:0/2841580207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c6670 msgr2=0x5652504c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:18.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.154+0000 7f893be00640 1 --2- 172.21.15.17:0/2841580207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c6670 0x5652504c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.154+0000 7f893be00640 1 -- 172.21.15.17:0/2841580207 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652503eebd0 con 0x5652504c15e0 2024-09-13T15:57:18.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.154+0000 7f893b400640 1 --2- 172.21.15.17:0/2841580207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c6670 0x5652504c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:57:18.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.154+0000 7f893be00640 1 --2- 172.21.15.17:0/2841580207 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652504c15e0 0x5652504c60a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f892c009bd0 tx=0x7f892c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72b47f6e85641f58 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:18.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.154+0000 7f8938c00640 1 --2- 172.21.15.17:0/2671247407 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f89200a1110 0x7f89200a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:18.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.154+0000 7f8931600640 1 -- 172.21.15.17:0/2841580207 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c004230 con 0x5652504c15e0 2024-09-13T15:57:18.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.154+0000 7f8931600640 1 -- 172.21.15.17:0/2841580207 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f892c009e40 con 0x5652504c15e0 2024-09-13T15:57:18.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.154+0000 7f8931600640 1 -- 172.21.15.17:0/2841580207 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c019790 con 0x5652504c15e0 2024-09-13T15:57:18.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.154+0000 7f8938c00640 1 -- 172.21.15.17:0/2671247407 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f8928014070 con 0x7f893c100d70 2024-09-13T15:57:18.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.154+0000 7f8941000640 1 --2- 172.21.15.17:0/2671247407 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f89200a1110 0x7f89200a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:18.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.155+0000 7f8945e6f740 1 -- 172.21.15.17:0/2841580207 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652504c15e0 msgr2=0x5652504c60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:18.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.155+0000 7f8945e6f740 1 --2- 172.21.15.17:0/2841580207 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652504c15e0 0x5652504c60a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f892c009bd0 tx=0x7f892c011810 comp rx=0 tx=0).stop 2024-09-13T15:57:18.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.155+0000 7f8945e6f740 1 -- 172.21.15.17:0/2841580207 shutdown_connections 2024-09-13T15:57:18.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.155+0000 7f8945e6f740 1 --2- 172.21.15.17:0/2841580207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c6670 0x5652504c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.155+0000 7f8945e6f740 1 --2- 172.21.15.17:0/2841580207 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652504c15e0 0x5652504c60a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.155+0000 7f8945e6f740 1 --2- 172.21.15.17:0/2841580207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652504c0ca0 0x5652504c10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.155+0000 7f8945e6f740 1 -- 172.21.15.17:0/2841580207 >> 172.21.15.17:0/2841580207 conn(0x5652504bc310 msgr2=0x5652504bc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:18.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.155+0000 7f8945e6f740 1 -- 172.21.15.17:0/2841580207 shutdown_connections 2024-09-13T15:57:18.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.155+0000 7f8945e6f740 1 -- 172.21.15.17:0/2841580207 wait complete. 2024-09-13T15:57:18.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.155+0000 7f8941000640 1 --2- 172.21.15.17:0/2671247407 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f89200a1110 0x7f89200a35d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8934005e30 tx=0x7f8934031be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:18.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.155+0000 7f8945e6f740 1 -- start start 2024-09-13T15:57:18.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.156+0000 7f8945e6f740 1 Processor -- start 2024-09-13T15:57:18.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.156+0000 7f8945e6f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652504c0ca0 0x5652504ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:18.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.156+0000 7f8945e6f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c15e0 0x5652504cade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:18.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.156+0000 7f8945e6f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652504c6670 0x5652504d1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:18.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.156+0000 7f8945e6f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652503c5260 con 0x5652504c15e0 2024-09-13T15:57:18.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.156+0000 7f8945e6f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652503c4f00 con 0x5652504c0ca0 2024-09-13T15:57:18.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.156+0000 7f8945e6f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x56525018af20 con 0x5652504c6670 2024-09-13T15:57:18.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.156+0000 7f8945e6f740 10 client.0 _ll_register_callbacks cb 0x56525041d1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:57:18.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.156+0000 7f893b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c15e0 0x5652504cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:18.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.156+0000 7f8941000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652504c6670 0x5652504d1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:18.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.156+0000 7f893b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c15e0 0x5652504cade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53188/0 (socket says 172.21.15.17:53188) 2024-09-13T15:57:18.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.156+0000 7f893b400640 1 -- 172.21.15.17:0/1114939978 learned_addr learned my addr 172.21.15.17:0/1114939978 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:18.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.157+0000 7f893be00640 1 --2- 172.21.15.17:0/1114939978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652504c0ca0 0x5652504ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:18.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.157+0000 7f893b400640 1 -- 172.21.15.17:0/1114939978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652504c6670 msgr2=0x5652504d1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:18.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.157+0000 7f893b400640 1 --2- 172.21.15.17:0/1114939978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652504c6670 0x5652504d1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.157+0000 7f893b400640 1 -- 172.21.15.17:0/1114939978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652504c0ca0 msgr2=0x5652504ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:18.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.157+0000 7f893b400640 1 --2- 172.21.15.17:0/1114939978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652504c0ca0 0x5652504ca8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.157+0000 7f893b400640 1 -- 172.21.15.17:0/1114939978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f892c009830 con 0x5652504c15e0 2024-09-13T15:57:18.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.157+0000 7f8941000640 1 --2- 172.21.15.17:0/1114939978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652504c6670 0x5652504d1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:57:18.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.157+0000 7f893b400640 1 --2- 172.21.15.17:0/1114939978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c15e0 0x5652504cade0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8928096ac0 tx=0x7f8928096450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4e12ac0e1fc65a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:18.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.157+0000 7f8926000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T15:57:18.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.157+0000 7f8926000640 1 -- 172.21.15.17:0/1114939978 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892809a050 con 0x5652504c15e0 2024-09-13T15:57:18.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.157+0000 7f8926000640 1 -- 172.21.15.17:0/1114939978 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f892809ddd0 con 0x5652504c15e0 2024-09-13T15:57:18.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.157+0000 7f8945e6f740 1 -- 172.21.15.17:0/1114939978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56525044dcd0 con 0x5652504c15e0 2024-09-13T15:57:18.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.158+0000 7f8926000640 1 -- 172.21.15.17:0/1114939978 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89280a2420 con 0x5652504c15e0 2024-09-13T15:57:18.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.158+0000 7f8945e6f740 10 client.15321 fetch_fsmap learned FSMap version 24 2024-09-13T15:57:18.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.158+0000 7f8945e6f740 1 -- 172.21.15.17:0/1114939978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5652504221b0 con 0x5652504c15e0 2024-09-13T15:57:18.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.158+0000 7f8926000640 1 -- 172.21.15.17:0/1114939978 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f89280b1030 con 0x5652504c15e0 2024-09-13T15:57:18.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.158+0000 7f8926000640 1 -- 172.21.15.17:0/1114939978 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8928095e40 con 0x5652504c15e0 2024-09-13T15:57:18.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.158+0000 7f8945e6f740 10 client.15321 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T15:57:18.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.158+0000 7f8945e6f740 10 client.15321 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T15:57:18.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.158+0000 7f8945e6f740 20 client.15321 populate_metadata read hostname 'smithi017' 2024-09-13T15:57:18.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.158+0000 7f8945e6f740 1 --2- 172.21.15.17:0/1114939978 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5652504d6cf0 0x5652504dae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:18.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.158+0000 7f8945e6f740 4 client.15321 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:57:18.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.158+0000 7f8945e6f740 1 -- 172.21.15.17:0/1114939978 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5652501173c0 con 0x5652504d6cf0 2024-09-13T15:57:18.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.159+0000 7f893be00640 1 --2- 172.21.15.17:0/1114939978 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5652504d6cf0 0x5652504dae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:18.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.159+0000 7f893be00640 1 --2- 172.21.15.17:0/1114939978 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5652504d6cf0 0x5652504dae90 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c34d6aa711f7a218 server_cookie=36ae833b9b9a1d16 in_seq=0 out_seq=0 2024-09-13T15:57:18.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.159+0000 7f8926000640 10 client.15321 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:57:18.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.160+0000 7f8926000640 1 -- 172.21.15.17:0/1114939978 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5652501173c0 con 0x5652504d6cf0 2024-09-13T15:57:18.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.160+0000 7f8926000640 10 client.15321 handle_command_reply: tid=0 2024-09-13T15:57:18.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.160+0000 7f8945e6f740 1 client.15321 shutdown 2024-09-13T15:57:18.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.160+0000 7f8945e6f740 1 -- 172.21.15.17:0/1114939978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c15e0 msgr2=0x5652504cade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:18.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.160+0000 7f8945e6f740 1 --2- 172.21.15.17:0/1114939978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c15e0 0x5652504cade0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8928096ac0 tx=0x7f8928096450 comp rx=0 tx=0).stop 2024-09-13T15:57:18.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.160+0000 7f8945e6f740 1 -- 172.21.15.17:0/1114939978 shutdown_connections 2024-09-13T15:57:18.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.160+0000 7f8945e6f740 1 --2- 172.21.15.17:0/1114939978 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5652504d6cf0 0x5652504dae90 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.161+0000 7f8945e6f740 1 --2- 172.21.15.17:0/1114939978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652504c6670 0x5652504d1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.161+0000 7f8945e6f740 1 --2- 172.21.15.17:0/1114939978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c15e0 0x5652504cade0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.161+0000 7f8945e6f740 1 --2- 172.21.15.17:0/1114939978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652504c0ca0 0x5652504ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.161+0000 7f8926000640 0 client.15321 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:57:18.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.161+0000 7f8945e6f740 1 -- 172.21.15.17:0/1114939978 >> 172.21.15.17:0/1114939978 conn(0x5652504bc310 msgr2=0x5652504bb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:18.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.161+0000 7f8945e6f740 1 -- 172.21.15.17:0/1114939978 shutdown_connections 2024-09-13T15:57:18.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.161+0000 7f8945e6f740 1 -- 172.21.15.17:0/1114939978 wait complete. 2024-09-13T15:57:18.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.161+0000 7f8945e6f740 20 client.15321 trim_cache size 0 max 16384 2024-09-13T15:57:18.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.176+0000 7f8945e6f740 1 Processor -- start 2024-09-13T15:57:18.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.176+0000 7f8945e6f740 1 -- start start 2024-09-13T15:57:18.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.176+0000 7f8945e6f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652504c0ca0 0x5652504ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:18.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.176+0000 7f8945e6f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652504c15e0 0x5652504d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:18.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.176+0000 7f8945e6f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c6670 0x5652504cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:18.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.176+0000 7f8945e6f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652504b79b0 con 0x5652504c6670 2024-09-13T15:57:18.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.176+0000 7f8945e6f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652504cb7a0 con 0x5652504c15e0 2024-09-13T15:57:18.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.176+0000 7f8945e6f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652504cb2f0 con 0x5652504c0ca0 2024-09-13T15:57:18.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.177+0000 7f8941000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c6670 0x5652504cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:18.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.177+0000 7f8941000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c6670 0x5652504cadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53196/0 (socket says 172.21.15.17:53196) 2024-09-13T15:57:18.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.177+0000 7f8941000640 1 -- 172.21.15.17:0/1559800593 learned_addr learned my addr 172.21.15.17:0/1559800593 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:18.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.177+0000 7f893b400640 1 --2- 172.21.15.17:0/1559800593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652504c15e0 0x5652504d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:18.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.177+0000 7f893be00640 1 --2- 172.21.15.17:0/1559800593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652504c0ca0 0x5652504ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:18.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.177+0000 7f8941000640 1 -- 172.21.15.17:0/1559800593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652504c0ca0 msgr2=0x5652504ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:18.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.177+0000 7f8941000640 1 --2- 172.21.15.17:0/1559800593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652504c0ca0 0x5652504ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.177+0000 7f8941000640 1 -- 172.21.15.17:0/1559800593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652504c15e0 msgr2=0x5652504d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:18.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.177+0000 7f8941000640 1 --2- 172.21.15.17:0/1559800593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652504c15e0 0x5652504d1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.177+0000 7f8941000640 1 -- 172.21.15.17:0/1559800593 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652503c4470 con 0x5652504c6670 2024-09-13T15:57:18.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.178+0000 7f8941000640 1 --2- 172.21.15.17:0/1559800593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c6670 0x5652504cadb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8934009ca0 tx=0x7f8934042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeaadda3ecd1bdc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:18.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.178+0000 7f8932000640 1 -- 172.21.15.17:0/1559800593 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934050070 con 0x5652504c6670 2024-09-13T15:57:18.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.178+0000 7f8932000640 1 -- 172.21.15.17:0/1559800593 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8934003cb0 con 0x5652504c6670 2024-09-13T15:57:18.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.178+0000 7f8932000640 1 -- 172.21.15.17:0/1559800593 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934042070 con 0x5652504c6670 2024-09-13T15:57:18.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.179+0000 7f8945e6f740 1 -- 172.21.15.17:0/1559800593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c6670 msgr2=0x5652504cadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:18.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.179+0000 7f8945e6f740 1 --2- 172.21.15.17:0/1559800593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c6670 0x5652504cadb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8934009ca0 tx=0x7f8934042000 comp rx=0 tx=0).stop 2024-09-13T15:57:18.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.179+0000 7f8945e6f740 1 -- 172.21.15.17:0/1559800593 shutdown_connections 2024-09-13T15:57:18.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.179+0000 7f8945e6f740 1 --2- 172.21.15.17:0/1559800593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c6670 0x5652504cadb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.179+0000 7f8945e6f740 1 --2- 172.21.15.17:0/1559800593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652504c15e0 0x5652504d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.179+0000 7f8945e6f740 1 --2- 172.21.15.17:0/1559800593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652504c0ca0 0x5652504ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.179+0000 7f8945e6f740 1 -- 172.21.15.17:0/1559800593 >> 172.21.15.17:0/1559800593 conn(0x5652504bc310 msgr2=0x5652504c5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:18.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.179+0000 7f8945e6f740 1 -- 172.21.15.17:0/1559800593 shutdown_connections 2024-09-13T15:57:18.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.179+0000 7f8945e6f740 1 -- 172.21.15.17:0/1559800593 wait complete. 2024-09-13T15:57:18.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.179+0000 7f8945e6f740 1 -- start start 2024-09-13T15:57:18.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.179+0000 7f8945e6f740 1 Processor -- start 2024-09-13T15:57:18.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.180+0000 7f8945e6f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c0ca0 0x5652504d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:18.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.180+0000 7f8945e6f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652504c15e0 0x5652504ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:18.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.180+0000 7f8945e6f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652504c6670 0x5652504ced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:18.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.180+0000 7f8945e6f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56525052cb50 con 0x5652504c0ca0 2024-09-13T15:57:18.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.180+0000 7f8945e6f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x56525052cc90 con 0x5652504c6670 2024-09-13T15:57:18.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.180+0000 7f8945e6f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x56525052cdd0 con 0x5652504c15e0 2024-09-13T15:57:18.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.180+0000 7f8945e6f740 10 client.0 _ll_register_callbacks cb 0x7f8928010da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:57:18.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.180+0000 7f893be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c0ca0 0x5652504d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:18.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.180+0000 7f893be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c0ca0 0x5652504d1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53212/0 (socket says 172.21.15.17:53212) 2024-09-13T15:57:18.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.180+0000 7f893be00640 1 -- 172.21.15.17:0/691726704 learned_addr learned my addr 172.21.15.17:0/691726704 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:18.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.180+0000 7f8941000640 1 --2- 172.21.15.17:0/691726704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652504c6670 0x5652504ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:18.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.180+0000 7f893b400640 1 --2- 172.21.15.17:0/691726704 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652504c15e0 0x5652504ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:18.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.180+0000 7f893be00640 1 -- 172.21.15.17:0/691726704 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652504c15e0 msgr2=0x5652504ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:18.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.180+0000 7f893be00640 1 --2- 172.21.15.17:0/691726704 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652504c15e0 0x5652504ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.180+0000 7f893be00640 1 -- 172.21.15.17:0/691726704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652504c6670 msgr2=0x5652504ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:18.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.180+0000 7f893be00640 1 --2- 172.21.15.17:0/691726704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652504c6670 0x5652504ced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.180+0000 7f893be00640 1 -- 172.21.15.17:0/691726704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893c1088c0 con 0x5652504c0ca0 2024-09-13T15:57:18.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.181+0000 7f893be00640 1 --2- 172.21.15.17:0/691726704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c0ca0 0x5652504d1d10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f892c009bd0 tx=0x7f892c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9c8ceccd61743d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:18.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.181+0000 7f8926000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T15:57:18.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.181+0000 7f8926000640 1 -- 172.21.15.17:0/691726704 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c02a040 con 0x5652504c0ca0 2024-09-13T15:57:18.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.181+0000 7f8926000640 1 -- 172.21.15.17:0/691726704 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f892c003e40 con 0x5652504c0ca0 2024-09-13T15:57:18.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.181+0000 7f8945e6f740 1 -- 172.21.15.17:0/691726704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f892c009e40 con 0x5652504c0ca0 2024-09-13T15:57:18.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.181+0000 7f8926000640 1 -- 172.21.15.17:0/691726704 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f892c009310 con 0x5652504c0ca0 2024-09-13T15:57:18.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.181+0000 7f8945e6f740 10 client.15327 fetch_fsmap learned FSMap version 24 2024-09-13T15:57:18.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.181+0000 7f8945e6f740 1 -- 172.21.15.17:0/691726704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5652503e9980 con 0x5652504c0ca0 2024-09-13T15:57:18.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.182+0000 7f8926000640 1 -- 172.21.15.17:0/691726704 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f892c009e40 con 0x5652504c0ca0 2024-09-13T15:57:18.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.182+0000 7f8926000640 1 -- 172.21.15.17:0/691726704 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f892c02b210 con 0x5652504c0ca0 2024-09-13T15:57:18.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.182+0000 7f8945e6f740 10 client.15327 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T15:57:18.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.182+0000 7f8945e6f740 10 client.15327 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T15:57:18.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.182+0000 7f8945e6f740 20 client.15327 populate_metadata read hostname 'smithi017' 2024-09-13T15:57:18.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.182+0000 7f8945e6f740 1 --2- 172.21.15.17:0/691726704 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x565250531b30 0x56525052e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:18.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.182+0000 7f8945e6f740 4 client.15327 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:57:18.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.182+0000 7f8945e6f740 1 -- 172.21.15.17:0/691726704 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5652501286c0 con 0x565250531b30 2024-09-13T15:57:18.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.182+0000 7f893b400640 1 --2- 172.21.15.17:0/691726704 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x565250531b30 0x56525052e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:18.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.183+0000 7f893b400640 1 --2- 172.21.15.17:0/691726704 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x565250531b30 0x56525052e450 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76787d1be6db3fdc server_cookie=3aabe0cee9b9a86 in_seq=0 out_seq=0 2024-09-13T15:57:18.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.183+0000 7f8926000640 10 client.15327 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:57:18.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.183+0000 7f8926000640 1 -- 172.21.15.17:0/691726704 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5652501286c0 con 0x565250531b30 2024-09-13T15:57:18.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.183+0000 7f8926000640 10 client.15327 handle_command_reply: tid=0 2024-09-13T15:57:18.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.183+0000 7f8945e6f740 1 client.15327 shutdown 2024-09-13T15:57:18.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.183+0000 7f8945e6f740 1 -- 172.21.15.17:0/691726704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c0ca0 msgr2=0x5652504d1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:18.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.183+0000 7f8945e6f740 1 --2- 172.21.15.17:0/691726704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c0ca0 0x5652504d1d10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f892c009bd0 tx=0x7f892c005d50 comp rx=0 tx=0).stop 2024-09-13T15:57:18.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.183+0000 7f8945e6f740 1 -- 172.21.15.17:0/691726704 shutdown_connections 2024-09-13T15:57:18.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.183+0000 7f8945e6f740 1 --2- 172.21.15.17:0/691726704 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x565250531b30 0x56525052e450 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.183+0000 7f8945e6f740 1 --2- 172.21.15.17:0/691726704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652504c6670 0x5652504ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.183+0000 7f8945e6f740 1 --2- 172.21.15.17:0/691726704 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652504c15e0 0x5652504ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.183+0000 7f8945e6f740 1 --2- 172.21.15.17:0/691726704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652504c0ca0 0x5652504d1d10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.183+0000 7f8926000640 0 client.15327 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:57:18.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.183+0000 7f8945e6f740 1 -- 172.21.15.17:0/691726704 >> 172.21.15.17:0/691726704 conn(0x5652504bc310 msgr2=0x5652504c5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:18.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.183+0000 7f8945e6f740 1 -- 172.21.15.17:0/691726704 shutdown_connections 2024-09-13T15:57:18.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.183+0000 7f8945e6f740 1 -- 172.21.15.17:0/691726704 wait complete. 2024-09-13T15:57:18.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.183+0000 7f8945e6f740 20 client.15327 trim_cache size 0 max 16384 2024-09-13T15:57:18.189 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-13T15:57:18.190 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "3334a620-71e7-11ef-bceb-c7b262605968", 2024-09-13T15:57:18.190 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-13T15:57:18.190 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24578, 2024-09-13T15:57:18.190 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-13T15:57:18.190 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-13T15:57:18.190 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-13T15:57:18.190 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 145.251267539, 2024-09-13T15:57:18.190 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 24, 2024-09-13T15:57:18.190 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 94, 2024-09-13T15:57:18.190 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 90, 2024-09-13T15:57:18.190 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 150.58142698200001 2024-09-13T15:57:18.190 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-13T15:57:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.184+0000 7f8941a00640 1 -- 172.21.15.17:0/2671247407 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f89200a1110 msgr2=0x7f89200a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.184+0000 7f8941a00640 1 --2- 172.21.15.17:0/2671247407 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f89200a1110 0x7f89200a35d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8934005e30 tx=0x7f8934031be0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.184+0000 7f8941a00640 1 -- 172.21.15.17:0/2671247407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f893c100d70 msgr2=0x7f893c1982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.184+0000 7f8941a00640 1 --2- 172.21.15.17:0/2671247407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f893c100d70 0x7f893c1982a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f892800e9f0 tx=0x7f892800eeb0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.184+0000 7f8941a00640 1 -- 172.21.15.17:0/2671247407 shutdown_connections 2024-09-13T15:57:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.184+0000 7f8941a00640 1 --2- 172.21.15.17:0/2671247407 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f89200a1110 0x7f89200a35d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.184+0000 7f8941a00640 1 --2- 172.21.15.17:0/2671247407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f893c101730 0x7f893c19f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.184+0000 7f8941a00640 1 --2- 172.21.15.17:0/2671247407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f893c100d70 0x7f893c1982a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.184+0000 7f8941a00640 1 --2- 172.21.15.17:0/2671247407 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f893c0ffb80 0x7f893c197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:18.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.184+0000 7f8941a00640 1 -- 172.21.15.17:0/2671247407 >> 172.21.15.17:0/2671247407 conn(0x7f893c0fb2c0 msgr2=0x7f893c106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:18.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.184+0000 7f8941a00640 1 -- 172.21.15.17:0/2671247407 shutdown_connections 2024-09-13T15:57:18.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:18.184+0000 7f8941a00640 1 -- 172.21.15.17:0/2671247407 wait complete. 2024-09-13T15:57:18.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:17 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3147381913' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:57:18.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:17 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/2951345596' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:57:18.201 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T15:57:18.212 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T15:57:18.212 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T15:57:18.212 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T15:57:18.212 INFO:teuthology.run_tasks:Running task kclient... 2024-09-13T15:57:18.242 INFO:tasks.kclient:Mounting kernel clients... 2024-09-13T15:57:18.242 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-13T15:57:18.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:57:18.242 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-13T15:57:18.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:17 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3147381913' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:57:18.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:17 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/2951345596' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:57:18.278 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-13T15:57:18.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:57:18.279 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T15:57:18.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:17 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3147381913' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T15:57:18.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:17 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/2951345596' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T15:57:18.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:57:18.377 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-09-13T15:57:18.708 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'wsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v1', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2024-09-13T15:57:18.708 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T15:57:18.708 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-09-13T15:57:18.709 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-09-13T15:57:18.709 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T15:57:19.031 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T15:57:19.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:19 smithi193 ceph-mon[35248]: pgmap v372: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:57:19.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:19 smithi017 ceph-mon[30494]: pgmap v372: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:57:19.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:19 smithi189 ceph-mon[34790]: pgmap v372: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:57:20.413 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:20 smithi017 ceph-mon[30494]: pgmap v373: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:57:20.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:20 smithi189 ceph-mon[34790]: pgmap v373: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:57:20.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:20 smithi193 ceph-mon[35248]: pgmap v373: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T15:57:21.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.195+0000 7fab27200640 1 -- 172.21.15.17:0/156600963 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab20107140 msgr2=0x7fab2010ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:21.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.195+0000 7fab27200640 1 --2- 172.21.15.17:0/156600963 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab20107140 0x7fab2010ecc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fab1c009be0 tx=0x7fab1c02a6c0 comp rx=0 tx=0).stop 2024-09-13T15:57:21.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.195+0000 7fab27200640 1 -- 172.21.15.17:0/156600963 shutdown_connections 2024-09-13T15:57:21.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.195+0000 7fab27200640 1 --2- 172.21.15.17:0/156600963 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab20107140 0x7fab2010ecc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:21.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.195+0000 7fab27200640 1 --2- 172.21.15.17:0/156600963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab201029c0 0x7fab20106a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:21.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.195+0000 7fab27200640 1 --2- 172.21.15.17:0/156600963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab20102010 0x7fab201023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:21.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.195+0000 7fab27200640 1 -- 172.21.15.17:0/156600963 >> 172.21.15.17:0/156600963 conn(0x7fab200fda70 msgr2=0x7fab200ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:21.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.195+0000 7fab27200640 1 -- 172.21.15.17:0/156600963 shutdown_connections 2024-09-13T15:57:21.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.195+0000 7fab27200640 1 -- 172.21.15.17:0/156600963 wait complete. 2024-09-13T15:57:21.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.196+0000 7fab27200640 1 Processor -- start 2024-09-13T15:57:21.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.196+0000 7fab27200640 1 -- start start 2024-09-13T15:57:21.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.197+0000 7fab27200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab20102010 0x7fab20198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:21.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.197+0000 7fab27200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab201029c0 0x7fab201987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:21.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.197+0000 7fab27200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab20107140 0x7fab2019cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:21.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.197+0000 7fab27200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2019d1a0 con 0x7fab201029c0 2024-09-13T15:57:21.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.197+0000 7fab27200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2019d310 con 0x7fab20107140 2024-09-13T15:57:21.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.197+0000 7fab27200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2019d480 con 0x7fab20102010 2024-09-13T15:57:21.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.197+0000 7fab25400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab201029c0 0x7fab201987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:21.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.197+0000 7fab26800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab20107140 0x7fab2019cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:21.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.197+0000 7fab25e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab20102010 0x7fab20198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:21.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.197+0000 7fab26800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab20107140 0x7fab2019cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:43898/0 (socket says 172.21.15.17:43898) 2024-09-13T15:57:21.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.197+0000 7fab26800640 1 -- 172.21.15.17:0/603009738 learned_addr learned my addr 172.21.15.17:0/603009738 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:21.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.198+0000 7fab25e00640 1 -- 172.21.15.17:0/603009738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab20107140 msgr2=0x7fab2019cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:21.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.198+0000 7fab25e00640 1 --2- 172.21.15.17:0/603009738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab20107140 0x7fab2019cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:21.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.198+0000 7fab25e00640 1 -- 172.21.15.17:0/603009738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab201029c0 msgr2=0x7fab201987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:21.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.198+0000 7fab25e00640 1 --2- 172.21.15.17:0/603009738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab201029c0 0x7fab201987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:21.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.198+0000 7fab25e00640 1 -- 172.21.15.17:0/603009738 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab14009560 con 0x7fab20102010 2024-09-13T15:57:21.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.198+0000 7fab25e00640 1 --2- 172.21.15.17:0/603009738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab20102010 0x7fab20198260 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fab14005fd0 tx=0x7fab1400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:21.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.198+0000 7fab1aa00640 1 -- 172.21.15.17:0/603009738 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1400cd00 con 0x7fab20102010 2024-09-13T15:57:21.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.198+0000 7fab27200640 1 -- 172.21.15.17:0/603009738 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab1c009840 con 0x7fab20102010 2024-09-13T15:57:21.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.198+0000 7fab1aa00640 1 -- 172.21.15.17:0/603009738 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fab1400ce60 con 0x7fab20102010 2024-09-13T15:57:21.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.198+0000 7fab1aa00640 1 -- 172.21.15.17:0/603009738 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab14010430 con 0x7fab20102010 2024-09-13T15:57:21.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.199+0000 7fab27200640 1 -- 172.21.15.17:0/603009738 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab201a4e50 con 0x7fab20102010 2024-09-13T15:57:21.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.200+0000 7fab27200640 1 -- 172.21.15.17:0/603009738 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab201034f0 con 0x7fab20102010 2024-09-13T15:57:21.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.202+0000 7fab1aa00640 1 -- 172.21.15.17:0/603009738 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fab140035f0 con 0x7fab20102010 2024-09-13T15:57:21.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.203+0000 7fab1aa00640 1 --2- 172.21.15.17:0/603009738 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fab080a10f0 0x7fab080a35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:21.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.203+0000 7fab1aa00640 1 -- 172.21.15.17:0/603009738 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fab14014070 con 0x7fab20102010 2024-09-13T15:57:21.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.203+0000 7fab25400640 1 --2- 172.21.15.17:0/603009738 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fab080a10f0 0x7fab080a35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:21.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.204+0000 7fab25400640 1 --2- 172.21.15.17:0/603009738 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fab080a10f0 0x7fab080a35b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fab20199810 tx=0x7fab10005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:21.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.207+0000 7fab1aa00640 1 -- 172.21.15.17:0/603009738 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fab140d0030 con 0x7fab20102010 2024-09-13T15:57:21.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.428+0000 7fab27200640 1 -- 172.21.15.17:0/603009738 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fab201023f0 con 0x7fab20102010 2024-09-13T15:57:21.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.428+0000 7fab1aa00640 1 -- 172.21.15.17:0/603009738 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+88 (secure 0 0 0) 0x7fab140963b0 con 0x7fab20102010 2024-09-13T15:57:21.430 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T15:57:21.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.430+0000 7fab27200640 1 -- 172.21.15.17:0/603009738 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fab080a10f0 msgr2=0x7fab080a35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:21.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.430+0000 7fab27200640 1 --2- 172.21.15.17:0/603009738 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fab080a10f0 0x7fab080a35b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fab20199810 tx=0x7fab10005f90 comp rx=0 tx=0).stop 2024-09-13T15:57:21.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.430+0000 7fab27200640 1 -- 172.21.15.17:0/603009738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab20102010 msgr2=0x7fab20198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:21.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.430+0000 7fab27200640 1 --2- 172.21.15.17:0/603009738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab20102010 0x7fab20198260 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fab14005fd0 tx=0x7fab1400ee50 comp rx=0 tx=0).stop 2024-09-13T15:57:21.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.430+0000 7fab27200640 1 -- 172.21.15.17:0/603009738 shutdown_connections 2024-09-13T15:57:21.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.430+0000 7fab27200640 1 --2- 172.21.15.17:0/603009738 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fab080a10f0 0x7fab080a35b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:21.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.430+0000 7fab27200640 1 --2- 172.21.15.17:0/603009738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab20107140 0x7fab2019cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:21.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.430+0000 7fab27200640 1 --2- 172.21.15.17:0/603009738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab201029c0 0x7fab201987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:21.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.430+0000 7fab27200640 1 --2- 172.21.15.17:0/603009738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab20102010 0x7fab20198260 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:21.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.430+0000 7fab27200640 1 -- 172.21.15.17:0/603009738 >> 172.21.15.17:0/603009738 conn(0x7fab200fda70 msgr2=0x7fab200fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:21.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.431+0000 7fab27200640 1 -- 172.21.15.17:0/603009738 shutdown_connections 2024-09-13T15:57:21.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:21.431+0000 7fab27200640 1 -- 172.21.15.17:0/603009738 wait complete. 2024-09-13T15:57:21.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:21 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/603009738' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T15:57:21.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:21 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/603009738' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T15:57:21.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:21 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/603009738' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T15:57:22.192 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T15:57:22.192 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:57:22.192 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-13T15:57:22.192 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T15:57:22.192 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-09-13T15:57:22.192 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T15:57:22.192 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T15:57:22.192 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:57:22.193 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-09-13T15:57:22.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:57:22.193 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-13T15:57:22.230 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:57:22.230 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:57:22.230 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:57:22.230 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:57:22.230 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-13T15:57:22.230 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:57:22.230 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T15:57:22.231 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:57:22.231 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-13T15:57:22.231 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T15:57:22.231 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:57:22.231 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-13T15:57:22.231 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:57:22.231 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:57:22.231 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-13T15:57:22.231 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T15:57:22.231 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42064sec preferred_lft 42064sec 2024-09-13T15:57:22.231 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-13T15:57:22.231 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:57:22.231 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T15:57:22.232 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:57:22.232 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-13T15:57:22.232 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T15:57:22.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:57:22.232 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-09-13T15:57:22.232 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-13T15:57:22.232 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add name ceph-brx type bridge 2024-09-13T15:57:22.232 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr flush dev ceph-brx 2024-09-13T15:57:22.232 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set ceph-brx up 2024-09-13T15:57:22.232 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T15:57:22.233 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-13T15:57:22.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:57:22.404 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:57:22.461 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-13T15:57:22.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:57:22.464 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-13T15:57:22.501 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-13T15:57:22.502 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:57:22.502 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T15:57:22.502 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T15:57:22.502 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:57:22.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:57:22.502 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-09-13T15:57:22.502 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-13T15:57:22.502 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T15:57:22.502 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T15:57:22.503 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T15:57:22.503 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-13T15:57:22.647 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:22 smithi017 ceph-mon[30494]: pgmap v374: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:57:22.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:57:22.650 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-13T15:57:22.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:57:22.686 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2024-09-13T15:57:22.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:22 smithi193 ceph-mon[35248]: pgmap v374: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:57:22.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:57:22.763 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-09-13T15:57:22.763 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-13T15:57:22.763 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--tmp-cephfs 2024-09-13T15:57:22.763 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-09-13T15:57:22.763 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-13T15:57:22.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:22 smithi189 ceph-mon[34790]: pgmap v374: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T15:57:22.890 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-09-13T15:57:22.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:57:22.890 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-09-13T15:57:22.890 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-13T15:57:22.890 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-09-13T15:57:22.890 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T15:57:22.890 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-09-13T15:57:22.890 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-09-13T15:57:22.890 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-09-13T15:57:22.890 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-13T15:57:23.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:57:23.058 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-09-13T15:57:23.058 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-13T15:57:23.058 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-13T15:57:23.058 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T15:57:23.058 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-13T15:57:23.174 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:57:23.174 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /tmp/cephfs 2024-09-13T15:57:23.209 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/tmp/cephfs' 2024-09-13T15:57:23.209 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:57:23.210 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /tmp/cephfs 2024-09-13T15:57:23.285 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-13T15:57:23.285 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-13T15:57:23.285 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/736a29cb-9b11-44c3-992c-0a482d8f2699 2024-09-13T15:57:23.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:57:23.285 DEBUG:teuthology.orchestra.run.smithi017:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/736a29cb-9b11-44c3-992c-0a482d8f2699 /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync,context=system_u:object_r:postgresql_db_t:s0 2024-09-13T15:57:23.414 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync,context="system_u:object_r:postgresql_db_t:s0" 2024-09-13T15:57:23.414 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-09-13T15:57:23.414 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2024-09-13T15:57:23.991 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync,context="system_u:object_r:postgresql_db_t:s0" 2024-09-13T15:57:23.992 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-09-13T15:57:23.992 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2024-09-13T15:57:23.992 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.189:6789,172.21.15.193:6789" 2024-09-13T15:57:23.992 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.189:6789,172.21.15.193:6789:/volumes/qa/sv_1/736a29cb-9b11-44c3-992c-0a482d8f2699 2024-09-13T15:57:23.992 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync,context="system_u:object_r:postgresql_db_t:s0",key=0,fsid=3334a620-71e7-11ef-bceb-c7b262605968" will pass to kernel 2024-09-13T15:57:23.997 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T15:57:23.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:57:23.997 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /tmp/cephfs 2024-09-13T15:57:24.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:57:24.056 DEBUG:teuthology.orchestra.run.smithi017:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:57:24.095 INFO:teuthology.orchestra.run.smithi017.stdout:client25370 2024-09-13T15:57:24.095 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T15:57:24.096 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:57:24.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:57:24.173 DEBUG:teuthology.orchestra.run.smithi017:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:57:24.253 INFO:teuthology.orchestra.run.smithi017.stdout:client25370 2024-09-13T15:57:24.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:57:24.254 DEBUG:teuthology.orchestra.run.smithi017:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:57:24.333 INFO:teuthology.orchestra.run.smithi017.stdout:client25370 2024-09-13T15:57:24.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:57:24.333 DEBUG:teuthology.orchestra.run.smithi017:> (cd /tmp/cephfs && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/3334a620-71e7-11ef-bceb-c7b262605968.client25370/status') 2024-09-13T15:57:24.429 INFO:teuthology.orchestra.run.smithi017.stdout:instance: client.25370 (3)172.21.15.17:0/3612860472 2024-09-13T15:57:24.429 INFO:teuthology.orchestra.run.smithi017.stdout:blocklisted: false 2024-09-13T15:57:24.429 INFO:teuthology.orchestra.run.smithi017.stderr:0+1 records in 2024-09-13T15:57:24.430 INFO:teuthology.orchestra.run.smithi017.stderr:0+1 records out 2024-09-13T15:57:24.430 INFO:teuthology.orchestra.run.smithi017.stderr:71 bytes copied, 5.7964e-05 s, 1.2 MB/s 2024-09-13T15:57:24.432 INFO:teuthology.run_tasks:Running task exec... 2024-09-13T15:57:24.447 INFO:teuthology.task.exec:Executing custom commands... 2024-09-13T15:57:24.448 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-13T15:57:24.448 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-13T15:57:24.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.603+0000 7fa7a5000640 1 -- 172.21.15.17:0/3942228550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7a01059f0 msgr2=0x7fa7a0107e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:24.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.603+0000 7fa7a5000640 1 --2- 172.21.15.17:0/3942228550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7a01059f0 0x7fa7a0107e60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa798009ca0 tx=0x7fa79802a8c0 comp rx=0 tx=0).stop 2024-09-13T15:57:24.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.603+0000 7fa7a5000640 1 -- 172.21.15.17:0/3942228550 shutdown_connections 2024-09-13T15:57:24.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.603+0000 7fa7a5000640 1 --2- 172.21.15.17:0/3942228550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7a01059f0 0x7fa7a0107e60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:24.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.603+0000 7fa7a5000640 1 --2- 172.21.15.17:0/3942228550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a01030c0 0x7fa7a01054b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:24.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.603+0000 7fa7a5000640 1 --2- 172.21.15.17:0/3942228550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7a0100790 0x7fa7a0102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:24.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.603+0000 7fa7a5000640 1 -- 172.21.15.17:0/3942228550 >> 172.21.15.17:0/3942228550 conn(0x7fa7a00fa370 msgr2=0x7fa7a00fc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:24.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.603+0000 7fa7a5000640 1 -- 172.21.15.17:0/3942228550 shutdown_connections 2024-09-13T15:57:24.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.603+0000 7fa7a5000640 1 -- 172.21.15.17:0/3942228550 wait complete. 2024-09-13T15:57:24.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.604+0000 7fa7a5000640 1 Processor -- start 2024-09-13T15:57:24.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.604+0000 7fa7a5000640 1 -- start start 2024-09-13T15:57:24.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:24 smithi189 ceph-mon[34790]: pgmap v375: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:57:24.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.604+0000 7fa7a5000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7a0100790 0x7fa7a0195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:24.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.604+0000 7fa7a5000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7a01030c0 0x7fa7a0196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:24.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.604+0000 7fa7a5000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a01059f0 0x7fa7a019d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:24.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.604+0000 7fa7a5000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a019d830 con 0x7fa7a01030c0 2024-09-13T15:57:24.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.604+0000 7fa7a5000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a019d9a0 con 0x7fa7a01059f0 2024-09-13T15:57:24.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.604+0000 7fa7a5000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a019db60 con 0x7fa7a0100790 2024-09-13T15:57:24.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.605+0000 7fa79e800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a01059f0 0x7fa7a019d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:24.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.605+0000 7fa797e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7a01030c0 0x7fa7a0196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:24.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.605+0000 7fa79de00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7a0100790 0x7fa7a0195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:24.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.605+0000 7fa79e800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a01059f0 0x7fa7a019d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:43908/0 (socket says 172.21.15.17:43908) 2024-09-13T15:57:24.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.605+0000 7fa79e800640 1 -- 172.21.15.17:0/3483099928 learned_addr learned my addr 172.21.15.17:0/3483099928 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:24.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.605+0000 7fa79e800640 1 -- 172.21.15.17:0/3483099928 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7a0100790 msgr2=0x7fa7a0195d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:24.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.605+0000 7fa79e800640 1 --2- 172.21.15.17:0/3483099928 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7a0100790 0x7fa7a0195d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:24.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.605+0000 7fa79e800640 1 -- 172.21.15.17:0/3483099928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7a01030c0 msgr2=0x7fa7a0196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:24.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.605+0000 7fa79e800640 1 --2- 172.21.15.17:0/3483099928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7a01030c0 0x7fa7a0196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:24.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.605+0000 7fa79e800640 1 -- 172.21.15.17:0/3483099928 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa798009900 con 0x7fa7a01059f0 2024-09-13T15:57:24.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.605+0000 7fa79de00640 1 --2- 172.21.15.17:0/3483099928 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7a0100790 0x7fa7a0195d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:57:24.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.605+0000 7fa797e00640 1 --2- 172.21.15.17:0/3483099928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7a01030c0 0x7fa7a0196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:57:24.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.606+0000 7fa79e800640 1 --2- 172.21.15.17:0/3483099928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a01059f0 0x7fa7a019d2c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa798031b10 tx=0x7fa798032f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:24.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.606+0000 7fa796a00640 1 -- 172.21.15.17:0/3483099928 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798003b70 con 0x7fa7a01059f0 2024-09-13T15:57:24.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.606+0000 7fa7a5000640 1 -- 172.21.15.17:0/3483099928 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a019dde0 con 0x7fa7a01059f0 2024-09-13T15:57:24.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.606+0000 7fa796a00640 1 -- 172.21.15.17:0/3483099928 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa798040070 con 0x7fa7a01059f0 2024-09-13T15:57:24.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.606+0000 7fa796a00640 1 -- 172.21.15.17:0/3483099928 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7980044d0 con 0x7fa7a01059f0 2024-09-13T15:57:24.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.606+0000 7fa7a5000640 1 -- 172.21.15.17:0/3483099928 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a019e260 con 0x7fa7a01059f0 2024-09-13T15:57:24.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.607+0000 7fa7a5000640 1 -- 172.21.15.17:0/3483099928 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a0103510 con 0x7fa7a01059f0 2024-09-13T15:57:24.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.609+0000 7fa796a00640 1 -- 172.21.15.17:0/3483099928 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa798042030 con 0x7fa7a01059f0 2024-09-13T15:57:24.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.610+0000 7fa796a00640 1 --2- 172.21.15.17:0/3483099928 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa7840a1090 0x7fa7840a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:24.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.610+0000 7fa796a00640 1 -- 172.21.15.17:0/3483099928 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fa7980ee230 con 0x7fa7a01059f0 2024-09-13T15:57:24.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.611+0000 7fa79de00640 1 --2- 172.21.15.17:0/3483099928 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa7840a1090 0x7fa7840a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.611+0000 7fa79de00640 1 --2- 172.21.15.17:0/3483099928 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa7840a1090 0x7fa7840a3550 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0197220 tx=0x7fa79000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.612+0000 7fa796a00640 1 -- 172.21.15.17:0/3483099928 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa7980b76a0 con 0x7fa7a01059f0 2024-09-13T15:57:24.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:24 smithi193 ceph-mon[35248]: pgmap v375: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:57:24.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:24 smithi017 ceph-mon[30494]: pgmap v375: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T15:57:24.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:24.830+0000 7fa7a5000640 1 -- 172.21.15.17:0/3483099928 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) v1 -- 0x7fa7a01034a0 con 0x7fa7a01059f0 2024-09-13T15:57:25.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:25.291+0000 7fa796a00640 1 -- 172.21.15.17:0/3483099928 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) v1 ==== 117+0+0 (secure 0 0 0) 0x7fa7980b95d0 con 0x7fa7a01059f0 2024-09-13T15:57:25.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:25.293+0000 7fa7a5000640 1 -- 172.21.15.17:0/3483099928 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa7840a1090 msgr2=0x7fa7840a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:25.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:25.293+0000 7fa7a5000640 1 --2- 172.21.15.17:0/3483099928 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa7840a1090 0x7fa7840a3550 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0197220 tx=0x7fa79000b390 comp rx=0 tx=0).stop 2024-09-13T15:57:25.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:25.293+0000 7fa7a5000640 1 -- 172.21.15.17:0/3483099928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a01059f0 msgr2=0x7fa7a019d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:25.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:25.293+0000 7fa7a5000640 1 --2- 172.21.15.17:0/3483099928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a01059f0 0x7fa7a019d2c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa798031b10 tx=0x7fa798032f00 comp rx=0 tx=0).stop 2024-09-13T15:57:25.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:25.293+0000 7fa7a5000640 1 -- 172.21.15.17:0/3483099928 shutdown_connections 2024-09-13T15:57:25.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:25.293+0000 7fa7a5000640 1 --2- 172.21.15.17:0/3483099928 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa7840a1090 0x7fa7840a3550 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:25.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:25.293+0000 7fa7a5000640 1 --2- 172.21.15.17:0/3483099928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a01059f0 0x7fa7a019d2c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:25.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:25.293+0000 7fa7a5000640 1 --2- 172.21.15.17:0/3483099928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7a01030c0 0x7fa7a0196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:25.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:25.293+0000 7fa7a5000640 1 --2- 172.21.15.17:0/3483099928 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7a0100790 0x7fa7a0195d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:25.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:25.293+0000 7fa7a5000640 1 -- 172.21.15.17:0/3483099928 >> 172.21.15.17:0/3483099928 conn(0x7fa7a00fa370 msgr2=0x7fa7a0101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:25.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:25.293+0000 7fa7a5000640 1 -- 172.21.15.17:0/3483099928 shutdown_connections 2024-09-13T15:57:25.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T15:57:25.293+0000 7fa7a5000640 1 -- 172.21.15.17:0/3483099928 wait complete. 2024-09-13T15:57:25.311 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-13T15:57:25.367 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-13T15:57:25.386 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-13T15:57:25.386 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-13T15:57:25.390 INFO:teuthology.run_tasks:Running task exec... 2024-09-13T15:57:25.401 INFO:teuthology.task.exec:Executing custom commands... 2024-09-13T15:57:25.401 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi017.front.sepia.ceph.com 2024-09-13T15:57:25.401 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-09-13T15:57:25.478 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T15:57:25.509 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem Size Used Avail Use% Mounted on 2024-09-13T15:57:25.510 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6789,172.21.15.189:6789,172.21.15.193:6789:/volumes/qa/sv_1/736a29cb-9b11-44c3-992c-0a482d8f2699 1.1T 364M 1.1T 1% /tmp/cephfs 2024-09-13T15:57:25.514 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-09-13T15:57:25.562 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:25 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3483099928' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-13T15:57:25.562 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:25 smithi017 ceph-mon[30494]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-13T15:57:25.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:25 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3483099928' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-13T15:57:25.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:25 smithi189 ceph-mon[34790]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-13T15:57:25.621 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-09-13T15:57:25.655 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:25 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3483099928' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-13T15:57:25.655 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:25 smithi193 ceph-mon[35248]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-13T15:57:25.703 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-09-13T15:57:26.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:26 smithi189 ceph-mon[34790]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-13T15:57:26.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:26 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T15:57:26.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:26 smithi189 ceph-mon[34790]: pgmap v376: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T15:57:26.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:26 smithi193 ceph-mon[35248]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-13T15:57:26.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:26 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T15:57:26.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:26 smithi193 ceph-mon[35248]: pgmap v376: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T15:57:26.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:26 smithi017 ceph-mon[30494]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-13T15:57:26.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:26 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T15:57:26.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:26 smithi017 ceph-mon[30494]: pgmap v376: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T15:57:28.062 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-09-13T15:57:28.141 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-09-13T15:57:28.145 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-09-13T15:57:28.228 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-13T15:57:28.306 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/: 2024-09-13T15:57:28.307 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T15:57:28.307 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 . 2024-09-13T15:57:28.307 INFO:teuthology.orchestra.run.smithi017.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 .. 2024-09-13T15:57:28.307 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 data 2024-09-13T15:57:28.307 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:28.307 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data: 2024-09-13T15:57:28.307 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T15:57:28.307 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T15:57:28.307 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 .. 2024-09-13T15:57:28.309 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:28 smithi017 ceph-mon[30494]: pgmap v377: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T15:57:28.311 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-09-13T15:57:28.409 INFO:teuthology.orchestra.run.smithi017.stdout:[Service] 2024-09-13T15:57:28.409 INFO:teuthology.orchestra.run.smithi017.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-09-13T15:57:28.409 INFO:teuthology.orchestra.run.smithi017.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-09-13T15:57:28.414 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-09-13T15:57:28.581 INFO:teuthology.orchestra.run.smithi017.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-09-13T15:57:28.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:28 smithi189 ceph-mon[34790]: pgmap v377: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T15:57:28.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:28 smithi193 ceph-mon[35248]: pgmap v377: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T15:57:30.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:30 smithi189 ceph-mon[34790]: pgmap v378: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2024-09-13T15:57:30.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:30 smithi193 ceph-mon[35248]: pgmap v378: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2024-09-13T15:57:30.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:30 smithi017 ceph-mon[30494]: pgmap v378: 129 pgs: 129 active+clean; 642 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2024-09-13T15:57:32.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:32 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:57:32.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:32 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:57:32.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:32 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:57:33.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:33 smithi189 ceph-mon[34790]: pgmap v379: 129 pgs: 129 active+clean; 6.2 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 483 KiB/s wr, 13 op/s 2024-09-13T15:57:33.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:33 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:33.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:33 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:33.507 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:33 smithi193 ceph-mon[35248]: pgmap v379: 129 pgs: 129 active+clean; 6.2 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 483 KiB/s wr, 13 op/s 2024-09-13T15:57:33.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:33 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:33.576 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:33 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:33.577 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:33 smithi017 ceph-mon[30494]: pgmap v379: 129 pgs: 129 active+clean; 6.2 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 483 KiB/s wr, 13 op/s 2024-09-13T15:57:33.577 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:33 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:33.577 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:33 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:33.578 INFO:teuthology.orchestra.run.smithi017.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-09-13T15:57:33.578 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-13T15:57:33.675 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/: 2024-09-13T15:57:33.676 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T15:57:33.676 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 . 2024-09-13T15:57:33.676 INFO:teuthology.orchestra.run.smithi017.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 .. 2024-09-13T15:57:33.676 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 13 15:57 data 2024-09-13T15:57:33.676 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.676 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data: 2024-09-13T15:57:33.676 INFO:teuthology.orchestra.run.smithi017.stdout:total 35 2024-09-13T15:57:33.676 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 13 15:57 . 2024-09-13T15:57:33.676 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 .. 2024-09-13T15:57:33.676 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 15:57 base 2024-09-13T15:57:33.677 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 13 15:57 global 2024-09-13T15:57:33.677 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 log 2024-09-13T15:57:33.677 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 pg_commit_ts 2024-09-13T15:57:33.677 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 pg_dynshmem 2024-09-13T15:57:33.677 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 13 15:57 pg_hba.conf 2024-09-13T15:57:33.677 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 13 15:57 pg_ident.conf 2024-09-13T15:57:33.677 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 15:57 pg_logical 2024-09-13T15:57:33.677 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 13 15:57 pg_multixact 2024-09-13T15:57:33.677 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 pg_notify 2024-09-13T15:57:33.677 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 pg_replslot 2024-09-13T15:57:33.677 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 pg_serial 2024-09-13T15:57:33.678 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 pg_snapshots 2024-09-13T15:57:33.678 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 pg_stat 2024-09-13T15:57:33.678 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 pg_stat_tmp 2024-09-13T15:57:33.678 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 pg_subtrans 2024-09-13T15:57:33.678 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 pg_tblspc 2024-09-13T15:57:33.678 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 pg_twophase 2024-09-13T15:57:33.678 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 15:57 PG_VERSION 2024-09-13T15:57:33.678 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 13 15:57 pg_wal 2024-09-13T15:57:33.678 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 pg_xact 2024-09-13T15:57:33.678 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 13 15:57 postgresql.auto.conf 2024-09-13T15:57:33.678 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 13 15:57 postgresql.conf 2024-09-13T15:57:33.679 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.679 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base: 2024-09-13T15:57:33.679 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T15:57:33.679 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 15:57 . 2024-09-13T15:57:33.679 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 13 15:57 .. 2024-09-13T15:57:33.679 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 13 15:57 1 2024-09-13T15:57:33.680 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 13 15:57 13493 2024-09-13T15:57:33.680 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 13 15:57 13494 2024-09-13T15:57:33.680 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.680 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-13T15:57:33.680 INFO:teuthology.orchestra.run.smithi017.stdout:total 7777 2024-09-13T15:57:33.680 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 13 15:57 . 2024-09-13T15:57:33.680 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 15:57 .. 2024-09-13T15:57:33.680 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 112 2024-09-13T15:57:33.680 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 113 2024-09-13T15:57:33.680 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 13 15:57 1247 2024-09-13T15:57:33.681 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1247_fsm 2024-09-13T15:57:33.681 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1247_vm 2024-09-13T15:57:33.681 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 13 15:57 1249 2024-09-13T15:57:33.681 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1249_fsm 2024-09-13T15:57:33.681 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1249_vm 2024-09-13T15:57:33.681 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 13 15:57 1255 2024-09-13T15:57:33.681 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1255_fsm 2024-09-13T15:57:33.681 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1255_vm 2024-09-13T15:57:33.681 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 13 15:57 1259 2024-09-13T15:57:33.681 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1259_fsm 2024-09-13T15:57:33.681 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1259_vm 2024-09-13T15:57:33.681 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 13 15:57 13344 2024-09-13T15:57:33.682 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13344_fsm 2024-09-13T15:57:33.682 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13344_vm 2024-09-13T15:57:33.682 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13346 2024-09-13T15:57:33.682 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13348 2024-09-13T15:57:33.682 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13349 2024-09-13T15:57:33.682 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13349_fsm 2024-09-13T15:57:33.682 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13349_vm 2024-09-13T15:57:33.682 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13351 2024-09-13T15:57:33.682 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13353 2024-09-13T15:57:33.682 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13354 2024-09-13T15:57:33.682 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13354_fsm 2024-09-13T15:57:33.682 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13354_vm 2024-09-13T15:57:33.682 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13356 2024-09-13T15:57:33.682 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13358 2024-09-13T15:57:33.683 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13359 2024-09-13T15:57:33.683 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13359_fsm 2024-09-13T15:57:33.683 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13359_vm 2024-09-13T15:57:33.683 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13361 2024-09-13T15:57:33.683 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13363 2024-09-13T15:57:33.683 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 1417 2024-09-13T15:57:33.683 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 1418 2024-09-13T15:57:33.684 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 174 2024-09-13T15:57:33.684 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 175 2024-09-13T15:57:33.684 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2187 2024-09-13T15:57:33.684 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2224 2024-09-13T15:57:33.684 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2328 2024-09-13T15:57:33.685 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2336 2024-09-13T15:57:33.685 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2337 2024-09-13T15:57:33.685 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2579 2024-09-13T15:57:33.685 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2600 2024-09-13T15:57:33.685 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2600_fsm 2024-09-13T15:57:33.685 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2600_vm 2024-09-13T15:57:33.686 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2601 2024-09-13T15:57:33.687 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2601_fsm 2024-09-13T15:57:33.687 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2601_vm 2024-09-13T15:57:33.687 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 13 15:57 2602 2024-09-13T15:57:33.687 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2602_fsm 2024-09-13T15:57:33.687 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2602_vm 2024-09-13T15:57:33.687 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2603 2024-09-13T15:57:33.687 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2603_fsm 2024-09-13T15:57:33.687 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2603_vm 2024-09-13T15:57:33.687 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2604 2024-09-13T15:57:33.688 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2605 2024-09-13T15:57:33.688 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2605_fsm 2024-09-13T15:57:33.688 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2605_vm 2024-09-13T15:57:33.688 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2606 2024-09-13T15:57:33.688 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2606_fsm 2024-09-13T15:57:33.688 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2606_vm 2024-09-13T15:57:33.688 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2607 2024-09-13T15:57:33.688 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2607_fsm 2024-09-13T15:57:33.688 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2607_vm 2024-09-13T15:57:33.689 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 13 15:57 2608 2024-09-13T15:57:33.689 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2608_fsm 2024-09-13T15:57:33.689 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2608_vm 2024-09-13T15:57:33.689 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 13 15:57 2609 2024-09-13T15:57:33.689 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2609_fsm 2024-09-13T15:57:33.689 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2609_vm 2024-09-13T15:57:33.689 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2610 2024-09-13T15:57:33.689 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2610_fsm 2024-09-13T15:57:33.689 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2610_vm 2024-09-13T15:57:33.689 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2611 2024-09-13T15:57:33.690 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2612 2024-09-13T15:57:33.690 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2612_fsm 2024-09-13T15:57:33.690 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2612_vm 2024-09-13T15:57:33.690 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2613 2024-09-13T15:57:33.690 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2615 2024-09-13T15:57:33.690 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2615_fsm 2024-09-13T15:57:33.690 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2615_vm 2024-09-13T15:57:33.690 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2616 2024-09-13T15:57:33.690 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2616_fsm 2024-09-13T15:57:33.690 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2616_vm 2024-09-13T15:57:33.691 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 13 15:57 2617 2024-09-13T15:57:33.691 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2617_fsm 2024-09-13T15:57:33.691 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2617_vm 2024-09-13T15:57:33.691 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 13 15:57 2618 2024-09-13T15:57:33.691 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2618_fsm 2024-09-13T15:57:33.691 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2618_vm 2024-09-13T15:57:33.691 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 13 15:57 2619 2024-09-13T15:57:33.691 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2619_fsm 2024-09-13T15:57:33.691 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2619_vm 2024-09-13T15:57:33.691 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2620 2024-09-13T15:57:33.691 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2650 2024-09-13T15:57:33.691 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2651 2024-09-13T15:57:33.692 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2652 2024-09-13T15:57:33.692 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2653 2024-09-13T15:57:33.692 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2654 2024-09-13T15:57:33.692 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2655 2024-09-13T15:57:33.692 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2656 2024-09-13T15:57:33.692 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2657 2024-09-13T15:57:33.693 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 13 15:57 2658 2024-09-13T15:57:33.693 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 13 15:57 2659 2024-09-13T15:57:33.693 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2660 2024-09-13T15:57:33.693 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2661 2024-09-13T15:57:33.693 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2662 2024-09-13T15:57:33.693 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 13 15:57 2663 2024-09-13T15:57:33.694 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2664 2024-09-13T15:57:33.694 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2665 2024-09-13T15:57:33.694 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2666 2024-09-13T15:57:33.694 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2667 2024-09-13T15:57:33.694 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2668 2024-09-13T15:57:33.694 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2669 2024-09-13T15:57:33.694 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2670 2024-09-13T15:57:33.694 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 13 15:57 2673 2024-09-13T15:57:33.695 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 13 15:57 2674 2024-09-13T15:57:33.695 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 13 15:57 2675 2024-09-13T15:57:33.695 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2678 2024-09-13T15:57:33.695 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2679 2024-09-13T15:57:33.695 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2680 2024-09-13T15:57:33.695 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2681 2024-09-13T15:57:33.695 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2682 2024-09-13T15:57:33.696 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2683 2024-09-13T15:57:33.696 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2684 2024-09-13T15:57:33.696 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2685 2024-09-13T15:57:33.696 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2686 2024-09-13T15:57:33.696 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2687 2024-09-13T15:57:33.696 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2688 2024-09-13T15:57:33.696 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 13 15:57 2689 2024-09-13T15:57:33.696 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 13 15:57 2690 2024-09-13T15:57:33.696 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 13 15:57 2691 2024-09-13T15:57:33.696 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2692 2024-09-13T15:57:33.696 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2693 2024-09-13T15:57:33.696 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2696 2024-09-13T15:57:33.697 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2699 2024-09-13T15:57:33.697 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2701 2024-09-13T15:57:33.697 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2702 2024-09-13T15:57:33.697 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2703 2024-09-13T15:57:33.697 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2704 2024-09-13T15:57:33.697 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2753 2024-09-13T15:57:33.697 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2753_fsm 2024-09-13T15:57:33.697 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2753_vm 2024-09-13T15:57:33.697 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2754 2024-09-13T15:57:33.698 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2755 2024-09-13T15:57:33.698 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2756 2024-09-13T15:57:33.698 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2757 2024-09-13T15:57:33.698 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2830 2024-09-13T15:57:33.698 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2831 2024-09-13T15:57:33.698 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2832 2024-09-13T15:57:33.699 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2833 2024-09-13T15:57:33.699 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2834 2024-09-13T15:57:33.699 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2835 2024-09-13T15:57:33.699 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2836 2024-09-13T15:57:33.699 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2837 2024-09-13T15:57:33.699 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 13 15:57 2838 2024-09-13T15:57:33.699 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2838_fsm 2024-09-13T15:57:33.699 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2838_vm 2024-09-13T15:57:33.700 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2839 2024-09-13T15:57:33.700 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2840 2024-09-13T15:57:33.700 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2840_fsm 2024-09-13T15:57:33.700 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2840_vm 2024-09-13T15:57:33.700 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2841 2024-09-13T15:57:33.700 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2995 2024-09-13T15:57:33.700 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2996 2024-09-13T15:57:33.700 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3079 2024-09-13T15:57:33.701 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3079_fsm 2024-09-13T15:57:33.701 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3079_vm 2024-09-13T15:57:33.701 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3080 2024-09-13T15:57:33.701 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3081 2024-09-13T15:57:33.701 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 3085 2024-09-13T15:57:33.701 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3118 2024-09-13T15:57:33.701 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3119 2024-09-13T15:57:33.701 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 13 15:57 3164 2024-09-13T15:57:33.702 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3256 2024-09-13T15:57:33.702 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3257 2024-09-13T15:57:33.702 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3258 2024-09-13T15:57:33.702 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3350 2024-09-13T15:57:33.702 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3351 2024-09-13T15:57:33.702 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3379 2024-09-13T15:57:33.702 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3380 2024-09-13T15:57:33.702 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3381 2024-09-13T15:57:33.703 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3394 2024-09-13T15:57:33.703 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3394_fsm 2024-09-13T15:57:33.703 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3394_vm 2024-09-13T15:57:33.703 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3395 2024-09-13T15:57:33.703 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3429 2024-09-13T15:57:33.703 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3430 2024-09-13T15:57:33.703 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3431 2024-09-13T15:57:33.703 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3433 2024-09-13T15:57:33.704 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3439 2024-09-13T15:57:33.704 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3440 2024-09-13T15:57:33.704 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 3455 2024-09-13T15:57:33.704 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 13 15:57 3456 2024-09-13T15:57:33.704 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3456_fsm 2024-09-13T15:57:33.704 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3456_vm 2024-09-13T15:57:33.704 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3466 2024-09-13T15:57:33.705 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3467 2024-09-13T15:57:33.705 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3468 2024-09-13T15:57:33.705 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3501 2024-09-13T15:57:33.705 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3502 2024-09-13T15:57:33.705 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3503 2024-09-13T15:57:33.705 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3534 2024-09-13T15:57:33.705 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3541 2024-09-13T15:57:33.705 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3541_fsm 2024-09-13T15:57:33.705 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3541_vm 2024-09-13T15:57:33.705 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3542 2024-09-13T15:57:33.706 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3574 2024-09-13T15:57:33.706 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3575 2024-09-13T15:57:33.706 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3576 2024-09-13T15:57:33.706 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3596 2024-09-13T15:57:33.706 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3597 2024-09-13T15:57:33.706 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3598 2024-09-13T15:57:33.706 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3599 2024-09-13T15:57:33.706 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3600 2024-09-13T15:57:33.706 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3600_fsm 2024-09-13T15:57:33.706 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3600_vm 2024-09-13T15:57:33.706 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3601 2024-09-13T15:57:33.706 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3601_fsm 2024-09-13T15:57:33.706 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3601_vm 2024-09-13T15:57:33.707 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3602 2024-09-13T15:57:33.707 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3602_fsm 2024-09-13T15:57:33.707 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3602_vm 2024-09-13T15:57:33.707 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3603 2024-09-13T15:57:33.707 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3603_fsm 2024-09-13T15:57:33.707 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3603_vm 2024-09-13T15:57:33.707 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3604 2024-09-13T15:57:33.707 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3605 2024-09-13T15:57:33.707 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3606 2024-09-13T15:57:33.707 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3607 2024-09-13T15:57:33.707 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3608 2024-09-13T15:57:33.707 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 3609 2024-09-13T15:57:33.707 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3712 2024-09-13T15:57:33.707 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3764 2024-09-13T15:57:33.708 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3764_fsm 2024-09-13T15:57:33.708 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3764_vm 2024-09-13T15:57:33.708 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3766 2024-09-13T15:57:33.708 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3767 2024-09-13T15:57:33.708 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3997 2024-09-13T15:57:33.708 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4143 2024-09-13T15:57:33.708 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4144 2024-09-13T15:57:33.708 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4145 2024-09-13T15:57:33.708 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4146 2024-09-13T15:57:33.708 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4147 2024-09-13T15:57:33.708 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4148 2024-09-13T15:57:33.708 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4149 2024-09-13T15:57:33.708 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4150 2024-09-13T15:57:33.708 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4151 2024-09-13T15:57:33.709 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4152 2024-09-13T15:57:33.709 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4153 2024-09-13T15:57:33.709 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4154 2024-09-13T15:57:33.709 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4155 2024-09-13T15:57:33.709 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4156 2024-09-13T15:57:33.709 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4157 2024-09-13T15:57:33.709 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4158 2024-09-13T15:57:33.709 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4159 2024-09-13T15:57:33.709 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4160 2024-09-13T15:57:33.709 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4161 2024-09-13T15:57:33.709 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4162 2024-09-13T15:57:33.709 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4163 2024-09-13T15:57:33.709 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4164 2024-09-13T15:57:33.709 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4165 2024-09-13T15:57:33.712 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4166 2024-09-13T15:57:33.712 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4167 2024-09-13T15:57:33.712 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4168 2024-09-13T15:57:33.713 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4169 2024-09-13T15:57:33.713 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4170 2024-09-13T15:57:33.713 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4171 2024-09-13T15:57:33.713 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4172 2024-09-13T15:57:33.713 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4173 2024-09-13T15:57:33.713 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4174 2024-09-13T15:57:33.713 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 5002 2024-09-13T15:57:33.713 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 548 2024-09-13T15:57:33.713 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 549 2024-09-13T15:57:33.713 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 6102 2024-09-13T15:57:33.713 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 6104 2024-09-13T15:57:33.714 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 6106 2024-09-13T15:57:33.714 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6110 2024-09-13T15:57:33.714 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6111 2024-09-13T15:57:33.714 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6112 2024-09-13T15:57:33.714 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6113 2024-09-13T15:57:33.714 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6117 2024-09-13T15:57:33.714 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 826 2024-09-13T15:57:33.714 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 827 2024-09-13T15:57:33.714 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 828 2024-09-13T15:57:33.714 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 13 15:57 pg_filenode.map 2024-09-13T15:57:33.714 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 15:57 PG_VERSION 2024-09-13T15:57:33.714 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.714 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-13T15:57:33.714 INFO:teuthology.orchestra.run.smithi017.stdout:total 7777 2024-09-13T15:57:33.715 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 13 15:57 . 2024-09-13T15:57:33.715 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 15:57 .. 2024-09-13T15:57:33.715 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 112 2024-09-13T15:57:33.715 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 113 2024-09-13T15:57:33.715 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 13 15:57 1247 2024-09-13T15:57:33.715 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1247_fsm 2024-09-13T15:57:33.715 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1247_vm 2024-09-13T15:57:33.715 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 13 15:57 1249 2024-09-13T15:57:33.715 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1249_fsm 2024-09-13T15:57:33.715 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1249_vm 2024-09-13T15:57:33.715 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 13 15:57 1255 2024-09-13T15:57:33.715 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1255_fsm 2024-09-13T15:57:33.715 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1255_vm 2024-09-13T15:57:33.715 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 13 15:57 1259 2024-09-13T15:57:33.716 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1259_fsm 2024-09-13T15:57:33.716 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1259_vm 2024-09-13T15:57:33.716 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 13 15:57 13344 2024-09-13T15:57:33.716 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13344_fsm 2024-09-13T15:57:33.716 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13344_vm 2024-09-13T15:57:33.716 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13346 2024-09-13T15:57:33.716 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13348 2024-09-13T15:57:33.716 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13349 2024-09-13T15:57:33.716 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13349_fsm 2024-09-13T15:57:33.716 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13349_vm 2024-09-13T15:57:33.716 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13351 2024-09-13T15:57:33.716 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13353 2024-09-13T15:57:33.717 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13354 2024-09-13T15:57:33.717 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13354_fsm 2024-09-13T15:57:33.717 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13354_vm 2024-09-13T15:57:33.717 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13356 2024-09-13T15:57:33.717 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13358 2024-09-13T15:57:33.717 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13359 2024-09-13T15:57:33.717 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13359_fsm 2024-09-13T15:57:33.717 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13359_vm 2024-09-13T15:57:33.717 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13361 2024-09-13T15:57:33.717 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13363 2024-09-13T15:57:33.717 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 1417 2024-09-13T15:57:33.717 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 1418 2024-09-13T15:57:33.717 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 174 2024-09-13T15:57:33.717 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 175 2024-09-13T15:57:33.718 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2187 2024-09-13T15:57:33.718 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2224 2024-09-13T15:57:33.718 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2328 2024-09-13T15:57:33.718 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2336 2024-09-13T15:57:33.718 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2337 2024-09-13T15:57:33.718 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2579 2024-09-13T15:57:33.718 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2600 2024-09-13T15:57:33.718 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2600_fsm 2024-09-13T15:57:33.718 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2600_vm 2024-09-13T15:57:33.718 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2601 2024-09-13T15:57:33.718 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2601_fsm 2024-09-13T15:57:33.718 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2601_vm 2024-09-13T15:57:33.718 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 13 15:57 2602 2024-09-13T15:57:33.718 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2602_fsm 2024-09-13T15:57:33.719 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2602_vm 2024-09-13T15:57:33.719 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2603 2024-09-13T15:57:33.719 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2603_fsm 2024-09-13T15:57:33.719 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2603_vm 2024-09-13T15:57:33.719 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2604 2024-09-13T15:57:33.719 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2605 2024-09-13T15:57:33.719 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2605_fsm 2024-09-13T15:57:33.719 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2605_vm 2024-09-13T15:57:33.719 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2606 2024-09-13T15:57:33.719 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2606_fsm 2024-09-13T15:57:33.719 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2606_vm 2024-09-13T15:57:33.719 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2607 2024-09-13T15:57:33.719 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2607_fsm 2024-09-13T15:57:33.719 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2607_vm 2024-09-13T15:57:33.720 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 13 15:57 2608 2024-09-13T15:57:33.720 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2608_fsm 2024-09-13T15:57:33.720 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2608_vm 2024-09-13T15:57:33.720 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 13 15:57 2609 2024-09-13T15:57:33.720 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2609_fsm 2024-09-13T15:57:33.720 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2609_vm 2024-09-13T15:57:33.720 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2610 2024-09-13T15:57:33.720 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2610_fsm 2024-09-13T15:57:33.720 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2610_vm 2024-09-13T15:57:33.720 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2611 2024-09-13T15:57:33.720 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2612 2024-09-13T15:57:33.720 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2612_fsm 2024-09-13T15:57:33.720 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2612_vm 2024-09-13T15:57:33.720 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2613 2024-09-13T15:57:33.721 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2615 2024-09-13T15:57:33.721 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2615_fsm 2024-09-13T15:57:33.721 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2615_vm 2024-09-13T15:57:33.721 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2616 2024-09-13T15:57:33.721 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2616_fsm 2024-09-13T15:57:33.721 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2616_vm 2024-09-13T15:57:33.721 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 13 15:57 2617 2024-09-13T15:57:33.721 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2617_fsm 2024-09-13T15:57:33.721 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2617_vm 2024-09-13T15:57:33.722 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 13 15:57 2618 2024-09-13T15:57:33.722 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2618_fsm 2024-09-13T15:57:33.722 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2618_vm 2024-09-13T15:57:33.722 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 13 15:57 2619 2024-09-13T15:57:33.722 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2619_fsm 2024-09-13T15:57:33.722 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2619_vm 2024-09-13T15:57:33.722 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2620 2024-09-13T15:57:33.722 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2650 2024-09-13T15:57:33.722 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2651 2024-09-13T15:57:33.722 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2652 2024-09-13T15:57:33.722 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2653 2024-09-13T15:57:33.722 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2654 2024-09-13T15:57:33.722 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2655 2024-09-13T15:57:33.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2656 2024-09-13T15:57:33.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2657 2024-09-13T15:57:33.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 13 15:57 2658 2024-09-13T15:57:33.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 13 15:57 2659 2024-09-13T15:57:33.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2660 2024-09-13T15:57:33.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2661 2024-09-13T15:57:33.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2662 2024-09-13T15:57:33.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 13 15:57 2663 2024-09-13T15:57:33.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2664 2024-09-13T15:57:33.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2665 2024-09-13T15:57:33.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2666 2024-09-13T15:57:33.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2667 2024-09-13T15:57:33.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2668 2024-09-13T15:57:33.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2669 2024-09-13T15:57:33.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2670 2024-09-13T15:57:33.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 13 15:57 2673 2024-09-13T15:57:33.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 13 15:57 2674 2024-09-13T15:57:33.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 13 15:57 2675 2024-09-13T15:57:33.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2678 2024-09-13T15:57:33.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2679 2024-09-13T15:57:33.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2680 2024-09-13T15:57:33.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2681 2024-09-13T15:57:33.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2682 2024-09-13T15:57:33.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2683 2024-09-13T15:57:33.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2684 2024-09-13T15:57:33.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2685 2024-09-13T15:57:33.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2686 2024-09-13T15:57:33.725 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2687 2024-09-13T15:57:33.725 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2688 2024-09-13T15:57:33.725 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 13 15:57 2689 2024-09-13T15:57:33.725 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 13 15:57 2690 2024-09-13T15:57:33.725 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 13 15:57 2691 2024-09-13T15:57:33.725 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2692 2024-09-13T15:57:33.725 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2693 2024-09-13T15:57:33.725 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2696 2024-09-13T15:57:33.725 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2699 2024-09-13T15:57:33.725 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2701 2024-09-13T15:57:33.725 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2702 2024-09-13T15:57:33.725 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2703 2024-09-13T15:57:33.725 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2704 2024-09-13T15:57:33.725 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2753 2024-09-13T15:57:33.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2753_fsm 2024-09-13T15:57:33.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2753_vm 2024-09-13T15:57:33.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2754 2024-09-13T15:57:33.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2755 2024-09-13T15:57:33.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2756 2024-09-13T15:57:33.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2757 2024-09-13T15:57:33.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2830 2024-09-13T15:57:33.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2831 2024-09-13T15:57:33.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2832 2024-09-13T15:57:33.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2833 2024-09-13T15:57:33.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2834 2024-09-13T15:57:33.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2835 2024-09-13T15:57:33.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2836 2024-09-13T15:57:33.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2837 2024-09-13T15:57:33.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 13 15:57 2838 2024-09-13T15:57:33.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2838_fsm 2024-09-13T15:57:33.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2838_vm 2024-09-13T15:57:33.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2839 2024-09-13T15:57:33.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2840 2024-09-13T15:57:33.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2840_fsm 2024-09-13T15:57:33.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2840_vm 2024-09-13T15:57:33.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2841 2024-09-13T15:57:33.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2995 2024-09-13T15:57:33.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2996 2024-09-13T15:57:33.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3079 2024-09-13T15:57:33.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3079_fsm 2024-09-13T15:57:33.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3079_vm 2024-09-13T15:57:33.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3080 2024-09-13T15:57:33.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3081 2024-09-13T15:57:33.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 3085 2024-09-13T15:57:33.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3118 2024-09-13T15:57:33.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3119 2024-09-13T15:57:33.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 13 15:57 3164 2024-09-13T15:57:33.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3256 2024-09-13T15:57:33.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3257 2024-09-13T15:57:33.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3258 2024-09-13T15:57:33.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3350 2024-09-13T15:57:33.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3351 2024-09-13T15:57:33.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3379 2024-09-13T15:57:33.729 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3380 2024-09-13T15:57:33.729 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3381 2024-09-13T15:57:33.729 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3394 2024-09-13T15:57:33.729 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3394_fsm 2024-09-13T15:57:33.729 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3394_vm 2024-09-13T15:57:33.729 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3395 2024-09-13T15:57:33.729 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3429 2024-09-13T15:57:33.730 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3430 2024-09-13T15:57:33.730 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3431 2024-09-13T15:57:33.730 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3433 2024-09-13T15:57:33.730 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3439 2024-09-13T15:57:33.730 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3440 2024-09-13T15:57:33.730 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 3455 2024-09-13T15:57:33.730 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 13 15:57 3456 2024-09-13T15:57:33.730 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3456_fsm 2024-09-13T15:57:33.730 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3456_vm 2024-09-13T15:57:33.730 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3466 2024-09-13T15:57:33.730 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3467 2024-09-13T15:57:33.730 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3468 2024-09-13T15:57:33.730 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3501 2024-09-13T15:57:33.731 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3502 2024-09-13T15:57:33.731 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3503 2024-09-13T15:57:33.731 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3534 2024-09-13T15:57:33.731 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3541 2024-09-13T15:57:33.731 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3541_fsm 2024-09-13T15:57:33.731 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3541_vm 2024-09-13T15:57:33.731 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3542 2024-09-13T15:57:33.731 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3574 2024-09-13T15:57:33.731 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3575 2024-09-13T15:57:33.731 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3576 2024-09-13T15:57:33.732 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3596 2024-09-13T15:57:33.732 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3597 2024-09-13T15:57:33.732 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3598 2024-09-13T15:57:33.732 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3599 2024-09-13T15:57:33.732 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3600 2024-09-13T15:57:33.732 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3600_fsm 2024-09-13T15:57:33.732 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3600_vm 2024-09-13T15:57:33.732 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3601 2024-09-13T15:57:33.732 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3601_fsm 2024-09-13T15:57:33.732 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3601_vm 2024-09-13T15:57:33.732 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3602 2024-09-13T15:57:33.732 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3602_fsm 2024-09-13T15:57:33.732 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3602_vm 2024-09-13T15:57:33.733 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3603 2024-09-13T15:57:33.733 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3603_fsm 2024-09-13T15:57:33.733 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3603_vm 2024-09-13T15:57:33.733 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3604 2024-09-13T15:57:33.733 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3605 2024-09-13T15:57:33.733 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3606 2024-09-13T15:57:33.733 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3607 2024-09-13T15:57:33.733 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3608 2024-09-13T15:57:33.733 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 3609 2024-09-13T15:57:33.733 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3712 2024-09-13T15:57:33.733 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3764 2024-09-13T15:57:33.733 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3764_fsm 2024-09-13T15:57:33.734 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3764_vm 2024-09-13T15:57:33.734 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3766 2024-09-13T15:57:33.734 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3767 2024-09-13T15:57:33.734 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3997 2024-09-13T15:57:33.734 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4143 2024-09-13T15:57:33.734 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4144 2024-09-13T15:57:33.734 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4145 2024-09-13T15:57:33.734 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4146 2024-09-13T15:57:33.734 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4147 2024-09-13T15:57:33.734 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4148 2024-09-13T15:57:33.734 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4149 2024-09-13T15:57:33.734 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4150 2024-09-13T15:57:33.735 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4151 2024-09-13T15:57:33.735 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4152 2024-09-13T15:57:33.735 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4153 2024-09-13T15:57:33.735 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4154 2024-09-13T15:57:33.735 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4155 2024-09-13T15:57:33.735 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4156 2024-09-13T15:57:33.735 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4157 2024-09-13T15:57:33.735 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4158 2024-09-13T15:57:33.735 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4159 2024-09-13T15:57:33.735 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4160 2024-09-13T15:57:33.735 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4161 2024-09-13T15:57:33.735 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4162 2024-09-13T15:57:33.735 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4163 2024-09-13T15:57:33.735 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4164 2024-09-13T15:57:33.736 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4165 2024-09-13T15:57:33.736 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4166 2024-09-13T15:57:33.736 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4167 2024-09-13T15:57:33.736 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4168 2024-09-13T15:57:33.736 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4169 2024-09-13T15:57:33.736 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4170 2024-09-13T15:57:33.736 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4171 2024-09-13T15:57:33.736 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4172 2024-09-13T15:57:33.736 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4173 2024-09-13T15:57:33.736 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4174 2024-09-13T15:57:33.736 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 5002 2024-09-13T15:57:33.736 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 548 2024-09-13T15:57:33.736 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 549 2024-09-13T15:57:33.737 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 6102 2024-09-13T15:57:33.737 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 6104 2024-09-13T15:57:33.737 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 6106 2024-09-13T15:57:33.737 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6110 2024-09-13T15:57:33.737 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6111 2024-09-13T15:57:33.737 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6112 2024-09-13T15:57:33.737 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6113 2024-09-13T15:57:33.737 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6117 2024-09-13T15:57:33.737 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 826 2024-09-13T15:57:33.737 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 827 2024-09-13T15:57:33.737 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 828 2024-09-13T15:57:33.737 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 13 15:57 pg_filenode.map 2024-09-13T15:57:33.737 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 15:57 PG_VERSION 2024-09-13T15:57:33.738 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.738 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-13T15:57:33.738 INFO:teuthology.orchestra.run.smithi017.stdout:total 7777 2024-09-13T15:57:33.738 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 13 15:57 . 2024-09-13T15:57:33.738 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 15:57 .. 2024-09-13T15:57:33.738 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 112 2024-09-13T15:57:33.738 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 113 2024-09-13T15:57:33.738 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 13 15:57 1247 2024-09-13T15:57:33.738 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1247_fsm 2024-09-13T15:57:33.738 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1247_vm 2024-09-13T15:57:33.738 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 13 15:57 1249 2024-09-13T15:57:33.738 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1249_fsm 2024-09-13T15:57:33.738 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1249_vm 2024-09-13T15:57:33.739 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 13 15:57 1255 2024-09-13T15:57:33.739 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1255_fsm 2024-09-13T15:57:33.739 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1255_vm 2024-09-13T15:57:33.739 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 13 15:57 1259 2024-09-13T15:57:33.739 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1259_fsm 2024-09-13T15:57:33.740 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1259_vm 2024-09-13T15:57:33.740 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 13 15:57 13344 2024-09-13T15:57:33.740 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13344_fsm 2024-09-13T15:57:33.740 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13344_vm 2024-09-13T15:57:33.740 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13346 2024-09-13T15:57:33.740 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13348 2024-09-13T15:57:33.740 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13349 2024-09-13T15:57:33.740 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13349_fsm 2024-09-13T15:57:33.740 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13349_vm 2024-09-13T15:57:33.740 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13351 2024-09-13T15:57:33.740 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13353 2024-09-13T15:57:33.740 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13354 2024-09-13T15:57:33.740 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13354_fsm 2024-09-13T15:57:33.741 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13354_vm 2024-09-13T15:57:33.741 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13356 2024-09-13T15:57:33.741 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13358 2024-09-13T15:57:33.741 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13359 2024-09-13T15:57:33.741 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13359_fsm 2024-09-13T15:57:33.741 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13359_vm 2024-09-13T15:57:33.741 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13361 2024-09-13T15:57:33.741 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13363 2024-09-13T15:57:33.741 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 1417 2024-09-13T15:57:33.741 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 1418 2024-09-13T15:57:33.741 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 174 2024-09-13T15:57:33.742 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 175 2024-09-13T15:57:33.742 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2187 2024-09-13T15:57:33.742 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2224 2024-09-13T15:57:33.742 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2328 2024-09-13T15:57:33.742 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2336 2024-09-13T15:57:33.742 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2337 2024-09-13T15:57:33.742 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2579 2024-09-13T15:57:33.742 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2600 2024-09-13T15:57:33.742 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2600_fsm 2024-09-13T15:57:33.742 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2600_vm 2024-09-13T15:57:33.742 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2601 2024-09-13T15:57:33.742 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2601_fsm 2024-09-13T15:57:33.743 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2601_vm 2024-09-13T15:57:33.743 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 13 15:57 2602 2024-09-13T15:57:33.743 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2602_fsm 2024-09-13T15:57:33.743 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2602_vm 2024-09-13T15:57:33.743 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2603 2024-09-13T15:57:33.743 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2603_fsm 2024-09-13T15:57:33.743 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2603_vm 2024-09-13T15:57:33.743 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2604 2024-09-13T15:57:33.743 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2605 2024-09-13T15:57:33.743 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2605_fsm 2024-09-13T15:57:33.743 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2605_vm 2024-09-13T15:57:33.743 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2606 2024-09-13T15:57:33.743 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2606_fsm 2024-09-13T15:57:33.743 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2606_vm 2024-09-13T15:57:33.744 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2607 2024-09-13T15:57:33.744 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2607_fsm 2024-09-13T15:57:33.744 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2607_vm 2024-09-13T15:57:33.744 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 13 15:57 2608 2024-09-13T15:57:33.744 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2608_fsm 2024-09-13T15:57:33.744 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2608_vm 2024-09-13T15:57:33.744 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 13 15:57 2609 2024-09-13T15:57:33.744 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2609_fsm 2024-09-13T15:57:33.744 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2609_vm 2024-09-13T15:57:33.744 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2610 2024-09-13T15:57:33.744 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2610_fsm 2024-09-13T15:57:33.745 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2610_vm 2024-09-13T15:57:33.745 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2611 2024-09-13T15:57:33.745 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2612 2024-09-13T15:57:33.745 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2612_fsm 2024-09-13T15:57:33.745 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2612_vm 2024-09-13T15:57:33.745 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2613 2024-09-13T15:57:33.745 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2615 2024-09-13T15:57:33.745 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2615_fsm 2024-09-13T15:57:33.745 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2615_vm 2024-09-13T15:57:33.746 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2616 2024-09-13T15:57:33.746 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2616_fsm 2024-09-13T15:57:33.746 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2616_vm 2024-09-13T15:57:33.746 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 13 15:57 2617 2024-09-13T15:57:33.746 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2617_fsm 2024-09-13T15:57:33.746 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2617_vm 2024-09-13T15:57:33.746 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 13 15:57 2618 2024-09-13T15:57:33.747 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2618_fsm 2024-09-13T15:57:33.747 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2618_vm 2024-09-13T15:57:33.747 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 13 15:57 2619 2024-09-13T15:57:33.747 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2619_fsm 2024-09-13T15:57:33.747 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2619_vm 2024-09-13T15:57:33.747 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2620 2024-09-13T15:57:33.747 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2650 2024-09-13T15:57:33.747 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2651 2024-09-13T15:57:33.747 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2652 2024-09-13T15:57:33.747 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2653 2024-09-13T15:57:33.747 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2654 2024-09-13T15:57:33.747 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2655 2024-09-13T15:57:33.747 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2656 2024-09-13T15:57:33.747 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2657 2024-09-13T15:57:33.748 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 13 15:57 2658 2024-09-13T15:57:33.748 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 13 15:57 2659 2024-09-13T15:57:33.748 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2660 2024-09-13T15:57:33.748 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2661 2024-09-13T15:57:33.748 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2662 2024-09-13T15:57:33.748 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 13 15:57 2663 2024-09-13T15:57:33.748 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2664 2024-09-13T15:57:33.748 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2665 2024-09-13T15:57:33.748 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2666 2024-09-13T15:57:33.748 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2667 2024-09-13T15:57:33.748 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2668 2024-09-13T15:57:33.748 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2669 2024-09-13T15:57:33.748 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2670 2024-09-13T15:57:33.749 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 13 15:57 2673 2024-09-13T15:57:33.749 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 13 15:57 2674 2024-09-13T15:57:33.749 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 13 15:57 2675 2024-09-13T15:57:33.749 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2678 2024-09-13T15:57:33.749 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2679 2024-09-13T15:57:33.749 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2680 2024-09-13T15:57:33.749 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2681 2024-09-13T15:57:33.749 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2682 2024-09-13T15:57:33.749 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2683 2024-09-13T15:57:33.749 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2684 2024-09-13T15:57:33.749 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2685 2024-09-13T15:57:33.749 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2686 2024-09-13T15:57:33.749 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2687 2024-09-13T15:57:33.749 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2688 2024-09-13T15:57:33.750 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 13 15:57 2689 2024-09-13T15:57:33.750 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 13 15:57 2690 2024-09-13T15:57:33.750 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 13 15:57 2691 2024-09-13T15:57:33.750 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2692 2024-09-13T15:57:33.750 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2693 2024-09-13T15:57:33.750 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2696 2024-09-13T15:57:33.750 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2699 2024-09-13T15:57:33.750 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2701 2024-09-13T15:57:33.750 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2702 2024-09-13T15:57:33.750 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2703 2024-09-13T15:57:33.750 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2704 2024-09-13T15:57:33.750 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2753 2024-09-13T15:57:33.750 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2753_fsm 2024-09-13T15:57:33.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2753_vm 2024-09-13T15:57:33.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2754 2024-09-13T15:57:33.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2755 2024-09-13T15:57:33.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2756 2024-09-13T15:57:33.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2757 2024-09-13T15:57:33.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2830 2024-09-13T15:57:33.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2831 2024-09-13T15:57:33.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2832 2024-09-13T15:57:33.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2833 2024-09-13T15:57:33.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2834 2024-09-13T15:57:33.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2835 2024-09-13T15:57:33.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2836 2024-09-13T15:57:33.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2837 2024-09-13T15:57:33.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 13 15:57 2838 2024-09-13T15:57:33.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2838_fsm 2024-09-13T15:57:33.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2838_vm 2024-09-13T15:57:33.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2839 2024-09-13T15:57:33.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2840 2024-09-13T15:57:33.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2840_fsm 2024-09-13T15:57:33.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2840_vm 2024-09-13T15:57:33.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2841 2024-09-13T15:57:33.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2995 2024-09-13T15:57:33.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2996 2024-09-13T15:57:33.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3079 2024-09-13T15:57:33.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3079_fsm 2024-09-13T15:57:33.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3079_vm 2024-09-13T15:57:33.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3080 2024-09-13T15:57:33.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3081 2024-09-13T15:57:33.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 3085 2024-09-13T15:57:33.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3118 2024-09-13T15:57:33.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3119 2024-09-13T15:57:33.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 13 15:57 3164 2024-09-13T15:57:33.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3256 2024-09-13T15:57:33.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3257 2024-09-13T15:57:33.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3258 2024-09-13T15:57:33.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3350 2024-09-13T15:57:33.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3351 2024-09-13T15:57:33.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3379 2024-09-13T15:57:33.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3380 2024-09-13T15:57:33.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3381 2024-09-13T15:57:33.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3394 2024-09-13T15:57:33.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3394_fsm 2024-09-13T15:57:33.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3394_vm 2024-09-13T15:57:33.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3395 2024-09-13T15:57:33.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3429 2024-09-13T15:57:33.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3430 2024-09-13T15:57:33.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3431 2024-09-13T15:57:33.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3433 2024-09-13T15:57:33.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3439 2024-09-13T15:57:33.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3440 2024-09-13T15:57:33.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 3455 2024-09-13T15:57:33.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 13 15:57 3456 2024-09-13T15:57:33.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3456_fsm 2024-09-13T15:57:33.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3456_vm 2024-09-13T15:57:33.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3466 2024-09-13T15:57:33.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3467 2024-09-13T15:57:33.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3468 2024-09-13T15:57:33.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3501 2024-09-13T15:57:33.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3502 2024-09-13T15:57:33.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3503 2024-09-13T15:57:33.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3534 2024-09-13T15:57:33.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3541 2024-09-13T15:57:33.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3541_fsm 2024-09-13T15:57:33.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3541_vm 2024-09-13T15:57:33.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3542 2024-09-13T15:57:33.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3574 2024-09-13T15:57:33.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3575 2024-09-13T15:57:33.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3576 2024-09-13T15:57:33.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3596 2024-09-13T15:57:33.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3597 2024-09-13T15:57:33.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3598 2024-09-13T15:57:33.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3599 2024-09-13T15:57:33.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3600 2024-09-13T15:57:33.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3600_fsm 2024-09-13T15:57:33.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3600_vm 2024-09-13T15:57:33.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3601 2024-09-13T15:57:33.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3601_fsm 2024-09-13T15:57:33.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3601_vm 2024-09-13T15:57:33.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3602 2024-09-13T15:57:33.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3602_fsm 2024-09-13T15:57:33.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3602_vm 2024-09-13T15:57:33.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3603 2024-09-13T15:57:33.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3603_fsm 2024-09-13T15:57:33.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3603_vm 2024-09-13T15:57:33.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3604 2024-09-13T15:57:33.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3605 2024-09-13T15:57:33.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3606 2024-09-13T15:57:33.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3607 2024-09-13T15:57:33.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3608 2024-09-13T15:57:33.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 3609 2024-09-13T15:57:33.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3712 2024-09-13T15:57:33.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3764 2024-09-13T15:57:33.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3764_fsm 2024-09-13T15:57:33.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3764_vm 2024-09-13T15:57:33.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3766 2024-09-13T15:57:33.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3767 2024-09-13T15:57:33.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3997 2024-09-13T15:57:33.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4143 2024-09-13T15:57:33.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4144 2024-09-13T15:57:33.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4145 2024-09-13T15:57:33.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4146 2024-09-13T15:57:33.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4147 2024-09-13T15:57:33.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4148 2024-09-13T15:57:33.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4149 2024-09-13T15:57:33.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4150 2024-09-13T15:57:33.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4151 2024-09-13T15:57:33.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4152 2024-09-13T15:57:33.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4153 2024-09-13T15:57:33.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4154 2024-09-13T15:57:33.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4155 2024-09-13T15:57:33.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4156 2024-09-13T15:57:33.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4157 2024-09-13T15:57:33.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4158 2024-09-13T15:57:33.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4159 2024-09-13T15:57:33.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4160 2024-09-13T15:57:33.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4161 2024-09-13T15:57:33.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4162 2024-09-13T15:57:33.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4163 2024-09-13T15:57:33.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4164 2024-09-13T15:57:33.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4165 2024-09-13T15:57:33.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4166 2024-09-13T15:57:33.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4167 2024-09-13T15:57:33.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4168 2024-09-13T15:57:33.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4169 2024-09-13T15:57:33.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4170 2024-09-13T15:57:33.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4171 2024-09-13T15:57:33.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4172 2024-09-13T15:57:33.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4173 2024-09-13T15:57:33.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4174 2024-09-13T15:57:33.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 5002 2024-09-13T15:57:33.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 548 2024-09-13T15:57:33.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 549 2024-09-13T15:57:33.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 6102 2024-09-13T15:57:33.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 6104 2024-09-13T15:57:33.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 6106 2024-09-13T15:57:33.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6110 2024-09-13T15:57:33.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6111 2024-09-13T15:57:33.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6112 2024-09-13T15:57:33.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6113 2024-09-13T15:57:33.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6117 2024-09-13T15:57:33.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 826 2024-09-13T15:57:33.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 827 2024-09-13T15:57:33.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 828 2024-09-13T15:57:33.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 13 15:57 pg_filenode.map 2024-09-13T15:57:33.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 15:57 PG_VERSION 2024-09-13T15:57:33.761 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.762 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/global: 2024-09-13T15:57:33.762 INFO:teuthology.orchestra.run.smithi017.stdout:total 537 2024-09-13T15:57:33.762 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 13 15:57 . 2024-09-13T15:57:33.762 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 13 15:57 .. 2024-09-13T15:57:33.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1213 2024-09-13T15:57:33.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1213_fsm 2024-09-13T15:57:33.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1213_vm 2024-09-13T15:57:33.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1214 2024-09-13T15:57:33.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1214_fsm 2024-09-13T15:57:33.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1214_vm 2024-09-13T15:57:33.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 1232 2024-09-13T15:57:33.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 1233 2024-09-13T15:57:33.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1260 2024-09-13T15:57:33.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1260_fsm 2024-09-13T15:57:33.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1260_vm 2024-09-13T15:57:33.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1261 2024-09-13T15:57:33.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1261_fsm 2024-09-13T15:57:33.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1261_vm 2024-09-13T15:57:33.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1262 2024-09-13T15:57:33.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1262_fsm 2024-09-13T15:57:33.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1262_vm 2024-09-13T15:57:33.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2396 2024-09-13T15:57:33.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2396_fsm 2024-09-13T15:57:33.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2396_vm 2024-09-13T15:57:33.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2397 2024-09-13T15:57:33.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2671 2024-09-13T15:57:33.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2672 2024-09-13T15:57:33.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2676 2024-09-13T15:57:33.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2677 2024-09-13T15:57:33.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2694 2024-09-13T15:57:33.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2695 2024-09-13T15:57:33.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2697 2024-09-13T15:57:33.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2698 2024-09-13T15:57:33.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2846 2024-09-13T15:57:33.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2847 2024-09-13T15:57:33.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2964 2024-09-13T15:57:33.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2965 2024-09-13T15:57:33.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2966 2024-09-13T15:57:33.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2967 2024-09-13T15:57:33.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3592 2024-09-13T15:57:33.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3593 2024-09-13T15:57:33.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4060 2024-09-13T15:57:33.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4061 2024-09-13T15:57:33.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4175 2024-09-13T15:57:33.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4176 2024-09-13T15:57:33.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4177 2024-09-13T15:57:33.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4178 2024-09-13T15:57:33.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4181 2024-09-13T15:57:33.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4182 2024-09-13T15:57:33.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4183 2024-09-13T15:57:33.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4184 2024-09-13T15:57:33.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4185 2024-09-13T15:57:33.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4186 2024-09-13T15:57:33.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 6000 2024-09-13T15:57:33.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6001 2024-09-13T15:57:33.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6002 2024-09-13T15:57:33.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 6100 2024-09-13T15:57:33.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6114 2024-09-13T15:57:33.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6115 2024-09-13T15:57:33.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 pg_control 2024-09-13T15:57:33.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 13 15:57 pg_filenode.map 2024-09-13T15:57:33.766 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.766 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/log: 2024-09-13T15:57:33.766 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T15:57:33.766 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T15:57:33.766 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 13 15:57 .. 2024-09-13T15:57:33.766 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.766 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-13T15:57:33.766 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T15:57:33.766 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T15:57:33.767 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 13 15:57 .. 2024-09-13T15:57:33.767 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.767 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-13T15:57:33.767 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T15:57:33.767 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T15:57:33.767 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 13 15:57 .. 2024-09-13T15:57:33.767 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.767 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-13T15:57:33.767 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2024-09-13T15:57:33.767 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 15:57 . 2024-09-13T15:57:33.767 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 13 15:57 .. 2024-09-13T15:57:33.767 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 mappings 2024-09-13T15:57:33.767 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 13 15:57 replorigin_checkpoint 2024-09-13T15:57:33.767 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 snapshots 2024-09-13T15:57:33.767 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.768 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-13T15:57:33.768 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T15:57:33.768 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T15:57:33.768 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 15:57 .. 2024-09-13T15:57:33.768 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.768 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-13T15:57:33.768 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T15:57:33.768 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T15:57:33.768 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 15:57 .. 2024-09-13T15:57:33.768 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.768 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-13T15:57:33.768 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T15:57:33.769 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 13 15:57 . 2024-09-13T15:57:33.769 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 13 15:57 .. 2024-09-13T15:57:33.769 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 members 2024-09-13T15:57:33.769 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 offsets 2024-09-13T15:57:33.769 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.769 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-13T15:57:33.769 INFO:teuthology.orchestra.run.smithi017.stdout:total 8 2024-09-13T15:57:33.769 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 . 2024-09-13T15:57:33.769 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 13 15:57 .. 2024-09-13T15:57:33.769 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 0000 2024-09-13T15:57:33.770 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.770 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-13T15:57:33.770 INFO:teuthology.orchestra.run.smithi017.stdout:total 8 2024-09-13T15:57:33.770 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 . 2024-09-13T15:57:33.770 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 13 15:57 .. 2024-09-13T15:57:33.770 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 0000 2024-09-13T15:57:33.770 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.770 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-13T15:57:33.770 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T15:57:33.770 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T15:57:33.771 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 13 15:57 .. 2024-09-13T15:57:33.771 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.771 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-13T15:57:33.771 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T15:57:33.771 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T15:57:33.771 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 13 15:57 .. 2024-09-13T15:57:33.771 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.771 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-13T15:57:33.771 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T15:57:33.772 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T15:57:33.772 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 13 15:57 .. 2024-09-13T15:57:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.772 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-13T15:57:33.772 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T15:57:33.772 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T15:57:33.772 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 13 15:57 .. 2024-09-13T15:57:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.772 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-13T15:57:33.773 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T15:57:33.773 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T15:57:33.773 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 13 15:57 .. 2024-09-13T15:57:33.773 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.773 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-13T15:57:33.773 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T15:57:33.773 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T15:57:33.773 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 13 15:57 .. 2024-09-13T15:57:33.773 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.773 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-13T15:57:33.774 INFO:teuthology.orchestra.run.smithi017.stdout:total 8 2024-09-13T15:57:33.774 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 . 2024-09-13T15:57:33.774 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 13 15:57 .. 2024-09-13T15:57:33.774 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 0000 2024-09-13T15:57:33.774 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.774 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-13T15:57:33.774 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T15:57:33.774 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T15:57:33.774 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 13 15:57 .. 2024-09-13T15:57:33.774 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.775 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-13T15:57:33.775 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T15:57:33.775 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T15:57:33.775 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 13 15:57 .. 2024-09-13T15:57:33.775 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.775 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-13T15:57:33.775 INFO:teuthology.orchestra.run.smithi017.stdout:total 16384 2024-09-13T15:57:33.775 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 13 15:57 . 2024-09-13T15:57:33.775 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 13 15:57 .. 2024-09-13T15:57:33.775 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 15:57 000000010000000000000001 2024-09-13T15:57:33.776 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 archive_status 2024-09-13T15:57:33.776 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.776 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-13T15:57:33.776 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T15:57:33.776 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T15:57:33.776 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 13 15:57 .. 2024-09-13T15:57:33.776 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T15:57:33.776 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-13T15:57:33.776 INFO:teuthology.orchestra.run.smithi017.stdout:total 8 2024-09-13T15:57:33.776 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 . 2024-09-13T15:57:33.776 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 13 15:57 .. 2024-09-13T15:57:33.776 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 0000 2024-09-13T15:57:33.777 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-09-13T15:57:34.009 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-09-13T15:57:34.114 INFO:teuthology.orchestra.run.smithi017.stderr:dropping old tables... 2024-09-13T15:57:34.114 INFO:teuthology.orchestra.run.smithi017.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-09-13T15:57:34.115 INFO:teuthology.orchestra.run.smithi017.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-09-13T15:57:34.115 INFO:teuthology.orchestra.run.smithi017.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-09-13T15:57:34.115 INFO:teuthology.orchestra.run.smithi017.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-09-13T15:57:34.115 INFO:teuthology.orchestra.run.smithi017.stderr:creating tables... 2024-09-13T15:57:34.135 INFO:teuthology.orchestra.run.smithi017.stderr:generating data (client-side)... 2024-09-13T15:57:34.268 INFO:teuthology.orchestra.run.smithi017.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.10 s, remaining 3.18 s) 2024-09-13T15:57:34.580 INFO:teuthology.orchestra.run.smithi017.stderr:200000 of 3200000 tuples (6%) done (elapsed 0.41 s, remaining 6.22 s) 2024-09-13T15:57:34.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:34.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:34.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:34.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:34 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:34.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:34 smithi193 ceph-mon[35248]: pgmap v380: 129 pgs: 129 active+clean; 28 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.3 MiB/s wr, 35 op/s 2024-09-13T15:57:34.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:34.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:34.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:34.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:34 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:34.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:34 smithi017 ceph-mon[30494]: pgmap v380: 129 pgs: 129 active+clean; 28 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.3 MiB/s wr, 35 op/s 2024-09-13T15:57:34.834 INFO:teuthology.orchestra.run.smithi017.stderr:300000 of 3200000 tuples (9%) done (elapsed 0.67 s, remaining 6.47 s) 2024-09-13T15:57:34.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:34 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:34.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:34 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:34.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:34 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:34.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:34 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:34.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:34 smithi189 ceph-mon[34790]: pgmap v380: 129 pgs: 129 active+clean; 28 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.3 MiB/s wr, 35 op/s 2024-09-13T15:57:35.010 INFO:teuthology.orchestra.run.smithi017.stderr:400000 of 3200000 tuples (12%) done (elapsed 0.85 s, remaining 5.92 s) 2024-09-13T15:57:35.209 INFO:teuthology.orchestra.run.smithi017.stderr:500000 of 3200000 tuples (15%) done (elapsed 1.04 s, remaining 5.64 s) 2024-09-13T15:57:35.339 INFO:teuthology.orchestra.run.smithi017.stderr:600000 of 3200000 tuples (18%) done (elapsed 1.17 s, remaining 5.09 s) 2024-09-13T15:57:35.602 INFO:teuthology.orchestra.run.smithi017.stderr:700000 of 3200000 tuples (21%) done (elapsed 1.44 s, remaining 5.13 s) 2024-09-13T15:57:35.923 INFO:teuthology.orchestra.run.smithi017.stderr:800000 of 3200000 tuples (25%) done (elapsed 1.76 s, remaining 5.27 s) 2024-09-13T15:57:36.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:35 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:36.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:35 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:36.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:35 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:57:36.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:35 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:57:36.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:35 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:36.107 INFO:teuthology.orchestra.run.smithi017.stderr:900000 of 3200000 tuples (28%) done (elapsed 1.94 s, remaining 4.96 s) 2024-09-13T15:57:36.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:35 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:36.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:35 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:36.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:35 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:57:36.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:35 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:57:36.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:35 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:36.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:35 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:36.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:35 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:36.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:35 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:57:36.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:35 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:57:36.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:35 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:57:36.356 INFO:teuthology.orchestra.run.smithi017.stderr:1000000 of 3200000 tuples (31%) done (elapsed 2.19 s, remaining 4.82 s) 2024-09-13T15:57:36.662 INFO:teuthology.orchestra.run.smithi017.stderr:1100000 of 3200000 tuples (34%) done (elapsed 2.50 s, remaining 4.77 s) 2024-09-13T15:57:36.810 INFO:teuthology.orchestra.run.smithi017.stderr:1200000 of 3200000 tuples (37%) done (elapsed 2.64 s, remaining 4.41 s) 2024-09-13T15:57:37.102 INFO:teuthology.orchestra.run.smithi017.stderr:1300000 of 3200000 tuples (40%) done (elapsed 2.94 s, remaining 4.29 s) 2024-09-13T15:57:37.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:36 smithi189 ceph-mon[34790]: pgmap v381: 129 pgs: 129 active+clean; 44 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 4.0 MiB/s wr, 116 op/s 2024-09-13T15:57:37.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:36 smithi193 ceph-mon[35248]: pgmap v381: 129 pgs: 129 active+clean; 44 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 4.0 MiB/s wr, 116 op/s 2024-09-13T15:57:37.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:36 smithi017 ceph-mon[30494]: pgmap v381: 129 pgs: 129 active+clean; 44 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 4.0 MiB/s wr, 116 op/s 2024-09-13T15:57:37.444 INFO:teuthology.orchestra.run.smithi017.stderr:1400000 of 3200000 tuples (43%) done (elapsed 3.28 s, remaining 4.21 s) 2024-09-13T15:57:37.533 INFO:teuthology.orchestra.run.smithi017.stderr:1500000 of 3200000 tuples (46%) done (elapsed 3.37 s, remaining 3.82 s) 2024-09-13T15:57:37.834 INFO:teuthology.orchestra.run.smithi017.stderr:1600000 of 3200000 tuples (50%) done (elapsed 3.67 s, remaining 3.67 s) 2024-09-13T15:57:38.007 INFO:teuthology.orchestra.run.smithi017.stderr:1700000 of 3200000 tuples (53%) done (elapsed 3.84 s, remaining 3.39 s) 2024-09-13T15:57:38.297 INFO:teuthology.orchestra.run.smithi017.stderr:1800000 of 3200000 tuples (56%) done (elapsed 4.13 s, remaining 3.21 s) 2024-09-13T15:57:38.576 INFO:teuthology.orchestra.run.smithi017.stderr:1900000 of 3200000 tuples (59%) done (elapsed 4.41 s, remaining 3.02 s) 2024-09-13T15:57:38.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:38 smithi189 ceph-mon[34790]: pgmap v382: 129 pgs: 129 active+clean; 88 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 12 MiB/s wr, 131 op/s 2024-09-13T15:57:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.606+0000 7fc996000640 1 -- 172.21.15.17:0/2849414667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc990074e70 msgr2=0x7fc990075270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.606+0000 7fc996000640 1 --2- 172.21.15.17:0/2849414667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc990074e70 0x7fc990075270 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc980009900 tx=0x7fc98002a410 comp rx=0 tx=0).stop 2024-09-13T15:57:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.606+0000 7fc996000640 1 -- 172.21.15.17:0/2849414667 shutdown_connections 2024-09-13T15:57:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.606+0000 7fc996000640 1 --2- 172.21.15.17:0/2849414667 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc990076a50 0x7fc9900772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.606+0000 7fc996000640 1 --2- 172.21.15.17:0/2849414667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9900760b0 0x7fc990076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.606+0000 7fc996000640 1 --2- 172.21.15.17:0/2849414667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc990074e70 0x7fc990075270 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.606+0000 7fc996000640 1 -- 172.21.15.17:0/2849414667 >> 172.21.15.17:0/2849414667 conn(0x7fc9900fd6b0 msgr2=0x7fc9900ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.606+0000 7fc996000640 1 -- 172.21.15.17:0/2849414667 shutdown_connections 2024-09-13T15:57:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.606+0000 7fc996000640 1 -- 172.21.15.17:0/2849414667 wait complete. 2024-09-13T15:57:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.607+0000 7fc996000640 1 Processor -- start 2024-09-13T15:57:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.607+0000 7fc996000640 1 -- start start 2024-09-13T15:57:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.607+0000 7fc996000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc990074e70 0x7fc99019c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.607+0000 7fc996000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9900760b0 0x7fc99019c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.607+0000 7fc996000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc990076a50 0x7fc9901a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.607+0000 7fc996000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9901a3ec0 con 0x7fc9900760b0 2024-09-13T15:57:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.607+0000 7fc996000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9901a4030 con 0x7fc990074e70 2024-09-13T15:57:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.607+0000 7fc996000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9901a41f0 con 0x7fc990076a50 2024-09-13T15:57:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.608+0000 7fc98ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9900760b0 0x7fc99019c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.608+0000 7fc98ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9900760b0 0x7fc99019c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46308/0 (socket says 172.21.15.17:46308) 2024-09-13T15:57:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.608+0000 7fc98ea00640 1 -- 172.21.15.17:0/2082490253 learned_addr learned my addr 172.21.15.17:0/2082490253 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.608+0000 7fc98f400640 1 --2- 172.21.15.17:0/2082490253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc990074e70 0x7fc99019c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.608+0000 7fc98fe00640 1 --2- 172.21.15.17:0/2082490253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc990076a50 0x7fc9901a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.608+0000 7fc98f400640 1 -- 172.21.15.17:0/2082490253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc990076a50 msgr2=0x7fc9901a3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.608+0000 7fc98f400640 1 --2- 172.21.15.17:0/2082490253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc990076a50 0x7fc9901a3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.608+0000 7fc98f400640 1 -- 172.21.15.17:0/2082490253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9900760b0 msgr2=0x7fc99019c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.608+0000 7fc98f400640 1 --2- 172.21.15.17:0/2082490253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9900760b0 0x7fc99019c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.608+0000 7fc98f400640 1 -- 172.21.15.17:0/2082490253 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc980009560 con 0x7fc990074e70 2024-09-13T15:57:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.608+0000 7fc98ea00640 1 --2- 172.21.15.17:0/2082490253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9900760b0 0x7fc99019c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:57:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.608+0000 7fc98fe00640 1 --2- 172.21.15.17:0/2082490253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc990076a50 0x7fc9901a3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:57:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.608+0000 7fc98f400640 1 --2- 172.21.15.17:0/2082490253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc990074e70 0x7fc99019c3d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc98002a930 tx=0x7fc980003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.609+0000 7fc987e00640 1 -- 172.21.15.17:0/2082490253 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc980003e00 con 0x7fc990074e70 2024-09-13T15:57:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.609+0000 7fc987e00640 1 -- 172.21.15.17:0/2082490253 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc980031c70 con 0x7fc990074e70 2024-09-13T15:57:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.609+0000 7fc996000640 1 -- 172.21.15.17:0/2082490253 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9901a4470 con 0x7fc990074e70 2024-09-13T15:57:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.609+0000 7fc987e00640 1 -- 172.21.15.17:0/2082490253 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98003bb90 con 0x7fc990074e70 2024-09-13T15:57:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.609+0000 7fc996000640 1 -- 172.21.15.17:0/2082490253 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9901a4940 con 0x7fc990074e70 2024-09-13T15:57:38.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.612+0000 7fc987e00640 1 -- 172.21.15.17:0/2082490253 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc98003bd10 con 0x7fc990074e70 2024-09-13T15:57:38.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.612+0000 7fc998e45740 1 Processor -- start 2024-09-13T15:57:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.613+0000 7fc998e45740 1 -- start start 2024-09-13T15:57:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.613+0000 7fc998e45740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557cebfcaa70 0x557cebfcae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.613+0000 7fc998e45740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfcb3b0 0x557cebfcfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.613+0000 7fc998e45740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfd0440 0x557cebfd2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.613+0000 7fc998e45740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cebed6bb0 con 0x557cebfcaa70 2024-09-13T15:57:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.613+0000 7fc998e45740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cebf34a70 con 0x557cebfd0440 2024-09-13T15:57:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.613+0000 7fc998e45740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cebf32200 con 0x557cebfcb3b0 2024-09-13T15:57:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.613+0000 7fc987e00640 1 --2- 172.21.15.17:0/2082490253 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc9740a1110 0x7fc9740a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.613+0000 7fc987e00640 1 -- 172.21.15.17:0/2082490253 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fc9800ed3b0 con 0x7fc990074e70 2024-09-13T15:57:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.613+0000 7fc98f400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfcb3b0 0x557cebfcfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.613+0000 7fc98fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557cebfcaa70 0x557cebfcae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.613+0000 7fc98fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557cebfcaa70 0x557cebfcae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46314/0 (socket says 172.21.15.17:46314) 2024-09-13T15:57:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.614+0000 7fc98fe00640 1 -- 172.21.15.17:0/1333009586 learned_addr learned my addr 172.21.15.17:0/1333009586 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.614+0000 7fc98ea00640 1 --2- 172.21.15.17:0/1333009586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfd0440 0x557cebfd2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.613+0000 7fc98f400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfcb3b0 0x557cebfcfe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:50694/0 (socket says 172.21.15.17:50694) 2024-09-13T15:57:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.614+0000 7fc98fe00640 1 --2- 172.21.15.17:0/2082490253 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc9740a1110 0x7fc9740a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.614+0000 7fc98ea00640 1 -- 172.21.15.17:0/1333009586 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfcb3b0 msgr2=0x557cebfcfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.614+0000 7fc98ea00640 1 --2- 172.21.15.17:0/1333009586 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfcb3b0 0x557cebfcfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.614+0000 7fc98ea00640 1 -- 172.21.15.17:0/1333009586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557cebfcaa70 msgr2=0x557cebfcae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.614+0000 7fc98ea00640 1 --2- 172.21.15.17:0/1333009586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557cebfcaa70 0x557cebfcae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.614+0000 7fc98ea00640 1 -- 172.21.15.17:0/1333009586 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557cebecf940 con 0x557cebfd0440 2024-09-13T15:57:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.614+0000 7fc98f400640 1 --2- 172.21.15.17:0/1333009586 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfcb3b0 0x557cebfcfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:57:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.614+0000 7fc98ea00640 1 --2- 172.21.15.17:0/1333009586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfd0440 0x557cebfd2900 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc97c0114c0 tx=0x7fc97c011980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8895fc8cbb993dc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.615+0000 7fc98fe00640 1 --2- 172.21.15.17:0/2082490253 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc9740a1110 0x7fc9740a35d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc988012d40 tx=0x7fc988009bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.615+0000 7fc984c00640 1 -- 172.21.15.17:0/1333009586 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c011030 con 0x557cebfd0440 2024-09-13T15:57:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.615+0000 7fc984c00640 1 -- 172.21.15.17:0/1333009586 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc97c0044f0 con 0x557cebfd0440 2024-09-13T15:57:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.615+0000 7fc984c00640 1 -- 172.21.15.17:0/1333009586 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c003da0 con 0x557cebfd0440 2024-09-13T15:57:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.615+0000 7fc998e45740 1 -- 172.21.15.17:0/1333009586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfd0440 msgr2=0x557cebfd2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.615+0000 7fc998e45740 1 --2- 172.21.15.17:0/1333009586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfd0440 0x557cebfd2900 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc97c0114c0 tx=0x7fc97c011980 comp rx=0 tx=0).stop 2024-09-13T15:57:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.615+0000 7fc998e45740 1 -- 172.21.15.17:0/1333009586 shutdown_connections 2024-09-13T15:57:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.615+0000 7fc998e45740 1 --2- 172.21.15.17:0/1333009586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfd0440 0x557cebfd2900 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.615+0000 7fc998e45740 1 --2- 172.21.15.17:0/1333009586 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfcb3b0 0x557cebfcfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.615+0000 7fc998e45740 1 --2- 172.21.15.17:0/1333009586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557cebfcaa70 0x557cebfcae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.615+0000 7fc998e45740 1 -- 172.21.15.17:0/1333009586 >> 172.21.15.17:0/1333009586 conn(0x557cebfc60e0 msgr2=0x557cebfc64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.616+0000 7fc998e45740 1 -- 172.21.15.17:0/1333009586 shutdown_connections 2024-09-13T15:57:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.616+0000 7fc998e45740 1 -- 172.21.15.17:0/1333009586 wait complete. 2024-09-13T15:57:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.616+0000 7fc998e45740 1 -- start start 2024-09-13T15:57:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.616+0000 7fc998e45740 1 Processor -- start 2024-09-13T15:57:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.617+0000 7fc998e45740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfcaa70 0x557cebfd4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.617+0000 7fc998e45740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfcb3b0 0x557cebfd4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.617+0000 7fc998e45740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557cebfd0440 0x557cebfdbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.617+0000 7fc998e45740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cebf2daf0 con 0x557cebfd0440 2024-09-13T15:57:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.617+0000 7fc998e45740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cebeebf20 con 0x557cebfcb3b0 2024-09-13T15:57:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.617+0000 7fc998e45740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cebeebbc0 con 0x557cebfcaa70 2024-09-13T15:57:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.617+0000 7fc998e45740 10 client.0 _ll_register_callbacks cb 0x557cebf1da70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:57:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.617+0000 7fc98f400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfcaa70 0x557cebfd4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.617+0000 7fc98ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfcb3b0 0x557cebfd4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.617+0000 7fc98f400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfcaa70 0x557cebfd4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:50700/0 (socket says 172.21.15.17:50700) 2024-09-13T15:57:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.617+0000 7fc98f400640 1 -- 172.21.15.17:0/3069528521 learned_addr learned my addr 172.21.15.17:0/3069528521 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.618+0000 7fc98fe00640 1 --2- 172.21.15.17:0/3069528521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557cebfd0440 0x557cebfdbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.618+0000 7fc98f400640 1 -- 172.21.15.17:0/3069528521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfcb3b0 msgr2=0x557cebfd4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.618+0000 7fc98f400640 1 --2- 172.21.15.17:0/3069528521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfcb3b0 0x557cebfd4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.618+0000 7fc98f400640 1 -- 172.21.15.17:0/3069528521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557cebfd0440 msgr2=0x557cebfdbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.618+0000 7fc98f400640 1 --2- 172.21.15.17:0/3069528521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557cebfd0440 0x557cebfdbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.618+0000 7fc98f400640 1 -- 172.21.15.17:0/3069528521 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97c009cd0 con 0x557cebfcaa70 2024-09-13T15:57:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.618+0000 7fc98f400640 1 --2- 172.21.15.17:0/3069528521 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfcaa70 0x557cebfd4700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc980006010 tx=0x7fc98002a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e36471ce215bc35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.618+0000 7fc979600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T15:57:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.618+0000 7fc979600640 1 -- 172.21.15.17:0/3069528521 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9800babb0 con 0x557cebfcaa70 2024-09-13T15:57:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.618+0000 7fc998e45740 1 -- 172.21.15.17:0/3069528521 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557cebf57c90 con 0x557cebfcaa70 2024-09-13T15:57:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.618+0000 7fc979600640 1 -- 172.21.15.17:0/3069528521 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fc9800ba4b0 con 0x557cebfcaa70 2024-09-13T15:57:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.618+0000 7fc979600640 1 -- 172.21.15.17:0/3069528521 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9800be2e0 con 0x557cebfcaa70 2024-09-13T15:57:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.618+0000 7fc998e45740 10 client.25405 fetch_fsmap learned FSMap version 25 2024-09-13T15:57:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.619+0000 7fc998e45740 1 -- 172.21.15.17:0/3069528521 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x557cebf2c170 con 0x557cebfcaa70 2024-09-13T15:57:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.619+0000 7fc979600640 1 -- 172.21.15.17:0/3069528521 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557cebf57c90 con 0x557cebfcaa70 2024-09-13T15:57:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.619+0000 7fc979600640 1 -- 172.21.15.17:0/3069528521 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc9800b6bc0 con 0x557cebfcaa70 2024-09-13T15:57:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.619+0000 7fc998e45740 10 client.25405 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T15:57:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.619+0000 7fc998e45740 10 client.25405 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T15:57:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.619+0000 7fc998e45740 20 client.25405 populate_metadata read hostname 'smithi017' 2024-09-13T15:57:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.619+0000 7fc998e45740 1 --2- 172.21.15.17:0/3069528521 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557cebfe0110 0x557cebfe2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.619+0000 7fc998e45740 4 client.25405 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:57:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.619+0000 7fc998e45740 1 -- 172.21.15.17:0/3069528521 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557cebf207d0 con 0x557cebfe0110 2024-09-13T15:57:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.620+0000 7fc98ea00640 1 --2- 172.21.15.17:0/3069528521 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557cebfe0110 0x557cebfe2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.620+0000 7fc98ea00640 1 --2- 172.21.15.17:0/3069528521 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557cebfe0110 0x557cebfe2500 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=343ad38f33444edb server_cookie=b147176b1f8b48f6 in_seq=0 out_seq=0 2024-09-13T15:57:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.620+0000 7fc979600640 10 client.25405 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:57:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.621+0000 7fc979600640 1 -- 172.21.15.17:0/3069528521 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557cebf207d0 con 0x557cebfe0110 2024-09-13T15:57:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.621+0000 7fc979600640 10 client.25405 handle_command_reply: tid=0 2024-09-13T15:57:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.621+0000 7fc998e45740 1 client.25405 shutdown 2024-09-13T15:57:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.621+0000 7fc998e45740 1 -- 172.21.15.17:0/3069528521 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfcaa70 msgr2=0x557cebfd4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.621+0000 7fc998e45740 1 --2- 172.21.15.17:0/3069528521 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfcaa70 0x557cebfd4700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc980006010 tx=0x7fc98002a410 comp rx=0 tx=0).stop 2024-09-13T15:57:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.621+0000 7fc998e45740 1 -- 172.21.15.17:0/3069528521 shutdown_connections 2024-09-13T15:57:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.621+0000 7fc998e45740 1 --2- 172.21.15.17:0/3069528521 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557cebfe0110 0x557cebfe2500 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.621+0000 7fc998e45740 1 --2- 172.21.15.17:0/3069528521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557cebfd0440 0x557cebfdbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.621+0000 7fc998e45740 1 --2- 172.21.15.17:0/3069528521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfcb3b0 0x557cebfd4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.621+0000 7fc979600640 0 client.25405 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:57:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.621+0000 7fc998e45740 1 --2- 172.21.15.17:0/3069528521 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfcaa70 0x557cebfd4700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.621+0000 7fc998e45740 1 -- 172.21.15.17:0/3069528521 >> 172.21.15.17:0/3069528521 conn(0x557cebfc60e0 msgr2=0x557cebfc78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.621+0000 7fc998e45740 1 -- 172.21.15.17:0/3069528521 shutdown_connections 2024-09-13T15:57:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.621+0000 7fc998e45740 1 -- 172.21.15.17:0/3069528521 wait complete. 2024-09-13T15:57:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.622+0000 7fc998e45740 20 client.25405 trim_cache size 0 max 16384 2024-09-13T15:57:38.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.635+0000 7fc998e45740 1 Processor -- start 2024-09-13T15:57:38.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.635+0000 7fc998e45740 1 -- start start 2024-09-13T15:57:38.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.635+0000 7fc998e45740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557cebfcaa70 0x557cebfcc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:38.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.635+0000 7fc998e45740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfcb3b0 0x557cebfcc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:38.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.635+0000 7fc998e45740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfd0440 0x557cebfdbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:38.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.635+0000 7fc998e45740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cebc94e60 con 0x557cebfcaa70 2024-09-13T15:57:38.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.635+0000 7fc998e45740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cebfc7fa0 con 0x557cebfcb3b0 2024-09-13T15:57:38.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.635+0000 7fc998e45740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cebfe76b0 con 0x557cebfd0440 2024-09-13T15:57:38.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.635+0000 7fc98ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfcb3b0 0x557cebfcc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:38.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.635+0000 7fc98fe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfd0440 0x557cebfdbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:38.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.636+0000 7fc98ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfcb3b0 0x557cebfcc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:45388/0 (socket says 172.21.15.17:45388) 2024-09-13T15:57:38.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.636+0000 7fc98ea00640 1 -- 172.21.15.17:0/979277193 learned_addr learned my addr 172.21.15.17:0/979277193 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:38.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.636+0000 7fc98ea00640 1 -- 172.21.15.17:0/979277193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfd0440 msgr2=0x557cebfdbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:38.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.636+0000 7fc98ea00640 1 --2- 172.21.15.17:0/979277193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfd0440 0x557cebfdbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.636+0000 7fc98ea00640 1 -- 172.21.15.17:0/979277193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557cebfcaa70 msgr2=0x557cebfcc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.636+0000 7fc98ea00640 1 --2- 172.21.15.17:0/979277193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557cebfcaa70 0x557cebfcc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.636+0000 7fc98ea00640 1 -- 172.21.15.17:0/979277193 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557cebece180 con 0x557cebfcb3b0 2024-09-13T15:57:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.636+0000 7fc98fe00640 1 --2- 172.21.15.17:0/979277193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfd0440 0x557cebfdbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:57:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.636+0000 7fc98ea00640 1 --2- 172.21.15.17:0/979277193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfcb3b0 0x557cebfcc810 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x557cebfc6f60 tx=0x7fc97c011980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74f1003020c45e12 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.637+0000 7fc985600640 1 -- 172.21.15.17:0/979277193 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c029070 con 0x557cebfcb3b0 2024-09-13T15:57:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.637+0000 7fc985600640 1 -- 172.21.15.17:0/979277193 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc97c011350 con 0x557cebfcb3b0 2024-09-13T15:57:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.637+0000 7fc985600640 1 -- 172.21.15.17:0/979277193 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c005550 con 0x557cebfcb3b0 2024-09-13T15:57:38.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.638+0000 7fc998e45740 1 -- 172.21.15.17:0/979277193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfcb3b0 msgr2=0x557cebfcc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:38.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.638+0000 7fc998e45740 1 --2- 172.21.15.17:0/979277193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfcb3b0 0x557cebfcc810 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x557cebfc6f60 tx=0x7fc97c011980 comp rx=0 tx=0).stop 2024-09-13T15:57:38.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.638+0000 7fc998e45740 1 -- 172.21.15.17:0/979277193 shutdown_connections 2024-09-13T15:57:38.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.638+0000 7fc998e45740 1 --2- 172.21.15.17:0/979277193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfd0440 0x557cebfdbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.638+0000 7fc998e45740 1 --2- 172.21.15.17:0/979277193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfcb3b0 0x557cebfcc810 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.638+0000 7fc998e45740 1 --2- 172.21.15.17:0/979277193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557cebfcaa70 0x557cebfcc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.638+0000 7fc998e45740 1 -- 172.21.15.17:0/979277193 >> 172.21.15.17:0/979277193 conn(0x557cebfc60e0 msgr2=0x557cebfc64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:38.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.638+0000 7fc998e45740 1 -- 172.21.15.17:0/979277193 shutdown_connections 2024-09-13T15:57:38.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.639+0000 7fc998e45740 1 -- 172.21.15.17:0/979277193 wait complete. 2024-09-13T15:57:38.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.639+0000 7fc998e45740 1 -- start start 2024-09-13T15:57:38.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.640+0000 7fc998e45740 1 Processor -- start 2024-09-13T15:57:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.641+0000 7fc998e45740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfcaa70 0x557cebfdbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.641+0000 7fc998e45740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557cebfcb3b0 0x557cebfd85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.641+0000 7fc998e45740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfd0440 0x557cebfd8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.641+0000 7fc998e45740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cec036570 con 0x557cebfcb3b0 2024-09-13T15:57:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.641+0000 7fc998e45740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cec0366b0 con 0x557cebfd0440 2024-09-13T15:57:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.641+0000 7fc998e45740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cec0367f0 con 0x557cebfcaa70 2024-09-13T15:57:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.641+0000 7fc998e45740 10 client.0 _ll_register_callbacks cb 0x7fc97c009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:57:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.641+0000 7fc98f400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfcaa70 0x557cebfdbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.641+0000 7fc98f400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfcaa70 0x557cebfdbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:50720/0 (socket says 172.21.15.17:50720) 2024-09-13T15:57:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.641+0000 7fc98f400640 1 -- 172.21.15.17:0/4112246608 learned_addr learned my addr 172.21.15.17:0/4112246608 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.641+0000 7fc98fe00640 1 --2- 172.21.15.17:0/4112246608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfd0440 0x557cebfd8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.641+0000 7fc98ea00640 1 --2- 172.21.15.17:0/4112246608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557cebfcb3b0 0x557cebfd85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.642+0000 7fc98f400640 1 -- 172.21.15.17:0/4112246608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfd0440 msgr2=0x557cebfd8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.642+0000 7fc98f400640 1 --2- 172.21.15.17:0/4112246608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfd0440 0x557cebfd8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.642+0000 7fc98f400640 1 -- 172.21.15.17:0/4112246608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557cebfcb3b0 msgr2=0x557cebfd85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.642+0000 7fc98f400640 1 --2- 172.21.15.17:0/4112246608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557cebfcb3b0 0x557cebfd85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.642+0000 7fc98f400640 1 -- 172.21.15.17:0/4112246608 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98801a040 con 0x557cebfcaa70 2024-09-13T15:57:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.642+0000 7fc98fe00640 1 --2- 172.21.15.17:0/4112246608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfd0440 0x557cebfd8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:57:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.642+0000 7fc98f400640 1 --2- 172.21.15.17:0/4112246608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfcaa70 0x557cebfdbb50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc9800da0d0 tx=0x7fc9800b8a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32d205ffa9c831c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.642+0000 7fc979600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T15:57:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.642+0000 7fc979600640 1 -- 172.21.15.17:0/4112246608 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9800b67f0 con 0x557cebfcaa70 2024-09-13T15:57:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.642+0000 7fc979600640 1 -- 172.21.15.17:0/4112246608 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fc9800babb0 con 0x557cebfcaa70 2024-09-13T15:57:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.642+0000 7fc998e45740 1 -- 172.21.15.17:0/4112246608 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc97c0044f0 con 0x557cebfcaa70 2024-09-13T15:57:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.642+0000 7fc979600640 1 -- 172.21.15.17:0/4112246608 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9800b9e10 con 0x557cebfcaa70 2024-09-13T15:57:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.642+0000 7fc998e45740 10 client.25411 fetch_fsmap learned FSMap version 25 2024-09-13T15:57:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.642+0000 7fc998e45740 1 -- 172.21.15.17:0/4112246608 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x557cebecf940 con 0x557cebfcaa70 2024-09-13T15:57:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.643+0000 7fc979600640 1 -- 172.21.15.17:0/4112246608 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc97c0044f0 con 0x557cebfcaa70 2024-09-13T15:57:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.643+0000 7fc979600640 1 -- 172.21.15.17:0/4112246608 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc9800b99a0 con 0x557cebfcaa70 2024-09-13T15:57:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.643+0000 7fc998e45740 10 client.25411 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T15:57:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.643+0000 7fc998e45740 10 client.25411 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T15:57:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.643+0000 7fc998e45740 20 client.25411 populate_metadata read hostname 'smithi017' 2024-09-13T15:57:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.643+0000 7fc998e45740 1 --2- 172.21.15.17:0/4112246608 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557cec037e80 0x557cec03a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.643+0000 7fc998e45740 4 client.25411 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T15:57:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.643+0000 7fc998e45740 1 -- 172.21.15.17:0/4112246608 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557cebc21300 con 0x557cec037e80 2024-09-13T15:57:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.643+0000 7fc98ea00640 1 --2- 172.21.15.17:0/4112246608 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557cec037e80 0x557cec03a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.644+0000 7fc979600640 10 client.25411 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:57:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.644+0000 7fc98ea00640 1 --2- 172.21.15.17:0/4112246608 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557cec037e80 0x557cec03a2a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b73d23a6c0ed8c6c server_cookie=af4e25ada9e16da9 in_seq=0 out_seq=0 2024-09-13T15:57:38.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:38 smithi193 ceph-mon[35248]: pgmap v382: 129 pgs: 129 active+clean; 88 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 12 MiB/s wr, 131 op/s 2024-09-13T15:57:38.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:38 smithi017 ceph-mon[30494]: pgmap v382: 129 pgs: 129 active+clean; 88 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 12 MiB/s wr, 131 op/s 2024-09-13T15:57:38.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.992+0000 7fc979600640 1 -- 172.21.15.17:0/4112246608 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557cebc21300 con 0x557cec037e80 2024-09-13T15:57:38.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.992+0000 7fc979600640 10 client.25411 handle_command_reply: tid=0 2024-09-13T15:57:38.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.992+0000 7fc998e45740 1 client.25411 shutdown 2024-09-13T15:57:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.992+0000 7fc998e45740 1 -- 172.21.15.17:0/4112246608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfcaa70 msgr2=0x557cebfdbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.992+0000 7fc998e45740 1 --2- 172.21.15.17:0/4112246608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfcaa70 0x557cebfdbb50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc9800da0d0 tx=0x7fc9800b8a60 comp rx=0 tx=0).stop 2024-09-13T15:57:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.992+0000 7fc998e45740 1 -- 172.21.15.17:0/4112246608 shutdown_connections 2024-09-13T15:57:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.992+0000 7fc998e45740 1 --2- 172.21.15.17:0/4112246608 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557cec037e80 0x557cec03a2a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.992+0000 7fc998e45740 1 --2- 172.21.15.17:0/4112246608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557cebfd0440 0x557cebfd8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.992+0000 7fc979600640 0 client.25411 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:57:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.992+0000 7fc998e45740 1 --2- 172.21.15.17:0/4112246608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557cebfcb3b0 0x557cebfd85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.993+0000 7fc998e45740 1 --2- 172.21.15.17:0/4112246608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557cebfcaa70 0x557cebfdbb50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.993+0000 7fc998e45740 1 -- 172.21.15.17:0/4112246608 >> 172.21.15.17:0/4112246608 conn(0x557cebfc60e0 msgr2=0x557cebfcf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.993+0000 7fc998e45740 1 -- 172.21.15.17:0/4112246608 shutdown_connections 2024-09-13T15:57:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.993+0000 7fc998e45740 1 -- 172.21.15.17:0/4112246608 wait complete. 2024-09-13T15:57:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.993+0000 7fc998e45740 20 client.25411 trim_cache size 0 max 16384 2024-09-13T15:57:38.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T15:57:38.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T15:57:38.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T15:57:38.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T15:57:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.994+0000 7fc996000640 1 -- 172.21.15.17:0/2082490253 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc9740a1110 msgr2=0x7fc9740a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.994+0000 7fc996000640 1 --2- 172.21.15.17:0/2082490253 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc9740a1110 0x7fc9740a35d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc988012d40 tx=0x7fc988009bd0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.994+0000 7fc996000640 1 -- 172.21.15.17:0/2082490253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc990074e70 msgr2=0x7fc99019c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.994+0000 7fc996000640 1 --2- 172.21.15.17:0/2082490253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc990074e70 0x7fc99019c3d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc98002a930 tx=0x7fc980003c10 comp rx=0 tx=0).stop 2024-09-13T15:57:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.994+0000 7fc996000640 1 -- 172.21.15.17:0/2082490253 shutdown_connections 2024-09-13T15:57:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.994+0000 7fc996000640 1 --2- 172.21.15.17:0/2082490253 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc9740a1110 0x7fc9740a35d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.994+0000 7fc996000640 1 --2- 172.21.15.17:0/2082490253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc990076a50 0x7fc9901a3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.994+0000 7fc996000640 1 --2- 172.21.15.17:0/2082490253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9900760b0 0x7fc99019c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.994+0000 7fc996000640 1 --2- 172.21.15.17:0/2082490253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc990074e70 0x7fc99019c3d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.994+0000 7fc996000640 1 -- 172.21.15.17:0/2082490253 >> 172.21.15.17:0/2082490253 conn(0x7fc9900fd6b0 msgr2=0x7fc9900fee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.994+0000 7fc996000640 1 -- 172.21.15.17:0/2082490253 shutdown_connections 2024-09-13T15:57:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:38.994+0000 7fc996000640 1 -- 172.21.15.17:0/2082490253 wait complete. 2024-09-13T15:57:39.017 INFO:teuthology.orchestra.run.smithi017.stderr:2000000 of 3200000 tuples (62%) done (elapsed 4.85 s, remaining 2.91 s) 2024-09-13T15:57:39.290 INFO:teuthology.orchestra.run.smithi017.stderr:2100000 of 3200000 tuples (65%) done (elapsed 5.12 s, remaining 2.68 s) 2024-09-13T15:57:39.601 INFO:teuthology.orchestra.run.smithi017.stderr:2200000 of 3200000 tuples (68%) done (elapsed 5.44 s, remaining 2.47 s) 2024-09-13T15:57:39.807 INFO:teuthology.orchestra.run.smithi017.stderr:2300000 of 3200000 tuples (71%) done (elapsed 5.64 s, remaining 2.21 s) 2024-09-13T15:57:40.073 INFO:teuthology.orchestra.run.smithi017.stderr:2400000 of 3200000 tuples (75%) done (elapsed 5.91 s, remaining 1.97 s) 2024-09-13T15:57:40.359 INFO:teuthology.orchestra.run.smithi017.stderr:2500000 of 3200000 tuples (78%) done (elapsed 6.19 s, remaining 1.73 s) 2024-09-13T15:57:40.518 INFO:teuthology.orchestra.run.smithi017.stderr:2600000 of 3200000 tuples (81%) done (elapsed 6.35 s, remaining 1.47 s) 2024-09-13T15:57:40.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:40 smithi189 ceph-mon[34790]: pgmap v383: 129 pgs: 129 active+clean; 188 MiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 28 MiB/s wr, 239 op/s 2024-09-13T15:57:40.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:40 smithi193 ceph-mon[35248]: pgmap v383: 129 pgs: 129 active+clean; 188 MiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 28 MiB/s wr, 239 op/s 2024-09-13T15:57:40.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:40 smithi017 ceph-mon[30494]: pgmap v383: 129 pgs: 129 active+clean; 188 MiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 28 MiB/s wr, 239 op/s 2024-09-13T15:57:40.803 INFO:teuthology.orchestra.run.smithi017.stderr:2700000 of 3200000 tuples (84%) done (elapsed 6.64 s, remaining 1.23 s) 2024-09-13T15:57:41.128 INFO:teuthology.orchestra.run.smithi017.stderr:2800000 of 3200000 tuples (87%) done (elapsed 6.96 s, remaining 0.99 s) 2024-09-13T15:57:41.269 INFO:teuthology.orchestra.run.smithi017.stderr:2900000 of 3200000 tuples (90%) done (elapsed 7.10 s, remaining 0.73 s) 2024-09-13T15:57:41.481 INFO:teuthology.orchestra.run.smithi017.stderr:3000000 of 3200000 tuples (93%) done (elapsed 7.32 s, remaining 0.49 s) 2024-09-13T15:57:41.656 INFO:teuthology.orchestra.run.smithi017.stderr:3100000 of 3200000 tuples (96%) done (elapsed 7.49 s, remaining 0.24 s) 2024-09-13T15:57:41.937 INFO:teuthology.orchestra.run.smithi017.stderr:3200000 of 3200000 tuples (100%) done (elapsed 7.77 s, remaining 0.00 s) 2024-09-13T15:57:42.029 INFO:teuthology.orchestra.run.smithi017.stderr:vacuuming... 2024-09-13T15:57:42.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:42 smithi189 ceph-mon[34790]: pgmap v384: 129 pgs: 129 active+clean; 256 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 40 MiB/s wr, 350 op/s 2024-09-13T15:57:42.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:42 smithi193 ceph-mon[35248]: pgmap v384: 129 pgs: 129 active+clean; 256 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 40 MiB/s wr, 350 op/s 2024-09-13T15:57:42.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:42 smithi017 ceph-mon[30494]: pgmap v384: 129 pgs: 129 active+clean; 256 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 40 MiB/s wr, 350 op/s 2024-09-13T15:57:42.934 INFO:teuthology.orchestra.run.smithi017.stderr:creating primary keys... 2024-09-13T15:57:44.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:44 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T15:57:44.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:44 smithi189 ceph-mon[34790]: pgmap v385: 129 pgs: 129 active+clean; 333 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 53 MiB/s wr, 417 op/s 2024-09-13T15:57:44.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:44 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T15:57:44.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:44 smithi193 ceph-mon[35248]: pgmap v385: 129 pgs: 129 active+clean; 333 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 53 MiB/s wr, 417 op/s 2024-09-13T15:57:44.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:44 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T15:57:44.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:44 smithi017 ceph-mon[30494]: pgmap v385: 129 pgs: 129 active+clean; 333 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 53 MiB/s wr, 417 op/s 2024-09-13T15:57:45.145 INFO:teuthology.orchestra.run.smithi017.stderr:done in 11.03 s (drop tables 0.00 s, create tables 0.02 s, client-side generate 7.89 s, vacuum 0.91 s, primary keys 2.21 s). 2024-09-13T15:57:45.153 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-09-13T15:57:45.313 INFO:teuthology.orchestra.run.smithi017.stderr:starting vacuum...end. 2024-09-13T15:57:46.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:46 smithi189 ceph-mon[34790]: pgmap v386: 129 pgs: 129 active+clean; 393 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 59 MiB/s wr, 398 op/s 2024-09-13T15:57:46.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:46 smithi193 ceph-mon[35248]: pgmap v386: 129 pgs: 129 active+clean; 393 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 59 MiB/s wr, 398 op/s 2024-09-13T15:57:46.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:46 smithi017 ceph-mon[30494]: pgmap v386: 129 pgs: 129 active+clean; 393 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 59 MiB/s wr, 398 op/s 2024-09-13T15:57:49.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:48 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T15:57:49.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:48 smithi193 ceph-mon[35248]: pgmap v387: 129 pgs: 129 active+clean; 437 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 63 MiB/s wr, 319 op/s 2024-09-13T15:57:49.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:48 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T15:57:49.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:48 smithi017 ceph-mon[30494]: pgmap v387: 129 pgs: 129 active+clean; 437 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 63 MiB/s wr, 319 op/s 2024-09-13T15:57:49.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:48 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T15:57:49.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:48 smithi189 ceph-mon[34790]: pgmap v387: 129 pgs: 129 active+clean; 437 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 63 MiB/s wr, 319 op/s 2024-09-13T15:57:50.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 5.0 s, 2558.4 tps, lat 37.352 ms stddev 46.079 2024-09-13T15:57:50.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:50 smithi017 ceph-mon[30494]: pgmap v388: 129 pgs: 129 active+clean; 584 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 65 MiB/s wr, 382 op/s 2024-09-13T15:57:50.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:50 smithi189 ceph-mon[34790]: pgmap v388: 129 pgs: 129 active+clean; 584 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 65 MiB/s wr, 382 op/s 2024-09-13T15:57:50.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:50 smithi193 ceph-mon[35248]: pgmap v388: 129 pgs: 129 active+clean; 584 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 65 MiB/s wr, 382 op/s 2024-09-13T15:57:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.201+0000 7f86f9e00640 1 -- 172.21.15.17:0/3842313577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86f4100f30 msgr2=0x7f86f41033a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.201+0000 7f86f9e00640 1 --2- 172.21.15.17:0/3842313577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86f4100f30 0x7f86f41033a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009900 tx=0x7f86dc02a420 comp rx=0 tx=0).stop 2024-09-13T15:57:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.202+0000 7f86f9e00640 1 -- 172.21.15.17:0/3842313577 shutdown_connections 2024-09-13T15:57:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.202+0000 7f86f9e00640 1 --2- 172.21.15.17:0/3842313577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86f41038e0 0x7f86f4103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.202+0000 7f86f9e00640 1 --2- 172.21.15.17:0/3842313577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86f4100f30 0x7f86f41033a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.202+0000 7f86f9e00640 1 --2- 172.21.15.17:0/3842313577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86f40fe5e0 0x7f86f41009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.202+0000 7f86f9e00640 1 -- 172.21.15.17:0/3842313577 >> 172.21.15.17:0/3842313577 conn(0x7f86f40fa3d0 msgr2=0x7f86f40fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.203+0000 7f86f9e00640 1 -- 172.21.15.17:0/3842313577 shutdown_connections 2024-09-13T15:57:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.203+0000 7f86f9e00640 1 -- 172.21.15.17:0/3842313577 wait complete. 2024-09-13T15:57:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.204+0000 7f86f9e00640 1 Processor -- start 2024-09-13T15:57:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.204+0000 7f86f9e00640 1 -- start start 2024-09-13T15:57:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.205+0000 7f86f9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86f40fe5e0 0x7f86f419c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.205+0000 7f86f9e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86f4100f30 0x7f86f419c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.206+0000 7f86ebe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86f4100f30 0x7f86f419c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.206+0000 7f86ebe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86f4100f30 0x7f86f419c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:37470/0 (socket says 172.21.15.17:37470) 2024-09-13T15:57:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.206+0000 7f86ebe00640 1 -- 172.21.15.17:0/121589771 learned_addr learned my addr 172.21.15.17:0/121589771 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.206+0000 7f86f9e00640 1 --2- 172.21.15.17:0/121589771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86f41038e0 0x7f86f41a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.206+0000 7f86f9e00640 1 -- 172.21.15.17:0/121589771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f41a3e70 con 0x7f86f40fe5e0 2024-09-13T15:57:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.206+0000 7f86f2a00640 1 --2- 172.21.15.17:0/121589771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86f40fe5e0 0x7f86f419c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.206+0000 7f86f9e00640 1 -- 172.21.15.17:0/121589771 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f41a3fe0 con 0x7f86f41038e0 2024-09-13T15:57:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.206+0000 7f86f9e00640 1 -- 172.21.15.17:0/121589771 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f41a41a0 con 0x7f86f4100f30 2024-09-13T15:57:52.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.207+0000 7f86f3400640 1 --2- 172.21.15.17:0/121589771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86f41038e0 0x7f86f41a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:52.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.207+0000 7f86ebe00640 1 -- 172.21.15.17:0/121589771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86f41038e0 msgr2=0x7f86f41a3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:52.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.207+0000 7f86ebe00640 1 --2- 172.21.15.17:0/121589771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86f41038e0 0x7f86f41a3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.207+0000 7f86ebe00640 1 -- 172.21.15.17:0/121589771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86f40fe5e0 msgr2=0x7f86f419c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:52.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.207+0000 7f86ebe00640 1 --2- 172.21.15.17:0/121589771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86f40fe5e0 0x7f86f419c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.207+0000 7f86ebe00640 1 -- 172.21.15.17:0/121589771 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc009560 con 0x7f86f4100f30 2024-09-13T15:57:52.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.208+0000 7f86f2a00640 1 --2- 172.21.15.17:0/121589771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86f40fe5e0 0x7f86f419c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:57:52.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.208+0000 7f86ebe00640 1 --2- 172.21.15.17:0/121589771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86f4100f30 0x7f86f419c8c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f86dc031500 tx=0x7f86dc003cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:52.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.209+0000 7f86f8a00640 1 -- 172.21.15.17:0/121589771 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0317b0 con 0x7f86f4100f30 2024-09-13T15:57:52.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.209+0000 7f86f8a00640 1 -- 172.21.15.17:0/121589771 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86dc031dd0 con 0x7f86f4100f30 2024-09-13T15:57:52.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.209+0000 7f86f8a00640 1 -- 172.21.15.17:0/121589771 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc03be90 con 0x7f86f4100f30 2024-09-13T15:57:52.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.209+0000 7f86f9e00640 1 -- 172.21.15.17:0/121589771 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f41a4420 con 0x7f86f4100f30 2024-09-13T15:57:52.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.209+0000 7f86f9e00640 1 -- 172.21.15.17:0/121589771 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f41a4900 con 0x7f86f4100f30 2024-09-13T15:57:52.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.215+0000 7f86f8a00640 1 -- 172.21.15.17:0/121589771 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f86dc031910 con 0x7f86f4100f30 2024-09-13T15:57:52.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.218+0000 7f86fccb5740 1 Processor -- start 2024-09-13T15:57:52.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.218+0000 7f86fccb5740 1 -- start start 2024-09-13T15:57:52.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.219+0000 7f86fccb5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec4060a70 0x55eec4060e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.219+0000 7f86f8a00640 1 --2- 172.21.15.17:0/121589771 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f86d80a1260 0x7f86d80a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.219+0000 7f86f8a00640 1 -- 172.21.15.17:0/121589771 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f86dc0ed760 con 0x7f86f4100f30 2024-09-13T15:57:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.219+0000 7f86f3400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec4060a70 0x55eec4060e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:52.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.219+0000 7f86f3400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec4060a70 0x55eec4060e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:37474/0 (socket says 172.21.15.17:37474) 2024-09-13T15:57:52.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.219+0000 7f86fccb5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eec40613b0 0x55eec4065e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:52.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.219+0000 7f86fccb5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eec4066440 0x55eec4068900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:52.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.219+0000 7f86fccb5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec3f6cbb0 con 0x55eec40613b0 2024-09-13T15:57:52.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.219+0000 7f86fccb5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec3fcaa70 con 0x55eec4066440 2024-09-13T15:57:52.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.219+0000 7f86fccb5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec3fc8200 con 0x55eec4060a70 2024-09-13T15:57:52.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.219+0000 7f86f3400640 1 -- 172.21.15.17:0/2873851084 learned_addr learned my addr 172.21.15.17:0/2873851084 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:52.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.220+0000 7f86f3400640 1 --2- 172.21.15.17:0/2873851084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eec4066440 0x55eec4068900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:52.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.220+0000 7f86f3400640 1 -- 172.21.15.17:0/2873851084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eec4066440 msgr2=0x55eec4068900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:52.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.220+0000 7f86f3400640 1 --2- 172.21.15.17:0/2873851084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eec4066440 0x55eec4068900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.220+0000 7f86ebe00640 1 --2- 172.21.15.17:0/2873851084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eec40613b0 0x55eec4065e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.220+0000 7f86f3400640 1 -- 172.21.15.17:0/2873851084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eec40613b0 msgr2=0x55eec4065e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.220+0000 7f86f2a00640 1 --2- 172.21.15.17:0/121589771 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f86d80a1260 0x7f86d80a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.220+0000 7f86f3400640 1 --2- 172.21.15.17:0/2873851084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eec40613b0 0x55eec4065e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.220+0000 7f86f3400640 1 -- 172.21.15.17:0/2873851084 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eec3f65940 con 0x55eec4060a70 2024-09-13T15:57:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.220+0000 7f86ebe00640 1 --2- 172.21.15.17:0/2873851084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eec40613b0 0x55eec4065e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:57:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.221+0000 7f86f3400640 1 --2- 172.21.15.17:0/2873851084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec4060a70 0x55eec4060e70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f86ec007f20 tx=0x7f86ec007a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd7fd47cd0b2c66a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.222+0000 7f86f2a00640 1 --2- 172.21.15.17:0/121589771 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f86d80a1260 0x7f86d80a3720 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f86e400abe0 tx=0x7f86e400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:52.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.228+0000 7f86e8c00640 1 -- 172.21.15.17:0/2873851084 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec003c10 con 0x55eec4060a70 2024-09-13T15:57:52.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.228+0000 7f86e8c00640 1 -- 172.21.15.17:0/2873851084 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86ec003d70 con 0x55eec4060a70 2024-09-13T15:57:52.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.228+0000 7f86e8c00640 1 -- 172.21.15.17:0/2873851084 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec011960 con 0x55eec4060a70 2024-09-13T15:57:52.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.232+0000 7f86fccb5740 1 -- 172.21.15.17:0/2873851084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec4060a70 msgr2=0x55eec4060e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:52.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.232+0000 7f86fccb5740 1 --2- 172.21.15.17:0/2873851084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec4060a70 0x55eec4060e70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f86ec007f20 tx=0x7f86ec007a50 comp rx=0 tx=0).stop 2024-09-13T15:57:52.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.233+0000 7f86fccb5740 1 -- 172.21.15.17:0/2873851084 shutdown_connections 2024-09-13T15:57:52.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.233+0000 7f86fccb5740 1 --2- 172.21.15.17:0/2873851084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eec4066440 0x55eec4068900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.234+0000 7f86fccb5740 1 --2- 172.21.15.17:0/2873851084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eec40613b0 0x55eec4065e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.234+0000 7f86fccb5740 1 --2- 172.21.15.17:0/2873851084 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec4060a70 0x55eec4060e70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.234+0000 7f86fccb5740 1 -- 172.21.15.17:0/2873851084 >> 172.21.15.17:0/2873851084 conn(0x55eec405c0e0 msgr2=0x55eec405c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:52.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.235+0000 7f86fccb5740 1 -- 172.21.15.17:0/2873851084 shutdown_connections 2024-09-13T15:57:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.237+0000 7f86fccb5740 1 -- 172.21.15.17:0/2873851084 wait complete. 2024-09-13T15:57:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.238+0000 7f86fccb5740 1 -- start start 2024-09-13T15:57:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.240+0000 7f86fccb5740 1 Processor -- start 2024-09-13T15:57:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.241+0000 7f86fccb5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eec4060a70 0x55eec406a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.241+0000 7f86fccb5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eec40613b0 0x55eec406ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.241+0000 7f86fccb5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec4066440 0x55eec4071d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.242+0000 7f86fccb5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec3fc3af0 con 0x55eec40613b0 2024-09-13T15:57:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.242+0000 7f86fccb5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec3f81f20 con 0x55eec4060a70 2024-09-13T15:57:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.242+0000 7f86fccb5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec3f81bc0 con 0x55eec4066440 2024-09-13T15:57:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.242+0000 7f86ebe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eec40613b0 0x55eec406ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.242+0000 7f86fccb5740 10 client.0 _ll_register_callbacks cb 0x55eec3fb3a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:57:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.243+0000 7f86f2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eec4060a70 0x55eec406a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.243+0000 7f86f2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eec4060a70 0x55eec406a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:50898/0 (socket says 172.21.15.17:50898) 2024-09-13T15:57:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.243+0000 7f86f2a00640 1 -- 172.21.15.17:0/1477234656 learned_addr learned my addr 172.21.15.17:0/1477234656 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.243+0000 7f86f3400640 1 --2- 172.21.15.17:0/1477234656 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec4066440 0x55eec4071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.244+0000 7f86f3400640 1 -- 172.21.15.17:0/1477234656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eec4060a70 msgr2=0x55eec406a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.244+0000 7f86f3400640 1 --2- 172.21.15.17:0/1477234656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eec4060a70 0x55eec406a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.244+0000 7f86f3400640 1 -- 172.21.15.17:0/1477234656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eec40613b0 msgr2=0x55eec406ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.244+0000 7f86f3400640 1 --2- 172.21.15.17:0/1477234656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eec40613b0 0x55eec406ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.244+0000 7f86f3400640 1 -- 172.21.15.17:0/1477234656 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ec0132c0 con 0x55eec4066440 2024-09-13T15:57:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.245+0000 7f86e1600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T15:57:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.245+0000 7f86f3400640 1 --2- 172.21.15.17:0/1477234656 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec4066440 0x55eec4071d70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f86ec007ef0 tx=0x7f86ec004250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86dfb144f461e2d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:52.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.248+0000 7f86e1600640 1 -- 172.21.15.17:0/1477234656 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec007890 con 0x55eec4066440 2024-09-13T15:57:52.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.248+0000 7f86e1600640 1 -- 172.21.15.17:0/1477234656 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f86ec00d040 con 0x55eec4066440 2024-09-13T15:57:52.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.248+0000 7f86fccb5740 1 -- 172.21.15.17:0/1477234656 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eec3fedc90 con 0x55eec4066440 2024-09-13T15:57:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.257+0000 7f86e1600640 1 -- 172.21.15.17:0/1477234656 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86ec007890 con 0x55eec4066440 2024-09-13T15:57:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.257+0000 7f86fccb5740 10 client.25420 fetch_fsmap learned FSMap version 27 2024-09-13T15:57:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.257+0000 7f86fccb5740 1 -- 172.21.15.17:0/1477234656 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55eec3fc2170 con 0x55eec4066440 2024-09-13T15:57:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.258+0000 7f86e1600640 1 -- 172.21.15.17:0/1477234656 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86ec004650 con 0x55eec4066440 2024-09-13T15:57:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.258+0000 7f86e1600640 1 -- 172.21.15.17:0/1477234656 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f86ec01e050 con 0x55eec4066440 2024-09-13T15:57:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.258+0000 7f86fccb5740 10 client.25420 fetch_fsmap finished waiting for FSMap version 27 2024-09-13T15:57:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.258+0000 7f86fccb5740 10 client.25420 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T15:57:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.258+0000 7f86fccb5740 20 client.25420 populate_metadata read hostname 'smithi017' 2024-09-13T15:57:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.258+0000 7f86fccb5740 1 --2- 172.21.15.17:0/1477234656 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55eec40762f0 0x55eec4078710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.258+0000 7f86fccb5740 4 client.25420 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:57:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.258+0000 7f86fccb5740 1 -- 172.21.15.17:0/1477234656 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eec3fedc90 con 0x55eec40762f0 2024-09-13T15:57:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.258+0000 7f86f2a00640 1 --2- 172.21.15.17:0/1477234656 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55eec40762f0 0x55eec4078710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.259+0000 7f86f2a00640 1 --2- 172.21.15.17:0/1477234656 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55eec40762f0 0x55eec4078710 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ee7eb9e3c9ca915 server_cookie=e0e9e028b1533e0c in_seq=0 out_seq=0 2024-09-13T15:57:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.259+0000 7f86e1600640 10 client.25420 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:57:52.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.263+0000 7f86e1600640 1 -- 172.21.15.17:0/1477234656 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55eec3fedc90 con 0x55eec40762f0 2024-09-13T15:57:52.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.263+0000 7f86e1600640 10 client.25420 handle_command_reply: tid=0 2024-09-13T15:57:52.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.263+0000 7f86fccb5740 1 client.25420 shutdown 2024-09-13T15:57:52.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.264+0000 7f86fccb5740 1 -- 172.21.15.17:0/1477234656 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec4066440 msgr2=0x55eec4071d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:52.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.264+0000 7f86fccb5740 1 --2- 172.21.15.17:0/1477234656 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec4066440 0x55eec4071d70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f86ec007ef0 tx=0x7f86ec004250 comp rx=0 tx=0).stop 2024-09-13T15:57:52.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.264+0000 7f86fccb5740 1 -- 172.21.15.17:0/1477234656 shutdown_connections 2024-09-13T15:57:52.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.264+0000 7f86fccb5740 1 --2- 172.21.15.17:0/1477234656 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55eec40762f0 0x55eec4078710 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.264+0000 7f86fccb5740 1 --2- 172.21.15.17:0/1477234656 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec4066440 0x55eec4071d70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.264+0000 7f86e1600640 0 client.25420 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:57:52.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.264+0000 7f86fccb5740 1 --2- 172.21.15.17:0/1477234656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eec40613b0 0x55eec406ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.265+0000 7f86fccb5740 1 --2- 172.21.15.17:0/1477234656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eec4060a70 0x55eec406a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.265+0000 7f86fccb5740 1 -- 172.21.15.17:0/1477234656 >> 172.21.15.17:0/1477234656 conn(0x55eec405c0e0 msgr2=0x55eec405d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:52.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.265+0000 7f86fccb5740 1 -- 172.21.15.17:0/1477234656 shutdown_connections 2024-09-13T15:57:52.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.265+0000 7f86fccb5740 1 -- 172.21.15.17:0/1477234656 wait complete. 2024-09-13T15:57:52.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.266+0000 7f86fccb5740 20 client.25420 trim_cache size 0 max 16384 2024-09-13T15:57:52.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.295+0000 7f86fccb5740 1 Processor -- start 2024-09-13T15:57:52.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.295+0000 7f86fccb5740 1 -- start start 2024-09-13T15:57:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.296+0000 7f86fccb5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eec4060a70 0x55eec405c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.296+0000 7f86fccb5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec40613b0 0x55eec4071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.296+0000 7f86fccb5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eec4066440 0x55eec407d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.296+0000 7f86fccb5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec3d2ae60 con 0x55eec4066440 2024-09-13T15:57:52.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.296+0000 7f86fccb5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec4072880 con 0x55eec4060a70 2024-09-13T15:57:52.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.296+0000 7f86fccb5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec405ba20 con 0x55eec40613b0 2024-09-13T15:57:52.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.296+0000 7f86ebe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec40613b0 0x55eec4071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:52.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.296+0000 7f86ebe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec40613b0 0x55eec4071ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:37492/0 (socket says 172.21.15.17:37492) 2024-09-13T15:57:52.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.296+0000 7f86ebe00640 1 -- 172.21.15.17:0/1965617170 learned_addr learned my addr 172.21.15.17:0/1965617170 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:52.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.297+0000 7f86ebe00640 1 -- 172.21.15.17:0/1965617170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eec4060a70 msgr2=0x55eec405c4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T15:57:52.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.297+0000 7f86ebe00640 1 --2- 172.21.15.17:0/1965617170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eec4060a70 0x55eec405c4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.297+0000 7f86ebe00640 1 -- 172.21.15.17:0/1965617170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eec4066440 msgr2=0x55eec407d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:52.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.297+0000 7f86ebe00640 1 --2- 172.21.15.17:0/1965617170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eec4066440 0x55eec407d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.297+0000 7f86ebe00640 1 -- 172.21.15.17:0/1965617170 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eec3f64180 con 0x55eec40613b0 2024-09-13T15:57:52.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.297+0000 7f86ebe00640 1 --2- 172.21.15.17:0/1965617170 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec40613b0 0x55eec4071ce0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f86dc000c00 tx=0x7f86dc031f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72d5b3d40ccd3551 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:52.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.297+0000 7f86e9600640 1 -- 172.21.15.17:0/1965617170 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0be630 con 0x55eec40613b0 2024-09-13T15:57:52.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.297+0000 7f86e9600640 1 -- 172.21.15.17:0/1965617170 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86dc0c2c80 con 0x55eec40613b0 2024-09-13T15:57:52.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.297+0000 7f86e9600640 1 -- 172.21.15.17:0/1965617170 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0b6f10 con 0x55eec40613b0 2024-09-13T15:57:52.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.298+0000 7f86fccb5740 1 -- 172.21.15.17:0/1965617170 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec40613b0 msgr2=0x55eec4071ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:52.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.298+0000 7f86fccb5740 1 --2- 172.21.15.17:0/1965617170 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec40613b0 0x55eec4071ce0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f86dc000c00 tx=0x7f86dc031f40 comp rx=0 tx=0).stop 2024-09-13T15:57:52.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.298+0000 7f86fccb5740 1 -- 172.21.15.17:0/1965617170 shutdown_connections 2024-09-13T15:57:52.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.298+0000 7f86fccb5740 1 --2- 172.21.15.17:0/1965617170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eec4066440 0x55eec407d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.298+0000 7f86fccb5740 1 --2- 172.21.15.17:0/1965617170 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec40613b0 0x55eec4071ce0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.298+0000 7f86fccb5740 1 --2- 172.21.15.17:0/1965617170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eec4060a70 0x55eec405c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.298+0000 7f86fccb5740 1 -- 172.21.15.17:0/1965617170 >> 172.21.15.17:0/1965617170 conn(0x55eec405c0e0 msgr2=0x55eec4065990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:52.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.298+0000 7f86fccb5740 1 -- 172.21.15.17:0/1965617170 shutdown_connections 2024-09-13T15:57:52.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.298+0000 7f86fccb5740 1 -- 172.21.15.17:0/1965617170 wait complete. 2024-09-13T15:57:52.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.299+0000 7f86fccb5740 1 -- start start 2024-09-13T15:57:52.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.299+0000 7f86fccb5740 1 Processor -- start 2024-09-13T15:57:52.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.300+0000 7f86fccb5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eec4060a70 0x55eec406dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:52.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.300+0000 7f86fccb5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec40613b0 0x55eec406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:52.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.300+0000 7f86fccb5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eec4066440 0x55eec4071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:52.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.300+0000 7f86fccb5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec4071550 con 0x55eec4060a70 2024-09-13T15:57:52.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.300+0000 7f86fccb5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec40716c0 con 0x55eec4066440 2024-09-13T15:57:52.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.300+0000 7f86fccb5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eec4071880 con 0x55eec40613b0 2024-09-13T15:57:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.300+0000 7f86fccb5740 10 client.0 _ll_register_callbacks cb 0x7f86ec008040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:57:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.300+0000 7f86ebe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec40613b0 0x55eec406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.300+0000 7f86ebe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec40613b0 0x55eec406e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:37498/0 (socket says 172.21.15.17:37498) 2024-09-13T15:57:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.300+0000 7f86ebe00640 1 -- 172.21.15.17:0/3781079067 learned_addr learned my addr 172.21.15.17:0/3781079067 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:57:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.301+0000 7f86f3400640 1 --2- 172.21.15.17:0/3781079067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eec4066440 0x55eec4071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.301+0000 7f86ebe00640 1 -- 172.21.15.17:0/3781079067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eec4066440 msgr2=0x55eec4071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.301+0000 7f86ebe00640 1 --2- 172.21.15.17:0/3781079067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eec4066440 0x55eec4071010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.301+0000 7f86ebe00640 1 -- 172.21.15.17:0/3781079067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eec4060a70 msgr2=0x55eec406dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:57:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.301+0000 7f86ebe00640 1 --2- 172.21.15.17:0/3781079067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eec4060a70 0x55eec406dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.301+0000 7f86ebe00640 1 -- 172.21.15.17:0/3781079067 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f41a4900 con 0x55eec40613b0 2024-09-13T15:57:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.301+0000 7f86f3400640 1 --2- 172.21.15.17:0/3781079067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eec4066440 0x55eec4071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:57:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.301+0000 7f86ebe00640 1 --2- 172.21.15.17:0/3781079067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec40613b0 0x55eec406e0e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0b6cb0 tx=0x7f86dc0ba660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b756445b23ed5e33 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:57:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.301+0000 7f86e1600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T15:57:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.302+0000 7f86e1600640 1 -- 172.21.15.17:0/3781079067 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0eafc0 con 0x55eec40613b0 2024-09-13T15:57:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.302+0000 7f86e1600640 1 -- 172.21.15.17:0/3781079067 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f86dc0b6f10 con 0x55eec40613b0 2024-09-13T15:57:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.302+0000 7f86fccb5740 1 -- 172.21.15.17:0/3781079067 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f86ec003d70 con 0x55eec40613b0 2024-09-13T15:57:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.302+0000 7f86e1600640 1 -- 172.21.15.17:0/3781079067 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86dc0b70f0 con 0x55eec40613b0 2024-09-13T15:57:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.302+0000 7f86fccb5740 10 client.25426 fetch_fsmap learned FSMap version 27 2024-09-13T15:57:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.302+0000 7f86fccb5740 1 -- 172.21.15.17:0/3781079067 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55eec3f89560 con 0x55eec40613b0 2024-09-13T15:57:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.302+0000 7f86e1600640 1 -- 172.21.15.17:0/3781079067 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86dc09f020 con 0x55eec40613b0 2024-09-13T15:57:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.303+0000 7f86e1600640 1 -- 172.21.15.17:0/3781079067 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f86dc0c27f0 con 0x55eec40613b0 2024-09-13T15:57:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.303+0000 7f86fccb5740 10 client.25426 fetch_fsmap finished waiting for FSMap version 27 2024-09-13T15:57:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.303+0000 7f86fccb5740 10 client.25426 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T15:57:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.303+0000 7f86fccb5740 20 client.25426 populate_metadata read hostname 'smithi017' 2024-09-13T15:57:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.303+0000 7f86fccb5740 1 --2- 172.21.15.17:0/3781079067 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55eec40762f0 0x55eec40e0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:57:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.303+0000 7f86fccb5740 4 client.25426 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T15:57:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.303+0000 7f86fccb5740 1 -- 172.21.15.17:0/3781079067 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55eec3fb67d0 con 0x55eec40762f0 2024-09-13T15:57:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.303+0000 7f86f2a00640 1 --2- 172.21.15.17:0/3781079067 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55eec40762f0 0x55eec40e0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:57:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.304+0000 7f86f2a00640 1 --2- 172.21.15.17:0/3781079067 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55eec40762f0 0x55eec40e0500 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86ffcd63ec0de0ed server_cookie=b3b215329255bd9c in_seq=0 out_seq=0 2024-09-13T15:57:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.304+0000 7f86e1600640 10 client.25426 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:57:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.329+0000 7f86e1600640 1 -- 172.21.15.17:0/3781079067 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55eec3fb67d0 con 0x55eec40762f0 2024-09-13T15:57:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.329+0000 7f86e1600640 10 client.25426 handle_command_reply: tid=0 2024-09-13T15:57:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.329+0000 7f86fccb5740 1 client.25426 shutdown 2024-09-13T15:57:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.330+0000 7f86fccb5740 1 -- 172.21.15.17:0/3781079067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec40613b0 msgr2=0x55eec406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.330+0000 7f86fccb5740 1 --2- 172.21.15.17:0/3781079067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec40613b0 0x55eec406e0e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0b6cb0 tx=0x7f86dc0ba660 comp rx=0 tx=0).stop 2024-09-13T15:57:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.330+0000 7f86fccb5740 1 -- 172.21.15.17:0/3781079067 shutdown_connections 2024-09-13T15:57:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.330+0000 7f86fccb5740 1 --2- 172.21.15.17:0/3781079067 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55eec40762f0 0x55eec40e0500 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.330+0000 7f86fccb5740 1 --2- 172.21.15.17:0/3781079067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eec4066440 0x55eec4071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.330+0000 7f86fccb5740 1 --2- 172.21.15.17:0/3781079067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eec40613b0 0x55eec406e0e0 secure :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0b6cb0 tx=0x7f86dc0ba660 comp rx=0 tx=0).stop 2024-09-13T15:57:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.330+0000 7f86fccb5740 1 --2- 172.21.15.17:0/3781079067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eec4060a70 0x55eec406dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.330+0000 7f86fccb5740 1 -- 172.21.15.17:0/3781079067 >> 172.21.15.17:0/3781079067 conn(0x55eec405c0e0 msgr2=0x55eec407d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.330+0000 7f86e1600640 0 client.25426 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:57:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.330+0000 7f86fccb5740 1 -- 172.21.15.17:0/3781079067 shutdown_connections 2024-09-13T15:57:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.330+0000 7f86fccb5740 1 -- 172.21.15.17:0/3781079067 wait complete. 2024-09-13T15:57:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.331+0000 7f86fccb5740 20 client.25426 trim_cache size 0 max 16384 2024-09-13T15:57:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T15:57:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T15:57:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T15:57:52.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T15:57:52.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.331+0000 7f86f9e00640 1 -- 172.21.15.17:0/121589771 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f86d80a1260 msgr2=0x7f86d80a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:52.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.331+0000 7f86f9e00640 1 --2- 172.21.15.17:0/121589771 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f86d80a1260 0x7f86d80a3720 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f86e400abe0 tx=0x7f86e400a5c0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.331+0000 7f86f9e00640 1 -- 172.21.15.17:0/121589771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86f4100f30 msgr2=0x7f86f419c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:57:52.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.331+0000 7f86f9e00640 1 --2- 172.21.15.17:0/121589771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86f4100f30 0x7f86f419c8c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f86dc031500 tx=0x7f86dc003cd0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.331+0000 7f86f9e00640 1 -- 172.21.15.17:0/121589771 shutdown_connections 2024-09-13T15:57:52.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.331+0000 7f86f9e00640 1 --2- 172.21.15.17:0/121589771 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f86d80a1260 0x7f86d80a3720 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.331+0000 7f86f9e00640 1 --2- 172.21.15.17:0/121589771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86f41038e0 0x7f86f41a3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.331+0000 7f86f9e00640 1 --2- 172.21.15.17:0/121589771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86f4100f30 0x7f86f419c8c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.331+0000 7f86f9e00640 1 --2- 172.21.15.17:0/121589771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86f40fe5e0 0x7f86f419c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:57:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.332+0000 7f86f9e00640 1 -- 172.21.15.17:0/121589771 >> 172.21.15.17:0/121589771 conn(0x7f86f40fa3d0 msgr2=0x7f86f40fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:57:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.332+0000 7f86f9e00640 1 -- 172.21.15.17:0/121589771 shutdown_connections 2024-09-13T15:57:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:57:52.332+0000 7f86f9e00640 1 -- 172.21.15.17:0/121589771 wait complete. 2024-09-13T15:57:52.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:52 smithi189 ceph-mon[34790]: pgmap v389: 129 pgs: 129 active+clean; 697 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 49 MiB/s wr, 343 op/s 2024-09-13T15:57:52.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:52 smithi193 ceph-mon[35248]: pgmap v389: 129 pgs: 129 active+clean; 697 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 49 MiB/s wr, 343 op/s 2024-09-13T15:57:52.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:52 smithi017 ceph-mon[30494]: pgmap v389: 129 pgs: 129 active+clean; 697 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 49 MiB/s wr, 343 op/s 2024-09-13T15:57:54.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:54 smithi189 ceph-mon[34790]: pgmap v390: 129 pgs: 129 active+clean; 859 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 38 MiB/s wr, 319 op/s 2024-09-13T15:57:54.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:54 smithi193 ceph-mon[35248]: pgmap v390: 129 pgs: 129 active+clean; 859 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 38 MiB/s wr, 319 op/s 2024-09-13T15:57:54.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:54 smithi017 ceph-mon[30494]: pgmap v390: 129 pgs: 129 active+clean; 859 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 38 MiB/s wr, 319 op/s 2024-09-13T15:57:55.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 10.0 s, 2361.4 tps, lat 42.500 ms stddev 44.422 2024-09-13T15:57:56.556 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:56 smithi193 ceph-mon[35248]: pgmap v391: 129 pgs: 129 active+clean; 893 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 26 MiB/s wr, 378 op/s 2024-09-13T15:57:56.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:56 smithi189 ceph-mon[34790]: pgmap v391: 129 pgs: 129 active+clean; 893 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 26 MiB/s wr, 378 op/s 2024-09-13T15:57:56.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:56 smithi017 ceph-mon[30494]: pgmap v391: 129 pgs: 129 active+clean; 893 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 26 MiB/s wr, 378 op/s 2024-09-13T15:57:58.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:58 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T15:57:58.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:57:58 smithi189 ceph-mon[34790]: pgmap v392: 129 pgs: 129 active+clean; 904 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 19 MiB/s wr, 434 op/s 2024-09-13T15:57:58.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:58 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T15:57:58.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:57:58 smithi193 ceph-mon[35248]: pgmap v392: 129 pgs: 129 active+clean; 904 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 19 MiB/s wr, 434 op/s 2024-09-13T15:57:58.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:58 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T15:57:58.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:57:58 smithi017 ceph-mon[30494]: pgmap v392: 129 pgs: 129 active+clean; 904 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 19 MiB/s wr, 434 op/s 2024-09-13T15:58:00.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 15.0 s, 2520.4 tps, lat 39.664 ms stddev 51.207 2024-09-13T15:58:00.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:00 smithi189 ceph-mon[34790]: pgmap v393: 129 pgs: 129 active+clean; 913 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 15 MiB/s wr, 586 op/s 2024-09-13T15:58:00.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:00 smithi017 ceph-mon[30494]: pgmap v393: 129 pgs: 129 active+clean; 913 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 15 MiB/s wr, 586 op/s 2024-09-13T15:58:00.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:00 smithi193 ceph-mon[35248]: pgmap v393: 129 pgs: 129 active+clean; 913 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 15 MiB/s wr, 586 op/s 2024-09-13T15:58:02.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:02 smithi189 ceph-mon[34790]: pgmap v394: 129 pgs: 129 active+clean; 919 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.9 MiB/s wr, 631 op/s 2024-09-13T15:58:02.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:02 smithi193 ceph-mon[35248]: pgmap v394: 129 pgs: 129 active+clean; 919 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.9 MiB/s wr, 631 op/s 2024-09-13T15:58:02.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:02 smithi017 ceph-mon[30494]: pgmap v394: 129 pgs: 129 active+clean; 919 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.9 MiB/s wr, 631 op/s 2024-09-13T15:58:04.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:04 smithi189 ceph-mon[34790]: pgmap v395: 129 pgs: 129 active+clean; 928 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.8 MiB/s wr, 678 op/s 2024-09-13T15:58:04.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:04 smithi193 ceph-mon[35248]: pgmap v395: 129 pgs: 129 active+clean; 928 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.8 MiB/s wr, 678 op/s 2024-09-13T15:58:04.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:04 smithi017 ceph-mon[30494]: pgmap v395: 129 pgs: 129 active+clean; 928 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.8 MiB/s wr, 678 op/s 2024-09-13T15:58:05.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 20.0 s, 1992.8 tps, lat 49.937 ms stddev 56.872 2024-09-13T15:58:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.504+0000 7f0106e00640 1 -- 172.21.15.17:0/1480899729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00f8094850 msgr2=0x7f00f8094cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.504+0000 7f0106e00640 1 --2- 172.21.15.17:0/1480899729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00f8094850 0x7f00f8094cb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009900 tx=0x7f00ec02a3f0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.509+0000 7f0106e00640 1 -- 172.21.15.17:0/1480899729 shutdown_connections 2024-09-13T15:58:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.509+0000 7f0106e00640 1 --2- 172.21.15.17:0/1480899729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00f80951f0 0x7f00f80956a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.509+0000 7f0106e00640 1 --2- 172.21.15.17:0/1480899729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00f8094850 0x7f00f8094cb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.509+0000 7f0106e00640 1 --2- 172.21.15.17:0/1480899729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00f8093f10 0x7f00f8094310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.509+0000 7f0106e00640 1 -- 172.21.15.17:0/1480899729 >> 172.21.15.17:0/1480899729 conn(0x7f00f808fc80 msgr2=0x7f00f80920e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:05.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.510+0000 7f0106e00640 1 -- 172.21.15.17:0/1480899729 shutdown_connections 2024-09-13T15:58:05.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.510+0000 7f0106e00640 1 -- 172.21.15.17:0/1480899729 wait complete. 2024-09-13T15:58:05.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.511+0000 7f0106e00640 1 Processor -- start 2024-09-13T15:58:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.511+0000 7f0106e00640 1 -- start start 2024-09-13T15:58:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.512+0000 7f0106e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00f8093f10 0x7f00f8131c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.512+0000 7f0106e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00f8094850 0x7f00f8132190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.512+0000 7f0106e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00f80951f0 0x7f00f81391c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.512+0000 7f0106e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f8139730 con 0x7f00f80951f0 2024-09-13T15:58:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.512+0000 7f0106e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80a1fa0 con 0x7f00f8094850 2024-09-13T15:58:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.512+0000 7f0106e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80a2160 con 0x7f00f8093f10 2024-09-13T15:58:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.512+0000 7f00ff400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00f8094850 0x7f00f8132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.513+0000 7f00ff400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00f8094850 0x7f00f8132190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:54672/0 (socket says 172.21.15.17:54672) 2024-09-13T15:58:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.513+0000 7f00ff400640 1 -- 172.21.15.17:0/673298769 learned_addr learned my addr 172.21.15.17:0/673298769 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.513+0000 7f0104e00640 1 --2- 172.21.15.17:0/673298769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00f80951f0 0x7f00f81391c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.514+0000 7f00ffe00640 1 --2- 172.21.15.17:0/673298769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00f8093f10 0x7f00f8131c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.514+0000 7f0104e00640 1 -- 172.21.15.17:0/673298769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00f8093f10 msgr2=0x7f00f8131c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:05.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.514+0000 7f0104e00640 1 --2- 172.21.15.17:0/673298769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00f8093f10 0x7f00f8131c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.514+0000 7f0104e00640 1 -- 172.21.15.17:0/673298769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00f8094850 msgr2=0x7f00f8132190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:05.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.514+0000 7f0104e00640 1 --2- 172.21.15.17:0/673298769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00f8094850 0x7f00f8132190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.514+0000 7f0104e00640 1 -- 172.21.15.17:0/673298769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec009560 con 0x7f00f80951f0 2024-09-13T15:58:05.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.514+0000 7f00ffe00640 1 --2- 172.21.15.17:0/673298769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00f8093f10 0x7f00f8131c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:58:05.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.514+0000 7f0104e00640 1 --2- 172.21.15.17:0/673298769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00f80951f0 0x7f00f81391c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f01000660d0 tx=0x7f0100069700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.515+0000 7f00fcc00640 1 -- 172.21.15.17:0/673298769 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0100080640 con 0x7f00f80951f0 2024-09-13T15:58:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.515+0000 7f00fcc00640 1 -- 172.21.15.17:0/673298769 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f010007b040 con 0x7f00f80951f0 2024-09-13T15:58:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.515+0000 7f00fcc00640 1 -- 172.21.15.17:0/673298769 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01000688f0 con 0x7f00f80951f0 2024-09-13T15:58:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.515+0000 7f0106e00640 1 -- 172.21.15.17:0/673298769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f80a2440 con 0x7f00f80951f0 2024-09-13T15:58:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.515+0000 7f0106e00640 1 -- 172.21.15.17:0/673298769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f80a28d0 con 0x7f00f80951f0 2024-09-13T15:58:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.521+0000 7f00fcc00640 1 -- 172.21.15.17:0/673298769 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0100068a50 con 0x7f00f80951f0 2024-09-13T15:58:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.523+0000 7f00fcc00640 1 --2- 172.21.15.17:0/673298769 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f00e80a1190 0x7f00e80a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.524+0000 7f00fcc00640 1 -- 172.21.15.17:0/673298769 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f0100136870 con 0x7f00f80951f0 2024-09-13T15:58:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.525+0000 7f00ffe00640 1 --2- 172.21.15.17:0/673298769 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f00e80a1190 0x7f00e80a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:05.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.526+0000 7f00ffe00640 1 --2- 172.21.15.17:0/673298769 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f00e80a1190 0x7f00e80a3650 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f00f4005860 tx=0x7f00f4005e60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.535+0000 7f0109cb9740 1 Processor -- start 2024-09-13T15:58:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.535+0000 7f0109cb9740 1 -- start start 2024-09-13T15:58:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.535+0000 7f0109cb9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558042a54c80 0x558042a55080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.536+0000 7f0109cb9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a555c0 0x558042a5a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.536+0000 7f0109cb9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a5a650 0x558042a5cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.536+0000 7f0109cb9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558042960bb0 con 0x558042a54c80 2024-09-13T15:58:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.536+0000 7f0109cb9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580429bea70 con 0x558042a555c0 2024-09-13T15:58:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.536+0000 7f0109cb9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580429bc200 con 0x558042a5a650 2024-09-13T15:58:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.536+0000 7f00ffe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558042a54c80 0x558042a55080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.536+0000 7f0104e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a5a650 0x558042a5cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.536+0000 7f0104e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a5a650 0x558042a5cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:33608/0 (socket says 172.21.15.17:33608) 2024-09-13T15:58:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.536+0000 7f0104e00640 1 -- 172.21.15.17:0/3775455383 learned_addr learned my addr 172.21.15.17:0/3775455383 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.536+0000 7f00ff400640 1 --2- 172.21.15.17:0/3775455383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a555c0 0x558042a5a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.537+0000 7f0104e00640 1 -- 172.21.15.17:0/3775455383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a555c0 msgr2=0x558042a5a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.537+0000 7f0104e00640 1 --2- 172.21.15.17:0/3775455383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a555c0 0x558042a5a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.537+0000 7f0104e00640 1 -- 172.21.15.17:0/3775455383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558042a54c80 msgr2=0x558042a55080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.537+0000 7f0104e00640 1 --2- 172.21.15.17:0/3775455383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558042a54c80 0x558042a55080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.537+0000 7f0104e00640 1 -- 172.21.15.17:0/3775455383 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558042959940 con 0x558042a5a650 2024-09-13T15:58:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.538+0000 7f00ff400640 1 --2- 172.21.15.17:0/3775455383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a555c0 0x558042a5a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:58:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.538+0000 7f00ffe00640 1 --2- 172.21.15.17:0/3775455383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558042a54c80 0x558042a55080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:58:05.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.539+0000 7f0104e00640 1 --2- 172.21.15.17:0/3775455383 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a5a650 0x558042a5cb10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0100069ea0 tx=0x7f010004e780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce440c8072160b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:05.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.539+0000 7f00f1600640 1 -- 172.21.15.17:0/3775455383 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0100101af0 con 0x558042a5a650 2024-09-13T15:58:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.539+0000 7f00f1600640 1 -- 172.21.15.17:0/3775455383 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0100104010 con 0x558042a5a650 2024-09-13T15:58:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.539+0000 7f00f1600640 1 -- 172.21.15.17:0/3775455383 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0100102e00 con 0x558042a5a650 2024-09-13T15:58:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.540+0000 7f0109cb9740 1 -- 172.21.15.17:0/3775455383 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a5a650 msgr2=0x558042a5cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.540+0000 7f0109cb9740 1 --2- 172.21.15.17:0/3775455383 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a5a650 0x558042a5cb10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0100069ea0 tx=0x7f010004e780 comp rx=0 tx=0).stop 2024-09-13T15:58:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.540+0000 7f0109cb9740 1 -- 172.21.15.17:0/3775455383 shutdown_connections 2024-09-13T15:58:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.540+0000 7f0109cb9740 1 --2- 172.21.15.17:0/3775455383 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a5a650 0x558042a5cb10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.540+0000 7f0109cb9740 1 --2- 172.21.15.17:0/3775455383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a555c0 0x558042a5a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.540+0000 7f0109cb9740 1 --2- 172.21.15.17:0/3775455383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558042a54c80 0x558042a55080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.540+0000 7f0109cb9740 1 -- 172.21.15.17:0/3775455383 >> 172.21.15.17:0/3775455383 conn(0x558042a502f0 msgr2=0x558042a506f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:05.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.543+0000 7f0109cb9740 1 -- 172.21.15.17:0/3775455383 shutdown_connections 2024-09-13T15:58:05.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.543+0000 7f0109cb9740 1 -- 172.21.15.17:0/3775455383 wait complete. 2024-09-13T15:58:05.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.544+0000 7f0109cb9740 1 -- start start 2024-09-13T15:58:05.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.544+0000 7f0109cb9740 1 Processor -- start 2024-09-13T15:58:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.545+0000 7f0109cb9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a54c80 0x558042a5e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.545+0000 7f0109cb9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558042a555c0 0x558042a5ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.545+0000 7f0109cb9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a5a650 0x558042a65dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.545+0000 7f0109cb9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580429b7af0 con 0x558042a555c0 2024-09-13T15:58:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.545+0000 7f0109cb9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x558042975f20 con 0x558042a5a650 2024-09-13T15:58:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.545+0000 7f0109cb9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x558042975bc0 con 0x558042a54c80 2024-09-13T15:58:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.545+0000 7f0109cb9740 10 client.0 _ll_register_callbacks cb 0x5580429a7a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:58:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.545+0000 7f00ffe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a54c80 0x558042a5e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.545+0000 7f00ffe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a54c80 0x558042a5e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:33612/0 (socket says 172.21.15.17:33612) 2024-09-13T15:58:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.545+0000 7f00ffe00640 1 -- 172.21.15.17:0/3946799236 learned_addr learned my addr 172.21.15.17:0/3946799236 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.546+0000 7f00ffe00640 1 -- 172.21.15.17:0/3946799236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a5a650 msgr2=0x558042a65dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:58:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.546+0000 7f00ffe00640 1 --2- 172.21.15.17:0/3946799236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a5a650 0x558042a65dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.546+0000 7f00ffe00640 1 -- 172.21.15.17:0/3946799236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558042a555c0 msgr2=0x558042a5ed90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:58:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.546+0000 7f00ffe00640 1 --2- 172.21.15.17:0/3946799236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558042a555c0 0x558042a5ed90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.547+0000 7f00ffe00640 1 -- 172.21.15.17:0/3946799236 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f80a28d0 con 0x558042a54c80 2024-09-13T15:58:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.547+0000 7f00ffe00640 1 --2- 172.21.15.17:0/3946799236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a54c80 0x558042a5e850 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f00f40117f0 tx=0x7f00f40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86afdfb9ee552f77 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.547+0000 7f00e6000640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T15:58:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.548+0000 7f00e6000640 1 -- 172.21.15.17:0/3946799236 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4010d60 con 0x558042a54c80 2024-09-13T15:58:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.548+0000 7f0109cb9740 1 -- 172.21.15.17:0/3946799236 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5580429e1c90 con 0x558042a54c80 2024-09-13T15:58:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.548+0000 7f00e6000640 1 -- 172.21.15.17:0/3946799236 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f00f4011e30 con 0x558042a54c80 2024-09-13T15:58:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.548+0000 7f00e6000640 1 -- 172.21.15.17:0/3946799236 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00f402a7d0 con 0x558042a54c80 2024-09-13T15:58:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.549+0000 7f0109cb9740 10 client.25435 fetch_fsmap learned FSMap version 28 2024-09-13T15:58:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.549+0000 7f0109cb9740 1 -- 172.21.15.17:0/3946799236 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5580429b6170 con 0x558042a54c80 2024-09-13T15:58:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.549+0000 7f00e6000640 1 -- 172.21.15.17:0/3946799236 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00f402adf0 con 0x558042a54c80 2024-09-13T15:58:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.550+0000 7f00e6000640 1 -- 172.21.15.17:0/3946799236 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f00f401f420 con 0x558042a54c80 2024-09-13T15:58:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.550+0000 7f0109cb9740 10 client.25435 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T15:58:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.550+0000 7f0109cb9740 10 client.25435 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T15:58:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.550+0000 7f0109cb9740 20 client.25435 populate_metadata read hostname 'smithi017' 2024-09-13T15:58:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.550+0000 7f0109cb9740 1 --2- 172.21.15.17:0/3946799236 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x558042a6a5d0 0x558042a6ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:05.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.551+0000 7f0109cb9740 4 client.25435 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:58:05.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.551+0000 7f0109cb9740 1 -- 172.21.15.17:0/3946799236 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5580429e1c90 con 0x558042a6a5d0 2024-09-13T15:58:05.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.551+0000 7f00ff400640 1 --2- 172.21.15.17:0/3946799236 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x558042a6a5d0 0x558042a6ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:05.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.554+0000 7f00ff400640 1 --2- 172.21.15.17:0/3946799236 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x558042a6a5d0 0x558042a6ca90 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=128fed4f040a5a87 server_cookie=9f8ac77322303115 in_seq=0 out_seq=0 2024-09-13T15:58:05.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.554+0000 7f00e6000640 10 client.25435 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:58:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.555+0000 7f00e6000640 1 -- 172.21.15.17:0/3946799236 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5580429e1c90 con 0x558042a6a5d0 2024-09-13T15:58:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.555+0000 7f00e6000640 10 client.25435 handle_command_reply: tid=0 2024-09-13T15:58:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.555+0000 7f0109cb9740 1 client.25435 shutdown 2024-09-13T15:58:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.556+0000 7f0109cb9740 1 -- 172.21.15.17:0/3946799236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a54c80 msgr2=0x558042a5e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.556+0000 7f0109cb9740 1 --2- 172.21.15.17:0/3946799236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a54c80 0x558042a5e850 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f00f40117f0 tx=0x7f00f40046c0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.556+0000 7f0109cb9740 1 -- 172.21.15.17:0/3946799236 shutdown_connections 2024-09-13T15:58:05.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.556+0000 7f0109cb9740 1 --2- 172.21.15.17:0/3946799236 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x558042a6a5d0 0x558042a6ca90 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.556+0000 7f0109cb9740 1 --2- 172.21.15.17:0/3946799236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a5a650 0x558042a65dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.556+0000 7f0109cb9740 1 --2- 172.21.15.17:0/3946799236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558042a555c0 0x558042a5ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.556+0000 7f00e6000640 0 client.25435 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:58:05.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.556+0000 7f0109cb9740 1 --2- 172.21.15.17:0/3946799236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a54c80 0x558042a5e850 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.556+0000 7f0109cb9740 1 -- 172.21.15.17:0/3946799236 >> 172.21.15.17:0/3946799236 conn(0x558042a502f0 msgr2=0x558042a51b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.557+0000 7f0109cb9740 1 -- 172.21.15.17:0/3946799236 shutdown_connections 2024-09-13T15:58:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.557+0000 7f0109cb9740 1 -- 172.21.15.17:0/3946799236 wait complete. 2024-09-13T15:58:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.558+0000 7f0109cb9740 20 client.25435 trim_cache size 0 max 16384 2024-09-13T15:58:05.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.576+0000 7f0109cb9740 1 Processor -- start 2024-09-13T15:58:05.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.577+0000 7f0109cb9740 1 -- start start 2024-09-13T15:58:05.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.577+0000 7f0109cb9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a54c80 0x558042a55060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:05.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.577+0000 7f0109cb9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558042a555c0 0x558042a65cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:05.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.577+0000 7f0109cb9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a5a650 0x558042a5e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:05.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.577+0000 7f0109cb9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55804271ee60 con 0x558042a555c0 2024-09-13T15:58:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.577+0000 7f0109cb9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x558042a5e390 con 0x558042a5a650 2024-09-13T15:58:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.577+0000 7f0109cb9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x558042a5e1a0 con 0x558042a54c80 2024-09-13T15:58:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.578+0000 7f0104e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a5a650 0x558042a5e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.578+0000 7f0104e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a5a650 0x558042a5e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:54694/0 (socket says 172.21.15.17:54694) 2024-09-13T15:58:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.578+0000 7f00ffe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a54c80 0x558042a55060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.578+0000 7f0104e00640 1 -- 172.21.15.17:0/2972204967 learned_addr learned my addr 172.21.15.17:0/2972204967 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:05.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.578+0000 7f00ff400640 1 --2- 172.21.15.17:0/2972204967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558042a555c0 0x558042a65cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:05.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.578+0000 7f0104e00640 1 -- 172.21.15.17:0/2972204967 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a54c80 msgr2=0x558042a55060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:05.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.578+0000 7f0104e00640 1 --2- 172.21.15.17:0/2972204967 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a54c80 0x558042a55060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.578+0000 7f0104e00640 1 -- 172.21.15.17:0/2972204967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558042a555c0 msgr2=0x558042a65cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:05.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.579+0000 7f0104e00640 1 --2- 172.21.15.17:0/2972204967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558042a555c0 0x558042a65cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.579+0000 7f0104e00640 1 -- 172.21.15.17:0/2972204967 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f8094d30 con 0x558042a5a650 2024-09-13T15:58:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.579+0000 7f00ff400640 1 --2- 172.21.15.17:0/2972204967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558042a555c0 0x558042a65cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:58:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.580+0000 7f0104e00640 1 --2- 172.21.15.17:0/2972204967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a5a650 0x558042a5e600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f010010b860 tx=0x7f0100066570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a702f886cc0b62e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.580+0000 7f00f2000640 1 -- 172.21.15.17:0/2972204967 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0100101af0 con 0x558042a5a650 2024-09-13T15:58:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.580+0000 7f00f2000640 1 -- 172.21.15.17:0/2972204967 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0100103910 con 0x558042a5a650 2024-09-13T15:58:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.580+0000 7f00f2000640 1 -- 172.21.15.17:0/2972204967 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0100102e00 con 0x558042a5a650 2024-09-13T15:58:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.581+0000 7f0109cb9740 1 -- 172.21.15.17:0/2972204967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a5a650 msgr2=0x558042a5e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.581+0000 7f0109cb9740 1 --2- 172.21.15.17:0/2972204967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a5a650 0x558042a5e600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f010010b860 tx=0x7f0100066570 comp rx=0 tx=0).stop 2024-09-13T15:58:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.581+0000 7f0109cb9740 1 -- 172.21.15.17:0/2972204967 shutdown_connections 2024-09-13T15:58:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.581+0000 7f0109cb9740 1 --2- 172.21.15.17:0/2972204967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a5a650 0x558042a5e600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.581+0000 7f0109cb9740 1 --2- 172.21.15.17:0/2972204967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558042a555c0 0x558042a65cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.581+0000 7f0109cb9740 1 --2- 172.21.15.17:0/2972204967 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a54c80 0x558042a55060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.581+0000 7f0109cb9740 1 -- 172.21.15.17:0/2972204967 >> 172.21.15.17:0/2972204967 conn(0x558042a502f0 msgr2=0x558042a56440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.581+0000 7f0109cb9740 1 -- 172.21.15.17:0/2972204967 shutdown_connections 2024-09-13T15:58:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.582+0000 7f0109cb9740 1 -- 172.21.15.17:0/2972204967 wait complete. 2024-09-13T15:58:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.582+0000 7f0109cb9740 1 -- start start 2024-09-13T15:58:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.582+0000 7f0109cb9740 1 Processor -- start 2024-09-13T15:58:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.583+0000 7f0109cb9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a54c80 0x558042a60330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.583+0000 7f0109cb9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a555c0 0x558042a60870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.583+0000 7f0109cb9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558042a5a650 0x558042a658a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.583+0000 7f00ffe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a54c80 0x558042a60330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.583+0000 7f00ffe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a54c80 0x558042a60330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:33634/0 (socket says 172.21.15.17:33634) 2024-09-13T15:58:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.584+0000 7f00ffe00640 1 -- 172.21.15.17:0/3548607722 learned_addr learned my addr 172.21.15.17:0/3548607722 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.584+0000 7f0109cb9740 1 -- 172.21.15.17:0/3548607722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558042a65de0 con 0x558042a5a650 2024-09-13T15:58:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.584+0000 7f0104e00640 1 --2- 172.21.15.17:0/3548607722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558042a5a650 0x558042a658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.584+0000 7f0109cb9740 1 -- 172.21.15.17:0/3548607722 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x558042a65f50 con 0x558042a555c0 2024-09-13T15:58:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.584+0000 7f0109cb9740 1 -- 172.21.15.17:0/3548607722 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x558042ad1b10 con 0x558042a54c80 2024-09-13T15:58:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.584+0000 7f00ff400640 1 --2- 172.21.15.17:0/3548607722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a555c0 0x558042a60870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.584+0000 7f0109cb9740 10 client.0 _ll_register_callbacks cb 0x7f0100065d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:58:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.585+0000 7f00ff400640 1 -- 172.21.15.17:0/3548607722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a54c80 msgr2=0x558042a60330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.585+0000 7f00ff400640 1 --2- 172.21.15.17:0/3548607722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a54c80 0x558042a60330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.585+0000 7f00ff400640 1 -- 172.21.15.17:0/3548607722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558042a5a650 msgr2=0x558042a658a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.585+0000 7f00ff400640 1 --2- 172.21.15.17:0/3548607722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558042a5a650 0x558042a658a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.585+0000 7f00ff400640 1 -- 172.21.15.17:0/3548607722 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558042959940 con 0x558042a555c0 2024-09-13T15:58:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.585+0000 7f00ff400640 1 --2- 172.21.15.17:0/3548607722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a555c0 0x558042a60870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f00ec000c00 tx=0x7f00ec031700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9674937a252c7523 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.585+0000 7f00e6000640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T15:58:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.586+0000 7f00e6000640 1 -- 172.21.15.17:0/3548607722 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec042050 con 0x558042a555c0 2024-09-13T15:58:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.586+0000 7f00e6000640 1 -- 172.21.15.17:0/3548607722 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f00ec044e40 con 0x558042a555c0 2024-09-13T15:58:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.586+0000 7f0109cb9740 1 -- 172.21.15.17:0/3548607722 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0100104010 con 0x558042a555c0 2024-09-13T15:58:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.586+0000 7f00e6000640 1 -- 172.21.15.17:0/3548607722 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00ec031a70 con 0x558042a555c0 2024-09-13T15:58:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.586+0000 7f0109cb9740 10 client.25418 fetch_fsmap learned FSMap version 28 2024-09-13T15:58:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.586+0000 7f0109cb9740 1 -- 172.21.15.17:0/3548607722 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x558042958180 con 0x558042a555c0 2024-09-13T15:58:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.587+0000 7f00e6000640 1 -- 172.21.15.17:0/3548607722 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0100104010 con 0x558042a555c0 2024-09-13T15:58:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.587+0000 7f00e6000640 1 -- 172.21.15.17:0/3548607722 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f00ec003790 con 0x558042a555c0 2024-09-13T15:58:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.587+0000 7f0109cb9740 10 client.25418 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T15:58:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.587+0000 7f0109cb9740 10 client.25418 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T15:58:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.587+0000 7f0109cb9740 20 client.25418 populate_metadata read hostname 'smithi017' 2024-09-13T15:58:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.587+0000 7f0109cb9740 1 --2- 172.21.15.17:0/3548607722 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x558042ad3360 0x558042ad5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.587+0000 7f0109cb9740 4 client.25418 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T15:58:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.587+0000 7f0109cb9740 1 -- 172.21.15.17:0/3548607722 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5580429aa7d0 con 0x558042ad3360 2024-09-13T15:58:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.587+0000 7f00ffe00640 1 --2- 172.21.15.17:0/3548607722 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x558042ad3360 0x558042ad5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.588+0000 7f00e6000640 10 client.25418 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:58:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.588+0000 7f00ffe00640 1 --2- 172.21.15.17:0/3548607722 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x558042ad3360 0x558042ad5780 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53dcda6f419f8f5a server_cookie=a9450d4e43c77d5d in_seq=0 out_seq=0 2024-09-13T15:58:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.604+0000 7f00e6000640 1 -- 172.21.15.17:0/3548607722 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5580429aa7d0 con 0x558042ad3360 2024-09-13T15:58:05.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.604+0000 7f00e6000640 10 client.25418 handle_command_reply: tid=0 2024-09-13T15:58:05.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.604+0000 7f0109cb9740 1 client.25418 shutdown 2024-09-13T15:58:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.605+0000 7f0109cb9740 1 -- 172.21.15.17:0/3548607722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a555c0 msgr2=0x558042a60870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.605+0000 7f0109cb9740 1 --2- 172.21.15.17:0/3548607722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a555c0 0x558042a60870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f00ec000c00 tx=0x7f00ec031700 comp rx=0 tx=0).stop 2024-09-13T15:58:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.605+0000 7f0109cb9740 1 -- 172.21.15.17:0/3548607722 shutdown_connections 2024-09-13T15:58:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.605+0000 7f0109cb9740 1 --2- 172.21.15.17:0/3548607722 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x558042ad3360 0x558042ad5780 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.605+0000 7f0109cb9740 1 --2- 172.21.15.17:0/3548607722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558042a5a650 0x558042a658a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.605+0000 7f0109cb9740 1 --2- 172.21.15.17:0/3548607722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558042a555c0 0x558042a60870 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.605+0000 7f0109cb9740 1 --2- 172.21.15.17:0/3548607722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558042a54c80 0x558042a60330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.605+0000 7f0109cb9740 1 -- 172.21.15.17:0/3548607722 >> 172.21.15.17:0/3548607722 conn(0x558042a502f0 msgr2=0x558042a5e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.605+0000 7f00e6000640 0 client.25418 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:58:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.605+0000 7f0109cb9740 1 -- 172.21.15.17:0/3548607722 shutdown_connections 2024-09-13T15:58:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.605+0000 7f0109cb9740 1 -- 172.21.15.17:0/3548607722 wait complete. 2024-09-13T15:58:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.608+0000 7f0109cb9740 20 client.25418 trim_cache size 0 max 16384 2024-09-13T15:58:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T15:58:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T15:58:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T15:58:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T15:58:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.608+0000 7f0106e00640 1 -- 172.21.15.17:0/673298769 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f00e80a1190 msgr2=0x7f00e80a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.608+0000 7f0106e00640 1 --2- 172.21.15.17:0/673298769 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f00e80a1190 0x7f00e80a3650 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f00f4005860 tx=0x7f00f4005e60 comp rx=0 tx=0).stop 2024-09-13T15:58:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.608+0000 7f0106e00640 1 -- 172.21.15.17:0/673298769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00f80951f0 msgr2=0x7f00f81391c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.608+0000 7f0106e00640 1 --2- 172.21.15.17:0/673298769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00f80951f0 0x7f00f81391c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f01000660d0 tx=0x7f0100069700 comp rx=0 tx=0).stop 2024-09-13T15:58:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.609+0000 7f0106e00640 1 -- 172.21.15.17:0/673298769 shutdown_connections 2024-09-13T15:58:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.609+0000 7f0106e00640 1 --2- 172.21.15.17:0/673298769 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f00e80a1190 0x7f00e80a3650 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.609+0000 7f0106e00640 1 --2- 172.21.15.17:0/673298769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00f80951f0 0x7f00f81391c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.609+0000 7f0106e00640 1 --2- 172.21.15.17:0/673298769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00f8094850 0x7f00f8132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.609+0000 7f0106e00640 1 --2- 172.21.15.17:0/673298769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00f8093f10 0x7f00f8131c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.609+0000 7f0106e00640 1 -- 172.21.15.17:0/673298769 >> 172.21.15.17:0/673298769 conn(0x7f00f808fc80 msgr2=0x7f00f8091800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.609+0000 7f0106e00640 1 -- 172.21.15.17:0/673298769 shutdown_connections 2024-09-13T15:58:05.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:05.609+0000 7f0106e00640 1 -- 172.21.15.17:0/673298769 wait complete. 2024-09-13T15:58:06.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:06 smithi189 ceph-mon[34790]: pgmap v396: 129 pgs: 129 active+clean; 931 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.7 MiB/s wr, 672 op/s 2024-09-13T15:58:06.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:06 smithi193 ceph-mon[35248]: pgmap v396: 129 pgs: 129 active+clean; 931 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.7 MiB/s wr, 672 op/s 2024-09-13T15:58:06.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:06 smithi017 ceph-mon[30494]: pgmap v396: 129 pgs: 129 active+clean; 931 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.7 MiB/s wr, 672 op/s 2024-09-13T15:58:08.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:08 smithi189 ceph-mon[34790]: pgmap v397: 129 pgs: 129 active+clean; 937 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 625 op/s 2024-09-13T15:58:08.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:08 smithi193 ceph-mon[35248]: pgmap v397: 129 pgs: 129 active+clean; 937 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 625 op/s 2024-09-13T15:58:08.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:08 smithi017 ceph-mon[30494]: pgmap v397: 129 pgs: 129 active+clean; 937 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 625 op/s 2024-09-13T15:58:10.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 25.0 s, 1736.4 tps, lat 57.624 ms stddev 84.078 2024-09-13T15:58:10.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:10 smithi189 ceph-mon[34790]: pgmap v398: 129 pgs: 129 active+clean; 963 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 14 MiB/s wr, 792 op/s 2024-09-13T15:58:10.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:10 smithi193 ceph-mon[35248]: pgmap v398: 129 pgs: 129 active+clean; 963 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 14 MiB/s wr, 792 op/s 2024-09-13T15:58:10.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:10 smithi017 ceph-mon[30494]: pgmap v398: 129 pgs: 129 active+clean; 963 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 14 MiB/s wr, 792 op/s 2024-09-13T15:58:12.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:12 smithi189 ceph-mon[34790]: pgmap v399: 129 pgs: 129 active+clean; 992 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 783 op/s 2024-09-13T15:58:12.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:12 smithi193 ceph-mon[35248]: pgmap v399: 129 pgs: 129 active+clean; 992 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 783 op/s 2024-09-13T15:58:12.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:12 smithi017 ceph-mon[30494]: pgmap v399: 129 pgs: 129 active+clean; 992 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 783 op/s 2024-09-13T15:58:14.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:14 smithi189 ceph-mon[34790]: pgmap v400: 129 pgs: 129 active+clean; 989 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 809 op/s 2024-09-13T15:58:14.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:14 smithi193 ceph-mon[35248]: pgmap v400: 129 pgs: 129 active+clean; 989 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 809 op/s 2024-09-13T15:58:14.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:14 smithi017 ceph-mon[30494]: pgmap v400: 129 pgs: 129 active+clean; 989 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 809 op/s 2024-09-13T15:58:15.319 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 30.0 s, 2378.6 tps, lat 42.403 ms stddev 48.650 2024-09-13T15:58:16.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:16 smithi017 ceph-mon[30494]: pgmap v401: 129 pgs: 129 active+clean; 973 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 800 op/s 2024-09-13T15:58:16.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:16 smithi189 ceph-mon[34790]: pgmap v401: 129 pgs: 129 active+clean; 973 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 800 op/s 2024-09-13T15:58:16.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:16 smithi193 ceph-mon[35248]: pgmap v401: 129 pgs: 129 active+clean; 973 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 800 op/s 2024-09-13T15:58:18.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:18 smithi189 ceph-mon[34790]: pgmap v402: 129 pgs: 129 active+clean; 957 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 776 op/s 2024-09-13T15:58:18.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:18 smithi193 ceph-mon[35248]: pgmap v402: 129 pgs: 129 active+clean; 957 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 776 op/s 2024-09-13T15:58:18.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:18 smithi017 ceph-mon[30494]: pgmap v402: 129 pgs: 129 active+clean; 957 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 776 op/s 2024-09-13T15:58:18.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.789+0000 7f8343e00640 1 -- 172.21.15.17:0/3336040358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83440fed70 msgr2=0x7f83440ff1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:18.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.789+0000 7f8343e00640 1 --2- 172.21.15.17:0/3336040358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83440fed70 0x7f83440ff1d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8330009900 tx=0x7f833002a420 comp rx=0 tx=0).stop 2024-09-13T15:58:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.790+0000 7f8343e00640 1 -- 172.21.15.17:0/3336040358 shutdown_connections 2024-09-13T15:58:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.790+0000 7f8343e00640 1 --2- 172.21.15.17:0/3336040358 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83440ff710 0x7f83440ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.790+0000 7f8343e00640 1 --2- 172.21.15.17:0/3336040358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83440fed70 0x7f83440ff1d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.790+0000 7f8343e00640 1 --2- 172.21.15.17:0/3336040358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83440fe430 0x7f83440fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.790+0000 7f8343e00640 1 -- 172.21.15.17:0/3336040358 >> 172.21.15.17:0/3336040358 conn(0x7f83440fa1c0 msgr2=0x7f83440fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.790+0000 7f8343e00640 1 -- 172.21.15.17:0/3336040358 shutdown_connections 2024-09-13T15:58:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.790+0000 7f8343e00640 1 -- 172.21.15.17:0/3336040358 wait complete. 2024-09-13T15:58:18.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.792+0000 7f8343e00640 1 Processor -- start 2024-09-13T15:58:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.792+0000 7f8343e00640 1 -- start start 2024-09-13T15:58:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.792+0000 7f8343e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83440fe430 0x7f8344197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.792+0000 7f8343e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83440fed70 0x7f8344198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.792+0000 7f8343e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83440ff710 0x7f834419f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.792+0000 7f8343e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834419f9d0 con 0x7f83440fed70 2024-09-13T15:58:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.793+0000 7f8343e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8344069f00 con 0x7f83440ff710 2024-09-13T15:58:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.793+0000 7f8343e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834406a0c0 con 0x7f83440fe430 2024-09-13T15:58:18.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.793+0000 7f8343400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83440ff710 0x7f834419f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:18.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.793+0000 7f8343400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83440ff710 0x7f834419f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:52780/0 (socket says 172.21.15.17:52780) 2024-09-13T15:58:18.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.793+0000 7f8343400640 1 -- 172.21.15.17:0/2208884635 learned_addr learned my addr 172.21.15.17:0/2208884635 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.793+0000 7f8342a00640 1 --2- 172.21.15.17:0/2208884635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83440fe430 0x7f8344197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.794+0000 7f8342000640 1 --2- 172.21.15.17:0/2208884635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83440fed70 0x7f8344198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.794+0000 7f8343400640 1 -- 172.21.15.17:0/2208884635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83440fe430 msgr2=0x7f8344197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.794+0000 7f8343400640 1 --2- 172.21.15.17:0/2208884635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83440fe430 0x7f8344197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.794+0000 7f8343400640 1 -- 172.21.15.17:0/2208884635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83440fed70 msgr2=0x7f8344198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.794+0000 7f8343400640 1 --2- 172.21.15.17:0/2208884635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83440fed70 0x7f8344198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.794+0000 7f8343400640 1 -- 172.21.15.17:0/2208884635 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8330009560 con 0x7f83440ff710 2024-09-13T15:58:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.794+0000 7f8342000640 1 --2- 172.21.15.17:0/2208884635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83440fed70 0x7f8344198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:58:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.795+0000 7f8343400640 1 --2- 172.21.15.17:0/2208884635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83440ff710 0x7f834419f490 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f833c00eaa0 tx=0x7f833c00ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.795+0000 7f833b400640 1 -- 172.21.15.17:0/2208884635 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c00cdb0 con 0x7f83440ff710 2024-09-13T15:58:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.795+0000 7f8343e00640 1 -- 172.21.15.17:0/2208884635 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834406a3a0 con 0x7f83440ff710 2024-09-13T15:58:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.795+0000 7f833b400640 1 -- 172.21.15.17:0/2208884635 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f833c005020 con 0x7f83440ff710 2024-09-13T15:58:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.795+0000 7f833b400640 1 -- 172.21.15.17:0/2208884635 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c0116b0 con 0x7f83440ff710 2024-09-13T15:58:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.795+0000 7f8343e00640 1 -- 172.21.15.17:0/2208884635 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f834406a930 con 0x7f83440ff710 2024-09-13T15:58:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.801+0000 7f833b400640 1 -- 172.21.15.17:0/2208884635 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f833c005450 con 0x7f83440ff710 2024-09-13T15:58:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.801+0000 7f834c7eb740 1 Processor -- start 2024-09-13T15:58:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.802+0000 7f834c7eb740 1 -- start start 2024-09-13T15:58:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.802+0000 7f834c7eb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557420890490 0x557420890890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.802+0000 7f834c7eb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420890dd0 0x557420895890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.802+0000 7f834c7eb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557420895e60 0x557420898320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.802+0000 7f834c7eb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557420793bb0 con 0x557420895e60 2024-09-13T15:58:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.802+0000 7f833b400640 1 --2- 172.21.15.17:0/2208884635 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f83280a11b0 0x7f83280a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.802+0000 7f834c7eb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574207f1a70 con 0x557420890dd0 2024-09-13T15:58:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.802+0000 7f834c7eb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574207ef200 con 0x557420890490 2024-09-13T15:58:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.802+0000 7f833b400640 1 -- 172.21.15.17:0/2208884635 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f833c0cc460 con 0x7f83440ff710 2024-09-13T15:58:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.802+0000 7f8342a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420890dd0 0x557420895890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.803+0000 7f8342a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420890dd0 0x557420895890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:52792/0 (socket says 172.21.15.17:52792) 2024-09-13T15:58:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.803+0000 7f8342a00640 1 -- 172.21.15.17:0/1154539143 learned_addr learned my addr 172.21.15.17:0/1154539143 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.803+0000 7f8342a00640 1 -- 172.21.15.17:0/1154539143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557420890490 msgr2=0x557420890890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.803+0000 7f8342a00640 1 --2- 172.21.15.17:0/1154539143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557420890490 0x557420890890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.803+0000 7f8342a00640 1 -- 172.21.15.17:0/1154539143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557420895e60 msgr2=0x557420898320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.803+0000 7f8342a00640 1 --2- 172.21.15.17:0/1154539143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557420895e60 0x557420898320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.803+0000 7f8342a00640 1 -- 172.21.15.17:0/1154539143 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55742078c940 con 0x557420890dd0 2024-09-13T15:58:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.803+0000 7f8343400640 1 --2- 172.21.15.17:0/2208884635 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f83280a11b0 0x7f83280a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.803+0000 7f8342a00640 1 --2- 172.21.15.17:0/1154539143 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420890dd0 0x557420895890 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f833400b820 tx=0x7f833400bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42a5e43c27bff84e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.804+0000 7f832fe00640 1 -- 172.21.15.17:0/1154539143 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833400d950 con 0x557420890dd0 2024-09-13T15:58:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.804+0000 7f832fe00640 1 -- 172.21.15.17:0/1154539143 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f833400b460 con 0x557420890dd0 2024-09-13T15:58:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.804+0000 7f832fe00640 1 -- 172.21.15.17:0/1154539143 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83340123e0 con 0x557420890dd0 2024-09-13T15:58:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.805+0000 7f834c7eb740 1 -- 172.21.15.17:0/1154539143 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420890dd0 msgr2=0x557420895890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.805+0000 7f834c7eb740 1 --2- 172.21.15.17:0/1154539143 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420890dd0 0x557420895890 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f833400b820 tx=0x7f833400bce0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.805+0000 7f8343400640 1 --2- 172.21.15.17:0/2208884635 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f83280a11b0 0x7f83280a3670 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f833c005800 tx=0x7f833c005750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.805+0000 7f834c7eb740 1 -- 172.21.15.17:0/1154539143 shutdown_connections 2024-09-13T15:58:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.805+0000 7f834c7eb740 1 --2- 172.21.15.17:0/1154539143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557420895e60 0x557420898320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.805+0000 7f834c7eb740 1 --2- 172.21.15.17:0/1154539143 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420890dd0 0x557420895890 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.805+0000 7f834c7eb740 1 --2- 172.21.15.17:0/1154539143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557420890490 0x557420890890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.805+0000 7f834c7eb740 1 -- 172.21.15.17:0/1154539143 >> 172.21.15.17:0/1154539143 conn(0x5574208832f0 msgr2=0x5574208836f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.806+0000 7f834c7eb740 1 -- 172.21.15.17:0/1154539143 shutdown_connections 2024-09-13T15:58:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.806+0000 7f834c7eb740 1 -- 172.21.15.17:0/1154539143 wait complete. 2024-09-13T15:58:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.807+0000 7f834c7eb740 1 -- start start 2024-09-13T15:58:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.807+0000 7f834c7eb740 1 Processor -- start 2024-09-13T15:58:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.808+0000 7f834c7eb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557420890490 0x5574208890c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.808+0000 7f834c7eb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557420890dd0 0x557420889600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.809+0000 7f834c7eb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420895e60 0x55742088e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.809+0000 7f834c7eb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574207eaaf0 con 0x557420890dd0 2024-09-13T15:58:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.809+0000 7f834c7eb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574207a8f20 con 0x557420895e60 2024-09-13T15:58:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.809+0000 7f834c7eb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574207a8bc0 con 0x557420890490 2024-09-13T15:58:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.809+0000 7f834c7eb740 10 client.0 _ll_register_callbacks cb 0x5574207daa70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:58:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.809+0000 7f8342000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557420890490 0x5574208890c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.809+0000 7f8342000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557420890490 0x5574208890c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:45290/0 (socket says 172.21.15.17:45290) 2024-09-13T15:58:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.809+0000 7f8342000640 1 -- 172.21.15.17:0/3338946302 learned_addr learned my addr 172.21.15.17:0/3338946302 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.809+0000 7f8342a00640 1 --2- 172.21.15.17:0/3338946302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557420890dd0 0x557420889600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.810+0000 7f8342000640 1 --2- 172.21.15.17:0/3338946302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420895e60 0x55742088e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.810+0000 7f8342a00640 1 -- 172.21.15.17:0/3338946302 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557420890490 msgr2=0x5574208890c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.810+0000 7f8342a00640 1 --2- 172.21.15.17:0/3338946302 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557420890490 0x5574208890c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.810+0000 7f8342a00640 1 -- 172.21.15.17:0/3338946302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420895e60 msgr2=0x55742088e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.811+0000 7f8342a00640 1 --2- 172.21.15.17:0/3338946302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420895e60 0x55742088e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.811+0000 7f8342a00640 1 -- 172.21.15.17:0/3338946302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833400e040 con 0x557420890dd0 2024-09-13T15:58:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.811+0000 7f8342000640 1 --2- 172.21.15.17:0/3338946302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420895e60 0x55742088e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:58:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.811+0000 7f8342a00640 1 --2- 172.21.15.17:0/3338946302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557420890dd0 0x557420889600 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f833400b7f0 tx=0x7f833400d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2535ad51396fadc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.811+0000 7f832cc00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T15:58:18.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.812+0000 7f832cc00640 1 -- 172.21.15.17:0/3338946302 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833400dd50 con 0x557420890dd0 2024-09-13T15:58:18.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.812+0000 7f832cc00640 1 -- 172.21.15.17:0/3338946302 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f833401d420 con 0x557420890dd0 2024-09-13T15:58:18.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.812+0000 7f834c7eb740 1 -- 172.21.15.17:0/3338946302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5574207dd7d0 con 0x557420890dd0 2024-09-13T15:58:18.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.813+0000 7f832cc00640 1 -- 172.21.15.17:0/3338946302 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f833400deb0 con 0x557420890dd0 2024-09-13T15:58:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.813+0000 7f834c7eb740 10 client.15375 fetch_fsmap learned FSMap version 28 2024-09-13T15:58:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.813+0000 7f834c7eb740 1 -- 172.21.15.17:0/3338946302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5574207e9170 con 0x557420890dd0 2024-09-13T15:58:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.814+0000 7f832cc00640 1 -- 172.21.15.17:0/3338946302 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5574207dd7d0 con 0x557420890dd0 2024-09-13T15:58:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.814+0000 7f832cc00640 1 -- 172.21.15.17:0/3338946302 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f833401c7e0 con 0x557420890dd0 2024-09-13T15:58:18.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.814+0000 7f834c7eb740 10 client.15375 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T15:58:18.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.814+0000 7f834c7eb740 10 client.15375 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T15:58:18.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.814+0000 7f834c7eb740 20 client.15375 populate_metadata read hostname 'smithi017' 2024-09-13T15:58:18.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.814+0000 7f834c7eb740 1 --2- 172.21.15.17:0/3338946302 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5574208ae440 0x5574208b0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:18.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.814+0000 7f834c7eb740 4 client.15375 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:58:18.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.814+0000 7f834c7eb740 1 -- 172.21.15.17:0/3338946302 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5574204de300 con 0x5574208ae440 2024-09-13T15:58:18.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.816+0000 7f8342000640 1 --2- 172.21.15.17:0/3338946302 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5574208ae440 0x5574208b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:18.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.816+0000 7f8342000640 1 --2- 172.21.15.17:0/3338946302 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5574208ae440 0x5574208b0860 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f18d79d4b840bed5 server_cookie=660011ca05213343 in_seq=0 out_seq=0 2024-09-13T15:58:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.816+0000 7f832cc00640 10 client.15375 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:58:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.817+0000 7f832cc00640 1 -- 172.21.15.17:0/3338946302 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5574204de300 con 0x5574208ae440 2024-09-13T15:58:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.817+0000 7f832cc00640 10 client.15375 handle_command_reply: tid=0 2024-09-13T15:58:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.817+0000 7f834c7eb740 1 client.15375 shutdown 2024-09-13T15:58:18.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.818+0000 7f834c7eb740 1 -- 172.21.15.17:0/3338946302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557420890dd0 msgr2=0x557420889600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:18.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.818+0000 7f834c7eb740 1 --2- 172.21.15.17:0/3338946302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557420890dd0 0x557420889600 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f833400b7f0 tx=0x7f833400d950 comp rx=0 tx=0).stop 2024-09-13T15:58:18.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.818+0000 7f834c7eb740 1 -- 172.21.15.17:0/3338946302 shutdown_connections 2024-09-13T15:58:18.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.818+0000 7f834c7eb740 1 --2- 172.21.15.17:0/3338946302 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5574208ae440 0x5574208b0860 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.819+0000 7f834c7eb740 1 --2- 172.21.15.17:0/3338946302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420895e60 0x55742088e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.819+0000 7f834c7eb740 1 --2- 172.21.15.17:0/3338946302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557420890dd0 0x557420889600 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.819+0000 7f834c7eb740 1 --2- 172.21.15.17:0/3338946302 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557420890490 0x5574208890c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.819+0000 7f832cc00640 0 client.15375 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:58:18.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.819+0000 7f834c7eb740 1 -- 172.21.15.17:0/3338946302 >> 172.21.15.17:0/3338946302 conn(0x5574208832f0 msgr2=0x557420884b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:18.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.819+0000 7f834c7eb740 1 -- 172.21.15.17:0/3338946302 shutdown_connections 2024-09-13T15:58:18.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.820+0000 7f834c7eb740 1 -- 172.21.15.17:0/3338946302 wait complete. 2024-09-13T15:58:18.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.820+0000 7f834c7eb740 20 client.15375 trim_cache size 0 max 16384 2024-09-13T15:58:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.857+0000 7f834c7eb740 1 Processor -- start 2024-09-13T15:58:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.857+0000 7f834c7eb740 1 -- start start 2024-09-13T15:58:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.857+0000 7f834c7eb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420890490 0x5574208be700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.857+0000 7f834c7eb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557420890dd0 0x5574208bec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.858+0000 7f8342000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420890490 0x5574208be700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.858+0000 7f8342000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420890490 0x5574208be700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:52808/0 (socket says 172.21.15.17:52808) 2024-09-13T15:58:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.858+0000 7f834c7eb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557420895e60 0x5574208890c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.858+0000 7f834c7eb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557420551e60 con 0x557420890dd0 2024-09-13T15:58:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.858+0000 7f834c7eb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x557420888c00 con 0x557420890490 2024-09-13T15:58:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.858+0000 7f834c7eb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574208adf90 con 0x557420895e60 2024-09-13T15:58:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.858+0000 7f8342a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557420890dd0 0x5574208bec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.858+0000 7f8342000640 1 -- 172.21.15.17:0/579352741 learned_addr learned my addr 172.21.15.17:0/579352741 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.859+0000 7f8342000640 1 -- 172.21.15.17:0/579352741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557420895e60 msgr2=0x5574208890c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.859+0000 7f8342000640 1 --2- 172.21.15.17:0/579352741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557420895e60 0x5574208890c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.859+0000 7f8342000640 1 -- 172.21.15.17:0/579352741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557420890dd0 msgr2=0x5574208bec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.859+0000 7f8342000640 1 --2- 172.21.15.17:0/579352741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557420890dd0 0x5574208bec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.859+0000 7f8342000640 1 -- 172.21.15.17:0/579352741 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55742078b180 con 0x557420890490 2024-09-13T15:58:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.860+0000 7f8342000640 1 --2- 172.21.15.17:0/579352741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420890490 0x5574208be700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f833002a460 tx=0x7f8330005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=184ab87741fed39d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.860+0000 7f8338c00640 1 -- 172.21.15.17:0/579352741 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8330044d70 con 0x557420890490 2024-09-13T15:58:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.860+0000 7f8338c00640 1 -- 172.21.15.17:0/579352741 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8330043040 con 0x557420890490 2024-09-13T15:58:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.860+0000 7f8338c00640 1 -- 172.21.15.17:0/579352741 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8330031a40 con 0x557420890490 2024-09-13T15:58:18.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.862+0000 7f834c7eb740 1 -- 172.21.15.17:0/579352741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420890490 msgr2=0x5574208be700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:18.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.862+0000 7f834c7eb740 1 --2- 172.21.15.17:0/579352741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420890490 0x5574208be700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f833002a460 tx=0x7f8330005fd0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.863+0000 7f834c7eb740 1 -- 172.21.15.17:0/579352741 shutdown_connections 2024-09-13T15:58:18.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.863+0000 7f834c7eb740 1 --2- 172.21.15.17:0/579352741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557420895e60 0x5574208890c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.863+0000 7f834c7eb740 1 --2- 172.21.15.17:0/579352741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557420890dd0 0x5574208bec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.863+0000 7f834c7eb740 1 --2- 172.21.15.17:0/579352741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420890490 0x5574208be700 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.863+0000 7f834c7eb740 1 -- 172.21.15.17:0/579352741 >> 172.21.15.17:0/579352741 conn(0x5574208832f0 msgr2=0x5574208b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.863+0000 7f834c7eb740 1 -- 172.21.15.17:0/579352741 shutdown_connections 2024-09-13T15:58:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.863+0000 7f834c7eb740 1 -- 172.21.15.17:0/579352741 wait complete. 2024-09-13T15:58:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.864+0000 7f834c7eb740 1 -- start start 2024-09-13T15:58:18.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.864+0000 7f834c7eb740 1 Processor -- start 2024-09-13T15:58:18.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.865+0000 7f834c7eb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420890490 0x5574208be500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:18.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.865+0000 7f834c7eb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557420890dd0 0x5574208bea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:18.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.865+0000 7f834c7eb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557420895e60 0x5574208bcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:18.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.865+0000 7f834c7eb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574208bd120 con 0x557420890dd0 2024-09-13T15:58:18.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.865+0000 7f834c7eb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574208bd290 con 0x557420890490 2024-09-13T15:58:18.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.865+0000 7f834c7eb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574208bd450 con 0x557420895e60 2024-09-13T15:58:18.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.865+0000 7f834c7eb740 10 client.0 _ll_register_callbacks cb 0x7f833400b240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:58:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.866+0000 7f8342000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420890490 0x5574208be500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.866+0000 7f8342000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420890490 0x5574208be500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:52814/0 (socket says 172.21.15.17:52814) 2024-09-13T15:58:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.866+0000 7f8342000640 1 -- 172.21.15.17:0/3348403771 learned_addr learned my addr 172.21.15.17:0/3348403771 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.866+0000 7f8342000640 1 --2- 172.21.15.17:0/3348403771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557420895e60 0x5574208bcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.867+0000 7f8342a00640 1 --2- 172.21.15.17:0/3348403771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557420890dd0 0x5574208bea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.868+0000 7f8342a00640 1 -- 172.21.15.17:0/3348403771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557420895e60 msgr2=0x5574208bcb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.868+0000 7f8342a00640 1 --2- 172.21.15.17:0/3348403771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557420895e60 0x5574208bcb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.868+0000 7f8342a00640 1 -- 172.21.15.17:0/3348403771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420890490 msgr2=0x5574208be500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.868+0000 7f8342a00640 1 --2- 172.21.15.17:0/3348403771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420890490 0x5574208be500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.868+0000 7f8342a00640 1 -- 172.21.15.17:0/3348403771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f834410abc0 con 0x557420890dd0 2024-09-13T15:58:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.868+0000 7f8342000640 1 --2- 172.21.15.17:0/3348403771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557420895e60 0x5574208bcb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:58:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.869+0000 7f8342a00640 1 --2- 172.21.15.17:0/3348403771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557420890dd0 0x5574208bea40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f833400b820 tx=0x7f833400df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4638ad474ef06 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.869+0000 7f832cc00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T15:58:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.869+0000 7f832cc00640 1 -- 172.21.15.17:0/3348403771 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8334014980 con 0x557420890dd0 2024-09-13T15:58:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.870+0000 7f832cc00640 1 -- 172.21.15.17:0/3348403771 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f8334014ae0 con 0x557420890dd0 2024-09-13T15:58:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.870+0000 7f834c7eb740 1 -- 172.21.15.17:0/3348403771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557420814c90 con 0x557420890dd0 2024-09-13T15:58:18.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.870+0000 7f832cc00640 1 -- 172.21.15.17:0/3348403771 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8334004040 con 0x557420890dd0 2024-09-13T15:58:18.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.870+0000 7f834c7eb740 10 client.15381 fetch_fsmap learned FSMap version 28 2024-09-13T15:58:18.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.870+0000 7f834c7eb740 1 -- 172.21.15.17:0/3348403771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5574207b0560 con 0x557420890dd0 2024-09-13T15:58:18.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.871+0000 7f832cc00640 1 -- 172.21.15.17:0/3348403771 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f833401c380 con 0x557420890dd0 2024-09-13T15:58:18.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.871+0000 7f832cc00640 1 -- 172.21.15.17:0/3348403771 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f83340036b0 con 0x557420890dd0 2024-09-13T15:58:18.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.871+0000 7f834c7eb740 10 client.15381 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T15:58:18.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.872+0000 7f834c7eb740 10 client.15381 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T15:58:18.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.872+0000 7f834c7eb740 20 client.15381 populate_metadata read hostname 'smithi017' 2024-09-13T15:58:18.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.872+0000 7f834c7eb740 1 --2- 172.21.15.17:0/3348403771 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557420906390 0x557420908780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:18.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.872+0000 7f834c7eb740 4 client.15381 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T15:58:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.872+0000 7f834c7eb740 1 -- 172.21.15.17:0/3348403771 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557420814c90 con 0x557420906390 2024-09-13T15:58:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.872+0000 7f8342000640 1 --2- 172.21.15.17:0/3348403771 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557420906390 0x557420908780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.873+0000 7f832cc00640 10 client.15381 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:58:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.873+0000 7f8342000640 1 --2- 172.21.15.17:0/3348403771 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557420906390 0x557420908780 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2585abaa3f7c46ed server_cookie=384667874b5500b1 in_seq=0 out_seq=0 2024-09-13T15:58:18.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.887+0000 7f832cc00640 1 -- 172.21.15.17:0/3348403771 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557420814c90 con 0x557420906390 2024-09-13T15:58:18.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.887+0000 7f832cc00640 10 client.15381 handle_command_reply: tid=0 2024-09-13T15:58:18.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.887+0000 7f834c7eb740 1 client.15381 shutdown 2024-09-13T15:58:18.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.888+0000 7f834c7eb740 1 -- 172.21.15.17:0/3348403771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557420890dd0 msgr2=0x5574208bea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:18.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.888+0000 7f834c7eb740 1 --2- 172.21.15.17:0/3348403771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557420890dd0 0x5574208bea40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f833400b820 tx=0x7f833400df80 comp rx=0 tx=0).stop 2024-09-13T15:58:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.889+0000 7f834c7eb740 1 -- 172.21.15.17:0/3348403771 shutdown_connections 2024-09-13T15:58:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.889+0000 7f834c7eb740 1 --2- 172.21.15.17:0/3348403771 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557420906390 0x557420908780 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.889+0000 7f834c7eb740 1 --2- 172.21.15.17:0/3348403771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557420895e60 0x5574208bcb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.889+0000 7f832cc00640 0 client.15381 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:58:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.889+0000 7f834c7eb740 1 --2- 172.21.15.17:0/3348403771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557420890dd0 0x5574208bea40 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.889+0000 7f834c7eb740 1 --2- 172.21.15.17:0/3348403771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557420890490 0x5574208be500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.889+0000 7f834c7eb740 1 -- 172.21.15.17:0/3348403771 >> 172.21.15.17:0/3348403771 conn(0x5574208832f0 msgr2=0x557420889060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.889+0000 7f834c7eb740 1 -- 172.21.15.17:0/3348403771 shutdown_connections 2024-09-13T15:58:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.889+0000 7f834c7eb740 1 -- 172.21.15.17:0/3348403771 wait complete. 2024-09-13T15:58:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.889+0000 7f834c7eb740 20 client.15381 trim_cache size 0 max 16384 2024-09-13T15:58:18.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T15:58:18.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T15:58:18.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T15:58:18.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T15:58:18.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.890+0000 7f8343e00640 1 -- 172.21.15.17:0/2208884635 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f83280a11b0 msgr2=0x7f83280a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:18.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.890+0000 7f8343e00640 1 --2- 172.21.15.17:0/2208884635 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f83280a11b0 0x7f83280a3670 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f833c005800 tx=0x7f833c005750 comp rx=0 tx=0).stop 2024-09-13T15:58:18.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.890+0000 7f8343e00640 1 -- 172.21.15.17:0/2208884635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83440ff710 msgr2=0x7f834419f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:18.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.890+0000 7f8343e00640 1 --2- 172.21.15.17:0/2208884635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83440ff710 0x7f834419f490 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f833c00eaa0 tx=0x7f833c00ef60 comp rx=0 tx=0).stop 2024-09-13T15:58:18.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.890+0000 7f8343e00640 1 -- 172.21.15.17:0/2208884635 shutdown_connections 2024-09-13T15:58:18.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.890+0000 7f8343e00640 1 --2- 172.21.15.17:0/2208884635 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f83280a11b0 0x7f83280a3670 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.890+0000 7f8343e00640 1 --2- 172.21.15.17:0/2208884635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f83440ff710 0x7f834419f490 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.890+0000 7f8343e00640 1 --2- 172.21.15.17:0/2208884635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83440fed70 0x7f8344198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.890+0000 7f8343e00640 1 --2- 172.21.15.17:0/2208884635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83440fe430 0x7f8344197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:18.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.890+0000 7f8343e00640 1 -- 172.21.15.17:0/2208884635 >> 172.21.15.17:0/2208884635 conn(0x7f83440fa1c0 msgr2=0x7f83440fbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:18.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.890+0000 7f8343e00640 1 -- 172.21.15.17:0/2208884635 shutdown_connections 2024-09-13T15:58:18.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:18.890+0000 7f8343e00640 1 -- 172.21.15.17:0/2208884635 wait complete. 2024-09-13T15:58:20.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 35.0 s, 2209.8 tps, lat 45.058 ms stddev 53.072 2024-09-13T15:58:20.565 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:20 smithi017 ceph-mon[30494]: pgmap v403: 129 pgs: 129 active+clean; 958 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 868 op/s 2024-09-13T15:58:20.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:20 smithi189 ceph-mon[34790]: pgmap v403: 129 pgs: 129 active+clean; 958 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 868 op/s 2024-09-13T15:58:20.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:20 smithi193 ceph-mon[35248]: pgmap v403: 129 pgs: 129 active+clean; 958 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 868 op/s 2024-09-13T15:58:22.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:22 smithi189 ceph-mon[34790]: pgmap v404: 129 pgs: 129 active+clean; 960 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 723 op/s 2024-09-13T15:58:22.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:22 smithi193 ceph-mon[35248]: pgmap v404: 129 pgs: 129 active+clean; 960 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 723 op/s 2024-09-13T15:58:22.776 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:22 smithi017 ceph-mon[30494]: pgmap v404: 129 pgs: 129 active+clean; 960 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 723 op/s 2024-09-13T15:58:24.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:24 smithi189 ceph-mon[34790]: pgmap v405: 129 pgs: 129 active+clean; 960 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 755 op/s 2024-09-13T15:58:24.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:24 smithi193 ceph-mon[35248]: pgmap v405: 129 pgs: 129 active+clean; 960 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 755 op/s 2024-09-13T15:58:24.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:24 smithi017 ceph-mon[30494]: pgmap v405: 129 pgs: 129 active+clean; 960 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 755 op/s 2024-09-13T15:58:25.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 40.0 s, 1924.6 tps, lat 51.951 ms stddev 93.237 2024-09-13T15:58:26.556 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:26 smithi193 ceph-mon[35248]: pgmap v406: 129 pgs: 129 active+clean; 961 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 838 op/s 2024-09-13T15:58:26.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:26 smithi189 ceph-mon[34790]: pgmap v406: 129 pgs: 129 active+clean; 961 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 838 op/s 2024-09-13T15:58:26.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:26 smithi017 ceph-mon[30494]: pgmap v406: 129 pgs: 129 active+clean; 961 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 838 op/s 2024-09-13T15:58:28.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:28 smithi189 ceph-mon[34790]: pgmap v407: 129 pgs: 129 active+clean; 961 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 865 op/s 2024-09-13T15:58:28.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:28 smithi193 ceph-mon[35248]: pgmap v407: 129 pgs: 129 active+clean; 961 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 865 op/s 2024-09-13T15:58:28.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:28 smithi017 ceph-mon[30494]: pgmap v407: 129 pgs: 129 active+clean; 961 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 865 op/s 2024-09-13T15:58:30.315 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 45.0 s, 2385.6 tps, lat 41.973 ms stddev 54.215 2024-09-13T15:58:30.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:30 smithi189 ceph-mon[34790]: pgmap v408: 129 pgs: 129 active+clean; 969 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 915 op/s 2024-09-13T15:58:30.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:30 smithi193 ceph-mon[35248]: pgmap v408: 129 pgs: 129 active+clean; 969 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 915 op/s 2024-09-13T15:58:30.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:30 smithi017 ceph-mon[30494]: pgmap v408: 129 pgs: 129 active+clean; 969 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 915 op/s 2024-09-13T15:58:32.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.093+0000 7efc34400640 1 -- 172.21.15.17:0/1266336801 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc2c100f00 msgr2=0x7efc2c101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:32.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.093+0000 7efc34400640 1 --2- 172.21.15.17:0/1266336801 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc2c100f00 0x7efc2c101380 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efc1800fb60 tx=0x7efc1802e4b0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.095+0000 7efc34400640 1 -- 172.21.15.17:0/1266336801 shutdown_connections 2024-09-13T15:58:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.095+0000 7efc34400640 1 --2- 172.21.15.17:0/1266336801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc2c1018c0 0x7efc2c108150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.095+0000 7efc34400640 1 --2- 172.21.15.17:0/1266336801 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc2c100f00 0x7efc2c101380 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.096+0000 7efc34400640 1 --2- 172.21.15.17:0/1266336801 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc2c0ffd10 0x7efc2c100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.096+0000 7efc34400640 1 -- 172.21.15.17:0/1266336801 >> 172.21.15.17:0/1266336801 conn(0x7efc2c0fb4b0 msgr2=0x7efc2c0fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.097+0000 7efc34400640 1 -- 172.21.15.17:0/1266336801 shutdown_connections 2024-09-13T15:58:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.097+0000 7efc34400640 1 -- 172.21.15.17:0/1266336801 wait complete. 2024-09-13T15:58:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.098+0000 7efc34400640 1 Processor -- start 2024-09-13T15:58:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.099+0000 7efc34400640 1 -- start start 2024-09-13T15:58:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.100+0000 7efc34400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc2c0ffd10 0x7efc2c19c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.100+0000 7efc34400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc2c100f00 0x7efc2c19c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.100+0000 7efc34400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc2c1018c0 0x7efc2c1a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.100+0000 7efc34400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c1a3e00 con 0x7efc2c1018c0 2024-09-13T15:58:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.100+0000 7efc34400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c1a3f70 con 0x7efc2c100f00 2024-09-13T15:58:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.100+0000 7efc34400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c1a4130 con 0x7efc2c0ffd10 2024-09-13T15:58:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.100+0000 7efc31000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc2c100f00 0x7efc2c19c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:32.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.101+0000 7efc31000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc2c100f00 0x7efc2c19c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:34906/0 (socket says 172.21.15.17:34906) 2024-09-13T15:58:32.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.101+0000 7efc31000640 1 -- 172.21.15.17:0/4280795507 learned_addr learned my addr 172.21.15.17:0/4280795507 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:32.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.101+0000 7efc31000640 1 -- 172.21.15.17:0/4280795507 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc2c0ffd10 msgr2=0x7efc2c19c310 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T15:58:32.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.101+0000 7efc31000640 1 --2- 172.21.15.17:0/4280795507 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc2c0ffd10 0x7efc2c19c310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.101+0000 7efc31000640 1 -- 172.21.15.17:0/4280795507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc2c1018c0 msgr2=0x7efc2c1a38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:32.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.101+0000 7efc31000640 1 --2- 172.21.15.17:0/4280795507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc2c1018c0 0x7efc2c1a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.101+0000 7efc31000640 1 -- 172.21.15.17:0/4280795507 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1800f790 con 0x7efc2c100f00 2024-09-13T15:58:32.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.101+0000 7efc31000640 1 --2- 172.21.15.17:0/4280795507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc2c100f00 0x7efc2c19c850 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efc180346d0 tx=0x7efc180345d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:32.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.102+0000 7efc2a000640 1 -- 172.21.15.17:0/4280795507 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc18004520 con 0x7efc2c100f00 2024-09-13T15:58:32.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.102+0000 7efc2a000640 1 -- 172.21.15.17:0/4280795507 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc18003ab0 con 0x7efc2c100f00 2024-09-13T15:58:32.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.102+0000 7efc2a000640 1 -- 172.21.15.17:0/4280795507 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc18035c70 con 0x7efc2c100f00 2024-09-13T15:58:32.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.103+0000 7efc34400640 1 -- 172.21.15.17:0/4280795507 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2c1a43b0 con 0x7efc2c100f00 2024-09-13T15:58:32.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.104+0000 7efc34400640 1 -- 172.21.15.17:0/4280795507 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2c1a47e0 con 0x7efc2c100f00 2024-09-13T15:58:32.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.110+0000 7efc2a000640 1 -- 172.21.15.17:0/4280795507 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7efc18003c20 con 0x7efc2c100f00 2024-09-13T15:58:32.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.111+0000 7efc372b0740 1 Processor -- start 2024-09-13T15:58:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.112+0000 7efc372b0740 1 -- start start 2024-09-13T15:58:32.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.113+0000 7efc2a000640 1 --2- 172.21.15.17:0/4280795507 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efc140a1190 0x7efc140a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:32.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.113+0000 7efc2a000640 1 -- 172.21.15.17:0/4280795507 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7efc180eda20 con 0x7efc2c100f00 2024-09-13T15:58:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.113+0000 7efc32400640 1 --2- 172.21.15.17:0/4280795507 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efc140a1190 0x7efc140a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.115+0000 7efc32400640 1 --2- 172.21.15.17:0/4280795507 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efc140a1190 0x7efc140a3650 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efc24005fd0 tx=0x7efc24005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.115+0000 7efc372b0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c7a70 0x55b8a80c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.115+0000 7efc372b0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c83b0 0x55b8a80cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.115+0000 7efc372b0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 0x55b8a80cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.115+0000 7efc372b0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a7fd3bb0 con 0x55b8a80cd440 2024-09-13T15:58:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.115+0000 7efc372b0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a8031a70 con 0x55b8a80c83b0 2024-09-13T15:58:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.115+0000 7efc372b0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a802f200 con 0x55b8a80c7a70 2024-09-13T15:58:32.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.116+0000 7efc31000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c83b0 0x55b8a80cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:32.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.116+0000 7efc31a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c7a70 0x55b8a80c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:32.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.116+0000 7efc31a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c7a70 0x55b8a80c7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:60828/0 (socket says 172.21.15.17:60828) 2024-09-13T15:58:32.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.116+0000 7efc31a00640 1 -- 172.21.15.17:0/2651087088 learned_addr learned my addr 172.21.15.17:0/2651087088 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:32.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.116+0000 7efc31000640 1 -- 172.21.15.17:0/2651087088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c7a70 msgr2=0x55b8a80c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:32.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.116+0000 7efc31000640 1 --2- 172.21.15.17:0/2651087088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c7a70 0x55b8a80c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.116+0000 7efc31000640 1 -- 172.21.15.17:0/2651087088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 msgr2=0x55b8a80cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:32.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.116+0000 7efc31000640 1 --2- 172.21.15.17:0/2651087088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 0x55b8a80cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.116+0000 7efc31000640 1 -- 172.21.15.17:0/2651087088 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8a7fcc940 con 0x55b8a80c83b0 2024-09-13T15:58:32.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.116+0000 7efc31a00640 1 --2- 172.21.15.17:0/2651087088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c7a70 0x55b8a80c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:58:32.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.117+0000 7efc31000640 1 --2- 172.21.15.17:0/2651087088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c83b0 0x55b8a80cce70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efc180eb170 tx=0x7efc180bb310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a5fef1e1719d227 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:32.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.117+0000 7efc1ea00640 1 -- 172.21.15.17:0/2651087088 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc180c2f40 con 0x55b8a80c83b0 2024-09-13T15:58:32.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.118+0000 7efc1ea00640 1 -- 172.21.15.17:0/2651087088 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc180eb280 con 0x55b8a80c83b0 2024-09-13T15:58:32.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.118+0000 7efc1ea00640 1 -- 172.21.15.17:0/2651087088 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc180bb010 con 0x55b8a80c83b0 2024-09-13T15:58:32.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.119+0000 7efc372b0740 1 -- 172.21.15.17:0/2651087088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c83b0 msgr2=0x55b8a80cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:32.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.119+0000 7efc372b0740 1 --2- 172.21.15.17:0/2651087088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c83b0 0x55b8a80cce70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efc180eb170 tx=0x7efc180bb310 comp rx=0 tx=0).stop 2024-09-13T15:58:32.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.120+0000 7efc372b0740 1 -- 172.21.15.17:0/2651087088 shutdown_connections 2024-09-13T15:58:32.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.120+0000 7efc372b0740 1 --2- 172.21.15.17:0/2651087088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 0x55b8a80cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.120+0000 7efc372b0740 1 --2- 172.21.15.17:0/2651087088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c83b0 0x55b8a80cce70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.120+0000 7efc372b0740 1 --2- 172.21.15.17:0/2651087088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c7a70 0x55b8a80c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.120+0000 7efc372b0740 1 -- 172.21.15.17:0/2651087088 >> 172.21.15.17:0/2651087088 conn(0x55b8a80c30e0 msgr2=0x55b8a80c34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:32.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.121+0000 7efc372b0740 1 -- 172.21.15.17:0/2651087088 shutdown_connections 2024-09-13T15:58:32.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.121+0000 7efc372b0740 1 -- 172.21.15.17:0/2651087088 wait complete. 2024-09-13T15:58:32.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.121+0000 7efc372b0740 1 -- start start 2024-09-13T15:58:32.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.125+0000 7efc372b0740 1 Processor -- start 2024-09-13T15:58:32.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.127+0000 7efc372b0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c7a70 0x55b8a80d1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:32.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.127+0000 7efc372b0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c83b0 0x55b8a80d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:32.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.127+0000 7efc372b0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 0x55b8a80d8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:32.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.127+0000 7efc372b0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a802aaf0 con 0x55b8a80cd440 2024-09-13T15:58:32.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.127+0000 7efc372b0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a7fe8f20 con 0x55b8a80c7a70 2024-09-13T15:58:32.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.127+0000 7efc372b0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a7fe8bc0 con 0x55b8a80c83b0 2024-09-13T15:58:32.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.128+0000 7efc372b0740 10 client.0 _ll_register_callbacks cb 0x55b8a801aa70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:58:32.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.128+0000 7efc31a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c7a70 0x55b8a80d1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:32.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.128+0000 7efc31a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c7a70 0x55b8a80d1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:34922/0 (socket says 172.21.15.17:34922) 2024-09-13T15:58:32.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.128+0000 7efc31a00640 1 -- 172.21.15.17:0/3686924270 learned_addr learned my addr 172.21.15.17:0/3686924270 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:32.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.130+0000 7efc32400640 1 --2- 172.21.15.17:0/3686924270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 0x55b8a80d8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:32.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.131+0000 7efc31000640 1 --2- 172.21.15.17:0/3686924270 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c83b0 0x55b8a80d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:32.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.131+0000 7efc31a00640 1 -- 172.21.15.17:0/3686924270 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c83b0 msgr2=0x55b8a80d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:32.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.131+0000 7efc31a00640 1 --2- 172.21.15.17:0/3686924270 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c83b0 0x55b8a80d1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.132+0000 7efc31a00640 1 -- 172.21.15.17:0/3686924270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 msgr2=0x55b8a80d8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:32.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.132+0000 7efc31a00640 1 --2- 172.21.15.17:0/3686924270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 0x55b8a80d8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.132+0000 7efc31a00640 1 -- 172.21.15.17:0/3686924270 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2c1a47e0 con 0x55b8a80c7a70 2024-09-13T15:58:32.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.132+0000 7efc31000640 1 --2- 172.21.15.17:0/3686924270 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c83b0 0x55b8a80d1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:58:32.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.133+0000 7efc13400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T15:58:32.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.133+0000 7efc31a00640 1 --2- 172.21.15.17:0/3686924270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c7a70 0x55b8a80d1590 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efc20010650 tx=0x7efc20010b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c09ac1c6dde7ecee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:32.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.133+0000 7efc32400640 1 --2- 172.21.15.17:0/3686924270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 0x55b8a80d8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:58:32.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.134+0000 7efc13400640 1 -- 172.21.15.17:0/3686924270 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc200096b0 con 0x55b8a80c7a70 2024-09-13T15:58:32.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.134+0000 7efc13400640 1 -- 172.21.15.17:0/3686924270 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7efc20010e50 con 0x55b8a80c7a70 2024-09-13T15:58:32.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.134+0000 7efc372b0740 1 -- 172.21.15.17:0/3686924270 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b8a8054c90 con 0x55b8a80c7a70 2024-09-13T15:58:32.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.135+0000 7efc13400640 1 -- 172.21.15.17:0/3686924270 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc2000eb30 con 0x55b8a80c7a70 2024-09-13T15:58:32.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.138+0000 7efc372b0740 10 client.25445 fetch_fsmap learned FSMap version 28 2024-09-13T15:58:32.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.138+0000 7efc372b0740 1 -- 172.21.15.17:0/3686924270 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55b8a8029170 con 0x55b8a80c7a70 2024-09-13T15:58:32.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.139+0000 7efc13400640 1 -- 172.21.15.17:0/3686924270 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b8a8054c90 con 0x55b8a80c7a70 2024-09-13T15:58:32.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.139+0000 7efc13400640 1 -- 172.21.15.17:0/3686924270 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7efc20019030 con 0x55b8a80c7a70 2024-09-13T15:58:32.140 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.139+0000 7efc372b0740 10 client.25445 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T15:58:32.140 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.139+0000 7efc372b0740 10 client.25445 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T15:58:32.141 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.139+0000 7efc372b0740 20 client.25445 populate_metadata read hostname 'smithi017' 2024-09-13T15:58:32.141 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.139+0000 7efc372b0740 1 --2- 172.21.15.17:0/3686924270 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55b8a80ee2a0 0x55b8a80f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:32.141 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.139+0000 7efc372b0740 4 client.25445 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:58:32.141 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.139+0000 7efc372b0740 1 -- 172.21.15.17:0/3686924270 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b8a801d7d0 con 0x55b8a80ee2a0 2024-09-13T15:58:32.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.143+0000 7efc31000640 1 --2- 172.21.15.17:0/3686924270 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55b8a80ee2a0 0x55b8a80f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:32.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.144+0000 7efc31000640 1 --2- 172.21.15.17:0/3686924270 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55b8a80ee2a0 0x55b8a80f06c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=697d38bf923e1a4e server_cookie=1e5687000c18a86b in_seq=0 out_seq=0 2024-09-13T15:58:32.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.144+0000 7efc13400640 10 client.25445 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:58:32.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.145+0000 7efc13400640 1 -- 172.21.15.17:0/3686924270 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b8a801d7d0 con 0x55b8a80ee2a0 2024-09-13T15:58:32.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.145+0000 7efc13400640 10 client.25445 handle_command_reply: tid=0 2024-09-13T15:58:32.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.145+0000 7efc372b0740 1 client.25445 shutdown 2024-09-13T15:58:32.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.147+0000 7efc372b0740 1 -- 172.21.15.17:0/3686924270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c7a70 msgr2=0x55b8a80d1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:32.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.147+0000 7efc372b0740 1 --2- 172.21.15.17:0/3686924270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c7a70 0x55b8a80d1590 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efc20010650 tx=0x7efc20010b10 comp rx=0 tx=0).stop 2024-09-13T15:58:32.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.147+0000 7efc372b0740 1 -- 172.21.15.17:0/3686924270 shutdown_connections 2024-09-13T15:58:32.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.147+0000 7efc372b0740 1 --2- 172.21.15.17:0/3686924270 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55b8a80ee2a0 0x55b8a80f06c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.147+0000 7efc372b0740 1 --2- 172.21.15.17:0/3686924270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 0x55b8a80d8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.147+0000 7efc372b0740 1 --2- 172.21.15.17:0/3686924270 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c83b0 0x55b8a80d1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.147+0000 7efc372b0740 1 --2- 172.21.15.17:0/3686924270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c7a70 0x55b8a80d1590 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.147+0000 7efc372b0740 1 -- 172.21.15.17:0/3686924270 >> 172.21.15.17:0/3686924270 conn(0x55b8a80c30e0 msgr2=0x55b8a80c48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:32.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.147+0000 7efc13400640 0 client.25445 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:58:32.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.148+0000 7efc372b0740 1 -- 172.21.15.17:0/3686924270 shutdown_connections 2024-09-13T15:58:32.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.149+0000 7efc372b0740 1 -- 172.21.15.17:0/3686924270 wait complete. 2024-09-13T15:58:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.151+0000 7efc372b0740 20 client.25445 trim_cache size 0 max 16384 2024-09-13T15:58:32.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.182+0000 7efc372b0740 1 Processor -- start 2024-09-13T15:58:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.182+0000 7efc372b0740 1 -- start start 2024-09-13T15:58:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.182+0000 7efc372b0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c7a70 0x55b8a80f4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.182+0000 7efc372b0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c83b0 0x55b8a80d8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.182+0000 7efc372b0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 0x55b8a80c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.183+0000 7efc31a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c7a70 0x55b8a80f4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.183+0000 7efc31a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c7a70 0x55b8a80f4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:34928/0 (socket says 172.21.15.17:34928) 2024-09-13T15:58:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.183+0000 7efc31a00640 1 -- 172.21.15.17:0/1305579537 learned_addr learned my addr 172.21.15.17:0/1305579537 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.183+0000 7efc31000640 1 --2- 172.21.15.17:0/1305579537 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c83b0 0x55b8a80d8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.183+0000 7efc372b0740 1 -- 172.21.15.17:0/1305579537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a7d91e60 con 0x55b8a80cd440 2024-09-13T15:58:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.183+0000 7efc372b0740 1 -- 172.21.15.17:0/1305579537 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a80c8890 con 0x55b8a80c7a70 2024-09-13T15:58:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.183+0000 7efc372b0740 1 -- 172.21.15.17:0/1305579537 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a80d01d0 con 0x55b8a80c83b0 2024-09-13T15:58:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.184+0000 7efc32400640 1 --2- 172.21.15.17:0/1305579537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 0x55b8a80c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.185+0000 7efc32400640 1 -- 172.21.15.17:0/1305579537 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c83b0 msgr2=0x55b8a80d8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.185+0000 7efc32400640 1 --2- 172.21.15.17:0/1305579537 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c83b0 0x55b8a80d8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.185+0000 7efc32400640 1 -- 172.21.15.17:0/1305579537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c7a70 msgr2=0x55b8a80f4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.185+0000 7efc32400640 1 --2- 172.21.15.17:0/1305579537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c7a70 0x55b8a80f4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.185+0000 7efc32400640 1 -- 172.21.15.17:0/1305579537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8a7fcb180 con 0x55b8a80cd440 2024-09-13T15:58:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.186+0000 7efc32400640 1 --2- 172.21.15.17:0/1305579537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 0x55b8a80c93b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7efc2400c760 tx=0x7efc24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774f40b20b058c14 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.186+0000 7efc1f400640 1 -- 172.21.15.17:0/1305579537 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2401c610 con 0x55b8a80cd440 2024-09-13T15:58:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.186+0000 7efc1f400640 1 -- 172.21.15.17:0/1305579537 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc2400fe60 con 0x55b8a80cd440 2024-09-13T15:58:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.187+0000 7efc1f400640 1 -- 172.21.15.17:0/1305579537 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2400eb30 con 0x55b8a80cd440 2024-09-13T15:58:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.188+0000 7efc372b0740 1 -- 172.21.15.17:0/1305579537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 msgr2=0x55b8a80c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.188+0000 7efc372b0740 1 --2- 172.21.15.17:0/1305579537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 0x55b8a80c93b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7efc2400c760 tx=0x7efc24004a40 comp rx=0 tx=0).stop 2024-09-13T15:58:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.189+0000 7efc372b0740 1 -- 172.21.15.17:0/1305579537 shutdown_connections 2024-09-13T15:58:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.189+0000 7efc372b0740 1 --2- 172.21.15.17:0/1305579537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 0x55b8a80c93b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.189+0000 7efc372b0740 1 --2- 172.21.15.17:0/1305579537 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c83b0 0x55b8a80d8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.189+0000 7efc372b0740 1 --2- 172.21.15.17:0/1305579537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c7a70 0x55b8a80f4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.189+0000 7efc372b0740 1 -- 172.21.15.17:0/1305579537 >> 172.21.15.17:0/1305579537 conn(0x55b8a80c30e0 msgr2=0x55b8a80cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.189+0000 7efc372b0740 1 -- 172.21.15.17:0/1305579537 shutdown_connections 2024-09-13T15:58:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.189+0000 7efc372b0740 1 -- 172.21.15.17:0/1305579537 wait complete. 2024-09-13T15:58:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.190+0000 7efc372b0740 1 -- start start 2024-09-13T15:58:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.191+0000 7efc372b0740 1 Processor -- start 2024-09-13T15:58:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.192+0000 7efc372b0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c7a70 0x55b8a80d48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.192+0000 7efc372b0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c83b0 0x55b8a80d4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.192+0000 7efc372b0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 0x55b8a80d7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:32.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.193+0000 7efc31000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c83b0 0x55b8a80d4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:32.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.193+0000 7efc31000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c83b0 0x55b8a80d4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:34936/0 (socket says 172.21.15.17:34936) 2024-09-13T15:58:32.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.193+0000 7efc32400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 0x55b8a80d7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:32.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.193+0000 7efc32400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 0x55b8a80d7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33372/0 (socket says 172.21.15.17:33372) 2024-09-13T15:58:32.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.193+0000 7efc31a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c7a70 0x55b8a80d48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:32.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.193+0000 7efc31a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c7a70 0x55b8a80d48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:60844/0 (socket says 172.21.15.17:60844) 2024-09-13T15:58:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.193+0000 7efc31a00640 1 -- 172.21.15.17:0/1993081068 learned_addr learned my addr 172.21.15.17:0/1993081068 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.193+0000 7efc372b0740 1 -- 172.21.15.17:0/1993081068 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a80d82c0 con 0x55b8a80cd440 2024-09-13T15:58:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.193+0000 7efc372b0740 1 -- 172.21.15.17:0/1993081068 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a80d8430 con 0x55b8a80c83b0 2024-09-13T15:58:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.193+0000 7efc372b0740 1 -- 172.21.15.17:0/1993081068 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a80d85f0 con 0x55b8a80c7a70 2024-09-13T15:58:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.194+0000 7efc372b0740 10 client.0 _ll_register_callbacks cb 0x7efc180b6f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:58:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.195+0000 7efc31a00640 1 -- 172.21.15.17:0/1993081068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c83b0 msgr2=0x55b8a80d4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.195+0000 7efc31a00640 1 --2- 172.21.15.17:0/1993081068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c83b0 0x55b8a80d4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.195+0000 7efc31a00640 1 -- 172.21.15.17:0/1993081068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 msgr2=0x55b8a80d7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.195+0000 7efc31a00640 1 --2- 172.21.15.17:0/1993081068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 0x55b8a80d7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.195+0000 7efc31a00640 1 -- 172.21.15.17:0/1993081068 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2400cc40 con 0x55b8a80c7a70 2024-09-13T15:58:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.195+0000 7efc31000640 1 --2- 172.21.15.17:0/1993081068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c83b0 0x55b8a80d4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:58:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.196+0000 7efc32400640 1 --2- 172.21.15.17:0/1993081068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 0x55b8a80d7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:58:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.196+0000 7efc31a00640 1 --2- 172.21.15.17:0/1993081068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c7a70 0x55b8a80d48c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55b8a8054dd0 tx=0x7efc20005920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5268d803790c1b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.196+0000 7efc13400640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T15:58:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.197+0000 7efc13400640 1 -- 172.21.15.17:0/1993081068 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2001bb60 con 0x55b8a80c7a70 2024-09-13T15:58:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.197+0000 7efc372b0740 1 -- 172.21.15.17:0/1993081068 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efc180eb280 con 0x55b8a80c7a70 2024-09-13T15:58:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.198+0000 7efc13400640 1 -- 172.21.15.17:0/1993081068 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7efc20000e40 con 0x55b8a80c7a70 2024-09-13T15:58:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.198+0000 7efc13400640 1 -- 172.21.15.17:0/1993081068 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc200092d0 con 0x55b8a80c7a70 2024-09-13T15:58:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.198+0000 7efc372b0740 10 client.25468 fetch_fsmap learned FSMap version 28 2024-09-13T15:58:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.199+0000 7efc372b0740 1 -- 172.21.15.17:0/1993081068 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55b8a7ff0560 con 0x55b8a80c7a70 2024-09-13T15:58:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.199+0000 7efc13400640 1 -- 172.21.15.17:0/1993081068 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc180eb280 con 0x55b8a80c7a70 2024-09-13T15:58:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.200+0000 7efc13400640 1 -- 172.21.15.17:0/1993081068 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7efc20019040 con 0x55b8a80c7a70 2024-09-13T15:58:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.200+0000 7efc372b0740 10 client.25468 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T15:58:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.200+0000 7efc372b0740 10 client.25468 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T15:58:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.200+0000 7efc372b0740 20 client.25468 populate_metadata read hostname 'smithi017' 2024-09-13T15:58:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.201+0000 7efc372b0740 1 --2- 172.21.15.17:0/1993081068 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55b8a8145710 0x55b8a8147b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.201+0000 7efc372b0740 4 client.25468 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T15:58:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.201+0000 7efc372b0740 1 -- 172.21.15.17:0/1993081068 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b8a7d1e300 con 0x55b8a8145710 2024-09-13T15:58:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.201+0000 7efc31000640 1 --2- 172.21.15.17:0/1993081068 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55b8a8145710 0x55b8a8147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.202+0000 7efc13400640 10 client.25468 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:58:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.202+0000 7efc31000640 1 --2- 172.21.15.17:0/1993081068 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55b8a8145710 0x55b8a8147b30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efce9620088d8d5e server_cookie=52b089c3bd887a13 in_seq=0 out_seq=0 2024-09-13T15:58:32.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.255+0000 7efc13400640 1 -- 172.21.15.17:0/1993081068 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b8a7d1e300 con 0x55b8a8145710 2024-09-13T15:58:32.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.255+0000 7efc13400640 10 client.25468 handle_command_reply: tid=0 2024-09-13T15:58:32.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.256+0000 7efc372b0740 1 client.25468 shutdown 2024-09-13T15:58:32.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.257+0000 7efc372b0740 1 -- 172.21.15.17:0/1993081068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c7a70 msgr2=0x55b8a80d48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:32.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.257+0000 7efc372b0740 1 --2- 172.21.15.17:0/1993081068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c7a70 0x55b8a80d48c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55b8a8054dd0 tx=0x7efc20005920 comp rx=0 tx=0).stop 2024-09-13T15:58:32.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.257+0000 7efc372b0740 1 -- 172.21.15.17:0/1993081068 shutdown_connections 2024-09-13T15:58:32.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.258+0000 7efc372b0740 1 --2- 172.21.15.17:0/1993081068 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55b8a8145710 0x55b8a8147b30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.258+0000 7efc372b0740 1 --2- 172.21.15.17:0/1993081068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a80cd440 0x55b8a80d7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.258+0000 7efc372b0740 1 --2- 172.21.15.17:0/1993081068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8a80c83b0 0x55b8a80d4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.258+0000 7efc372b0740 1 --2- 172.21.15.17:0/1993081068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b8a80c7a70 0x55b8a80d48c0 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55b8a8054dd0 tx=0x7efc20005920 comp rx=0 tx=0).stop 2024-09-13T15:58:32.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.258+0000 7efc372b0740 1 -- 172.21.15.17:0/1993081068 >> 172.21.15.17:0/1993081068 conn(0x55b8a80c30e0 msgr2=0x55b8a80cc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:32.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.258+0000 7efc13400640 0 client.25468 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:58:32.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.258+0000 7efc372b0740 1 -- 172.21.15.17:0/1993081068 shutdown_connections 2024-09-13T15:58:32.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.258+0000 7efc372b0740 1 -- 172.21.15.17:0/1993081068 wait complete. 2024-09-13T15:58:32.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.259+0000 7efc372b0740 20 client.25468 trim_cache size 0 max 16384 2024-09-13T15:58:32.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T15:58:32.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T15:58:32.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T15:58:32.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T15:58:32.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.260+0000 7efc34400640 1 -- 172.21.15.17:0/4280795507 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efc140a1190 msgr2=0x7efc140a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:32.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.260+0000 7efc34400640 1 --2- 172.21.15.17:0/4280795507 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efc140a1190 0x7efc140a3650 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efc24005fd0 tx=0x7efc24005f60 comp rx=0 tx=0).stop 2024-09-13T15:58:32.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.260+0000 7efc34400640 1 -- 172.21.15.17:0/4280795507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc2c100f00 msgr2=0x7efc2c19c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:32.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.260+0000 7efc34400640 1 --2- 172.21.15.17:0/4280795507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc2c100f00 0x7efc2c19c850 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efc180346d0 tx=0x7efc180345d0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.260+0000 7efc34400640 1 -- 172.21.15.17:0/4280795507 shutdown_connections 2024-09-13T15:58:32.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.260+0000 7efc34400640 1 --2- 172.21.15.17:0/4280795507 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efc140a1190 0x7efc140a3650 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.260+0000 7efc34400640 1 --2- 172.21.15.17:0/4280795507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc2c1018c0 0x7efc2c1a38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.260+0000 7efc34400640 1 --2- 172.21.15.17:0/4280795507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc2c100f00 0x7efc2c19c850 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.260+0000 7efc34400640 1 --2- 172.21.15.17:0/4280795507 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc2c0ffd10 0x7efc2c19c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:32.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.260+0000 7efc34400640 1 -- 172.21.15.17:0/4280795507 >> 172.21.15.17:0/4280795507 conn(0x7efc2c0fb4b0 msgr2=0x7efc2c1043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:32.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.261+0000 7efc34400640 1 -- 172.21.15.17:0/4280795507 shutdown_connections 2024-09-13T15:58:32.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:32.261+0000 7efc34400640 1 -- 172.21.15.17:0/4280795507 wait complete. 2024-09-13T15:58:32.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:32 smithi189 ceph-mon[34790]: pgmap v409: 129 pgs: 129 active+clean; 974 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 839 op/s 2024-09-13T15:58:32.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:32 smithi193 ceph-mon[35248]: pgmap v409: 129 pgs: 129 active+clean; 974 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 839 op/s 2024-09-13T15:58:32.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:32 smithi017 ceph-mon[30494]: pgmap v409: 129 pgs: 129 active+clean; 974 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 839 op/s 2024-09-13T15:58:34.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:34 smithi189 ceph-mon[34790]: pgmap v410: 129 pgs: 129 active+clean; 978 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 978 op/s 2024-09-13T15:58:34.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:34 smithi193 ceph-mon[35248]: pgmap v410: 129 pgs: 129 active+clean; 978 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 978 op/s 2024-09-13T15:58:34.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:34 smithi017 ceph-mon[30494]: pgmap v410: 129 pgs: 129 active+clean; 978 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 978 op/s 2024-09-13T15:58:35.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 50.0 s, 2929.2 tps, lat 33.725 ms stddev 39.126 2024-09-13T15:58:36.266 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:35 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:58:36.268 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:35 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:58:36.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:35 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:58:37.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:37 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:58:37.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:37 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:58:37.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:37 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:58:37.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:37 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:58:37.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:37 smithi193 ceph-mon[35248]: pgmap v411: 129 pgs: 129 active+clean; 978 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 13 MiB/s wr, 906 op/s 2024-09-13T15:58:37.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:37 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:58:37.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:37 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:58:37.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:37 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:58:37.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:37 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:58:37.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:37 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:58:37.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:37 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:58:37.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:37 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:58:37.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:37 smithi017 ceph-mon[30494]: pgmap v411: 129 pgs: 129 active+clean; 978 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 13 MiB/s wr, 906 op/s 2024-09-13T15:58:37.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:37 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:58:37.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:37 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:58:37.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:37 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:58:37.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:37 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:58:37.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:37 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:58:37.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:37 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:58:37.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:37 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:58:37.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:37 smithi189 ceph-mon[34790]: pgmap v411: 129 pgs: 129 active+clean; 978 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 13 MiB/s wr, 906 op/s 2024-09-13T15:58:37.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:37 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:58:37.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:37 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:58:37.607 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:37 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:58:38.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:38 smithi189 ceph-mon[34790]: pgmap v412: 129 pgs: 129 active+clean; 978 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.4 MiB/s wr, 726 op/s 2024-09-13T15:58:38.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:38 smithi193 ceph-mon[35248]: pgmap v412: 129 pgs: 129 active+clean; 978 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.4 MiB/s wr, 726 op/s 2024-09-13T15:58:38.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:38 smithi017 ceph-mon[30494]: pgmap v412: 129 pgs: 129 active+clean; 978 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.4 MiB/s wr, 726 op/s 2024-09-13T15:58:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 55.0 s, 1507.6 tps, lat 65.604 ms stddev 87.880 2024-09-13T15:58:40.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:40 smithi189 ceph-mon[34790]: pgmap v413: 129 pgs: 129 active+clean; 979 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 8.0 MiB/s wr, 721 op/s 2024-09-13T15:58:40.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:40 smithi193 ceph-mon[35248]: pgmap v413: 129 pgs: 129 active+clean; 979 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 8.0 MiB/s wr, 721 op/s 2024-09-13T15:58:40.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:40 smithi017 ceph-mon[30494]: pgmap v413: 129 pgs: 129 active+clean; 979 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 8.0 MiB/s wr, 721 op/s 2024-09-13T15:58:42.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:42 smithi189 ceph-mon[34790]: pgmap v414: 129 pgs: 129 active+clean; 982 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 8.4 MiB/s wr, 754 op/s 2024-09-13T15:58:42.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:42 smithi193 ceph-mon[35248]: pgmap v414: 129 pgs: 129 active+clean; 982 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 8.4 MiB/s wr, 754 op/s 2024-09-13T15:58:42.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:42 smithi017 ceph-mon[30494]: pgmap v414: 129 pgs: 129 active+clean; 982 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 8.4 MiB/s wr, 754 op/s 2024-09-13T15:58:44.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:44 smithi189 ceph-mon[34790]: pgmap v415: 129 pgs: 129 active+clean; 982 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 9.9 MiB/s wr, 837 op/s 2024-09-13T15:58:44.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:44 smithi193 ceph-mon[35248]: pgmap v415: 129 pgs: 129 active+clean; 982 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 9.9 MiB/s wr, 837 op/s 2024-09-13T15:58:44.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:44 smithi017 ceph-mon[30494]: pgmap v415: 129 pgs: 129 active+clean; 982 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 9.9 MiB/s wr, 837 op/s 2024-09-13T15:58:45.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 60.0 s, 1670.0 tps, lat 61.200 ms stddev 89.976 2024-09-13T15:58:45.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.461+0000 7f1824000640 1 -- 172.21.15.17:0/3575910012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f181c1018c0 msgr2=0x7f181c108150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:45.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.461+0000 7f1824000640 1 --2- 172.21.15.17:0/3575910012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f181c1018c0 0x7f181c108150 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1814009be0 tx=0x7f181402a6c0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.461+0000 7f1824000640 1 -- 172.21.15.17:0/3575910012 shutdown_connections 2024-09-13T15:58:45.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.461+0000 7f1824000640 1 --2- 172.21.15.17:0/3575910012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f181c1018c0 0x7f181c108150 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.461+0000 7f1824000640 1 --2- 172.21.15.17:0/3575910012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f181c100f00 0x7f181c101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.461+0000 7f1824000640 1 --2- 172.21.15.17:0/3575910012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f181c0ffd10 0x7f181c100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.461+0000 7f1824000640 1 -- 172.21.15.17:0/3575910012 >> 172.21.15.17:0/3575910012 conn(0x7f181c0fb4b0 msgr2=0x7f181c0fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.462+0000 7f1824000640 1 -- 172.21.15.17:0/3575910012 shutdown_connections 2024-09-13T15:58:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.462+0000 7f1824000640 1 -- 172.21.15.17:0/3575910012 wait complete. 2024-09-13T15:58:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.463+0000 7f1824000640 1 Processor -- start 2024-09-13T15:58:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.463+0000 7f1824000640 1 -- start start 2024-09-13T15:58:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.463+0000 7f1824000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f181c0ffd10 0x7f181c1980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.463+0000 7f1824000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f181c100f00 0x7f181c198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.464+0000 7f1824000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f181c1018c0 0x7f181c19f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.464+0000 7f1824000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c19fb60 con 0x7f181c100f00 2024-09-13T15:58:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.464+0000 7f1824000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c19fcd0 con 0x7f181c1018c0 2024-09-13T15:58:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.464+0000 7f1824000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c19fe90 con 0x7f181c0ffd10 2024-09-13T15:58:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.464+0000 7f1822000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f181c1018c0 0x7f181c19f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.464+0000 7f1822000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f181c1018c0 0x7f181c19f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:44714/0 (socket says 172.21.15.17:44714) 2024-09-13T15:58:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.464+0000 7f1822000640 1 -- 172.21.15.17:0/722087786 learned_addr learned my addr 172.21.15.17:0/722087786 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.464+0000 7f1821600640 1 --2- 172.21.15.17:0/722087786 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f181c0ffd10 0x7f181c1980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.464+0000 7f1820c00640 1 --2- 172.21.15.17:0/722087786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f181c100f00 0x7f181c198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.465+0000 7f1822000640 1 -- 172.21.15.17:0/722087786 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f181c0ffd10 msgr2=0x7f181c1980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.465+0000 7f1822000640 1 --2- 172.21.15.17:0/722087786 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f181c0ffd10 0x7f181c1980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.465+0000 7f1822000640 1 -- 172.21.15.17:0/722087786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f181c100f00 msgr2=0x7f181c198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.465+0000 7f1822000640 1 --2- 172.21.15.17:0/722087786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f181c100f00 0x7f181c198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.465+0000 7f1822000640 1 -- 172.21.15.17:0/722087786 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1814009840 con 0x7f181c1018c0 2024-09-13T15:58:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.467+0000 7f1822000640 1 --2- 172.21.15.17:0/722087786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f181c1018c0 0x7f181c19f620 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1814034040 tx=0x7f1814030ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.467+0000 7f181a000640 1 -- 172.21.15.17:0/722087786 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1814003e60 con 0x7f181c1018c0 2024-09-13T15:58:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.468+0000 7f181a000640 1 -- 172.21.15.17:0/722087786 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1814004500 con 0x7f181c1018c0 2024-09-13T15:58:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.468+0000 7f181a000640 1 -- 172.21.15.17:0/722087786 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1814031ba0 con 0x7f181c1018c0 2024-09-13T15:58:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.468+0000 7f1824000640 1 -- 172.21.15.17:0/722087786 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181c1a0110 con 0x7f181c1018c0 2024-09-13T15:58:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.468+0000 7f1824000640 1 -- 172.21.15.17:0/722087786 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181c1a05f0 con 0x7f181c1018c0 2024-09-13T15:58:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.472+0000 7f1826fda740 1 Processor -- start 2024-09-13T15:58:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.473+0000 7f181a000640 1 -- 172.21.15.17:0/722087786 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1814038070 con 0x7f181c1018c0 2024-09-13T15:58:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.473+0000 7f1826fda740 1 -- start start 2024-09-13T15:58:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.473+0000 7f1826fda740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c10a70 0x55a3b8c10e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.474+0000 7f1826fda740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c113b0 0x55a3b8c15e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.474+0000 7f1826fda740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3b8c16440 0x55a3b8c18900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.474+0000 7f1826fda740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8b1cbb0 con 0x55a3b8c113b0 2024-09-13T15:58:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.474+0000 7f1826fda740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8b7aa70 con 0x55a3b8c16440 2024-09-13T15:58:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.474+0000 7f1826fda740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8b78200 con 0x55a3b8c10a70 2024-09-13T15:58:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.474+0000 7f1821600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c113b0 0x55a3b8c15e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.474+0000 7f1821600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c113b0 0x55a3b8c15e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38656/0 (socket says 172.21.15.17:38656) 2024-09-13T15:58:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.474+0000 7f1821600640 1 -- 172.21.15.17:0/2154698622 learned_addr learned my addr 172.21.15.17:0/2154698622 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.474+0000 7f1820c00640 1 --2- 172.21.15.17:0/2154698622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3b8c16440 0x55a3b8c18900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.475+0000 7f1820c00640 1 --2- 172.21.15.17:0/2154698622 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c10a70 0x55a3b8c10e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.476+0000 7f1820c00640 1 -- 172.21.15.17:0/2154698622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3b8c16440 msgr2=0x55a3b8c18900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.476+0000 7f1820c00640 1 --2- 172.21.15.17:0/2154698622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3b8c16440 0x55a3b8c18900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.476+0000 7f1820c00640 1 -- 172.21.15.17:0/2154698622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c113b0 msgr2=0x55a3b8c15e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.476+0000 7f181a000640 1 --2- 172.21.15.17:0/722087786 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f18040a1160 0x7f18040a3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.477+0000 7f1820c00640 1 --2- 172.21.15.17:0/2154698622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c113b0 0x55a3b8c15e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.477+0000 7f1820c00640 1 -- 172.21.15.17:0/2154698622 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3b8b15940 con 0x55a3b8c10a70 2024-09-13T15:58:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.477+0000 7f1821600640 1 --2- 172.21.15.17:0/2154698622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c113b0 0x55a3b8c15e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:58:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.477+0000 7f181a000640 1 -- 172.21.15.17:0/722087786 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f18140ed130 con 0x7f181c1018c0 2024-09-13T15:58:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.478+0000 7f1820c00640 1 --2- 172.21.15.17:0/2154698622 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c10a70 0x55a3b8c10e70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1808005ab0 tx=0x7f1808009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1009ec39b6e3ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.479+0000 7f180ea00640 1 -- 172.21.15.17:0/2154698622 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18080120d0 con 0x55a3b8c10a70 2024-09-13T15:58:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.479+0000 7f1820c00640 1 --2- 172.21.15.17:0/722087786 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f18040a1160 0x7f18040a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.479+0000 7f180ea00640 1 -- 172.21.15.17:0/2154698622 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1808012230 con 0x55a3b8c10a70 2024-09-13T15:58:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.479+0000 7f180ea00640 1 -- 172.21.15.17:0/2154698622 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808010a90 con 0x55a3b8c10a70 2024-09-13T15:58:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.480+0000 7f1826fda740 1 -- 172.21.15.17:0/2154698622 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c10a70 msgr2=0x55a3b8c10e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.480+0000 7f1826fda740 1 --2- 172.21.15.17:0/2154698622 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c10a70 0x55a3b8c10e70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1808005ab0 tx=0x7f1808009260 comp rx=0 tx=0).stop 2024-09-13T15:58:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.480+0000 7f1826fda740 1 -- 172.21.15.17:0/2154698622 shutdown_connections 2024-09-13T15:58:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.480+0000 7f1826fda740 1 --2- 172.21.15.17:0/2154698622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3b8c16440 0x55a3b8c18900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.480+0000 7f1826fda740 1 --2- 172.21.15.17:0/2154698622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c113b0 0x55a3b8c15e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.480+0000 7f1826fda740 1 --2- 172.21.15.17:0/2154698622 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c10a70 0x55a3b8c10e70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.480+0000 7f1826fda740 1 -- 172.21.15.17:0/2154698622 >> 172.21.15.17:0/2154698622 conn(0x55a3b8c0c0e0 msgr2=0x55a3b8c0c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.480+0000 7f1826fda740 1 -- 172.21.15.17:0/2154698622 shutdown_connections 2024-09-13T15:58:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.480+0000 7f1826fda740 1 -- 172.21.15.17:0/2154698622 wait complete. 2024-09-13T15:58:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.481+0000 7f1826fda740 1 -- start start 2024-09-13T15:58:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.482+0000 7f1826fda740 1 Processor -- start 2024-09-13T15:58:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.482+0000 7f1820c00640 1 --2- 172.21.15.17:0/722087786 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f18040a1160 0x7f18040a3620 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1808005a40 tx=0x7f1808009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.483+0000 7f1826fda740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3b8c10a70 0x55a3b8c1a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.483+0000 7f1826fda740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c113b0 0x55a3b8c1abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.483+0000 7f1826fda740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c16440 0x55a3b8c21bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.483+0000 7f1826fda740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8b73af0 con 0x55a3b8c113b0 2024-09-13T15:58:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.483+0000 7f1826fda740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8b31f20 con 0x55a3b8c10a70 2024-09-13T15:58:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.483+0000 7f1826fda740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8b31bc0 con 0x55a3b8c16440 2024-09-13T15:58:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.483+0000 7f1820c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c113b0 0x55a3b8c1abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.483+0000 7f1821600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3b8c10a70 0x55a3b8c1a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.483+0000 7f1822000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c16440 0x55a3b8c21bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.483+0000 7f1826fda740 10 client.0 _ll_register_callbacks cb 0x55a3b8b63a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:58:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.483+0000 7f1822000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c16440 0x55a3b8c21bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:36752/0 (socket says 172.21.15.17:36752) 2024-09-13T15:58:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.483+0000 7f1822000640 1 -- 172.21.15.17:0/2648305605 learned_addr learned my addr 172.21.15.17:0/2648305605 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.484+0000 7f1822000640 1 -- 172.21.15.17:0/2648305605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3b8c10a70 msgr2=0x55a3b8c1a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.484+0000 7f1822000640 1 --2- 172.21.15.17:0/2648305605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3b8c10a70 0x55a3b8c1a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.484+0000 7f1822000640 1 -- 172.21.15.17:0/2648305605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c113b0 msgr2=0x55a3b8c1abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.484+0000 7f1822000640 1 --2- 172.21.15.17:0/2648305605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c113b0 0x55a3b8c1abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.484+0000 7f1822000640 1 -- 172.21.15.17:0/2648305605 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180801a040 con 0x55a3b8c16440 2024-09-13T15:58:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.485+0000 7f1820c00640 1 --2- 172.21.15.17:0/2648305605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c113b0 0x55a3b8c1abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:58:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.485+0000 7f1822000640 1 --2- 172.21.15.17:0/2648305605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c16440 0x55a3b8c21bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f18140c2180 tx=0x7f18140ba930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bbfc831a8e3dfc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.485+0000 7f1803400640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T15:58:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.485+0000 7f1803400640 1 -- 172.21.15.17:0/2648305605 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18140c26b0 con 0x55a3b8c16440 2024-09-13T15:58:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.485+0000 7f1803400640 1 -- 172.21.15.17:0/2648305605 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f1814004670 con 0x55a3b8c16440 2024-09-13T15:58:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.486+0000 7f1826fda740 1 -- 172.21.15.17:0/2648305605 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a3b8b9dc90 con 0x55a3b8c16440 2024-09-13T15:58:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.486+0000 7f1803400640 1 -- 172.21.15.17:0/2648305605 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18140b9720 con 0x55a3b8c16440 2024-09-13T15:58:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.486+0000 7f1826fda740 10 client.25480 fetch_fsmap learned FSMap version 28 2024-09-13T15:58:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.486+0000 7f1826fda740 1 -- 172.21.15.17:0/2648305605 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55a3b8b72170 con 0x55a3b8c16440 2024-09-13T15:58:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.486+0000 7f1803400640 1 -- 172.21.15.17:0/2648305605 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a3b8b9dc90 con 0x55a3b8c16440 2024-09-13T15:58:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.487+0000 7f1803400640 1 -- 172.21.15.17:0/2648305605 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f1814004040 con 0x55a3b8c16440 2024-09-13T15:58:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.487+0000 7f1826fda740 10 client.25480 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T15:58:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.487+0000 7f1826fda740 10 client.25480 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T15:58:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.487+0000 7f1826fda740 20 client.25480 populate_metadata read hostname 'smithi017' 2024-09-13T15:58:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.487+0000 7f1826fda740 1 --2- 172.21.15.17:0/2648305605 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55a3b8c26120 0x55a3b8c28540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.487+0000 7f1826fda740 4 client.25480 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:58:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.487+0000 7f1826fda740 1 -- 172.21.15.17:0/2648305605 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a3b8b667d0 con 0x55a3b8c26120 2024-09-13T15:58:45.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.488+0000 7f1821600640 1 --2- 172.21.15.17:0/2648305605 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55a3b8c26120 0x55a3b8c28540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.489+0000 7f1821600640 1 --2- 172.21.15.17:0/2648305605 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55a3b8c26120 0x55a3b8c28540 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd46abe6e068bbb5 server_cookie=ef3ae031c7c22bfb in_seq=0 out_seq=0 2024-09-13T15:58:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.489+0000 7f1803400640 10 client.25480 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:58:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.489+0000 7f1803400640 1 -- 172.21.15.17:0/2648305605 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a3b8b667d0 con 0x55a3b8c26120 2024-09-13T15:58:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.489+0000 7f1803400640 10 client.25480 handle_command_reply: tid=0 2024-09-13T15:58:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.489+0000 7f1826fda740 1 client.25480 shutdown 2024-09-13T15:58:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.490+0000 7f1826fda740 1 -- 172.21.15.17:0/2648305605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c16440 msgr2=0x55a3b8c21bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.490+0000 7f1826fda740 1 --2- 172.21.15.17:0/2648305605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c16440 0x55a3b8c21bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f18140c2180 tx=0x7f18140ba930 comp rx=0 tx=0).stop 2024-09-13T15:58:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.490+0000 7f1826fda740 1 -- 172.21.15.17:0/2648305605 shutdown_connections 2024-09-13T15:58:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.490+0000 7f1826fda740 1 --2- 172.21.15.17:0/2648305605 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55a3b8c26120 0x55a3b8c28540 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.490+0000 7f1826fda740 1 --2- 172.21.15.17:0/2648305605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c16440 0x55a3b8c21bf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.490+0000 7f1826fda740 1 --2- 172.21.15.17:0/2648305605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c113b0 0x55a3b8c1abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.490+0000 7f1826fda740 1 --2- 172.21.15.17:0/2648305605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3b8c10a70 0x55a3b8c1a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.490+0000 7f1826fda740 1 -- 172.21.15.17:0/2648305605 >> 172.21.15.17:0/2648305605 conn(0x55a3b8c0c0e0 msgr2=0x55a3b8c0d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.491+0000 7f1803400640 0 client.25480 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:58:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.491+0000 7f1826fda740 1 -- 172.21.15.17:0/2648305605 shutdown_connections 2024-09-13T15:58:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.491+0000 7f1826fda740 1 -- 172.21.15.17:0/2648305605 wait complete. 2024-09-13T15:58:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.492+0000 7f1826fda740 20 client.25480 trim_cache size 0 max 16384 2024-09-13T15:58:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.511+0000 7f1826fda740 1 Processor -- start 2024-09-13T15:58:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.511+0000 7f1826fda740 1 -- start start 2024-09-13T15:58:45.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.512+0000 7f1826fda740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c0c0e0 0x55a3b8c12270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.512+0000 7f1826fda740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c10a70 0x55a3b8c127b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.512+0000 7f1826fda740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3b8c113b0 0x55a3b8c21bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.512+0000 7f1826fda740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b88dae60 con 0x55a3b8c10a70 2024-09-13T15:58:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.512+0000 7f1826fda740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8b9dc90 con 0x55a3b8c113b0 2024-09-13T15:58:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.512+0000 7f1826fda740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8c0cd80 con 0x55a3b8c0c0e0 2024-09-13T15:58:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.513+0000 7f1821600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c0c0e0 0x55a3b8c12270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.513+0000 7f1821600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c0c0e0 0x55a3b8c12270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:36760/0 (socket says 172.21.15.17:36760) 2024-09-13T15:58:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.513+0000 7f1821600640 1 -- 172.21.15.17:0/1294626774 learned_addr learned my addr 172.21.15.17:0/1294626774 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.513+0000 7f1822000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3b8c113b0 0x55a3b8c21bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.513+0000 7f1820c00640 1 --2- 172.21.15.17:0/1294626774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c10a70 0x55a3b8c127b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:45.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.513+0000 7f1821600640 1 -- 172.21.15.17:0/1294626774 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3b8c113b0 msgr2=0x55a3b8c21bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:45.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.513+0000 7f1821600640 1 --2- 172.21.15.17:0/1294626774 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3b8c113b0 0x55a3b8c21bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.513+0000 7f1821600640 1 -- 172.21.15.17:0/1294626774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c10a70 msgr2=0x55a3b8c127b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:45.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.513+0000 7f1821600640 1 --2- 172.21.15.17:0/1294626774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c10a70 0x55a3b8c127b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.513+0000 7f1821600640 1 -- 172.21.15.17:0/1294626774 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3b8b14180 con 0x55a3b8c0c0e0 2024-09-13T15:58:45.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.514+0000 7f1821600640 1 --2- 172.21.15.17:0/1294626774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c0c0e0 0x55a3b8c12270 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1810009600 tx=0x7f1810008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa9dbb9308972db1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:45.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.514+0000 7f180f400640 1 -- 172.21.15.17:0/1294626774 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181001c070 con 0x55a3b8c0c0e0 2024-09-13T15:58:45.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.515+0000 7f180f400640 1 -- 172.21.15.17:0/1294626774 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1810009e30 con 0x55a3b8c0c0e0 2024-09-13T15:58:45.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.515+0000 7f180f400640 1 -- 172.21.15.17:0/1294626774 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181001c8d0 con 0x55a3b8c0c0e0 2024-09-13T15:58:45.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.516+0000 7f1826fda740 1 -- 172.21.15.17:0/1294626774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c0c0e0 msgr2=0x55a3b8c12270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:45.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.516+0000 7f1826fda740 1 --2- 172.21.15.17:0/1294626774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c0c0e0 0x55a3b8c12270 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1810009600 tx=0x7f1810008040 comp rx=0 tx=0).stop 2024-09-13T15:58:45.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.516+0000 7f1826fda740 1 -- 172.21.15.17:0/1294626774 shutdown_connections 2024-09-13T15:58:45.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.516+0000 7f1826fda740 1 --2- 172.21.15.17:0/1294626774 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3b8c113b0 0x55a3b8c21bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.516+0000 7f1826fda740 1 --2- 172.21.15.17:0/1294626774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c10a70 0x55a3b8c127b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.516+0000 7f1826fda740 1 --2- 172.21.15.17:0/1294626774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c0c0e0 0x55a3b8c12270 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.516+0000 7f1826fda740 1 -- 172.21.15.17:0/1294626774 >> 172.21.15.17:0/1294626774 conn(0x55a3b8c18ba0 msgr2=0x55a3b8c1a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:45.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.517+0000 7f1826fda740 1 -- 172.21.15.17:0/1294626774 shutdown_connections 2024-09-13T15:58:45.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.517+0000 7f1826fda740 1 -- 172.21.15.17:0/1294626774 wait complete. 2024-09-13T15:58:45.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.517+0000 7f1826fda740 1 -- start start 2024-09-13T15:58:45.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.518+0000 7f1826fda740 1 Processor -- start 2024-09-13T15:58:45.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.518+0000 7f1826fda740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3b8c0c0e0 0x55a3b8c21890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:45.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.518+0000 7f1826fda740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c10a70 0x55a3b8c1ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:45.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.518+0000 7f1826fda740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c113b0 0x55a3b8c204d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:45.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.519+0000 7f1821600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3b8c0c0e0 0x55a3b8c21890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.519+0000 7f1821600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3b8c0c0e0 0x55a3b8c21890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:44746/0 (socket says 172.21.15.17:44746) 2024-09-13T15:58:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.519+0000 7f1822000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c113b0 0x55a3b8c204d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.519+0000 7f1826fda740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8c20a10 con 0x55a3b8c10a70 2024-09-13T15:58:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.519+0000 7f1822000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c113b0 0x55a3b8c204d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:36764/0 (socket says 172.21.15.17:36764) 2024-09-13T15:58:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.519+0000 7f1821600640 1 -- 172.21.15.17:0/2436391599 learned_addr learned my addr 172.21.15.17:0/2436391599 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.519+0000 7f1820c00640 1 --2- 172.21.15.17:0/2436391599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c10a70 0x55a3b8c1ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.519+0000 7f1826fda740 1 -- 172.21.15.17:0/2436391599 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8c20b80 con 0x55a3b8c0c0e0 2024-09-13T15:58:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.519+0000 7f1826fda740 1 -- 172.21.15.17:0/2436391599 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8c20d40 con 0x55a3b8c113b0 2024-09-13T15:58:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.519+0000 7f1826fda740 10 client.0 _ll_register_callbacks cb 0x7f1808009a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:58:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.520+0000 7f1822000640 1 -- 172.21.15.17:0/2436391599 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3b8c0c0e0 msgr2=0x55a3b8c21890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.520+0000 7f1822000640 1 --2- 172.21.15.17:0/2436391599 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3b8c0c0e0 0x55a3b8c21890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.520+0000 7f1822000640 1 -- 172.21.15.17:0/2436391599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c10a70 msgr2=0x55a3b8c1ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.520+0000 7f1822000640 1 --2- 172.21.15.17:0/2436391599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c10a70 0x55a3b8c1ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.520+0000 7f1822000640 1 -- 172.21.15.17:0/2436391599 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1810009830 con 0x55a3b8c113b0 2024-09-13T15:58:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.520+0000 7f1803400640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T15:58:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.520+0000 7f1822000640 1 --2- 172.21.15.17:0/2436391599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c113b0 0x55a3b8c204d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f18140b6ca0 tx=0x7f18140b87e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26887a9bfa31efeb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.520+0000 7f1803400640 1 -- 172.21.15.17:0/2436391599 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18140c24c0 con 0x55a3b8c113b0 2024-09-13T15:58:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.520+0000 7f1826fda740 1 -- 172.21.15.17:0/2436391599 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1808012230 con 0x55a3b8c113b0 2024-09-13T15:58:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.521+0000 7f1803400640 1 -- 172.21.15.17:0/2436391599 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f18140b4e40 con 0x55a3b8c113b0 2024-09-13T15:58:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.521+0000 7f1803400640 1 -- 172.21.15.17:0/2436391599 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18140c24c0 con 0x55a3b8c113b0 2024-09-13T15:58:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.521+0000 7f1826fda740 10 client.25486 fetch_fsmap learned FSMap version 28 2024-09-13T15:58:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.521+0000 7f1826fda740 1 -- 172.21.15.17:0/2436391599 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55a3b8b39560 con 0x55a3b8c113b0 2024-09-13T15:58:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.521+0000 7f1803400640 1 -- 172.21.15.17:0/2436391599 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1808012230 con 0x55a3b8c113b0 2024-09-13T15:58:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.521+0000 7f1803400640 1 -- 172.21.15.17:0/2436391599 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f1814004040 con 0x55a3b8c113b0 2024-09-13T15:58:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.522+0000 7f1826fda740 10 client.25486 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T15:58:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.522+0000 7f1826fda740 10 client.25486 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T15:58:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.522+0000 7f1826fda740 20 client.25486 populate_metadata read hostname 'smithi017' 2024-09-13T15:58:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.522+0000 7f1826fda740 1 --2- 172.21.15.17:0/2436391599 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55a3b8c16440 0x55a3b8c880c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.522+0000 7f1826fda740 4 client.25486 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T15:58:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.522+0000 7f1826fda740 1 -- 172.21.15.17:0/2436391599 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a3b8867300 con 0x55a3b8c16440 2024-09-13T15:58:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.522+0000 7f1821600640 1 --2- 172.21.15.17:0/2436391599 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55a3b8c16440 0x55a3b8c880c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.522+0000 7f1821600640 1 --2- 172.21.15.17:0/2436391599 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55a3b8c16440 0x55a3b8c880c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bdec8042ec08d74 server_cookie=63fd4a6c844eb7ac in_seq=0 out_seq=0 2024-09-13T15:58:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.522+0000 7f1803400640 10 client.25486 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:58:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.543+0000 7f1803400640 1 -- 172.21.15.17:0/2436391599 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a3b8867300 con 0x55a3b8c16440 2024-09-13T15:58:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.543+0000 7f1803400640 10 client.25486 handle_command_reply: tid=0 2024-09-13T15:58:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.543+0000 7f1826fda740 1 client.25486 shutdown 2024-09-13T15:58:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.544+0000 7f1826fda740 1 -- 172.21.15.17:0/2436391599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c113b0 msgr2=0x55a3b8c204d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.544+0000 7f1826fda740 1 --2- 172.21.15.17:0/2436391599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c113b0 0x55a3b8c204d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f18140b6ca0 tx=0x7f18140b87e0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.544+0000 7f1826fda740 1 -- 172.21.15.17:0/2436391599 shutdown_connections 2024-09-13T15:58:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.544+0000 7f1826fda740 1 --2- 172.21.15.17:0/2436391599 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55a3b8c16440 0x55a3b8c880c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.544+0000 7f1826fda740 1 --2- 172.21.15.17:0/2436391599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a3b8c113b0 0x55a3b8c204d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.544+0000 7f1826fda740 1 --2- 172.21.15.17:0/2436391599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3b8c10a70 0x55a3b8c1ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.544+0000 7f1826fda740 1 --2- 172.21.15.17:0/2436391599 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3b8c0c0e0 0x55a3b8c21890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.544+0000 7f1826fda740 1 -- 172.21.15.17:0/2436391599 >> 172.21.15.17:0/2436391599 conn(0x55a3b8c18ba0 msgr2=0x55a3b8c1a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.544+0000 7f1803400640 0 client.25486 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:58:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.545+0000 7f1826fda740 1 -- 172.21.15.17:0/2436391599 shutdown_connections 2024-09-13T15:58:45.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.545+0000 7f1826fda740 1 -- 172.21.15.17:0/2436391599 wait complete. 2024-09-13T15:58:45.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.545+0000 7f1826fda740 20 client.25486 trim_cache size 0 max 16384 2024-09-13T15:58:45.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T15:58:45.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T15:58:45.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T15:58:45.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T15:58:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.546+0000 7f1824000640 1 -- 172.21.15.17:0/722087786 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f18040a1160 msgr2=0x7f18040a3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.546+0000 7f1824000640 1 --2- 172.21.15.17:0/722087786 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f18040a1160 0x7f18040a3620 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1808005a40 tx=0x7f1808009260 comp rx=0 tx=0).stop 2024-09-13T15:58:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.546+0000 7f1824000640 1 -- 172.21.15.17:0/722087786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f181c1018c0 msgr2=0x7f181c19f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.546+0000 7f1824000640 1 --2- 172.21.15.17:0/722087786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f181c1018c0 0x7f181c19f620 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1814034040 tx=0x7f1814030ee0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.547+0000 7f1824000640 1 -- 172.21.15.17:0/722087786 shutdown_connections 2024-09-13T15:58:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.547+0000 7f1824000640 1 --2- 172.21.15.17:0/722087786 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f18040a1160 0x7f18040a3620 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.547+0000 7f1824000640 1 --2- 172.21.15.17:0/722087786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f181c1018c0 0x7f181c19f620 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.547+0000 7f1824000640 1 --2- 172.21.15.17:0/722087786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f181c100f00 0x7f181c198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.547+0000 7f1824000640 1 --2- 172.21.15.17:0/722087786 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f181c0ffd10 0x7f181c1980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.547+0000 7f1824000640 1 -- 172.21.15.17:0/722087786 >> 172.21.15.17:0/722087786 conn(0x7f181c0fb4b0 msgr2=0x7f181c106860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:45.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.547+0000 7f1824000640 1 -- 172.21.15.17:0/722087786 shutdown_connections 2024-09-13T15:58:45.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:45.547+0000 7f1824000640 1 -- 172.21.15.17:0/722087786 wait complete. 2024-09-13T15:58:46.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:46 smithi189 ceph-mon[34790]: pgmap v416: 129 pgs: 129 active+clean; 987 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 9.8 MiB/s wr, 776 op/s 2024-09-13T15:58:46.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:46 smithi193 ceph-mon[35248]: pgmap v416: 129 pgs: 129 active+clean; 987 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 9.8 MiB/s wr, 776 op/s 2024-09-13T15:58:46.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:46 smithi017 ceph-mon[30494]: pgmap v416: 129 pgs: 129 active+clean; 987 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 9.8 MiB/s wr, 776 op/s 2024-09-13T15:58:48.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:48 smithi189 ceph-mon[34790]: pgmap v417: 129 pgs: 129 active+clean; 991 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 11 MiB/s wr, 766 op/s 2024-09-13T15:58:48.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:48 smithi193 ceph-mon[35248]: pgmap v417: 129 pgs: 129 active+clean; 991 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 11 MiB/s wr, 766 op/s 2024-09-13T15:58:48.764 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:48 smithi017 ceph-mon[30494]: pgmap v417: 129 pgs: 129 active+clean; 991 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 11 MiB/s wr, 766 op/s 2024-09-13T15:58:50.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 65.0 s, 2686.4 tps, lat 37.269 ms stddev 40.553 2024-09-13T15:58:50.563 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:50 smithi017 ceph-mon[30494]: pgmap v418: 129 pgs: 129 active+clean; 999 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 13 MiB/s wr, 871 op/s 2024-09-13T15:58:50.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:50 smithi189 ceph-mon[34790]: pgmap v418: 129 pgs: 129 active+clean; 999 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 13 MiB/s wr, 871 op/s 2024-09-13T15:58:50.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:50 smithi193 ceph-mon[35248]: pgmap v418: 129 pgs: 129 active+clean; 999 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 13 MiB/s wr, 871 op/s 2024-09-13T15:58:52.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:52 smithi189 ceph-mon[34790]: pgmap v419: 129 pgs: 129 active+clean; 999 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 13 MiB/s wr, 855 op/s 2024-09-13T15:58:53.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:52 smithi193 ceph-mon[35248]: pgmap v419: 129 pgs: 129 active+clean; 999 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 13 MiB/s wr, 855 op/s 2024-09-13T15:58:53.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:52 smithi017 ceph-mon[30494]: pgmap v419: 129 pgs: 129 active+clean; 999 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 13 MiB/s wr, 855 op/s 2024-09-13T15:58:54.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:54 smithi189 ceph-mon[34790]: pgmap v420: 129 pgs: 129 active+clean; 999 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 12 MiB/s wr, 803 op/s 2024-09-13T15:58:54.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:54 smithi193 ceph-mon[35248]: pgmap v420: 129 pgs: 129 active+clean; 999 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 12 MiB/s wr, 803 op/s 2024-09-13T15:58:54.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:54 smithi017 ceph-mon[30494]: pgmap v420: 129 pgs: 129 active+clean; 999 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 12 MiB/s wr, 803 op/s 2024-09-13T15:58:55.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 70.0 s, 2314.8 tps, lat 43.088 ms stddev 55.775 2024-09-13T15:58:56.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:56 smithi189 ceph-mon[34790]: pgmap v421: 129 pgs: 129 active+clean; 1001 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 829 op/s 2024-09-13T15:58:56.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:56 smithi193 ceph-mon[35248]: pgmap v421: 129 pgs: 129 active+clean; 1001 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 829 op/s 2024-09-13T15:58:56.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:56 smithi017 ceph-mon[30494]: pgmap v421: 129 pgs: 129 active+clean; 1001 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 829 op/s 2024-09-13T15:58:58.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:58:58 smithi189 ceph-mon[34790]: pgmap v422: 129 pgs: 129 active+clean; 1001 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 MiB/s wr, 767 op/s 2024-09-13T15:58:58.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.740+0000 7f5131000640 1 -- 172.21.15.17:0/3038087943 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f512c1031e0 msgr2=0x7f512c1055d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:58.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.740+0000 7f5131000640 1 --2- 172.21.15.17:0/3038087943 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f512c1031e0 0x7f512c1055d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5118009900 tx=0x7f511802a410 comp rx=0 tx=0).stop 2024-09-13T15:58:58.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.740+0000 7f5131000640 1 -- 172.21.15.17:0/3038087943 shutdown_connections 2024-09-13T15:58:58.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.740+0000 7f5131000640 1 --2- 172.21.15.17:0/3038087943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f512c105b10 0x7f512c107f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.740+0000 7f5131000640 1 --2- 172.21.15.17:0/3038087943 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f512c1031e0 0x7f512c1055d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.740+0000 7f5131000640 1 --2- 172.21.15.17:0/3038087943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f512c1008b0 0x7f512c102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.740+0000 7f5131000640 1 -- 172.21.15.17:0/3038087943 >> 172.21.15.17:0/3038087943 conn(0x7f512c0fa3d0 msgr2=0x7f512c0fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.740+0000 7f5131000640 1 -- 172.21.15.17:0/3038087943 shutdown_connections 2024-09-13T15:58:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.740+0000 7f5131000640 1 -- 172.21.15.17:0/3038087943 wait complete. 2024-09-13T15:58:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.742+0000 7f5131000640 1 Processor -- start 2024-09-13T15:58:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.742+0000 7f5131000640 1 -- start start 2024-09-13T15:58:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.742+0000 7f5131000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f512c1008b0 0x7f512c06d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.742+0000 7f5131000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f512c1031e0 0x7f512c06d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.743+0000 7f5131000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f512c105b10 0x7f512c06db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.743+0000 7f5131000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c06e2f0 con 0x7f512c1031e0 2024-09-13T15:58:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.743+0000 7f5131000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c06e430 con 0x7f512c105b10 2024-09-13T15:58:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.743+0000 7f5131000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c06e5c0 con 0x7f512c1008b0 2024-09-13T15:58:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.743+0000 7f5129e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f512c1008b0 0x7f512c06d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.743+0000 7f5129e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f512c1008b0 0x7f512c06d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:34966/0 (socket says 172.21.15.17:34966) 2024-09-13T15:58:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.743+0000 7f5129e00640 1 -- 172.21.15.17:0/1108423905 learned_addr learned my addr 172.21.15.17:0/1108423905 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.743+0000 7f5129e00640 1 -- 172.21.15.17:0/1108423905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f512c105b10 msgr2=0x7f512c06db60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T15:58:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.743+0000 7f5129e00640 1 --2- 172.21.15.17:0/1108423905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f512c105b10 0x7f512c06db60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.743+0000 7f5129e00640 1 -- 172.21.15.17:0/1108423905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f512c1031e0 msgr2=0x7f512c06d620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:58:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.743+0000 7f5129e00640 1 --2- 172.21.15.17:0/1108423905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f512c1031e0 0x7f512c06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.743+0000 7f5129e00640 1 -- 172.21.15.17:0/1108423905 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c009490 con 0x7f512c1008b0 2024-09-13T15:58:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.744+0000 7f5129e00640 1 --2- 172.21.15.17:0/1108423905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f512c1008b0 0x7f512c06d0e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f511c00ea60 tx=0x7f511c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.744+0000 7f5122a00640 1 -- 172.21.15.17:0/1108423905 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c00cde0 con 0x7f512c1008b0 2024-09-13T15:58:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.744+0000 7f5122a00640 1 -- 172.21.15.17:0/1108423905 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f511c0035f0 con 0x7f512c1008b0 2024-09-13T15:58:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.744+0000 7f5122a00640 1 -- 172.21.15.17:0/1108423905 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c0044e0 con 0x7f512c1008b0 2024-09-13T15:58:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.744+0000 7f5131000640 1 -- 172.21.15.17:0/1108423905 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5118009560 con 0x7f512c1008b0 2024-09-13T15:58:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.745+0000 7f5131000640 1 -- 172.21.15.17:0/1108423905 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512c06ebd0 con 0x7f512c1008b0 2024-09-13T15:58:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.748+0000 7f5122a00640 1 -- 172.21.15.17:0/1108423905 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f511c004020 con 0x7f512c1008b0 2024-09-13T15:58:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.749+0000 7f5133fd2740 1 Processor -- start 2024-09-13T15:58:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.749+0000 7f5133fd2740 1 -- start start 2024-09-13T15:58:58.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.749+0000 7f5133fd2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d07a70 0x560b93d07e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:58.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.749+0000 7f5133fd2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d083b0 0x560b93d0ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:58.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.749+0000 7f5133fd2740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b93d0d440 0x560b93d0f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:58.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.749+0000 7f5133fd2740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b93c13bb0 con 0x560b93d0d440 2024-09-13T15:58:58.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.749+0000 7f5133fd2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b93c71a70 con 0x560b93d07a70 2024-09-13T15:58:58.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.749+0000 7f5133fd2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b93c6f200 con 0x560b93d083b0 2024-09-13T15:58:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.750+0000 7f5129e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d083b0 0x560b93d0ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.750+0000 7f5129e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d083b0 0x560b93d0ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:34978/0 (socket says 172.21.15.17:34978) 2024-09-13T15:58:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.750+0000 7f5129e00640 1 -- 172.21.15.17:0/1579729661 learned_addr learned my addr 172.21.15.17:0/1579729661 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.750+0000 7f512a800640 1 --2- 172.21.15.17:0/1579729661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d07a70 0x560b93d07e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.750+0000 7f5129e00640 1 -- 172.21.15.17:0/1579729661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d07a70 msgr2=0x560b93d07e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.750+0000 7f5129e00640 1 --2- 172.21.15.17:0/1579729661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d07a70 0x560b93d07e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.750+0000 7f5129e00640 1 -- 172.21.15.17:0/1579729661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b93d0d440 msgr2=0x560b93d0f900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:58:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.750+0000 7f5129e00640 1 --2- 172.21.15.17:0/1579729661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b93d0d440 0x560b93d0f900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.750+0000 7f5129e00640 1 -- 172.21.15.17:0/1579729661 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b93c0c940 con 0x560b93d083b0 2024-09-13T15:58:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.751+0000 7f5122a00640 1 --2- 172.21.15.17:0/1108423905 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f51100a1210 0x7f51100a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.751+0000 7f5129e00640 1 --2- 172.21.15.17:0/1579729661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d083b0 0x560b93d0ce70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f511c0d0ea0 tx=0x7f511c0d0f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c471fe2b1e0cfb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.751+0000 7f5122a00640 1 -- 172.21.15.17:0/1108423905 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f511c014070 con 0x7f512c1008b0 2024-09-13T15:58:58.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.751+0000 7f5117400640 1 -- 172.21.15.17:0/1579729661 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c096490 con 0x560b93d083b0 2024-09-13T15:58:58.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.751+0000 7f5117400640 1 -- 172.21.15.17:0/1579729661 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f511c099f20 con 0x560b93d083b0 2024-09-13T15:58:58.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.751+0000 7f5117400640 1 -- 172.21.15.17:0/1579729661 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c09a150 con 0x560b93d083b0 2024-09-13T15:58:58.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.751+0000 7f512a800640 1 --2- 172.21.15.17:0/1108423905 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f51100a1210 0x7f51100a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:58.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:58:58 smithi193 ceph-mon[35248]: pgmap v422: 129 pgs: 129 active+clean; 1001 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 MiB/s wr, 767 op/s 2024-09-13T15:58:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.752+0000 7f5133fd2740 1 -- 172.21.15.17:0/1579729661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d083b0 msgr2=0x560b93d0ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.752+0000 7f512a800640 1 --2- 172.21.15.17:0/1108423905 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f51100a1210 0x7f51100a36d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5124005fd0 tx=0x7f5124009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.752+0000 7f5133fd2740 1 --2- 172.21.15.17:0/1579729661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d083b0 0x560b93d0ce70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f511c0d0ea0 tx=0x7f511c0d0f90 comp rx=0 tx=0).stop 2024-09-13T15:58:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.753+0000 7f5133fd2740 1 -- 172.21.15.17:0/1579729661 shutdown_connections 2024-09-13T15:58:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.753+0000 7f5133fd2740 1 --2- 172.21.15.17:0/1579729661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b93d0d440 0x560b93d0f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.753+0000 7f5133fd2740 1 --2- 172.21.15.17:0/1579729661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d083b0 0x560b93d0ce70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.753+0000 7f5133fd2740 1 --2- 172.21.15.17:0/1579729661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d07a70 0x560b93d07e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.753+0000 7f5133fd2740 1 -- 172.21.15.17:0/1579729661 >> 172.21.15.17:0/1579729661 conn(0x560b93d030e0 msgr2=0x560b93d034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:58.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.753+0000 7f5133fd2740 1 -- 172.21.15.17:0/1579729661 shutdown_connections 2024-09-13T15:58:58.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.753+0000 7f5133fd2740 1 -- 172.21.15.17:0/1579729661 wait complete. 2024-09-13T15:58:58.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.753+0000 7f5133fd2740 1 -- start start 2024-09-13T15:58:58.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.754+0000 7f5133fd2740 1 Processor -- start 2024-09-13T15:58:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.754+0000 7f5133fd2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d07a70 0x560b93d117b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.754+0000 7f5133fd2740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b93d083b0 0x560b93d11cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.754+0000 7f5133fd2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d0d440 0x560b93d18ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.754+0000 7f5133fd2740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b93c6aaf0 con 0x560b93d083b0 2024-09-13T15:58:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.754+0000 7f5133fd2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b93c28f20 con 0x560b93d0d440 2024-09-13T15:58:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.754+0000 7f5133fd2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b93c28bc0 con 0x560b93d07a70 2024-09-13T15:58:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.754+0000 7f5133fd2740 10 client.0 _ll_register_callbacks cb 0x560b93c5aa70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:58:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.754+0000 7f5129e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d07a70 0x560b93d117b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.754+0000 7f5129400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b93d083b0 0x560b93d11cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.754+0000 7f5129e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d07a70 0x560b93d117b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:34982/0 (socket says 172.21.15.17:34982) 2024-09-13T15:58:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.754+0000 7f5129e00640 1 -- 172.21.15.17:0/411712046 learned_addr learned my addr 172.21.15.17:0/411712046 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.755+0000 7f512a800640 1 --2- 172.21.15.17:0/411712046 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d0d440 0x560b93d18ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.755+0000 7f5129e00640 1 -- 172.21.15.17:0/411712046 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d0d440 msgr2=0x560b93d18ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.755+0000 7f5129e00640 1 --2- 172.21.15.17:0/411712046 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d0d440 0x560b93d18ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.755+0000 7f5129e00640 1 -- 172.21.15.17:0/411712046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b93d083b0 msgr2=0x560b93d11cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.755+0000 7f5129e00640 1 --2- 172.21.15.17:0/411712046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b93d083b0 0x560b93d11cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.755+0000 7f5129e00640 1 -- 172.21.15.17:0/411712046 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512c06ebd0 con 0x560b93d07a70 2024-09-13T15:58:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.756+0000 7f5129e00640 1 --2- 172.21.15.17:0/411712046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d07a70 0x560b93d117b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f511c0a20a0 tx=0x7f511c0d0bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=412759e9f86e48 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.756+0000 7f510be00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T15:58:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.756+0000 7f510be00640 1 -- 172.21.15.17:0/411712046 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c099c90 con 0x560b93d07a70 2024-09-13T15:58:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.756+0000 7f510be00640 1 -- 172.21.15.17:0/411712046 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f511c09df80 con 0x560b93d07a70 2024-09-13T15:58:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.757+0000 7f5133fd2740 1 -- 172.21.15.17:0/411712046 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560b93c94c90 con 0x560b93d07a70 2024-09-13T15:58:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.757+0000 7f510be00640 1 -- 172.21.15.17:0/411712046 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f511c099ab0 con 0x560b93d07a70 2024-09-13T15:58:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.757+0000 7f5133fd2740 10 client.25498 fetch_fsmap learned FSMap version 28 2024-09-13T15:58:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.757+0000 7f5133fd2740 1 -- 172.21.15.17:0/411712046 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x560b93c69170 con 0x560b93d07a70 2024-09-13T15:58:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.757+0000 7f510be00640 1 -- 172.21.15.17:0/411712046 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f511c0b6030 con 0x560b93d07a70 2024-09-13T15:58:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.757+0000 7f510be00640 1 -- 172.21.15.17:0/411712046 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f511c01f060 con 0x560b93d07a70 2024-09-13T15:58:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.758+0000 7f5133fd2740 10 client.25498 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T15:58:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.758+0000 7f5133fd2740 10 client.25498 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T15:58:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.758+0000 7f5133fd2740 20 client.25498 populate_metadata read hostname 'smithi017' 2024-09-13T15:58:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.758+0000 7f5133fd2740 1 --2- 172.21.15.17:0/411712046 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x560b93d1cef0 0x560b93d1f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.758+0000 7f5133fd2740 4 client.25498 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:58:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.758+0000 7f5133fd2740 1 -- 172.21.15.17:0/411712046 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560b93c5d7d0 con 0x560b93d1cef0 2024-09-13T15:58:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.758+0000 7f5129400640 1 --2- 172.21.15.17:0/411712046 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x560b93d1cef0 0x560b93d1f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.759+0000 7f5129400640 1 --2- 172.21.15.17:0/411712046 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x560b93d1cef0 0x560b93d1f330 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45006e03aa6ce4e3 server_cookie=2fdf969e40b559b9 in_seq=0 out_seq=0 2024-09-13T15:58:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.759+0000 7f510be00640 10 client.25498 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:58:58.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:58:58 smithi017 ceph-mon[30494]: pgmap v422: 129 pgs: 129 active+clean; 1001 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 MiB/s wr, 767 op/s 2024-09-13T15:58:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.760+0000 7f510be00640 1 -- 172.21.15.17:0/411712046 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560b93c5d7d0 con 0x560b93d1cef0 2024-09-13T15:58:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.760+0000 7f510be00640 10 client.25498 handle_command_reply: tid=0 2024-09-13T15:58:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.760+0000 7f5133fd2740 1 client.25498 shutdown 2024-09-13T15:58:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.760+0000 7f5133fd2740 1 -- 172.21.15.17:0/411712046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d07a70 msgr2=0x560b93d117b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.760+0000 7f5133fd2740 1 --2- 172.21.15.17:0/411712046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d07a70 0x560b93d117b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f511c0a20a0 tx=0x7f511c0d0bb0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.760+0000 7f5133fd2740 1 -- 172.21.15.17:0/411712046 shutdown_connections 2024-09-13T15:58:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.760+0000 7f5133fd2740 1 --2- 172.21.15.17:0/411712046 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x560b93d1cef0 0x560b93d1f330 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.761+0000 7f5133fd2740 1 --2- 172.21.15.17:0/411712046 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d0d440 0x560b93d18ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.761+0000 7f5133fd2740 1 --2- 172.21.15.17:0/411712046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b93d083b0 0x560b93d11cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.761+0000 7f5133fd2740 1 --2- 172.21.15.17:0/411712046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d07a70 0x560b93d117b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.761+0000 7f5133fd2740 1 -- 172.21.15.17:0/411712046 >> 172.21.15.17:0/411712046 conn(0x560b93d030e0 msgr2=0x560b93d048f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.761+0000 7f510be00640 0 client.25498 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:58:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.761+0000 7f5133fd2740 1 -- 172.21.15.17:0/411712046 shutdown_connections 2024-09-13T15:58:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.761+0000 7f5133fd2740 1 -- 172.21.15.17:0/411712046 wait complete. 2024-09-13T15:58:58.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.761+0000 7f5133fd2740 20 client.25498 trim_cache size 0 max 16384 2024-09-13T15:58:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.794+0000 7f5133fd2740 1 Processor -- start 2024-09-13T15:58:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.794+0000 7f5133fd2740 1 -- start start 2024-09-13T15:58:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.795+0000 7f5133fd2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d07a70 0x560b93d1ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.795+0000 7f5133fd2740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b93d083b0 0x560b93d18ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.795+0000 7f5133fd2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d0d440 0x560b93d1f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.795+0000 7f5133fd2740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b939d1e60 con 0x560b93d083b0 2024-09-13T15:58:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.795+0000 7f5133fd2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b93d19e60 con 0x560b93d0d440 2024-09-13T15:58:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.795+0000 7f5133fd2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b93d1f710 con 0x560b93d07a70 2024-09-13T15:58:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.795+0000 7f5129e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d07a70 0x560b93d1ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.795+0000 7f5129400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b93d083b0 0x560b93d18ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.795+0000 7f512a800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d0d440 0x560b93d1f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.795+0000 7f5129e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d07a70 0x560b93d1ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:34988/0 (socket says 172.21.15.17:34988) 2024-09-13T15:58:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.795+0000 7f5129400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b93d083b0 0x560b93d18ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37602/0 (socket says 172.21.15.17:37602) 2024-09-13T15:58:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.795+0000 7f5129e00640 1 -- 172.21.15.17:0/2772825438 learned_addr learned my addr 172.21.15.17:0/2772825438 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.796+0000 7f5129e00640 1 -- 172.21.15.17:0/2772825438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d0d440 msgr2=0x560b93d1f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.796+0000 7f5129e00640 1 --2- 172.21.15.17:0/2772825438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d0d440 0x560b93d1f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.796+0000 7f5129e00640 1 -- 172.21.15.17:0/2772825438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b93d083b0 msgr2=0x560b93d18ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.796+0000 7f5129e00640 1 --2- 172.21.15.17:0/2772825438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b93d083b0 0x560b93d18ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.796+0000 7f5129e00640 1 -- 172.21.15.17:0/2772825438 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b93c0b180 con 0x560b93d07a70 2024-09-13T15:58:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.796+0000 7f512a800640 1 --2- 172.21.15.17:0/2772825438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d0d440 0x560b93d1f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:58:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.797+0000 7f5129e00640 1 --2- 172.21.15.17:0/2772825438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d07a70 0x560b93d1ec60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f511c0d0ea0 tx=0x7f511c096550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b293a663acd5c7a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.797+0000 7f5117e00640 1 -- 172.21.15.17:0/2772825438 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c09a8c0 con 0x560b93d07a70 2024-09-13T15:58:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.797+0000 7f5117e00640 1 -- 172.21.15.17:0/2772825438 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f511c09a8c0 con 0x560b93d07a70 2024-09-13T15:58:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.797+0000 7f5117e00640 1 -- 172.21.15.17:0/2772825438 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c09a150 con 0x560b93d07a70 2024-09-13T15:58:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.799+0000 7f5133fd2740 1 -- 172.21.15.17:0/2772825438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d07a70 msgr2=0x560b93d1ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.799+0000 7f5133fd2740 1 --2- 172.21.15.17:0/2772825438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d07a70 0x560b93d1ec60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f511c0d0ea0 tx=0x7f511c096550 comp rx=0 tx=0).stop 2024-09-13T15:58:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.799+0000 7f5133fd2740 1 -- 172.21.15.17:0/2772825438 shutdown_connections 2024-09-13T15:58:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.800+0000 7f5133fd2740 1 --2- 172.21.15.17:0/2772825438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d0d440 0x560b93d1f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.800+0000 7f5133fd2740 1 --2- 172.21.15.17:0/2772825438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b93d083b0 0x560b93d18ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.800+0000 7f5133fd2740 1 --2- 172.21.15.17:0/2772825438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d07a70 0x560b93d1ec60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.800+0000 7f5133fd2740 1 -- 172.21.15.17:0/2772825438 >> 172.21.15.17:0/2772825438 conn(0x560b93d030e0 msgr2=0x560b93d092d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.800+0000 7f5133fd2740 1 -- 172.21.15.17:0/2772825438 shutdown_connections 2024-09-13T15:58:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.800+0000 7f5133fd2740 1 -- 172.21.15.17:0/2772825438 wait complete. 2024-09-13T15:58:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.800+0000 7f5133fd2740 1 -- start start 2024-09-13T15:58:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.801+0000 7f5133fd2740 1 Processor -- start 2024-09-13T15:58:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.801+0000 7f5133fd2740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b93d07a70 0x560b93d14e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.801+0000 7f5133fd2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d083b0 0x560b93d15370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.801+0000 7f5133fd2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d0d440 0x560b93d182a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.801+0000 7f5133fd2740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b93d187e0 con 0x560b93d07a70 2024-09-13T15:58:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.801+0000 7f5133fd2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b93d18950 con 0x560b93d083b0 2024-09-13T15:58:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.801+0000 7f5133fd2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b93d18b10 con 0x560b93d0d440 2024-09-13T15:58:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.801+0000 7f5133fd2740 10 client.0 _ll_register_callbacks cb 0x7f511c0d08d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:58:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.801+0000 7f5129400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d083b0 0x560b93d15370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.802+0000 7f5129400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d083b0 0x560b93d15370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:55270/0 (socket says 172.21.15.17:55270) 2024-09-13T15:58:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.802+0000 7f5129400640 1 -- 172.21.15.17:0/3650888524 learned_addr learned my addr 172.21.15.17:0/3650888524 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:58:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.802+0000 7f5129e00640 1 --2- 172.21.15.17:0/3650888524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b93d07a70 0x560b93d14e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.802+0000 7f5129400640 1 -- 172.21.15.17:0/3650888524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d0d440 msgr2=0x560b93d182a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T15:58:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.802+0000 7f5129400640 1 --2- 172.21.15.17:0/3650888524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d0d440 0x560b93d182a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.802+0000 7f5129400640 1 -- 172.21.15.17:0/3650888524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b93d07a70 msgr2=0x560b93d14e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:58:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.802+0000 7f5129400640 1 --2- 172.21.15.17:0/3650888524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b93d07a70 0x560b93d14e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.802+0000 7f5129400640 1 -- 172.21.15.17:0/3650888524 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5124011440 con 0x560b93d083b0 2024-09-13T15:58:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.802+0000 7f5129e00640 1 --2- 172.21.15.17:0/3650888524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b93d07a70 0x560b93d14e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:58:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.802+0000 7f5129400640 1 --2- 172.21.15.17:0/3650888524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d083b0 0x560b93d15370 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5118031500 tx=0x7f51180044b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da67b020b11d3d0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:58:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.802+0000 7f510be00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T15:58:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.803+0000 7f510be00640 1 -- 172.21.15.17:0/3650888524 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5118042150 con 0x560b93d083b0 2024-09-13T15:58:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.803+0000 7f510be00640 1 -- 172.21.15.17:0/3650888524 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f51180422b0 con 0x560b93d083b0 2024-09-13T15:58:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.803+0000 7f5133fd2740 1 -- 172.21.15.17:0/3650888524 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f511c099f20 con 0x560b93d083b0 2024-09-13T15:58:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.803+0000 7f510be00640 1 -- 172.21.15.17:0/3650888524 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5118042490 con 0x560b93d083b0 2024-09-13T15:58:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.803+0000 7f5133fd2740 10 client.25481 fetch_fsmap learned FSMap version 28 2024-09-13T15:58:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.804+0000 7f5133fd2740 1 -- 172.21.15.17:0/3650888524 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f512c06ebd0 con 0x560b93d083b0 2024-09-13T15:58:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.804+0000 7f510be00640 1 -- 172.21.15.17:0/3650888524 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f511c099f20 con 0x560b93d083b0 2024-09-13T15:58:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.804+0000 7f510be00640 1 -- 172.21.15.17:0/3650888524 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f511804b480 con 0x560b93d083b0 2024-09-13T15:58:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.804+0000 7f5133fd2740 10 client.25481 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T15:58:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.804+0000 7f5133fd2740 10 client.25481 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T15:58:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.804+0000 7f5133fd2740 20 client.25481 populate_metadata read hostname 'smithi017' 2024-09-13T15:58:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.804+0000 7f5133fd2740 1 --2- 172.21.15.17:0/3650888524 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x560b93d747c0 0x560b93d76be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:58:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.804+0000 7f5133fd2740 4 client.25481 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T15:58:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.804+0000 7f5133fd2740 1 -- 172.21.15.17:0/3650888524 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560b9395e300 con 0x560b93d747c0 2024-09-13T15:58:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.805+0000 7f5129e00640 1 --2- 172.21.15.17:0/3650888524 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x560b93d747c0 0x560b93d76be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:58:58.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.805+0000 7f5129e00640 1 --2- 172.21.15.17:0/3650888524 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x560b93d747c0 0x560b93d76be0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1e1c9fb75a2d8da server_cookie=adeaba74e3468468 in_seq=0 out_seq=0 2024-09-13T15:58:58.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.805+0000 7f510be00640 10 client.25481 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:58:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.819+0000 7f510be00640 1 -- 172.21.15.17:0/3650888524 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560b9395e300 con 0x560b93d747c0 2024-09-13T15:58:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.819+0000 7f510be00640 10 client.25481 handle_command_reply: tid=0 2024-09-13T15:58:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.819+0000 7f5133fd2740 1 client.25481 shutdown 2024-09-13T15:58:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.819+0000 7f5133fd2740 1 -- 172.21.15.17:0/3650888524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d083b0 msgr2=0x560b93d15370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.819+0000 7f5133fd2740 1 --2- 172.21.15.17:0/3650888524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d083b0 0x560b93d15370 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5118031500 tx=0x7f51180044b0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.819+0000 7f5133fd2740 1 -- 172.21.15.17:0/3650888524 shutdown_connections 2024-09-13T15:58:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.819+0000 7f5133fd2740 1 --2- 172.21.15.17:0/3650888524 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x560b93d747c0 0x560b93d76be0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.819+0000 7f5133fd2740 1 --2- 172.21.15.17:0/3650888524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b93d0d440 0x560b93d182a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.819+0000 7f5133fd2740 1 --2- 172.21.15.17:0/3650888524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b93d083b0 0x560b93d15370 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.819+0000 7f5133fd2740 1 --2- 172.21.15.17:0/3650888524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b93d07a70 0x560b93d14e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.819+0000 7f510be00640 0 client.25481 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:58:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.819+0000 7f5133fd2740 1 -- 172.21.15.17:0/3650888524 >> 172.21.15.17:0/3650888524 conn(0x560b93d030e0 msgr2=0x560b93d1ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.820+0000 7f5133fd2740 1 -- 172.21.15.17:0/3650888524 shutdown_connections 2024-09-13T15:58:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.820+0000 7f5133fd2740 1 -- 172.21.15.17:0/3650888524 wait complete. 2024-09-13T15:58:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.820+0000 7f5133fd2740 20 client.25481 trim_cache size 0 max 16384 2024-09-13T15:58:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T15:58:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T15:58:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T15:58:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T15:58:58.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.821+0000 7f5131000640 1 -- 172.21.15.17:0/1108423905 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f51100a1210 msgr2=0x7f51100a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:58.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.821+0000 7f5131000640 1 --2- 172.21.15.17:0/1108423905 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f51100a1210 0x7f51100a36d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5124005fd0 tx=0x7f5124009500 comp rx=0 tx=0).stop 2024-09-13T15:58:58.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.821+0000 7f5131000640 1 -- 172.21.15.17:0/1108423905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f512c1008b0 msgr2=0x7f512c06d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:58:58.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.821+0000 7f5131000640 1 --2- 172.21.15.17:0/1108423905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f512c1008b0 0x7f512c06d0e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f511c00ea60 tx=0x7f511c00ef20 comp rx=0 tx=0).stop 2024-09-13T15:58:58.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.821+0000 7f5131000640 1 -- 172.21.15.17:0/1108423905 shutdown_connections 2024-09-13T15:58:58.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.821+0000 7f5131000640 1 --2- 172.21.15.17:0/1108423905 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f51100a1210 0x7f51100a36d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.821+0000 7f5131000640 1 --2- 172.21.15.17:0/1108423905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f512c105b10 0x7f512c06db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.821+0000 7f5131000640 1 --2- 172.21.15.17:0/1108423905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f512c1031e0 0x7f512c06d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.821+0000 7f5131000640 1 --2- 172.21.15.17:0/1108423905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f512c1008b0 0x7f512c06d0e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:58:58.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.821+0000 7f5131000640 1 -- 172.21.15.17:0/1108423905 >> 172.21.15.17:0/1108423905 conn(0x7f512c0fa3d0 msgr2=0x7f512c100070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:58:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.821+0000 7f5131000640 1 -- 172.21.15.17:0/1108423905 shutdown_connections 2024-09-13T15:58:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:58:58.821+0000 7f5131000640 1 -- 172.21.15.17:0/1108423905 wait complete. 2024-09-13T15:59:00.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 75.0 s, 1762.2 tps, lat 55.799 ms stddev 63.806 2024-09-13T15:59:00.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:00 smithi189 ceph-mon[34790]: pgmap v423: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 847 op/s 2024-09-13T15:59:00.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:00 smithi193 ceph-mon[35248]: pgmap v423: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 847 op/s 2024-09-13T15:59:00.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:00 smithi017 ceph-mon[30494]: pgmap v423: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 847 op/s 2024-09-13T15:59:02.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:02 smithi189 ceph-mon[34790]: pgmap v424: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.1 MiB/s wr, 803 op/s 2024-09-13T15:59:02.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:02 smithi193 ceph-mon[35248]: pgmap v424: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.1 MiB/s wr, 803 op/s 2024-09-13T15:59:02.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:02 smithi017 ceph-mon[30494]: pgmap v424: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.1 MiB/s wr, 803 op/s 2024-09-13T15:59:04.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:04 smithi189 ceph-mon[34790]: pgmap v425: 129 pgs: 129 active+clean; 1013 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 814 op/s 2024-09-13T15:59:04.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:04 smithi193 ceph-mon[35248]: pgmap v425: 129 pgs: 129 active+clean; 1013 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 814 op/s 2024-09-13T15:59:04.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:04 smithi017 ceph-mon[30494]: pgmap v425: 129 pgs: 129 active+clean; 1013 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 814 op/s 2024-09-13T15:59:05.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 80.0 s, 1581.2 tps, lat 63.458 ms stddev 74.501 2024-09-13T15:59:06.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:06 smithi189 ceph-mon[34790]: pgmap v426: 129 pgs: 129 active+clean; 1017 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 806 op/s 2024-09-13T15:59:06.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:06 smithi193 ceph-mon[35248]: pgmap v426: 129 pgs: 129 active+clean; 1017 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 806 op/s 2024-09-13T15:59:06.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:06 smithi017 ceph-mon[30494]: pgmap v426: 129 pgs: 129 active+clean; 1017 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 806 op/s 2024-09-13T15:59:08.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:08 smithi189 ceph-mon[34790]: pgmap v427: 129 pgs: 129 active+clean; 1017 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 8.2 MiB/s wr, 668 op/s 2024-09-13T15:59:08.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:08 smithi193 ceph-mon[35248]: pgmap v427: 129 pgs: 129 active+clean; 1017 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 8.2 MiB/s wr, 668 op/s 2024-09-13T15:59:08.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:08 smithi017 ceph-mon[30494]: pgmap v427: 129 pgs: 129 active+clean; 1017 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 8.2 MiB/s wr, 668 op/s 2024-09-13T15:59:10.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 85.0 s, 1761.4 tps, lat 57.287 ms stddev 73.073 2024-09-13T15:59:10.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:10 smithi189 ceph-mon[34790]: pgmap v428: 129 pgs: 129 active+clean; 1018 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 MiB/s wr, 695 op/s 2024-09-13T15:59:10.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:10 smithi193 ceph-mon[35248]: pgmap v428: 129 pgs: 129 active+clean; 1018 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 MiB/s wr, 695 op/s 2024-09-13T15:59:10.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:10 smithi017 ceph-mon[30494]: pgmap v428: 129 pgs: 129 active+clean; 1018 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 MiB/s wr, 695 op/s 2024-09-13T15:59:12.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.008+0000 7fbaec600640 1 -- 172.21.15.17:0/2331814121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbae40ff5c0 msgr2=0x7fbae40ffa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:12.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.008+0000 7fbaec600640 1 --2- 172.21.15.17:0/2331814121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbae40ff5c0 0x7fbae40ffa40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009900 tx=0x7fbad802b500 comp rx=0 tx=0).stop 2024-09-13T15:59:12.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.008+0000 7fbaec600640 1 -- 172.21.15.17:0/2331814121 shutdown_connections 2024-09-13T15:59:12.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.008+0000 7fbaec600640 1 --2- 172.21.15.17:0/2331814121 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbae40fff80 0x7fbae4106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.008+0000 7fbaec600640 1 --2- 172.21.15.17:0/2331814121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbae40ff5c0 0x7fbae40ffa40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.008+0000 7fbaec600640 1 --2- 172.21.15.17:0/2331814121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbae40fe3d0 0x7fbae40fe7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.008+0000 7fbaec600640 1 -- 172.21.15.17:0/2331814121 >> 172.21.15.17:0/2331814121 conn(0x7fbae40f9b50 msgr2=0x7fbae40fbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:12.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.008+0000 7fbaec600640 1 -- 172.21.15.17:0/2331814121 shutdown_connections 2024-09-13T15:59:12.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.008+0000 7fbaec600640 1 -- 172.21.15.17:0/2331814121 wait complete. 2024-09-13T15:59:12.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.010+0000 7fbaec600640 1 Processor -- start 2024-09-13T15:59:12.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.010+0000 7fbaec600640 1 -- start start 2024-09-13T15:59:12.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.010+0000 7fbaec600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbae40fe3d0 0x7fbae41980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:12.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.010+0000 7fbaec600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbae40fff80 0x7fbae4198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:12.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.011+0000 7fbaec600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbae419d660 0x7fbae419fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.011+0000 7fbae9c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbae40fe3d0 0x7fbae41980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.011+0000 7fbae9c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbae40fe3d0 0x7fbae41980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:49752/0 (socket says 172.21.15.17:49752) 2024-09-13T15:59:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.011+0000 7fbae9200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbae40fff80 0x7fbae4198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.012+0000 7fbae9200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbae40fff80 0x7fbae4198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50492/0 (socket says 172.21.15.17:50492) 2024-09-13T15:59:12.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.014+0000 7fbae9c00640 1 -- 172.21.15.17:0/1424858119 learned_addr learned my addr 172.21.15.17:0/1424858119 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:59:12.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.014+0000 7fbaec600640 1 -- 172.21.15.17:0/1424858119 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae419ff90 con 0x7fbae40fff80 2024-09-13T15:59:12.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.014+0000 7fbaec600640 1 -- 172.21.15.17:0/1424858119 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae41a0100 con 0x7fbae40fe3d0 2024-09-13T15:59:12.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.014+0000 7fbaec600640 1 -- 172.21.15.17:0/1424858119 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae41a02c0 con 0x7fbae419d660 2024-09-13T15:59:12.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.014+0000 7fbaea600640 1 --2- 172.21.15.17:0/1424858119 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbae419d660 0x7fbae419fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:12.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.015+0000 7fbaea600640 1 -- 172.21.15.17:0/1424858119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbae40fe3d0 msgr2=0x7fbae41980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:12.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.015+0000 7fbaea600640 1 --2- 172.21.15.17:0/1424858119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbae40fe3d0 0x7fbae41980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.015+0000 7fbaea600640 1 -- 172.21.15.17:0/1424858119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbae40fff80 msgr2=0x7fbae4198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:12.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.015+0000 7fbaea600640 1 --2- 172.21.15.17:0/1424858119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbae40fff80 0x7fbae4198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.015+0000 7fbaea600640 1 -- 172.21.15.17:0/1424858119 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad8009560 con 0x7fbae419d660 2024-09-13T15:59:12.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.015+0000 7fbaea600640 1 --2- 172.21.15.17:0/1424858119 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbae419d660 0x7fbae419fa50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00cab0 tx=0x7fbadc00cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:12.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.016+0000 7fbae2000640 1 -- 172.21.15.17:0/1424858119 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc00ae20 con 0x7fbae419d660 2024-09-13T15:59:12.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.016+0000 7fbaec600640 1 -- 172.21.15.17:0/1424858119 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae41a05a0 con 0x7fbae419d660 2024-09-13T15:59:12.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.016+0000 7fbaec600640 1 -- 172.21.15.17:0/1424858119 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae41a0a80 con 0x7fbae419d660 2024-09-13T15:59:12.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.019+0000 7fbae2000640 1 -- 172.21.15.17:0/1424858119 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbadc00f910 con 0x7fbae419d660 2024-09-13T15:59:12.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.019+0000 7fbae2000640 1 -- 172.21.15.17:0/1424858119 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc00ae20 con 0x7fbae419d660 2024-09-13T15:59:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.024+0000 7fbaef45c740 1 Processor -- start 2024-09-13T15:59:12.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.027+0000 7fbae2000640 1 -- 172.21.15.17:0/1424858119 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fbadc00e790 con 0x7fbae419d660 2024-09-13T15:59:12.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.030+0000 7fbae2000640 1 --2- 172.21.15.17:0/1424858119 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbacc0a1150 0x7fbacc0a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:12.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.031+0000 7fbae9200640 1 --2- 172.21.15.17:0/1424858119 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbacc0a1150 0x7fbacc0a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:12.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.032+0000 7fbae2000640 1 -- 172.21.15.17:0/1424858119 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fbadc09a8b0 con 0x7fbae419d660 2024-09-13T15:59:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.032+0000 7fbaef45c740 1 -- start start 2024-09-13T15:59:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.033+0000 7fbaef45c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b7c280 0x55fb03b7c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.033+0000 7fbaef45c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb03b7cbc0 0x55fb03b81680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.033+0000 7fbaef45c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fb03b81c50 0x55fb03b84110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.033+0000 7fbaef45c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb03a7fbb0 con 0x55fb03b81c50 2024-09-13T15:59:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.033+0000 7fbaef45c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb03adda70 con 0x55fb03b7cbc0 2024-09-13T15:59:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.033+0000 7fbaef45c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb03adb200 con 0x55fb03b7c280 2024-09-13T15:59:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.033+0000 7fbae9c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b7c280 0x55fb03b7c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.033+0000 7fbae9c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b7c280 0x55fb03b7c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:38362/0 (socket says 172.21.15.17:38362) 2024-09-13T15:59:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.033+0000 7fbae9c00640 1 -- 172.21.15.17:0/3830867250 learned_addr learned my addr 172.21.15.17:0/3830867250 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:59:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.034+0000 7fbae9c00640 1 -- 172.21.15.17:0/3830867250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb03b7cbc0 msgr2=0x55fb03b81680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:59:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.034+0000 7fbae9c00640 1 --2- 172.21.15.17:0/3830867250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb03b7cbc0 0x55fb03b81680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.034+0000 7fbae9c00640 1 -- 172.21.15.17:0/3830867250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fb03b81c50 msgr2=0x55fb03b84110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.034+0000 7fbae9c00640 1 --2- 172.21.15.17:0/3830867250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fb03b81c50 0x55fb03b84110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.034+0000 7fbae9c00640 1 -- 172.21.15.17:0/3830867250 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb03a78940 con 0x55fb03b7c280 2024-09-13T15:59:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.034+0000 7fbae9c00640 1 --2- 172.21.15.17:0/3830867250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b7c280 0x55fb03b7c680 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbad000bd90 tx=0x7fbad00107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c5fcd4999bf48af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.034+0000 7fbae9200640 1 --2- 172.21.15.17:0/1424858119 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbacc0a1150 0x7fbacc0a3610 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009230 tx=0x7fbad80324a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.035+0000 7fbad6a00640 1 -- 172.21.15.17:0/3830867250 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad0004220 con 0x55fb03b7c280 2024-09-13T15:59:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.035+0000 7fbad6a00640 1 -- 172.21.15.17:0/3830867250 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbad0015070 con 0x55fb03b7c280 2024-09-13T15:59:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.035+0000 7fbad6a00640 1 -- 172.21.15.17:0/3830867250 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad00116a0 con 0x55fb03b7c280 2024-09-13T15:59:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.036+0000 7fbaef45c740 1 -- 172.21.15.17:0/3830867250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b7c280 msgr2=0x55fb03b7c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:12.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.036+0000 7fbaef45c740 1 --2- 172.21.15.17:0/3830867250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b7c280 0x55fb03b7c680 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbad000bd90 tx=0x7fbad00107a0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.036+0000 7fbaef45c740 1 -- 172.21.15.17:0/3830867250 shutdown_connections 2024-09-13T15:59:12.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.036+0000 7fbaef45c740 1 --2- 172.21.15.17:0/3830867250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fb03b81c50 0x55fb03b84110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.036+0000 7fbaef45c740 1 --2- 172.21.15.17:0/3830867250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb03b7cbc0 0x55fb03b81680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.036+0000 7fbaef45c740 1 --2- 172.21.15.17:0/3830867250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b7c280 0x55fb03b7c680 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.036+0000 7fbaef45c740 1 -- 172.21.15.17:0/3830867250 >> 172.21.15.17:0/3830867250 conn(0x55fb03b778f0 msgr2=0x55fb03b77cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:12.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.037+0000 7fbaef45c740 1 -- 172.21.15.17:0/3830867250 shutdown_connections 2024-09-13T15:59:12.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.037+0000 7fbaef45c740 1 -- 172.21.15.17:0/3830867250 wait complete. 2024-09-13T15:59:12.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.039+0000 7fbaef45c740 1 -- start start 2024-09-13T15:59:12.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.039+0000 7fbaef45c740 1 Processor -- start 2024-09-13T15:59:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.040+0000 7fbaef45c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fb03b7c280 0x55fb03b96f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.040+0000 7fbaef45c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb03b7cbc0 0x55fb03b974a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.040+0000 7fbaef45c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b81c50 0x55fb03b9e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.040+0000 7fbaef45c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb03ad6af0 con 0x55fb03b7c280 2024-09-13T15:59:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.040+0000 7fbaef45c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb03a94f20 con 0x55fb03b7cbc0 2024-09-13T15:59:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.040+0000 7fbaef45c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb03a94bc0 con 0x55fb03b81c50 2024-09-13T15:59:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.040+0000 7fbaef45c740 10 client.0 _ll_register_callbacks cb 0x55fb03ac6a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:59:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.041+0000 7fbae9c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fb03b7c280 0x55fb03b96f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.041+0000 7fbae9200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb03b7cbc0 0x55fb03b974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.041+0000 7fbae9c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fb03b7c280 0x55fb03b96f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50508/0 (socket says 172.21.15.17:50508) 2024-09-13T15:59:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.041+0000 7fbae9c00640 1 -- 172.21.15.17:0/2553398808 learned_addr learned my addr 172.21.15.17:0/2553398808 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:59:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.041+0000 7fbaea600640 1 --2- 172.21.15.17:0/2553398808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b81c50 0x55fb03b9e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.042+0000 7fbaea600640 1 -- 172.21.15.17:0/2553398808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb03b7cbc0 msgr2=0x55fb03b974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.042+0000 7fbaea600640 1 --2- 172.21.15.17:0/2553398808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb03b7cbc0 0x55fb03b974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.042+0000 7fbaea600640 1 -- 172.21.15.17:0/2553398808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fb03b7c280 msgr2=0x55fb03b96f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.042+0000 7fbaea600640 1 --2- 172.21.15.17:0/2553398808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fb03b7c280 0x55fb03b96f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.042+0000 7fbaea600640 1 -- 172.21.15.17:0/2553398808 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad000b9c0 con 0x55fb03b81c50 2024-09-13T15:59:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.042+0000 7fbaea600640 1 --2- 172.21.15.17:0/2553398808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b81c50 0x55fb03b9e4e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbadc094d20 tx=0x7fbadc0ca730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1531e1eca73550b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.042+0000 7fbacb400640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T15:59:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.042+0000 7fbacb400640 1 -- 172.21.15.17:0/2553398808 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc096530 con 0x55fb03b81c50 2024-09-13T15:59:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.043+0000 7fbacb400640 1 -- 172.21.15.17:0/2553398808 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fbadc096ac0 con 0x55fb03b81c50 2024-09-13T15:59:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.043+0000 7fbaef45c740 1 -- 172.21.15.17:0/2553398808 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb03b00c90 con 0x55fb03b81c50 2024-09-13T15:59:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.044+0000 7fbacb400640 1 -- 172.21.15.17:0/2553398808 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbadc099b10 con 0x55fb03b81c50 2024-09-13T15:59:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.044+0000 7fbaef45c740 10 client.25510 fetch_fsmap learned FSMap version 28 2024-09-13T15:59:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.044+0000 7fbaef45c740 1 -- 172.21.15.17:0/2553398808 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55fb03ad5170 con 0x55fb03b81c50 2024-09-13T15:59:12.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.044+0000 7fbacb400640 1 -- 172.21.15.17:0/2553398808 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fb03b00c90 con 0x55fb03b81c50 2024-09-13T15:59:12.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.046+0000 7fbacb400640 1 -- 172.21.15.17:0/2553398808 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fbadc016020 con 0x55fb03b81c50 2024-09-13T15:59:12.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.046+0000 7fbaef45c740 10 client.25510 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T15:59:12.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.046+0000 7fbaef45c740 10 client.25510 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T15:59:12.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.046+0000 7fbaef45c740 20 client.25510 populate_metadata read hostname 'smithi017' 2024-09-13T15:59:12.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.046+0000 7fbaef45c740 1 --2- 172.21.15.17:0/2553398808 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55fb03ba2d00 0x55fb03ba5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:12.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.046+0000 7fbaef45c740 4 client.25510 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:59:12.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.046+0000 7fbaef45c740 1 -- 172.21.15.17:0/2553398808 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fb03ac97d0 con 0x55fb03ba2d00 2024-09-13T15:59:12.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.046+0000 7fbae9c00640 1 --2- 172.21.15.17:0/2553398808 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55fb03ba2d00 0x55fb03ba5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:12.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.047+0000 7fbae9c00640 1 --2- 172.21.15.17:0/2553398808 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55fb03ba2d00 0x55fb03ba5120 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9aa7dfae9bff9fc5 server_cookie=d129f8d6f07b5a30 in_seq=0 out_seq=0 2024-09-13T15:59:12.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.047+0000 7fbacb400640 10 client.25510 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:59:12.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.048+0000 7fbacb400640 1 -- 172.21.15.17:0/2553398808 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fb03ac97d0 con 0x55fb03ba2d00 2024-09-13T15:59:12.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.048+0000 7fbacb400640 10 client.25510 handle_command_reply: tid=0 2024-09-13T15:59:12.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.048+0000 7fbaef45c740 1 client.25510 shutdown 2024-09-13T15:59:12.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.048+0000 7fbaef45c740 1 -- 172.21.15.17:0/2553398808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b81c50 msgr2=0x55fb03b9e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:12.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.048+0000 7fbaef45c740 1 --2- 172.21.15.17:0/2553398808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b81c50 0x55fb03b9e4e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbadc094d20 tx=0x7fbadc0ca730 comp rx=0 tx=0).stop 2024-09-13T15:59:12.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.049+0000 7fbaef45c740 1 -- 172.21.15.17:0/2553398808 shutdown_connections 2024-09-13T15:59:12.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.049+0000 7fbaef45c740 1 --2- 172.21.15.17:0/2553398808 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55fb03ba2d00 0x55fb03ba5120 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.049+0000 7fbaef45c740 1 --2- 172.21.15.17:0/2553398808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b81c50 0x55fb03b9e4e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.049+0000 7fbaef45c740 1 --2- 172.21.15.17:0/2553398808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb03b7cbc0 0x55fb03b974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.049+0000 7fbaef45c740 1 --2- 172.21.15.17:0/2553398808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fb03b7c280 0x55fb03b96f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.049+0000 7fbaef45c740 1 -- 172.21.15.17:0/2553398808 >> 172.21.15.17:0/2553398808 conn(0x55fb03b778f0 msgr2=0x55fb03b79100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:12.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.049+0000 7fbacb400640 0 client.25510 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:59:12.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.049+0000 7fbaef45c740 1 -- 172.21.15.17:0/2553398808 shutdown_connections 2024-09-13T15:59:12.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.049+0000 7fbaef45c740 1 -- 172.21.15.17:0/2553398808 wait complete. 2024-09-13T15:59:12.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.049+0000 7fbaef45c740 20 client.25510 trim_cache size 0 max 16384 2024-09-13T15:59:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.076+0000 7fbaef45c740 1 Processor -- start 2024-09-13T15:59:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.077+0000 7fbaef45c740 1 -- start start 2024-09-13T15:59:12.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.078+0000 7fbaef45c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fb03b7c280 0x55fb03b7daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:12.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.078+0000 7fbaef45c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b7cbc0 0x55fb03b9e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.078+0000 7fbaef45c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb03b81c50 0x55fb03b7dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.078+0000 7fbaef45c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb0383de60 con 0x55fb03b7c280 2024-09-13T15:59:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.078+0000 7fbaef45c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb03b7d0a0 con 0x55fb03b81c50 2024-09-13T15:59:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.078+0000 7fbaef45c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb03b95cb0 con 0x55fb03b7cbc0 2024-09-13T15:59:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.079+0000 7fbae9200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b7cbc0 0x55fb03b9e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.079+0000 7fbae9200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b7cbc0 0x55fb03b9e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:38368/0 (socket says 172.21.15.17:38368) 2024-09-13T15:59:12.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.079+0000 7fbae9200640 1 -- 172.21.15.17:0/3601703641 learned_addr learned my addr 172.21.15.17:0/3601703641 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:59:12.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.079+0000 7fbaea600640 1 --2- 172.21.15.17:0/3601703641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb03b81c50 0x55fb03b7dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.079+0000 7fbae9c00640 1 --2- 172.21.15.17:0/3601703641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fb03b7c280 0x55fb03b7daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.079+0000 7fbaea600640 1 -- 172.21.15.17:0/3601703641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b7cbc0 msgr2=0x55fb03b9e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.079+0000 7fbaea600640 1 --2- 172.21.15.17:0/3601703641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b7cbc0 0x55fb03b9e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.079+0000 7fbaea600640 1 -- 172.21.15.17:0/3601703641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fb03b7c280 msgr2=0x55fb03b7daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.079+0000 7fbaea600640 1 --2- 172.21.15.17:0/3601703641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fb03b7c280 0x55fb03b7daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.079+0000 7fbaea600640 1 -- 172.21.15.17:0/3601703641 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb03a77180 con 0x55fb03b81c50 2024-09-13T15:59:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.080+0000 7fbae9200640 1 --2- 172.21.15.17:0/3601703641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b7cbc0 0x55fb03b9e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:59:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.080+0000 7fbaea600640 1 --2- 172.21.15.17:0/3601703641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb03b81c50 0x55fb03b7dfe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbadc0974d0 tx=0x7fbadc0072a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc37467f51110152 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:12.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.080+0000 7fbad7400640 1 -- 172.21.15.17:0/3601703641 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc096530 con 0x55fb03b81c50 2024-09-13T15:59:12.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.081+0000 7fbad7400640 1 -- 172.21.15.17:0/3601703641 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbadc099b10 con 0x55fb03b81c50 2024-09-13T15:59:12.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.081+0000 7fbad7400640 1 -- 172.21.15.17:0/3601703641 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc098810 con 0x55fb03b81c50 2024-09-13T15:59:12.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.082+0000 7fbaef45c740 1 -- 172.21.15.17:0/3601703641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb03b81c50 msgr2=0x55fb03b7dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:12.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.082+0000 7fbaef45c740 1 --2- 172.21.15.17:0/3601703641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb03b81c50 0x55fb03b7dfe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbadc0974d0 tx=0x7fbadc0072a0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.082+0000 7fbaef45c740 1 -- 172.21.15.17:0/3601703641 shutdown_connections 2024-09-13T15:59:12.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.082+0000 7fbaef45c740 1 --2- 172.21.15.17:0/3601703641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb03b81c50 0x55fb03b7dfe0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.082+0000 7fbaef45c740 1 --2- 172.21.15.17:0/3601703641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b7cbc0 0x55fb03b9e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.082+0000 7fbaef45c740 1 --2- 172.21.15.17:0/3601703641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fb03b7c280 0x55fb03b7daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.082+0000 7fbaef45c740 1 -- 172.21.15.17:0/3601703641 >> 172.21.15.17:0/3601703641 conn(0x55fb03b778f0 msgr2=0x55fb03b810c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:12.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.083+0000 7fbaef45c740 1 -- 172.21.15.17:0/3601703641 shutdown_connections 2024-09-13T15:59:12.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.083+0000 7fbaef45c740 1 -- 172.21.15.17:0/3601703641 wait complete. 2024-09-13T15:59:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.083+0000 7fbaef45c740 1 -- start start 2024-09-13T15:59:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.084+0000 7fbaef45c740 1 Processor -- start 2024-09-13T15:59:12.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.085+0000 7fbaef45c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b7c280 0x55fb03b9bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.085+0000 7fbaef45c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb03b7cbc0 0x55fb03b9c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.085+0000 7fbaef45c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fb03b81c50 0x55fb03b9d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.085+0000 7fbaef45c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb03b9d5c0 con 0x55fb03b81c50 2024-09-13T15:59:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.085+0000 7fbaef45c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb03b9d730 con 0x55fb03b7cbc0 2024-09-13T15:59:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.085+0000 7fbaef45c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb03b9d8f0 con 0x55fb03b7c280 2024-09-13T15:59:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.085+0000 7fbaef45c740 10 client.0 _ll_register_callbacks cb 0x7fbad000b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:59:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.085+0000 7fbae9200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb03b7cbc0 0x55fb03b9c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:12.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.085+0000 7fbae9200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb03b7cbc0 0x55fb03b9c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:49782/0 (socket says 172.21.15.17:49782) 2024-09-13T15:59:12.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.085+0000 7fbae9200640 1 -- 172.21.15.17:0/2333043419 learned_addr learned my addr 172.21.15.17:0/2333043419 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:59:12.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.085+0000 7fbae9c00640 1 --2- 172.21.15.17:0/2333043419 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b7c280 0x55fb03b9bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.085+0000 7fbaea600640 1 --2- 172.21.15.17:0/2333043419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fb03b81c50 0x55fb03b9d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.086+0000 7fbae9200640 1 -- 172.21.15.17:0/2333043419 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b7c280 msgr2=0x55fb03b9bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.086+0000 7fbae9200640 1 --2- 172.21.15.17:0/2333043419 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b7c280 0x55fb03b9bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.086+0000 7fbae9200640 1 -- 172.21.15.17:0/2333043419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fb03b81c50 msgr2=0x55fb03b9d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.086+0000 7fbae9200640 1 --2- 172.21.15.17:0/2333043419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fb03b81c50 0x55fb03b9d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.086+0000 7fbae9200640 1 -- 172.21.15.17:0/2333043419 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae4107110 con 0x55fb03b7cbc0 2024-09-13T15:59:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.086+0000 7fbae9c00640 1 --2- 172.21.15.17:0/2333043419 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b7c280 0x55fb03b9bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:59:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.086+0000 7fbacb400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T15:59:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.086+0000 7fbae9200640 1 --2- 172.21.15.17:0/2333043419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb03b7cbc0 0x55fb03b9c0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009900 tx=0x7fbad8009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75e835fee8c2d9e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.087+0000 7fbacb400640 1 -- 172.21.15.17:0/2333043419 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad80335b0 con 0x55fb03b7cbc0 2024-09-13T15:59:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.087+0000 7fbacb400640 1 -- 172.21.15.17:0/2333043419 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fbad8033710 con 0x55fb03b7cbc0 2024-09-13T15:59:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.087+0000 7fbaef45c740 1 -- 172.21.15.17:0/2333043419 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbad0015070 con 0x55fb03b7cbc0 2024-09-13T15:59:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.087+0000 7fbacb400640 1 -- 172.21.15.17:0/2333043419 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbad80335b0 con 0x55fb03b7cbc0 2024-09-13T15:59:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.088+0000 7fbaef45c740 10 client.25496 fetch_fsmap learned FSMap version 28 2024-09-13T15:59:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.088+0000 7fbaef45c740 1 -- 172.21.15.17:0/2333043419 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55fb03ad5170 con 0x55fb03b7cbc0 2024-09-13T15:59:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.088+0000 7fbacb400640 1 -- 172.21.15.17:0/2333043419 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbad8033d90 con 0x55fb03b7cbc0 2024-09-13T15:59:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.088+0000 7fbacb400640 1 -- 172.21.15.17:0/2333043419 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fbad802bd20 con 0x55fb03b7cbc0 2024-09-13T15:59:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.089+0000 7fbaef45c740 10 client.25496 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T15:59:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.089+0000 7fbaef45c740 10 client.25496 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T15:59:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.089+0000 7fbaef45c740 20 client.25496 populate_metadata read hostname 'smithi017' 2024-09-13T15:59:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.089+0000 7fbaef45c740 1 --2- 172.21.15.17:0/2333043419 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55fb03bf9a30 0x55fb03bfbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.089+0000 7fbaef45c740 4 client.25496 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T15:59:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.089+0000 7fbaef45c740 1 -- 172.21.15.17:0/2333043419 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7fbad0015070 con 0x55fb03bf9a30 2024-09-13T15:59:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.090+0000 7fbae9c00640 1 --2- 172.21.15.17:0/2333043419 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55fb03bf9a30 0x55fb03bfbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:12.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.093+0000 7fbae9c00640 1 --2- 172.21.15.17:0/2333043419 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55fb03bf9a30 0x55fb03bfbe50 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6db0c5962a36981e server_cookie=43176194dbb27dd7 in_seq=0 out_seq=0 2024-09-13T15:59:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.093+0000 7fbacb400640 10 client.25496 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:59:12.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.116+0000 7fbacb400640 1 -- 172.21.15.17:0/2333043419 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7fbad0015070 con 0x55fb03bf9a30 2024-09-13T15:59:12.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.116+0000 7fbacb400640 10 client.25496 handle_command_reply: tid=0 2024-09-13T15:59:12.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.116+0000 7fbaef45c740 1 client.25496 shutdown 2024-09-13T15:59:12.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.116+0000 7fbaef45c740 1 -- 172.21.15.17:0/2333043419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb03b7cbc0 msgr2=0x55fb03b9c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:12.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.116+0000 7fbaef45c740 1 --2- 172.21.15.17:0/2333043419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb03b7cbc0 0x55fb03b9c0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009900 tx=0x7fbad8009260 comp rx=0 tx=0).stop 2024-09-13T15:59:12.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.117+0000 7fbaef45c740 1 -- 172.21.15.17:0/2333043419 shutdown_connections 2024-09-13T15:59:12.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.117+0000 7fbaef45c740 1 --2- 172.21.15.17:0/2333043419 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55fb03bf9a30 0x55fb03bfbe50 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.117+0000 7fbaef45c740 1 --2- 172.21.15.17:0/2333043419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fb03b81c50 0x55fb03b9d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.117+0000 7fbaef45c740 1 --2- 172.21.15.17:0/2333043419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb03b7cbc0 0x55fb03b9c0c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.117+0000 7fbaef45c740 1 --2- 172.21.15.17:0/2333043419 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fb03b7c280 0x55fb03b9bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.117+0000 7fbaef45c740 1 -- 172.21.15.17:0/2333043419 >> 172.21.15.17:0/2333043419 conn(0x55fb03b778f0 msgr2=0x55fb03b80ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:12.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.117+0000 7fbacb400640 0 client.25496 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:59:12.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.119+0000 7fbaef45c740 1 -- 172.21.15.17:0/2333043419 shutdown_connections 2024-09-13T15:59:12.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.119+0000 7fbaef45c740 1 -- 172.21.15.17:0/2333043419 wait complete. 2024-09-13T15:59:12.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.119+0000 7fbaef45c740 20 client.25496 trim_cache size 0 max 16384 2024-09-13T15:59:12.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T15:59:12.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T15:59:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T15:59:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T15:59:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.120+0000 7fbaec600640 1 -- 172.21.15.17:0/1424858119 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbacc0a1150 msgr2=0x7fbacc0a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.120+0000 7fbaec600640 1 --2- 172.21.15.17:0/1424858119 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbacc0a1150 0x7fbacc0a3610 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009230 tx=0x7fbad80324a0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.120+0000 7fbaec600640 1 -- 172.21.15.17:0/1424858119 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbae419d660 msgr2=0x7fbae419fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.120+0000 7fbaec600640 1 --2- 172.21.15.17:0/1424858119 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbae419d660 0x7fbae419fa50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00cab0 tx=0x7fbadc00cf70 comp rx=0 tx=0).stop 2024-09-13T15:59:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.120+0000 7fbaec600640 1 -- 172.21.15.17:0/1424858119 shutdown_connections 2024-09-13T15:59:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.120+0000 7fbaec600640 1 --2- 172.21.15.17:0/1424858119 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbacc0a1150 0x7fbacc0a3610 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.120+0000 7fbaec600640 1 --2- 172.21.15.17:0/1424858119 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbae419d660 0x7fbae419fa50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.120+0000 7fbaec600640 1 --2- 172.21.15.17:0/1424858119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbae40fff80 0x7fbae4198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.120+0000 7fbaec600640 1 --2- 172.21.15.17:0/1424858119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbae40fe3d0 0x7fbae41980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.120+0000 7fbaec600640 1 -- 172.21.15.17:0/1424858119 >> 172.21.15.17:0/1424858119 conn(0x7fbae40f9b50 msgr2=0x7fbae4104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:12.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.121+0000 7fbaec600640 1 -- 172.21.15.17:0/1424858119 shutdown_connections 2024-09-13T15:59:12.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:12.121+0000 7fbaec600640 1 -- 172.21.15.17:0/1424858119 wait complete. 2024-09-13T15:59:12.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:12 smithi189 ceph-mon[34790]: pgmap v429: 129 pgs: 129 active+clean; 1018 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.6 MiB/s wr, 592 op/s 2024-09-13T15:59:12.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:12 smithi193 ceph-mon[35248]: pgmap v429: 129 pgs: 129 active+clean; 1018 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.6 MiB/s wr, 592 op/s 2024-09-13T15:59:12.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:12 smithi017 ceph-mon[30494]: pgmap v429: 129 pgs: 129 active+clean; 1018 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.6 MiB/s wr, 592 op/s 2024-09-13T15:59:14.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:14 smithi189 ceph-mon[34790]: pgmap v430: 129 pgs: 129 active+clean; 1018 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.6 MiB/s wr, 595 op/s 2024-09-13T15:59:14.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:14 smithi193 ceph-mon[35248]: pgmap v430: 129 pgs: 129 active+clean; 1018 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.6 MiB/s wr, 595 op/s 2024-09-13T15:59:14.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:14 smithi017 ceph-mon[30494]: pgmap v430: 129 pgs: 129 active+clean; 1018 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.6 MiB/s wr, 595 op/s 2024-09-13T15:59:15.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 90.0 s, 1905.8 tps, lat 52.461 ms stddev 82.023 2024-09-13T15:59:16.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:16 smithi189 ceph-mon[34790]: pgmap v431: 129 pgs: 129 active+clean; 1018 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.6 MiB/s wr, 599 op/s 2024-09-13T15:59:16.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:16 smithi193 ceph-mon[35248]: pgmap v431: 129 pgs: 129 active+clean; 1018 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.6 MiB/s wr, 599 op/s 2024-09-13T15:59:16.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:16 smithi017 ceph-mon[30494]: pgmap v431: 129 pgs: 129 active+clean; 1018 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.6 MiB/s wr, 599 op/s 2024-09-13T15:59:18.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:18 smithi189 ceph-mon[34790]: pgmap v432: 129 pgs: 129 active+clean; 1018 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.8 MiB/s wr, 637 op/s 2024-09-13T15:59:18.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:18 smithi193 ceph-mon[35248]: pgmap v432: 129 pgs: 129 active+clean; 1018 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.8 MiB/s wr, 637 op/s 2024-09-13T15:59:18.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:18 smithi017 ceph-mon[30494]: pgmap v432: 129 pgs: 129 active+clean; 1018 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.8 MiB/s wr, 637 op/s 2024-09-13T15:59:20.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 95.0 s, 2390.6 tps, lat 41.673 ms stddev 59.172 2024-09-13T15:59:20.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:20 smithi189 ceph-mon[34790]: pgmap v433: 129 pgs: 129 active+clean; 1021 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 853 op/s 2024-09-13T15:59:20.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:20 smithi193 ceph-mon[35248]: pgmap v433: 129 pgs: 129 active+clean; 1021 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 853 op/s 2024-09-13T15:59:20.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:20 smithi017 ceph-mon[30494]: pgmap v433: 129 pgs: 129 active+clean; 1021 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 853 op/s 2024-09-13T15:59:22.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:22 smithi189 ceph-mon[34790]: pgmap v434: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 853 op/s 2024-09-13T15:59:22.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:22 smithi193 ceph-mon[35248]: pgmap v434: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 853 op/s 2024-09-13T15:59:22.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:22 smithi017 ceph-mon[30494]: pgmap v434: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 853 op/s 2024-09-13T15:59:24.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:24 smithi189 ceph-mon[34790]: pgmap v435: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 935 op/s 2024-09-13T15:59:24.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:24 smithi193 ceph-mon[35248]: pgmap v435: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 935 op/s 2024-09-13T15:59:24.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:24 smithi017 ceph-mon[30494]: pgmap v435: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 935 op/s 2024-09-13T15:59:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 100.0 s, 2192.6 tps, lat 45.616 ms stddev 53.738 2024-09-13T15:59:25.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.326+0000 7f9699200640 1 -- 172.21.15.17:0/2876482278 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96940ff0d0 msgr2=0x7f96940ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.326+0000 7f9699200640 1 --2- 172.21.15.17:0/2876482278 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96940ff0d0 0x7f96940ff550 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9680009860 tx=0x7f968002e770 comp rx=0 tx=0).stop 2024-09-13T15:59:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.327+0000 7f9699200640 1 -- 172.21.15.17:0/2876482278 shutdown_connections 2024-09-13T15:59:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.327+0000 7f9699200640 1 --2- 172.21.15.17:0/2876482278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96940ffa90 0x7f96941063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.327+0000 7f9699200640 1 --2- 172.21.15.17:0/2876482278 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96940ff0d0 0x7f96940ff550 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.327+0000 7f9699200640 1 --2- 172.21.15.17:0/2876482278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96940fdf00 0x7f96940fe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.327+0000 7f9699200640 1 -- 172.21.15.17:0/2876482278 >> 172.21.15.17:0/2876482278 conn(0x7f96940f96d0 msgr2=0x7f96940fbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.328+0000 7f9699200640 1 -- 172.21.15.17:0/2876482278 shutdown_connections 2024-09-13T15:59:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.328+0000 7f9699200640 1 -- 172.21.15.17:0/2876482278 wait complete. 2024-09-13T15:59:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.330+0000 7f9699200640 1 Processor -- start 2024-09-13T15:59:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.332+0000 7f9699200640 1 -- start start 2024-09-13T15:59:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.333+0000 7f9699200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96940fdf00 0x7f969419c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.333+0000 7f9699200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96940ff0d0 0x7f969419c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:25.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.333+0000 7f9699200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96940ffa90 0x7f96941a3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:25.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.333+0000 7f9699200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96941a3ea0 con 0x7f96940ffa90 2024-09-13T15:59:25.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.333+0000 7f9699200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96941a4010 con 0x7f96940fdf00 2024-09-13T15:59:25.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.333+0000 7f9699200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96941a41d0 con 0x7f96940ff0d0 2024-09-13T15:59:25.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.333+0000 7f9691e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96940fdf00 0x7f969419c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:25.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.333+0000 7f9691e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96940fdf00 0x7f969419c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:35192/0 (socket says 172.21.15.17:35192) 2024-09-13T15:59:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.334+0000 7f9691e00640 1 -- 172.21.15.17:0/407328624 learned_addr learned my addr 172.21.15.17:0/407328624 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:59:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.334+0000 7f9691400640 1 --2- 172.21.15.17:0/407328624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96940ff0d0 0x7f969419c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.334+0000 7f9692800640 1 --2- 172.21.15.17:0/407328624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96940ffa90 0x7f96941a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.336+0000 7f9691e00640 1 -- 172.21.15.17:0/407328624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96940ff0d0 msgr2=0x7f969419c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:25.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.336+0000 7f9691e00640 1 --2- 172.21.15.17:0/407328624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96940ff0d0 0x7f969419c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.336+0000 7f9691e00640 1 -- 172.21.15.17:0/407328624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96940ffa90 msgr2=0x7f96941a3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:25.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.336+0000 7f9691e00640 1 --2- 172.21.15.17:0/407328624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96940ffa90 0x7f96941a3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.336+0000 7f9691e00640 1 -- 172.21.15.17:0/407328624 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9680009490 con 0x7f96940fdf00 2024-09-13T15:59:25.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.336+0000 7f9691400640 1 --2- 172.21.15.17:0/407328624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96940ff0d0 0x7f969419c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:59:25.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.336+0000 7f9691e00640 1 --2- 172.21.15.17:0/407328624 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96940fdf00 0x7f969419c3b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f968400e9d0 tx=0x7f968400ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.337+0000 7f968aa00640 1 -- 172.21.15.17:0/407328624 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684008ae0 con 0x7f96940fdf00 2024-09-13T15:59:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.337+0000 7f968aa00640 1 -- 172.21.15.17:0/407328624 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9684008c40 con 0x7f96940fdf00 2024-09-13T15:59:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.337+0000 7f968aa00640 1 -- 172.21.15.17:0/407328624 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684003b80 con 0x7f96940fdf00 2024-09-13T15:59:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.337+0000 7f9699200640 1 -- 172.21.15.17:0/407328624 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96941a44b0 con 0x7f96940fdf00 2024-09-13T15:59:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.337+0000 7f9699200640 1 -- 172.21.15.17:0/407328624 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96941a49c0 con 0x7f96940fdf00 2024-09-13T15:59:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.345+0000 7f968aa00640 1 -- 172.21.15.17:0/407328624 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9684003d00 con 0x7f96940fdf00 2024-09-13T15:59:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.348+0000 7f968aa00640 1 --2- 172.21.15.17:0/407328624 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f96780a11e0 0x7f96780a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.348+0000 7f968aa00640 1 -- 172.21.15.17:0/407328624 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f96840cc760 con 0x7f96940fdf00 2024-09-13T15:59:25.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.348+0000 7f9691400640 1 --2- 172.21.15.17:0/407328624 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f96780a11e0 0x7f96780a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:25.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.349+0000 7f969c025740 1 Processor -- start 2024-09-13T15:59:25.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.349+0000 7f969c025740 1 -- start start 2024-09-13T15:59:25.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.350+0000 7f969c025740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b2967a70 0x5559b2967e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:25.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.350+0000 7f969c025740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b29683b0 0x5559b296ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:25.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.350+0000 7f969c025740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b296d440 0x5559b296f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:25.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.350+0000 7f969c025740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559b2873bb0 con 0x5559b296d440 2024-09-13T15:59:25.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.350+0000 7f969c025740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559b28d1a70 con 0x5559b29683b0 2024-09-13T15:59:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.350+0000 7f969c025740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559b28cf200 con 0x5559b2967a70 2024-09-13T15:59:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.350+0000 7f9691e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b2967a70 0x5559b2967e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.350+0000 7f9691400640 1 --2- 172.21.15.17:0/407328624 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f96780a11e0 0x7f96780a36a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9680009830 tx=0x7f9680034780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.351+0000 7f9691e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b2967a70 0x5559b2967e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:33966/0 (socket says 172.21.15.17:33966) 2024-09-13T15:59:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.351+0000 7f9691e00640 1 -- 172.21.15.17:0/3721043749 learned_addr learned my addr 172.21.15.17:0/3721043749 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:59:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.351+0000 7f9691400640 1 --2- 172.21.15.17:0/3721043749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b29683b0 0x5559b296ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.351+0000 7f9691e00640 1 -- 172.21.15.17:0/3721043749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b29683b0 msgr2=0x5559b296ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.351+0000 7f9691e00640 1 --2- 172.21.15.17:0/3721043749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b29683b0 0x5559b296ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.351+0000 7f9691e00640 1 -- 172.21.15.17:0/3721043749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b296d440 msgr2=0x5559b296f900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:59:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.351+0000 7f9691e00640 1 --2- 172.21.15.17:0/3721043749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b296d440 0x5559b296f900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.351+0000 7f9691e00640 1 -- 172.21.15.17:0/3721043749 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559b286c940 con 0x5559b2967a70 2024-09-13T15:59:25.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.352+0000 7f9691e00640 1 --2- 172.21.15.17:0/3721043749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b2967a70 0x5559b2967e70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9684095d60 tx=0x7f96840991c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b00e4588b1b7b4bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:25.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.352+0000 7f967f400640 1 -- 172.21.15.17:0/3721043749 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840b2210 con 0x5559b2967a70 2024-09-13T15:59:25.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.353+0000 7f967f400640 1 -- 172.21.15.17:0/3721043749 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f968409d690 con 0x5559b2967a70 2024-09-13T15:59:25.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.353+0000 7f967f400640 1 -- 172.21.15.17:0/3721043749 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684098d50 con 0x5559b2967a70 2024-09-13T15:59:25.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.354+0000 7f969c025740 1 -- 172.21.15.17:0/3721043749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b2967a70 msgr2=0x5559b2967e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:25.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.354+0000 7f969c025740 1 --2- 172.21.15.17:0/3721043749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b2967a70 0x5559b2967e70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9684095d60 tx=0x7f96840991c0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.356+0000 7f969c025740 1 -- 172.21.15.17:0/3721043749 shutdown_connections 2024-09-13T15:59:25.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.356+0000 7f969c025740 1 --2- 172.21.15.17:0/3721043749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b296d440 0x5559b296f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.356+0000 7f969c025740 1 --2- 172.21.15.17:0/3721043749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b29683b0 0x5559b296ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.356+0000 7f969c025740 1 --2- 172.21.15.17:0/3721043749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b2967a70 0x5559b2967e70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.356+0000 7f969c025740 1 -- 172.21.15.17:0/3721043749 >> 172.21.15.17:0/3721043749 conn(0x5559b29630e0 msgr2=0x5559b29634e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.356+0000 7f969c025740 1 -- 172.21.15.17:0/3721043749 shutdown_connections 2024-09-13T15:59:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.356+0000 7f969c025740 1 -- 172.21.15.17:0/3721043749 wait complete. 2024-09-13T15:59:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.357+0000 7f969c025740 1 -- start start 2024-09-13T15:59:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.358+0000 7f969c025740 1 Processor -- start 2024-09-13T15:59:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.360+0000 7f969c025740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b2967a70 0x5559b29717a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.360+0000 7f969c025740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b29683b0 0x5559b2971ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.360+0000 7f969c025740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b296d440 0x5559b2978cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.360+0000 7f9691e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b2967a70 0x5559b29717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.360+0000 7f9691e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b2967a70 0x5559b29717a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:35210/0 (socket says 172.21.15.17:35210) 2024-09-13T15:59:25.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.361+0000 7f969c025740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559b28caaf0 con 0x5559b29683b0 2024-09-13T15:59:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.361+0000 7f969c025740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559b2888f20 con 0x5559b2967a70 2024-09-13T15:59:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.361+0000 7f969c025740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559b2888bc0 con 0x5559b296d440 2024-09-13T15:59:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.361+0000 7f969c025740 10 client.0 _ll_register_callbacks cb 0x5559b28baa70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:59:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.362+0000 7f9691400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b29683b0 0x5559b2971ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.362+0000 7f9691e00640 1 -- 172.21.15.17:0/1809336717 learned_addr learned my addr 172.21.15.17:0/1809336717 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:59:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.361+0000 7f9692800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b296d440 0x5559b2978cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.362+0000 7f9691e00640 1 -- 172.21.15.17:0/1809336717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b296d440 msgr2=0x5559b2978cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.362+0000 7f9691e00640 1 --2- 172.21.15.17:0/1809336717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b296d440 0x5559b2978cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.362+0000 7f9691e00640 1 -- 172.21.15.17:0/1809336717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b29683b0 msgr2=0x5559b2971ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.362+0000 7f9691e00640 1 --2- 172.21.15.17:0/1809336717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b29683b0 0x5559b2971ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.362+0000 7f9691e00640 1 -- 172.21.15.17:0/1809336717 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96941a49c0 con 0x5559b2967a70 2024-09-13T15:59:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.363+0000 7f9691e00640 1 --2- 172.21.15.17:0/1809336717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b2967a70 0x5559b29717a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9684097e50 tx=0x7f9684097c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fce0fe483b4e49a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.363+0000 7f9673e00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T15:59:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.364+0000 7f9673e00640 1 -- 172.21.15.17:0/1809336717 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840979a0 con 0x5559b2967a70 2024-09-13T15:59:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.364+0000 7f9673e00640 1 -- 172.21.15.17:0/1809336717 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f96840a1a60 con 0x5559b2967a70 2024-09-13T15:59:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.364+0000 7f969c025740 1 -- 172.21.15.17:0/1809336717 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5559b28f4c90 con 0x5559b2967a70 2024-09-13T15:59:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.365+0000 7f9673e00640 1 -- 172.21.15.17:0/1809336717 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96840b90b0 con 0x5559b2967a70 2024-09-13T15:59:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.366+0000 7f969c025740 10 client.25508 fetch_fsmap learned FSMap version 28 2024-09-13T15:59:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.366+0000 7f969c025740 1 -- 172.21.15.17:0/1809336717 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5559b28c9170 con 0x5559b2967a70 2024-09-13T15:59:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.366+0000 7f9673e00640 1 -- 172.21.15.17:0/1809336717 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5559b28f4c90 con 0x5559b2967a70 2024-09-13T15:59:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.366+0000 7f9673e00640 1 -- 172.21.15.17:0/1809336717 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f9684021020 con 0x5559b2967a70 2024-09-13T15:59:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.366+0000 7f969c025740 10 client.25508 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T15:59:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.366+0000 7f969c025740 10 client.25508 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T15:59:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.366+0000 7f969c025740 20 client.25508 populate_metadata read hostname 'smithi017' 2024-09-13T15:59:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.366+0000 7f969c025740 1 --2- 172.21.15.17:0/1809336717 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5559b297d110 0x5559b297f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.366+0000 7f969c025740 4 client.25508 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:59:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.366+0000 7f969c025740 1 -- 172.21.15.17:0/1809336717 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5559b28bd7d0 con 0x5559b297d110 2024-09-13T15:59:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.367+0000 7f9691400640 1 --2- 172.21.15.17:0/1809336717 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5559b297d110 0x5559b297f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.368+0000 7f9691400640 1 --2- 172.21.15.17:0/1809336717 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5559b297d110 0x5559b297f500 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1563b5ae34f7c66 server_cookie=542f1ee5726fbbca in_seq=0 out_seq=0 2024-09-13T15:59:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.368+0000 7f9673e00640 10 client.25508 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:59:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.369+0000 7f9673e00640 1 -- 172.21.15.17:0/1809336717 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5559b28bd7d0 con 0x5559b297d110 2024-09-13T15:59:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.369+0000 7f9673e00640 10 client.25508 handle_command_reply: tid=0 2024-09-13T15:59:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.370+0000 7f969c025740 1 client.25508 shutdown 2024-09-13T15:59:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.372+0000 7f969c025740 1 -- 172.21.15.17:0/1809336717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b2967a70 msgr2=0x5559b29717a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.372+0000 7f969c025740 1 --2- 172.21.15.17:0/1809336717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b2967a70 0x5559b29717a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9684097e50 tx=0x7f9684097c70 comp rx=0 tx=0).stop 2024-09-13T15:59:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.372+0000 7f969c025740 1 -- 172.21.15.17:0/1809336717 shutdown_connections 2024-09-13T15:59:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.372+0000 7f969c025740 1 --2- 172.21.15.17:0/1809336717 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5559b297d110 0x5559b297f500 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.372+0000 7f969c025740 1 --2- 172.21.15.17:0/1809336717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b296d440 0x5559b2978cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.372+0000 7f969c025740 1 --2- 172.21.15.17:0/1809336717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b29683b0 0x5559b2971ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.372+0000 7f969c025740 1 --2- 172.21.15.17:0/1809336717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b2967a70 0x5559b29717a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.372+0000 7f969c025740 1 -- 172.21.15.17:0/1809336717 >> 172.21.15.17:0/1809336717 conn(0x5559b29630e0 msgr2=0x5559b29648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.372+0000 7f9673e00640 0 client.25508 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:59:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.373+0000 7f969c025740 1 -- 172.21.15.17:0/1809336717 shutdown_connections 2024-09-13T15:59:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.373+0000 7f969c025740 1 -- 172.21.15.17:0/1809336717 wait complete. 2024-09-13T15:59:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.373+0000 7f969c025740 20 client.25508 trim_cache size 0 max 16384 2024-09-13T15:59:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.398+0000 7f969c025740 1 Processor -- start 2024-09-13T15:59:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.398+0000 7f969c025740 1 -- start start 2024-09-13T15:59:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.398+0000 7f969c025740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b2967a70 0x5559b2969370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.398+0000 7f969c025740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b29683b0 0x5559b2978c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.398+0000 7f969c025740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b296d440 0x5559b29698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.398+0000 7f969c025740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559b2631e60 con 0x5559b2967a70 2024-09-13T15:59:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.398+0000 7f969c025740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559b2970070 con 0x5559b296d440 2024-09-13T15:59:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.398+0000 7f969c025740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559b28f4c90 con 0x5559b29683b0 2024-09-13T15:59:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.399+0000 7f9691e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b2967a70 0x5559b2969370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.399+0000 7f9691e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b2967a70 0x5559b2969370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52718/0 (socket says 172.21.15.17:52718) 2024-09-13T15:59:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.399+0000 7f9691e00640 1 -- 172.21.15.17:0/1495572275 learned_addr learned my addr 172.21.15.17:0/1495572275 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:59:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.399+0000 7f9691400640 1 --2- 172.21.15.17:0/1495572275 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b29683b0 0x5559b2978c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.399+0000 7f9692800640 1 --2- 172.21.15.17:0/1495572275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b296d440 0x5559b29698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.399+0000 7f9691e00640 1 -- 172.21.15.17:0/1495572275 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b29683b0 msgr2=0x5559b2978c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.399+0000 7f9691e00640 1 --2- 172.21.15.17:0/1495572275 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b29683b0 0x5559b2978c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.399+0000 7f9691e00640 1 -- 172.21.15.17:0/1495572275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b296d440 msgr2=0x5559b29698b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.399+0000 7f9691e00640 1 --2- 172.21.15.17:0/1495572275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b296d440 0x5559b29698b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.399+0000 7f9691e00640 1 -- 172.21.15.17:0/1495572275 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559b286b180 con 0x5559b2967a70 2024-09-13T15:59:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.400+0000 7f9691e00640 1 --2- 172.21.15.17:0/1495572275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b2967a70 0x5559b2969370 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f96840ca280 tx=0x7f96840991c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3174c42e0c24f553 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.401+0000 7f967fe00640 1 -- 172.21.15.17:0/1495572275 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840959d0 con 0x5559b2967a70 2024-09-13T15:59:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.401+0000 7f967fe00640 1 -- 172.21.15.17:0/1495572275 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96840979a0 con 0x5559b2967a70 2024-09-13T15:59:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.401+0000 7f967fe00640 1 -- 172.21.15.17:0/1495572275 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840ad2a0 con 0x5559b2967a70 2024-09-13T15:59:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.402+0000 7f969c025740 1 -- 172.21.15.17:0/1495572275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b2967a70 msgr2=0x5559b2969370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.402+0000 7f969c025740 1 --2- 172.21.15.17:0/1495572275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b2967a70 0x5559b2969370 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f96840ca280 tx=0x7f96840991c0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.403+0000 7f969c025740 1 -- 172.21.15.17:0/1495572275 shutdown_connections 2024-09-13T15:59:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.403+0000 7f969c025740 1 --2- 172.21.15.17:0/1495572275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b296d440 0x5559b29698b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.403+0000 7f969c025740 1 --2- 172.21.15.17:0/1495572275 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b29683b0 0x5559b2978c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.403+0000 7f969c025740 1 --2- 172.21.15.17:0/1495572275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b2967a70 0x5559b2969370 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.403+0000 7f969c025740 1 -- 172.21.15.17:0/1495572275 >> 172.21.15.17:0/1495572275 conn(0x5559b29630e0 msgr2=0x5559b29634c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.405+0000 7f969c025740 1 -- 172.21.15.17:0/1495572275 shutdown_connections 2024-09-13T15:59:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.405+0000 7f969c025740 1 -- 172.21.15.17:0/1495572275 wait complete. 2024-09-13T15:59:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.406+0000 7f969c025740 1 -- start start 2024-09-13T15:59:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.406+0000 7f969c025740 1 Processor -- start 2024-09-13T15:59:25.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.407+0000 7f969c025740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b2967a70 0x5559b2978420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.407+0000 7f969c025740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b29683b0 0x5559b2978960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.407+0000 7f969c025740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b296d440 0x5559b2976a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.407+0000 7f969c025740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559b2976f70 con 0x5559b2967a70 2024-09-13T15:59:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.407+0000 7f969c025740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559b29770e0 con 0x5559b29683b0 2024-09-13T15:59:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.407+0000 7f969c025740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559b2977250 con 0x5559b296d440 2024-09-13T15:59:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.407+0000 7f969c025740 10 client.0 _ll_register_callbacks cb 0x7f9684003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:59:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.407+0000 7f9691e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b2967a70 0x5559b2978420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.407+0000 7f9691400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b29683b0 0x5559b2978960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.407+0000 7f9691e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b2967a70 0x5559b2978420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52730/0 (socket says 172.21.15.17:52730) 2024-09-13T15:59:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.407+0000 7f9691e00640 1 -- 172.21.15.17:0/2017146923 learned_addr learned my addr 172.21.15.17:0/2017146923 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:59:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.407+0000 7f9691400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b29683b0 0x5559b2978960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:35240/0 (socket says 172.21.15.17:35240) 2024-09-13T15:59:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.408+0000 7f9692800640 1 --2- 172.21.15.17:0/2017146923 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b296d440 0x5559b2976a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.409+0000 7f9692800640 1 -- 172.21.15.17:0/2017146923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b29683b0 msgr2=0x5559b2978960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.409+0000 7f9692800640 1 --2- 172.21.15.17:0/2017146923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b29683b0 0x5559b2978960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.409+0000 7f9692800640 1 -- 172.21.15.17:0/2017146923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b2967a70 msgr2=0x5559b2978420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.409+0000 7f9692800640 1 --2- 172.21.15.17:0/2017146923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b2967a70 0x5559b2978420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.409+0000 7f9692800640 1 -- 172.21.15.17:0/2017146923 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5559b28c9170 con 0x5559b296d440 2024-09-13T15:59:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.409+0000 7f9691e00640 1 --2- 172.21.15.17:0/2017146923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b2967a70 0x5559b2978420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:59:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.410+0000 7f9692800640 1 --2- 172.21.15.17:0/2017146923 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b296d440 0x5559b2976a30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x5559b2963f60 tx=0x7f968c007680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=932ca5a163abe7b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.410+0000 7f9673e00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T15:59:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.410+0000 7f9673e00640 1 -- 172.21.15.17:0/2017146923 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c010040 con 0x5559b296d440 2024-09-13T15:59:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.410+0000 7f9673e00640 1 -- 172.21.15.17:0/2017146923 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f968c017410 con 0x5559b296d440 2024-09-13T15:59:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.410+0000 7f969c025740 1 -- 172.21.15.17:0/2017146923 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f968409d690 con 0x5559b296d440 2024-09-13T15:59:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.411+0000 7f9673e00640 1 -- 172.21.15.17:0/2017146923 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f968c007e90 con 0x5559b296d440 2024-09-13T15:59:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.411+0000 7f969c025740 10 client.25534 fetch_fsmap learned FSMap version 28 2024-09-13T15:59:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.411+0000 7f969c025740 1 -- 172.21.15.17:0/2017146923 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5559b2890560 con 0x5559b296d440 2024-09-13T15:59:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.411+0000 7f9673e00640 1 -- 172.21.15.17:0/2017146923 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f968409d690 con 0x5559b296d440 2024-09-13T15:59:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.411+0000 7f9673e00640 1 -- 172.21.15.17:0/2017146923 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f968c008040 con 0x5559b296d440 2024-09-13T15:59:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.412+0000 7f969c025740 10 client.25534 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T15:59:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.412+0000 7f969c025740 10 client.25534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T15:59:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.412+0000 7f969c025740 20 client.25534 populate_metadata read hostname 'smithi017' 2024-09-13T15:59:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.412+0000 7f969c025740 1 --2- 172.21.15.17:0/2017146923 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5559b29d49f0 0x5559b29d6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.412+0000 7f969c025740 4 client.25534 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T15:59:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.412+0000 7f969c025740 1 -- 172.21.15.17:0/2017146923 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5559b25be300 con 0x5559b29d49f0 2024-09-13T15:59:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.412+0000 7f9691e00640 1 --2- 172.21.15.17:0/2017146923 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5559b29d49f0 0x5559b29d6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:25.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.413+0000 7f9673e00640 10 client.25534 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:59:25.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.413+0000 7f9691e00640 1 --2- 172.21.15.17:0/2017146923 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5559b29d49f0 0x5559b29d6e10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d65e402e3219c552 server_cookie=2bcd6074c1ba2f67 in_seq=0 out_seq=0 2024-09-13T15:59:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.426+0000 7f9673e00640 1 -- 172.21.15.17:0/2017146923 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5559b25be300 con 0x5559b29d49f0 2024-09-13T15:59:25.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.426+0000 7f9673e00640 10 client.25534 handle_command_reply: tid=0 2024-09-13T15:59:25.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.426+0000 7f969c025740 1 client.25534 shutdown 2024-09-13T15:59:25.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.426+0000 7f969c025740 1 -- 172.21.15.17:0/2017146923 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b296d440 msgr2=0x5559b2976a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:25.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.426+0000 7f969c025740 1 --2- 172.21.15.17:0/2017146923 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b296d440 0x5559b2976a30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x5559b2963f60 tx=0x7f968c007680 comp rx=0 tx=0).stop 2024-09-13T15:59:25.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.427+0000 7f969c025740 1 -- 172.21.15.17:0/2017146923 shutdown_connections 2024-09-13T15:59:25.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.427+0000 7f969c025740 1 --2- 172.21.15.17:0/2017146923 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5559b29d49f0 0x5559b29d6e10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.427+0000 7f969c025740 1 --2- 172.21.15.17:0/2017146923 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559b296d440 0x5559b2976a30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.427+0000 7f969c025740 1 --2- 172.21.15.17:0/2017146923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559b29683b0 0x5559b2978960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.427+0000 7f969c025740 1 --2- 172.21.15.17:0/2017146923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559b2967a70 0x5559b2978420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.427+0000 7f969c025740 1 -- 172.21.15.17:0/2017146923 >> 172.21.15.17:0/2017146923 conn(0x5559b29630e0 msgr2=0x5559b29634c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:25.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.427+0000 7f9673e00640 0 client.25534 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:59:25.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.427+0000 7f969c025740 1 -- 172.21.15.17:0/2017146923 shutdown_connections 2024-09-13T15:59:25.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.427+0000 7f969c025740 1 -- 172.21.15.17:0/2017146923 wait complete. 2024-09-13T15:59:25.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.427+0000 7f969c025740 20 client.25534 trim_cache size 0 max 16384 2024-09-13T15:59:25.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T15:59:25.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T15:59:25.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T15:59:25.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T15:59:25.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.429+0000 7f9699200640 1 -- 172.21.15.17:0/407328624 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f96780a11e0 msgr2=0x7f96780a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:25.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.429+0000 7f9699200640 1 --2- 172.21.15.17:0/407328624 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f96780a11e0 0x7f96780a36a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9680009830 tx=0x7f9680034780 comp rx=0 tx=0).stop 2024-09-13T15:59:25.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.429+0000 7f9699200640 1 -- 172.21.15.17:0/407328624 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96940fdf00 msgr2=0x7f969419c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:25.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.429+0000 7f9699200640 1 --2- 172.21.15.17:0/407328624 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96940fdf00 0x7f969419c3b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f968400e9d0 tx=0x7f968400ee90 comp rx=0 tx=0).stop 2024-09-13T15:59:25.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.429+0000 7f9699200640 1 -- 172.21.15.17:0/407328624 shutdown_connections 2024-09-13T15:59:25.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.429+0000 7f9699200640 1 --2- 172.21.15.17:0/407328624 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f96780a11e0 0x7f96780a36a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.429+0000 7f9699200640 1 --2- 172.21.15.17:0/407328624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96940ffa90 0x7f96941a3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.429+0000 7f9699200640 1 --2- 172.21.15.17:0/407328624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96940ff0d0 0x7f969419c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.429+0000 7f9699200640 1 --2- 172.21.15.17:0/407328624 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96940fdf00 0x7f969419c3b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:25.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.429+0000 7f9699200640 1 -- 172.21.15.17:0/407328624 >> 172.21.15.17:0/407328624 conn(0x7f96940f96d0 msgr2=0x7f9694102710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:25.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.429+0000 7f9699200640 1 -- 172.21.15.17:0/407328624 shutdown_connections 2024-09-13T15:59:25.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:25.430+0000 7f9699200640 1 -- 172.21.15.17:0/407328624 wait complete. 2024-09-13T15:59:26.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:26 smithi189 ceph-mon[34790]: pgmap v436: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 927 op/s 2024-09-13T15:59:26.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:26 smithi193 ceph-mon[35248]: pgmap v436: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 927 op/s 2024-09-13T15:59:26.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:26 smithi017 ceph-mon[30494]: pgmap v436: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 927 op/s 2024-09-13T15:59:28.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:28 smithi189 ceph-mon[34790]: pgmap v437: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 856 op/s 2024-09-13T15:59:28.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:28 smithi193 ceph-mon[35248]: pgmap v437: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 856 op/s 2024-09-13T15:59:28.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:28 smithi017 ceph-mon[30494]: pgmap v437: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 856 op/s 2024-09-13T15:59:30.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 105.0 s, 1729.4 tps, lat 57.872 ms stddev 79.065 2024-09-13T15:59:30.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:30 smithi189 ceph-mon[34790]: pgmap v438: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 844 op/s 2024-09-13T15:59:30.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:30 smithi193 ceph-mon[35248]: pgmap v438: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 844 op/s 2024-09-13T15:59:30.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:30 smithi017 ceph-mon[30494]: pgmap v438: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 844 op/s 2024-09-13T15:59:32.608 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:32 smithi189 ceph-mon[34790]: pgmap v439: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 MiB/s wr, 658 op/s 2024-09-13T15:59:32.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:32 smithi193 ceph-mon[35248]: pgmap v439: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 MiB/s wr, 658 op/s 2024-09-13T15:59:32.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:32 smithi017 ceph-mon[30494]: pgmap v439: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 MiB/s wr, 658 op/s 2024-09-13T15:59:34.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:34 smithi189 ceph-mon[34790]: pgmap v440: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 MiB/s wr, 684 op/s 2024-09-13T15:59:34.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:34 smithi193 ceph-mon[35248]: pgmap v440: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 MiB/s wr, 684 op/s 2024-09-13T15:59:34.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:34 smithi017 ceph-mon[30494]: pgmap v440: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 MiB/s wr, 684 op/s 2024-09-13T15:59:35.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 110.0 s, 1797.4 tps, lat 55.740 ms stddev 68.737 2024-09-13T15:59:36.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:36 smithi189 ceph-mon[34790]: pgmap v441: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.2 MiB/s wr, 661 op/s 2024-09-13T15:59:36.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:36 smithi193 ceph-mon[35248]: pgmap v441: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.2 MiB/s wr, 661 op/s 2024-09-13T15:59:36.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:36 smithi017 ceph-mon[30494]: pgmap v441: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.2 MiB/s wr, 661 op/s 2024-09-13T15:59:37.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:37 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:59:37.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:37 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:59:37.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:37 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T15:59:38.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:38 smithi189 ceph-mon[34790]: pgmap v442: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.4 MiB/s wr, 625 op/s 2024-09-13T15:59:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.623+0000 7fb9a2800640 1 -- 172.21.15.17:0/521070288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb99c107940 msgr2=0x7fb99c107dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.623+0000 7fb9a2800640 1 --2- 172.21.15.17:0/521070288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb99c107940 0x7fb99c107dc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb988009860 tx=0x7fb98802a360 comp rx=0 tx=0).stop 2024-09-13T15:59:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.623+0000 7fb9a2800640 1 -- 172.21.15.17:0/521070288 shutdown_connections 2024-09-13T15:59:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.623+0000 7fb9a2800640 1 --2- 172.21.15.17:0/521070288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb99c108300 0x7fb99c10eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.623+0000 7fb9a2800640 1 --2- 172.21.15.17:0/521070288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb99c107940 0x7fb99c107dc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.623+0000 7fb9a2800640 1 --2- 172.21.15.17:0/521070288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb99c0718e0 0x7fb99c071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.623+0000 7fb9a2800640 1 -- 172.21.15.17:0/521070288 >> 172.21.15.17:0/521070288 conn(0x7fb99c06cf30 msgr2=0x7fb99c06f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.625+0000 7fb9a2800640 1 -- 172.21.15.17:0/521070288 shutdown_connections 2024-09-13T15:59:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.626+0000 7fb9a2800640 1 -- 172.21.15.17:0/521070288 wait complete. 2024-09-13T15:59:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.627+0000 7fb9a2800640 1 Processor -- start 2024-09-13T15:59:38.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.627+0000 7fb9a2800640 1 -- start start 2024-09-13T15:59:38.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.627+0000 7fb9a2800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb99c0718e0 0x7fb99c1a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:38.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.627+0000 7fb9a2800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb99c107940 0x7fb99c1a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:38.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.627+0000 7fb9a2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb99c108300 0x7fb99c1ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:38.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.627+0000 7fb9a2800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c1ac750 con 0x7fb99c108300 2024-09-13T15:59:38.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.627+0000 7fb9a2800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c1ac8c0 con 0x7fb99c107940 2024-09-13T15:59:38.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.627+0000 7fb9a2800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c1aca80 con 0x7fb99c0718e0 2024-09-13T15:59:38.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.628+0000 7fb99b400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb99c0718e0 0x7fb99c1a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:38.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.628+0000 7fb99aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb99c107940 0x7fb99c1a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:38.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.628+0000 7fb99b400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb99c0718e0 0x7fb99c1a4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:37958/0 (socket says 172.21.15.17:37958) 2024-09-13T15:59:38.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.628+0000 7fb99b400640 1 -- 172.21.15.17:0/808703836 learned_addr learned my addr 172.21.15.17:0/808703836 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:59:38.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.628+0000 7fb99be00640 1 --2- 172.21.15.17:0/808703836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb99c108300 0x7fb99c1ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:38.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.628+0000 7fb99b400640 1 -- 172.21.15.17:0/808703836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb99c107940 msgr2=0x7fb99c1a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:38.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.628+0000 7fb99b400640 1 --2- 172.21.15.17:0/808703836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb99c107940 0x7fb99c1a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.628+0000 7fb99b400640 1 -- 172.21.15.17:0/808703836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb99c108300 msgr2=0x7fb99c1ac1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:38.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.628+0000 7fb99b400640 1 --2- 172.21.15.17:0/808703836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb99c108300 0x7fb99c1ac1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.628+0000 7fb99b400640 1 -- 172.21.15.17:0/808703836 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb988009490 con 0x7fb99c0718e0 2024-09-13T15:59:38.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.628+0000 7fb99aa00640 1 --2- 172.21.15.17:0/808703836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb99c107940 0x7fb99c1a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:59:38.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.628+0000 7fb99b400640 1 --2- 172.21.15.17:0/808703836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb99c0718e0 0x7fb99c1a4c70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb98c009800 tx=0x7fb98c009cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:38.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.629+0000 7fb993e00640 1 -- 172.21.15.17:0/808703836 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c004020 con 0x7fb99c0718e0 2024-09-13T15:59:38.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.629+0000 7fb993e00640 1 -- 172.21.15.17:0/808703836 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb98c010040 con 0x7fb99c0718e0 2024-09-13T15:59:38.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.629+0000 7fb9a2800640 1 -- 172.21.15.17:0/808703836 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb99c1acd60 con 0x7fb99c0718e0 2024-09-13T15:59:38.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.629+0000 7fb993e00640 1 -- 172.21.15.17:0/808703836 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c003850 con 0x7fb99c0718e0 2024-09-13T15:59:38.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.630+0000 7fb9a2800640 1 -- 172.21.15.17:0/808703836 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb99c116a30 con 0x7fb99c0718e0 2024-09-13T15:59:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.638+0000 7fb993e00640 1 -- 172.21.15.17:0/808703836 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb98c00e6b0 con 0x7fb99c0718e0 2024-09-13T15:59:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.641+0000 7fb993e00640 1 --2- 172.21.15.17:0/808703836 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb9800a1290 0x7fb9800a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.641+0000 7fb993e00640 1 -- 172.21.15.17:0/808703836 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fb98c0cc3c0 con 0x7fb99c0718e0 2024-09-13T15:59:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.641+0000 7fb99aa00640 1 --2- 172.21.15.17:0/808703836 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb9800a1290 0x7fb9800a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.642+0000 7fb99aa00640 1 --2- 172.21.15.17:0/808703836 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb9800a1290 0x7fb9800a3750 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb988009830 tx=0x7fb9880305f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.642+0000 7fb9a5618740 1 Processor -- start 2024-09-13T15:59:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.643+0000 7fb9a5618740 1 -- start start 2024-09-13T15:59:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.643+0000 7fb9a5618740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087ada70 0x55c7087ade70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.643+0000 7fb9a5618740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7087ae3b0 0x55c7087b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.643+0000 7fb9a5618740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c7087b3440 0x55c7087b5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.643+0000 7fb9a5618740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7086b9bb0 con 0x55c7087ae3b0 2024-09-13T15:59:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.643+0000 7fb9a5618740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c708717a70 con 0x55c7087b3440 2024-09-13T15:59:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.643+0000 7fb9a5618740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c708715200 con 0x55c7087ada70 2024-09-13T15:59:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.643+0000 7fb99b400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087ada70 0x55c7087ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.643+0000 7fb99b400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087ada70 0x55c7087ade70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:37974/0 (socket says 172.21.15.17:37974) 2024-09-13T15:59:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.643+0000 7fb99b400640 1 -- 172.21.15.17:0/2946292063 learned_addr learned my addr 172.21.15.17:0/2946292063 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:59:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.644+0000 7fb99aa00640 1 --2- 172.21.15.17:0/2946292063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7087ae3b0 0x55c7087b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.644+0000 7fb99be00640 1 --2- 172.21.15.17:0/2946292063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c7087b3440 0x55c7087b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.644+0000 7fb99b400640 1 -- 172.21.15.17:0/2946292063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c7087b3440 msgr2=0x55c7087b5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.644+0000 7fb99b400640 1 --2- 172.21.15.17:0/2946292063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c7087b3440 0x55c7087b5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.644+0000 7fb99b400640 1 -- 172.21.15.17:0/2946292063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7087ae3b0 msgr2=0x55c7087b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.644+0000 7fb99b400640 1 --2- 172.21.15.17:0/2946292063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7087ae3b0 0x55c7087b2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.645+0000 7fb99b400640 1 -- 172.21.15.17:0/2946292063 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7086b2940 con 0x55c7087ada70 2024-09-13T15:59:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.645+0000 7fb99be00640 1 --2- 172.21.15.17:0/2946292063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c7087b3440 0x55c7087b5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:59:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.645+0000 7fb99b400640 1 --2- 172.21.15.17:0/2946292063 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087ada70 0x55c7087ade70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0958d0 tx=0x7fb98c095840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=567d1c6085b0f4b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.645+0000 7fb990c00640 1 -- 172.21.15.17:0/2946292063 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c099b60 con 0x55c7087ada70 2024-09-13T15:59:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.645+0000 7fb990c00640 1 -- 172.21.15.17:0/2946292063 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb98c099460 con 0x55c7087ada70 2024-09-13T15:59:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.645+0000 7fb990c00640 1 -- 172.21.15.17:0/2946292063 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c0a1450 con 0x55c7087ada70 2024-09-13T15:59:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.646+0000 7fb9a5618740 1 -- 172.21.15.17:0/2946292063 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087ada70 msgr2=0x55c7087ade70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.646+0000 7fb9a5618740 1 --2- 172.21.15.17:0/2946292063 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087ada70 0x55c7087ade70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0958d0 tx=0x7fb98c095840 comp rx=0 tx=0).stop 2024-09-13T15:59:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.647+0000 7fb9a5618740 1 -- 172.21.15.17:0/2946292063 shutdown_connections 2024-09-13T15:59:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.647+0000 7fb9a5618740 1 --2- 172.21.15.17:0/2946292063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c7087b3440 0x55c7087b5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.647+0000 7fb9a5618740 1 --2- 172.21.15.17:0/2946292063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7087ae3b0 0x55c7087b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.647+0000 7fb9a5618740 1 --2- 172.21.15.17:0/2946292063 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087ada70 0x55c7087ade70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.647+0000 7fb9a5618740 1 -- 172.21.15.17:0/2946292063 >> 172.21.15.17:0/2946292063 conn(0x55c7087a90e0 msgr2=0x55c7087a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.647+0000 7fb9a5618740 1 -- 172.21.15.17:0/2946292063 shutdown_connections 2024-09-13T15:59:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.647+0000 7fb9a5618740 1 -- 172.21.15.17:0/2946292063 wait complete. 2024-09-13T15:59:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.648+0000 7fb9a5618740 1 -- start start 2024-09-13T15:59:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.648+0000 7fb9a5618740 1 Processor -- start 2024-09-13T15:59:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.649+0000 7fb9a5618740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c7087ada70 0x55c7087b7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:38.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.649+0000 7fb9a5618740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087ae3b0 0x55c7087b7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:38.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.649+0000 7fb9a5618740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7087b3440 0x55c7087bec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:38.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.649+0000 7fb9a5618740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c708710af0 con 0x55c7087b3440 2024-09-13T15:59:38.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.649+0000 7fb9a5618740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7086cef20 con 0x55c7087ada70 2024-09-13T15:59:38.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.649+0000 7fb9a5618740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7086cebc0 con 0x55c7087ae3b0 2024-09-13T15:59:38.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.649+0000 7fb9a5618740 10 client.0 _ll_register_callbacks cb 0x55c708700a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:59:38.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.649+0000 7fb99aa00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087ae3b0 0x55c7087b7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:38.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.649+0000 7fb99b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c7087ada70 0x55c7087b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:38.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.649+0000 7fb99aa00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087ae3b0 0x55c7087b7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:37984/0 (socket says 172.21.15.17:37984) 2024-09-13T15:59:38.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.649+0000 7fb99aa00640 1 -- 172.21.15.17:0/2742268264 learned_addr learned my addr 172.21.15.17:0/2742268264 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:59:38.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.650+0000 7fb99be00640 1 --2- 172.21.15.17:0/2742268264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7087b3440 0x55c7087bec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:38.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.650+0000 7fb99aa00640 1 -- 172.21.15.17:0/2742268264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c7087ada70 msgr2=0x55c7087b7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:38.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.650+0000 7fb99aa00640 1 --2- 172.21.15.17:0/2742268264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c7087ada70 0x55c7087b7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.650+0000 7fb99aa00640 1 -- 172.21.15.17:0/2742268264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7087b3440 msgr2=0x55c7087bec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:38.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.650+0000 7fb99aa00640 1 --2- 172.21.15.17:0/2742268264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7087b3440 0x55c7087bec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.650+0000 7fb99aa00640 1 -- 172.21.15.17:0/2742268264 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb99c116a30 con 0x55c7087ae3b0 2024-09-13T15:59:38.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.651+0000 7fb99aa00640 1 --2- 172.21.15.17:0/2742268264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087ae3b0 0x55c7087b7c70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb988030520 tx=0x7fb988005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a6b8262e6cd18d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:38.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.651+0000 7fb985600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T15:59:38.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.652+0000 7fb985600640 1 -- 172.21.15.17:0/2742268264 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9880043c0 con 0x55c7087ae3b0 2024-09-13T15:59:38.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.652+0000 7fb985600640 1 -- 172.21.15.17:0/2742268264 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fb9880035f0 con 0x55c7087ae3b0 2024-09-13T15:59:38.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.652+0000 7fb9a5618740 1 -- 172.21.15.17:0/2742268264 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c70873ac90 con 0x55c7087ae3b0 2024-09-13T15:59:38.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.653+0000 7fb985600640 1 -- 172.21.15.17:0/2742268264 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9880043c0 con 0x55c7087ae3b0 2024-09-13T15:59:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.653+0000 7fb9a5618740 10 client.25546 fetch_fsmap learned FSMap version 28 2024-09-13T15:59:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.653+0000 7fb9a5618740 1 -- 172.21.15.17:0/2742268264 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55c70870f170 con 0x55c7087ae3b0 2024-09-13T15:59:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.654+0000 7fb985600640 1 -- 172.21.15.17:0/2742268264 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb988058030 con 0x55c7087ae3b0 2024-09-13T15:59:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.654+0000 7fb985600640 1 -- 172.21.15.17:0/2742268264 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fb98804f020 con 0x55c7087ae3b0 2024-09-13T15:59:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.654+0000 7fb9a5618740 10 client.25546 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T15:59:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.654+0000 7fb9a5618740 10 client.25546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T15:59:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.654+0000 7fb9a5618740 20 client.25546 populate_metadata read hostname 'smithi017' 2024-09-13T15:59:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.654+0000 7fb9a5618740 1 --2- 172.21.15.17:0/2742268264 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c7087c3360 0x55c7087c5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.655+0000 7fb9a5618740 4 client.25546 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:59:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.655+0000 7fb9a5618740 1 -- 172.21.15.17:0/2742268264 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c7087037d0 con 0x55c7087c3360 2024-09-13T15:59:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.657+0000 7fb99b400640 1 --2- 172.21.15.17:0/2742268264 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c7087c3360 0x55c7087c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.658+0000 7fb99b400640 1 --2- 172.21.15.17:0/2742268264 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c7087c3360 0x55c7087c5780 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f290dd603f5324f server_cookie=2fd18b7e0cf5042 in_seq=0 out_seq=0 2024-09-13T15:59:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.658+0000 7fb985600640 10 client.25546 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:59:38.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.660+0000 7fb985600640 1 -- 172.21.15.17:0/2742268264 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c7087037d0 con 0x55c7087c3360 2024-09-13T15:59:38.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.660+0000 7fb985600640 10 client.25546 handle_command_reply: tid=0 2024-09-13T15:59:38.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.661+0000 7fb9a5618740 1 client.25546 shutdown 2024-09-13T15:59:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.661+0000 7fb9a5618740 1 -- 172.21.15.17:0/2742268264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087ae3b0 msgr2=0x55c7087b7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.661+0000 7fb9a5618740 1 --2- 172.21.15.17:0/2742268264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087ae3b0 0x55c7087b7c70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb988030520 tx=0x7fb988005f90 comp rx=0 tx=0).stop 2024-09-13T15:59:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.662+0000 7fb9a5618740 1 -- 172.21.15.17:0/2742268264 shutdown_connections 2024-09-13T15:59:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.662+0000 7fb9a5618740 1 --2- 172.21.15.17:0/2742268264 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c7087c3360 0x55c7087c5780 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.662+0000 7fb9a5618740 1 --2- 172.21.15.17:0/2742268264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7087b3440 0x55c7087bec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.662+0000 7fb9a5618740 1 --2- 172.21.15.17:0/2742268264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087ae3b0 0x55c7087b7c70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.662+0000 7fb9a5618740 1 --2- 172.21.15.17:0/2742268264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c7087ada70 0x55c7087b7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.662+0000 7fb9a5618740 1 -- 172.21.15.17:0/2742268264 >> 172.21.15.17:0/2742268264 conn(0x55c7087a90e0 msgr2=0x55c7087aa8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:38.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.662+0000 7fb985600640 0 client.25546 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:59:38.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.662+0000 7fb9a5618740 1 -- 172.21.15.17:0/2742268264 shutdown_connections 2024-09-13T15:59:38.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.662+0000 7fb9a5618740 1 -- 172.21.15.17:0/2742268264 wait complete. 2024-09-13T15:59:38.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.663+0000 7fb9a5618740 20 client.25546 trim_cache size 0 max 16384 2024-09-13T15:59:38.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.691+0000 7fb9a5618740 1 Processor -- start 2024-09-13T15:59:38.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.691+0000 7fb9a5618740 1 -- start start 2024-09-13T15:59:38.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.692+0000 7fb9a5618740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7087ada70 0x55c7087b7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:38.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.692+0000 7fb9a5618740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c7087ae3b0 0x55c7087bec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:38.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.692+0000 7fb9a5618740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087b3440 0x55c7087b7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:38.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.692+0000 7fb9a5618740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c708477e60 con 0x55c7087ada70 2024-09-13T15:59:38.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.692+0000 7fb9a5618740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7087bf770 con 0x55c7087ae3b0 2024-09-13T15:59:38.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.692+0000 7fb9a5618740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7087a4c90 con 0x55c7087b3440 2024-09-13T15:59:38.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.692+0000 7fb99be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087b3440 0x55c7087b7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:38.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.692+0000 7fb99aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c7087ae3b0 0x55c7087bec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:38.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.693+0000 7fb99aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c7087ae3b0 0x55c7087bec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:49822/0 (socket says 172.21.15.17:49822) 2024-09-13T15:59:38.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.693+0000 7fb99aa00640 1 -- 172.21.15.17:0/2453528309 learned_addr learned my addr 172.21.15.17:0/2453528309 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:59:38.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.693+0000 7fb99b400640 1 --2- 172.21.15.17:0/2453528309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7087ada70 0x55c7087b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.693+0000 7fb99aa00640 1 -- 172.21.15.17:0/2453528309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087b3440 msgr2=0x55c7087b7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.693+0000 7fb99aa00640 1 --2- 172.21.15.17:0/2453528309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087b3440 0x55c7087b7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.693+0000 7fb99aa00640 1 -- 172.21.15.17:0/2453528309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7087ada70 msgr2=0x55c7087b7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.693+0000 7fb99aa00640 1 --2- 172.21.15.17:0/2453528309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7087ada70 0x55c7087b7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.693+0000 7fb99aa00640 1 -- 172.21.15.17:0/2453528309 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7086b1180 con 0x55c7087ae3b0 2024-09-13T15:59:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.694+0000 7fb99aa00640 1 --2- 172.21.15.17:0/2453528309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c7087ae3b0 0x55c7087bec20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb988030be0 tx=0x7fb98802aa60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc29ab82b6d371a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.694+0000 7fb991600640 1 -- 172.21.15.17:0/2453528309 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9880043c0 con 0x55c7087ae3b0 2024-09-13T15:59:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.694+0000 7fb991600640 1 -- 172.21.15.17:0/2453528309 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb988058070 con 0x55c7087ae3b0 2024-09-13T15:59:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.694+0000 7fb991600640 1 -- 172.21.15.17:0/2453528309 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb988003ab0 con 0x55c7087ae3b0 2024-09-13T15:59:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.694+0000 7fb99b400640 1 --2- 172.21.15.17:0/2453528309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7087ada70 0x55c7087b7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:59:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.696+0000 7fb9a5618740 1 -- 172.21.15.17:0/2453528309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c7087ae3b0 msgr2=0x55c7087bec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.696+0000 7fb9a5618740 1 --2- 172.21.15.17:0/2453528309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c7087ae3b0 0x55c7087bec20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb988030be0 tx=0x7fb98802aa60 comp rx=0 tx=0).stop 2024-09-13T15:59:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.696+0000 7fb9a5618740 1 -- 172.21.15.17:0/2453528309 shutdown_connections 2024-09-13T15:59:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.696+0000 7fb9a5618740 1 --2- 172.21.15.17:0/2453528309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087b3440 0x55c7087b7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.696+0000 7fb9a5618740 1 --2- 172.21.15.17:0/2453528309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c7087ae3b0 0x55c7087bec20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.696+0000 7fb9a5618740 1 --2- 172.21.15.17:0/2453528309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7087ada70 0x55c7087b7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.696+0000 7fb9a5618740 1 -- 172.21.15.17:0/2453528309 >> 172.21.15.17:0/2453528309 conn(0x55c7087a90e0 msgr2=0x55c7087ca0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.696+0000 7fb9a5618740 1 -- 172.21.15.17:0/2453528309 shutdown_connections 2024-09-13T15:59:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.697+0000 7fb9a5618740 1 -- 172.21.15.17:0/2453528309 wait complete. 2024-09-13T15:59:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.697+0000 7fb9a5618740 1 -- start start 2024-09-13T15:59:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.697+0000 7fb9a5618740 1 Processor -- start 2024-09-13T15:59:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.699+0000 7fb9a5618740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c7087ada70 0x55c7087baa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.699+0000 7fb9a5618740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087ae3b0 0x55c7087baf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.699+0000 7fb9a5618740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7087b3440 0x55c7087bdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.699+0000 7fb9a5618740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7087be4d0 con 0x55c7087b3440 2024-09-13T15:59:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.699+0000 7fb9a5618740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7087be640 con 0x55c7087ada70 2024-09-13T15:59:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.699+0000 7fb9a5618740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7087be800 con 0x55c7087ae3b0 2024-09-13T15:59:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.699+0000 7fb9a5618740 10 client.0 _ll_register_callbacks cb 0x7fb98c0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:59:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.699+0000 7fb99aa00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087ae3b0 0x55c7087baf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.699+0000 7fb99aa00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087ae3b0 0x55c7087baf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:37992/0 (socket says 172.21.15.17:37992) 2024-09-13T15:59:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.699+0000 7fb99aa00640 1 -- 172.21.15.17:0/1939066312 learned_addr learned my addr 172.21.15.17:0/1939066312 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:59:38.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.699+0000 7fb99be00640 1 --2- 172.21.15.17:0/1939066312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7087b3440 0x55c7087bdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:38.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.700+0000 7fb99aa00640 1 -- 172.21.15.17:0/1939066312 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c7087ada70 msgr2=0x55c7087baa30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T15:59:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.700+0000 7fb99aa00640 1 --2- 172.21.15.17:0/1939066312 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c7087ada70 0x55c7087baa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.700+0000 7fb99aa00640 1 -- 172.21.15.17:0/1939066312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7087b3440 msgr2=0x55c7087bdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.700+0000 7fb99aa00640 1 --2- 172.21.15.17:0/1939066312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7087b3440 0x55c7087bdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.700+0000 7fb99aa00640 1 -- 172.21.15.17:0/1939066312 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c70870f170 con 0x55c7087ae3b0 2024-09-13T15:59:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.700+0000 7fb99be00640 1 --2- 172.21.15.17:0/1939066312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7087b3440 0x55c7087bdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:59:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.701+0000 7fb99aa00640 1 --2- 172.21.15.17:0/1939066312 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087ae3b0 0x55c7087baf70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb988055f50 tx=0x7fb988030840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bec97dc2c19bf442 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.701+0000 7fb985600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T15:59:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.701+0000 7fb985600640 1 -- 172.21.15.17:0/1939066312 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98803de70 con 0x55c7087ae3b0 2024-09-13T15:59:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.701+0000 7fb985600640 1 -- 172.21.15.17:0/1939066312 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fb9880035f0 con 0x55c7087ae3b0 2024-09-13T15:59:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.701+0000 7fb9a5618740 1 -- 172.21.15.17:0/1939066312 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb98c099460 con 0x55c7087ae3b0 2024-09-13T15:59:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.702+0000 7fb985600640 1 -- 172.21.15.17:0/1939066312 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9880037f0 con 0x55c7087ae3b0 2024-09-13T15:59:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.702+0000 7fb9a5618740 10 client.25552 fetch_fsmap learned FSMap version 28 2024-09-13T15:59:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.702+0000 7fb9a5618740 1 -- 172.21.15.17:0/1939066312 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55c7086d6560 con 0x55c7087ae3b0 2024-09-13T15:59:38.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.702+0000 7fb985600640 1 -- 172.21.15.17:0/1939066312 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb98c099460 con 0x55c7087ae3b0 2024-09-13T15:59:38.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.702+0000 7fb985600640 1 -- 172.21.15.17:0/1939066312 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 28) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fb988064020 con 0x55c7087ae3b0 2024-09-13T15:59:38.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.702+0000 7fb9a5618740 10 client.25552 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T15:59:38.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.702+0000 7fb9a5618740 10 client.25552 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T15:59:38.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.702+0000 7fb9a5618740 20 client.25552 populate_metadata read hostname 'smithi017' 2024-09-13T15:59:38.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.702+0000 7fb9a5618740 1 --2- 172.21.15.17:0/1939066312 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c70881a320 0x55c70881c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:38.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.702+0000 7fb9a5618740 4 client.25552 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T15:59:38.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.703+0000 7fb9a5618740 1 -- 172.21.15.17:0/1939066312 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c708404300 con 0x55c70881a320 2024-09-13T15:59:38.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.703+0000 7fb99b400640 1 --2- 172.21.15.17:0/1939066312 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c70881a320 0x55c70881c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:38.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.704+0000 7fb99b400640 1 --2- 172.21.15.17:0/1939066312 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c70881a320 0x55c70881c740 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de3463c60a36df4c server_cookie=42efb062008c6d96 in_seq=0 out_seq=0 2024-09-13T15:59:38.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.704+0000 7fb985600640 10 client.25552 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:59:38.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.745+0000 7fb985600640 1 -- 172.21.15.17:0/1939066312 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c708404300 con 0x55c70881a320 2024-09-13T15:59:38.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.745+0000 7fb985600640 10 client.25552 handle_command_reply: tid=0 2024-09-13T15:59:38.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.745+0000 7fb9a5618740 1 client.25552 shutdown 2024-09-13T15:59:38.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.746+0000 7fb9a5618740 1 -- 172.21.15.17:0/1939066312 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087ae3b0 msgr2=0x55c7087baf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:38.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.746+0000 7fb9a5618740 1 --2- 172.21.15.17:0/1939066312 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087ae3b0 0x55c7087baf70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb988055f50 tx=0x7fb988030840 comp rx=0 tx=0).stop 2024-09-13T15:59:38.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.747+0000 7fb9a5618740 1 -- 172.21.15.17:0/1939066312 shutdown_connections 2024-09-13T15:59:38.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.747+0000 7fb9a5618740 1 --2- 172.21.15.17:0/1939066312 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c70881a320 0x55c70881c740 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.747+0000 7fb9a5618740 1 --2- 172.21.15.17:0/1939066312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7087b3440 0x55c7087bdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.747+0000 7fb9a5618740 1 --2- 172.21.15.17:0/1939066312 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c7087ae3b0 0x55c7087baf70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.747+0000 7fb9a5618740 1 --2- 172.21.15.17:0/1939066312 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c7087ada70 0x55c7087baa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.747+0000 7fb985600640 0 client.25552 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:59:38.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.747+0000 7fb9a5618740 1 -- 172.21.15.17:0/1939066312 >> 172.21.15.17:0/1939066312 conn(0x55c7087a90e0 msgr2=0x55c7087af310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:38.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.747+0000 7fb9a5618740 1 -- 172.21.15.17:0/1939066312 shutdown_connections 2024-09-13T15:59:38.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.747+0000 7fb9a5618740 1 -- 172.21.15.17:0/1939066312 wait complete. 2024-09-13T15:59:38.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.748+0000 7fb9a5618740 20 client.25552 trim_cache size 0 max 16384 2024-09-13T15:59:38.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T15:59:38.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T15:59:38.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T15:59:38.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T15:59:38.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.748+0000 7fb9a2800640 1 -- 172.21.15.17:0/808703836 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb9800a1290 msgr2=0x7fb9800a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:38.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.748+0000 7fb9a2800640 1 --2- 172.21.15.17:0/808703836 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb9800a1290 0x7fb9800a3750 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb988009830 tx=0x7fb9880305f0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.749+0000 7fb9a2800640 1 -- 172.21.15.17:0/808703836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb99c0718e0 msgr2=0x7fb99c1a4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:38.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.749+0000 7fb9a2800640 1 --2- 172.21.15.17:0/808703836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb99c0718e0 0x7fb99c1a4c70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb98c009800 tx=0x7fb98c009cc0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.749+0000 7fb9a2800640 1 -- 172.21.15.17:0/808703836 shutdown_connections 2024-09-13T15:59:38.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.749+0000 7fb9a2800640 1 --2- 172.21.15.17:0/808703836 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb9800a1290 0x7fb9800a3750 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.749+0000 7fb9a2800640 1 --2- 172.21.15.17:0/808703836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb99c108300 0x7fb99c1ac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.749+0000 7fb9a2800640 1 --2- 172.21.15.17:0/808703836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb99c107940 0x7fb99c1a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.749+0000 7fb9a2800640 1 --2- 172.21.15.17:0/808703836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb99c0718e0 0x7fb99c1a4c70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:38.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.749+0000 7fb9a2800640 1 -- 172.21.15.17:0/808703836 >> 172.21.15.17:0/808703836 conn(0x7fb99c06cf30 msgr2=0x7fb99c114ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:38.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.749+0000 7fb9a2800640 1 -- 172.21.15.17:0/808703836 shutdown_connections 2024-09-13T15:59:38.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:38.749+0000 7fb9a2800640 1 -- 172.21.15.17:0/808703836 wait complete. 2024-09-13T15:59:38.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:38 smithi193 ceph-mon[35248]: pgmap v442: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.4 MiB/s wr, 625 op/s 2024-09-13T15:59:38.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:38 smithi017 ceph-mon[30494]: pgmap v442: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.4 MiB/s wr, 625 op/s 2024-09-13T15:59:39.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:39 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:59:39.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:39 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:59:39.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:39 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:59:39.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:39 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:59:39.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:39 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:59:39.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:39 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:59:39.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:39 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T15:59:39.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:39 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T15:59:39.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:39 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T15:59:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 115.0 s, 1724.4 tps, lat 57.945 ms stddev 78.507 2024-09-13T15:59:40.756 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:40 smithi193 ceph-mon[35248]: pgmap v443: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.5 MiB/s wr, 688 op/s 2024-09-13T15:59:40.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:40 smithi017 ceph-mon[30494]: pgmap v443: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.5 MiB/s wr, 688 op/s 2024-09-13T15:59:40.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:40 smithi189 ceph-mon[34790]: pgmap v443: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.5 MiB/s wr, 688 op/s 2024-09-13T15:59:43.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:42 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T15:59:43.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:42 smithi193 ceph-mon[35248]: pgmap v444: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 7.9 MiB/s wr, 683 op/s 2024-09-13T15:59:43.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:42 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T15:59:43.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:42 smithi017 ceph-mon[30494]: pgmap v444: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 7.9 MiB/s wr, 683 op/s 2024-09-13T15:59:43.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:42 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T15:59:43.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:42 smithi189 ceph-mon[34790]: pgmap v444: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 7.9 MiB/s wr, 683 op/s 2024-09-13T15:59:44.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:44 smithi189 ceph-mon[34790]: pgmap v445: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 8.2 MiB/s wr, 713 op/s 2024-09-13T15:59:44.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:44 smithi193 ceph-mon[35248]: pgmap v445: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 8.2 MiB/s wr, 713 op/s 2024-09-13T15:59:44.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:44 smithi017 ceph-mon[30494]: pgmap v445: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 8.2 MiB/s wr, 713 op/s 2024-09-13T15:59:45.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 120.0 s, 1890.2 tps, lat 52.678 ms stddev 62.336 2024-09-13T15:59:46.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:46 smithi189 ceph-mon[34790]: pgmap v446: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 7.2 MiB/s wr, 642 op/s 2024-09-13T15:59:46.686 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:46 smithi017 ceph-mon[30494]: pgmap v446: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 7.2 MiB/s wr, 642 op/s 2024-09-13T15:59:46.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:46 smithi193 ceph-mon[35248]: pgmap v446: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 7.2 MiB/s wr, 642 op/s 2024-09-13T15:59:48.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:48 smithi189 ceph-mon[34790]: pgmap v447: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.7 MiB/s wr, 642 op/s 2024-09-13T15:59:48.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:48 smithi193 ceph-mon[35248]: pgmap v447: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.7 MiB/s wr, 642 op/s 2024-09-13T15:59:48.765 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:48 smithi017 ceph-mon[30494]: pgmap v447: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.7 MiB/s wr, 642 op/s 2024-09-13T15:59:50.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 125.0 s, 2342.6 tps, lat 43.101 ms stddev 64.036 2024-09-13T15:59:50.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:50 smithi189 ceph-mon[34790]: pgmap v448: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 11 MiB/s wr, 839 op/s 2024-09-13T15:59:50.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:50 smithi193 ceph-mon[35248]: pgmap v448: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 11 MiB/s wr, 839 op/s 2024-09-13T15:59:50.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:50 smithi017 ceph-mon[30494]: pgmap v448: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 11 MiB/s wr, 839 op/s 2024-09-13T15:59:51.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.946+0000 7fad6e000640 1 -- 172.21.15.17:0/3083473137 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad680feba0 msgr2=0x7fad680fefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:51.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.946+0000 7fad6e000640 1 --2- 172.21.15.17:0/3083473137 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad680feba0 0x7fad680fefa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fad50009860 tx=0x7fad5002a340 comp rx=0 tx=0).stop 2024-09-13T15:59:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.947+0000 7fad6e000640 1 -- 172.21.15.17:0/3083473137 shutdown_connections 2024-09-13T15:59:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.947+0000 7fad6e000640 1 --2- 172.21.15.17:0/3083473137 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad68100750 0x7fad68106fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.947+0000 7fad6e000640 1 --2- 172.21.15.17:0/3083473137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad680ffd90 0x7fad68100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.947+0000 7fad6e000640 1 --2- 172.21.15.17:0/3083473137 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad680feba0 0x7fad680fefa0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.947+0000 7fad6e000640 1 -- 172.21.15.17:0/3083473137 >> 172.21.15.17:0/3083473137 conn(0x7fad680fa320 msgr2=0x7fad680fc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.948+0000 7fad6e000640 1 -- 172.21.15.17:0/3083473137 shutdown_connections 2024-09-13T15:59:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.948+0000 7fad6e000640 1 -- 172.21.15.17:0/3083473137 wait complete. 2024-09-13T15:59:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.949+0000 7fad6e000640 1 Processor -- start 2024-09-13T15:59:51.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.949+0000 7fad6e000640 1 -- start start 2024-09-13T15:59:51.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.949+0000 7fad6e000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad680feba0 0x7fad6810e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:51.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.950+0000 7fad6e000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad680ffd90 0x7fad6810eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:51.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.950+0000 7fad6e000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad68100750 0x7fad6810b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:51.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.950+0000 7fad6e000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6810b8f0 con 0x7fad68100750 2024-09-13T15:59:51.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.950+0000 7fad6e000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6810ba60 con 0x7fad680feba0 2024-09-13T15:59:51.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.950+0000 7fad6e000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6810bc20 con 0x7fad680ffd90 2024-09-13T15:59:51.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.950+0000 7fad66a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad680ffd90 0x7fad6810eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:51.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.950+0000 7fad67400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad680feba0 0x7fad6810e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:51.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.950+0000 7fad67400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad680feba0 0x7fad6810e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:58572/0 (socket says 172.21.15.17:58572) 2024-09-13T15:59:51.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.950+0000 7fad66a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad680ffd90 0x7fad6810eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:43046/0 (socket says 172.21.15.17:43046) 2024-09-13T15:59:51.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.950+0000 7fad67400640 1 -- 172.21.15.17:0/1923713414 learned_addr learned my addr 172.21.15.17:0/1923713414 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:59:51.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.951+0000 7fad67e00640 1 --2- 172.21.15.17:0/1923713414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad68100750 0x7fad6810b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:51.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.951+0000 7fad67400640 1 -- 172.21.15.17:0/1923713414 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad680ffd90 msgr2=0x7fad6810eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:51.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.951+0000 7fad67400640 1 --2- 172.21.15.17:0/1923713414 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad680ffd90 0x7fad6810eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:51.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.951+0000 7fad67400640 1 -- 172.21.15.17:0/1923713414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad68100750 msgr2=0x7fad6810b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:51.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.951+0000 7fad67400640 1 --2- 172.21.15.17:0/1923713414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad68100750 0x7fad6810b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:51.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.951+0000 7fad67400640 1 -- 172.21.15.17:0/1923713414 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad50009490 con 0x7fad680feba0 2024-09-13T15:59:51.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.951+0000 7fad66a00640 1 --2- 172.21.15.17:0/1923713414 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad680ffd90 0x7fad6810eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:59:51.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.952+0000 7fad67e00640 1 --2- 172.21.15.17:0/1923713414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad68100750 0x7fad6810b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:59:51.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.952+0000 7fad67400640 1 --2- 172.21.15.17:0/1923713414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad680feba0 0x7fad6810e5f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fad50009780 tx=0x7fad50032ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:51.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.952+0000 7fad5fe00640 1 -- 172.21.15.17:0/1923713414 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad50004050 con 0x7fad680feba0 2024-09-13T15:59:51.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.952+0000 7fad5fe00640 1 -- 172.21.15.17:0/1923713414 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad500035f0 con 0x7fad680feba0 2024-09-13T15:59:51.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.952+0000 7fad5fe00640 1 -- 172.21.15.17:0/1923713414 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5003c660 con 0x7fad680feba0 2024-09-13T15:59:51.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.952+0000 7fad6e000640 1 -- 172.21.15.17:0/1923713414 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad68197c30 con 0x7fad680feba0 2024-09-13T15:59:51.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.952+0000 7fad6e000640 1 -- 172.21.15.17:0/1923713414 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad681980f0 con 0x7fad680feba0 2024-09-13T15:59:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.958+0000 7fad5fe00640 1 -- 172.21.15.17:0/1923713414 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fad50003760 con 0x7fad680feba0 2024-09-13T15:59:51.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.960+0000 7fad5fe00640 1 --2- 172.21.15.17:0/1923713414 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fad4c0a1160 0x7fad4c0a3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.961+0000 7fad70dd6740 1 Processor -- start 2024-09-13T15:59:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.961+0000 7fad70dd6740 1 -- start start 2024-09-13T15:59:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.962+0000 7fad5fe00640 1 -- 172.21.15.17:0/1923713414 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fad500ed930 con 0x7fad680feba0 2024-09-13T15:59:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.962+0000 7fad70dd6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef5fa70 0x56424ef5fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.962+0000 7fad70dd6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef603b0 0x56424ef64e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.962+0000 7fad70dd6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56424ef65440 0x56424ef67900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.962+0000 7fad70dd6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424ee6bbb0 con 0x56424ef65440 2024-09-13T15:59:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.962+0000 7fad70dd6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424eec9a70 con 0x56424ef603b0 2024-09-13T15:59:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.962+0000 7fad70dd6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424eec7200 con 0x56424ef5fa70 2024-09-13T15:59:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.962+0000 7fad66a00640 1 --2- 172.21.15.17:0/1923713414 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fad4c0a1160 0x7fad4c0a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.963+0000 7fad67400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef5fa70 0x56424ef5fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.963+0000 7fad66a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef603b0 0x56424ef64e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.963+0000 7fad67e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56424ef65440 0x56424ef67900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.963+0000 7fad67400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef5fa70 0x56424ef5fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:43052/0 (socket says 172.21.15.17:43052) 2024-09-13T15:59:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.963+0000 7fad66a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef603b0 0x56424ef64e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:58584/0 (socket says 172.21.15.17:58584) 2024-09-13T15:59:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.963+0000 7fad66a00640 1 -- 172.21.15.17:0/861512876 learned_addr learned my addr 172.21.15.17:0/861512876 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:59:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.963+0000 7fad66a00640 1 -- 172.21.15.17:0/861512876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef5fa70 msgr2=0x56424ef5fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.963+0000 7fad66a00640 1 --2- 172.21.15.17:0/861512876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef5fa70 0x56424ef5fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.963+0000 7fad66a00640 1 -- 172.21.15.17:0/861512876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56424ef65440 msgr2=0x56424ef67900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.963+0000 7fad66a00640 1 --2- 172.21.15.17:0/861512876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56424ef65440 0x56424ef67900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:51.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.963+0000 7fad66a00640 1 -- 172.21.15.17:0/861512876 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56424ee64940 con 0x56424ef603b0 2024-09-13T15:59:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.964+0000 7fad66a00640 1 --2- 172.21.15.17:0/861512876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef603b0 0x56424ef64e70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fad58013be0 tx=0x7fad58017380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6e6eb092908e81d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.964+0000 7fad5cc00640 1 -- 172.21.15.17:0/861512876 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad58013380 con 0x56424ef603b0 2024-09-13T15:59:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.964+0000 7fad66a00640 1 --2- 172.21.15.17:0/1923713414 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fad4c0a1160 0x7fad4c0a3620 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fad58017880 tx=0x7fad58012000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.964+0000 7fad5cc00640 1 -- 172.21.15.17:0/861512876 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad58018e30 con 0x56424ef603b0 2024-09-13T15:59:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.964+0000 7fad5cc00640 1 -- 172.21.15.17:0/861512876 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad58022dc0 con 0x56424ef603b0 2024-09-13T15:59:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.965+0000 7fad70dd6740 1 -- 172.21.15.17:0/861512876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef603b0 msgr2=0x56424ef64e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.965+0000 7fad70dd6740 1 --2- 172.21.15.17:0/861512876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef603b0 0x56424ef64e70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fad58013be0 tx=0x7fad58017380 comp rx=0 tx=0).stop 2024-09-13T15:59:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.965+0000 7fad70dd6740 1 -- 172.21.15.17:0/861512876 shutdown_connections 2024-09-13T15:59:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.965+0000 7fad70dd6740 1 --2- 172.21.15.17:0/861512876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56424ef65440 0x56424ef67900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.965+0000 7fad70dd6740 1 --2- 172.21.15.17:0/861512876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef603b0 0x56424ef64e70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.965+0000 7fad70dd6740 1 --2- 172.21.15.17:0/861512876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef5fa70 0x56424ef5fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:51.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.965+0000 7fad70dd6740 1 -- 172.21.15.17:0/861512876 >> 172.21.15.17:0/861512876 conn(0x56424ef5b0e0 msgr2=0x56424ef5b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:51.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.965+0000 7fad70dd6740 1 -- 172.21.15.17:0/861512876 shutdown_connections 2024-09-13T15:59:51.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.966+0000 7fad70dd6740 1 -- 172.21.15.17:0/861512876 wait complete. 2024-09-13T15:59:51.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.966+0000 7fad70dd6740 1 -- start start 2024-09-13T15:59:51.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.967+0000 7fad70dd6740 1 Processor -- start 2024-09-13T15:59:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.968+0000 7fad70dd6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef5fa70 0x56424ef69730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.968+0000 7fad70dd6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef603b0 0x56424ef69c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.968+0000 7fad70dd6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56424ef65440 0x56424ef70c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.968+0000 7fad70dd6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424eec2af0 con 0x56424ef65440 2024-09-13T15:59:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.968+0000 7fad70dd6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424ee80f20 con 0x56424ef603b0 2024-09-13T15:59:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.968+0000 7fad70dd6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424ee80bc0 con 0x56424ef5fa70 2024-09-13T15:59:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.968+0000 7fad70dd6740 10 client.0 _ll_register_callbacks cb 0x56424eeb2a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:59:51.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.969+0000 7fad66a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef603b0 0x56424ef69c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:51.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.969+0000 7fad66a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef603b0 0x56424ef69c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:58600/0 (socket says 172.21.15.17:58600) 2024-09-13T15:59:51.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.969+0000 7fad66a00640 1 -- 172.21.15.17:0/1479823450 learned_addr learned my addr 172.21.15.17:0/1479823450 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:59:51.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.969+0000 7fad67e00640 1 --2- 172.21.15.17:0/1479823450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56424ef65440 0x56424ef70c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:51.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.969+0000 7fad66a00640 1 -- 172.21.15.17:0/1479823450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef5fa70 msgr2=0x56424ef69730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:51.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.969+0000 7fad67400640 1 --2- 172.21.15.17:0/1479823450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef5fa70 0x56424ef69730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:51.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.969+0000 7fad66a00640 1 --2- 172.21.15.17:0/1479823450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef5fa70 0x56424ef69730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:51.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.969+0000 7fad66a00640 1 -- 172.21.15.17:0/1479823450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56424ef65440 msgr2=0x56424ef70c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:51.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.969+0000 7fad66a00640 1 --2- 172.21.15.17:0/1479823450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56424ef65440 0x56424ef70c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:51.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.969+0000 7fad66a00640 1 -- 172.21.15.17:0/1479823450 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad58013840 con 0x56424ef603b0 2024-09-13T15:59:51.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.970+0000 7fad67400640 1 --2- 172.21.15.17:0/1479823450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef5fa70 0x56424ef69730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:59:51.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.970+0000 7fad66a00640 1 --2- 172.21.15.17:0/1479823450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef603b0 0x56424ef69c70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fad58009cd0 tx=0x7fad58009170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe72b91ec1e83719 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:51.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.970+0000 7fad55600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T15:59:51.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.971+0000 7fad55600640 1 -- 172.21.15.17:0/1479823450 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad58018970 con 0x56424ef603b0 2024-09-13T15:59:51.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.971+0000 7fad55600640 1 -- 172.21.15.17:0/1479823450 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fad5801e070 con 0x56424ef603b0 2024-09-13T15:59:51.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.971+0000 7fad70dd6740 1 -- 172.21.15.17:0/1479823450 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56424eeecc90 con 0x56424ef603b0 2024-09-13T15:59:51.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.971+0000 7fad55600640 1 -- 172.21.15.17:0/1479823450 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad58018ad0 con 0x56424ef603b0 2024-09-13T15:59:51.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.972+0000 7fad70dd6740 10 client.25535 fetch_fsmap learned FSMap version 29 2024-09-13T15:59:51.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.972+0000 7fad70dd6740 1 -- 172.21.15.17:0/1479823450 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x56424eec1170 con 0x56424ef603b0 2024-09-13T15:59:51.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.972+0000 7fad55600640 1 -- 172.21.15.17:0/1479823450 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56424eeecc90 con 0x56424ef603b0 2024-09-13T15:59:51.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.972+0000 7fad55600640 1 -- 172.21.15.17:0/1479823450 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 29) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fad58021470 con 0x56424ef603b0 2024-09-13T15:59:51.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.972+0000 7fad70dd6740 10 client.25535 fetch_fsmap finished waiting for FSMap version 29 2024-09-13T15:59:51.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.972+0000 7fad70dd6740 10 client.25535 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T15:59:51.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.973+0000 7fad70dd6740 20 client.25535 populate_metadata read hostname 'smithi017' 2024-09-13T15:59:51.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.973+0000 7fad70dd6740 1 --2- 172.21.15.17:0/1479823450 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56424ef753a0 0x56424ef777c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:51.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.973+0000 7fad70dd6740 4 client.25535 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:59:51.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.973+0000 7fad70dd6740 1 -- 172.21.15.17:0/1479823450 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56424eeb57d0 con 0x56424ef753a0 2024-09-13T15:59:51.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.973+0000 7fad67400640 1 --2- 172.21.15.17:0/1479823450 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56424ef753a0 0x56424ef777c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:51.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.974+0000 7fad55600640 10 client.25535 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:59:51.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.974+0000 7fad67400640 1 --2- 172.21.15.17:0/1479823450 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56424ef753a0 0x56424ef777c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33950c922e851069 server_cookie=51bf861ea2ffbac4 in_seq=0 out_seq=0 2024-09-13T15:59:51.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.974+0000 7fad55600640 1 -- 172.21.15.17:0/1479823450 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56424eeb57d0 con 0x56424ef753a0 2024-09-13T15:59:51.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.974+0000 7fad55600640 10 client.25535 handle_command_reply: tid=0 2024-09-13T15:59:51.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.975+0000 7fad70dd6740 1 client.25535 shutdown 2024-09-13T15:59:51.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.975+0000 7fad70dd6740 1 -- 172.21.15.17:0/1479823450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef603b0 msgr2=0x56424ef69c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:51.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.975+0000 7fad70dd6740 1 --2- 172.21.15.17:0/1479823450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef603b0 0x56424ef69c70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fad58009cd0 tx=0x7fad58009170 comp rx=0 tx=0).stop 2024-09-13T15:59:51.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.975+0000 7fad70dd6740 1 -- 172.21.15.17:0/1479823450 shutdown_connections 2024-09-13T15:59:51.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.975+0000 7fad70dd6740 1 --2- 172.21.15.17:0/1479823450 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56424ef753a0 0x56424ef777c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.975+0000 7fad70dd6740 1 --2- 172.21.15.17:0/1479823450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56424ef65440 0x56424ef70c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.975+0000 7fad70dd6740 1 --2- 172.21.15.17:0/1479823450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef603b0 0x56424ef69c70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.975+0000 7fad70dd6740 1 --2- 172.21.15.17:0/1479823450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef5fa70 0x56424ef69730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.975+0000 7fad70dd6740 1 -- 172.21.15.17:0/1479823450 >> 172.21.15.17:0/1479823450 conn(0x56424ef5b0e0 msgr2=0x56424ef5c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.975+0000 7fad55600640 0 client.25535 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:59:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.975+0000 7fad70dd6740 1 -- 172.21.15.17:0/1479823450 shutdown_connections 2024-09-13T15:59:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.975+0000 7fad70dd6740 1 -- 172.21.15.17:0/1479823450 wait complete. 2024-09-13T15:59:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.976+0000 7fad70dd6740 20 client.25535 trim_cache size 0 max 16384 2024-09-13T15:59:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.999+0000 7fad70dd6740 1 Processor -- start 2024-09-13T15:59:52.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:51.999+0000 7fad70dd6740 1 -- start start 2024-09-13T15:59:52.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.000+0000 7fad70dd6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56424ef5fa70 0x56424ef5fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:52.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.000+0000 7fad70dd6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef603b0 0x56424ef70bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:52.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.000+0000 7fad70dd6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef65440 0x56424ef61410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:52.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.000+0000 7fad70dd6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424ec29e60 con 0x56424ef5fa70 2024-09-13T15:59:52.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.000+0000 7fad70dd6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424ef738e0 con 0x56424ef65440 2024-09-13T15:59:52.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.000+0000 7fad70dd6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424ef69270 con 0x56424ef603b0 2024-09-13T15:59:52.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.000+0000 7fad66a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef603b0 0x56424ef70bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:52.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.000+0000 7fad66a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef603b0 0x56424ef70bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:43062/0 (socket says 172.21.15.17:43062) 2024-09-13T15:59:52.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.000+0000 7fad66a00640 1 -- 172.21.15.17:0/323284633 learned_addr learned my addr 172.21.15.17:0/323284633 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:59:52.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.001+0000 7fad66a00640 1 -- 172.21.15.17:0/323284633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef65440 msgr2=0x56424ef61410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:52.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.001+0000 7fad66a00640 1 --2- 172.21.15.17:0/323284633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef65440 0x56424ef61410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:52.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.001+0000 7fad66a00640 1 -- 172.21.15.17:0/323284633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56424ef5fa70 msgr2=0x56424ef5fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:52.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.001+0000 7fad67400640 1 --2- 172.21.15.17:0/323284633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56424ef5fa70 0x56424ef5fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:52.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.001+0000 7fad66a00640 1 --2- 172.21.15.17:0/323284633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56424ef5fa70 0x56424ef5fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:52.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.001+0000 7fad66a00640 1 -- 172.21.15.17:0/323284633 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56424ee63180 con 0x56424ef603b0 2024-09-13T15:59:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.001+0000 7fad67400640 1 --2- 172.21.15.17:0/323284633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56424ef5fa70 0x56424ef5fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:59:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.002+0000 7fad66a00640 1 --2- 172.21.15.17:0/323284633 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef603b0 0x56424ef70bd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fad58008010 tx=0x7fad58009d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bb8dc367c20df86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.002+0000 7fad5d600640 1 -- 172.21.15.17:0/323284633 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad58021d80 con 0x56424ef603b0 2024-09-13T15:59:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.002+0000 7fad5d600640 1 -- 172.21.15.17:0/323284633 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad580228a0 con 0x56424ef603b0 2024-09-13T15:59:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.002+0000 7fad5d600640 1 -- 172.21.15.17:0/323284633 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5802b460 con 0x56424ef603b0 2024-09-13T15:59:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.003+0000 7fad70dd6740 1 -- 172.21.15.17:0/323284633 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef603b0 msgr2=0x56424ef70bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.003+0000 7fad70dd6740 1 --2- 172.21.15.17:0/323284633 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef603b0 0x56424ef70bd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fad58008010 tx=0x7fad58009d80 comp rx=0 tx=0).stop 2024-09-13T15:59:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.003+0000 7fad70dd6740 1 -- 172.21.15.17:0/323284633 shutdown_connections 2024-09-13T15:59:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.003+0000 7fad70dd6740 1 --2- 172.21.15.17:0/323284633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef65440 0x56424ef61410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.003+0000 7fad70dd6740 1 --2- 172.21.15.17:0/323284633 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef603b0 0x56424ef70bd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.003+0000 7fad70dd6740 1 --2- 172.21.15.17:0/323284633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56424ef5fa70 0x56424ef5fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.003+0000 7fad70dd6740 1 -- 172.21.15.17:0/323284633 >> 172.21.15.17:0/323284633 conn(0x56424ef5b0e0 msgr2=0x56424ef7c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.003+0000 7fad70dd6740 1 -- 172.21.15.17:0/323284633 shutdown_connections 2024-09-13T15:59:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.003+0000 7fad70dd6740 1 -- 172.21.15.17:0/323284633 wait complete. 2024-09-13T15:59:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.004+0000 7fad70dd6740 1 -- start start 2024-09-13T15:59:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.004+0000 7fad70dd6740 1 Processor -- start 2024-09-13T15:59:52.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.006+0000 7fad70dd6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef5fa70 0x56424ef6cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:52.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.006+0000 7fad70dd6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56424ef603b0 0x56424ef6d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.006+0000 7fad70dd6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef65440 0x56424ef70120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.006+0000 7fad70dd6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424ef70660 con 0x56424ef603b0 2024-09-13T15:59:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.006+0000 7fad70dd6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424ef707d0 con 0x56424ef65440 2024-09-13T15:59:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.006+0000 7fad70dd6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424ef70990 con 0x56424ef5fa70 2024-09-13T15:59:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.007+0000 7fad67e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef65440 0x56424ef70120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.007+0000 7fad67e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef65440 0x56424ef70120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:58618/0 (socket says 172.21.15.17:58618) 2024-09-13T15:59:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.007+0000 7fad67e00640 1 -- 172.21.15.17:0/3126304300 learned_addr learned my addr 172.21.15.17:0/3126304300 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T15:59:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.007+0000 7fad67400640 1 --2- 172.21.15.17:0/3126304300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef5fa70 0x56424ef6cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.007+0000 7fad70dd6740 10 client.0 _ll_register_callbacks cb 0x7fad58013560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:59:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.007+0000 7fad66a00640 1 --2- 172.21.15.17:0/3126304300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56424ef603b0 0x56424ef6d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.007+0000 7fad67e00640 1 -- 172.21.15.17:0/3126304300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef5fa70 msgr2=0x56424ef6cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.007+0000 7fad67e00640 1 --2- 172.21.15.17:0/3126304300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef5fa70 0x56424ef6cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.007+0000 7fad67e00640 1 -- 172.21.15.17:0/3126304300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56424ef603b0 msgr2=0x56424ef6d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:59:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.007+0000 7fad67e00640 1 --2- 172.21.15.17:0/3126304300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56424ef603b0 0x56424ef6d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.007+0000 7fad67e00640 1 -- 172.21.15.17:0/3126304300 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56424eec1170 con 0x56424ef65440 2024-09-13T15:59:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.007+0000 7fad66a00640 1 --2- 172.21.15.17:0/3126304300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56424ef603b0 0x56424ef6d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:59:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.008+0000 7fad67e00640 1 --2- 172.21.15.17:0/3126304300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef65440 0x56424ef70120 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fad6000eb60 tx=0x7fad6000d7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f1c2d21493f8e86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:59:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.008+0000 7fad55600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T15:59:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.008+0000 7fad55600640 1 -- 172.21.15.17:0/3126304300 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6001d070 con 0x56424ef65440 2024-09-13T15:59:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.008+0000 7fad55600640 1 -- 172.21.15.17:0/3126304300 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fad60004b20 con 0x56424ef65440 2024-09-13T15:59:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.008+0000 7fad70dd6740 1 -- 172.21.15.17:0/3126304300 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fad58018e30 con 0x56424ef65440 2024-09-13T15:59:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.008+0000 7fad55600640 1 -- 172.21.15.17:0/3126304300 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad60014050 con 0x56424ef65440 2024-09-13T15:59:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.008+0000 7fad70dd6740 10 client.25538 fetch_fsmap learned FSMap version 29 2024-09-13T15:59:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.008+0000 7fad70dd6740 1 -- 172.21.15.17:0/3126304300 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x56424ee88560 con 0x56424ef65440 2024-09-13T15:59:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.009+0000 7fad55600640 1 -- 172.21.15.17:0/3126304300 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad58018e30 con 0x56424ef65440 2024-09-13T15:59:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.009+0000 7fad55600640 1 -- 172.21.15.17:0/3126304300 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 29) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fad60020030 con 0x56424ef65440 2024-09-13T15:59:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.009+0000 7fad70dd6740 10 client.25538 fetch_fsmap finished waiting for FSMap version 29 2024-09-13T15:59:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.009+0000 7fad70dd6740 10 client.25538 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T15:59:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.009+0000 7fad70dd6740 20 client.25538 populate_metadata read hostname 'smithi017' 2024-09-13T15:59:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.009+0000 7fad70dd6740 1 --2- 172.21.15.17:0/3126304300 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56424efddc10 0x56424efe0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:59:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.009+0000 7fad70dd6740 4 client.25538 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T15:59:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.009+0000 7fad70dd6740 1 -- 172.21.15.17:0/3126304300 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56424ebb6300 con 0x56424efddc10 2024-09-13T15:59:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.010+0000 7fad67400640 1 --2- 172.21.15.17:0/3126304300 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56424efddc10 0x56424efe0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:59:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.011+0000 7fad67400640 1 --2- 172.21.15.17:0/3126304300 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56424efddc10 0x56424efe0030 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61d93ac671dffbd8 server_cookie=876fa5ad480f7fe in_seq=0 out_seq=0 2024-09-13T15:59:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.011+0000 7fad55600640 10 client.25538 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T15:59:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.073+0000 7fad55600640 1 -- 172.21.15.17:0/3126304300 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56424ebb6300 con 0x56424efddc10 2024-09-13T15:59:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.073+0000 7fad55600640 10 client.25538 handle_command_reply: tid=0 2024-09-13T15:59:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.073+0000 7fad70dd6740 1 client.25538 shutdown 2024-09-13T15:59:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.074+0000 7fad70dd6740 1 -- 172.21.15.17:0/3126304300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef65440 msgr2=0x56424ef70120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.074+0000 7fad70dd6740 1 --2- 172.21.15.17:0/3126304300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef65440 0x56424ef70120 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fad6000eb60 tx=0x7fad6000d7b0 comp rx=0 tx=0).stop 2024-09-13T15:59:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.074+0000 7fad70dd6740 1 -- 172.21.15.17:0/3126304300 shutdown_connections 2024-09-13T15:59:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.074+0000 7fad70dd6740 1 --2- 172.21.15.17:0/3126304300 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56424efddc10 0x56424efe0030 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.074+0000 7fad70dd6740 1 --2- 172.21.15.17:0/3126304300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56424ef65440 0x56424ef70120 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.074+0000 7fad70dd6740 1 --2- 172.21.15.17:0/3126304300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56424ef603b0 0x56424ef6d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.074+0000 7fad55600640 0 client.25538 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T15:59:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.074+0000 7fad70dd6740 1 --2- 172.21.15.17:0/3126304300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56424ef5fa70 0x56424ef6cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:52.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.074+0000 7fad70dd6740 1 -- 172.21.15.17:0/3126304300 >> 172.21.15.17:0/3126304300 conn(0x56424ef5b0e0 msgr2=0x56424ef61410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:52.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.075+0000 7fad70dd6740 1 -- 172.21.15.17:0/3126304300 shutdown_connections 2024-09-13T15:59:52.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.075+0000 7fad70dd6740 1 -- 172.21.15.17:0/3126304300 wait complete. 2024-09-13T15:59:52.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T15:59:52.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T15:59:52.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T15:59:52.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T15:59:52.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.076+0000 7fad70dd6740 20 client.25538 trim_cache size 0 max 16384 2024-09-13T15:59:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.077+0000 7fad6e000640 1 -- 172.21.15.17:0/1923713414 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fad4c0a1160 msgr2=0x7fad4c0a3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.077+0000 7fad6e000640 1 --2- 172.21.15.17:0/1923713414 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fad4c0a1160 0x7fad4c0a3620 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fad58017880 tx=0x7fad58012000 comp rx=0 tx=0).stop 2024-09-13T15:59:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.077+0000 7fad6e000640 1 -- 172.21.15.17:0/1923713414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad680feba0 msgr2=0x7fad6810e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:59:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.077+0000 7fad6e000640 1 --2- 172.21.15.17:0/1923713414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad680feba0 0x7fad6810e5f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fad50009780 tx=0x7fad50032ca0 comp rx=0 tx=0).stop 2024-09-13T15:59:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.078+0000 7fad6e000640 1 -- 172.21.15.17:0/1923713414 shutdown_connections 2024-09-13T15:59:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.078+0000 7fad6e000640 1 --2- 172.21.15.17:0/1923713414 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fad4c0a1160 0x7fad4c0a3620 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.078+0000 7fad6e000640 1 --2- 172.21.15.17:0/1923713414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad68100750 0x7fad6810b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.078+0000 7fad6e000640 1 --2- 172.21.15.17:0/1923713414 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad680ffd90 0x7fad6810eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.078+0000 7fad6e000640 1 --2- 172.21.15.17:0/1923713414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad680feba0 0x7fad6810e5f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:59:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.078+0000 7fad6e000640 1 -- 172.21.15.17:0/1923713414 >> 172.21.15.17:0/1923713414 conn(0x7fad680fa320 msgr2=0x7fad680fafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:59:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.078+0000 7fad6e000640 1 -- 172.21.15.17:0/1923713414 shutdown_connections 2024-09-13T15:59:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T15:59:52.078+0000 7fad6e000640 1 -- 172.21.15.17:0/1923713414 wait complete. 2024-09-13T15:59:52.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:52 smithi189 ceph-mon[34790]: pgmap v449: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 12 MiB/s wr, 891 op/s 2024-09-13T15:59:52.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:52 smithi193 ceph-mon[35248]: pgmap v449: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 12 MiB/s wr, 891 op/s 2024-09-13T15:59:52.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:52 smithi017 ceph-mon[30494]: pgmap v449: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 12 MiB/s wr, 891 op/s 2024-09-13T15:59:54.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:54 smithi189 ceph-mon[34790]: pgmap v450: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 955 op/s 2024-09-13T15:59:54.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:54 smithi193 ceph-mon[35248]: pgmap v450: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 955 op/s 2024-09-13T15:59:54.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:54 smithi017 ceph-mon[30494]: pgmap v450: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 955 op/s 2024-09-13T15:59:55.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 130.0 s, 1880.6 tps, lat 52.826 ms stddev 60.871 2024-09-13T15:59:56.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:56 smithi189 ceph-mon[34790]: pgmap v451: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 905 op/s 2024-09-13T15:59:56.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:56 smithi193 ceph-mon[35248]: pgmap v451: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 905 op/s 2024-09-13T15:59:56.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:56 smithi017 ceph-mon[30494]: pgmap v451: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 905 op/s 2024-09-13T15:59:58.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 15:59:58 smithi189 ceph-mon[34790]: pgmap v452: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 886 op/s 2024-09-13T15:59:58.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 15:59:58 smithi193 ceph-mon[35248]: pgmap v452: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 886 op/s 2024-09-13T15:59:58.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 15:59:58 smithi017 ceph-mon[30494]: pgmap v452: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 886 op/s 2024-09-13T16:00:00.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 135.0 s, 1953.4 tps, lat 51.127 ms stddev 63.973 2024-09-13T16:00:00.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:00 smithi189 ceph-mon[34790]: overall HEALTH_OK 2024-09-13T16:00:00.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:00 smithi193 ceph-mon[35248]: overall HEALTH_OK 2024-09-13T16:00:00.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:00 smithi017 ceph-mon[30494]: overall HEALTH_OK 2024-09-13T16:00:01.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:01 smithi189 ceph-mon[34790]: pgmap v453: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 882 op/s 2024-09-13T16:00:01.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:01 smithi193 ceph-mon[35248]: pgmap v453: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 882 op/s 2024-09-13T16:00:01.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:01 smithi017 ceph-mon[30494]: pgmap v453: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 882 op/s 2024-09-13T16:00:02.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:02 smithi189 ceph-mon[34790]: pgmap v454: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.6 MiB/s wr, 748 op/s 2024-09-13T16:00:02.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:02 smithi193 ceph-mon[35248]: pgmap v454: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.6 MiB/s wr, 748 op/s 2024-09-13T16:00:02.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:02 smithi017 ceph-mon[30494]: pgmap v454: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.6 MiB/s wr, 748 op/s 2024-09-13T16:00:04.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:04 smithi189 ceph-mon[34790]: pgmap v455: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.4 MiB/s wr, 662 op/s 2024-09-13T16:00:04.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:04 smithi193 ceph-mon[35248]: pgmap v455: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.4 MiB/s wr, 662 op/s 2024-09-13T16:00:04.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:04 smithi017 ceph-mon[30494]: pgmap v455: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.4 MiB/s wr, 662 op/s 2024-09-13T16:00:05.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.271+0000 7fc694200640 1 -- 172.21.15.17:0/1086852955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc68c0fddc0 msgr2=0x7fc68c0fe240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:05.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.271+0000 7fc694200640 1 --2- 172.21.15.17:0/1086852955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc68c0fddc0 0x7fc68c0fe240 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc678009900 tx=0x7fc67802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.271+0000 7fc694200640 1 -- 172.21.15.17:0/1086852955 shutdown_connections 2024-09-13T16:00:05.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.271+0000 7fc694200640 1 --2- 172.21.15.17:0/1086852955 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc68c0fe780 0x7fc68c0fec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.271+0000 7fc694200640 1 --2- 172.21.15.17:0/1086852955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc68c0fddc0 0x7fc68c0fe240 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.271+0000 7fc694200640 1 --2- 172.21.15.17:0/1086852955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc68c1002d0 0x7fc68c1006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.271+0000 7fc694200640 1 -- 172.21.15.17:0/1086852955 >> 172.21.15.17:0/1086852955 conn(0x7fc68c0f9b50 msgr2=0x7fc68c0fbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:05.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.271+0000 7fc694200640 1 -- 172.21.15.17:0/1086852955 shutdown_connections 2024-09-13T16:00:05.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.272+0000 7fc694200640 1 -- 172.21.15.17:0/1086852955 wait complete. 2024-09-13T16:00:05.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.275+0000 7fc694200640 1 Processor -- start 2024-09-13T16:00:05.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.275+0000 7fc694200640 1 -- start start 2024-09-13T16:00:05.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.276+0000 7fc694200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc68c0fddc0 0x7fc68c19c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:05.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.277+0000 7fc694200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc68c0fe780 0x7fc68c19c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:05.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.277+0000 7fc694200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc68c1002d0 0x7fc68c1a3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:05.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.277+0000 7fc694200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c1a3e90 con 0x7fc68c0fddc0 2024-09-13T16:00:05.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.277+0000 7fc694200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c1a4000 con 0x7fc68c0fe780 2024-09-13T16:00:05.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.277+0000 7fc694200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c1a41c0 con 0x7fc68c1002d0 2024-09-13T16:00:05.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.277+0000 7fc690e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc68c0fe780 0x7fc68c19c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:05.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.277+0000 7fc690e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc68c0fe780 0x7fc68c19c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:39290/0 (socket says 172.21.15.17:39290) 2024-09-13T16:00:05.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.277+0000 7fc690e00640 1 -- 172.21.15.17:0/1568067459 learned_addr learned my addr 172.21.15.17:0/1568067459 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.277+0000 7fc692200640 1 --2- 172.21.15.17:0/1568067459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc68c1002d0 0x7fc68c1a3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.277+0000 7fc691800640 1 --2- 172.21.15.17:0/1568067459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc68c0fddc0 0x7fc68c19c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.278+0000 7fc692200640 1 -- 172.21.15.17:0/1568067459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc68c0fe780 msgr2=0x7fc68c19c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.278+0000 7fc692200640 1 --2- 172.21.15.17:0/1568067459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc68c0fe780 0x7fc68c19c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.278+0000 7fc692200640 1 -- 172.21.15.17:0/1568067459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc68c0fddc0 msgr2=0x7fc68c19c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.278+0000 7fc692200640 1 --2- 172.21.15.17:0/1568067459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc68c0fddc0 0x7fc68c19c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.278+0000 7fc692200640 1 -- 172.21.15.17:0/1568067459 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc680009490 con 0x7fc68c1002d0 2024-09-13T16:00:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.278+0000 7fc691800640 1 --2- 172.21.15.17:0/1568067459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc68c0fddc0 0x7fc68c19c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:00:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.278+0000 7fc692200640 1 --2- 172.21.15.17:0/1568067459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc68c1002d0 0x7fc68c1a3950 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc684009fd0 tx=0x7fc68400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.279+0000 7fc68a000640 1 -- 172.21.15.17:0/1568067459 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68400ce20 con 0x7fc68c1002d0 2024-09-13T16:00:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.279+0000 7fc68a000640 1 -- 172.21.15.17:0/1568067459 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc684005020 con 0x7fc68c1002d0 2024-09-13T16:00:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.279+0000 7fc694200640 1 -- 172.21.15.17:0/1568067459 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc678009560 con 0x7fc68c1002d0 2024-09-13T16:00:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.279+0000 7fc68a000640 1 -- 172.21.15.17:0/1568067459 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc684010670 con 0x7fc68c1002d0 2024-09-13T16:00:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.279+0000 7fc694200640 1 -- 172.21.15.17:0/1568067459 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68c1a4820 con 0x7fc68c1002d0 2024-09-13T16:00:05.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.285+0000 7fc69702c740 1 Processor -- start 2024-09-13T16:00:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.288+0000 7fc68a000640 1 -- 172.21.15.17:0/1568067459 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc684005450 con 0x7fc68c1002d0 2024-09-13T16:00:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.289+0000 7fc69702c740 1 -- start start 2024-09-13T16:00:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.291+0000 7fc68a000640 1 --2- 172.21.15.17:0/1568067459 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc6740a1090 0x7fc6740a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:05.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.291+0000 7fc68a000640 1 -- 172.21.15.17:0/1568067459 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fc684014070 con 0x7fc68c1002d0 2024-09-13T16:00:05.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.292+0000 7fc690e00640 1 --2- 172.21.15.17:0/1568067459 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc6740a1090 0x7fc6740a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.294+0000 7fc69702c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55794a76ca70 0x55794a76ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.294+0000 7fc69702c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a76d3b0 0x55794a771e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.294+0000 7fc69702c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55794a772440 0x55794a774900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.294+0000 7fc69702c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794a678bb0 con 0x55794a772440 2024-09-13T16:00:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.294+0000 7fc69702c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794a6d6a70 con 0x55794a76d3b0 2024-09-13T16:00:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.294+0000 7fc69702c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794a6d4200 con 0x55794a76ca70 2024-09-13T16:00:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.294+0000 7fc690e00640 1 --2- 172.21.15.17:0/1568067459 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc6740a1090 0x7fc6740a3550 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc68c19d8b0 tx=0x7fc678005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.295+0000 7fc691800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55794a76ca70 0x55794a76ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.295+0000 7fc692200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55794a772440 0x55794a774900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.295+0000 7fc691800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55794a76ca70 0x55794a76ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:36456/0 (socket says 172.21.15.17:36456) 2024-09-13T16:00:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.295+0000 7fc691800640 1 -- 172.21.15.17:0/1071241936 learned_addr learned my addr 172.21.15.17:0/1071241936 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.295+0000 7fc690e00640 1 --2- 172.21.15.17:0/1071241936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a76d3b0 0x55794a771e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:05.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.296+0000 7fc691800640 1 -- 172.21.15.17:0/1071241936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a76d3b0 msgr2=0x55794a771e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:05.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.296+0000 7fc691800640 1 --2- 172.21.15.17:0/1071241936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a76d3b0 0x55794a771e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.296+0000 7fc691800640 1 -- 172.21.15.17:0/1071241936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55794a772440 msgr2=0x55794a774900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:05.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.296+0000 7fc691800640 1 --2- 172.21.15.17:0/1071241936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55794a772440 0x55794a774900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.296+0000 7fc691800640 1 -- 172.21.15.17:0/1071241936 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55794a671940 con 0x55794a76ca70 2024-09-13T16:00:05.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.297+0000 7fc691800640 1 --2- 172.21.15.17:0/1071241936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55794a76ca70 0x55794a76ce70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc680009ee0 tx=0x7fc6800117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5cb789f0b8cf237 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:05.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.297+0000 7fc67ea00640 1 -- 172.21.15.17:0/1071241936 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc680012650 con 0x55794a76ca70 2024-09-13T16:00:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.297+0000 7fc67ea00640 1 -- 172.21.15.17:0/1071241936 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc680012c70 con 0x55794a76ca70 2024-09-13T16:00:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.298+0000 7fc67ea00640 1 -- 172.21.15.17:0/1071241936 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68000fd10 con 0x55794a76ca70 2024-09-13T16:00:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.299+0000 7fc69702c740 1 -- 172.21.15.17:0/1071241936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55794a76ca70 msgr2=0x55794a76ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.299+0000 7fc69702c740 1 --2- 172.21.15.17:0/1071241936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55794a76ca70 0x55794a76ce70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc680009ee0 tx=0x7fc6800117b0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.299+0000 7fc69702c740 1 -- 172.21.15.17:0/1071241936 shutdown_connections 2024-09-13T16:00:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.299+0000 7fc69702c740 1 --2- 172.21.15.17:0/1071241936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55794a772440 0x55794a774900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.299+0000 7fc69702c740 1 --2- 172.21.15.17:0/1071241936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a76d3b0 0x55794a771e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.299+0000 7fc69702c740 1 --2- 172.21.15.17:0/1071241936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55794a76ca70 0x55794a76ce70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.299+0000 7fc69702c740 1 -- 172.21.15.17:0/1071241936 >> 172.21.15.17:0/1071241936 conn(0x55794a7680e0 msgr2=0x55794a7684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.299+0000 7fc69702c740 1 -- 172.21.15.17:0/1071241936 shutdown_connections 2024-09-13T16:00:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.299+0000 7fc69702c740 1 -- 172.21.15.17:0/1071241936 wait complete. 2024-09-13T16:00:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.300+0000 7fc69702c740 1 -- start start 2024-09-13T16:00:05.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.301+0000 7fc69702c740 1 Processor -- start 2024-09-13T16:00:05.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.303+0000 7fc69702c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55794a76ca70 0x55794a7767d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:05.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.304+0000 7fc69702c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a76d3b0 0x55794a776d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.304+0000 7fc69702c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55794a772440 0x55794a77dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.304+0000 7fc69702c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794a6cfaf0 con 0x55794a772440 2024-09-13T16:00:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.304+0000 7fc69702c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794a68df20 con 0x55794a76d3b0 2024-09-13T16:00:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.304+0000 7fc69702c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794a68dbc0 con 0x55794a76ca70 2024-09-13T16:00:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.304+0000 7fc69702c740 10 client.0 _ll_register_callbacks cb 0x55794a6bfa70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:00:05.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.304+0000 7fc692200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55794a772440 0x55794a77dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:05.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.304+0000 7fc692200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55794a772440 0x55794a77dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34124/0 (socket says 172.21.15.17:34124) 2024-09-13T16:00:05.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.304+0000 7fc692200640 1 -- 172.21.15.17:0/1907937487 learned_addr learned my addr 172.21.15.17:0/1907937487 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:05.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.304+0000 7fc690e00640 1 --2- 172.21.15.17:0/1907937487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a76d3b0 0x55794a776d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:05.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.304+0000 7fc692200640 1 -- 172.21.15.17:0/1907937487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55794a76ca70 msgr2=0x55794a7767d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:00:05.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.304+0000 7fc692200640 1 --2- 172.21.15.17:0/1907937487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55794a76ca70 0x55794a7767d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.305+0000 7fc692200640 1 -- 172.21.15.17:0/1907937487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a76d3b0 msgr2=0x55794a776d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:05.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.305+0000 7fc692200640 1 --2- 172.21.15.17:0/1907937487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a76d3b0 0x55794a776d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.305+0000 7fc692200640 1 -- 172.21.15.17:0/1907937487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc680009b10 con 0x55794a772440 2024-09-13T16:00:05.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.305+0000 7fc692200640 1 --2- 172.21.15.17:0/1907937487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55794a772440 0x55794a77dd00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc6840969b0 tx=0x7fc68409acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7fdd5cf93ccccfe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:05.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.305+0000 7fc673400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T16:00:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.307+0000 7fc673400640 1 -- 172.21.15.17:0/1907937487 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6840cd160 con 0x55794a772440 2024-09-13T16:00:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.308+0000 7fc673400640 1 -- 172.21.15.17:0/1907937487 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fc6840a2930 con 0x55794a772440 2024-09-13T16:00:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.308+0000 7fc69702c740 1 -- 172.21.15.17:0/1907937487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55794a6f9c90 con 0x55794a772440 2024-09-13T16:00:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.308+0000 7fc673400640 1 -- 172.21.15.17:0/1907937487 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6840850b0 con 0x55794a772440 2024-09-13T16:00:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.308+0000 7fc69702c740 10 client.15474 fetch_fsmap learned FSMap version 29 2024-09-13T16:00:05.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.308+0000 7fc69702c740 1 -- 172.21.15.17:0/1907937487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55794a6ce170 con 0x55794a772440 2024-09-13T16:00:05.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.309+0000 7fc673400640 1 -- 172.21.15.17:0/1907937487 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55794a6f9c90 con 0x55794a772440 2024-09-13T16:00:05.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.312+0000 7fc673400640 1 -- 172.21.15.17:0/1907937487 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fc68401f070 con 0x55794a772440 2024-09-13T16:00:05.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.312+0000 7fc69702c740 10 client.15474 fetch_fsmap finished waiting for FSMap version 29 2024-09-13T16:00:05.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.312+0000 7fc69702c740 10 client.15474 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:00:05.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.312+0000 7fc69702c740 20 client.15474 populate_metadata read hostname 'smithi017' 2024-09-13T16:00:05.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.312+0000 7fc69702c740 1 --2- 172.21.15.17:0/1907937487 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55794a793410 0x55794a795830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:05.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.312+0000 7fc69702c740 4 client.15474 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:00:05.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.312+0000 7fc69702c740 1 -- 172.21.15.17:0/1907937487 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55794a6c27d0 con 0x55794a793410 2024-09-13T16:00:05.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 140.0 s, 1903.1 tps, lat 52.086 ms stddev 78.477 2024-09-13T16:00:05.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.314+0000 7fc691800640 1 --2- 172.21.15.17:0/1907937487 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55794a793410 0x55794a795830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:05.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.317+0000 7fc691800640 1 --2- 172.21.15.17:0/1907937487 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55794a793410 0x55794a795830 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1852496e235d200b server_cookie=ba81bc69cced8124 in_seq=0 out_seq=0 2024-09-13T16:00:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.317+0000 7fc673400640 10 client.15474 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:00:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.318+0000 7fc673400640 1 -- 172.21.15.17:0/1907937487 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55794a6c27d0 con 0x55794a793410 2024-09-13T16:00:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.318+0000 7fc673400640 10 client.15474 handle_command_reply: tid=0 2024-09-13T16:00:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.318+0000 7fc69702c740 1 client.15474 shutdown 2024-09-13T16:00:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.318+0000 7fc69702c740 1 -- 172.21.15.17:0/1907937487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55794a772440 msgr2=0x55794a77dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.318+0000 7fc69702c740 1 --2- 172.21.15.17:0/1907937487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55794a772440 0x55794a77dd00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc6840969b0 tx=0x7fc68409acf0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.319+0000 7fc69702c740 1 -- 172.21.15.17:0/1907937487 shutdown_connections 2024-09-13T16:00:05.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.319+0000 7fc69702c740 1 --2- 172.21.15.17:0/1907937487 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55794a793410 0x55794a795830 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.319+0000 7fc69702c740 1 --2- 172.21.15.17:0/1907937487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55794a772440 0x55794a77dd00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.319+0000 7fc69702c740 1 --2- 172.21.15.17:0/1907937487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a76d3b0 0x55794a776d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.319+0000 7fc69702c740 1 --2- 172.21.15.17:0/1907937487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55794a76ca70 0x55794a7767d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.319+0000 7fc673400640 0 client.15474 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:00:05.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.319+0000 7fc69702c740 1 -- 172.21.15.17:0/1907937487 >> 172.21.15.17:0/1907937487 conn(0x55794a7680e0 msgr2=0x55794a7698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:05.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.321+0000 7fc69702c740 1 -- 172.21.15.17:0/1907937487 shutdown_connections 2024-09-13T16:00:05.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.321+0000 7fc69702c740 1 -- 172.21.15.17:0/1907937487 wait complete. 2024-09-13T16:00:05.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.321+0000 7fc69702c740 20 client.15474 trim_cache size 0 max 16384 2024-09-13T16:00:05.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.349+0000 7fc69702c740 1 Processor -- start 2024-09-13T16:00:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.350+0000 7fc69702c740 1 -- start start 2024-09-13T16:00:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.350+0000 7fc69702c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55794a76ca70 0x55794a79a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.350+0000 7fc69702c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55794a76d3b0 0x55794a77dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.350+0000 7fc69702c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a772440 0x55794a7767d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.350+0000 7fc69702c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794a436e60 con 0x55794a76ca70 2024-09-13T16:00:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.350+0000 7fc69702c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794a763b40 con 0x55794a772440 2024-09-13T16:00:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.350+0000 7fc69702c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794a76d910 con 0x55794a76d3b0 2024-09-13T16:00:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.351+0000 7fc690e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55794a76d3b0 0x55794a77dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.351+0000 7fc690e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55794a76d3b0 0x55794a77dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:36486/0 (socket says 172.21.15.17:36486) 2024-09-13T16:00:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.351+0000 7fc690e00640 1 -- 172.21.15.17:0/555204381 learned_addr learned my addr 172.21.15.17:0/555204381 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.351+0000 7fc692200640 1 --2- 172.21.15.17:0/555204381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a772440 0x55794a7767d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.351+0000 7fc691800640 1 --2- 172.21.15.17:0/555204381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55794a76ca70 0x55794a79a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.352+0000 7fc692200640 1 -- 172.21.15.17:0/555204381 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55794a76d3b0 msgr2=0x55794a77dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.352+0000 7fc692200640 1 --2- 172.21.15.17:0/555204381 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55794a76d3b0 0x55794a77dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.352+0000 7fc692200640 1 -- 172.21.15.17:0/555204381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55794a76ca70 msgr2=0x55794a79a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.352+0000 7fc692200640 1 --2- 172.21.15.17:0/555204381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55794a76ca70 0x55794a79a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.352+0000 7fc692200640 1 -- 172.21.15.17:0/555204381 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55794a670180 con 0x55794a772440 2024-09-13T16:00:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.353+0000 7fc692200640 1 --2- 172.21.15.17:0/555204381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a772440 0x55794a7767d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc684098800 tx=0x7fc684098a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebb13eed54737d0d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.353+0000 7fc67f400640 1 -- 172.21.15.17:0/555204381 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc684005b70 con 0x55794a772440 2024-09-13T16:00:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.353+0000 7fc67f400640 1 -- 172.21.15.17:0/555204381 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6840b6020 con 0x55794a772440 2024-09-13T16:00:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.353+0000 7fc67f400640 1 -- 172.21.15.17:0/555204381 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68409a280 con 0x55794a772440 2024-09-13T16:00:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.354+0000 7fc69702c740 1 -- 172.21.15.17:0/555204381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a772440 msgr2=0x55794a7767d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.354+0000 7fc69702c740 1 --2- 172.21.15.17:0/555204381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a772440 0x55794a7767d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc684098800 tx=0x7fc684098a60 comp rx=0 tx=0).stop 2024-09-13T16:00:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.354+0000 7fc69702c740 1 -- 172.21.15.17:0/555204381 shutdown_connections 2024-09-13T16:00:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.354+0000 7fc69702c740 1 --2- 172.21.15.17:0/555204381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a772440 0x55794a7767d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.355+0000 7fc69702c740 1 --2- 172.21.15.17:0/555204381 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55794a76d3b0 0x55794a77dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.355+0000 7fc69702c740 1 --2- 172.21.15.17:0/555204381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55794a76ca70 0x55794a79a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.355+0000 7fc69702c740 1 -- 172.21.15.17:0/555204381 >> 172.21.15.17:0/555204381 conn(0x55794a7680e0 msgr2=0x55794a7719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.355+0000 7fc69702c740 1 -- 172.21.15.17:0/555204381 shutdown_connections 2024-09-13T16:00:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.356+0000 7fc69702c740 1 -- 172.21.15.17:0/555204381 wait complete. 2024-09-13T16:00:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.356+0000 7fc69702c740 1 -- start start 2024-09-13T16:00:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.356+0000 7fc69702c740 1 Processor -- start 2024-09-13T16:00:05.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.360+0000 7fc69702c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55794a76ca70 0x55794a779c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.360+0000 7fc69702c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55794a76d3b0 0x55794a77a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:05.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.360+0000 7fc69702c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a772440 0x55794a77d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:05.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.361+0000 7fc69702c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794a77d6c0 con 0x55794a76ca70 2024-09-13T16:00:05.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.361+0000 7fc69702c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794a77d830 con 0x55794a772440 2024-09-13T16:00:05.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.361+0000 7fc69702c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794a77d9f0 con 0x55794a76d3b0 2024-09-13T16:00:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.361+0000 7fc692200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a772440 0x55794a77d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.361+0000 7fc690e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55794a76d3b0 0x55794a77a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.361+0000 7fc692200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a772440 0x55794a77d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:39318/0 (socket says 172.21.15.17:39318) 2024-09-13T16:00:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.361+0000 7fc692200640 1 -- 172.21.15.17:0/3079477947 learned_addr learned my addr 172.21.15.17:0/3079477947 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.361+0000 7fc69702c740 10 client.0 _ll_register_callbacks cb 0x7fc680009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:00:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.362+0000 7fc692200640 1 -- 172.21.15.17:0/3079477947 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55794a76d3b0 msgr2=0x55794a77a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.362+0000 7fc692200640 1 --2- 172.21.15.17:0/3079477947 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55794a76d3b0 0x55794a77a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.362+0000 7fc692200640 1 -- 172.21.15.17:0/3079477947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55794a76ca70 msgr2=0x55794a779c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.362+0000 7fc692200640 1 --2- 172.21.15.17:0/3079477947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55794a76ca70 0x55794a779c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.362+0000 7fc692200640 1 -- 172.21.15.17:0/3079477947 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55794a6ce170 con 0x55794a772440 2024-09-13T16:00:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.363+0000 7fc692200640 1 --2- 172.21.15.17:0/3079477947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a772440 0x55794a77d180 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc68400c760 tx=0x7fc68409a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95fd6fe78b8834d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.363+0000 7fc673400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:00:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.364+0000 7fc673400640 1 -- 172.21.15.17:0/3079477947 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc684005b70 con 0x55794a772440 2024-09-13T16:00:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.364+0000 7fc673400640 1 -- 172.21.15.17:0/3079477947 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fc6840b7030 con 0x55794a772440 2024-09-13T16:00:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.364+0000 7fc69702c740 1 -- 172.21.15.17:0/3079477947 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc680012c70 con 0x55794a772440 2024-09-13T16:00:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.364+0000 7fc673400640 1 -- 172.21.15.17:0/3079477947 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc68409a280 con 0x55794a772440 2024-09-13T16:00:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.365+0000 7fc69702c740 10 client.25553 fetch_fsmap learned FSMap version 29 2024-09-13T16:00:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.366+0000 7fc69702c740 1 -- 172.21.15.17:0/3079477947 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55794a695560 con 0x55794a772440 2024-09-13T16:00:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.366+0000 7fc673400640 1 -- 172.21.15.17:0/3079477947 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6840a6020 con 0x55794a772440 2024-09-13T16:00:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.366+0000 7fc673400640 1 -- 172.21.15.17:0/3079477947 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 29) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fc68401f040 con 0x55794a772440 2024-09-13T16:00:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.366+0000 7fc69702c740 10 client.25553 fetch_fsmap finished waiting for FSMap version 29 2024-09-13T16:00:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.366+0000 7fc69702c740 10 client.25553 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:00:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.366+0000 7fc69702c740 20 client.25553 populate_metadata read hostname 'smithi017' 2024-09-13T16:00:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.366+0000 7fc69702c740 1 --2- 172.21.15.17:0/3079477947 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55794a7ea620 0x55794a7eca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.367+0000 7fc69702c740 4 client.25553 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:00:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.367+0000 7fc69702c740 1 -- 172.21.15.17:0/3079477947 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55794a3c3300 con 0x55794a7ea620 2024-09-13T16:00:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.367+0000 7fc691800640 1 --2- 172.21.15.17:0/3079477947 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55794a7ea620 0x55794a7eca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:05.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.368+0000 7fc691800640 1 --2- 172.21.15.17:0/3079477947 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55794a7ea620 0x55794a7eca10 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97d070a28be61dbd server_cookie=dfffaefd1677c409 in_seq=0 out_seq=0 2024-09-13T16:00:05.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.368+0000 7fc673400640 10 client.25553 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:00:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.403+0000 7fc673400640 1 -- 172.21.15.17:0/3079477947 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55794a3c3300 con 0x55794a7ea620 2024-09-13T16:00:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.403+0000 7fc673400640 10 client.25553 handle_command_reply: tid=0 2024-09-13T16:00:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.404+0000 7fc69702c740 1 client.25553 shutdown 2024-09-13T16:00:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.404+0000 7fc69702c740 1 -- 172.21.15.17:0/3079477947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a772440 msgr2=0x55794a77d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.405+0000 7fc69702c740 1 --2- 172.21.15.17:0/3079477947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a772440 0x55794a77d180 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc68400c760 tx=0x7fc68409a0f0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.405+0000 7fc69702c740 1 -- 172.21.15.17:0/3079477947 shutdown_connections 2024-09-13T16:00:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.405+0000 7fc69702c740 1 --2- 172.21.15.17:0/3079477947 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55794a7ea620 0x55794a7eca10 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.405+0000 7fc69702c740 1 --2- 172.21.15.17:0/3079477947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55794a772440 0x55794a77d180 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.405+0000 7fc69702c740 1 --2- 172.21.15.17:0/3079477947 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55794a76d3b0 0x55794a77a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.405+0000 7fc69702c740 1 --2- 172.21.15.17:0/3079477947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55794a76ca70 0x55794a779c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.405+0000 7fc69702c740 1 -- 172.21.15.17:0/3079477947 >> 172.21.15.17:0/3079477947 conn(0x55794a7680e0 msgr2=0x55794a7684c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.406+0000 7fc673400640 0 client.25553 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:00:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.406+0000 7fc69702c740 1 -- 172.21.15.17:0/3079477947 shutdown_connections 2024-09-13T16:00:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.406+0000 7fc69702c740 1 -- 172.21.15.17:0/3079477947 wait complete. 2024-09-13T16:00:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:00:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:00:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:00:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:00:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.407+0000 7fc69702c740 20 client.25553 trim_cache size 0 max 16384 2024-09-13T16:00:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.409+0000 7fc694200640 1 -- 172.21.15.17:0/1568067459 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc6740a1090 msgr2=0x7fc6740a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.409+0000 7fc694200640 1 --2- 172.21.15.17:0/1568067459 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc6740a1090 0x7fc6740a3550 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc68c19d8b0 tx=0x7fc678005780 comp rx=0 tx=0).stop 2024-09-13T16:00:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.409+0000 7fc694200640 1 -- 172.21.15.17:0/1568067459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc68c1002d0 msgr2=0x7fc68c1a3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.409+0000 7fc694200640 1 --2- 172.21.15.17:0/1568067459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc68c1002d0 0x7fc68c1a3950 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc684009fd0 tx=0x7fc68400ef10 comp rx=0 tx=0).stop 2024-09-13T16:00:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.409+0000 7fc694200640 1 -- 172.21.15.17:0/1568067459 shutdown_connections 2024-09-13T16:00:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.409+0000 7fc694200640 1 --2- 172.21.15.17:0/1568067459 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc6740a1090 0x7fc6740a3550 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.409+0000 7fc694200640 1 --2- 172.21.15.17:0/1568067459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc68c1002d0 0x7fc68c1a3950 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.409+0000 7fc694200640 1 --2- 172.21.15.17:0/1568067459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc68c0fe780 0x7fc68c19c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.409+0000 7fc694200640 1 --2- 172.21.15.17:0/1568067459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc68c0fddc0 0x7fc68c19c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.409+0000 7fc694200640 1 -- 172.21.15.17:0/1568067459 >> 172.21.15.17:0/1568067459 conn(0x7fc68c0f9b50 msgr2=0x7fc68c0fb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.410+0000 7fc694200640 1 -- 172.21.15.17:0/1568067459 shutdown_connections 2024-09-13T16:00:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:05.410+0000 7fc694200640 1 -- 172.21.15.17:0/1568067459 wait complete. 2024-09-13T16:00:06.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:06 smithi189 ceph-mon[34790]: pgmap v456: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.3 MiB/s wr, 571 op/s 2024-09-13T16:00:06.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:06 smithi193 ceph-mon[35248]: pgmap v456: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.3 MiB/s wr, 571 op/s 2024-09-13T16:00:06.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:06 smithi017 ceph-mon[30494]: pgmap v456: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.3 MiB/s wr, 571 op/s 2024-09-13T16:00:08.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:08 smithi189 ceph-mon[34790]: pgmap v457: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.2 MiB/s wr, 610 op/s 2024-09-13T16:00:08.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:08 smithi193 ceph-mon[35248]: pgmap v457: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.2 MiB/s wr, 610 op/s 2024-09-13T16:00:08.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:08 smithi017 ceph-mon[30494]: pgmap v457: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.2 MiB/s wr, 610 op/s 2024-09-13T16:00:10.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 145.0 s, 1006.4 tps, lat 98.855 ms stddev 122.297 2024-09-13T16:00:10.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:10 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:00:10.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:10 smithi189 ceph-mon[34790]: pgmap v458: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.8 MiB/s wr, 765 op/s 2024-09-13T16:00:10.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:10 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:00:10.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:10 smithi193 ceph-mon[35248]: pgmap v458: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.8 MiB/s wr, 765 op/s 2024-09-13T16:00:10.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:10 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:00:10.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:10 smithi017 ceph-mon[30494]: pgmap v458: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.8 MiB/s wr, 765 op/s 2024-09-13T16:00:12.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:12 smithi189 ceph-mon[34790]: pgmap v459: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.3 MiB/s wr, 781 op/s 2024-09-13T16:00:12.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:12 smithi193 ceph-mon[35248]: pgmap v459: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.3 MiB/s wr, 781 op/s 2024-09-13T16:00:12.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:12 smithi017 ceph-mon[30494]: pgmap v459: 129 pgs: 129 active+clean; 1.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.3 MiB/s wr, 781 op/s 2024-09-13T16:00:14.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:14 smithi189 ceph-mon[34790]: pgmap v460: 129 pgs: 129 active+clean; 1.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.9 MiB/s wr, 760 op/s 2024-09-13T16:00:14.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:14 smithi193 ceph-mon[35248]: pgmap v460: 129 pgs: 129 active+clean; 1.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.9 MiB/s wr, 760 op/s 2024-09-13T16:00:14.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:14 smithi017 ceph-mon[30494]: pgmap v460: 129 pgs: 129 active+clean; 1.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.9 MiB/s wr, 760 op/s 2024-09-13T16:00:15.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 150.0 s, 1058.4 tps, lat 95.210 ms stddev 131.560 2024-09-13T16:00:16.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:16 smithi189 ceph-mon[34790]: pgmap v461: 129 pgs: 129 active+clean; 1.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.9 MiB/s wr, 761 op/s 2024-09-13T16:00:16.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:16 smithi193 ceph-mon[35248]: pgmap v461: 129 pgs: 129 active+clean; 1.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.9 MiB/s wr, 761 op/s 2024-09-13T16:00:16.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:16 smithi017 ceph-mon[30494]: pgmap v461: 129 pgs: 129 active+clean; 1.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.9 MiB/s wr, 761 op/s 2024-09-13T16:00:18.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.603+0000 7fdfbfe00640 1 -- 172.21.15.17:0/620769936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdfb8076a50 msgr2=0x7fdfb80772f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:18.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.603+0000 7fdfbfe00640 1 --2- 172.21.15.17:0/620769936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdfb8076a50 0x7fdfb80772f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0009ca0 tx=0x7fdfb002a8c0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.603+0000 7fdfbfe00640 1 -- 172.21.15.17:0/620769936 shutdown_connections 2024-09-13T16:00:18.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.603+0000 7fdfbfe00640 1 --2- 172.21.15.17:0/620769936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdfb8076a50 0x7fdfb80772f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.603+0000 7fdfbfe00640 1 --2- 172.21.15.17:0/620769936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb80760b0 0x7fdfb8076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.603+0000 7fdfbfe00640 1 --2- 172.21.15.17:0/620769936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdfb8074e70 0x7fdfb8075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.604+0000 7fdfbfe00640 1 -- 172.21.15.17:0/620769936 >> 172.21.15.17:0/620769936 conn(0x7fdfb80fd680 msgr2=0x7fdfb80ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:18.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.604+0000 7fdfbfe00640 1 -- 172.21.15.17:0/620769936 shutdown_connections 2024-09-13T16:00:18.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.604+0000 7fdfbfe00640 1 -- 172.21.15.17:0/620769936 wait complete. 2024-09-13T16:00:18.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:18 smithi189 ceph-mon[34790]: pgmap v462: 129 pgs: 129 active+clean; 1.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.7 MiB/s wr, 737 op/s 2024-09-13T16:00:18.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.605+0000 7fdfbfe00640 1 Processor -- start 2024-09-13T16:00:18.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.605+0000 7fdfbfe00640 1 -- start start 2024-09-13T16:00:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.606+0000 7fdfbfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb8074e70 0x7fdfb819c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.606+0000 7fdfbfe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdfb80760b0 0x7fdfb819c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.606+0000 7fdfbfe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdfb8076a50 0x7fdfb81a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.606+0000 7fdfbfe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb81a3df0 con 0x7fdfb8074e70 2024-09-13T16:00:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.606+0000 7fdfbca00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdfb80760b0 0x7fdfb819c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.606+0000 7fdfbde00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdfb8076a50 0x7fdfb81a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.606+0000 7fdfbde00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdfb8076a50 0x7fdfb81a38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:59250/0 (socket says 172.21.15.17:59250) 2024-09-13T16:00:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.606+0000 7fdfbde00640 1 -- 172.21.15.17:0/501339068 learned_addr learned my addr 172.21.15.17:0/501339068 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.606+0000 7fdfbfe00640 1 -- 172.21.15.17:0/501339068 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb81a3f60 con 0x7fdfb80760b0 2024-09-13T16:00:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.606+0000 7fdfbfe00640 1 -- 172.21.15.17:0/501339068 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb81a4120 con 0x7fdfb8076a50 2024-09-13T16:00:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.607+0000 7fdfbde00640 1 -- 172.21.15.17:0/501339068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdfb80760b0 msgr2=0x7fdfb819c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.607+0000 7fdfbde00640 1 --2- 172.21.15.17:0/501339068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdfb80760b0 0x7fdfb819c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.607+0000 7fdfbde00640 1 -- 172.21.15.17:0/501339068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb8074e70 msgr2=0x7fdfb819c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.607+0000 7fdfbde00640 1 --2- 172.21.15.17:0/501339068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb8074e70 0x7fdfb819c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.607+0000 7fdfbde00640 1 -- 172.21.15.17:0/501339068 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb0009900 con 0x7fdfb8076a50 2024-09-13T16:00:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.607+0000 7fdfbde00640 1 --2- 172.21.15.17:0/501339068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdfb8076a50 0x7fdfb81a38b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0009bf0 tx=0x7fdfb0032f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.608+0000 7fdfb6000640 1 -- 172.21.15.17:0/501339068 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0003b70 con 0x7fdfb8076a50 2024-09-13T16:00:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.608+0000 7fdfb6000640 1 -- 172.21.15.17:0/501339068 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdfb0040070 con 0x7fdfb8076a50 2024-09-13T16:00:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.608+0000 7fdfb6000640 1 -- 172.21.15.17:0/501339068 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb00043a0 con 0x7fdfb8076a50 2024-09-13T16:00:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.608+0000 7fdfbfe00640 1 -- 172.21.15.17:0/501339068 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb81a43a0 con 0x7fdfb8076a50 2024-09-13T16:00:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.609+0000 7fdfbfe00640 1 -- 172.21.15.17:0/501339068 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb81a4860 con 0x7fdfb8076a50 2024-09-13T16:00:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.614+0000 7fdfc2c60740 1 Processor -- start 2024-09-13T16:00:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.614+0000 7fdfb6000640 1 -- 172.21.15.17:0/501339068 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fdfb0042030 con 0x7fdfb8076a50 2024-09-13T16:00:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.614+0000 7fdfc2c60740 1 -- start start 2024-09-13T16:00:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.615+0000 7fdfc2c60740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55946f419a70 0x55946f419e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.615+0000 7fdfc2c60740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f41ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.615+0000 7fdfc2c60740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946f41f440 0x55946f421900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.615+0000 7fdfc2c60740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55946f325bb0 con 0x55946f419a70 2024-09-13T16:00:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.615+0000 7fdfc2c60740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55946f383a70 con 0x55946f41a3b0 2024-09-13T16:00:18.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.615+0000 7fdfc2c60740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55946f381200 con 0x55946f41f440 2024-09-13T16:00:18.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.615+0000 7fdfbd400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f41ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:18.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.615+0000 7fdfbd400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f41ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:45314/0 (socket says 172.21.15.17:45314) 2024-09-13T16:00:18.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.615+0000 7fdfbd400640 1 -- 172.21.15.17:0/4248969364 learned_addr learned my addr 172.21.15.17:0/4248969364 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:18.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.615+0000 7fdfbd400640 1 -- 172.21.15.17:0/4248969364 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946f41f440 msgr2=0x55946f421900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:00:18.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.615+0000 7fdfbd400640 1 --2- 172.21.15.17:0/4248969364 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946f41f440 0x55946f421900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.616+0000 7fdfbd400640 1 -- 172.21.15.17:0/4248969364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55946f419a70 msgr2=0x55946f419e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:00:18.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.616+0000 7fdfbca00640 1 --2- 172.21.15.17:0/4248969364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55946f419a70 0x55946f419e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:18.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.616+0000 7fdfbd400640 1 --2- 172.21.15.17:0/4248969364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55946f419a70 0x55946f419e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.616+0000 7fdfbd400640 1 -- 172.21.15.17:0/4248969364 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55946f31e940 con 0x55946f41a3b0 2024-09-13T16:00:18.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.616+0000 7fdfb6000640 1 --2- 172.21.15.17:0/501339068 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdfa00a1160 0x7fdfa00a3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:18.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.617+0000 7fdfb6000640 1 -- 172.21.15.17:0/501339068 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fdfb00ee290 con 0x7fdfb8076a50 2024-09-13T16:00:18.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.617+0000 7fdfbd400640 1 --2- 172.21.15.17:0/4248969364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f41ee70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdfac009c40 tx=0x7fdfac00e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61c1045307036582 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:18.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.617+0000 7fdfbca00640 1 --2- 172.21.15.17:0/501339068 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdfa00a1160 0x7fdfa00a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:18.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.617+0000 7fdfaaa00640 1 -- 172.21.15.17:0/4248969364 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac009790 con 0x55946f41a3b0 2024-09-13T16:00:18.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.617+0000 7fdfaaa00640 1 -- 172.21.15.17:0/4248969364 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdfac0054e0 con 0x55946f41a3b0 2024-09-13T16:00:18.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.617+0000 7fdfaaa00640 1 -- 172.21.15.17:0/4248969364 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac010690 con 0x55946f41a3b0 2024-09-13T16:00:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.618+0000 7fdfc2c60740 1 -- 172.21.15.17:0/4248969364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 msgr2=0x55946f41ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.618+0000 7fdfc2c60740 1 --2- 172.21.15.17:0/4248969364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f41ee70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdfac009c40 tx=0x7fdfac00e720 comp rx=0 tx=0).stop 2024-09-13T16:00:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.618+0000 7fdfbca00640 1 --2- 172.21.15.17:0/501339068 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdfa00a1160 0x7fdfa00a3620 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdfb819d810 tx=0x7fdfa4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.618+0000 7fdfc2c60740 1 -- 172.21.15.17:0/4248969364 shutdown_connections 2024-09-13T16:00:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.618+0000 7fdfc2c60740 1 --2- 172.21.15.17:0/4248969364 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946f41f440 0x55946f421900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.618+0000 7fdfc2c60740 1 --2- 172.21.15.17:0/4248969364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f41ee70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.618+0000 7fdfc2c60740 1 --2- 172.21.15.17:0/4248969364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55946f419a70 0x55946f419e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.618+0000 7fdfc2c60740 1 -- 172.21.15.17:0/4248969364 >> 172.21.15.17:0/4248969364 conn(0x55946f4150e0 msgr2=0x55946f4154e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.618+0000 7fdfc2c60740 1 -- 172.21.15.17:0/4248969364 shutdown_connections 2024-09-13T16:00:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.618+0000 7fdfc2c60740 1 -- 172.21.15.17:0/4248969364 wait complete. 2024-09-13T16:00:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.619+0000 7fdfc2c60740 1 -- start start 2024-09-13T16:00:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.619+0000 7fdfc2c60740 1 Processor -- start 2024-09-13T16:00:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.620+0000 7fdfc2c60740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55946f419a70 0x55946f423760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.620+0000 7fdfc2c60740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f423ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.620+0000 7fdfc2c60740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946f41f440 0x55946f42ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.620+0000 7fdfc2c60740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55946f37caf0 con 0x55946f419a70 2024-09-13T16:00:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.620+0000 7fdfc2c60740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55946f33af20 con 0x55946f41a3b0 2024-09-13T16:00:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.620+0000 7fdfc2c60740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55946f33abc0 con 0x55946f41f440 2024-09-13T16:00:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.620+0000 7fdfc2c60740 10 client.0 _ll_register_callbacks cb 0x55946f36ca70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:00:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.621+0000 7fdfbde00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946f41f440 0x55946f42ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.621+0000 7fdfbca00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f423ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.621+0000 7fdfbca00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f423ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:45324/0 (socket says 172.21.15.17:45324) 2024-09-13T16:00:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.621+0000 7fdfbca00640 1 -- 172.21.15.17:0/2083889943 learned_addr learned my addr 172.21.15.17:0/2083889943 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.622+0000 7fdfbca00640 1 -- 172.21.15.17:0/2083889943 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946f41f440 msgr2=0x55946f42ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.622+0000 7fdfbca00640 1 --2- 172.21.15.17:0/2083889943 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946f41f440 0x55946f42ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.622+0000 7fdfbca00640 1 -- 172.21.15.17:0/2083889943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55946f419a70 msgr2=0x55946f423760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.622+0000 7fdfbca00640 1 --2- 172.21.15.17:0/2083889943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55946f419a70 0x55946f423760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.622+0000 7fdfbca00640 1 -- 172.21.15.17:0/2083889943 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfac0098f0 con 0x55946f41a3b0 2024-09-13T16:00:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.623+0000 7fdfbca00640 1 --2- 172.21.15.17:0/2083889943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f423ca0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4011940 tx=0x7fdfa40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48eb5ada03872269 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.623+0000 7fdf9f400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:00:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.623+0000 7fdf9f400640 1 -- 172.21.15.17:0/2083889943 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4011ec0 con 0x55946f41a3b0 2024-09-13T16:00:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.623+0000 7fdf9f400640 1 -- 172.21.15.17:0/2083889943 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fdfa401eb90 con 0x55946f41a3b0 2024-09-13T16:00:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.623+0000 7fdfc2c60740 1 -- 172.21.15.17:0/2083889943 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55946f3a6c90 con 0x55946f41a3b0 2024-09-13T16:00:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.624+0000 7fdf9f400640 1 -- 172.21.15.17:0/2083889943 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfa401ed50 con 0x55946f41a3b0 2024-09-13T16:00:18.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.624+0000 7fdfc2c60740 10 client.25565 fetch_fsmap learned FSMap version 30 2024-09-13T16:00:18.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.624+0000 7fdfc2c60740 1 -- 172.21.15.17:0/2083889943 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55946f37b170 con 0x55946f41a3b0 2024-09-13T16:00:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.625+0000 7fdf9f400640 1 -- 172.21.15.17:0/2083889943 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55946f3a6c90 con 0x55946f41a3b0 2024-09-13T16:00:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.625+0000 7fdf9f400640 1 -- 172.21.15.17:0/2083889943 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) v1 ==== 7490+0+0 (secure 0 0 0) 0x7fdfa402d020 con 0x55946f41a3b0 2024-09-13T16:00:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.625+0000 7fdfc2c60740 10 client.25565 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T16:00:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.625+0000 7fdfc2c60740 10 client.25565 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:00:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.625+0000 7fdfc2c60740 20 client.25565 populate_metadata read hostname 'smithi017' 2024-09-13T16:00:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.625+0000 7fdfc2c60740 1 --2- 172.21.15.17:0/2083889943 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55946f42f5c0 0x55946f4319e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.625+0000 7fdfc2c60740 4 client.25565 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:00:18.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.625+0000 7fdfc2c60740 1 -- 172.21.15.17:0/2083889943 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55946f36f7d0 con 0x55946f42f5c0 2024-09-13T16:00:18.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.626+0000 7fdfbd400640 1 --2- 172.21.15.17:0/2083889943 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55946f42f5c0 0x55946f4319e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.626+0000 7fdfbd400640 1 --2- 172.21.15.17:0/2083889943 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55946f42f5c0 0x55946f4319e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e81a7adea4945b6 server_cookie=9d5bb8646be12781 in_seq=0 out_seq=0 2024-09-13T16:00:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.626+0000 7fdf9f400640 10 client.25565 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:00:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.627+0000 7fdf9f400640 1 -- 172.21.15.17:0/2083889943 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55946f36f7d0 con 0x55946f42f5c0 2024-09-13T16:00:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.627+0000 7fdf9f400640 10 client.25565 handle_command_reply: tid=0 2024-09-13T16:00:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.627+0000 7fdfc2c60740 1 client.25565 shutdown 2024-09-13T16:00:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.628+0000 7fdfc2c60740 1 -- 172.21.15.17:0/2083889943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 msgr2=0x55946f423ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.628+0000 7fdfc2c60740 1 --2- 172.21.15.17:0/2083889943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f423ca0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4011940 tx=0x7fdfa40046c0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.628+0000 7fdfc2c60740 1 -- 172.21.15.17:0/2083889943 shutdown_connections 2024-09-13T16:00:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.628+0000 7fdfc2c60740 1 --2- 172.21.15.17:0/2083889943 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55946f42f5c0 0x55946f4319e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.628+0000 7fdfc2c60740 1 --2- 172.21.15.17:0/2083889943 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946f41f440 0x55946f42ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.628+0000 7fdfc2c60740 1 --2- 172.21.15.17:0/2083889943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f423ca0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.628+0000 7fdfc2c60740 1 --2- 172.21.15.17:0/2083889943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55946f419a70 0x55946f423760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.628+0000 7fdfc2c60740 1 -- 172.21.15.17:0/2083889943 >> 172.21.15.17:0/2083889943 conn(0x55946f4150e0 msgr2=0x55946f4168f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.628+0000 7fdf9f400640 0 client.25565 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:00:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.628+0000 7fdfc2c60740 1 -- 172.21.15.17:0/2083889943 shutdown_connections 2024-09-13T16:00:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.629+0000 7fdfc2c60740 1 -- 172.21.15.17:0/2083889943 wait complete. 2024-09-13T16:00:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.629+0000 7fdfc2c60740 20 client.25565 trim_cache size 0 max 16384 2024-09-13T16:00:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.658+0000 7fdfc2c60740 1 Processor -- start 2024-09-13T16:00:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.659+0000 7fdfc2c60740 1 -- start start 2024-09-13T16:00:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.659+0000 7fdfc2c60740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55946f419a70 0x55946f41e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.660+0000 7fdfc2c60740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f41ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.660+0000 7fdfc2c60740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946f41f440 0x55946f42aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.660+0000 7fdfc2c60740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55946f0e3e60 con 0x55946f419a70 2024-09-13T16:00:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.660+0000 7fdfc2c60740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55946f41ae10 con 0x55946f41a3b0 2024-09-13T16:00:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.660+0000 7fdfc2c60740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55946f4245f0 con 0x55946f41f440 2024-09-13T16:00:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.660+0000 7fdfbd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55946f419a70 0x55946f41e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.660+0000 7fdfbca00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f41ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.660+0000 7fdfbde00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946f41f440 0x55946f42aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.660+0000 7fdfbca00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f41ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:45334/0 (socket says 172.21.15.17:45334) 2024-09-13T16:00:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.660+0000 7fdfbca00640 1 -- 172.21.15.17:0/2718440494 learned_addr learned my addr 172.21.15.17:0/2718440494 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.661+0000 7fdfbca00640 1 -- 172.21.15.17:0/2718440494 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946f41f440 msgr2=0x55946f42aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.661+0000 7fdfbca00640 1 --2- 172.21.15.17:0/2718440494 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946f41f440 0x55946f42aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.661+0000 7fdfbca00640 1 -- 172.21.15.17:0/2718440494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55946f419a70 msgr2=0x55946f41e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.661+0000 7fdfbca00640 1 --2- 172.21.15.17:0/2718440494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55946f419a70 0x55946f41e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.661+0000 7fdfbca00640 1 -- 172.21.15.17:0/2718440494 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55946f31d180 con 0x55946f41a3b0 2024-09-13T16:00:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.662+0000 7fdfbca00640 1 --2- 172.21.15.17:0/2718440494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f41ee00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdfa40138d0 tx=0x7fdfa4005cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=994e029fbbe70b0c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.662+0000 7fdfab400640 1 -- 172.21.15.17:0/2718440494 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa401ed90 con 0x55946f41a3b0 2024-09-13T16:00:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.663+0000 7fdfab400640 1 -- 172.21.15.17:0/2718440494 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdfa4011500 con 0x55946f41a3b0 2024-09-13T16:00:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.663+0000 7fdfab400640 1 -- 172.21.15.17:0/2718440494 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4005290 con 0x55946f41a3b0 2024-09-13T16:00:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.665+0000 7fdfc2c60740 1 -- 172.21.15.17:0/2718440494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 msgr2=0x55946f41ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.665+0000 7fdfc2c60740 1 --2- 172.21.15.17:0/2718440494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f41ee00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdfa40138d0 tx=0x7fdfa4005cb0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.665+0000 7fdfc2c60740 1 -- 172.21.15.17:0/2718440494 shutdown_connections 2024-09-13T16:00:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.665+0000 7fdfc2c60740 1 --2- 172.21.15.17:0/2718440494 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946f41f440 0x55946f42aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.665+0000 7fdfc2c60740 1 --2- 172.21.15.17:0/2718440494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f41ee00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.665+0000 7fdfc2c60740 1 --2- 172.21.15.17:0/2718440494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55946f419a70 0x55946f41e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.665+0000 7fdfc2c60740 1 -- 172.21.15.17:0/2718440494 >> 172.21.15.17:0/2718440494 conn(0x55946f4150e0 msgr2=0x55946f436360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.666+0000 7fdfc2c60740 1 -- 172.21.15.17:0/2718440494 shutdown_connections 2024-09-13T16:00:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.666+0000 7fdfc2c60740 1 -- 172.21.15.17:0/2718440494 wait complete. 2024-09-13T16:00:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.666+0000 7fdfc2c60740 1 -- start start 2024-09-13T16:00:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.667+0000 7fdfc2c60740 1 Processor -- start 2024-09-13T16:00:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.668+0000 7fdfc2c60740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946f419a70 0x55946f42a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.668+0000 7fdfc2c60740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f427310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.668+0000 7fdfc2c60740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55946f41f440 0x55946f427850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.668+0000 7fdfc2c60740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55946f427f50 con 0x55946f41f440 2024-09-13T16:00:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.668+0000 7fdfc2c60740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55946f42aed0 con 0x55946f41a3b0 2024-09-13T16:00:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.668+0000 7fdfc2c60740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55946f42b090 con 0x55946f419a70 2024-09-13T16:00:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.668+0000 7fdfc2c60740 10 client.0 _ll_register_callbacks cb 0x7fdfac009670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:00:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.669+0000 7fdfbd400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946f419a70 0x55946f42a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.669+0000 7fdfbd400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946f419a70 0x55946f42a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:59270/0 (socket says 172.21.15.17:59270) 2024-09-13T16:00:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.669+0000 7fdfbd400640 1 -- 172.21.15.17:0/2153529807 learned_addr learned my addr 172.21.15.17:0/2153529807 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.669+0000 7fdfbca00640 1 --2- 172.21.15.17:0/2153529807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f427310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.669+0000 7fdfbde00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55946f41f440 0x55946f427850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.670+0000 7fdfbca00640 1 -- 172.21.15.17:0/2153529807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946f419a70 msgr2=0x55946f42a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.670+0000 7fdfbca00640 1 --2- 172.21.15.17:0/2153529807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946f419a70 0x55946f42a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.670+0000 7fdfbca00640 1 -- 172.21.15.17:0/2153529807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55946f41f440 msgr2=0x55946f427850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.670+0000 7fdfbca00640 1 --2- 172.21.15.17:0/2153529807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55946f41f440 0x55946f427850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.670+0000 7fdfbca00640 1 -- 172.21.15.17:0/2153529807 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55946f37b170 con 0x55946f41a3b0 2024-09-13T16:00:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.671+0000 7fdfbca00640 1 --2- 172.21.15.17:0/2153529807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f427310 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55946f42bfc0 tx=0x7fdfa400e980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=150a50bbdc4be194 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.671+0000 7fdf9f400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:00:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.672+0000 7fdf9f400640 1 -- 172.21.15.17:0/2153529807 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa400ee00 con 0x55946f41a3b0 2024-09-13T16:00:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.672+0000 7fdf9f400640 1 -- 172.21.15.17:0/2153529807 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fdfa4005070 con 0x55946f41a3b0 2024-09-13T16:00:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.672+0000 7fdfc2c60740 1 -- 172.21.15.17:0/2153529807 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdfac0054e0 con 0x55946f41a3b0 2024-09-13T16:00:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.672+0000 7fdf9f400640 1 -- 172.21.15.17:0/2153529807 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfa4005270 con 0x55946f41a3b0 2024-09-13T16:00:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.672+0000 7fdfc2c60740 10 client.25571 fetch_fsmap learned FSMap version 30 2024-09-13T16:00:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.672+0000 7fdfc2c60740 1 -- 172.21.15.17:0/2153529807 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55946f342560 con 0x55946f41a3b0 2024-09-13T16:00:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.673+0000 7fdf9f400640 1 -- 172.21.15.17:0/2153529807 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdfa4042080 con 0x55946f41a3b0 2024-09-13T16:00:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.673+0000 7fdf9f400640 1 -- 172.21.15.17:0/2153529807 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) v1 ==== 7490+0+0 (secure 0 0 0) 0x7fdfa402d040 con 0x55946f41a3b0 2024-09-13T16:00:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.673+0000 7fdfc2c60740 10 client.25571 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T16:00:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.673+0000 7fdfc2c60740 10 client.25571 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:00:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.673+0000 7fdfc2c60740 20 client.25571 populate_metadata read hostname 'smithi017' 2024-09-13T16:00:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.673+0000 7fdfc2c60740 1 --2- 172.21.15.17:0/2153529807 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55946f497fd0 0x55946f49a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.673+0000 7fdfc2c60740 4 client.25571 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:00:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.673+0000 7fdfc2c60740 1 -- 172.21.15.17:0/2153529807 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55946f070300 con 0x55946f497fd0 2024-09-13T16:00:18.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.673+0000 7fdfbd400640 1 --2- 172.21.15.17:0/2153529807 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55946f497fd0 0x55946f49a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:18.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.674+0000 7fdfbd400640 1 --2- 172.21.15.17:0/2153529807 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55946f497fd0 0x55946f49a3f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94ae1af012214c5 server_cookie=cbe3c80fff3b6641 in_seq=0 out_seq=0 2024-09-13T16:00:18.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.674+0000 7fdf9f400640 10 client.25571 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:00:18.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.709+0000 7fdf9f400640 1 -- 172.21.15.17:0/2153529807 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55946f070300 con 0x55946f497fd0 2024-09-13T16:00:18.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.710+0000 7fdf9f400640 10 client.25571 handle_command_reply: tid=0 2024-09-13T16:00:18.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.710+0000 7fdfc2c60740 1 client.25571 shutdown 2024-09-13T16:00:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.711+0000 7fdfc2c60740 1 -- 172.21.15.17:0/2153529807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 msgr2=0x55946f427310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.711+0000 7fdfc2c60740 1 --2- 172.21.15.17:0/2153529807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f427310 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55946f42bfc0 tx=0x7fdfa400e980 comp rx=0 tx=0).stop 2024-09-13T16:00:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.711+0000 7fdfc2c60740 1 -- 172.21.15.17:0/2153529807 shutdown_connections 2024-09-13T16:00:18.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.711+0000 7fdfc2c60740 1 --2- 172.21.15.17:0/2153529807 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55946f497fd0 0x55946f49a3f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.711+0000 7fdfc2c60740 1 --2- 172.21.15.17:0/2153529807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55946f41f440 0x55946f427850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.711+0000 7fdfc2c60740 1 --2- 172.21.15.17:0/2153529807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55946f41a3b0 0x55946f427310 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.711+0000 7fdf9f400640 0 client.25571 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:00:18.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.711+0000 7fdfc2c60740 1 --2- 172.21.15.17:0/2153529807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55946f419a70 0x55946f42a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.711+0000 7fdfc2c60740 1 -- 172.21.15.17:0/2153529807 >> 172.21.15.17:0/2153529807 conn(0x55946f4150e0 msgr2=0x55946f41b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:18.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.712+0000 7fdfc2c60740 1 -- 172.21.15.17:0/2153529807 shutdown_connections 2024-09-13T16:00:18.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.712+0000 7fdfc2c60740 1 -- 172.21.15.17:0/2153529807 wait complete. 2024-09-13T16:00:18.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.713+0000 7fdfc2c60740 20 client.25571 trim_cache size 0 max 16384 2024-09-13T16:00:18.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:00:18.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:00:18.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:00:18.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:00:18.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.714+0000 7fdfbfe00640 1 -- 172.21.15.17:0/501339068 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdfa00a1160 msgr2=0x7fdfa00a3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:18.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.714+0000 7fdfbfe00640 1 --2- 172.21.15.17:0/501339068 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdfa00a1160 0x7fdfa00a3620 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdfb819d810 tx=0x7fdfa4005f90 comp rx=0 tx=0).stop 2024-09-13T16:00:18.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.714+0000 7fdfbfe00640 1 -- 172.21.15.17:0/501339068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdfb8076a50 msgr2=0x7fdfb81a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:18.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.714+0000 7fdfbfe00640 1 --2- 172.21.15.17:0/501339068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdfb8076a50 0x7fdfb81a38b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0009bf0 tx=0x7fdfb0032f20 comp rx=0 tx=0).stop 2024-09-13T16:00:18.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.714+0000 7fdfbfe00640 1 -- 172.21.15.17:0/501339068 shutdown_connections 2024-09-13T16:00:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.714+0000 7fdfbfe00640 1 --2- 172.21.15.17:0/501339068 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdfa00a1160 0x7fdfa00a3620 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.714+0000 7fdfbfe00640 1 --2- 172.21.15.17:0/501339068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdfb8076a50 0x7fdfb81a38b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.714+0000 7fdfbfe00640 1 --2- 172.21.15.17:0/501339068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdfb80760b0 0x7fdfb819c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.714+0000 7fdfbfe00640 1 --2- 172.21.15.17:0/501339068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb8074e70 0x7fdfb819c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.714+0000 7fdfbfe00640 1 -- 172.21.15.17:0/501339068 >> 172.21.15.17:0/501339068 conn(0x7fdfb80fd680 msgr2=0x7fdfb80fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.716+0000 7fdfbfe00640 1 -- 172.21.15.17:0/501339068 shutdown_connections 2024-09-13T16:00:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:18.716+0000 7fdfbfe00640 1 -- 172.21.15.17:0/501339068 wait complete. 2024-09-13T16:00:18.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:18 smithi193 ceph-mon[35248]: pgmap v462: 129 pgs: 129 active+clean; 1.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.7 MiB/s wr, 737 op/s 2024-09-13T16:00:18.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:18 smithi017 ceph-mon[30494]: pgmap v462: 129 pgs: 129 active+clean; 1.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.7 MiB/s wr, 737 op/s 2024-09-13T16:00:20.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 155.0 s, 1642.8 tps, lat 61.583 ms stddev 72.971 2024-09-13T16:00:20.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:20 smithi193 ceph-mon[35248]: pgmap v463: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.0 MiB/s wr, 788 op/s 2024-09-13T16:00:20.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:20 smithi017 ceph-mon[30494]: pgmap v463: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.0 MiB/s wr, 788 op/s 2024-09-13T16:00:20.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:20 smithi189 ceph-mon[34790]: pgmap v463: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.0 MiB/s wr, 788 op/s 2024-09-13T16:00:22.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:22 smithi189 ceph-mon[34790]: pgmap v464: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 MiB/s wr, 656 op/s 2024-09-13T16:00:22.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:22 smithi193 ceph-mon[35248]: pgmap v464: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 MiB/s wr, 656 op/s 2024-09-13T16:00:22.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:22 smithi017 ceph-mon[30494]: pgmap v464: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 MiB/s wr, 656 op/s 2024-09-13T16:00:24.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:24 smithi189 ceph-mon[34790]: pgmap v465: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.7 MiB/s wr, 598 op/s 2024-09-13T16:00:24.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:24 smithi193 ceph-mon[35248]: pgmap v465: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.7 MiB/s wr, 598 op/s 2024-09-13T16:00:24.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:24 smithi017 ceph-mon[30494]: pgmap v465: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.7 MiB/s wr, 598 op/s 2024-09-13T16:00:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 160.0 s, 1788.2 tps, lat 55.097 ms stddev 65.232 2024-09-13T16:00:26.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:26 smithi189 ceph-mon[34790]: pgmap v466: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.9 MiB/s wr, 610 op/s 2024-09-13T16:00:26.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:26 smithi193 ceph-mon[35248]: pgmap v466: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.9 MiB/s wr, 610 op/s 2024-09-13T16:00:26.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:26 smithi017 ceph-mon[30494]: pgmap v466: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.9 MiB/s wr, 610 op/s 2024-09-13T16:00:28.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:28 smithi189 ceph-mon[34790]: pgmap v467: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 7.1 MiB/s wr, 608 op/s 2024-09-13T16:00:28.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:28 smithi193 ceph-mon[35248]: pgmap v467: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 7.1 MiB/s wr, 608 op/s 2024-09-13T16:00:28.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:28 smithi017 ceph-mon[30494]: pgmap v467: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 7.1 MiB/s wr, 608 op/s 2024-09-13T16:00:30.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 165.0 s, 1296.6 tps, lat 77.380 ms stddev 97.772 2024-09-13T16:00:30.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:30 smithi189 ceph-mon[34790]: pgmap v468: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.9 MiB/s wr, 692 op/s 2024-09-13T16:00:30.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:30 smithi193 ceph-mon[35248]: pgmap v468: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.9 MiB/s wr, 692 op/s 2024-09-13T16:00:30.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:30 smithi017 ceph-mon[30494]: pgmap v468: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.9 MiB/s wr, 692 op/s 2024-09-13T16:00:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.916+0000 7f86c8200640 1 -- 172.21.15.17:0/2680460787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c00744f0 msgr2=0x7f86c0072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:31.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.916+0000 7f86c8200640 1 --2- 172.21.15.17:0/2680460787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c00744f0 0x7f86c0072940 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f86b4009900 tx=0x7f86b402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:00:31.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.916+0000 7f86c8200640 1 -- 172.21.15.17:0/2680460787 shutdown_connections 2024-09-13T16:00:31.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.916+0000 7f86c8200640 1 --2- 172.21.15.17:0/2680460787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86c010c2f0 0x7f86c010e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:31.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.916+0000 7f86c8200640 1 --2- 172.21.15.17:0/2680460787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86c0072f10 0x7f86c0073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:31.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.916+0000 7f86c8200640 1 --2- 172.21.15.17:0/2680460787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c00744f0 0x7f86c0072940 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:31.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.916+0000 7f86c8200640 1 -- 172.21.15.17:0/2680460787 >> 172.21.15.17:0/2680460787 conn(0x7f86c00fb4a0 msgr2=0x7f86c00fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.916+0000 7f86c8200640 1 -- 172.21.15.17:0/2680460787 shutdown_connections 2024-09-13T16:00:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.917+0000 7f86c8200640 1 -- 172.21.15.17:0/2680460787 wait complete. 2024-09-13T16:00:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.918+0000 7f86c8200640 1 Processor -- start 2024-09-13T16:00:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.918+0000 7f86c8200640 1 -- start start 2024-09-13T16:00:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.919+0000 7f86c8200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86c0072f10 0x7f86c019c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.919+0000 7f86c8200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c00744f0 0x7f86c019c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.919+0000 7f86c8200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86c010c2f0 0x7f86c01a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.920+0000 7f86c5800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86c0072f10 0x7f86c019c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.920+0000 7f86c4e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c00744f0 0x7f86c019c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.920+0000 7f86c4e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c00744f0 0x7f86c019c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44096/0 (socket says 172.21.15.17:44096) 2024-09-13T16:00:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.920+0000 7f86c4e00640 1 -- 172.21.15.17:0/2750129382 learned_addr learned my addr 172.21.15.17:0/2750129382 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.920+0000 7f86c8200640 1 -- 172.21.15.17:0/2750129382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c01a3e30 con 0x7f86c00744f0 2024-09-13T16:00:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.920+0000 7f86c8200640 1 -- 172.21.15.17:0/2750129382 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c01a3fa0 con 0x7f86c010c2f0 2024-09-13T16:00:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.920+0000 7f86c8200640 1 -- 172.21.15.17:0/2750129382 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c01a4160 con 0x7f86c0072f10 2024-09-13T16:00:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.920+0000 7f86c6200640 1 --2- 172.21.15.17:0/2750129382 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86c010c2f0 0x7f86c01a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.920+0000 7f86c4e00640 1 -- 172.21.15.17:0/2750129382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86c0072f10 msgr2=0x7f86c019c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.920+0000 7f86c4e00640 1 --2- 172.21.15.17:0/2750129382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86c0072f10 0x7f86c019c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.920+0000 7f86c4e00640 1 -- 172.21.15.17:0/2750129382 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86c010c2f0 msgr2=0x7f86c01a38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.920+0000 7f86c4e00640 1 --2- 172.21.15.17:0/2750129382 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86c010c2f0 0x7f86c01a38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.920+0000 7f86c4e00640 1 -- 172.21.15.17:0/2750129382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac009490 con 0x7f86c00744f0 2024-09-13T16:00:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.921+0000 7f86c4e00640 1 --2- 172.21.15.17:0/2750129382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c00744f0 0x7f86c019c880 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00ea60 tx=0x7f86ac00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:31.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.922+0000 7f86be000640 1 -- 172.21.15.17:0/2750129382 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac00cd20 con 0x7f86c00744f0 2024-09-13T16:00:31.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.922+0000 7f86c8200640 1 -- 172.21.15.17:0/2750129382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b8009840 con 0x7f86c00744f0 2024-09-13T16:00:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.922+0000 7f86c8200640 1 -- 172.21.15.17:0/2750129382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b4009560 con 0x7f86c00744f0 2024-09-13T16:00:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.922+0000 7f86be000640 1 -- 172.21.15.17:0/2750129382 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86ac00ce80 con 0x7f86c00744f0 2024-09-13T16:00:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.922+0000 7f86be000640 1 -- 172.21.15.17:0/2750129382 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac00cd20 con 0x7f86c00744f0 2024-09-13T16:00:31.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.927+0000 7f86cafc0740 1 Processor -- start 2024-09-13T16:00:31.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.927+0000 7f86cafc0740 1 -- start start 2024-09-13T16:00:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.929+0000 7f86cafc0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2aa70 0x555c34b2ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.929+0000 7f86cafc0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c34b2b3b0 0x555c34b2fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:31.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.929+0000 7f86cafc0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c34b30440 0x555c34b32900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:31.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.929+0000 7f86cafc0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c34a36bb0 con 0x555c34b30440 2024-09-13T16:00:31.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.929+0000 7f86cafc0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c34a94a70 con 0x555c34b2aa70 2024-09-13T16:00:31.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.929+0000 7f86cafc0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c34a92200 con 0x555c34b2b3b0 2024-09-13T16:00:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.931+0000 7f86c6200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2aa70 0x555c34b2ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:31.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.931+0000 7f86c6200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2aa70 0x555c34b2ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:50822/0 (socket says 172.21.15.17:50822) 2024-09-13T16:00:31.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.931+0000 7f86c6200640 1 -- 172.21.15.17:0/3089955298 learned_addr learned my addr 172.21.15.17:0/3089955298 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:31.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.931+0000 7f86c5800640 1 --2- 172.21.15.17:0/3089955298 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c34b2b3b0 0x555c34b2fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:31.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.932+0000 7f86c6200640 1 -- 172.21.15.17:0/3089955298 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c34b2b3b0 msgr2=0x555c34b2fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:31.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.932+0000 7f86be000640 1 -- 172.21.15.17:0/2750129382 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f86ac0035f0 con 0x7f86c00744f0 2024-09-13T16:00:31.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.932+0000 7f86c6200640 1 --2- 172.21.15.17:0/3089955298 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c34b2b3b0 0x555c34b2fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:31.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.932+0000 7f86c6200640 1 -- 172.21.15.17:0/3089955298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c34b30440 msgr2=0x555c34b32900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:00:31.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.932+0000 7f86c6200640 1 --2- 172.21.15.17:0/3089955298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c34b30440 0x555c34b32900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:31.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.932+0000 7f86c6200640 1 -- 172.21.15.17:0/3089955298 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c34a2f940 con 0x555c34b2aa70 2024-09-13T16:00:31.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.932+0000 7f86c6200640 1 --2- 172.21.15.17:0/3089955298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2aa70 0x555c34b2ae70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f86b80115b0 tx=0x7f86b8011a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a29168dd66bee01 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:31.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.933+0000 7f86b2a00640 1 -- 172.21.15.17:0/3089955298 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8004d20 con 0x555c34b2aa70 2024-09-13T16:00:31.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.933+0000 7f86b2a00640 1 -- 172.21.15.17:0/3089955298 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86b8004e80 con 0x555c34b2aa70 2024-09-13T16:00:31.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.933+0000 7f86b2a00640 1 -- 172.21.15.17:0/3089955298 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b800f8c0 con 0x555c34b2aa70 2024-09-13T16:00:31.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.933+0000 7f86be000640 1 --2- 172.21.15.17:0/2750129382 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f86a80a11a0 0x7f86a80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:31.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.934+0000 7f86be000640 1 -- 172.21.15.17:0/2750129382 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f86ac014070 con 0x7f86c00744f0 2024-09-13T16:00:31.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.934+0000 7f86cafc0740 1 -- 172.21.15.17:0/3089955298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2aa70 msgr2=0x555c34b2ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:31.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.934+0000 7f86cafc0740 1 --2- 172.21.15.17:0/3089955298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2aa70 0x555c34b2ae70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f86b80115b0 tx=0x7f86b8011a70 comp rx=0 tx=0).stop 2024-09-13T16:00:31.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.935+0000 7f86cafc0740 1 -- 172.21.15.17:0/3089955298 shutdown_connections 2024-09-13T16:00:31.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.935+0000 7f86cafc0740 1 --2- 172.21.15.17:0/3089955298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c34b30440 0x555c34b32900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:31.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.935+0000 7f86cafc0740 1 --2- 172.21.15.17:0/3089955298 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c34b2b3b0 0x555c34b2fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:31.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.935+0000 7f86cafc0740 1 --2- 172.21.15.17:0/3089955298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2aa70 0x555c34b2ae70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:31.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.935+0000 7f86cafc0740 1 -- 172.21.15.17:0/3089955298 >> 172.21.15.17:0/3089955298 conn(0x555c34b260e0 msgr2=0x555c34b264e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:31.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.935+0000 7f86c5800640 1 --2- 172.21.15.17:0/2750129382 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f86a80a11a0 0x7f86a80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:31.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.936+0000 7f86cafc0740 1 -- 172.21.15.17:0/3089955298 shutdown_connections 2024-09-13T16:00:31.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.937+0000 7f86c5800640 1 --2- 172.21.15.17:0/2750129382 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f86a80a11a0 0x7f86a80a3660 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f86b4000c00 tx=0x7f86b4005760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:31.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.937+0000 7f86cafc0740 1 -- 172.21.15.17:0/3089955298 wait complete. 2024-09-13T16:00:31.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.937+0000 7f86cafc0740 1 -- start start 2024-09-13T16:00:31.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.938+0000 7f86cafc0740 1 Processor -- start 2024-09-13T16:00:31.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.938+0000 7f86cafc0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2aa70 0x555c34b34800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:31.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.939+0000 7f86cafc0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c34b2b3b0 0x555c34b34d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:31.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.939+0000 7f86cafc0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c34b30440 0x555c34b3bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:31.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.939+0000 7f86cafc0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c34a8daf0 con 0x555c34b2b3b0 2024-09-13T16:00:31.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.939+0000 7f86cafc0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c34a4bf20 con 0x555c34b2aa70 2024-09-13T16:00:31.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.939+0000 7f86cafc0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c34a4bbc0 con 0x555c34b30440 2024-09-13T16:00:31.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.939+0000 7f86cafc0740 10 client.0 _ll_register_callbacks cb 0x555c34a7da70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:00:31.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.940+0000 7f86c5800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2aa70 0x555c34b34800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:31.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.940+0000 7f86c5800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2aa70 0x555c34b34800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:50826/0 (socket says 172.21.15.17:50826) 2024-09-13T16:00:31.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.940+0000 7f86c5800640 1 -- 172.21.15.17:0/385387595 learned_addr learned my addr 172.21.15.17:0/385387595 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:31.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.940+0000 7f86c6200640 1 --2- 172.21.15.17:0/385387595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c34b30440 0x555c34b3bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:31.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.941+0000 7f86c5800640 1 -- 172.21.15.17:0/385387595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c34b30440 msgr2=0x555c34b3bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:31.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.941+0000 7f86c5800640 1 --2- 172.21.15.17:0/385387595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c34b30440 0x555c34b3bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:31.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.941+0000 7f86c5800640 1 -- 172.21.15.17:0/385387595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c34b2b3b0 msgr2=0x555c34b34d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:31.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.941+0000 7f86c5800640 1 --2- 172.21.15.17:0/385387595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c34b2b3b0 0x555c34b34d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:31.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.941+0000 7f86c5800640 1 -- 172.21.15.17:0/385387595 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b8009e20 con 0x555c34b2aa70 2024-09-13T16:00:31.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.941+0000 7f86c5800640 1 --2- 172.21.15.17:0/385387595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2aa70 0x555c34b34800 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f86b4033000 tx=0x7f86b4009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2ce70ce3369c054 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:31.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.941+0000 7f86a7400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:00:31.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.941+0000 7f86a7400640 1 -- 172.21.15.17:0/385387595 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b40319b0 con 0x555c34b2aa70 2024-09-13T16:00:31.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.942+0000 7f86a7400640 1 -- 172.21.15.17:0/385387595 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f86b4031b10 con 0x555c34b2aa70 2024-09-13T16:00:31.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.942+0000 7f86cafc0740 1 -- 172.21.15.17:0/385387595 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555c34a807d0 con 0x555c34b2aa70 2024-09-13T16:00:31.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.942+0000 7f86a7400640 1 -- 172.21.15.17:0/385387595 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86b4031cd0 con 0x555c34b2aa70 2024-09-13T16:00:31.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.942+0000 7f86cafc0740 10 client.25583 fetch_fsmap learned FSMap version 30 2024-09-13T16:00:31.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.942+0000 7f86cafc0740 1 -- 172.21.15.17:0/385387595 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x555c34a8c170 con 0x555c34b2aa70 2024-09-13T16:00:31.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.943+0000 7f86a7400640 1 -- 172.21.15.17:0/385387595 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555c34a807d0 con 0x555c34b2aa70 2024-09-13T16:00:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.943+0000 7f86a7400640 1 -- 172.21.15.17:0/385387595 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) v1 ==== 7490+0+0 (secure 0 0 0) 0x7f86b403c440 con 0x555c34b2aa70 2024-09-13T16:00:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.943+0000 7f86cafc0740 10 client.25583 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T16:00:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.943+0000 7f86cafc0740 10 client.25583 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:00:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.943+0000 7f86cafc0740 20 client.25583 populate_metadata read hostname 'smithi017' 2024-09-13T16:00:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.943+0000 7f86cafc0740 1 --2- 172.21.15.17:0/385387595 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555c34b405f0 0x555c34b42a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.943+0000 7f86cafc0740 4 client.25583 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:00:31.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.943+0000 7f86cafc0740 1 -- 172.21.15.17:0/385387595 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555c34781300 con 0x555c34b405f0 2024-09-13T16:00:31.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.944+0000 7f86c4e00640 1 --2- 172.21.15.17:0/385387595 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555c34b405f0 0x555c34b42a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:31.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.944+0000 7f86a7400640 10 client.25583 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:00:31.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.944+0000 7f86c4e00640 1 --2- 172.21.15.17:0/385387595 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555c34b405f0 0x555c34b42a10 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cb40f5a4fe914f0 server_cookie=d12cff80fdc44557 in_seq=0 out_seq=0 2024-09-13T16:00:31.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.945+0000 7f86a7400640 1 -- 172.21.15.17:0/385387595 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555c34781300 con 0x555c34b405f0 2024-09-13T16:00:31.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.945+0000 7f86a7400640 10 client.25583 handle_command_reply: tid=0 2024-09-13T16:00:31.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.946+0000 7f86cafc0740 1 client.25583 shutdown 2024-09-13T16:00:31.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.946+0000 7f86cafc0740 1 -- 172.21.15.17:0/385387595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2aa70 msgr2=0x555c34b34800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:31.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.946+0000 7f86cafc0740 1 --2- 172.21.15.17:0/385387595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2aa70 0x555c34b34800 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f86b4033000 tx=0x7f86b4009260 comp rx=0 tx=0).stop 2024-09-13T16:00:31.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.946+0000 7f86cafc0740 1 -- 172.21.15.17:0/385387595 shutdown_connections 2024-09-13T16:00:31.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.946+0000 7f86cafc0740 1 --2- 172.21.15.17:0/385387595 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555c34b405f0 0x555c34b42a10 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:31.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.946+0000 7f86cafc0740 1 --2- 172.21.15.17:0/385387595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c34b30440 0x555c34b3bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:31.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.946+0000 7f86cafc0740 1 --2- 172.21.15.17:0/385387595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c34b2b3b0 0x555c34b34d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:31.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.946+0000 7f86a7400640 0 client.25583 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:00:31.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.946+0000 7f86cafc0740 1 --2- 172.21.15.17:0/385387595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2aa70 0x555c34b34800 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:31.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.946+0000 7f86cafc0740 1 -- 172.21.15.17:0/385387595 >> 172.21.15.17:0/385387595 conn(0x555c34b260e0 msgr2=0x555c34b278f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:31.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.947+0000 7f86cafc0740 1 -- 172.21.15.17:0/385387595 shutdown_connections 2024-09-13T16:00:31.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.947+0000 7f86cafc0740 1 -- 172.21.15.17:0/385387595 wait complete. 2024-09-13T16:00:31.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.947+0000 7f86cafc0740 20 client.25583 trim_cache size 0 max 16384 2024-09-13T16:00:31.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.993+0000 7f86cafc0740 1 Processor -- start 2024-09-13T16:00:31.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.993+0000 7f86cafc0740 1 -- start start 2024-09-13T16:00:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.993+0000 7f86cafc0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2aa70 0x555c34b34cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.993+0000 7f86cafc0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c34b2b3b0 0x555c34b3bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.993+0000 7f86cafc0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c34b30440 0x555c34b264c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.993+0000 7f86cafc0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c347f4e60 con 0x555c34b30440 2024-09-13T16:00:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.993+0000 7f86cafc0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c34b35760 con 0x555c34b2aa70 2024-09-13T16:00:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.993+0000 7f86cafc0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c34b20770 con 0x555c34b2b3b0 2024-09-13T16:00:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.994+0000 7f86c4e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c34b2b3b0 0x555c34b3bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.994+0000 7f86c4e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c34b2b3b0 0x555c34b3bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:58426/0 (socket says 172.21.15.17:58426) 2024-09-13T16:00:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.994+0000 7f86c4e00640 1 -- 172.21.15.17:0/1193709168 learned_addr learned my addr 172.21.15.17:0/1193709168 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.994+0000 7f86c6200640 1 --2- 172.21.15.17:0/1193709168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c34b30440 0x555c34b264c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.994+0000 7f86c5800640 1 --2- 172.21.15.17:0/1193709168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2aa70 0x555c34b34cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.995+0000 7f86c6200640 1 -- 172.21.15.17:0/1193709168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c34b2b3b0 msgr2=0x555c34b3bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.995+0000 7f86c6200640 1 --2- 172.21.15.17:0/1193709168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c34b2b3b0 0x555c34b3bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.995+0000 7f86c6200640 1 -- 172.21.15.17:0/1193709168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2aa70 msgr2=0x555c34b34cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.995+0000 7f86c6200640 1 --2- 172.21.15.17:0/1193709168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2aa70 0x555c34b34cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.995+0000 7f86c6200640 1 -- 172.21.15.17:0/1193709168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c34a2e180 con 0x555c34b30440 2024-09-13T16:00:32.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.999+0000 7f86c6200640 1 --2- 172.21.15.17:0/1193709168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c34b30440 0x555c34b264c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f86b8000f80 tx=0x7f86b8004050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f24430e8ecc70ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:32.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.999+0000 7f86b3400640 1 -- 172.21.15.17:0/1193709168 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8003c30 con 0x555c34b30440 2024-09-13T16:00:32.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.999+0000 7f86b3400640 1 -- 172.21.15.17:0/1193709168 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86b8003d90 con 0x555c34b30440 2024-09-13T16:00:32.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:31.999+0000 7f86b3400640 1 -- 172.21.15.17:0/1193709168 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b80047c0 con 0x555c34b30440 2024-09-13T16:00:32.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.000+0000 7f86cafc0740 1 -- 172.21.15.17:0/1193709168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c34b30440 msgr2=0x555c34b264c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:32.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.000+0000 7f86cafc0740 1 --2- 172.21.15.17:0/1193709168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c34b30440 0x555c34b264c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f86b8000f80 tx=0x7f86b8004050 comp rx=0 tx=0).stop 2024-09-13T16:00:32.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.001+0000 7f86cafc0740 1 -- 172.21.15.17:0/1193709168 shutdown_connections 2024-09-13T16:00:32.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.001+0000 7f86cafc0740 1 --2- 172.21.15.17:0/1193709168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c34b30440 0x555c34b264c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:32.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.001+0000 7f86cafc0740 1 --2- 172.21.15.17:0/1193709168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c34b2b3b0 0x555c34b3bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:32.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.001+0000 7f86cafc0740 1 --2- 172.21.15.17:0/1193709168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2aa70 0x555c34b34cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:32.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.001+0000 7f86cafc0740 1 -- 172.21.15.17:0/1193709168 >> 172.21.15.17:0/1193709168 conn(0x555c34b260e0 msgr2=0x555c34b345b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:32.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.001+0000 7f86cafc0740 1 -- 172.21.15.17:0/1193709168 shutdown_connections 2024-09-13T16:00:32.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.001+0000 7f86cafc0740 1 -- 172.21.15.17:0/1193709168 wait complete. 2024-09-13T16:00:32.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.001+0000 7f86cafc0740 1 -- start start 2024-09-13T16:00:32.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.002+0000 7f86cafc0740 1 Processor -- start 2024-09-13T16:00:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.003+0000 7f86cafc0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c34b2aa70 0x555c34b38ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.003+0000 7f86cafc0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2b3b0 0x555c34b393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.003+0000 7f86cafc0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c34b30440 0x555c34b3a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.003+0000 7f86cafc0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c34b3a930 con 0x555c34b30440 2024-09-13T16:00:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.003+0000 7f86cafc0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c34b3aaa0 con 0x555c34b2b3b0 2024-09-13T16:00:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.003+0000 7f86cafc0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c34b3ac60 con 0x555c34b2aa70 2024-09-13T16:00:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.003+0000 7f86cafc0740 10 client.0 _ll_register_callbacks cb 0x7f86b8009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:00:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.004+0000 7f86c4e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2b3b0 0x555c34b393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.005+0000 7f86c4e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2b3b0 0x555c34b393e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:50832/0 (socket says 172.21.15.17:50832) 2024-09-13T16:00:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.005+0000 7f86c4e00640 1 -- 172.21.15.17:0/4161290365 learned_addr learned my addr 172.21.15.17:0/4161290365 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.005+0000 7f86c5800640 1 --2- 172.21.15.17:0/4161290365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c34b2aa70 0x555c34b38ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.006+0000 7f86c5800640 1 -- 172.21.15.17:0/4161290365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2b3b0 msgr2=0x555c34b393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.006+0000 7f86c5800640 1 --2- 172.21.15.17:0/4161290365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2b3b0 0x555c34b393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:32.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.006+0000 7f86c5800640 1 -- 172.21.15.17:0/4161290365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c34b30440 msgr2=0x555c34b3a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:32.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.006+0000 7f86c5800640 1 --2- 172.21.15.17:0/4161290365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c34b30440 0x555c34b3a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:32.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.006+0000 7f86c5800640 1 -- 172.21.15.17:0/4161290365 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c34a2f940 con 0x555c34b2aa70 2024-09-13T16:00:32.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.006+0000 7f86c4e00640 1 --2- 172.21.15.17:0/4161290365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2b3b0 0x555c34b393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:00:32.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.007+0000 7f86c5800640 1 --2- 172.21.15.17:0/4161290365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c34b2aa70 0x555c34b38ea0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f86b4041040 tx=0x7f86b40097f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ef56c2f894f3de1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:32.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.007+0000 7f86a7400640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:00:32.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.007+0000 7f86a7400640 1 -- 172.21.15.17:0/4161290365 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b402aa70 con 0x555c34b2aa70 2024-09-13T16:00:32.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.008+0000 7f86a7400640 1 -- 172.21.15.17:0/4161290365 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f86b403cac0 con 0x555c34b2aa70 2024-09-13T16:00:32.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.008+0000 7f86cafc0740 1 -- 172.21.15.17:0/4161290365 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555c34ab7c90 con 0x555c34b2aa70 2024-09-13T16:00:32.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.008+0000 7f86a7400640 1 -- 172.21.15.17:0/4161290365 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86b4003d00 con 0x555c34b2aa70 2024-09-13T16:00:32.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.008+0000 7f86cafc0740 10 client.25615 fetch_fsmap learned FSMap version 30 2024-09-13T16:00:32.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.008+0000 7f86cafc0740 1 -- 172.21.15.17:0/4161290365 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x555c34a53560 con 0x555c34b2aa70 2024-09-13T16:00:32.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.009+0000 7f86a7400640 1 -- 172.21.15.17:0/4161290365 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555c34ab7c90 con 0x555c34b2aa70 2024-09-13T16:00:32.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.009+0000 7f86a7400640 1 -- 172.21.15.17:0/4161290365 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) v1 ==== 7490+0+0 (secure 0 0 0) 0x7f86b403cd20 con 0x555c34b2aa70 2024-09-13T16:00:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.009+0000 7f86cafc0740 10 client.25615 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T16:00:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.009+0000 7f86cafc0740 10 client.25615 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:00:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.009+0000 7f86cafc0740 20 client.25615 populate_metadata read hostname 'smithi017' 2024-09-13T16:00:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.009+0000 7f86cafc0740 1 --2- 172.21.15.17:0/4161290365 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555c34b98ce0 0x555c34b9b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.009+0000 7f86cafc0740 4 client.25615 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:00:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.009+0000 7f86cafc0740 1 -- 172.21.15.17:0/4161290365 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555c34792600 con 0x555c34b98ce0 2024-09-13T16:00:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.010+0000 7f86c4e00640 1 --2- 172.21.15.17:0/4161290365 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555c34b98ce0 0x555c34b9b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.011+0000 7f86a7400640 10 client.25615 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:00:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.013+0000 7f86c4e00640 1 --2- 172.21.15.17:0/4161290365 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555c34b98ce0 0x555c34b9b100 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cb74428f4dc0424 server_cookie=d1aa89015f6ac67d in_seq=0 out_seq=0 2024-09-13T16:00:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.112+0000 7f86a7400640 1 -- 172.21.15.17:0/4161290365 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555c34792600 con 0x555c34b98ce0 2024-09-13T16:00:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.112+0000 7f86a7400640 10 client.25615 handle_command_reply: tid=0 2024-09-13T16:00:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.112+0000 7f86cafc0740 1 client.25615 shutdown 2024-09-13T16:00:32.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.113+0000 7f86cafc0740 1 -- 172.21.15.17:0/4161290365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c34b2aa70 msgr2=0x555c34b38ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.113+0000 7f86cafc0740 1 --2- 172.21.15.17:0/4161290365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c34b2aa70 0x555c34b38ea0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f86b4041040 tx=0x7f86b40097f0 comp rx=0 tx=0).stop 2024-09-13T16:00:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.113+0000 7f86cafc0740 1 -- 172.21.15.17:0/4161290365 shutdown_connections 2024-09-13T16:00:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.113+0000 7f86cafc0740 1 --2- 172.21.15.17:0/4161290365 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555c34b98ce0 0x555c34b9b100 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.113+0000 7f86cafc0740 1 --2- 172.21.15.17:0/4161290365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c34b30440 0x555c34b3a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.113+0000 7f86cafc0740 1 --2- 172.21.15.17:0/4161290365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c34b2b3b0 0x555c34b393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.113+0000 7f86cafc0740 1 --2- 172.21.15.17:0/4161290365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c34b2aa70 0x555c34b38ea0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:32.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.113+0000 7f86cafc0740 1 -- 172.21.15.17:0/4161290365 >> 172.21.15.17:0/4161290365 conn(0x555c34b260e0 msgr2=0x555c34b24a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.113+0000 7f86a7400640 0 client.25615 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:00:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.114+0000 7f86cafc0740 1 -- 172.21.15.17:0/4161290365 shutdown_connections 2024-09-13T16:00:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.114+0000 7f86cafc0740 1 -- 172.21.15.17:0/4161290365 wait complete. 2024-09-13T16:00:32.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.114+0000 7f86cafc0740 20 client.25615 trim_cache size 0 max 16384 2024-09-13T16:00:32.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:00:32.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:00:32.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:00:32.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:00:32.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.115+0000 7f86c8200640 1 -- 172.21.15.17:0/2750129382 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f86a80a11a0 msgr2=0x7f86a80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:32.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.115+0000 7f86c8200640 1 --2- 172.21.15.17:0/2750129382 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f86a80a11a0 0x7f86a80a3660 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f86b4000c00 tx=0x7f86b4005760 comp rx=0 tx=0).stop 2024-09-13T16:00:32.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.116+0000 7f86c8200640 1 -- 172.21.15.17:0/2750129382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c00744f0 msgr2=0x7f86c019c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:32.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.116+0000 7f86c8200640 1 --2- 172.21.15.17:0/2750129382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c00744f0 0x7f86c019c880 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00ea60 tx=0x7f86ac00ee60 comp rx=0 tx=0).stop 2024-09-13T16:00:32.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.116+0000 7f86c8200640 1 -- 172.21.15.17:0/2750129382 shutdown_connections 2024-09-13T16:00:32.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.116+0000 7f86c8200640 1 --2- 172.21.15.17:0/2750129382 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f86a80a11a0 0x7f86a80a3660 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:32.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.116+0000 7f86c8200640 1 --2- 172.21.15.17:0/2750129382 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86c010c2f0 0x7f86c01a38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:32.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.116+0000 7f86c8200640 1 --2- 172.21.15.17:0/2750129382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c00744f0 0x7f86c019c880 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:32.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.116+0000 7f86c8200640 1 --2- 172.21.15.17:0/2750129382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86c0072f10 0x7f86c019c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:32.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.116+0000 7f86c8200640 1 -- 172.21.15.17:0/2750129382 >> 172.21.15.17:0/2750129382 conn(0x7f86c00fb4a0 msgr2=0x7f86c00fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:32.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.116+0000 7f86c8200640 1 -- 172.21.15.17:0/2750129382 shutdown_connections 2024-09-13T16:00:32.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:32.116+0000 7f86c8200640 1 -- 172.21.15.17:0/2750129382 wait complete. 2024-09-13T16:00:32.608 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:32 smithi189 ceph-mon[34790]: pgmap v469: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.0 MiB/s wr, 608 op/s 2024-09-13T16:00:32.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:32 smithi193 ceph-mon[35248]: pgmap v469: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.0 MiB/s wr, 608 op/s 2024-09-13T16:00:32.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:32 smithi017 ceph-mon[30494]: pgmap v469: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.0 MiB/s wr, 608 op/s 2024-09-13T16:00:34.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:34 smithi193 ceph-mon[35248]: pgmap v470: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 668 op/s 2024-09-13T16:00:34.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:34 smithi017 ceph-mon[30494]: pgmap v470: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 668 op/s 2024-09-13T16:00:34.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:34 smithi189 ceph-mon[34790]: pgmap v470: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 668 op/s 2024-09-13T16:00:35.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 170.0 s, 1368.4 tps, lat 72.893 ms stddev 92.255 2024-09-13T16:00:36.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:36 smithi189 ceph-mon[34790]: pgmap v471: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.4 MiB/s wr, 672 op/s 2024-09-13T16:00:36.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:36 smithi193 ceph-mon[35248]: pgmap v471: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.4 MiB/s wr, 672 op/s 2024-09-13T16:00:36.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:36 smithi017 ceph-mon[30494]: pgmap v471: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.4 MiB/s wr, 672 op/s 2024-09-13T16:00:38.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:38 smithi193 ceph-mon[35248]: pgmap v472: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.5 MiB/s wr, 597 op/s 2024-09-13T16:00:38.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:38 smithi017 ceph-mon[30494]: pgmap v472: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.5 MiB/s wr, 597 op/s 2024-09-13T16:00:38.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:38 smithi189 ceph-mon[34790]: pgmap v472: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.5 MiB/s wr, 597 op/s 2024-09-13T16:00:39.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:39 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:00:39.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:39 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:00:39.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:39 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:00:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 175.0 s, 1417.6 tps, lat 70.496 ms stddev 82.370 2024-09-13T16:00:40.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:40 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:00:40.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:40 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:00:40.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:40 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T16:00:40.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:40 smithi193 ceph-mon[35248]: pgmap v473: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 6.1 MiB/s wr, 672 op/s 2024-09-13T16:00:40.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:40 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:00:40.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:40 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:00:40.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:40 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T16:00:40.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:40 smithi017 ceph-mon[30494]: pgmap v473: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 6.1 MiB/s wr, 672 op/s 2024-09-13T16:00:40.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:40 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:00:40.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:40 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:00:40.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:40 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T16:00:40.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:40 smithi189 ceph-mon[34790]: pgmap v473: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 6.1 MiB/s wr, 672 op/s 2024-09-13T16:00:42.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:42 smithi193 ceph-mon[35248]: pgmap v474: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.2 MiB/s wr, 666 op/s 2024-09-13T16:00:42.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:42 smithi017 ceph-mon[30494]: pgmap v474: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.2 MiB/s wr, 666 op/s 2024-09-13T16:00:42.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:42 smithi189 ceph-mon[34790]: pgmap v474: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.2 MiB/s wr, 666 op/s 2024-09-13T16:00:44.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:44 smithi193 ceph-mon[35248]: pgmap v475: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.7 MiB/s wr, 666 op/s 2024-09-13T16:00:44.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:44 smithi017 ceph-mon[30494]: pgmap v475: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.7 MiB/s wr, 666 op/s 2024-09-13T16:00:44.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:44 smithi189 ceph-mon[34790]: pgmap v475: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.7 MiB/s wr, 666 op/s 2024-09-13T16:00:45.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 180.0 s, 1693.9 tps, lat 59.361 ms stddev 74.137 2024-09-13T16:00:45.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.318+0000 7fac94000640 1 -- 172.21.15.17:0/2658892336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac8c107f10 msgr2=0x7fac8c112c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:45.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.318+0000 7fac94000640 1 --2- 172.21.15.17:0/2658892336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac8c107f10 0x7fac8c112c00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fac84009be0 tx=0x7fac8402a710 comp rx=0 tx=0).stop 2024-09-13T16:00:45.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.318+0000 7fac94000640 1 -- 172.21.15.17:0/2658892336 shutdown_connections 2024-09-13T16:00:45.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.318+0000 7fac94000640 1 --2- 172.21.15.17:0/2658892336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac8c107f10 0x7fac8c112c00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.318+0000 7fac94000640 1 --2- 172.21.15.17:0/2658892336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac8c107550 0x7fac8c1079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.318+0000 7fac94000640 1 --2- 172.21.15.17:0/2658892336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac8c071650 0x7fac8c071a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.319+0000 7fac94000640 1 -- 172.21.15.17:0/2658892336 >> 172.21.15.17:0/2658892336 conn(0x7fac8c06d0f0 msgr2=0x7fac8c06f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:45.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.319+0000 7fac94000640 1 -- 172.21.15.17:0/2658892336 shutdown_connections 2024-09-13T16:00:45.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.319+0000 7fac94000640 1 -- 172.21.15.17:0/2658892336 wait complete. 2024-09-13T16:00:45.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.320+0000 7fac94000640 1 Processor -- start 2024-09-13T16:00:45.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.320+0000 7fac94000640 1 -- start start 2024-09-13T16:00:45.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.320+0000 7fac94000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac8c071650 0x7fac8c117640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:45.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.320+0000 7fac94000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac8c107550 0x7fac8c117b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:45.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.321+0000 7fac94000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac8c107f10 0x7fac8c1b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:45.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.321+0000 7fac94000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c11cbe0 con 0x7fac8c071650 2024-09-13T16:00:45.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.321+0000 7fac94000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c11cd50 con 0x7fac8c107550 2024-09-13T16:00:45.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.321+0000 7fac94000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c11cf10 con 0x7fac8c107f10 2024-09-13T16:00:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.321+0000 7fac90c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac8c107550 0x7fac8c117b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.321+0000 7fac90c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac8c107550 0x7fac8c117b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:34222/0 (socket says 172.21.15.17:34222) 2024-09-13T16:00:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.321+0000 7fac90c00640 1 -- 172.21.15.17:0/675555478 learned_addr learned my addr 172.21.15.17:0/675555478 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.321+0000 7fac92000640 1 --2- 172.21.15.17:0/675555478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac8c107f10 0x7fac8c1b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.322+0000 7fac91600640 1 --2- 172.21.15.17:0/675555478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac8c071650 0x7fac8c117640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.322+0000 7fac90c00640 1 -- 172.21.15.17:0/675555478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac8c107f10 msgr2=0x7fac8c1b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.322+0000 7fac90c00640 1 --2- 172.21.15.17:0/675555478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac8c107f10 0x7fac8c1b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.322+0000 7fac90c00640 1 -- 172.21.15.17:0/675555478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac8c071650 msgr2=0x7fac8c117640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.322+0000 7fac90c00640 1 --2- 172.21.15.17:0/675555478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac8c071650 0x7fac8c117640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.322+0000 7fac90c00640 1 -- 172.21.15.17:0/675555478 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac84009840 con 0x7fac8c107550 2024-09-13T16:00:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.322+0000 7fac92000640 1 --2- 172.21.15.17:0/675555478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac8c107f10 0x7fac8c1b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:00:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.322+0000 7fac90c00640 1 --2- 172.21.15.17:0/675555478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac8c107550 0x7fac8c117b80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fac7800b4a0 tx=0x7fac7800b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.323+0000 7fac8a000640 1 -- 172.21.15.17:0/675555478 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac78010610 con 0x7fac8c107550 2024-09-13T16:00:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.323+0000 7fac8a000640 1 -- 172.21.15.17:0/675555478 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac78010c30 con 0x7fac8c107550 2024-09-13T16:00:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.323+0000 7fac8a000640 1 -- 172.21.15.17:0/675555478 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac78017dd0 con 0x7fac8c107550 2024-09-13T16:00:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.323+0000 7fac94000640 1 -- 172.21.15.17:0/675555478 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8c1b5460 con 0x7fac8c107550 2024-09-13T16:00:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.323+0000 7fac94000640 1 -- 172.21.15.17:0/675555478 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8c1b59a0 con 0x7fac8c107550 2024-09-13T16:00:45.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.328+0000 7fac8a000640 1 -- 172.21.15.17:0/675555478 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fac78019450 con 0x7fac8c107550 2024-09-13T16:00:45.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.329+0000 7fac96ea4740 1 Processor -- start 2024-09-13T16:00:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.330+0000 7fac8a000640 1 --2- 172.21.15.17:0/675555478 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fac740a1140 0x7fac740a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.331+0000 7fac8a000640 1 -- 172.21.15.17:0/675555478 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fac780cc5e0 con 0x7fac8c107550 2024-09-13T16:00:45.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.331+0000 7fac96ea4740 1 -- start start 2024-09-13T16:00:45.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.332+0000 7fac92000640 1 --2- 172.21.15.17:0/675555478 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fac740a1140 0x7fac740a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:45.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.332+0000 7fac96ea4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 0x55f74b22ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:45.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.332+0000 7fac96ea4740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f74b22f3b0 0x55f74b233e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:45.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.332+0000 7fac96ea4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b234440 0x55f74b236900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:45.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.332+0000 7fac96ea4740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74b13abb0 con 0x55f74b22f3b0 2024-09-13T16:00:45.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.332+0000 7fac96ea4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74b198a70 con 0x55f74b22ea70 2024-09-13T16:00:45.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.332+0000 7fac96ea4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74b196200 con 0x55f74b234440 2024-09-13T16:00:45.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.332+0000 7fac92000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b234440 0x55f74b236900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:45.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.332+0000 7fac92000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b234440 0x55f74b236900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:36624/0 (socket says 172.21.15.17:36624) 2024-09-13T16:00:45.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.332+0000 7fac92000640 1 -- 172.21.15.17:0/2803380853 learned_addr learned my addr 172.21.15.17:0/2803380853 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:45.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.333+0000 7fac91600640 1 --2- 172.21.15.17:0/2803380853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 0x55f74b22ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:45.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.333+0000 7fac90c00640 1 --2- 172.21.15.17:0/2803380853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f74b22f3b0 0x55f74b233e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:45.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.333+0000 7fac91600640 1 -- 172.21.15.17:0/2803380853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b234440 msgr2=0x55f74b236900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:45.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.333+0000 7fac91600640 1 --2- 172.21.15.17:0/2803380853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b234440 0x55f74b236900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.333+0000 7fac91600640 1 -- 172.21.15.17:0/2803380853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f74b22f3b0 msgr2=0x55f74b233e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.333+0000 7fac91600640 1 --2- 172.21.15.17:0/2803380853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f74b22f3b0 0x55f74b233e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.333+0000 7fac91600640 1 -- 172.21.15.17:0/2803380853 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f74b133940 con 0x55f74b22ea70 2024-09-13T16:00:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.334+0000 7fac92000640 1 --2- 172.21.15.17:0/675555478 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fac740a1140 0x7fac740a3600 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fac84004af0 tx=0x7fac84031570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.334+0000 7fac91600640 1 --2- 172.21.15.17:0/2803380853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 0x55f74b22ee70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fac80005fd0 tx=0x7fac800113e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=193252bb08e1f68d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.334+0000 7fac7ea00640 1 -- 172.21.15.17:0/2803380853 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac80011e10 con 0x55f74b22ea70 2024-09-13T16:00:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.334+0000 7fac7ea00640 1 -- 172.21.15.17:0/2803380853 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac800054e0 con 0x55f74b22ea70 2024-09-13T16:00:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.334+0000 7fac7ea00640 1 -- 172.21.15.17:0/2803380853 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac800126b0 con 0x55f74b22ea70 2024-09-13T16:00:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.335+0000 7fac96ea4740 1 -- 172.21.15.17:0/2803380853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 msgr2=0x55f74b22ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.335+0000 7fac96ea4740 1 --2- 172.21.15.17:0/2803380853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 0x55f74b22ee70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fac80005fd0 tx=0x7fac800113e0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.338+0000 7fac96ea4740 1 -- 172.21.15.17:0/2803380853 shutdown_connections 2024-09-13T16:00:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.338+0000 7fac96ea4740 1 --2- 172.21.15.17:0/2803380853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b234440 0x55f74b236900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.338+0000 7fac96ea4740 1 --2- 172.21.15.17:0/2803380853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f74b22f3b0 0x55f74b233e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.338+0000 7fac96ea4740 1 --2- 172.21.15.17:0/2803380853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 0x55f74b22ee70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.338+0000 7fac96ea4740 1 -- 172.21.15.17:0/2803380853 >> 172.21.15.17:0/2803380853 conn(0x55f74b22a0e0 msgr2=0x55f74b22a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:45.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.341+0000 7fac96ea4740 1 -- 172.21.15.17:0/2803380853 shutdown_connections 2024-09-13T16:00:45.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.341+0000 7fac96ea4740 1 -- 172.21.15.17:0/2803380853 wait complete. 2024-09-13T16:00:45.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.341+0000 7fac96ea4740 1 -- start start 2024-09-13T16:00:45.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.346+0000 7fac96ea4740 1 Processor -- start 2024-09-13T16:00:45.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.347+0000 7fac96ea4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 0x55f74b2386e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:45.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.347+0000 7fac96ea4740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f74b22f3b0 0x55f74b238c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:45.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.347+0000 7fac96ea4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b234440 0x55f74b23fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:45.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.348+0000 7fac91600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 0x55f74b2386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.348+0000 7fac92000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b234440 0x55f74b23fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.348+0000 7fac92000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b234440 0x55f74b23fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:36640/0 (socket says 172.21.15.17:36640) 2024-09-13T16:00:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.348+0000 7fac92000640 1 -- 172.21.15.17:0/2432712749 learned_addr learned my addr 172.21.15.17:0/2432712749 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.348+0000 7fac96ea4740 1 -- 172.21.15.17:0/2432712749 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74b191af0 con 0x55f74b22f3b0 2024-09-13T16:00:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.348+0000 7fac96ea4740 1 -- 172.21.15.17:0/2432712749 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74b14ff20 con 0x55f74b22ea70 2024-09-13T16:00:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.348+0000 7fac90c00640 1 --2- 172.21.15.17:0/2432712749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f74b22f3b0 0x55f74b238c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.349+0000 7fac96ea4740 1 -- 172.21.15.17:0/2432712749 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74b14fbc0 con 0x55f74b234440 2024-09-13T16:00:45.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.349+0000 7fac96ea4740 10 client.0 _ll_register_callbacks cb 0x55f74b181a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:00:45.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.350+0000 7fac92000640 1 -- 172.21.15.17:0/2432712749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 msgr2=0x55f74b2386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:45.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.350+0000 7fac92000640 1 --2- 172.21.15.17:0/2432712749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 0x55f74b2386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.350+0000 7fac92000640 1 -- 172.21.15.17:0/2432712749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f74b22f3b0 msgr2=0x55f74b238c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:45.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.350+0000 7fac92000640 1 --2- 172.21.15.17:0/2432712749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f74b22f3b0 0x55f74b238c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.350+0000 7fac92000640 1 -- 172.21.15.17:0/2432712749 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac800097b0 con 0x55f74b234440 2024-09-13T16:00:45.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.351+0000 7fac92000640 1 --2- 172.21.15.17:0/2432712749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b234440 0x55f74b23fc10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fac840307e0 tx=0x7fac8402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8410e1e8d07d99b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:45.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.351+0000 7fac73400640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:00:45.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.351+0000 7fac73400640 1 -- 172.21.15.17:0/2432712749 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8403cb40 con 0x55f74b234440 2024-09-13T16:00:45.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.351+0000 7fac73400640 1 -- 172.21.15.17:0/2432712749 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fac84041040 con 0x55f74b234440 2024-09-13T16:00:45.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.351+0000 7fac96ea4740 1 -- 172.21.15.17:0/2432712749 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f74b1bbc90 con 0x55f74b234440 2024-09-13T16:00:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.352+0000 7fac73400640 1 -- 172.21.15.17:0/2432712749 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac8403cca0 con 0x55f74b234440 2024-09-13T16:00:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.352+0000 7fac96ea4740 10 client.25627 fetch_fsmap learned FSMap version 30 2024-09-13T16:00:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.352+0000 7fac96ea4740 1 -- 172.21.15.17:0/2432712749 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55f74b190170 con 0x55f74b234440 2024-09-13T16:00:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.353+0000 7fac73400640 1 -- 172.21.15.17:0/2432712749 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f74b1bbc90 con 0x55f74b234440 2024-09-13T16:00:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.353+0000 7fac73400640 1 -- 172.21.15.17:0/2432712749 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) v1 ==== 7490+0+0 (secure 0 0 0) 0x7fac8404b3f0 con 0x55f74b234440 2024-09-13T16:00:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.353+0000 7fac96ea4740 10 client.25627 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T16:00:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.353+0000 7fac96ea4740 10 client.25627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:00:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.353+0000 7fac96ea4740 20 client.25627 populate_metadata read hostname 'smithi017' 2024-09-13T16:00:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.353+0000 7fac96ea4740 1 --2- 172.21.15.17:0/2432712749 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f74b244350 0x55f74b246770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.353+0000 7fac96ea4740 4 client.25627 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:00:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.353+0000 7fac96ea4740 1 -- 172.21.15.17:0/2432712749 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f74b1847d0 con 0x55f74b244350 2024-09-13T16:00:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.355+0000 7fac91600640 1 --2- 172.21.15.17:0/2432712749 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f74b244350 0x55f74b246770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:45.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.356+0000 7fac91600640 1 --2- 172.21.15.17:0/2432712749 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f74b244350 0x55f74b246770 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4ab1318043c3792 server_cookie=4fb0c8367f8f1b98 in_seq=0 out_seq=0 2024-09-13T16:00:45.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.356+0000 7fac73400640 10 client.25627 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:00:45.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.357+0000 7fac73400640 1 -- 172.21.15.17:0/2432712749 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f74b1847d0 con 0x55f74b244350 2024-09-13T16:00:45.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.357+0000 7fac73400640 10 client.25627 handle_command_reply: tid=0 2024-09-13T16:00:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.357+0000 7fac96ea4740 1 client.25627 shutdown 2024-09-13T16:00:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.357+0000 7fac96ea4740 1 -- 172.21.15.17:0/2432712749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b234440 msgr2=0x55f74b23fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.357+0000 7fac96ea4740 1 --2- 172.21.15.17:0/2432712749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b234440 0x55f74b23fc10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fac840307e0 tx=0x7fac8402a710 comp rx=0 tx=0).stop 2024-09-13T16:00:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.360+0000 7fac96ea4740 1 -- 172.21.15.17:0/2432712749 shutdown_connections 2024-09-13T16:00:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.360+0000 7fac96ea4740 1 --2- 172.21.15.17:0/2432712749 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f74b244350 0x55f74b246770 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.360+0000 7fac96ea4740 1 --2- 172.21.15.17:0/2432712749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b234440 0x55f74b23fc10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.360+0000 7fac96ea4740 1 --2- 172.21.15.17:0/2432712749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f74b22f3b0 0x55f74b238c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.360+0000 7fac96ea4740 1 --2- 172.21.15.17:0/2432712749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 0x55f74b2386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.360+0000 7fac96ea4740 1 -- 172.21.15.17:0/2432712749 >> 172.21.15.17:0/2432712749 conn(0x55f74b22a0e0 msgr2=0x55f74b22b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.360+0000 7fac73400640 0 client.25627 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:00:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.360+0000 7fac96ea4740 1 -- 172.21.15.17:0/2432712749 shutdown_connections 2024-09-13T16:00:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.360+0000 7fac96ea4740 1 -- 172.21.15.17:0/2432712749 wait complete. 2024-09-13T16:00:45.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.360+0000 7fac96ea4740 20 client.25627 trim_cache size 0 max 16384 2024-09-13T16:00:45.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.385+0000 7fac96ea4740 1 Processor -- start 2024-09-13T16:00:45.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.385+0000 7fac96ea4740 1 -- start start 2024-09-13T16:00:45.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.386+0000 7fac96ea4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 0x55f74b2386e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.386+0000 7fac96ea4740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f74b22f3b0 0x55f74b23fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.386+0000 7fac96ea4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b234440 0x55f74b238c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.386+0000 7fac96ea4740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74aef8e60 con 0x55f74b22f3b0 2024-09-13T16:00:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.386+0000 7fac96ea4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74b1bbc90 con 0x55f74b22ea70 2024-09-13T16:00:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.386+0000 7fac96ea4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74b240d90 con 0x55f74b234440 2024-09-13T16:00:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.386+0000 7fac90c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f74b22f3b0 0x55f74b23fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.386+0000 7fac90c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f74b22f3b0 0x55f74b23fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54842/0 (socket says 172.21.15.17:54842) 2024-09-13T16:00:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.386+0000 7fac90c00640 1 -- 172.21.15.17:0/2634689158 learned_addr learned my addr 172.21.15.17:0/2634689158 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.386+0000 7fac92000640 1 --2- 172.21.15.17:0/2634689158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b234440 0x55f74b238c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.386+0000 7fac91600640 1 --2- 172.21.15.17:0/2634689158 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 0x55f74b2386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.387+0000 7fac90c00640 1 -- 172.21.15.17:0/2634689158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b234440 msgr2=0x55f74b238c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.387+0000 7fac90c00640 1 --2- 172.21.15.17:0/2634689158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b234440 0x55f74b238c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.387+0000 7fac90c00640 1 -- 172.21.15.17:0/2634689158 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 msgr2=0x55f74b2386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:45.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.387+0000 7fac90c00640 1 --2- 172.21.15.17:0/2634689158 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 0x55f74b2386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.387+0000 7fac90c00640 1 -- 172.21.15.17:0/2634689158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f74b132180 con 0x55f74b22f3b0 2024-09-13T16:00:45.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.387+0000 7fac92000640 1 --2- 172.21.15.17:0/2634689158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b234440 0x55f74b238c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:00:45.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.388+0000 7fac90c00640 1 --2- 172.21.15.17:0/2634689158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f74b22f3b0 0x55f74b23fbd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fac780c9de0 tx=0x7fac780b9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f36adf0e0d1f284 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:45.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.389+0000 7fac7f400640 1 -- 172.21.15.17:0/2634689158 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7809a610 con 0x55f74b22f3b0 2024-09-13T16:00:45.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.389+0000 7fac7f400640 1 -- 172.21.15.17:0/2634689158 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac7809e440 con 0x55f74b22f3b0 2024-09-13T16:00:45.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.389+0000 7fac7f400640 1 -- 172.21.15.17:0/2634689158 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7809e120 con 0x55f74b22f3b0 2024-09-13T16:00:45.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.390+0000 7fac96ea4740 1 -- 172.21.15.17:0/2634689158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f74b22f3b0 msgr2=0x55f74b23fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:45.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.390+0000 7fac96ea4740 1 --2- 172.21.15.17:0/2634689158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f74b22f3b0 0x55f74b23fbd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fac780c9de0 tx=0x7fac780b9040 comp rx=0 tx=0).stop 2024-09-13T16:00:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.391+0000 7fac96ea4740 1 -- 172.21.15.17:0/2634689158 shutdown_connections 2024-09-13T16:00:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.391+0000 7fac96ea4740 1 --2- 172.21.15.17:0/2634689158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b234440 0x55f74b238c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.391+0000 7fac96ea4740 1 --2- 172.21.15.17:0/2634689158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f74b22f3b0 0x55f74b23fbd0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.391+0000 7fac96ea4740 1 --2- 172.21.15.17:0/2634689158 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 0x55f74b2386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.391+0000 7fac96ea4740 1 -- 172.21.15.17:0/2634689158 >> 172.21.15.17:0/2634689158 conn(0x55f74b22a0e0 msgr2=0x55f74b2338e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.392+0000 7fac96ea4740 1 -- 172.21.15.17:0/2634689158 shutdown_connections 2024-09-13T16:00:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.392+0000 7fac96ea4740 1 -- 172.21.15.17:0/2634689158 wait complete. 2024-09-13T16:00:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.392+0000 7fac96ea4740 1 -- start start 2024-09-13T16:00:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.393+0000 7fac96ea4740 1 Processor -- start 2024-09-13T16:00:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.393+0000 7fac96ea4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 0x55f74b23c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.393+0000 7fac96ea4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b22f3b0 0x55f74b23ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.393+0000 7fac96ea4740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f74b234440 0x55f74b29a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.393+0000 7fac96ea4740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74b23fda0 con 0x55f74b234440 2024-09-13T16:00:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.393+0000 7fac96ea4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74b23ff10 con 0x55f74b22ea70 2024-09-13T16:00:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.393+0000 7fac96ea4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74b29ad80 con 0x55f74b22f3b0 2024-09-13T16:00:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.394+0000 7fac96ea4740 10 client.0 _ll_register_callbacks cb 0x7fac80009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:00:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.394+0000 7fac91600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 0x55f74b23c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.395+0000 7fac91600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 0x55f74b23c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:34248/0 (socket says 172.21.15.17:34248) 2024-09-13T16:00:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.395+0000 7fac91600640 1 -- 172.21.15.17:0/1574376013 learned_addr learned my addr 172.21.15.17:0/1574376013 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.395+0000 7fac92000640 1 --2- 172.21.15.17:0/1574376013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f74b234440 0x55f74b29a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.395+0000 7fac90c00640 1 --2- 172.21.15.17:0/1574376013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b22f3b0 0x55f74b23ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.395+0000 7fac91600640 1 -- 172.21.15.17:0/1574376013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b22f3b0 msgr2=0x55f74b23ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.395+0000 7fac91600640 1 --2- 172.21.15.17:0/1574376013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b22f3b0 0x55f74b23ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.395+0000 7fac91600640 1 -- 172.21.15.17:0/1574376013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f74b234440 msgr2=0x55f74b29a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.395+0000 7fac91600640 1 --2- 172.21.15.17:0/1574376013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f74b234440 0x55f74b29a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.395+0000 7fac91600640 1 -- 172.21.15.17:0/1574376013 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f74b190170 con 0x55f74b22ea70 2024-09-13T16:00:45.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.395+0000 7fac90c00640 1 --2- 172.21.15.17:0/1574376013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b22f3b0 0x55f74b23ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:00:45.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.396+0000 7fac73400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:00:45.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.396+0000 7fac91600640 1 --2- 172.21.15.17:0/1574376013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 0x55f74b23c8e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fac8001a000 tx=0x7fac80005650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=612c705854572d5b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:45.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.396+0000 7fac73400640 1 -- 172.21.15.17:0/1574376013 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac80011e10 con 0x55f74b22ea70 2024-09-13T16:00:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.396+0000 7fac73400640 1 -- 172.21.15.17:0/1574376013 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fac8002cb00 con 0x55f74b22ea70 2024-09-13T16:00:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.397+0000 7fac96ea4740 1 -- 172.21.15.17:0/1574376013 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fac800054e0 con 0x55f74b22ea70 2024-09-13T16:00:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.397+0000 7fac73400640 1 -- 172.21.15.17:0/1574376013 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac800057f0 con 0x55f74b22ea70 2024-09-13T16:00:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.397+0000 7fac96ea4740 10 client.25607 fetch_fsmap learned FSMap version 30 2024-09-13T16:00:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.397+0000 7fac96ea4740 1 -- 172.21.15.17:0/1574376013 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7fac8c1b59a0 con 0x55f74b22ea70 2024-09-13T16:00:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.397+0000 7fac73400640 1 -- 172.21.15.17:0/1574376013 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac800054e0 con 0x55f74b22ea70 2024-09-13T16:00:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.398+0000 7fac73400640 1 -- 172.21.15.17:0/1574376013 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) v1 ==== 7490+0+0 (secure 0 0 0) 0x7fac8002c680 con 0x55f74b22ea70 2024-09-13T16:00:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.398+0000 7fac96ea4740 10 client.25607 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T16:00:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.398+0000 7fac96ea4740 10 client.25607 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:00:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.398+0000 7fac96ea4740 20 client.25607 populate_metadata read hostname 'smithi017' 2024-09-13T16:00:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.398+0000 7fac96ea4740 1 --2- 172.21.15.17:0/1574376013 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f74b29c7f0 0x55f74b29ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.398+0000 7fac96ea4740 4 client.25607 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:00:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.398+0000 7fac96ea4740 1 -- 172.21.15.17:0/1574376013 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f74ae85300 con 0x55f74b29c7f0 2024-09-13T16:00:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.398+0000 7fac90c00640 1 --2- 172.21.15.17:0/1574376013 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f74b29c7f0 0x55f74b29ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.399+0000 7fac73400640 10 client.25607 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:00:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.399+0000 7fac90c00640 1 --2- 172.21.15.17:0/1574376013 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f74b29c7f0 0x55f74b29ec10 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56c86493a165ecc0 server_cookie=1ffa1e693bdd2973 in_seq=0 out_seq=0 2024-09-13T16:00:45.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.417+0000 7fac73400640 1 -- 172.21.15.17:0/1574376013 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f74ae85300 con 0x55f74b29c7f0 2024-09-13T16:00:45.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.417+0000 7fac73400640 10 client.25607 handle_command_reply: tid=0 2024-09-13T16:00:45.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.417+0000 7fac96ea4740 1 client.25607 shutdown 2024-09-13T16:00:45.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.418+0000 7fac96ea4740 1 -- 172.21.15.17:0/1574376013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 msgr2=0x55f74b23c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:45.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.418+0000 7fac96ea4740 1 --2- 172.21.15.17:0/1574376013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 0x55f74b23c8e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fac8001a000 tx=0x7fac80005650 comp rx=0 tx=0).stop 2024-09-13T16:00:45.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.418+0000 7fac96ea4740 1 -- 172.21.15.17:0/1574376013 shutdown_connections 2024-09-13T16:00:45.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.418+0000 7fac96ea4740 1 --2- 172.21.15.17:0/1574376013 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f74b29c7f0 0x55f74b29ec10 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.418+0000 7fac73400640 0 client.25607 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:00:45.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.418+0000 7fac96ea4740 1 --2- 172.21.15.17:0/1574376013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f74b234440 0x55f74b29a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.418+0000 7fac96ea4740 1 --2- 172.21.15.17:0/1574376013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f74b22f3b0 0x55f74b23ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.418+0000 7fac96ea4740 1 --2- 172.21.15.17:0/1574376013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f74b22ea70 0x55f74b23c8e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.418+0000 7fac96ea4740 1 -- 172.21.15.17:0/1574376013 >> 172.21.15.17:0/1574376013 conn(0x55f74b22a0e0 msgr2=0x55f74b2302d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:45.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.418+0000 7fac96ea4740 1 -- 172.21.15.17:0/1574376013 shutdown_connections 2024-09-13T16:00:45.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.418+0000 7fac96ea4740 1 -- 172.21.15.17:0/1574376013 wait complete. 2024-09-13T16:00:45.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.419+0000 7fac96ea4740 20 client.25607 trim_cache size 0 max 16384 2024-09-13T16:00:45.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:00:45.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:00:45.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:00:45.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:00:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.419+0000 7fac94000640 1 -- 172.21.15.17:0/675555478 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fac740a1140 msgr2=0x7fac740a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.419+0000 7fac94000640 1 --2- 172.21.15.17:0/675555478 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fac740a1140 0x7fac740a3600 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fac84004af0 tx=0x7fac84031570 comp rx=0 tx=0).stop 2024-09-13T16:00:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.419+0000 7fac94000640 1 -- 172.21.15.17:0/675555478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac8c107550 msgr2=0x7fac8c117b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.419+0000 7fac94000640 1 --2- 172.21.15.17:0/675555478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac8c107550 0x7fac8c117b80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fac7800b4a0 tx=0x7fac7800b960 comp rx=0 tx=0).stop 2024-09-13T16:00:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.420+0000 7fac94000640 1 -- 172.21.15.17:0/675555478 shutdown_connections 2024-09-13T16:00:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.420+0000 7fac94000640 1 --2- 172.21.15.17:0/675555478 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fac740a1140 0x7fac740a3600 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.420+0000 7fac94000640 1 --2- 172.21.15.17:0/675555478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac8c107f10 0x7fac8c1b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.420+0000 7fac94000640 1 --2- 172.21.15.17:0/675555478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac8c107550 0x7fac8c117b80 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.420+0000 7fac94000640 1 --2- 172.21.15.17:0/675555478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac8c071650 0x7fac8c117640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.420+0000 7fac94000640 1 -- 172.21.15.17:0/675555478 >> 172.21.15.17:0/675555478 conn(0x7fac8c06d0f0 msgr2=0x7fac8c06dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.421+0000 7fac94000640 1 -- 172.21.15.17:0/675555478 shutdown_connections 2024-09-13T16:00:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:45.421+0000 7fac94000640 1 -- 172.21.15.17:0/675555478 wait complete. 2024-09-13T16:00:46.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:46 smithi193 ceph-mon[35248]: pgmap v476: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.1 MiB/s wr, 602 op/s 2024-09-13T16:00:46.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:46 smithi017 ceph-mon[30494]: pgmap v476: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.1 MiB/s wr, 602 op/s 2024-09-13T16:00:46.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:46 smithi189 ceph-mon[34790]: pgmap v476: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.1 MiB/s wr, 602 op/s 2024-09-13T16:00:48.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:48 smithi193 ceph-mon[35248]: pgmap v477: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 6.9 MiB/s wr, 615 op/s 2024-09-13T16:00:48.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:48 smithi017 ceph-mon[30494]: pgmap v477: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 6.9 MiB/s wr, 615 op/s 2024-09-13T16:00:48.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:48 smithi189 ceph-mon[34790]: pgmap v477: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 6.9 MiB/s wr, 615 op/s 2024-09-13T16:00:50.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 185.0 s, 1535.7 tps, lat 64.853 ms stddev 84.141 2024-09-13T16:00:50.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:50 smithi193 ceph-mon[35248]: pgmap v478: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 7.5 MiB/s wr, 689 op/s 2024-09-13T16:00:50.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:50 smithi017 ceph-mon[30494]: pgmap v478: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 7.5 MiB/s wr, 689 op/s 2024-09-13T16:00:50.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:50 smithi189 ceph-mon[34790]: pgmap v478: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 7.5 MiB/s wr, 689 op/s 2024-09-13T16:00:52.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:52 smithi193 ceph-mon[35248]: pgmap v479: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.1 MiB/s wr, 627 op/s 2024-09-13T16:00:52.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:52 smithi017 ceph-mon[30494]: pgmap v479: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.1 MiB/s wr, 627 op/s 2024-09-13T16:00:52.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:52 smithi189 ceph-mon[34790]: pgmap v479: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.1 MiB/s wr, 627 op/s 2024-09-13T16:00:54.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:54 smithi193 ceph-mon[35248]: pgmap v480: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.5 MiB/s wr, 570 op/s 2024-09-13T16:00:54.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:54 smithi017 ceph-mon[30494]: pgmap v480: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.5 MiB/s wr, 570 op/s 2024-09-13T16:00:54.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:54 smithi189 ceph-mon[34790]: pgmap v480: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.5 MiB/s wr, 570 op/s 2024-09-13T16:00:55.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 190.0 s, 1270.2 tps, lat 79.133 ms stddev 88.501 2024-09-13T16:00:56.657 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:56 smithi189 ceph-mon[34790]: pgmap v481: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.5 MiB/s wr, 635 op/s 2024-09-13T16:00:56.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:56 smithi193 ceph-mon[35248]: pgmap v481: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.5 MiB/s wr, 635 op/s 2024-09-13T16:00:56.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:56 smithi017 ceph-mon[30494]: pgmap v481: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.5 MiB/s wr, 635 op/s 2024-09-13T16:00:58.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.618+0000 7f0746600640 1 -- 172.21.15.17:0/1342972597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0740102f10 msgr2=0x7f0740105300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:58.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.618+0000 7f0746600640 1 --2- 172.21.15.17:0/1342972597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0740102f10 0x7f0740105300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f072c009900 tx=0x7f072c02a3f0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.619+0000 7f0746600640 1 -- 172.21.15.17:0/1342972597 shutdown_connections 2024-09-13T16:00:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.619+0000 7f0746600640 1 --2- 172.21.15.17:0/1342972597 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0740105920 0x7f0740107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.619+0000 7f0746600640 1 --2- 172.21.15.17:0/1342972597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0740102f10 0x7f0740105300 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.619+0000 7f0746600640 1 --2- 172.21.15.17:0/1342972597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07401005e0 0x7f07401029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.619+0000 7f0746600640 1 -- 172.21.15.17:0/1342972597 >> 172.21.15.17:0/1342972597 conn(0x7f07400fa1c0 msgr2=0x7f07400fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.620+0000 7f0746600640 1 -- 172.21.15.17:0/1342972597 shutdown_connections 2024-09-13T16:00:58.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.620+0000 7f0746600640 1 -- 172.21.15.17:0/1342972597 wait complete. 2024-09-13T16:00:58.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.622+0000 7f0746600640 1 Processor -- start 2024-09-13T16:00:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.623+0000 7f0746600640 1 -- start start 2024-09-13T16:00:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.623+0000 7f0746600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07401005e0 0x7f07401937f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.623+0000 7f0746600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0740102f10 0x7f0740193d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.623+0000 7f0746600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0740105920 0x7f07401a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:58.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.623+0000 7f0746600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07401945c0 con 0x7f07401005e0 2024-09-13T16:00:58.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.623+0000 7f0746600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07401951d0 con 0x7f0740102f10 2024-09-13T16:00:58.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.623+0000 7f0746600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0740195390 con 0x7f0740105920 2024-09-13T16:00:58.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.623+0000 7f073fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0740102f10 0x7f0740193d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:58.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.624+0000 7f073fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0740102f10 0x7f0740193d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:51084/0 (socket says 172.21.15.17:51084) 2024-09-13T16:00:58.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.624+0000 7f073fe00640 1 -- 172.21.15.17:0/2741930764 learned_addr learned my addr 172.21.15.17:0/2741930764 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:58.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.624+0000 7f0745200640 1 --2- 172.21.15.17:0/2741930764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07401005e0 0x7f07401937f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:58.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.624+0000 7f0745c00640 1 --2- 172.21.15.17:0/2741930764 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0740105920 0x7f07401a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:58.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.624+0000 7f073fe00640 1 -- 172.21.15.17:0/2741930764 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0740105920 msgr2=0x7f07401a3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:58.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.624+0000 7f073fe00640 1 --2- 172.21.15.17:0/2741930764 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0740105920 0x7f07401a3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.624+0000 7f073fe00640 1 -- 172.21.15.17:0/2741930764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07401005e0 msgr2=0x7f07401937f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:58.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.624+0000 7f073fe00640 1 --2- 172.21.15.17:0/2741930764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07401005e0 0x7f07401937f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.624+0000 7f073fe00640 1 -- 172.21.15.17:0/2741930764 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072c009560 con 0x7f0740102f10 2024-09-13T16:00:58.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.624+0000 7f0745c00640 1 --2- 172.21.15.17:0/2741930764 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0740105920 0x7f07401a3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:00:58.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.625+0000 7f073fe00640 1 --2- 172.21.15.17:0/2741930764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0740102f10 0x7f0740193d30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f072c009230 tx=0x7f072c003b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.625+0000 7f073d600640 1 -- 172.21.15.17:0/2741930764 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c003e50 con 0x7f0740102f10 2024-09-13T16:00:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.625+0000 7f073d600640 1 -- 172.21.15.17:0/2741930764 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f072c031c70 con 0x7f0740102f10 2024-09-13T16:00:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.626+0000 7f073d600640 1 -- 172.21.15.17:0/2741930764 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c03bd60 con 0x7f0740102f10 2024-09-13T16:00:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.626+0000 7f0746600640 1 -- 172.21.15.17:0/2741930764 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0740195610 con 0x7f0740102f10 2024-09-13T16:00:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.626+0000 7f0746600640 1 -- 172.21.15.17:0/2741930764 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0740195a70 con 0x7f0740102f10 2024-09-13T16:00:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.631+0000 7f074aa92740 1 Processor -- start 2024-09-13T16:00:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.632+0000 7f074aa92740 1 -- start start 2024-09-13T16:00:58.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.632+0000 7f074aa92740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af768c80 0x5646af769080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.632+0000 7f073d600640 1 -- 172.21.15.17:0/2741930764 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f072c03b460 con 0x7f0740102f10 2024-09-13T16:00:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.633+0000 7f074aa92740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af7695c0 0x5646af76e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.633+0000 7f074aa92740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646af76e650 0x5646af770b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.633+0000 7f074aa92740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646af674bb0 con 0x5646af768c80 2024-09-13T16:00:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.633+0000 7f074aa92740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646af6d2a70 con 0x5646af76e650 2024-09-13T16:00:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.633+0000 7f074aa92740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646af6d0200 con 0x5646af7695c0 2024-09-13T16:00:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.633+0000 7f0745c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af768c80 0x5646af769080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.633+0000 7f0745200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af7695c0 0x5646af76e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.633+0000 7f0745200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af7695c0 0x5646af76e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:46346/0 (socket says 172.21.15.17:46346) 2024-09-13T16:00:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.633+0000 7f0745200640 1 -- 172.21.15.17:0/3174707434 learned_addr learned my addr 172.21.15.17:0/3174707434 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.633+0000 7f073fe00640 1 --2- 172.21.15.17:0/3174707434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646af76e650 0x5646af770b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.634+0000 7f0745200640 1 -- 172.21.15.17:0/3174707434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646af76e650 msgr2=0x5646af770b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.634+0000 7f0745200640 1 --2- 172.21.15.17:0/3174707434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646af76e650 0x5646af770b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.634+0000 7f0745200640 1 -- 172.21.15.17:0/3174707434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af768c80 msgr2=0x5646af769080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.634+0000 7f0745200640 1 --2- 172.21.15.17:0/3174707434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af768c80 0x5646af769080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.634+0000 7f0745200640 1 -- 172.21.15.17:0/3174707434 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646af66d940 con 0x5646af7695c0 2024-09-13T16:00:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.634+0000 7f0745200640 1 --2- 172.21.15.17:0/3174707434 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af7695c0 0x5646af76e080 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0738009f70 tx=0x7f073800e780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d49944b062779715 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.635+0000 7f073d600640 1 --2- 172.21.15.17:0/2741930764 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f07240a12f0 0x7f07240a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.635+0000 7f073d600640 1 -- 172.21.15.17:0/2741930764 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f072c0ed650 con 0x7f0740102f10 2024-09-13T16:00:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.635+0000 7f0736000640 1 -- 172.21.15.17:0/3174707434 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0738004d20 con 0x5646af7695c0 2024-09-13T16:00:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.635+0000 7f0736000640 1 -- 172.21.15.17:0/3174707434 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0738004e80 con 0x5646af7695c0 2024-09-13T16:00:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.635+0000 7f0736000640 1 -- 172.21.15.17:0/3174707434 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07380118d0 con 0x5646af7695c0 2024-09-13T16:00:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.635+0000 7f0745c00640 1 --2- 172.21.15.17:0/2741930764 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f07240a12f0 0x7f07240a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:58.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.637+0000 7f074aa92740 1 -- 172.21.15.17:0/3174707434 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af7695c0 msgr2=0x5646af76e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:58.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.637+0000 7f074aa92740 1 --2- 172.21.15.17:0/3174707434 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af7695c0 0x5646af76e080 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0738009f70 tx=0x7f073800e780 comp rx=0 tx=0).stop 2024-09-13T16:00:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.637+0000 7f0745c00640 1 --2- 172.21.15.17:0/2741930764 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f07240a12f0 0x7f07240a37b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f073000cc00 tx=0x7f073000c5e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.637+0000 7f074aa92740 1 -- 172.21.15.17:0/3174707434 shutdown_connections 2024-09-13T16:00:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.637+0000 7f074aa92740 1 --2- 172.21.15.17:0/3174707434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646af76e650 0x5646af770b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.637+0000 7f074aa92740 1 --2- 172.21.15.17:0/3174707434 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af7695c0 0x5646af76e080 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.637+0000 7f074aa92740 1 --2- 172.21.15.17:0/3174707434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af768c80 0x5646af769080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.637+0000 7f074aa92740 1 -- 172.21.15.17:0/3174707434 >> 172.21.15.17:0/3174707434 conn(0x5646af7642f0 msgr2=0x5646af7646f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.637+0000 7f074aa92740 1 -- 172.21.15.17:0/3174707434 shutdown_connections 2024-09-13T16:00:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.637+0000 7f074aa92740 1 -- 172.21.15.17:0/3174707434 wait complete. 2024-09-13T16:00:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.638+0000 7f074aa92740 1 -- start start 2024-09-13T16:00:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.638+0000 7f074aa92740 1 Processor -- start 2024-09-13T16:00:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.640+0000 7f074aa92740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646af768c80 0x5646af7728e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.640+0000 7f074aa92740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af7695c0 0x5646af772e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.640+0000 7f074aa92740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af76e650 0x5646af779e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.640+0000 7f074aa92740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646af6cbaf0 con 0x5646af7695c0 2024-09-13T16:00:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.640+0000 7f074aa92740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646af689f20 con 0x5646af768c80 2024-09-13T16:00:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.640+0000 7f074aa92740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646af689bc0 con 0x5646af76e650 2024-09-13T16:00:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.640+0000 7f074aa92740 10 client.0 _ll_register_callbacks cb 0x5646af6bba70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:00:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.640+0000 7f0745200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646af768c80 0x5646af7728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.640+0000 7f073fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af7695c0 0x5646af772e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.641+0000 7f0745c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af76e650 0x5646af779e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.641+0000 7f073fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af7695c0 0x5646af772e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60358/0 (socket says 172.21.15.17:60358) 2024-09-13T16:00:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.641+0000 7f073fe00640 1 -- 172.21.15.17:0/2739590464 learned_addr learned my addr 172.21.15.17:0/2739590464 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.642+0000 7f0745c00640 1 -- 172.21.15.17:0/2739590464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646af768c80 msgr2=0x5646af7728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.642+0000 7f0745c00640 1 --2- 172.21.15.17:0/2739590464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646af768c80 0x5646af7728e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.642+0000 7f0745c00640 1 -- 172.21.15.17:0/2739590464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af7695c0 msgr2=0x5646af772e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.642+0000 7f0745c00640 1 --2- 172.21.15.17:0/2739590464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af7695c0 0x5646af772e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.642+0000 7f0745c00640 1 -- 172.21.15.17:0/2739590464 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0738009ba0 con 0x5646af76e650 2024-09-13T16:00:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.642+0000 7f0745c00640 1 --2- 172.21.15.17:0/2739590464 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af76e650 0x5646af779e60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0730010fa0 tx=0x7f0730004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63e95be64b7cf136 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.642+0000 7f072aa00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:00:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.643+0000 7f072aa00640 1 -- 172.21.15.17:0/2739590464 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073001f860 con 0x5646af76e650 2024-09-13T16:00:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.643+0000 7f072aa00640 1 -- 172.21.15.17:0/2739590464 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f073001f9c0 con 0x5646af76e650 2024-09-13T16:00:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.643+0000 7f074aa92740 1 -- 172.21.15.17:0/2739590464 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5646af6be7d0 con 0x5646af76e650 2024-09-13T16:00:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.643+0000 7f072aa00640 1 -- 172.21.15.17:0/2739590464 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f073001fbc0 con 0x5646af76e650 2024-09-13T16:00:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.643+0000 7f074aa92740 10 client.25639 fetch_fsmap learned FSMap version 30 2024-09-13T16:00:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.643+0000 7f074aa92740 1 -- 172.21.15.17:0/2739590464 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5646af6ca170 con 0x5646af76e650 2024-09-13T16:00:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.643+0000 7f072aa00640 1 -- 172.21.15.17:0/2739590464 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5646af6be7d0 con 0x5646af76e650 2024-09-13T16:00:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.644+0000 7f072aa00640 1 -- 172.21.15.17:0/2739590464 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) v1 ==== 7490+0+0 (secure 0 0 0) 0x7f07300113e0 con 0x5646af76e650 2024-09-13T16:00:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.644+0000 7f074aa92740 10 client.25639 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T16:00:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.644+0000 7f074aa92740 10 client.25639 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:00:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.644+0000 7f074aa92740 20 client.25639 populate_metadata read hostname 'smithi017' 2024-09-13T16:00:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.644+0000 7f074aa92740 1 --2- 172.21.15.17:0/2739590464 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5646af77e5a0 0x5646af7809c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.644+0000 7f074aa92740 4 client.25639 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:00:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.644+0000 7f074aa92740 1 -- 172.21.15.17:0/2739590464 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5646af3bf300 con 0x5646af77e5a0 2024-09-13T16:00:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.645+0000 7f0745200640 1 --2- 172.21.15.17:0/2739590464 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5646af77e5a0 0x5646af7809c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.645+0000 7f0745200640 1 --2- 172.21.15.17:0/2739590464 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5646af77e5a0 0x5646af7809c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e77b597d0880950 server_cookie=7d62796ba29b2614 in_seq=0 out_seq=0 2024-09-13T16:00:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.645+0000 7f072aa00640 10 client.25639 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:00:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.646+0000 7f072aa00640 1 -- 172.21.15.17:0/2739590464 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5646af3bf300 con 0x5646af77e5a0 2024-09-13T16:00:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.646+0000 7f072aa00640 10 client.25639 handle_command_reply: tid=0 2024-09-13T16:00:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.646+0000 7f074aa92740 1 client.25639 shutdown 2024-09-13T16:00:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.648+0000 7f074aa92740 1 -- 172.21.15.17:0/2739590464 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af76e650 msgr2=0x5646af779e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.648+0000 7f074aa92740 1 --2- 172.21.15.17:0/2739590464 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af76e650 0x5646af779e60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0730010fa0 tx=0x7f0730004730 comp rx=0 tx=0).stop 2024-09-13T16:00:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.648+0000 7f074aa92740 1 -- 172.21.15.17:0/2739590464 shutdown_connections 2024-09-13T16:00:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.648+0000 7f074aa92740 1 --2- 172.21.15.17:0/2739590464 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5646af77e5a0 0x5646af7809c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.648+0000 7f074aa92740 1 --2- 172.21.15.17:0/2739590464 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af76e650 0x5646af779e60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.648+0000 7f074aa92740 1 --2- 172.21.15.17:0/2739590464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af7695c0 0x5646af772e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.648+0000 7f074aa92740 1 --2- 172.21.15.17:0/2739590464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646af768c80 0x5646af7728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.648+0000 7f074aa92740 1 -- 172.21.15.17:0/2739590464 >> 172.21.15.17:0/2739590464 conn(0x5646af7642f0 msgr2=0x5646af765b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.648+0000 7f072aa00640 0 client.25639 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:00:58.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.649+0000 7f074aa92740 1 -- 172.21.15.17:0/2739590464 shutdown_connections 2024-09-13T16:00:58.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.649+0000 7f074aa92740 1 -- 172.21.15.17:0/2739590464 wait complete. 2024-09-13T16:00:58.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.649+0000 7f074aa92740 20 client.25639 trim_cache size 0 max 16384 2024-09-13T16:00:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.671+0000 7f074aa92740 1 Processor -- start 2024-09-13T16:00:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.671+0000 7f074aa92740 1 -- start start 2024-09-13T16:00:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.672+0000 7f074aa92740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af768c80 0x5646af76dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.672+0000 7f074aa92740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af7695c0 0x5646af779e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.672+0000 7f074aa92740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646af76e650 0x5646af76e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.672+0000 7f074aa92740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646af432e60 con 0x5646af768c80 2024-09-13T16:00:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.672+0000 7f074aa92740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646af772260 con 0x5646af76e650 2024-09-13T16:00:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.672+0000 7f074aa92740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646af769ad0 con 0x5646af7695c0 2024-09-13T16:00:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.672+0000 7f073fe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af7695c0 0x5646af779e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.672+0000 7f073fe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af7695c0 0x5646af779e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:46362/0 (socket says 172.21.15.17:46362) 2024-09-13T16:00:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.672+0000 7f073fe00640 1 -- 172.21.15.17:0/1978910550 learned_addr learned my addr 172.21.15.17:0/1978910550 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.672+0000 7f0745200640 1 --2- 172.21.15.17:0/1978910550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af768c80 0x5646af76dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.672+0000 7f0745c00640 1 --2- 172.21.15.17:0/1978910550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646af76e650 0x5646af76e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.673+0000 7f073fe00640 1 -- 172.21.15.17:0/1978910550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646af76e650 msgr2=0x5646af76e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.673+0000 7f073fe00640 1 --2- 172.21.15.17:0/1978910550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646af76e650 0x5646af76e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.673+0000 7f073fe00640 1 -- 172.21.15.17:0/1978910550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af768c80 msgr2=0x5646af76dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.673+0000 7f073fe00640 1 --2- 172.21.15.17:0/1978910550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af768c80 0x5646af76dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.673+0000 7f073fe00640 1 -- 172.21.15.17:0/1978910550 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646af66c180 con 0x5646af7695c0 2024-09-13T16:00:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.673+0000 7f0745200640 1 --2- 172.21.15.17:0/1978910550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af768c80 0x5646af76dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:00:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.673+0000 7f073fe00640 1 --2- 172.21.15.17:0/1978910550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af7695c0 0x5646af779e20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f072c0eb170 tx=0x7f072c0f3550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a6fa8d927b03345 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.673+0000 7f0736a00640 1 -- 172.21.15.17:0/1978910550 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c0ba290 con 0x5646af7695c0 2024-09-13T16:00:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.673+0000 7f0736a00640 1 -- 172.21.15.17:0/1978910550 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f072c0ba0b0 con 0x5646af7695c0 2024-09-13T16:00:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.673+0000 7f0736a00640 1 -- 172.21.15.17:0/1978910550 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c0be580 con 0x5646af7695c0 2024-09-13T16:00:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.674+0000 7f074aa92740 1 -- 172.21.15.17:0/1978910550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af7695c0 msgr2=0x5646af779e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.674+0000 7f074aa92740 1 --2- 172.21.15.17:0/1978910550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af7695c0 0x5646af779e20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f072c0eb170 tx=0x7f072c0f3550 comp rx=0 tx=0).stop 2024-09-13T16:00:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.674+0000 7f074aa92740 1 -- 172.21.15.17:0/1978910550 shutdown_connections 2024-09-13T16:00:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.674+0000 7f074aa92740 1 --2- 172.21.15.17:0/1978910550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646af76e650 0x5646af76e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.674+0000 7f074aa92740 1 --2- 172.21.15.17:0/1978910550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af7695c0 0x5646af779e20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.674+0000 7f074aa92740 1 --2- 172.21.15.17:0/1978910550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af768c80 0x5646af76dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.674+0000 7f074aa92740 1 -- 172.21.15.17:0/1978910550 >> 172.21.15.17:0/1978910550 conn(0x5646af7642f0 msgr2=0x5646af7646d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.675+0000 7f074aa92740 1 -- 172.21.15.17:0/1978910550 shutdown_connections 2024-09-13T16:00:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.675+0000 7f074aa92740 1 -- 172.21.15.17:0/1978910550 wait complete. 2024-09-13T16:00:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.675+0000 7f074aa92740 1 -- start start 2024-09-13T16:00:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.675+0000 7f074aa92740 1 Processor -- start 2024-09-13T16:00:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.676+0000 7f074aa92740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af768c80 0x5646af773fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.676+0000 7f074aa92740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646af7695c0 0x5646af774500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.677+0000 7f073fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646af7695c0 0x5646af774500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.677+0000 7f074aa92740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af76e650 0x5646af779280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:58.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.677+0000 7f0745200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af768c80 0x5646af773fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:58.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.678+0000 7f0745200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af768c80 0x5646af773fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:46374/0 (socket says 172.21.15.17:46374) 2024-09-13T16:00:58.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.678+0000 7f0745200640 1 -- 172.21.15.17:0/3137654961 learned_addr learned my addr 172.21.15.17:0/3137654961 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:00:58.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.678+0000 7f074aa92740 1 -- 172.21.15.17:0/3137654961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646af7797c0 con 0x5646af76e650 2024-09-13T16:00:58.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.678+0000 7f074aa92740 1 -- 172.21.15.17:0/3137654961 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646af779930 con 0x5646af7695c0 2024-09-13T16:00:58.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.678+0000 7f0745c00640 1 --2- 172.21.15.17:0/3137654961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af76e650 0x5646af779280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:58.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.678+0000 7f074aa92740 1 -- 172.21.15.17:0/3137654961 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646af779aa0 con 0x5646af768c80 2024-09-13T16:00:58.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.678+0000 7f074aa92740 10 client.0 _ll_register_callbacks cb 0x7f0738009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:00:58.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.679+0000 7f073fe00640 1 -- 172.21.15.17:0/3137654961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af768c80 msgr2=0x5646af773fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:58.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.679+0000 7f073fe00640 1 --2- 172.21.15.17:0/3137654961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af768c80 0x5646af773fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.679+0000 7f073fe00640 1 -- 172.21.15.17:0/3137654961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af76e650 msgr2=0x5646af779280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:00:58.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.679+0000 7f073fe00640 1 --2- 172.21.15.17:0/3137654961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af76e650 0x5646af779280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.679+0000 7f073fe00640 1 -- 172.21.15.17:0/3137654961 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0740195a70 con 0x5646af7695c0 2024-09-13T16:00:58.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.679+0000 7f0745200640 1 --2- 172.21.15.17:0/3137654961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af768c80 0x5646af773fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:00:58.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.679+0000 7f0745c00640 1 --2- 172.21.15.17:0/3137654961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af76e650 0x5646af779280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:00:58.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.679+0000 7f073fe00640 1 --2- 172.21.15.17:0/3137654961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646af7695c0 0x5646af774500 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x5646af772530 tx=0x7f072c0f3170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e82880dbd5aef68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:00:58.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.679+0000 7f072aa00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:00:58.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.680+0000 7f072aa00640 1 -- 172.21.15.17:0/3137654961 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c0ba290 con 0x5646af7695c0 2024-09-13T16:00:58.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.680+0000 7f072aa00640 1 -- 172.21.15.17:0/3137654961 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f072c031de0 con 0x5646af7695c0 2024-09-13T16:00:58.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.680+0000 7f074aa92740 1 -- 172.21.15.17:0/3137654961 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5646af6f5c90 con 0x5646af7695c0 2024-09-13T16:00:58.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.680+0000 7f072aa00640 1 -- 172.21.15.17:0/3137654961 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f072c0d30d0 con 0x5646af7695c0 2024-09-13T16:00:58.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.680+0000 7f074aa92740 10 client.25625 fetch_fsmap learned FSMap version 30 2024-09-13T16:00:58.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.680+0000 7f074aa92740 1 -- 172.21.15.17:0/3137654961 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5646af691560 con 0x5646af7695c0 2024-09-13T16:00:58.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.680+0000 7f072aa00640 1 -- 172.21.15.17:0/3137654961 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5646af6f5c90 con 0x5646af7695c0 2024-09-13T16:00:58.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.680+0000 7f072aa00640 1 -- 172.21.15.17:0/3137654961 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) v1 ==== 7490+0+0 (secure 0 0 0) 0x7f072c0f5040 con 0x5646af7695c0 2024-09-13T16:00:58.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.680+0000 7f074aa92740 10 client.25625 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T16:00:58.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.680+0000 7f074aa92740 10 client.25625 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:00:58.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.680+0000 7f074aa92740 20 client.25625 populate_metadata read hostname 'smithi017' 2024-09-13T16:00:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.680+0000 7f074aa92740 1 --2- 172.21.15.17:0/3137654961 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5646af7e6930 0x5646af7e8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:00:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.680+0000 7f074aa92740 4 client.25625 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:00:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.680+0000 7f074aa92740 1 -- 172.21.15.17:0/3137654961 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5646af3d0600 con 0x5646af7e6930 2024-09-13T16:00:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.682+0000 7f0745200640 1 --2- 172.21.15.17:0/3137654961 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5646af7e6930 0x5646af7e8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:00:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.683+0000 7f0745200640 1 --2- 172.21.15.17:0/3137654961 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5646af7e6930 0x5646af7e8d50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=410e26620bbc87a8 server_cookie=4eca73d5dfcd5547 in_seq=0 out_seq=0 2024-09-13T16:00:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.683+0000 7f072aa00640 10 client.25625 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:00:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.694+0000 7f072aa00640 1 -- 172.21.15.17:0/3137654961 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5646af3d0600 con 0x5646af7e6930 2024-09-13T16:00:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.695+0000 7f072aa00640 10 client.25625 handle_command_reply: tid=0 2024-09-13T16:00:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.695+0000 7f074aa92740 1 client.25625 shutdown 2024-09-13T16:00:58.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.695+0000 7f074aa92740 1 -- 172.21.15.17:0/3137654961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646af7695c0 msgr2=0x5646af774500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:58.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.695+0000 7f074aa92740 1 --2- 172.21.15.17:0/3137654961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646af7695c0 0x5646af774500 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x5646af772530 tx=0x7f072c0f3170 comp rx=0 tx=0).stop 2024-09-13T16:00:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.695+0000 7f074aa92740 1 -- 172.21.15.17:0/3137654961 shutdown_connections 2024-09-13T16:00:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.695+0000 7f074aa92740 1 --2- 172.21.15.17:0/3137654961 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5646af7e6930 0x5646af7e8d50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.695+0000 7f074aa92740 1 --2- 172.21.15.17:0/3137654961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646af76e650 0x5646af779280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.695+0000 7f074aa92740 1 --2- 172.21.15.17:0/3137654961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646af7695c0 0x5646af774500 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.695+0000 7f074aa92740 1 --2- 172.21.15.17:0/3137654961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646af768c80 0x5646af773fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.695+0000 7f074aa92740 1 -- 172.21.15.17:0/3137654961 >> 172.21.15.17:0/3137654961 conn(0x5646af7642f0 msgr2=0x5646af76a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.695+0000 7f072aa00640 0 client.25625 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:00:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.696+0000 7f074aa92740 1 -- 172.21.15.17:0/3137654961 shutdown_connections 2024-09-13T16:00:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.696+0000 7f074aa92740 1 -- 172.21.15.17:0/3137654961 wait complete. 2024-09-13T16:00:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.696+0000 7f074aa92740 20 client.25625 trim_cache size 0 max 16384 2024-09-13T16:00:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:00:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:00:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:00:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:00:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.697+0000 7f0746600640 1 -- 172.21.15.17:0/2741930764 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f07240a12f0 msgr2=0x7f07240a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.697+0000 7f0746600640 1 --2- 172.21.15.17:0/2741930764 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f07240a12f0 0x7f07240a37b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f073000cc00 tx=0x7f073000c5e0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.697+0000 7f0746600640 1 -- 172.21.15.17:0/2741930764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0740102f10 msgr2=0x7f0740193d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:00:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.697+0000 7f0746600640 1 --2- 172.21.15.17:0/2741930764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0740102f10 0x7f0740193d30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f072c009230 tx=0x7f072c003b70 comp rx=0 tx=0).stop 2024-09-13T16:00:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.697+0000 7f0746600640 1 -- 172.21.15.17:0/2741930764 shutdown_connections 2024-09-13T16:00:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.697+0000 7f0746600640 1 --2- 172.21.15.17:0/2741930764 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f07240a12f0 0x7f07240a37b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.697+0000 7f0746600640 1 --2- 172.21.15.17:0/2741930764 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0740105920 0x7f07401a3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.697+0000 7f0746600640 1 --2- 172.21.15.17:0/2741930764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0740102f10 0x7f0740193d30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.697+0000 7f0746600640 1 --2- 172.21.15.17:0/2741930764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07401005e0 0x7f07401937f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:00:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.697+0000 7f0746600640 1 -- 172.21.15.17:0/2741930764 >> 172.21.15.17:0/2741930764 conn(0x7f07400fa1c0 msgr2=0x7f07400ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:00:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.697+0000 7f0746600640 1 -- 172.21.15.17:0/2741930764 shutdown_connections 2024-09-13T16:00:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:00:58.698+0000 7f0746600640 1 -- 172.21.15.17:0/2741930764 wait complete. 2024-09-13T16:00:58.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:00:58 smithi193 ceph-mon[35248]: pgmap v482: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.9 MiB/s wr, 591 op/s 2024-09-13T16:00:58.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:00:58 smithi017 ceph-mon[30494]: pgmap v482: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.9 MiB/s wr, 591 op/s 2024-09-13T16:00:58.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:00:58 smithi189 ceph-mon[34790]: pgmap v482: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.9 MiB/s wr, 591 op/s 2024-09-13T16:01:00.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 195.0 s, 1512.4 tps, lat 65.813 ms stddev 74.774 2024-09-13T16:01:00.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:00 smithi193 ceph-mon[35248]: pgmap v483: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.9 MiB/s wr, 640 op/s 2024-09-13T16:01:00.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:00 smithi017 ceph-mon[30494]: pgmap v483: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.9 MiB/s wr, 640 op/s 2024-09-13T16:01:00.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:00 smithi189 ceph-mon[34790]: pgmap v483: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.9 MiB/s wr, 640 op/s 2024-09-13T16:01:02.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:02 smithi193 ceph-mon[35248]: pgmap v484: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.3 MiB/s wr, 582 op/s 2024-09-13T16:01:02.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:02 smithi017 ceph-mon[30494]: pgmap v484: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.3 MiB/s wr, 582 op/s 2024-09-13T16:01:02.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:02 smithi189 ceph-mon[34790]: pgmap v484: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.3 MiB/s wr, 582 op/s 2024-09-13T16:01:04.625 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:04 smithi017 ceph-mon[30494]: pgmap v485: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.3 MiB/s wr, 591 op/s 2024-09-13T16:01:04.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:04 smithi193 ceph-mon[35248]: pgmap v485: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.3 MiB/s wr, 591 op/s 2024-09-13T16:01:04.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:04 smithi189 ceph-mon[34790]: pgmap v485: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.3 MiB/s wr, 591 op/s 2024-09-13T16:01:05.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 200.0 s, 837.6 tps, lat 116.022 ms stddev 177.864 2024-09-13T16:01:06.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:06 smithi193 ceph-mon[35248]: pgmap v486: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.3 MiB/s wr, 776 op/s 2024-09-13T16:01:06.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:06 smithi017 ceph-mon[30494]: pgmap v486: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.3 MiB/s wr, 776 op/s 2024-09-13T16:01:06.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:06 smithi189 ceph-mon[34790]: pgmap v486: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.3 MiB/s wr, 776 op/s 2024-09-13T16:01:08.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:08 smithi193 ceph-mon[35248]: pgmap v487: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 730 op/s 2024-09-13T16:01:08.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:08 smithi017 ceph-mon[30494]: pgmap v487: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 730 op/s 2024-09-13T16:01:08.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:08 smithi189 ceph-mon[34790]: pgmap v487: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 730 op/s 2024-09-13T16:01:10.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 205.0 s, 782.4 tps, lat 129.379 ms stddev 195.109 2024-09-13T16:01:10.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:10 smithi193 ceph-mon[35248]: pgmap v488: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 MiB/s wr, 899 op/s 2024-09-13T16:01:10.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:10 smithi017 ceph-mon[30494]: pgmap v488: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 MiB/s wr, 899 op/s 2024-09-13T16:01:10.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:10 smithi189 ceph-mon[34790]: pgmap v488: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 MiB/s wr, 899 op/s 2024-09-13T16:01:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.885+0000 7fb427200640 1 -- 172.21.15.17:0/3569613981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb428070f40 msgr2=0x7fb428071320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.885+0000 7fb427200640 1 --2- 172.21.15.17:0/3569613981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb428070f40 0x7fb428071320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb410009900 tx=0x7fb41002a440 comp rx=0 tx=0).stop 2024-09-13T16:01:11.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.887+0000 7fb427200640 1 -- 172.21.15.17:0/3569613981 shutdown_connections 2024-09-13T16:01:11.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.887+0000 7fb427200640 1 --2- 172.21.15.17:0/3569613981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb42810bdc0 0x7fb42810e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.887+0000 7fb427200640 1 --2- 172.21.15.17:0/3569613981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb428071860 0x7fb42810b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.887+0000 7fb427200640 1 --2- 172.21.15.17:0/3569613981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb428070f40 0x7fb428071320 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.887+0000 7fb427200640 1 -- 172.21.15.17:0/3569613981 >> 172.21.15.17:0/3569613981 conn(0x7fb42806cd10 msgr2=0x7fb42806f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:11.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.887+0000 7fb427200640 1 -- 172.21.15.17:0/3569613981 shutdown_connections 2024-09-13T16:01:11.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.887+0000 7fb427200640 1 -- 172.21.15.17:0/3569613981 wait complete. 2024-09-13T16:01:11.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.889+0000 7fb427200640 1 Processor -- start 2024-09-13T16:01:11.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.889+0000 7fb427200640 1 -- start start 2024-09-13T16:01:11.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.889+0000 7fb427200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb428070f40 0x7fb4281a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.889+0000 7fb427200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb428071860 0x7fb4281a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.889+0000 7fb427200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb42810bdc0 0x7fb4281ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.889+0000 7fb427200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4281ac590 con 0x7fb42810bdc0 2024-09-13T16:01:11.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.889+0000 7fb427200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42810ec10 con 0x7fb428071860 2024-09-13T16:01:11.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.889+0000 7fb427200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42810edd0 con 0x7fb428070f40 2024-09-13T16:01:11.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.890+0000 7fb426800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb42810bdc0 0x7fb4281ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.890+0000 7fb425e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb428070f40 0x7fb4281a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.890+0000 7fb425e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb428070f40 0x7fb4281a4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:54682/0 (socket says 172.21.15.17:54682) 2024-09-13T16:01:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.890+0000 7fb425e00640 1 -- 172.21.15.17:0/2583377587 learned_addr learned my addr 172.21.15.17:0/2583377587 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:01:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.890+0000 7fb425400640 1 --2- 172.21.15.17:0/2583377587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb428071860 0x7fb4281a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.891+0000 7fb425400640 1 -- 172.21.15.17:0/2583377587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb428070f40 msgr2=0x7fb4281a4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.891+0000 7fb425400640 1 --2- 172.21.15.17:0/2583377587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb428070f40 0x7fb4281a4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.891+0000 7fb425400640 1 -- 172.21.15.17:0/2583377587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb42810bdc0 msgr2=0x7fb4281ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.891+0000 7fb425400640 1 --2- 172.21.15.17:0/2583377587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb42810bdc0 0x7fb4281ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.891+0000 7fb425400640 1 -- 172.21.15.17:0/2583377587 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb410009560 con 0x7fb428071860 2024-09-13T16:01:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.891+0000 7fb425e00640 1 --2- 172.21.15.17:0/2583377587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb428070f40 0x7fb4281a4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:01:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.891+0000 7fb425400640 1 --2- 172.21.15.17:0/2583377587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb428071860 0x7fb4281a4fe0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb41800b3c0 tx=0x7fb41800b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.891+0000 7fb41ea00640 1 -- 172.21.15.17:0/2583377587 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb418011830 con 0x7fb428071860 2024-09-13T16:01:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.891+0000 7fb41ea00640 1 -- 172.21.15.17:0/2583377587 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb418011e50 con 0x7fb428071860 2024-09-13T16:01:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.891+0000 7fb41ea00640 1 -- 172.21.15.17:0/2583377587 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41800f2e0 con 0x7fb428071860 2024-09-13T16:01:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.892+0000 7fb427200640 1 -- 172.21.15.17:0/2583377587 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42810f0b0 con 0x7fb428071860 2024-09-13T16:01:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.892+0000 7fb427200640 1 -- 172.21.15.17:0/2583377587 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42810f5f0 con 0x7fb428071860 2024-09-13T16:01:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.897+0000 7fb42fc53740 1 Processor -- start 2024-09-13T16:01:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.897+0000 7fb42fc53740 1 -- start start 2024-09-13T16:01:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.897+0000 7fb42fc53740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563856311c80 0x563856312080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.898+0000 7fb42fc53740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638563125c0 0x563856317080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.898+0000 7fb41ea00640 1 -- 172.21.15.17:0/2583377587 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb4180105a0 con 0x7fb428071860 2024-09-13T16:01:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.898+0000 7fb426800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563856311c80 0x563856312080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.898+0000 7fb426800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563856311c80 0x563856312080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:54688/0 (socket says 172.21.15.17:54688) 2024-09-13T16:01:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.898+0000 7fb42fc53740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 0x563856319b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.898+0000 7fb42fc53740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56385621dbb0 con 0x5638563125c0 2024-09-13T16:01:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.898+0000 7fb42fc53740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x56385627ba70 con 0x563856317650 2024-09-13T16:01:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.898+0000 7fb42fc53740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x563856279200 con 0x563856311c80 2024-09-13T16:01:11.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.898+0000 7fb426800640 1 -- 172.21.15.17:0/1558294788 learned_addr learned my addr 172.21.15.17:0/1558294788 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:01:11.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.899+0000 7fb425400640 1 --2- 172.21.15.17:0/1558294788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 0x563856319b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.900+0000 7fb426800640 1 -- 172.21.15.17:0/1558294788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 msgr2=0x563856319b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.900+0000 7fb426800640 1 --2- 172.21.15.17:0/1558294788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 0x563856319b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.900+0000 7fb426800640 1 -- 172.21.15.17:0/1558294788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638563125c0 msgr2=0x563856317080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.900+0000 7fb426800640 1 --2- 172.21.15.17:0/1558294788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638563125c0 0x563856317080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.900+0000 7fb426800640 1 -- 172.21.15.17:0/1558294788 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563856216940 con 0x563856311c80 2024-09-13T16:01:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.900+0000 7fb425400640 1 --2- 172.21.15.17:0/1558294788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 0x563856319b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.900+0000 7fb426800640 1 --2- 172.21.15.17:0/1558294788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563856311c80 0x563856312080 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb42000b500 tx=0x7fb420009630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df46749e980e887a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.901+0000 7fb417400640 1 -- 172.21.15.17:0/1558294788 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb420010040 con 0x563856311c80 2024-09-13T16:01:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.901+0000 7fb417400640 1 -- 172.21.15.17:0/1558294788 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb42000ae30 con 0x563856311c80 2024-09-13T16:01:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.901+0000 7fb417400640 1 -- 172.21.15.17:0/1558294788 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb420013380 con 0x563856311c80 2024-09-13T16:01:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.901+0000 7fb41ea00640 1 --2- 172.21.15.17:0/2583377587 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb40c0a1280 0x7fb40c0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.901+0000 7fb41ea00640 1 -- 172.21.15.17:0/2583377587 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fb4180cc330 con 0x7fb428071860 2024-09-13T16:01:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.902+0000 7fb42fc53740 1 -- 172.21.15.17:0/1558294788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563856311c80 msgr2=0x563856312080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.902+0000 7fb42fc53740 1 --2- 172.21.15.17:0/1558294788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563856311c80 0x563856312080 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb42000b500 tx=0x7fb420009630 comp rx=0 tx=0).stop 2024-09-13T16:01:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.902+0000 7fb42fc53740 1 -- 172.21.15.17:0/1558294788 shutdown_connections 2024-09-13T16:01:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.902+0000 7fb42fc53740 1 --2- 172.21.15.17:0/1558294788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 0x563856319b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.903+0000 7fb42fc53740 1 --2- 172.21.15.17:0/1558294788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638563125c0 0x563856317080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.903+0000 7fb42fc53740 1 --2- 172.21.15.17:0/1558294788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563856311c80 0x563856312080 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.903+0000 7fb42fc53740 1 -- 172.21.15.17:0/1558294788 >> 172.21.15.17:0/1558294788 conn(0x56385630d2f0 msgr2=0x56385630d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.903+0000 7fb42fc53740 1 -- 172.21.15.17:0/1558294788 shutdown_connections 2024-09-13T16:01:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.903+0000 7fb42fc53740 1 -- 172.21.15.17:0/1558294788 wait complete. 2024-09-13T16:01:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.903+0000 7fb425e00640 1 --2- 172.21.15.17:0/2583377587 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb40c0a1280 0x7fb40c0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.904+0000 7fb42fc53740 1 -- start start 2024-09-13T16:01:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.904+0000 7fb42fc53740 1 Processor -- start 2024-09-13T16:01:11.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.905+0000 7fb42fc53740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563856311c80 0x56385631b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.905+0000 7fb42fc53740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638563125c0 0x56385631bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.905+0000 7fb42fc53740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 0x563856322e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.905+0000 7fb42fc53740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563856274af0 con 0x563856311c80 2024-09-13T16:01:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.905+0000 7fb42fc53740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x563856232f20 con 0x563856317650 2024-09-13T16:01:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.905+0000 7fb42fc53740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x563856232bc0 con 0x5638563125c0 2024-09-13T16:01:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.905+0000 7fb425400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638563125c0 0x56385631bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.905+0000 7fb425400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638563125c0 0x56385631bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:54696/0 (socket says 172.21.15.17:54696) 2024-09-13T16:01:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.905+0000 7fb425400640 1 -- 172.21.15.17:0/3603993375 learned_addr learned my addr 172.21.15.17:0/3603993375 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:01:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.905+0000 7fb42fc53740 10 client.0 _ll_register_callbacks cb 0x563856264a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:01:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.905+0000 7fb426800640 1 --2- 172.21.15.17:0/3603993375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 0x563856322e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.906+0000 7fb425400640 1 -- 172.21.15.17:0/3603993375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 msgr2=0x563856322e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.906+0000 7fb425400640 1 --2- 172.21.15.17:0/3603993375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 0x563856322e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.906+0000 7fb425400640 1 -- 172.21.15.17:0/3603993375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563856311c80 msgr2=0x56385631b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:01:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.907+0000 7fb425e00640 1 --2- 172.21.15.17:0/3603993375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563856311c80 0x56385631b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.907+0000 7fb425400640 1 --2- 172.21.15.17:0/3603993375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563856311c80 0x56385631b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.907+0000 7fb425400640 1 -- 172.21.15.17:0/3603993375 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb420009ce0 con 0x5638563125c0 2024-09-13T16:01:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.907+0000 7fb426800640 1 --2- 172.21.15.17:0/3603993375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 0x563856322e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.907+0000 7fb425e00640 1 --2- 172.21.15.17:0/3603993375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563856311c80 0x56385631b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:11.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.908+0000 7fb425400640 1 --2- 172.21.15.17:0/3603993375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638563125c0 0x56385631bed0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb4180a1320 tx=0x7fb418010f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40f23b223a48c70b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:11.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.908+0000 7fb425e00640 1 --2- 172.21.15.17:0/2583377587 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb40c0a1280 0x7fb40c0a3740 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x563856312ff0 tx=0x7fb410003980 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:11.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.909+0000 7fb40be00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:01:11.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.910+0000 7fb40be00640 1 -- 172.21.15.17:0/3603993375 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4180cc170 con 0x5638563125c0 2024-09-13T16:01:11.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.910+0000 7fb40be00640 1 -- 172.21.15.17:0/3603993375 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fb418099ad0 con 0x5638563125c0 2024-09-13T16:01:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.910+0000 7fb42fc53740 1 -- 172.21.15.17:0/3603993375 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56385629ec90 con 0x5638563125c0 2024-09-13T16:01:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.910+0000 7fb40be00640 1 -- 172.21.15.17:0/3603993375 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4180cf7e0 con 0x5638563125c0 2024-09-13T16:01:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.910+0000 7fb42fc53740 10 client.25654 fetch_fsmap learned FSMap version 30 2024-09-13T16:01:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.910+0000 7fb42fc53740 1 -- 172.21.15.17:0/3603993375 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x563856273170 con 0x5638563125c0 2024-09-13T16:01:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.911+0000 7fb40be00640 1 -- 172.21.15.17:0/3603993375 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56385629ec90 con 0x5638563125c0 2024-09-13T16:01:11.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.911+0000 7fb40be00640 1 -- 172.21.15.17:0/3603993375 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) v1 ==== 7490+0+0 (secure 0 0 0) 0x7fb418095ae0 con 0x5638563125c0 2024-09-13T16:01:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.914+0000 7fb42fc53740 10 client.25654 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T16:01:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.914+0000 7fb42fc53740 10 client.25654 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:01:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.914+0000 7fb42fc53740 20 client.25654 populate_metadata read hostname 'smithi017' 2024-09-13T16:01:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.914+0000 7fb42fc53740 1 --2- 172.21.15.17:0/3603993375 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x563856327510 0x563856329930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.914+0000 7fb42fc53740 4 client.25654 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:01:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.914+0000 7fb42fc53740 1 -- 172.21.15.17:0/3603993375 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5638562677d0 con 0x563856327510 2024-09-13T16:01:11.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.915+0000 7fb425e00640 1 --2- 172.21.15.17:0/3603993375 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x563856327510 0x563856329930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:11.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.916+0000 7fb425e00640 1 --2- 172.21.15.17:0/3603993375 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x563856327510 0x563856329930 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62455fde681dfd37 server_cookie=da6238cae377bc2d in_seq=0 out_seq=0 2024-09-13T16:01:11.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.916+0000 7fb40be00640 10 client.25654 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:01:11.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.917+0000 7fb40be00640 1 -- 172.21.15.17:0/3603993375 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5638562677d0 con 0x563856327510 2024-09-13T16:01:11.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.917+0000 7fb40be00640 10 client.25654 handle_command_reply: tid=0 2024-09-13T16:01:11.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.917+0000 7fb42fc53740 1 client.25654 shutdown 2024-09-13T16:01:11.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.917+0000 7fb42fc53740 1 -- 172.21.15.17:0/3603993375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638563125c0 msgr2=0x56385631bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:11.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.918+0000 7fb42fc53740 1 --2- 172.21.15.17:0/3603993375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638563125c0 0x56385631bed0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb4180a1320 tx=0x7fb418010f00 comp rx=0 tx=0).stop 2024-09-13T16:01:11.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.918+0000 7fb42fc53740 1 -- 172.21.15.17:0/3603993375 shutdown_connections 2024-09-13T16:01:11.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.918+0000 7fb42fc53740 1 --2- 172.21.15.17:0/3603993375 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x563856327510 0x563856329930 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.918+0000 7fb42fc53740 1 --2- 172.21.15.17:0/3603993375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 0x563856322e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.918+0000 7fb42fc53740 1 --2- 172.21.15.17:0/3603993375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638563125c0 0x56385631bed0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.918+0000 7fb40be00640 0 client.25654 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:01:11.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.918+0000 7fb42fc53740 1 --2- 172.21.15.17:0/3603993375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563856311c80 0x56385631b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.918+0000 7fb42fc53740 1 -- 172.21.15.17:0/3603993375 >> 172.21.15.17:0/3603993375 conn(0x56385630d2f0 msgr2=0x56385630c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:11.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.918+0000 7fb42fc53740 1 -- 172.21.15.17:0/3603993375 shutdown_connections 2024-09-13T16:01:11.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.918+0000 7fb42fc53740 1 -- 172.21.15.17:0/3603993375 wait complete. 2024-09-13T16:01:11.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.919+0000 7fb42fc53740 20 client.25654 trim_cache size 0 max 16384 2024-09-13T16:01:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.937+0000 7fb42fc53740 1 Processor -- start 2024-09-13T16:01:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.938+0000 7fb42fc53740 1 -- start start 2024-09-13T16:01:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.938+0000 7fb42fc53740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563856311c80 0x56385630e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.938+0000 7fb42fc53740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638563125c0 0x563856322e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.938+0000 7fb42fc53740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 0x56385630ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.938+0000 7fb42fc53740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563855fdbe60 con 0x563856311c80 2024-09-13T16:01:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.938+0000 7fb42fc53740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638563270b0 con 0x563856317650 2024-09-13T16:01:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.938+0000 7fb42fc53740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x56385631b4d0 con 0x5638563125c0 2024-09-13T16:01:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.938+0000 7fb425400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638563125c0 0x563856322e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.938+0000 7fb425400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638563125c0 0x563856322e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:54712/0 (socket says 172.21.15.17:54712) 2024-09-13T16:01:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.938+0000 7fb425400640 1 -- 172.21.15.17:0/2182708723 learned_addr learned my addr 172.21.15.17:0/2182708723 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:01:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.939+0000 7fb425e00640 1 --2- 172.21.15.17:0/2182708723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563856311c80 0x56385630e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.939+0000 7fb426800640 1 --2- 172.21.15.17:0/2182708723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 0x56385630ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.939+0000 7fb425400640 1 -- 172.21.15.17:0/2182708723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 msgr2=0x56385630ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.939+0000 7fb425400640 1 --2- 172.21.15.17:0/2182708723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 0x56385630ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.939+0000 7fb425400640 1 -- 172.21.15.17:0/2182708723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563856311c80 msgr2=0x56385630e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.939+0000 7fb425400640 1 --2- 172.21.15.17:0/2182708723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563856311c80 0x56385630e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.939+0000 7fb425400640 1 -- 172.21.15.17:0/2182708723 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563856215180 con 0x5638563125c0 2024-09-13T16:01:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.939+0000 7fb425400640 1 --2- 172.21.15.17:0/2182708723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638563125c0 0x563856322e30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb4180990d0 tx=0x7fb4180047d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfb5e7dd403ed47d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.939+0000 7fb417e00640 1 -- 172.21.15.17:0/2182708723 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4180cf7e0 con 0x5638563125c0 2024-09-13T16:01:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.940+0000 7fb417e00640 1 -- 172.21.15.17:0/2182708723 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb41800d040 con 0x5638563125c0 2024-09-13T16:01:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.940+0000 7fb417e00640 1 -- 172.21.15.17:0/2182708723 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4180cc170 con 0x5638563125c0 2024-09-13T16:01:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.940+0000 7fb42fc53740 1 -- 172.21.15.17:0/2182708723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638563125c0 msgr2=0x563856322e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.940+0000 7fb42fc53740 1 --2- 172.21.15.17:0/2182708723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638563125c0 0x563856322e30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb4180990d0 tx=0x7fb4180047d0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.941+0000 7fb42fc53740 1 -- 172.21.15.17:0/2182708723 shutdown_connections 2024-09-13T16:01:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.941+0000 7fb42fc53740 1 --2- 172.21.15.17:0/2182708723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 0x56385630ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.941+0000 7fb42fc53740 1 --2- 172.21.15.17:0/2182708723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638563125c0 0x563856322e30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.941+0000 7fb42fc53740 1 --2- 172.21.15.17:0/2182708723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563856311c80 0x56385630e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.941+0000 7fb42fc53740 1 -- 172.21.15.17:0/2182708723 >> 172.21.15.17:0/2182708723 conn(0x56385630d2f0 msgr2=0x5638563135e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.941+0000 7fb42fc53740 1 -- 172.21.15.17:0/2182708723 shutdown_connections 2024-09-13T16:01:11.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.941+0000 7fb42fc53740 1 -- 172.21.15.17:0/2182708723 wait complete. 2024-09-13T16:01:11.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.941+0000 7fb42fc53740 1 -- start start 2024-09-13T16:01:11.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.941+0000 7fb42fc53740 1 Processor -- start 2024-09-13T16:01:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.942+0000 7fb42fc53740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563856311c80 0x563856322810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.942+0000 7fb42fc53740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638563125c0 0x563856322d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.942+0000 7fb42fc53740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 0x56385631f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.942+0000 7fb42fc53740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56385631f9f0 con 0x563856311c80 2024-09-13T16:01:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.942+0000 7fb42fc53740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x56385631fb60 con 0x563856317650 2024-09-13T16:01:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.942+0000 7fb42fc53740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x56385631fd20 con 0x5638563125c0 2024-09-13T16:01:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.942+0000 7fb42fc53740 10 client.0 _ll_register_callbacks cb 0x7fb420009ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:01:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.942+0000 7fb425400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638563125c0 0x563856322d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.942+0000 7fb426800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 0x56385631f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.942+0000 7fb426800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 0x56385631f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:38852/0 (socket says 172.21.15.17:38852) 2024-09-13T16:01:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.942+0000 7fb426800640 1 -- 172.21.15.17:0/835615713 learned_addr learned my addr 172.21.15.17:0/835615713 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:01:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.942+0000 7fb425400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638563125c0 0x563856322d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:54714/0 (socket says 172.21.15.17:54714) 2024-09-13T16:01:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.942+0000 7fb425e00640 1 --2- 172.21.15.17:0/835615713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563856311c80 0x563856322810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.943+0000 7fb425400640 1 -- 172.21.15.17:0/835615713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 msgr2=0x56385631f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.943+0000 7fb425400640 1 --2- 172.21.15.17:0/835615713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 0x56385631f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.943+0000 7fb425400640 1 -- 172.21.15.17:0/835615713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563856311c80 msgr2=0x563856322810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.943+0000 7fb425400640 1 --2- 172.21.15.17:0/835615713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563856311c80 0x563856322810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.943+0000 7fb425400640 1 -- 172.21.15.17:0/835615713 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563856273170 con 0x5638563125c0 2024-09-13T16:01:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.943+0000 7fb426800640 1 --2- 172.21.15.17:0/835615713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 0x56385631f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:01:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.943+0000 7fb425400640 1 --2- 172.21.15.17:0/835615713 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638563125c0 0x563856322d50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb4180109e0 tx=0x7fb41800beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3decf8d42a0d138 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:11.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.943+0000 7fb40be00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:01:11.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.943+0000 7fb40be00640 1 -- 172.21.15.17:0/835615713 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4180cc170 con 0x5638563125c0 2024-09-13T16:01:11.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.943+0000 7fb40be00640 1 -- 172.21.15.17:0/835615713 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fb418099ad0 con 0x5638563125c0 2024-09-13T16:01:11.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.944+0000 7fb42fc53740 1 -- 172.21.15.17:0/835615713 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb42000ae30 con 0x5638563125c0 2024-09-13T16:01:11.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.944+0000 7fb40be00640 1 -- 172.21.15.17:0/835615713 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4180a15d0 con 0x5638563125c0 2024-09-13T16:01:11.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.944+0000 7fb42fc53740 10 client.25660 fetch_fsmap learned FSMap version 30 2024-09-13T16:01:11.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.944+0000 7fb42fc53740 1 -- 172.21.15.17:0/835615713 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x56385623a560 con 0x5638563125c0 2024-09-13T16:01:11.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.944+0000 7fb40be00640 1 -- 172.21.15.17:0/835615713 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb42000ae30 con 0x5638563125c0 2024-09-13T16:01:11.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.944+0000 7fb40be00640 1 -- 172.21.15.17:0/835615713 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) v1 ==== 7490+0+0 (secure 0 0 0) 0x7fb4180b7060 con 0x5638563125c0 2024-09-13T16:01:11.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.944+0000 7fb42fc53740 10 client.25660 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T16:01:11.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.944+0000 7fb42fc53740 10 client.25660 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:01:11.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.944+0000 7fb42fc53740 20 client.25660 populate_metadata read hostname 'smithi017' 2024-09-13T16:01:11.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.945+0000 7fb42fc53740 1 --2- 172.21.15.17:0/835615713 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56385637eb00 0x563856380ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:11.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.945+0000 7fb42fc53740 4 client.25660 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:01:11.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.945+0000 7fb42fc53740 1 -- 172.21.15.17:0/835615713 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563855f68300 con 0x56385637eb00 2024-09-13T16:01:11.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.946+0000 7fb425e00640 1 --2- 172.21.15.17:0/835615713 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56385637eb00 0x563856380ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:11.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.949+0000 7fb40be00640 10 client.25660 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:01:11.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.949+0000 7fb425e00640 1 --2- 172.21.15.17:0/835615713 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56385637eb00 0x563856380ef0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a49d1fa47c9f0918 server_cookie=dd20f239c77d2614 in_seq=0 out_seq=0 2024-09-13T16:01:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.957+0000 7fb40be00640 1 -- 172.21.15.17:0/835615713 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563855f68300 con 0x56385637eb00 2024-09-13T16:01:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.957+0000 7fb40be00640 10 client.25660 handle_command_reply: tid=0 2024-09-13T16:01:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.957+0000 7fb42fc53740 1 client.25660 shutdown 2024-09-13T16:01:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.957+0000 7fb42fc53740 1 -- 172.21.15.17:0/835615713 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638563125c0 msgr2=0x563856322d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.957+0000 7fb42fc53740 1 --2- 172.21.15.17:0/835615713 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638563125c0 0x563856322d50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb4180109e0 tx=0x7fb41800beb0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.957+0000 7fb42fc53740 1 -- 172.21.15.17:0/835615713 shutdown_connections 2024-09-13T16:01:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.957+0000 7fb42fc53740 1 --2- 172.21.15.17:0/835615713 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56385637eb00 0x563856380ef0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.957+0000 7fb42fc53740 1 --2- 172.21.15.17:0/835615713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563856317650 0x56385631f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.957+0000 7fb42fc53740 1 --2- 172.21.15.17:0/835615713 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638563125c0 0x563856322d50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.957+0000 7fb42fc53740 1 --2- 172.21.15.17:0/835615713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563856311c80 0x563856322810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.957+0000 7fb40be00640 0 client.25660 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:01:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.957+0000 7fb42fc53740 1 -- 172.21.15.17:0/835615713 >> 172.21.15.17:0/835615713 conn(0x56385630d2f0 msgr2=0x56385631b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.958+0000 7fb42fc53740 1 -- 172.21.15.17:0/835615713 shutdown_connections 2024-09-13T16:01:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.958+0000 7fb42fc53740 1 -- 172.21.15.17:0/835615713 wait complete. 2024-09-13T16:01:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.958+0000 7fb42fc53740 20 client.25660 trim_cache size 0 max 16384 2024-09-13T16:01:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:01:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:01:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:01:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:01:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.959+0000 7fb427200640 1 -- 172.21.15.17:0/2583377587 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb40c0a1280 msgr2=0x7fb40c0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.959+0000 7fb427200640 1 --2- 172.21.15.17:0/2583377587 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb40c0a1280 0x7fb40c0a3740 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x563856312ff0 tx=0x7fb410003980 comp rx=0 tx=0).stop 2024-09-13T16:01:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.959+0000 7fb427200640 1 -- 172.21.15.17:0/2583377587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb428071860 msgr2=0x7fb4281a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.959+0000 7fb427200640 1 --2- 172.21.15.17:0/2583377587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb428071860 0x7fb4281a4fe0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb41800b3c0 tx=0x7fb41800b880 comp rx=0 tx=0).stop 2024-09-13T16:01:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.959+0000 7fb427200640 1 -- 172.21.15.17:0/2583377587 shutdown_connections 2024-09-13T16:01:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.959+0000 7fb427200640 1 --2- 172.21.15.17:0/2583377587 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb40c0a1280 0x7fb40c0a3740 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.959+0000 7fb427200640 1 --2- 172.21.15.17:0/2583377587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb42810bdc0 0x7fb4281ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.959+0000 7fb427200640 1 --2- 172.21.15.17:0/2583377587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb428071860 0x7fb4281a4fe0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.959+0000 7fb427200640 1 --2- 172.21.15.17:0/2583377587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb428070f40 0x7fb4281a4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.959+0000 7fb427200640 1 -- 172.21.15.17:0/2583377587 >> 172.21.15.17:0/2583377587 conn(0x7fb42806cd10 msgr2=0x7fb42806d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.960+0000 7fb427200640 1 -- 172.21.15.17:0/2583377587 shutdown_connections 2024-09-13T16:01:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:11.960+0000 7fb427200640 1 -- 172.21.15.17:0/2583377587 wait complete. 2024-09-13T16:01:12.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:12 smithi193 ceph-mon[35248]: pgmap v489: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 816 op/s 2024-09-13T16:01:12.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:12 smithi017 ceph-mon[30494]: pgmap v489: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 816 op/s 2024-09-13T16:01:12.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:12 smithi189 ceph-mon[34790]: pgmap v489: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 816 op/s 2024-09-13T16:01:14.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:14 smithi193 ceph-mon[35248]: pgmap v490: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 13 MiB/s wr, 839 op/s 2024-09-13T16:01:14.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:14 smithi017 ceph-mon[30494]: pgmap v490: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 13 MiB/s wr, 839 op/s 2024-09-13T16:01:14.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:14 smithi189 ceph-mon[34790]: pgmap v490: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 13 MiB/s wr, 839 op/s 2024-09-13T16:01:15.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 210.0 s, 1239.1 tps, lat 82.290 ms stddev 112.523 2024-09-13T16:01:16.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:16 smithi193 ceph-mon[35248]: pgmap v491: 129 pgs: 129 active+clean; 1.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 875 op/s 2024-09-13T16:01:16.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:16 smithi017 ceph-mon[30494]: pgmap v491: 129 pgs: 129 active+clean; 1.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 875 op/s 2024-09-13T16:01:16.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:16 smithi189 ceph-mon[34790]: pgmap v491: 129 pgs: 129 active+clean; 1.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 875 op/s 2024-09-13T16:01:18.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:18 smithi193 ceph-mon[35248]: pgmap v492: 129 pgs: 129 active+clean; 1.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 656 op/s 2024-09-13T16:01:18.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:18 smithi017 ceph-mon[30494]: pgmap v492: 129 pgs: 129 active+clean; 1.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 656 op/s 2024-09-13T16:01:18.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:18 smithi189 ceph-mon[34790]: pgmap v492: 129 pgs: 129 active+clean; 1.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 656 op/s 2024-09-13T16:01:20.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 215.0 s, 1402.3 tps, lat 70.831 ms stddev 86.517 2024-09-13T16:01:20.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:20 smithi193 ceph-mon[35248]: pgmap v493: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.5 MiB/s wr, 657 op/s 2024-09-13T16:01:20.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:20 smithi017 ceph-mon[30494]: pgmap v493: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.5 MiB/s wr, 657 op/s 2024-09-13T16:01:20.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:20 smithi189 ceph-mon[34790]: pgmap v493: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.5 MiB/s wr, 657 op/s 2024-09-13T16:01:22.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:22 smithi193 ceph-mon[35248]: pgmap v494: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.4 MiB/s wr, 577 op/s 2024-09-13T16:01:22.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:22 smithi017 ceph-mon[30494]: pgmap v494: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.4 MiB/s wr, 577 op/s 2024-09-13T16:01:22.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:22 smithi189 ceph-mon[34790]: pgmap v494: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.4 MiB/s wr, 577 op/s 2024-09-13T16:01:24.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:24 smithi193 ceph-mon[35248]: pgmap v495: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.4 MiB/s wr, 578 op/s 2024-09-13T16:01:24.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:24 smithi017 ceph-mon[30494]: pgmap v495: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.4 MiB/s wr, 578 op/s 2024-09-13T16:01:24.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:24 smithi189 ceph-mon[34790]: pgmap v495: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.4 MiB/s wr, 578 op/s 2024-09-13T16:01:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.176+0000 7ff347e00640 1 -- 172.21.15.17:0/944922529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff340100790 msgr2=0x7ff340102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.176+0000 7ff347e00640 1 --2- 172.21.15.17:0/944922529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff340100790 0x7ff340102b80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff338009ca0 tx=0x7ff33802a8d0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.178+0000 7ff347e00640 1 -- 172.21.15.17:0/944922529 shutdown_connections 2024-09-13T16:01:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.178+0000 7ff347e00640 1 --2- 172.21.15.17:0/944922529 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3401059f0 0x7ff340107e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.178+0000 7ff347e00640 1 --2- 172.21.15.17:0/944922529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3401030c0 0x7ff3401054b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.178+0000 7ff347e00640 1 --2- 172.21.15.17:0/944922529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff340100790 0x7ff340102b80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.178+0000 7ff347e00640 1 -- 172.21.15.17:0/944922529 >> 172.21.15.17:0/944922529 conn(0x7ff3400fa370 msgr2=0x7ff3400fc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.180+0000 7ff347e00640 1 -- 172.21.15.17:0/944922529 shutdown_connections 2024-09-13T16:01:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.181+0000 7ff347e00640 1 -- 172.21.15.17:0/944922529 wait complete. 2024-09-13T16:01:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.185+0000 7ff347e00640 1 Processor -- start 2024-09-13T16:01:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.185+0000 7ff347e00640 1 -- start start 2024-09-13T16:01:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.186+0000 7ff347e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff340100790 0x7ff340195e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.187+0000 7ff347e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3401030c0 0x7ff340196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.188+0000 7ff347e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff3401059f0 0x7ff34019d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.188+0000 7ff347e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34019d910 con 0x7ff340100790 2024-09-13T16:01:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.188+0000 7ff347e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34019da80 con 0x7ff3401030c0 2024-09-13T16:01:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.188+0000 7ff347e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34019dc40 con 0x7ff3401059f0 2024-09-13T16:01:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.188+0000 7ff345e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff3401059f0 0x7ff34019d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.188+0000 7ff345e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff3401059f0 0x7ff34019d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:40564/0 (socket says 172.21.15.17:40564) 2024-09-13T16:01:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.188+0000 7ff345e00640 1 -- 172.21.15.17:0/325389827 learned_addr learned my addr 172.21.15.17:0/325389827 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:01:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.188+0000 7ff344a00640 1 --2- 172.21.15.17:0/325389827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3401030c0 0x7ff340196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.189+0000 7ff345e00640 1 -- 172.21.15.17:0/325389827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3401030c0 msgr2=0x7ff340196360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.189+0000 7ff345e00640 1 --2- 172.21.15.17:0/325389827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3401030c0 0x7ff340196360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.189+0000 7ff345e00640 1 -- 172.21.15.17:0/325389827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff340100790 msgr2=0x7ff340195e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.189+0000 7ff345e00640 1 --2- 172.21.15.17:0/325389827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff340100790 0x7ff340195e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.189+0000 7ff345e00640 1 -- 172.21.15.17:0/325389827 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff338009900 con 0x7ff3401059f0 2024-09-13T16:01:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.189+0000 7ff345e00640 1 --2- 172.21.15.17:0/325389827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff3401059f0 0x7ff34019d3d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00d720 tx=0x7ff32c00dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.190+0000 7ff33e000640 1 -- 172.21.15.17:0/325389827 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c009bd0 con 0x7ff3401059f0 2024-09-13T16:01:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.190+0000 7ff33e000640 1 -- 172.21.15.17:0/325389827 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff32c00de30 con 0x7ff3401059f0 2024-09-13T16:01:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.190+0000 7ff33e000640 1 -- 172.21.15.17:0/325389827 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c004e20 con 0x7ff3401059f0 2024-09-13T16:01:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.190+0000 7ff347e00640 1 -- 172.21.15.17:0/325389827 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff34019df20 con 0x7ff3401059f0 2024-09-13T16:01:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.190+0000 7ff347e00640 1 -- 172.21.15.17:0/325389827 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34019e3d0 con 0x7ff3401059f0 2024-09-13T16:01:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.196+0000 7ff34ac8b740 1 Processor -- start 2024-09-13T16:01:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.198+0000 7ff33e000640 1 -- 172.21.15.17:0/325389827 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff32c004f80 con 0x7ff3401059f0 2024-09-13T16:01:25.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.201+0000 7ff34ac8b740 1 -- start start 2024-09-13T16:01:25.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.201+0000 7ff34ac8b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c16764a70 0x558c16764e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.201+0000 7ff34ac8b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167653b0 0x558c16769e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.201+0000 7ff34ac8b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c1676a440 0x558c1676c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.201+0000 7ff34ac8b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c16670bb0 con 0x558c1676a440 2024-09-13T16:01:25.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.201+0000 7ff34ac8b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c166cea70 con 0x558c16764a70 2024-09-13T16:01:25.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.201+0000 7ff34ac8b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c166cc200 con 0x558c167653b0 2024-09-13T16:01:25.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.202+0000 7ff345400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167653b0 0x558c16769e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.202+0000 7ff345400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167653b0 0x558c16769e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:40574/0 (socket says 172.21.15.17:40574) 2024-09-13T16:01:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.202+0000 7ff345400640 1 -- 172.21.15.17:0/1150405468 learned_addr learned my addr 172.21.15.17:0/1150405468 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:01:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.202+0000 7ff33e000640 1 --2- 172.21.15.17:0/325389827 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff3280a11e0 0x7ff3280a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.202+0000 7ff344a00640 1 --2- 172.21.15.17:0/1150405468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c1676a440 0x558c1676c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.202+0000 7ff344a00640 1 --2- 172.21.15.17:0/1150405468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c16764a70 0x558c16764e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.202+0000 7ff345e00640 1 --2- 172.21.15.17:0/325389827 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff3280a11e0 0x7ff3280a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.202+0000 7ff345400640 1 -- 172.21.15.17:0/1150405468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c16764a70 msgr2=0x558c16764e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.202+0000 7ff345400640 1 --2- 172.21.15.17:0/1150405468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c16764a70 0x558c16764e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.202+0000 7ff345400640 1 -- 172.21.15.17:0/1150405468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c1676a440 msgr2=0x558c1676c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.202+0000 7ff345400640 1 --2- 172.21.15.17:0/1150405468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c1676a440 0x558c1676c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.202+0000 7ff345400640 1 -- 172.21.15.17:0/1150405468 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c16669940 con 0x558c167653b0 2024-09-13T16:01:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.203+0000 7ff345400640 1 --2- 172.21.15.17:0/1150405468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167653b0 0x558c16769e70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff338031010 tx=0x7ff338009890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=856775bb81294f15 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.204+0000 7ff332a00640 1 -- 172.21.15.17:0/1150405468 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338031460 con 0x558c167653b0 2024-09-13T16:01:25.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.204+0000 7ff332a00640 1 -- 172.21.15.17:0/1150405468 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff338003970 con 0x558c167653b0 2024-09-13T16:01:25.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.204+0000 7ff332a00640 1 -- 172.21.15.17:0/1150405468 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338030bf0 con 0x558c167653b0 2024-09-13T16:01:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.205+0000 7ff344a00640 1 --2- 172.21.15.17:0/1150405468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c16764a70 0x558c16764e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.205+0000 7ff34ac8b740 1 -- 172.21.15.17:0/1150405468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167653b0 msgr2=0x558c16769e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.205+0000 7ff34ac8b740 1 --2- 172.21.15.17:0/1150405468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167653b0 0x558c16769e70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff338031010 tx=0x7ff338009890 comp rx=0 tx=0).stop 2024-09-13T16:01:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.204+0000 7ff33e000640 1 -- 172.21.15.17:0/325389827 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7ff32c0cc700 con 0x7ff3401059f0 2024-09-13T16:01:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.206+0000 7ff34ac8b740 1 -- 172.21.15.17:0/1150405468 shutdown_connections 2024-09-13T16:01:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.206+0000 7ff34ac8b740 1 --2- 172.21.15.17:0/1150405468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c1676a440 0x558c1676c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.206+0000 7ff34ac8b740 1 --2- 172.21.15.17:0/1150405468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167653b0 0x558c16769e70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.206+0000 7ff34ac8b740 1 --2- 172.21.15.17:0/1150405468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c16764a70 0x558c16764e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.206+0000 7ff34ac8b740 1 -- 172.21.15.17:0/1150405468 >> 172.21.15.17:0/1150405468 conn(0x558c167600e0 msgr2=0x558c167604e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.206+0000 7ff34ac8b740 1 -- 172.21.15.17:0/1150405468 shutdown_connections 2024-09-13T16:01:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.206+0000 7ff34ac8b740 1 -- 172.21.15.17:0/1150405468 wait complete. 2024-09-13T16:01:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.206+0000 7ff345e00640 1 --2- 172.21.15.17:0/325389827 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff3280a11e0 0x7ff3280a36a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0c9e20 tx=0x7ff32c0cfd90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.207+0000 7ff34ac8b740 1 -- start start 2024-09-13T16:01:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.207+0000 7ff34ac8b740 1 Processor -- start 2024-09-13T16:01:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.208+0000 7ff34ac8b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c16764a70 0x558c16776e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.208+0000 7ff34ac8b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167653b0 0x558c167773a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.208+0000 7ff34ac8b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c1676a440 0x558c1677e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.208+0000 7ff34ac8b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c166c7af0 con 0x558c1676a440 2024-09-13T16:01:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.208+0000 7ff34ac8b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c16685f20 con 0x558c16764a70 2024-09-13T16:01:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.208+0000 7ff34ac8b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c16685bc0 con 0x558c167653b0 2024-09-13T16:01:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.208+0000 7ff34ac8b740 10 client.0 _ll_register_callbacks cb 0x558c166b7a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:01:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.209+0000 7ff344a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c1676a440 0x558c1677e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.209+0000 7ff344a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c16764a70 0x558c16776e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.209+0000 7ff344a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c16764a70 0x558c16776e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:49648/0 (socket says 172.21.15.17:49648) 2024-09-13T16:01:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.209+0000 7ff344a00640 1 -- 172.21.15.17:0/3847984352 learned_addr learned my addr 172.21.15.17:0/3847984352 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:01:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.209+0000 7ff345400640 1 --2- 172.21.15.17:0/3847984352 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167653b0 0x558c167773a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.210+0000 7ff344a00640 1 -- 172.21.15.17:0/3847984352 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167653b0 msgr2=0x558c167773a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.210+0000 7ff344a00640 1 --2- 172.21.15.17:0/3847984352 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167653b0 0x558c167773a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.210+0000 7ff344a00640 1 -- 172.21.15.17:0/3847984352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c1676a440 msgr2=0x558c1677e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.210+0000 7ff344a00640 1 --2- 172.21.15.17:0/3847984352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c1676a440 0x558c1677e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.210+0000 7ff344a00640 1 -- 172.21.15.17:0/3847984352 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff340108a40 con 0x558c16764a70 2024-09-13T16:01:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.210+0000 7ff345400640 1 --2- 172.21.15.17:0/3847984352 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167653b0 0x558c167773a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.210+0000 7ff344a00640 1 --2- 172.21.15.17:0/3847984352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c16764a70 0x558c16776e60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff33400ae10 tx=0x7ff33400a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8781812470b3742 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.211+0000 7ff327400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:01:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.212+0000 7ff327400640 1 -- 172.21.15.17:0/3847984352 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff334015cf0 con 0x558c16764a70 2024-09-13T16:01:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.212+0000 7ff327400640 1 -- 172.21.15.17:0/3847984352 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7ff334015e50 con 0x558c16764a70 2024-09-13T16:01:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.212+0000 7ff34ac8b740 1 -- 172.21.15.17:0/3847984352 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558c166f1c90 con 0x558c16764a70 2024-09-13T16:01:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.213+0000 7ff327400640 1 -- 172.21.15.17:0/3847984352 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3340163d0 con 0x558c16764a70 2024-09-13T16:01:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.216+0000 7ff34ac8b740 10 client.25655 fetch_fsmap learned FSMap version 30 2024-09-13T16:01:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.216+0000 7ff34ac8b740 1 -- 172.21.15.17:0/3847984352 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x558c166c6170 con 0x558c16764a70 2024-09-13T16:01:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.216+0000 7ff327400640 1 -- 172.21.15.17:0/3847984352 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558c166f1c90 con 0x558c16764a70 2024-09-13T16:01:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.216+0000 7ff327400640 1 -- 172.21.15.17:0/3847984352 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) v1 ==== 7490+0+0 (secure 0 0 0) 0x7ff3340224d0 con 0x558c16764a70 2024-09-13T16:01:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.217+0000 7ff34ac8b740 10 client.25655 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T16:01:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.217+0000 7ff34ac8b740 10 client.25655 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:01:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.217+0000 7ff34ac8b740 20 client.25655 populate_metadata read hostname 'smithi017' 2024-09-13T16:01:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.217+0000 7ff34ac8b740 1 --2- 172.21.15.17:0/3847984352 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x558c16782bb0 0x558c16784fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.217+0000 7ff34ac8b740 4 client.25655 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:01:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.217+0000 7ff34ac8b740 1 -- 172.21.15.17:0/3847984352 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558c166ba7d0 con 0x558c16782bb0 2024-09-13T16:01:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.217+0000 7ff345400640 1 --2- 172.21.15.17:0/3847984352 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x558c16782bb0 0x558c16784fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.218+0000 7ff345400640 1 --2- 172.21.15.17:0/3847984352 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x558c16782bb0 0x558c16784fd0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f9cef93b1f7c7ed server_cookie=c5ceb0c672380845 in_seq=0 out_seq=0 2024-09-13T16:01:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.218+0000 7ff327400640 10 client.25655 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:01:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.219+0000 7ff327400640 1 -- 172.21.15.17:0/3847984352 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558c166ba7d0 con 0x558c16782bb0 2024-09-13T16:01:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.219+0000 7ff327400640 10 client.25655 handle_command_reply: tid=0 2024-09-13T16:01:25.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.219+0000 7ff34ac8b740 1 client.25655 shutdown 2024-09-13T16:01:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.220+0000 7ff34ac8b740 1 -- 172.21.15.17:0/3847984352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c16764a70 msgr2=0x558c16776e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.220+0000 7ff34ac8b740 1 --2- 172.21.15.17:0/3847984352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c16764a70 0x558c16776e60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff33400ae10 tx=0x7ff33400a230 comp rx=0 tx=0).stop 2024-09-13T16:01:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.221+0000 7ff34ac8b740 1 -- 172.21.15.17:0/3847984352 shutdown_connections 2024-09-13T16:01:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.221+0000 7ff34ac8b740 1 --2- 172.21.15.17:0/3847984352 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x558c16782bb0 0x558c16784fd0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.221+0000 7ff34ac8b740 1 --2- 172.21.15.17:0/3847984352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c1676a440 0x558c1677e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.221+0000 7ff34ac8b740 1 --2- 172.21.15.17:0/3847984352 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167653b0 0x558c167773a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.221+0000 7ff34ac8b740 1 --2- 172.21.15.17:0/3847984352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c16764a70 0x558c16776e60 secure :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff33400ae10 tx=0x7ff33400a230 comp rx=0 tx=0).stop 2024-09-13T16:01:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.221+0000 7ff327400640 0 client.25655 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:01:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.221+0000 7ff34ac8b740 1 -- 172.21.15.17:0/3847984352 >> 172.21.15.17:0/3847984352 conn(0x558c167600e0 msgr2=0x558c167618f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:25.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.221+0000 7ff34ac8b740 1 -- 172.21.15.17:0/3847984352 shutdown_connections 2024-09-13T16:01:25.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.221+0000 7ff34ac8b740 1 -- 172.21.15.17:0/3847984352 wait complete. 2024-09-13T16:01:25.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.222+0000 7ff34ac8b740 20 client.25655 trim_cache size 0 max 16384 2024-09-13T16:01:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.249+0000 7ff34ac8b740 1 Processor -- start 2024-09-13T16:01:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.250+0000 7ff34ac8b740 1 -- start start 2024-09-13T16:01:25.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.251+0000 7ff34ac8b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167600e0 0x558c16776c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.251+0000 7ff34ac8b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c167653b0 0x558c1677e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.251+0000 7ff34ac8b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c1676a440 0x558c16777150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.251+0000 7ff34ac8b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c1642ee60 con 0x558c1676a440 2024-09-13T16:01:25.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.251+0000 7ff34ac8b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c166f1c90 con 0x558c167653b0 2024-09-13T16:01:25.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.251+0000 7ff34ac8b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c16765890 con 0x558c167600e0 2024-09-13T16:01:25.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.251+0000 7ff344a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167600e0 0x558c16776c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.252+0000 7ff344a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167600e0 0x558c16776c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:40582/0 (socket says 172.21.15.17:40582) 2024-09-13T16:01:25.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.252+0000 7ff344a00640 1 -- 172.21.15.17:0/3828421343 learned_addr learned my addr 172.21.15.17:0/3828421343 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:01:25.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.252+0000 7ff345400640 1 --2- 172.21.15.17:0/3828421343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c167653b0 0x558c1677e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.255+0000 7ff345400640 1 -- 172.21.15.17:0/3828421343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167600e0 msgr2=0x558c16776c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.255+0000 7ff345400640 1 --2- 172.21.15.17:0/3828421343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167600e0 0x558c16776c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.255+0000 7ff345400640 1 -- 172.21.15.17:0/3828421343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c1676a440 msgr2=0x558c16777150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.256+0000 7ff345400640 1 --2- 172.21.15.17:0/3828421343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c1676a440 0x558c16777150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.256+0000 7ff345400640 1 -- 172.21.15.17:0/3828421343 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c16668180 con 0x558c167653b0 2024-09-13T16:01:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.257+0000 7ff345400640 1 --2- 172.21.15.17:0/3828421343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c167653b0 0x558c1677e3a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff338031b30 tx=0x7ff33802f320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46198074d01c0dad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.258+0000 7ff333400640 1 -- 172.21.15.17:0/3828421343 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338049040 con 0x558c167653b0 2024-09-13T16:01:25.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.258+0000 7ff333400640 1 -- 172.21.15.17:0/3828421343 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff33804a040 con 0x558c167653b0 2024-09-13T16:01:25.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.258+0000 7ff333400640 1 -- 172.21.15.17:0/3828421343 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338053410 con 0x558c167653b0 2024-09-13T16:01:25.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.259+0000 7ff34ac8b740 1 -- 172.21.15.17:0/3828421343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c167653b0 msgr2=0x558c1677e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.259+0000 7ff34ac8b740 1 --2- 172.21.15.17:0/3828421343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c167653b0 0x558c1677e3a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff338031b30 tx=0x7ff33802f320 comp rx=0 tx=0).stop 2024-09-13T16:01:25.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.261+0000 7ff34ac8b740 1 -- 172.21.15.17:0/3828421343 shutdown_connections 2024-09-13T16:01:25.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.261+0000 7ff34ac8b740 1 --2- 172.21.15.17:0/3828421343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c1676a440 0x558c16777150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.261+0000 7ff34ac8b740 1 --2- 172.21.15.17:0/3828421343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c167653b0 0x558c1677e3a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.261+0000 7ff34ac8b740 1 --2- 172.21.15.17:0/3828421343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167600e0 0x558c16776c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.261+0000 7ff34ac8b740 1 -- 172.21.15.17:0/3828421343 >> 172.21.15.17:0/3828421343 conn(0x558c1676cba0 msgr2=0x558c16769810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.262+0000 7ff34ac8b740 1 -- 172.21.15.17:0/3828421343 shutdown_connections 2024-09-13T16:01:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.262+0000 7ff34ac8b740 1 -- 172.21.15.17:0/3828421343 wait complete. 2024-09-13T16:01:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.262+0000 7ff34ac8b740 1 -- start start 2024-09-13T16:01:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.263+0000 7ff34ac8b740 1 Processor -- start 2024-09-13T16:01:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.266+0000 7ff34ac8b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167600e0 0x558c1677ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.267+0000 7ff34ac8b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c167653b0 0x558c1677d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.267+0000 7ff34ac8b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c1676a440 0x558c1677d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.267+0000 7ff34ac8b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c167d9170 con 0x558c167653b0 2024-09-13T16:01:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.267+0000 7ff34ac8b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c167d92e0 con 0x558c1676a440 2024-09-13T16:01:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.267+0000 7ff34ac8b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c167d94a0 con 0x558c167600e0 2024-09-13T16:01:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.267+0000 7ff34ac8b740 10 client.0 _ll_register_callbacks cb 0x7ff338009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:01:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.268+0000 7ff344a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167600e0 0x558c1677ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.268+0000 7ff344a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167600e0 0x558c1677ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:40586/0 (socket says 172.21.15.17:40586) 2024-09-13T16:01:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.268+0000 7ff344a00640 1 -- 172.21.15.17:0/662698313 learned_addr learned my addr 172.21.15.17:0/662698313 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:01:25.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.268+0000 7ff344a00640 1 --2- 172.21.15.17:0/662698313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c1676a440 0x558c1677d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.268+0000 7ff345400640 1 --2- 172.21.15.17:0/662698313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c167653b0 0x558c1677d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.269+0000 7ff344a00640 1 -- 172.21.15.17:0/662698313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c1676a440 msgr2=0x558c1677d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:25.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.269+0000 7ff344a00640 1 --2- 172.21.15.17:0/662698313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c1676a440 0x558c1677d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.269+0000 7ff344a00640 1 -- 172.21.15.17:0/662698313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c167653b0 msgr2=0x558c1677d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:25.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.269+0000 7ff344a00640 1 --2- 172.21.15.17:0/662698313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c167653b0 0x558c1677d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.269+0000 7ff344a00640 1 -- 172.21.15.17:0/662698313 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558c16669940 con 0x558c167600e0 2024-09-13T16:01:25.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.270+0000 7ff344a00640 1 --2- 172.21.15.17:0/662698313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167600e0 0x558c1677ccf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff33400ae10 tx=0x7ff334007f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75a8da2fea7762cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:25.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.270+0000 7ff327400640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:01:25.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.270+0000 7ff327400640 1 -- 172.21.15.17:0/662698313 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33400a590 con 0x558c167600e0 2024-09-13T16:01:25.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.270+0000 7ff327400640 1 -- 172.21.15.17:0/662698313 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7ff334021bd0 con 0x558c167600e0 2024-09-13T16:01:25.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.271+0000 7ff34ac8b740 1 -- 172.21.15.17:0/662698313 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff338003970 con 0x558c167600e0 2024-09-13T16:01:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.271+0000 7ff327400640 1 -- 172.21.15.17:0/662698313 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff334021db0 con 0x558c167600e0 2024-09-13T16:01:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.271+0000 7ff34ac8b740 10 client.25678 fetch_fsmap learned FSMap version 30 2024-09-13T16:01:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.271+0000 7ff34ac8b740 1 -- 172.21.15.17:0/662698313 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x558c1668d560 con 0x558c167600e0 2024-09-13T16:01:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.272+0000 7ff327400640 1 -- 172.21.15.17:0/662698313 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff338003970 con 0x558c167600e0 2024-09-13T16:01:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.272+0000 7ff327400640 1 -- 172.21.15.17:0/662698313 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) v1 ==== 7490+0+0 (secure 0 0 0) 0x7ff334015d60 con 0x558c167600e0 2024-09-13T16:01:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.272+0000 7ff34ac8b740 10 client.25678 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T16:01:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.273+0000 7ff34ac8b740 10 client.25678 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:01:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.273+0000 7ff34ac8b740 20 client.25678 populate_metadata read hostname 'smithi017' 2024-09-13T16:01:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.273+0000 7ff34ac8b740 1 --2- 172.21.15.17:0/662698313 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x558c167ebee0 0x558c167ee300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.273+0000 7ff34ac8b740 4 client.25678 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:01:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.273+0000 7ff34ac8b740 1 -- 172.21.15.17:0/662698313 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558c163bb300 con 0x558c167ebee0 2024-09-13T16:01:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.273+0000 7ff345400640 1 --2- 172.21.15.17:0/662698313 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x558c167ebee0 0x558c167ee300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.274+0000 7ff345400640 1 --2- 172.21.15.17:0/662698313 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x558c167ebee0 0x558c167ee300 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=479ab9e85fdcc51b server_cookie=d1ebf3b06beb2a56 in_seq=0 out_seq=0 2024-09-13T16:01:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.274+0000 7ff327400640 10 client.25678 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:01:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 220.0 s, 855.2 tps, lat 111.734 ms stddev 156.511 2024-09-13T16:01:25.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.487+0000 7ff327400640 1 -- 172.21.15.17:0/662698313 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558c163bb300 con 0x558c167ebee0 2024-09-13T16:01:25.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.488+0000 7ff327400640 10 client.25678 handle_command_reply: tid=0 2024-09-13T16:01:25.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.488+0000 7ff34ac8b740 1 client.25678 shutdown 2024-09-13T16:01:25.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.488+0000 7ff34ac8b740 1 -- 172.21.15.17:0/662698313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167600e0 msgr2=0x558c1677ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.488+0000 7ff34ac8b740 1 --2- 172.21.15.17:0/662698313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167600e0 0x558c1677ccf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff33400ae10 tx=0x7ff334007f90 comp rx=0 tx=0).stop 2024-09-13T16:01:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.491+0000 7ff34ac8b740 1 -- 172.21.15.17:0/662698313 shutdown_connections 2024-09-13T16:01:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.491+0000 7ff34ac8b740 1 --2- 172.21.15.17:0/662698313 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x558c167ebee0 0x558c167ee300 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.491+0000 7ff327400640 0 client.25678 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:01:25.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.491+0000 7ff34ac8b740 1 --2- 172.21.15.17:0/662698313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c1676a440 0x558c1677d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.491+0000 7ff34ac8b740 1 --2- 172.21.15.17:0/662698313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c167653b0 0x558c1677d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.491+0000 7ff34ac8b740 1 --2- 172.21.15.17:0/662698313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558c167600e0 0x558c1677ccf0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.491+0000 7ff34ac8b740 1 -- 172.21.15.17:0/662698313 >> 172.21.15.17:0/662698313 conn(0x558c1676cba0 msgr2=0x558c16776c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:25.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.491+0000 7ff34ac8b740 1 -- 172.21.15.17:0/662698313 shutdown_connections 2024-09-13T16:01:25.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.492+0000 7ff34ac8b740 1 -- 172.21.15.17:0/662698313 wait complete. 2024-09-13T16:01:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.492+0000 7ff34ac8b740 20 client.25678 trim_cache size 0 max 16384 2024-09-13T16:01:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:01:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:01:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:01:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:01:25.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.494+0000 7ff347e00640 1 -- 172.21.15.17:0/325389827 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff3280a11e0 msgr2=0x7ff3280a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.494+0000 7ff347e00640 1 --2- 172.21.15.17:0/325389827 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff3280a11e0 0x7ff3280a36a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0c9e20 tx=0x7ff32c0cfd90 comp rx=0 tx=0).stop 2024-09-13T16:01:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.494+0000 7ff347e00640 1 -- 172.21.15.17:0/325389827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff3401059f0 msgr2=0x7ff34019d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.494+0000 7ff347e00640 1 --2- 172.21.15.17:0/325389827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff3401059f0 0x7ff34019d3d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00d720 tx=0x7ff32c00dbe0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.499+0000 7ff347e00640 1 -- 172.21.15.17:0/325389827 shutdown_connections 2024-09-13T16:01:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.499+0000 7ff347e00640 1 --2- 172.21.15.17:0/325389827 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff3280a11e0 0x7ff3280a36a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.499+0000 7ff347e00640 1 --2- 172.21.15.17:0/325389827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff3401059f0 0x7ff34019d3d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.499+0000 7ff347e00640 1 --2- 172.21.15.17:0/325389827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3401030c0 0x7ff340196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.499+0000 7ff347e00640 1 --2- 172.21.15.17:0/325389827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff340100790 0x7ff340195e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.499+0000 7ff347e00640 1 -- 172.21.15.17:0/325389827 >> 172.21.15.17:0/325389827 conn(0x7ff3400fa370 msgr2=0x7ff340101090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.499+0000 7ff347e00640 1 -- 172.21.15.17:0/325389827 shutdown_connections 2024-09-13T16:01:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:25.499+0000 7ff347e00640 1 -- 172.21.15.17:0/325389827 wait complete. 2024-09-13T16:01:26.656 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:26 smithi189 ceph-mon[34790]: pgmap v496: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 7.2 MiB/s wr, 653 op/s 2024-09-13T16:01:26.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:26 smithi193 ceph-mon[35248]: pgmap v496: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 7.2 MiB/s wr, 653 op/s 2024-09-13T16:01:26.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:26 smithi017 ceph-mon[30494]: pgmap v496: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 7.2 MiB/s wr, 653 op/s 2024-09-13T16:01:28.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:28 smithi193 ceph-mon[35248]: pgmap v497: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.4 MiB/s wr, 590 op/s 2024-09-13T16:01:28.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:28 smithi017 ceph-mon[30494]: pgmap v497: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.4 MiB/s wr, 590 op/s 2024-09-13T16:01:28.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:28 smithi189 ceph-mon[34790]: pgmap v497: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.4 MiB/s wr, 590 op/s 2024-09-13T16:01:30.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 225.0 s, 1227.4 tps, lat 84.879 ms stddev 119.729 2024-09-13T16:01:30.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:30 smithi193 ceph-mon[35248]: pgmap v498: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.3 MiB/s wr, 723 op/s 2024-09-13T16:01:30.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:30 smithi017 ceph-mon[30494]: pgmap v498: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.3 MiB/s wr, 723 op/s 2024-09-13T16:01:30.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:30 smithi189 ceph-mon[34790]: pgmap v498: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.3 MiB/s wr, 723 op/s 2024-09-13T16:01:32.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:32 smithi193 ceph-mon[35248]: pgmap v499: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.7 MiB/s wr, 746 op/s 2024-09-13T16:01:32.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:32 smithi017 ceph-mon[30494]: pgmap v499: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.7 MiB/s wr, 746 op/s 2024-09-13T16:01:32.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:32 smithi189 ceph-mon[34790]: pgmap v499: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.7 MiB/s wr, 746 op/s 2024-09-13T16:01:34.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:34 smithi193 ceph-mon[35248]: pgmap v500: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.0 MiB/s wr, 692 op/s 2024-09-13T16:01:34.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:34 smithi017 ceph-mon[30494]: pgmap v500: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.0 MiB/s wr, 692 op/s 2024-09-13T16:01:34.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:34 smithi189 ceph-mon[34790]: pgmap v500: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.0 MiB/s wr, 692 op/s 2024-09-13T16:01:35.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 230.0 s, 1343.8 tps, lat 75.048 ms stddev 90.888 2024-09-13T16:01:36.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:36 smithi193 ceph-mon[35248]: pgmap v501: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.7 MiB/s wr, 766 op/s 2024-09-13T16:01:36.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:36 smithi017 ceph-mon[30494]: pgmap v501: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.7 MiB/s wr, 766 op/s 2024-09-13T16:01:36.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:36 smithi189 ceph-mon[34790]: pgmap v501: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.7 MiB/s wr, 766 op/s 2024-09-13T16:01:38.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.695+0000 7f91ed000640 1 -- 172.21.15.17:0/3280184200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91e8071870 msgr2=0x7f91e8110800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:38.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.695+0000 7f91ed000640 1 --2- 172.21.15.17:0/3280184200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91e8071870 0x7f91e8110800 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f91d8009900 tx=0x7f91d802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.695+0000 7f91ed000640 1 -- 172.21.15.17:0/3280184200 shutdown_connections 2024-09-13T16:01:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.695+0000 7f91ed000640 1 --2- 172.21.15.17:0/3280184200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91e8071870 0x7f91e8110800 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.695+0000 7f91ed000640 1 --2- 172.21.15.17:0/3280184200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e8070eb0 0x7f91e8071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.695+0000 7f91ed000640 1 --2- 172.21.15.17:0/3280184200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91e8107ad0 0x7f91e8107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.695+0000 7f91ed000640 1 -- 172.21.15.17:0/3280184200 >> 172.21.15.17:0/3280184200 conn(0x7f91e806cf30 msgr2=0x7f91e806f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.695+0000 7f91ed000640 1 -- 172.21.15.17:0/3280184200 shutdown_connections 2024-09-13T16:01:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.695+0000 7f91ed000640 1 -- 172.21.15.17:0/3280184200 wait complete. 2024-09-13T16:01:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.697+0000 7f91ed000640 1 Processor -- start 2024-09-13T16:01:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.699+0000 7f91ed000640 1 -- start start 2024-09-13T16:01:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.700+0000 7f91ed000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91e8070eb0 0x7f91e819e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.700+0000 7f91ed000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e8071870 0x7f91e819eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.700+0000 7f91ed000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91e8107ad0 0x7f91e81a5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.700+0000 7f91ed000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e81a6070 con 0x7f91e8071870 2024-09-13T16:01:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.700+0000 7f91ed000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e81a61e0 con 0x7f91e8107ad0 2024-09-13T16:01:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.700+0000 7f91ed000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e81a63a0 con 0x7f91e8070eb0 2024-09-13T16:01:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.700+0000 7f91e5e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91e8070eb0 0x7f91e819e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.700+0000 7f91e5e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91e8070eb0 0x7f91e819e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:41752/0 (socket says 172.21.15.17:41752) 2024-09-13T16:01:38.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.700+0000 7f91e5e00640 1 -- 172.21.15.17:0/3745220267 learned_addr learned my addr 172.21.15.17:0/3745220267 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:01:38.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.701+0000 7f91e5400640 1 --2- 172.21.15.17:0/3745220267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e8071870 0x7f91e819eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:38.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.701+0000 7f91e5e00640 1 -- 172.21.15.17:0/3745220267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91e8107ad0 msgr2=0x7f91e81a5b30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T16:01:38.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.701+0000 7f91e5e00640 1 --2- 172.21.15.17:0/3745220267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91e8107ad0 0x7f91e81a5b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.701+0000 7f91e5e00640 1 -- 172.21.15.17:0/3745220267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e8071870 msgr2=0x7f91e819eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:38.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.701+0000 7f91e5e00640 1 --2- 172.21.15.17:0/3745220267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e8071870 0x7f91e819eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.701+0000 7f91e5e00640 1 -- 172.21.15.17:0/3745220267 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d8009560 con 0x7f91e8070eb0 2024-09-13T16:01:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.701+0000 7f91e5e00640 1 --2- 172.21.15.17:0/3745220267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91e8070eb0 0x7f91e819e580 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f91e000eab0 tx=0x7f91e000ef70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.702+0000 7f91dea00640 1 -- 172.21.15.17:0/3745220267 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e000ce40 con 0x7f91e8070eb0 2024-09-13T16:01:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.702+0000 7f91dea00640 1 -- 172.21.15.17:0/3745220267 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91e0011930 con 0x7f91e8070eb0 2024-09-13T16:01:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.702+0000 7f91dea00640 1 -- 172.21.15.17:0/3745220267 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0010a30 con 0x7f91e8070eb0 2024-09-13T16:01:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.702+0000 7f91ed000640 1 -- 172.21.15.17:0/3745220267 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e8108620 con 0x7f91e8070eb0 2024-09-13T16:01:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.702+0000 7f91ed000640 1 -- 172.21.15.17:0/3745220267 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e8108b00 con 0x7f91e8070eb0 2024-09-13T16:01:38.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.708+0000 7f91efe76740 1 Processor -- start 2024-09-13T16:01:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.711+0000 7f91dea00640 1 -- 172.21.15.17:0/3745220267 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f91e0011470 con 0x7f91e8070eb0 2024-09-13T16:01:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.712+0000 7f91efe76740 1 -- start start 2024-09-13T16:01:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.712+0000 7f91efe76740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904e4b0a70 0x55904e4b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.712+0000 7f91efe76740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b13b0 0x55904e4b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.712+0000 7f91efe76740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55904e4b6440 0x55904e4b8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.712+0000 7f91efe76740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904e3bcbb0 con 0x55904e4b0a70 2024-09-13T16:01:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.712+0000 7f91efe76740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904e41aa70 con 0x55904e4b13b0 2024-09-13T16:01:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.712+0000 7f91efe76740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904e418200 con 0x55904e4b6440 2024-09-13T16:01:38.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.713+0000 7f91e5400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55904e4b6440 0x55904e4b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:38.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.713+0000 7f91e5400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55904e4b6440 0x55904e4b8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:41756/0 (socket says 172.21.15.17:41756) 2024-09-13T16:01:38.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.713+0000 7f91e5400640 1 -- 172.21.15.17:0/1861742447 learned_addr learned my addr 172.21.15.17:0/1861742447 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:01:38.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.713+0000 7f91e5e00640 1 --2- 172.21.15.17:0/1861742447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b13b0 0x55904e4b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.713+0000 7f91e6800640 1 --2- 172.21.15.17:0/1861742447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904e4b0a70 0x55904e4b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.713+0000 7f91e5e00640 1 -- 172.21.15.17:0/1861742447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55904e4b6440 msgr2=0x55904e4b8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.713+0000 7f91e5e00640 1 --2- 172.21.15.17:0/1861742447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55904e4b6440 0x55904e4b8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.713+0000 7f91e5e00640 1 -- 172.21.15.17:0/1861742447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904e4b0a70 msgr2=0x55904e4b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.713+0000 7f91e5e00640 1 --2- 172.21.15.17:0/1861742447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904e4b0a70 0x55904e4b0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.713+0000 7f91e5e00640 1 -- 172.21.15.17:0/1861742447 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55904e3b5940 con 0x55904e4b13b0 2024-09-13T16:01:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.714+0000 7f91e5e00640 1 --2- 172.21.15.17:0/1861742447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b13b0 0x55904e4b5e70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f91e00caa10 tx=0x7f91e00d5450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a26c5082e084c104 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.714+0000 7f91d7400640 1 -- 172.21.15.17:0/1861742447 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e00cf310 con 0x55904e4b13b0 2024-09-13T16:01:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.714+0000 7f91d7400640 1 -- 172.21.15.17:0/1861742447 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91e00d5e60 con 0x55904e4b13b0 2024-09-13T16:01:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.714+0000 7f91d7400640 1 -- 172.21.15.17:0/1861742447 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e00dc8d0 con 0x55904e4b13b0 2024-09-13T16:01:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.715+0000 7f91efe76740 1 -- 172.21.15.17:0/1861742447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b13b0 msgr2=0x55904e4b5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.715+0000 7f91efe76740 1 --2- 172.21.15.17:0/1861742447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b13b0 0x55904e4b5e70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f91e00caa10 tx=0x7f91e00d5450 comp rx=0 tx=0).stop 2024-09-13T16:01:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.717+0000 7f91dea00640 1 --2- 172.21.15.17:0/3745220267 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f91cc0a10e0 0x7f91cc0a35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.717+0000 7f91dea00640 1 -- 172.21.15.17:0/3745220267 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f91e00cd290 con 0x7f91e8070eb0 2024-09-13T16:01:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.718+0000 7f91e6800640 1 --2- 172.21.15.17:0/3745220267 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f91cc0a10e0 0x7f91cc0a35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.718+0000 7f91efe76740 1 -- 172.21.15.17:0/1861742447 shutdown_connections 2024-09-13T16:01:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.718+0000 7f91efe76740 1 --2- 172.21.15.17:0/1861742447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55904e4b6440 0x55904e4b8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.718+0000 7f91efe76740 1 --2- 172.21.15.17:0/1861742447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b13b0 0x55904e4b5e70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.718+0000 7f91efe76740 1 --2- 172.21.15.17:0/1861742447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904e4b0a70 0x55904e4b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.718+0000 7f91efe76740 1 -- 172.21.15.17:0/1861742447 >> 172.21.15.17:0/1861742447 conn(0x55904e4ac0e0 msgr2=0x55904e4ac4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.718+0000 7f91efe76740 1 -- 172.21.15.17:0/1861742447 shutdown_connections 2024-09-13T16:01:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.718+0000 7f91efe76740 1 -- 172.21.15.17:0/1861742447 wait complete. 2024-09-13T16:01:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.719+0000 7f91efe76740 1 -- start start 2024-09-13T16:01:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.719+0000 7f91efe76740 1 Processor -- start 2024-09-13T16:01:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.719+0000 7f91e6800640 1 --2- 172.21.15.17:0/3745220267 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f91cc0a10e0 0x7f91cc0a35a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f91d80057c0 tx=0x7f91d8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:38.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.720+0000 7f91efe76740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55904e4b0a70 0x55904e4ba7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:38.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.721+0000 7f91efe76740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904e4b13b0 0x55904e4bad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:38.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.721+0000 7f91efe76740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b6440 0x55904e4c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:38.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.721+0000 7f91efe76740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904e413af0 con 0x55904e4b13b0 2024-09-13T16:01:38.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.721+0000 7f91efe76740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904e3d1f20 con 0x55904e4b6440 2024-09-13T16:01:38.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.721+0000 7f91efe76740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904e3d1bc0 con 0x55904e4b0a70 2024-09-13T16:01:38.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.721+0000 7f91efe76740 10 client.0 _ll_register_callbacks cb 0x55904e403a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:01:38.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.721+0000 7f91e6800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b6440 0x55904e4c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.721+0000 7f91e6800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b6440 0x55904e4c1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:55810/0 (socket says 172.21.15.17:55810) 2024-09-13T16:01:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.721+0000 7f91e6800640 1 -- 172.21.15.17:0/2572569506 learned_addr learned my addr 172.21.15.17:0/2572569506 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:01:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.722+0000 7f91e5400640 1 --2- 172.21.15.17:0/2572569506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904e4b13b0 0x55904e4bad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.722+0000 7f91e6800640 1 -- 172.21.15.17:0/2572569506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55904e4b0a70 msgr2=0x55904e4ba7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.722+0000 7f91e6800640 1 --2- 172.21.15.17:0/2572569506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55904e4b0a70 0x55904e4ba7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.722+0000 7f91e6800640 1 -- 172.21.15.17:0/2572569506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904e4b13b0 msgr2=0x55904e4bad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:38.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.722+0000 7f91e6800640 1 --2- 172.21.15.17:0/2572569506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904e4b13b0 0x55904e4bad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.722+0000 7f91e6800640 1 -- 172.21.15.17:0/2572569506 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e8108b00 con 0x55904e4b6440 2024-09-13T16:01:38.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.722+0000 7f91e5400640 1 --2- 172.21.15.17:0/2572569506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904e4b13b0 0x55904e4bad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:01:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.724+0000 7f91e6800640 1 --2- 172.21.15.17:0/2572569506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b6440 0x55904e4c1cd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f91d8033000 tx=0x7f91d8009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9e5128134b30dee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.724+0000 7f91cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:01:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.725+0000 7f91cbe00640 1 -- 172.21.15.17:0/2572569506 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d80317a0 con 0x55904e4b6440 2024-09-13T16:01:38.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.725+0000 7f91cbe00640 1 -- 172.21.15.17:0/2572569506 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f91d8031900 con 0x55904e4b6440 2024-09-13T16:01:38.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.725+0000 7f91efe76740 1 -- 172.21.15.17:0/2572569506 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55904e43dc90 con 0x55904e4b6440 2024-09-13T16:01:38.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.726+0000 7f91cbe00640 1 -- 172.21.15.17:0/2572569506 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91d8031ac0 con 0x55904e4b6440 2024-09-13T16:01:38.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.726+0000 7f91efe76740 10 client.25670 fetch_fsmap learned FSMap version 30 2024-09-13T16:01:38.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.726+0000 7f91efe76740 1 -- 172.21.15.17:0/2572569506 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55904e412170 con 0x55904e4b6440 2024-09-13T16:01:38.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.727+0000 7f91cbe00640 1 -- 172.21.15.17:0/2572569506 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55904e43dc90 con 0x55904e4b6440 2024-09-13T16:01:38.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.727+0000 7f91cbe00640 1 -- 172.21.15.17:0/2572569506 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) v1 ==== 7490+0+0 (secure 0 0 0) 0x7f91d803c440 con 0x55904e4b6440 2024-09-13T16:01:38.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.727+0000 7f91efe76740 10 client.25670 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T16:01:38.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.727+0000 7f91efe76740 10 client.25670 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:01:38.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.727+0000 7f91efe76740 20 client.25670 populate_metadata read hostname 'smithi017' 2024-09-13T16:01:38.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.727+0000 7f91efe76740 1 --2- 172.21.15.17:0/2572569506 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55904e4c64e0 0x55904e4c8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:38.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.727+0000 7f91efe76740 4 client.25670 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:01:38.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.727+0000 7f91efe76740 1 -- 172.21.15.17:0/2572569506 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55904e4067d0 con 0x55904e4c64e0 2024-09-13T16:01:38.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.727+0000 7f91e5e00640 1 --2- 172.21.15.17:0/2572569506 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55904e4c64e0 0x55904e4c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:38.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.728+0000 7f91e5e00640 1 --2- 172.21.15.17:0/2572569506 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55904e4c64e0 0x55904e4c8900 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2eca6e971d1beff1 server_cookie=1e1c3871250ac5d9 in_seq=0 out_seq=0 2024-09-13T16:01:38.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.728+0000 7f91cbe00640 10 client.25670 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:01:38.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.729+0000 7f91cbe00640 1 -- 172.21.15.17:0/2572569506 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55904e4067d0 con 0x55904e4c64e0 2024-09-13T16:01:38.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.729+0000 7f91cbe00640 10 client.25670 handle_command_reply: tid=0 2024-09-13T16:01:38.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.729+0000 7f91efe76740 1 client.25670 shutdown 2024-09-13T16:01:38.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.730+0000 7f91efe76740 1 -- 172.21.15.17:0/2572569506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b6440 msgr2=0x55904e4c1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:38.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.730+0000 7f91efe76740 1 --2- 172.21.15.17:0/2572569506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b6440 0x55904e4c1cd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f91d8033000 tx=0x7f91d8009260 comp rx=0 tx=0).stop 2024-09-13T16:01:38.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.731+0000 7f91efe76740 1 -- 172.21.15.17:0/2572569506 shutdown_connections 2024-09-13T16:01:38.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.731+0000 7f91efe76740 1 --2- 172.21.15.17:0/2572569506 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55904e4c64e0 0x55904e4c8900 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.731+0000 7f91efe76740 1 --2- 172.21.15.17:0/2572569506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b6440 0x55904e4c1cd0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.731+0000 7f91efe76740 1 --2- 172.21.15.17:0/2572569506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904e4b13b0 0x55904e4bad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.731+0000 7f91efe76740 1 --2- 172.21.15.17:0/2572569506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55904e4b0a70 0x55904e4ba7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.731+0000 7f91cbe00640 0 client.25670 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:01:38.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.731+0000 7f91efe76740 1 -- 172.21.15.17:0/2572569506 >> 172.21.15.17:0/2572569506 conn(0x55904e4ac0e0 msgr2=0x55904e4ad8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:38.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.733+0000 7f91efe76740 1 -- 172.21.15.17:0/2572569506 shutdown_connections 2024-09-13T16:01:38.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.733+0000 7f91efe76740 1 -- 172.21.15.17:0/2572569506 wait complete. 2024-09-13T16:01:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.736+0000 7f91efe76740 20 client.25670 trim_cache size 0 max 16384 2024-09-13T16:01:38.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:38 smithi193 ceph-mon[35248]: pgmap v502: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.4 MiB/s wr, 667 op/s 2024-09-13T16:01:38.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:38 smithi017 ceph-mon[30494]: pgmap v502: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.4 MiB/s wr, 667 op/s 2024-09-13T16:01:38.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.775+0000 7f91efe76740 1 Processor -- start 2024-09-13T16:01:38.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.775+0000 7f91efe76740 1 -- start start 2024-09-13T16:01:38.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.776+0000 7f91efe76740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55904e4b0a70 0x55904e4b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:38.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.776+0000 7f91efe76740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904e4b13b0 0x55904e4b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:38.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.776+0000 7f91efe76740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b6440 0x55904e4c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:38.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.776+0000 7f91efe76740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904e17ae60 con 0x55904e4b13b0 2024-09-13T16:01:38.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.776+0000 7f91efe76740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904e406800 con 0x55904e4b6440 2024-09-13T16:01:38.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.776+0000 7f91efe76740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904e4bb940 con 0x55904e4b0a70 2024-09-13T16:01:38.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.776+0000 7f91e5e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55904e4b0a70 0x55904e4b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:38.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.776+0000 7f91e6800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b6440 0x55904e4c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:38.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.776+0000 7f91e5e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55904e4b0a70 0x55904e4b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:41784/0 (socket says 172.21.15.17:41784) 2024-09-13T16:01:38.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.776+0000 7f91e5e00640 1 -- 172.21.15.17:0/1496526426 learned_addr learned my addr 172.21.15.17:0/1496526426 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:01:38.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.777+0000 7f91e5400640 1 --2- 172.21.15.17:0/1496526426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904e4b13b0 0x55904e4b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:38.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.777+0000 7f91e5e00640 1 -- 172.21.15.17:0/1496526426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b6440 msgr2=0x55904e4c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:38.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.777+0000 7f91e5e00640 1 --2- 172.21.15.17:0/1496526426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b6440 0x55904e4c1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.777+0000 7f91e5e00640 1 -- 172.21.15.17:0/1496526426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904e4b13b0 msgr2=0x55904e4b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:38.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.777+0000 7f91e5e00640 1 --2- 172.21.15.17:0/1496526426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904e4b13b0 0x55904e4b28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.777+0000 7f91e5e00640 1 -- 172.21.15.17:0/1496526426 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55904e3b4180 con 0x55904e4b0a70 2024-09-13T16:01:38.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.777+0000 7f91e5e00640 1 --2- 172.21.15.17:0/1496526426 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55904e4b0a70 0x55904e4b2370 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f91e000c700 tx=0x7f91e00d0e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b222a0633617c987 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:38.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.777+0000 7f91d7e00640 1 -- 172.21.15.17:0/1496526426 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e00cd550 con 0x55904e4b0a70 2024-09-13T16:01:38.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.777+0000 7f91d7e00640 1 -- 172.21.15.17:0/1496526426 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91e00850c0 con 0x55904e4b0a70 2024-09-13T16:01:38.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.777+0000 7f91d7e00640 1 -- 172.21.15.17:0/1496526426 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e009aa90 con 0x55904e4b0a70 2024-09-13T16:01:38.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.779+0000 7f91efe76740 1 -- 172.21.15.17:0/1496526426 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55904e4b0a70 msgr2=0x55904e4b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:38.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.779+0000 7f91efe76740 1 --2- 172.21.15.17:0/1496526426 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55904e4b0a70 0x55904e4b2370 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f91e000c700 tx=0x7f91e00d0e10 comp rx=0 tx=0).stop 2024-09-13T16:01:38.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.779+0000 7f91efe76740 1 -- 172.21.15.17:0/1496526426 shutdown_connections 2024-09-13T16:01:38.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.779+0000 7f91efe76740 1 --2- 172.21.15.17:0/1496526426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b6440 0x55904e4c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.779+0000 7f91efe76740 1 --2- 172.21.15.17:0/1496526426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904e4b13b0 0x55904e4b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.779+0000 7f91efe76740 1 --2- 172.21.15.17:0/1496526426 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55904e4b0a70 0x55904e4b2370 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.779+0000 7f91efe76740 1 -- 172.21.15.17:0/1496526426 >> 172.21.15.17:0/1496526426 conn(0x55904e4ac0e0 msgr2=0x55904e4ac4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:38.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.779+0000 7f91efe76740 1 -- 172.21.15.17:0/1496526426 shutdown_connections 2024-09-13T16:01:38.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.780+0000 7f91efe76740 1 -- 172.21.15.17:0/1496526426 wait complete. 2024-09-13T16:01:38.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.780+0000 7f91efe76740 1 -- start start 2024-09-13T16:01:38.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.780+0000 7f91efe76740 1 Processor -- start 2024-09-13T16:01:38.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.782+0000 7f91efe76740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55904e4b0a70 0x55904e4c1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:38.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.782+0000 7f91efe76740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904e4b13b0 0x55904e4bff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:38.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.782+0000 7f91efe76740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b6440 0x55904e4c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:38.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.782+0000 7f91e6800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b6440 0x55904e4c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:38.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.782+0000 7f91e6800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b6440 0x55904e4c0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:55830/0 (socket says 172.21.15.17:55830) 2024-09-13T16:01:38.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.782+0000 7f91e6800640 1 -- 172.21.15.17:0/4202693613 learned_addr learned my addr 172.21.15.17:0/4202693613 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:01:38.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.783+0000 7f91e5e00640 1 --2- 172.21.15.17:0/4202693613 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55904e4b0a70 0x55904e4c1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:38.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.783+0000 7f91efe76740 1 -- 172.21.15.17:0/4202693613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904e4c2150 con 0x55904e4b13b0 2024-09-13T16:01:38.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.783+0000 7f91efe76740 1 -- 172.21.15.17:0/4202693613 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904e4c09c0 con 0x55904e4b6440 2024-09-13T16:01:38.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.783+0000 7f91efe76740 1 -- 172.21.15.17:0/4202693613 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904e4c0b80 con 0x55904e4b0a70 2024-09-13T16:01:38.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.783+0000 7f91efe76740 10 client.0 _ll_register_callbacks cb 0x7f91e00d0ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:01:38.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.784+0000 7f91e5400640 1 --2- 172.21.15.17:0/4202693613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904e4b13b0 0x55904e4bff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:38.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.784+0000 7f91e6800640 1 -- 172.21.15.17:0/4202693613 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55904e4b0a70 msgr2=0x55904e4c1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:38.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.785+0000 7f91e6800640 1 --2- 172.21.15.17:0/4202693613 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55904e4b0a70 0x55904e4c1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.785+0000 7f91e6800640 1 -- 172.21.15.17:0/4202693613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904e4b13b0 msgr2=0x55904e4bff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:38.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.785+0000 7f91e6800640 1 --2- 172.21.15.17:0/4202693613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904e4b13b0 0x55904e4bff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.785+0000 7f91e6800640 1 -- 172.21.15.17:0/4202693613 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55904e3b5940 con 0x55904e4b6440 2024-09-13T16:01:38.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.785+0000 7f91e5400640 1 --2- 172.21.15.17:0/4202693613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904e4b13b0 0x55904e4bff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:01:38.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.786+0000 7f91cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:01:38.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.786+0000 7f91e6800640 1 --2- 172.21.15.17:0/4202693613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b6440 0x55904e4c0480 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f91d803c820 tx=0x7f91d8003b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e09ec78e2e1ff18 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:38.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.786+0000 7f91cbe00640 1 -- 172.21.15.17:0/4202693613 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d80319b0 con 0x55904e4b6440 2024-09-13T16:01:38.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.787+0000 7f91cbe00640 1 -- 172.21.15.17:0/4202693613 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f91d8031b10 con 0x55904e4b6440 2024-09-13T16:01:38.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.787+0000 7f91efe76740 1 -- 172.21.15.17:0/4202693613 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55904e107300 con 0x55904e4b6440 2024-09-13T16:01:38.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.788+0000 7f91cbe00640 1 -- 172.21.15.17:0/4202693613 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91d803cb80 con 0x55904e4b6440 2024-09-13T16:01:38.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.788+0000 7f91efe76740 10 client.25676 fetch_fsmap learned FSMap version 30 2024-09-13T16:01:38.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.788+0000 7f91efe76740 1 -- 172.21.15.17:0/4202693613 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55904e3d9560 con 0x55904e4b6440 2024-09-13T16:01:38.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.789+0000 7f91cbe00640 1 -- 172.21.15.17:0/4202693613 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55904e107300 con 0x55904e4b6440 2024-09-13T16:01:38.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.789+0000 7f91cbe00640 1 -- 172.21.15.17:0/4202693613 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) v1 ==== 7490+0+0 (secure 0 0 0) 0x7f91d805c400 con 0x55904e4b6440 2024-09-13T16:01:38.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.790+0000 7f91efe76740 10 client.25676 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T16:01:38.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.790+0000 7f91efe76740 10 client.25676 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:01:38.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.790+0000 7f91efe76740 20 client.25676 populate_metadata read hostname 'smithi017' 2024-09-13T16:01:38.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.790+0000 7f91efe76740 1 --2- 172.21.15.17:0/4202693613 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55904e51dd40 0x55904e520160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:38.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.790+0000 7f91efe76740 4 client.25676 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:01:38.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.790+0000 7f91efe76740 1 -- 172.21.15.17:0/4202693613 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55904e118600 con 0x55904e51dd40 2024-09-13T16:01:38.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.791+0000 7f91e5e00640 1 --2- 172.21.15.17:0/4202693613 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55904e51dd40 0x55904e520160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:38.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.791+0000 7f91e5e00640 1 --2- 172.21.15.17:0/4202693613 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55904e51dd40 0x55904e520160 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=951023a2d8e91a90 server_cookie=6c16cff5eb04b63a in_seq=0 out_seq=0 2024-09-13T16:01:38.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.792+0000 7f91cbe00640 10 client.25676 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:01:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.820+0000 7f91cbe00640 1 -- 172.21.15.17:0/4202693613 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55904e118600 con 0x55904e51dd40 2024-09-13T16:01:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.820+0000 7f91cbe00640 10 client.25676 handle_command_reply: tid=0 2024-09-13T16:01:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.820+0000 7f91efe76740 1 client.25676 shutdown 2024-09-13T16:01:38.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.821+0000 7f91efe76740 1 -- 172.21.15.17:0/4202693613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b6440 msgr2=0x55904e4c0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:38.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.821+0000 7f91efe76740 1 --2- 172.21.15.17:0/4202693613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b6440 0x55904e4c0480 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f91d803c820 tx=0x7f91d8003b40 comp rx=0 tx=0).stop 2024-09-13T16:01:38.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.821+0000 7f91efe76740 1 -- 172.21.15.17:0/4202693613 shutdown_connections 2024-09-13T16:01:38.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.821+0000 7f91efe76740 1 --2- 172.21.15.17:0/4202693613 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55904e51dd40 0x55904e520160 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.823+0000 7f91efe76740 1 --2- 172.21.15.17:0/4202693613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55904e4b6440 0x55904e4c0480 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.823+0000 7f91cbe00640 0 client.25676 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:01:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.823+0000 7f91efe76740 1 --2- 172.21.15.17:0/4202693613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904e4b13b0 0x55904e4bff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.823+0000 7f91efe76740 1 --2- 172.21.15.17:0/4202693613 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55904e4b0a70 0x55904e4c1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.823+0000 7f91efe76740 1 -- 172.21.15.17:0/4202693613 >> 172.21.15.17:0/4202693613 conn(0x55904e4ac0e0 msgr2=0x55904e4b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.823+0000 7f91efe76740 1 -- 172.21.15.17:0/4202693613 shutdown_connections 2024-09-13T16:01:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.823+0000 7f91efe76740 1 -- 172.21.15.17:0/4202693613 wait complete. 2024-09-13T16:01:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.825+0000 7f91efe76740 20 client.25676 trim_cache size 0 max 16384 2024-09-13T16:01:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:01:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:01:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:01:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:01:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.826+0000 7f91ed000640 1 -- 172.21.15.17:0/3745220267 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f91cc0a10e0 msgr2=0x7f91cc0a35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.826+0000 7f91ed000640 1 --2- 172.21.15.17:0/3745220267 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f91cc0a10e0 0x7f91cc0a35a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f91d80057c0 tx=0x7f91d8005b50 comp rx=0 tx=0).stop 2024-09-13T16:01:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.826+0000 7f91ed000640 1 -- 172.21.15.17:0/3745220267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91e8070eb0 msgr2=0x7f91e819e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.826+0000 7f91ed000640 1 --2- 172.21.15.17:0/3745220267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91e8070eb0 0x7f91e819e580 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f91e000eab0 tx=0x7f91e000ef70 comp rx=0 tx=0).stop 2024-09-13T16:01:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.826+0000 7f91ed000640 1 -- 172.21.15.17:0/3745220267 shutdown_connections 2024-09-13T16:01:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.826+0000 7f91ed000640 1 --2- 172.21.15.17:0/3745220267 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f91cc0a10e0 0x7f91cc0a35a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.826+0000 7f91ed000640 1 --2- 172.21.15.17:0/3745220267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91e8107ad0 0x7f91e81a5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.826+0000 7f91ed000640 1 --2- 172.21.15.17:0/3745220267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e8071870 0x7f91e819eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.826+0000 7f91ed000640 1 --2- 172.21.15.17:0/3745220267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91e8070eb0 0x7f91e819e580 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:38.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.826+0000 7f91ed000640 1 -- 172.21.15.17:0/3745220267 >> 172.21.15.17:0/3745220267 conn(0x7f91e806cf30 msgr2=0x7f91e810ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:38.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.826+0000 7f91ed000640 1 -- 172.21.15.17:0/3745220267 shutdown_connections 2024-09-13T16:01:38.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:38.826+0000 7f91ed000640 1 -- 172.21.15.17:0/3745220267 wait complete. 2024-09-13T16:01:38.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:38 smithi189 ceph-mon[34790]: pgmap v502: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.4 MiB/s wr, 667 op/s 2024-09-13T16:01:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 235.0 s, 1003.8 tps, lat 98.596 ms stddev 112.343 2024-09-13T16:01:40.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:40 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:01:40.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:40 smithi189 ceph-mon[34790]: pgmap v503: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.0 MiB/s wr, 670 op/s 2024-09-13T16:01:40.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:40 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:01:40.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:40 smithi193 ceph-mon[35248]: pgmap v503: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.0 MiB/s wr, 670 op/s 2024-09-13T16:01:40.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:40 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:01:40.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:40 smithi017 ceph-mon[30494]: pgmap v503: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.0 MiB/s wr, 670 op/s 2024-09-13T16:01:41.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:41 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:01:41.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:41 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:01:41.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:41 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T16:01:42.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:41 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:01:42.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:41 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:01:42.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:41 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T16:01:42.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:41 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:01:42.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:41 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:01:42.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:41 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T16:01:42.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:42 smithi189 ceph-mon[34790]: pgmap v504: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.1 MiB/s wr, 595 op/s 2024-09-13T16:01:43.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:42 smithi193 ceph-mon[35248]: pgmap v504: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.1 MiB/s wr, 595 op/s 2024-09-13T16:01:43.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:42 smithi017 ceph-mon[30494]: pgmap v504: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.1 MiB/s wr, 595 op/s 2024-09-13T16:01:44.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:44 smithi193 ceph-mon[35248]: pgmap v505: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.8 MiB/s wr, 560 op/s 2024-09-13T16:01:44.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:44 smithi017 ceph-mon[30494]: pgmap v505: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.8 MiB/s wr, 560 op/s 2024-09-13T16:01:44.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:44 smithi189 ceph-mon[34790]: pgmap v505: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.8 MiB/s wr, 560 op/s 2024-09-13T16:01:45.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 240.0 s, 839.6 tps, lat 119.601 ms stddev 173.572 2024-09-13T16:01:46.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:46 smithi193 ceph-mon[35248]: pgmap v506: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 MiB/s wr, 618 op/s 2024-09-13T16:01:46.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:46 smithi017 ceph-mon[30494]: pgmap v506: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 MiB/s wr, 618 op/s 2024-09-13T16:01:46.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:46 smithi189 ceph-mon[34790]: pgmap v506: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 MiB/s wr, 618 op/s 2024-09-13T16:01:48.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:48 smithi193 ceph-mon[35248]: pgmap v507: 129 pgs: 129 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.4 MiB/s wr, 513 op/s 2024-09-13T16:01:48.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:48 smithi017 ceph-mon[30494]: pgmap v507: 129 pgs: 129 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.4 MiB/s wr, 513 op/s 2024-09-13T16:01:48.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:48 smithi189 ceph-mon[34790]: pgmap v507: 129 pgs: 129 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.4 MiB/s wr, 513 op/s 2024-09-13T16:01:50.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 245.0 s, 1359.0 tps, lat 73.901 ms stddev 94.134 2024-09-13T16:01:50.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:50 smithi193 ceph-mon[35248]: pgmap v508: 129 pgs: 129 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 MiB/s wr, 530 op/s 2024-09-13T16:01:50.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:50 smithi017 ceph-mon[30494]: pgmap v508: 129 pgs: 129 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 MiB/s wr, 530 op/s 2024-09-13T16:01:50.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:50 smithi189 ceph-mon[34790]: pgmap v508: 129 pgs: 129 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 MiB/s wr, 530 op/s 2024-09-13T16:01:52.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.025+0000 7ff7dba00640 1 -- 172.21.15.17:0/2174631033 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7d4079f80 msgr2=0x7ff7d407a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.025+0000 7ff7dba00640 1 --2- 172.21.15.17:0/2174631033 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7d4079f80 0x7ff7d407a400 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0009900 tx=0x7ff7c002a490 comp rx=0 tx=0).stop 2024-09-13T16:01:52.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.026+0000 7ff7dba00640 1 -- 172.21.15.17:0/2174631033 shutdown_connections 2024-09-13T16:01:52.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.026+0000 7ff7dba00640 1 --2- 172.21.15.17:0/2174631033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7d407a940 0x7ff7d41172f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.026+0000 7ff7dba00640 1 --2- 172.21.15.17:0/2174631033 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7d4079f80 0x7ff7d407a400 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.026+0000 7ff7dba00640 1 --2- 172.21.15.17:0/2174631033 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7d4078da0 0x7ff7d40791a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.026+0000 7ff7dba00640 1 -- 172.21.15.17:0/2174631033 >> 172.21.15.17:0/2174631033 conn(0x7ff7d4075730 msgr2=0x7ff7d4077b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.027+0000 7ff7dba00640 1 -- 172.21.15.17:0/2174631033 shutdown_connections 2024-09-13T16:01:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.027+0000 7ff7dba00640 1 -- 172.21.15.17:0/2174631033 wait complete. 2024-09-13T16:01:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.028+0000 7ff7dba00640 1 Processor -- start 2024-09-13T16:01:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.028+0000 7ff7dba00640 1 -- start start 2024-09-13T16:01:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.029+0000 7ff7dba00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7d4078da0 0x7ff7d41a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.029+0000 7ff7dba00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7d4079f80 0x7ff7d41a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.029+0000 7ff7dba00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7d407a940 0x7ff7d41ac150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.029+0000 7ff7dba00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d41ac690 con 0x7ff7d4078da0 2024-09-13T16:01:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.029+0000 7ff7dba00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d41ac800 con 0x7ff7d4079f80 2024-09-13T16:01:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.029+0000 7ff7dba00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d41ac9c0 con 0x7ff7d407a940 2024-09-13T16:01:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.030+0000 7ff7d3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7d4079f80 0x7ff7d41a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.030+0000 7ff7d9000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7d4078da0 0x7ff7d41a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.030+0000 7ff7d3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7d4079f80 0x7ff7d41a50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:56322/0 (socket says 172.21.15.17:56322) 2024-09-13T16:01:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.030+0000 7ff7d3e00640 1 -- 172.21.15.17:0/1496735744 learned_addr learned my addr 172.21.15.17:0/1496735744 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:01:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.030+0000 7ff7d9a00640 1 --2- 172.21.15.17:0/1496735744 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7d407a940 0x7ff7d41ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.030+0000 7ff7d9000640 1 -- 172.21.15.17:0/1496735744 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7d407a940 msgr2=0x7ff7d41ac150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.030+0000 7ff7d9000640 1 --2- 172.21.15.17:0/1496735744 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7d407a940 0x7ff7d41ac150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.030+0000 7ff7d9000640 1 -- 172.21.15.17:0/1496735744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7d4079f80 msgr2=0x7ff7d41a50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.030+0000 7ff7d9000640 1 --2- 172.21.15.17:0/1496735744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7d4079f80 0x7ff7d41a50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.030+0000 7ff7d9000640 1 -- 172.21.15.17:0/1496735744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c0009560 con 0x7ff7d4078da0 2024-09-13T16:01:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.031+0000 7ff7d9000640 1 --2- 172.21.15.17:0/1496735744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7d4078da0 0x7ff7d41a4ba0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff7c800c940 tx=0x7ff7c800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.032+0000 7ff7d1600640 1 -- 172.21.15.17:0/1496735744 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c8004220 con 0x7ff7d4078da0 2024-09-13T16:01:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.032+0000 7ff7d1600640 1 -- 172.21.15.17:0/1496735744 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7c8007e70 con 0x7ff7d4078da0 2024-09-13T16:01:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.032+0000 7ff7d1600640 1 -- 172.21.15.17:0/1496735744 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c8003e20 con 0x7ff7d4078da0 2024-09-13T16:01:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.034+0000 7ff7dba00640 1 -- 172.21.15.17:0/1496735744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d41acca0 con 0x7ff7d4078da0 2024-09-13T16:01:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.034+0000 7ff7dba00640 1 -- 172.21.15.17:0/1496735744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d41ad160 con 0x7ff7d4078da0 2024-09-13T16:01:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.041+0000 7ff7de8c3740 1 Processor -- start 2024-09-13T16:01:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.042+0000 7ff7d1600640 1 -- 172.21.15.17:0/1496735744 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff7c80079b0 con 0x7ff7d4078da0 2024-09-13T16:01:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.043+0000 7ff7de8c3740 1 -- start start 2024-09-13T16:01:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.043+0000 7ff7de8c3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb0677a70 0x55dbb0677e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.043+0000 7ff7de8c3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbb06783b0 0x55dbb067ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.043+0000 7ff7de8c3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb067d440 0x55dbb067f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.043+0000 7ff7de8c3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbb0583bb0 con 0x55dbb06783b0 2024-09-13T16:01:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.043+0000 7ff7de8c3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbb05e1a70 con 0x55dbb067d440 2024-09-13T16:01:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.043+0000 7ff7de8c3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbb05df200 con 0x55dbb0677a70 2024-09-13T16:01:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.044+0000 7ff7d9a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb0677a70 0x55dbb0677e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.044+0000 7ff7d3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb067d440 0x55dbb067f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.044+0000 7ff7d9a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb0677a70 0x55dbb0677e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:45040/0 (socket says 172.21.15.17:45040) 2024-09-13T16:01:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.044+0000 7ff7d9a00640 1 -- 172.21.15.17:0/2316108197 learned_addr learned my addr 172.21.15.17:0/2316108197 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:01:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.044+0000 7ff7d1600640 1 --2- 172.21.15.17:0/1496735744 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff7bc0a1110 0x7ff7bc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.044+0000 7ff7d9a00640 1 -- 172.21.15.17:0/2316108197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb067d440 msgr2=0x55dbb067f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.044+0000 7ff7d9a00640 1 --2- 172.21.15.17:0/2316108197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb067d440 0x55dbb067f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.044+0000 7ff7d9a00640 1 -- 172.21.15.17:0/2316108197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbb06783b0 msgr2=0x55dbb067ce70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:01:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.044+0000 7ff7d9a00640 1 --2- 172.21.15.17:0/2316108197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbb06783b0 0x55dbb067ce70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.044+0000 7ff7d9a00640 1 -- 172.21.15.17:0/2316108197 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbb057c940 con 0x55dbb0677a70 2024-09-13T16:01:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.044+0000 7ff7d1600640 1 -- 172.21.15.17:0/1496735744 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7ff7c80cc5a0 con 0x7ff7d4078da0 2024-09-13T16:01:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.044+0000 7ff7d9a00640 1 --2- 172.21.15.17:0/2316108197 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb0677a70 0x55dbb0677e70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc010370 tx=0x7ff7cc010830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8de95534ec0f1d6e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.045+0000 7ff7d9a00640 1 --2- 172.21.15.17:0/1496735744 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff7bc0a1110 0x7ff7bc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.045+0000 7ff7c6000640 1 -- 172.21.15.17:0/2316108197 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc01f040 con 0x55dbb0677a70 2024-09-13T16:01:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.045+0000 7ff7c6000640 1 -- 172.21.15.17:0/2316108197 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7cc012cb0 con 0x55dbb0677a70 2024-09-13T16:01:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.045+0000 7ff7c6000640 1 -- 172.21.15.17:0/2316108197 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc01f040 con 0x55dbb0677a70 2024-09-13T16:01:52.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.046+0000 7ff7de8c3740 1 -- 172.21.15.17:0/2316108197 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb0677a70 msgr2=0x55dbb0677e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.046+0000 7ff7de8c3740 1 --2- 172.21.15.17:0/2316108197 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb0677a70 0x55dbb0677e70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc010370 tx=0x7ff7cc010830 comp rx=0 tx=0).stop 2024-09-13T16:01:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.052+0000 7ff7de8c3740 1 -- 172.21.15.17:0/2316108197 shutdown_connections 2024-09-13T16:01:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.052+0000 7ff7de8c3740 1 --2- 172.21.15.17:0/2316108197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb067d440 0x55dbb067f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.052+0000 7ff7de8c3740 1 --2- 172.21.15.17:0/2316108197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbb06783b0 0x55dbb067ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.052+0000 7ff7de8c3740 1 --2- 172.21.15.17:0/2316108197 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb0677a70 0x55dbb0677e70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.052+0000 7ff7de8c3740 1 -- 172.21.15.17:0/2316108197 >> 172.21.15.17:0/2316108197 conn(0x55dbb06730e0 msgr2=0x55dbb06734e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.053+0000 7ff7de8c3740 1 -- 172.21.15.17:0/2316108197 shutdown_connections 2024-09-13T16:01:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.053+0000 7ff7de8c3740 1 -- 172.21.15.17:0/2316108197 wait complete. 2024-09-13T16:01:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.054+0000 7ff7d9a00640 1 --2- 172.21.15.17:0/1496735744 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff7bc0a1110 0x7ff7bc0a35d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc01bdf0 tx=0x7ff7cc01bd60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.054+0000 7ff7de8c3740 1 -- start start 2024-09-13T16:01:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.054+0000 7ff7de8c3740 1 Processor -- start 2024-09-13T16:01:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.056+0000 7ff7de8c3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb0677a70 0x55dbb0681820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.056+0000 7ff7de8c3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbb06783b0 0x55dbb0681d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.056+0000 7ff7de8c3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb067d440 0x55dbb0688d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.056+0000 7ff7d9000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb0677a70 0x55dbb0681820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.056+0000 7ff7d9000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb0677a70 0x55dbb0681820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:56354/0 (socket says 172.21.15.17:56354) 2024-09-13T16:01:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.056+0000 7ff7d3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbb06783b0 0x55dbb0681d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.057+0000 7ff7de8c3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbb05daaf0 con 0x55dbb06783b0 2024-09-13T16:01:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.057+0000 7ff7de8c3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbb0598f20 con 0x55dbb0677a70 2024-09-13T16:01:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.057+0000 7ff7de8c3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbb0598bc0 con 0x55dbb067d440 2024-09-13T16:01:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.057+0000 7ff7de8c3740 10 client.0 _ll_register_callbacks cb 0x55dbb05caa70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:01:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.057+0000 7ff7d9a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb067d440 0x55dbb0688d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.057+0000 7ff7d3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbb06783b0 0x55dbb0681d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51186/0 (socket says 172.21.15.17:51186) 2024-09-13T16:01:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.057+0000 7ff7d3e00640 1 -- 172.21.15.17:0/260025807 learned_addr learned my addr 172.21.15.17:0/260025807 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:01:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.058+0000 7ff7d9000640 1 -- 172.21.15.17:0/260025807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb067d440 msgr2=0x55dbb0688d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.058+0000 7ff7d9000640 1 --2- 172.21.15.17:0/260025807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb067d440 0x55dbb0688d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.058+0000 7ff7d9000640 1 -- 172.21.15.17:0/260025807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbb06783b0 msgr2=0x55dbb0681d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.058+0000 7ff7d9000640 1 --2- 172.21.15.17:0/260025807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbb06783b0 0x55dbb0681d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.058+0000 7ff7d9000640 1 -- 172.21.15.17:0/260025807 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7cc009c50 con 0x55dbb0677a70 2024-09-13T16:01:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.058+0000 7ff7d9000640 1 --2- 172.21.15.17:0/260025807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb0677a70 0x55dbb0681820 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55dbb0678de0 tx=0x7ff7c8099470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=307e06d181ebe219 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.058+0000 7ff7baa00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:01:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.059+0000 7ff7baa00640 1 -- 172.21.15.17:0/260025807 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c8099da0 con 0x55dbb0677a70 2024-09-13T16:01:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.060+0000 7ff7baa00640 1 -- 172.21.15.17:0/260025807 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7ff7c80996a0 con 0x55dbb0677a70 2024-09-13T16:01:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.060+0000 7ff7de8c3740 1 -- 172.21.15.17:0/260025807 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dbb0604c90 con 0x55dbb0677a70 2024-09-13T16:01:52.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.063+0000 7ff7baa00640 1 -- 172.21.15.17:0/260025807 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7c809d4d0 con 0x55dbb0677a70 2024-09-13T16:01:52.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.063+0000 7ff7de8c3740 10 client.25685 fetch_fsmap learned FSMap version 30 2024-09-13T16:01:52.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.063+0000 7ff7de8c3740 1 -- 172.21.15.17:0/260025807 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55dbb05d9170 con 0x55dbb0677a70 2024-09-13T16:01:52.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.064+0000 7ff7baa00640 1 -- 172.21.15.17:0/260025807 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55dbb0604c90 con 0x55dbb0677a70 2024-09-13T16:01:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.064+0000 7ff7baa00640 1 -- 172.21.15.17:0/260025807 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) v1 ==== 7490+0+0 (secure 0 0 0) 0x7ff7c8016030 con 0x55dbb0677a70 2024-09-13T16:01:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.064+0000 7ff7de8c3740 10 client.25685 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T16:01:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.064+0000 7ff7de8c3740 10 client.25685 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:01:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.065+0000 7ff7de8c3740 20 client.25685 populate_metadata read hostname 'smithi017' 2024-09-13T16:01:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.065+0000 7ff7de8c3740 1 --2- 172.21.15.17:0/260025807 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55dbb068d400 0x55dbb068f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.065+0000 7ff7de8c3740 4 client.25685 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:01:52.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.065+0000 7ff7de8c3740 1 -- 172.21.15.17:0/260025807 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dbb05cd7d0 con 0x55dbb068d400 2024-09-13T16:01:52.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.066+0000 7ff7d3e00640 1 --2- 172.21.15.17:0/260025807 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55dbb068d400 0x55dbb068f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.066+0000 7ff7d3e00640 1 --2- 172.21.15.17:0/260025807 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55dbb068d400 0x55dbb068f820 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=713fe85c7062c00 server_cookie=9f60f62db0032253 in_seq=0 out_seq=0 2024-09-13T16:01:52.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.066+0000 7ff7baa00640 10 client.25685 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:01:52.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.067+0000 7ff7baa00640 1 -- 172.21.15.17:0/260025807 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55dbb05cd7d0 con 0x55dbb068d400 2024-09-13T16:01:52.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.067+0000 7ff7baa00640 10 client.25685 handle_command_reply: tid=0 2024-09-13T16:01:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.067+0000 7ff7de8c3740 1 client.25685 shutdown 2024-09-13T16:01:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.068+0000 7ff7de8c3740 1 -- 172.21.15.17:0/260025807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb0677a70 msgr2=0x55dbb0681820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.068+0000 7ff7de8c3740 1 --2- 172.21.15.17:0/260025807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb0677a70 0x55dbb0681820 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55dbb0678de0 tx=0x7ff7c8099470 comp rx=0 tx=0).stop 2024-09-13T16:01:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.069+0000 7ff7de8c3740 1 -- 172.21.15.17:0/260025807 shutdown_connections 2024-09-13T16:01:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.069+0000 7ff7de8c3740 1 --2- 172.21.15.17:0/260025807 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55dbb068d400 0x55dbb068f820 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.069+0000 7ff7de8c3740 1 --2- 172.21.15.17:0/260025807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb067d440 0x55dbb0688d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.069+0000 7ff7de8c3740 1 --2- 172.21.15.17:0/260025807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbb06783b0 0x55dbb0681d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.069+0000 7ff7de8c3740 1 --2- 172.21.15.17:0/260025807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb0677a70 0x55dbb0681820 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.069+0000 7ff7baa00640 0 client.25685 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:01:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.069+0000 7ff7de8c3740 1 -- 172.21.15.17:0/260025807 >> 172.21.15.17:0/260025807 conn(0x55dbb06730e0 msgr2=0x55dbb06748f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.069+0000 7ff7de8c3740 1 -- 172.21.15.17:0/260025807 shutdown_connections 2024-09-13T16:01:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.070+0000 7ff7de8c3740 1 -- 172.21.15.17:0/260025807 wait complete. 2024-09-13T16:01:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.071+0000 7ff7de8c3740 20 client.25685 trim_cache size 0 max 16384 2024-09-13T16:01:52.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.091+0000 7ff7de8c3740 1 Processor -- start 2024-09-13T16:01:52.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.091+0000 7ff7de8c3740 1 -- start start 2024-09-13T16:01:52.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.092+0000 7ff7de8c3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb0677a70 0x55dbb06793d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.092+0000 7ff7de8c3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb06783b0 0x55dbb0688ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.092+0000 7ff7de8c3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbb067d440 0x55dbb0679910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.092+0000 7ff7de8c3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbb0341e60 con 0x55dbb067d440 2024-09-13T16:01:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.092+0000 7ff7de8c3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbb066eb10 con 0x55dbb0677a70 2024-09-13T16:01:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.092+0000 7ff7de8c3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbb068ba20 con 0x55dbb06783b0 2024-09-13T16:01:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.092+0000 7ff7d9000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb0677a70 0x55dbb06793d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.092+0000 7ff7d9000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb0677a70 0x55dbb06793d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:56368/0 (socket says 172.21.15.17:56368) 2024-09-13T16:01:52.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.092+0000 7ff7d9000640 1 -- 172.21.15.17:0/1834787134 learned_addr learned my addr 172.21.15.17:0/1834787134 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:01:52.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.093+0000 7ff7d9a00640 1 --2- 172.21.15.17:0/1834787134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbb067d440 0x55dbb0679910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.093+0000 7ff7d3e00640 1 --2- 172.21.15.17:0/1834787134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb06783b0 0x55dbb0688ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.094+0000 7ff7d3e00640 1 -- 172.21.15.17:0/1834787134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb0677a70 msgr2=0x55dbb06793d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:52.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.094+0000 7ff7d3e00640 1 --2- 172.21.15.17:0/1834787134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb0677a70 0x55dbb06793d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.094+0000 7ff7d3e00640 1 -- 172.21.15.17:0/1834787134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbb067d440 msgr2=0x55dbb0679910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:52.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.094+0000 7ff7d3e00640 1 --2- 172.21.15.17:0/1834787134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbb067d440 0x55dbb0679910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.095+0000 7ff7d3e00640 1 -- 172.21.15.17:0/1834787134 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbb057b180 con 0x55dbb06783b0 2024-09-13T16:01:52.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.096+0000 7ff7d3e00640 1 --2- 172.21.15.17:0/1834787134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb06783b0 0x55dbb0688ce0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55dbb0690100 tx=0x7ff7c0005760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f07558418e18d038 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:52.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.097+0000 7ff7c6a00640 1 -- 172.21.15.17:0/1834787134 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0043040 con 0x55dbb06783b0 2024-09-13T16:01:52.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.097+0000 7ff7c6a00640 1 -- 172.21.15.17:0/1834787134 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7c0045d70 con 0x55dbb06783b0 2024-09-13T16:01:52.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.097+0000 7ff7c6a00640 1 -- 172.21.15.17:0/1834787134 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0003d00 con 0x55dbb06783b0 2024-09-13T16:01:52.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.098+0000 7ff7de8c3740 1 -- 172.21.15.17:0/1834787134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb06783b0 msgr2=0x55dbb0688ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.098+0000 7ff7de8c3740 1 --2- 172.21.15.17:0/1834787134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb06783b0 0x55dbb0688ce0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55dbb0690100 tx=0x7ff7c0005760 comp rx=0 tx=0).stop 2024-09-13T16:01:52.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.098+0000 7ff7de8c3740 1 -- 172.21.15.17:0/1834787134 shutdown_connections 2024-09-13T16:01:52.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.098+0000 7ff7de8c3740 1 --2- 172.21.15.17:0/1834787134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbb067d440 0x55dbb0679910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.098+0000 7ff7de8c3740 1 --2- 172.21.15.17:0/1834787134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb06783b0 0x55dbb0688ce0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.098+0000 7ff7de8c3740 1 --2- 172.21.15.17:0/1834787134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb0677a70 0x55dbb06793d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.098+0000 7ff7de8c3740 1 -- 172.21.15.17:0/1834787134 >> 172.21.15.17:0/1834787134 conn(0x55dbb06730e0 msgr2=0x55dbb0694180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:52.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.098+0000 7ff7de8c3740 1 -- 172.21.15.17:0/1834787134 shutdown_connections 2024-09-13T16:01:52.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.098+0000 7ff7de8c3740 1 -- 172.21.15.17:0/1834787134 wait complete. 2024-09-13T16:01:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.099+0000 7ff7de8c3740 1 -- start start 2024-09-13T16:01:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.099+0000 7ff7de8c3740 1 Processor -- start 2024-09-13T16:01:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.099+0000 7ff7de8c3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb0677a70 0x55dbb06885b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.099+0000 7ff7de8c3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb06783b0 0x55dbb0688af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.099+0000 7ff7de8c3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbb067d440 0x55dbb0686bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.099+0000 7ff7de8c3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbb0687200 con 0x55dbb067d440 2024-09-13T16:01:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.099+0000 7ff7de8c3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbb0687370 con 0x55dbb06783b0 2024-09-13T16:01:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.099+0000 7ff7de8c3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbb0687530 con 0x55dbb0677a70 2024-09-13T16:01:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.100+0000 7ff7de8c3740 10 client.0 _ll_register_callbacks cb 0x7ff7cc009a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:01:52.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.100+0000 7ff7d3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb06783b0 0x55dbb0688af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.100+0000 7ff7d3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb06783b0 0x55dbb0688af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:56374/0 (socket says 172.21.15.17:56374) 2024-09-13T16:01:52.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.100+0000 7ff7d3e00640 1 -- 172.21.15.17:0/598193682 learned_addr learned my addr 172.21.15.17:0/598193682 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:01:52.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.100+0000 7ff7d9000640 1 --2- 172.21.15.17:0/598193682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb0677a70 0x55dbb06885b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.100+0000 7ff7d9a00640 1 --2- 172.21.15.17:0/598193682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbb067d440 0x55dbb0686bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.100+0000 7ff7d3e00640 1 -- 172.21.15.17:0/598193682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb0677a70 msgr2=0x55dbb06885b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:52.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.100+0000 7ff7d3e00640 1 --2- 172.21.15.17:0/598193682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb0677a70 0x55dbb06885b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.100+0000 7ff7d3e00640 1 -- 172.21.15.17:0/598193682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbb067d440 msgr2=0x55dbb0686bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:01:52.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.100+0000 7ff7d3e00640 1 --2- 172.21.15.17:0/598193682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbb067d440 0x55dbb0686bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.100+0000 7ff7d3e00640 1 -- 172.21.15.17:0/598193682 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d41178b0 con 0x55dbb06783b0 2024-09-13T16:01:52.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.101+0000 7ff7d3e00640 1 --2- 172.21.15.17:0/598193682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb06783b0 0x55dbb0688af0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0000c00 tx=0x7ff7c0003800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9483170e02edf17 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:01:52.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.101+0000 7ff7baa00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:01:52.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.101+0000 7ff7baa00640 1 -- 172.21.15.17:0/598193682 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0043040 con 0x55dbb06783b0 2024-09-13T16:01:52.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.101+0000 7ff7baa00640 1 -- 172.21.15.17:0/598193682 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7ff7c0052070 con 0x55dbb06783b0 2024-09-13T16:01:52.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.101+0000 7ff7de8c3740 1 -- 172.21.15.17:0/598193682 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff7cc012cb0 con 0x55dbb06783b0 2024-09-13T16:01:52.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.102+0000 7ff7baa00640 1 -- 172.21.15.17:0/598193682 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7c0003e50 con 0x55dbb06783b0 2024-09-13T16:01:52.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.102+0000 7ff7de8c3740 10 client.25691 fetch_fsmap learned FSMap version 30 2024-09-13T16:01:52.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.102+0000 7ff7de8c3740 1 -- 172.21.15.17:0/598193682 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55dbb05a0560 con 0x55dbb06783b0 2024-09-13T16:01:52.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.102+0000 7ff7baa00640 1 -- 172.21.15.17:0/598193682 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7c005d030 con 0x55dbb06783b0 2024-09-13T16:01:52.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.103+0000 7ff7baa00640 1 -- 172.21.15.17:0/598193682 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) v1 ==== 7490+0+0 (secure 0 0 0) 0x7ff7c00457e0 con 0x55dbb06783b0 2024-09-13T16:01:52.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.103+0000 7ff7de8c3740 10 client.25691 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T16:01:52.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.103+0000 7ff7de8c3740 10 client.25691 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:01:52.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.103+0000 7ff7de8c3740 20 client.25691 populate_metadata read hostname 'smithi017' 2024-09-13T16:01:52.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.103+0000 7ff7de8c3740 1 --2- 172.21.15.17:0/598193682 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55dbb06e48a0 0x55dbb06e6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:01:52.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.103+0000 7ff7de8c3740 4 client.25691 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:01:52.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.103+0000 7ff7de8c3740 1 -- 172.21.15.17:0/598193682 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dbb02ce300 con 0x55dbb06e48a0 2024-09-13T16:01:52.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.103+0000 7ff7d9000640 1 --2- 172.21.15.17:0/598193682 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55dbb06e48a0 0x55dbb06e6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:01:52.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.104+0000 7ff7d9000640 1 --2- 172.21.15.17:0/598193682 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55dbb06e48a0 0x55dbb06e6c90 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d2aa858e27becf3 server_cookie=199d5209e87530d1 in_seq=0 out_seq=0 2024-09-13T16:01:52.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.104+0000 7ff7baa00640 10 client.25691 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:01:52.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.112+0000 7ff7baa00640 1 -- 172.21.15.17:0/598193682 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dbb02ce300 con 0x55dbb06e48a0 2024-09-13T16:01:52.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.112+0000 7ff7baa00640 10 client.25691 handle_command_reply: tid=0 2024-09-13T16:01:52.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.112+0000 7ff7de8c3740 1 client.25691 shutdown 2024-09-13T16:01:52.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.113+0000 7ff7de8c3740 1 -- 172.21.15.17:0/598193682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb06783b0 msgr2=0x55dbb0688af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.113+0000 7ff7de8c3740 1 --2- 172.21.15.17:0/598193682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb06783b0 0x55dbb0688af0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0000c00 tx=0x7ff7c0003800 comp rx=0 tx=0).stop 2024-09-13T16:01:52.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.113+0000 7ff7de8c3740 1 -- 172.21.15.17:0/598193682 shutdown_connections 2024-09-13T16:01:52.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.113+0000 7ff7de8c3740 1 --2- 172.21.15.17:0/598193682 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55dbb06e48a0 0x55dbb06e6c90 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.113+0000 7ff7de8c3740 1 --2- 172.21.15.17:0/598193682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbb067d440 0x55dbb0686bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.113+0000 7ff7de8c3740 1 --2- 172.21.15.17:0/598193682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbb06783b0 0x55dbb0688af0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.113+0000 7ff7de8c3740 1 --2- 172.21.15.17:0/598193682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dbb0677a70 0x55dbb06885b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.113+0000 7ff7baa00640 0 client.25691 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:01:52.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.113+0000 7ff7de8c3740 1 -- 172.21.15.17:0/598193682 >> 172.21.15.17:0/598193682 conn(0x55dbb06730e0 msgr2=0x55dbb06815d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:52.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.113+0000 7ff7de8c3740 1 -- 172.21.15.17:0/598193682 shutdown_connections 2024-09-13T16:01:52.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.113+0000 7ff7de8c3740 1 -- 172.21.15.17:0/598193682 wait complete. 2024-09-13T16:01:52.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.114+0000 7ff7de8c3740 20 client.25691 trim_cache size 0 max 16384 2024-09-13T16:01:52.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:01:52.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:01:52.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:01:52.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:01:52.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.114+0000 7ff7dba00640 1 -- 172.21.15.17:0/1496735744 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff7bc0a1110 msgr2=0x7ff7bc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.114+0000 7ff7dba00640 1 --2- 172.21.15.17:0/1496735744 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff7bc0a1110 0x7ff7bc0a35d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc01bdf0 tx=0x7ff7cc01bd60 comp rx=0 tx=0).stop 2024-09-13T16:01:52.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.114+0000 7ff7dba00640 1 -- 172.21.15.17:0/1496735744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7d4078da0 msgr2=0x7ff7d41a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:01:52.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.114+0000 7ff7dba00640 1 --2- 172.21.15.17:0/1496735744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7d4078da0 0x7ff7d41a4ba0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff7c800c940 tx=0x7ff7c800ce00 comp rx=0 tx=0).stop 2024-09-13T16:01:52.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.114+0000 7ff7dba00640 1 -- 172.21.15.17:0/1496735744 shutdown_connections 2024-09-13T16:01:52.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.114+0000 7ff7dba00640 1 --2- 172.21.15.17:0/1496735744 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff7bc0a1110 0x7ff7bc0a35d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.114+0000 7ff7dba00640 1 --2- 172.21.15.17:0/1496735744 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7d407a940 0x7ff7d41ac150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.114+0000 7ff7dba00640 1 --2- 172.21.15.17:0/1496735744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7d4079f80 0x7ff7d41a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.114+0000 7ff7dba00640 1 --2- 172.21.15.17:0/1496735744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7d4078da0 0x7ff7d41a4ba0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:01:52.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.114+0000 7ff7dba00640 1 -- 172.21.15.17:0/1496735744 >> 172.21.15.17:0/1496735744 conn(0x7ff7d4075730 msgr2=0x7ff7d4077210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:01:52.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.115+0000 7ff7dba00640 1 -- 172.21.15.17:0/1496735744 shutdown_connections 2024-09-13T16:01:52.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:01:52.115+0000 7ff7dba00640 1 -- 172.21.15.17:0/1496735744 wait complete. 2024-09-13T16:01:52.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:52 smithi193 ceph-mon[35248]: pgmap v509: 129 pgs: 129 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.5 MiB/s wr, 594 op/s 2024-09-13T16:01:52.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:52 smithi017 ceph-mon[30494]: pgmap v509: 129 pgs: 129 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.5 MiB/s wr, 594 op/s 2024-09-13T16:01:52.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:52 smithi189 ceph-mon[34790]: pgmap v509: 129 pgs: 129 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.5 MiB/s wr, 594 op/s 2024-09-13T16:01:54.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:54 smithi193 ceph-mon[35248]: pgmap v510: 129 pgs: 129 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 6.3 MiB/s wr, 568 op/s 2024-09-13T16:01:54.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:54 smithi017 ceph-mon[30494]: pgmap v510: 129 pgs: 129 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 6.3 MiB/s wr, 568 op/s 2024-09-13T16:01:54.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:54 smithi189 ceph-mon[34790]: pgmap v510: 129 pgs: 129 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 6.3 MiB/s wr, 568 op/s 2024-09-13T16:01:55.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 250.0 s, 909.4 tps, lat 108.843 ms stddev 118.985 2024-09-13T16:01:56.657 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:56 smithi189 ceph-mon[34790]: pgmap v511: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.5 MiB/s wr, 602 op/s 2024-09-13T16:01:56.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:56 smithi193 ceph-mon[35248]: pgmap v511: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.5 MiB/s wr, 602 op/s 2024-09-13T16:01:56.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:56 smithi017 ceph-mon[30494]: pgmap v511: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.5 MiB/s wr, 602 op/s 2024-09-13T16:01:58.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:01:58 smithi193 ceph-mon[35248]: pgmap v512: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 5.9 MiB/s wr, 551 op/s 2024-09-13T16:01:58.764 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:01:58 smithi017 ceph-mon[30494]: pgmap v512: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 5.9 MiB/s wr, 551 op/s 2024-09-13T16:01:58.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:01:58 smithi189 ceph-mon[34790]: pgmap v512: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 5.9 MiB/s wr, 551 op/s 2024-09-13T16:02:00.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 255.0 s, 873.0 tps, lat 114.705 ms stddev 163.893 2024-09-13T16:02:00.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:00 smithi193 ceph-mon[35248]: pgmap v513: 129 pgs: 129 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 5.7 MiB/s wr, 615 op/s 2024-09-13T16:02:00.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:00 smithi017 ceph-mon[30494]: pgmap v513: 129 pgs: 129 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 5.7 MiB/s wr, 615 op/s 2024-09-13T16:02:00.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:00 smithi189 ceph-mon[34790]: pgmap v513: 129 pgs: 129 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 5.7 MiB/s wr, 615 op/s 2024-09-13T16:02:02.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:02 smithi193 ceph-mon[35248]: pgmap v514: 129 pgs: 129 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 6.0 MiB/s wr, 668 op/s 2024-09-13T16:02:02.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:02 smithi017 ceph-mon[30494]: pgmap v514: 129 pgs: 129 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 6.0 MiB/s wr, 668 op/s 2024-09-13T16:02:02.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:02 smithi189 ceph-mon[34790]: pgmap v514: 129 pgs: 129 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 6.0 MiB/s wr, 668 op/s 2024-09-13T16:02:04.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:04 smithi193 ceph-mon[35248]: pgmap v515: 129 pgs: 129 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 5.5 MiB/s wr, 597 op/s 2024-09-13T16:02:04.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:04 smithi017 ceph-mon[30494]: pgmap v515: 129 pgs: 129 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 5.5 MiB/s wr, 597 op/s 2024-09-13T16:02:04.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:04 smithi189 ceph-mon[34790]: pgmap v515: 129 pgs: 129 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 5.5 MiB/s wr, 597 op/s 2024-09-13T16:02:05.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.309+0000 7f911a600640 1 -- 172.21.15.17:0/851910132 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91140fe3d0 msgr2=0x7f91140fe7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.309+0000 7f911a600640 1 --2- 172.21.15.17:0/851910132 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91140fe3d0 0x7f91140fe7d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9104009930 tx=0x7f910402a460 comp rx=0 tx=0).stop 2024-09-13T16:02:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.309+0000 7f911a600640 1 -- 172.21.15.17:0/851910132 shutdown_connections 2024-09-13T16:02:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.309+0000 7f911a600640 1 --2- 172.21.15.17:0/851910132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91140ff6b0 0x7f91140ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.309+0000 7f911a600640 1 --2- 172.21.15.17:0/851910132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91140fed10 0x7f91140ff170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.309+0000 7f911a600640 1 --2- 172.21.15.17:0/851910132 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91140fe3d0 0x7f91140fe7d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.309+0000 7f911a600640 1 -- 172.21.15.17:0/851910132 >> 172.21.15.17:0/851910132 conn(0x7f91140fa1c0 msgr2=0x7f91140fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.310+0000 7f911a600640 1 -- 172.21.15.17:0/851910132 shutdown_connections 2024-09-13T16:02:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.310+0000 7f911a600640 1 -- 172.21.15.17:0/851910132 wait complete. 2024-09-13T16:02:05.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.311+0000 7f911a600640 1 Processor -- start 2024-09-13T16:02:05.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 260.0 s, 804.6 tps, lat 121.666 ms stddev 150.685 2024-09-13T16:02:05.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.312+0000 7f911a600640 1 -- start start 2024-09-13T16:02:05.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.312+0000 7f911a600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91140fe3d0 0x7f9114197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.312+0000 7f911a600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91140fed10 0x7f9114198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.312+0000 7f911a600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91140ff6b0 0x7f911419f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.312+0000 7f911a600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911419f830 con 0x7f91140fe3d0 2024-09-13T16:02:05.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.312+0000 7f911a600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911419f9a0 con 0x7f91140ff6b0 2024-09-13T16:02:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.312+0000 7f911a600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911419fb60 con 0x7f91140fed10 2024-09-13T16:02:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.313+0000 7f9119200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91140fe3d0 0x7f9114197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.313+0000 7f9113e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91140fed10 0x7f9114198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.313+0000 7f9119200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91140fe3d0 0x7f9114197d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40074/0 (socket says 172.21.15.17:40074) 2024-09-13T16:02:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.313+0000 7f9119200640 1 -- 172.21.15.17:0/938436305 learned_addr learned my addr 172.21.15.17:0/938436305 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.313+0000 7f9119c00640 1 --2- 172.21.15.17:0/938436305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91140ff6b0 0x7f911419f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.313+0000 7f9113e00640 1 -- 172.21.15.17:0/938436305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91140ff6b0 msgr2=0x7f911419f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.313+0000 7f9113e00640 1 --2- 172.21.15.17:0/938436305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91140ff6b0 0x7f911419f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.313+0000 7f9113e00640 1 -- 172.21.15.17:0/938436305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91140fe3d0 msgr2=0x7f9114197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.313+0000 7f9113e00640 1 --2- 172.21.15.17:0/938436305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91140fe3d0 0x7f9114197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.313+0000 7f9113e00640 1 -- 172.21.15.17:0/938436305 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9104009560 con 0x7f91140fed10 2024-09-13T16:02:05.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.314+0000 7f9113e00640 1 --2- 172.21.15.17:0/938436305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91140fed10 0x7f9114198280 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f910000e9f0 tx=0x7f910000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.316+0000 7f9111600640 1 -- 172.21.15.17:0/938436305 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910000ccc0 con 0x7f91140fed10 2024-09-13T16:02:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.316+0000 7f9111600640 1 -- 172.21.15.17:0/938436305 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f910000ce20 con 0x7f91140fed10 2024-09-13T16:02:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.316+0000 7f9111600640 1 -- 172.21.15.17:0/938436305 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91000187e0 con 0x7f91140fed10 2024-09-13T16:02:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.316+0000 7f911a600640 1 -- 172.21.15.17:0/938436305 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9114100780 con 0x7f91140fed10 2024-09-13T16:02:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.316+0000 7f911a600640 1 -- 172.21.15.17:0/938436305 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9114100c90 con 0x7f91140fed10 2024-09-13T16:02:05.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.322+0000 7f9111600640 1 -- 172.21.15.17:0/938436305 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9100010430 con 0x7f91140fed10 2024-09-13T16:02:05.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.323+0000 7f911ea0a740 1 Processor -- start 2024-09-13T16:02:05.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.323+0000 7f911ea0a740 1 -- start start 2024-09-13T16:02:05.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.323+0000 7f911ea0a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a55410c80 0x564a55411080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.323+0000 7f911ea0a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a554115c0 0x564a55416080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.323+0000 7f911ea0a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a55416650 0x564a55418b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.323+0000 7f911ea0a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5531cbb0 con 0x564a55416650 2024-09-13T16:02:05.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.323+0000 7f911ea0a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5537aa70 con 0x564a554115c0 2024-09-13T16:02:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.323+0000 7f911ea0a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a55378200 con 0x564a55410c80 2024-09-13T16:02:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.324+0000 7f9119c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a55410c80 0x564a55411080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.324+0000 7f9119c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a55410c80 0x564a55411080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:41652/0 (socket says 172.21.15.17:41652) 2024-09-13T16:02:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.324+0000 7f9119c00640 1 -- 172.21.15.17:0/2425659552 learned_addr learned my addr 172.21.15.17:0/2425659552 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.324+0000 7f9119200640 1 --2- 172.21.15.17:0/2425659552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a554115c0 0x564a55416080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.324+0000 7f9111600640 1 --2- 172.21.15.17:0/938436305 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f90f80a1370 0x7f90f80a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.324+0000 7f9113e00640 1 --2- 172.21.15.17:0/2425659552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a55416650 0x564a55418b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.325+0000 7f9111600640 1 -- 172.21.15.17:0/938436305 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f9100014070 con 0x7f91140fed10 2024-09-13T16:02:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.325+0000 7f9119200640 1 -- 172.21.15.17:0/2425659552 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a55410c80 msgr2=0x564a55411080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.325+0000 7f9119200640 1 --2- 172.21.15.17:0/2425659552 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a55410c80 0x564a55411080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.325+0000 7f9119200640 1 -- 172.21.15.17:0/2425659552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a55416650 msgr2=0x564a55418b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.325+0000 7f9119200640 1 --2- 172.21.15.17:0/2425659552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a55416650 0x564a55418b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.325+0000 7f9119200640 1 -- 172.21.15.17:0/2425659552 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a55315940 con 0x564a554115c0 2024-09-13T16:02:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.326+0000 7f9119200640 1 --2- 172.21.15.17:0/2425659552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a554115c0 0x564a55416080 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9104033040 tx=0x7f9104004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d336c86c168e0d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.326+0000 7f910a000640 1 -- 172.21.15.17:0/2425659552 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91040316c0 con 0x564a554115c0 2024-09-13T16:02:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.326+0000 7f910a000640 1 -- 172.21.15.17:0/2425659552 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9104031ce0 con 0x564a554115c0 2024-09-13T16:02:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.326+0000 7f910a000640 1 -- 172.21.15.17:0/2425659552 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9104046e80 con 0x564a554115c0 2024-09-13T16:02:05.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.327+0000 7f911ea0a740 1 -- 172.21.15.17:0/2425659552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a554115c0 msgr2=0x564a55416080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.327+0000 7f911ea0a740 1 --2- 172.21.15.17:0/2425659552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a554115c0 0x564a55416080 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9104033040 tx=0x7f9104004750 comp rx=0 tx=0).stop 2024-09-13T16:02:05.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.329+0000 7f911ea0a740 1 -- 172.21.15.17:0/2425659552 shutdown_connections 2024-09-13T16:02:05.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.329+0000 7f911ea0a740 1 --2- 172.21.15.17:0/2425659552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a55416650 0x564a55418b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.329+0000 7f911ea0a740 1 --2- 172.21.15.17:0/2425659552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a554115c0 0x564a55416080 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.329+0000 7f911ea0a740 1 --2- 172.21.15.17:0/2425659552 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a55410c80 0x564a55411080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.329+0000 7f911ea0a740 1 -- 172.21.15.17:0/2425659552 >> 172.21.15.17:0/2425659552 conn(0x564a5540c2f0 msgr2=0x564a5540c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:05.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.333+0000 7f9119c00640 1 --2- 172.21.15.17:0/938436305 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f90f80a1370 0x7f90f80a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.333+0000 7f911ea0a740 1 -- 172.21.15.17:0/2425659552 shutdown_connections 2024-09-13T16:02:05.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.334+0000 7f911ea0a740 1 -- 172.21.15.17:0/2425659552 wait complete. 2024-09-13T16:02:05.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.334+0000 7f911ea0a740 1 -- start start 2024-09-13T16:02:05.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.334+0000 7f911ea0a740 1 Processor -- start 2024-09-13T16:02:05.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.335+0000 7f9119c00640 1 --2- 172.21.15.17:0/938436305 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f90f80a1370 0x7f90f80a3830 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f910c00a760 tx=0x7f910c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.336+0000 7f911ea0a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a55410c80 0x564a5541a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.336+0000 7f911ea0a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a554115c0 0x564a5541adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.336+0000 7f911ea0a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a55416650 0x564a55421e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.336+0000 7f911ea0a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a55373af0 con 0x564a554115c0 2024-09-13T16:02:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.336+0000 7f911ea0a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a55331f20 con 0x564a55416650 2024-09-13T16:02:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.336+0000 7f911ea0a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a55331bc0 con 0x564a55410c80 2024-09-13T16:02:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.336+0000 7f9119200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a55410c80 0x564a5541a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.336+0000 7f9119200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a55410c80 0x564a5541a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:41664/0 (socket says 172.21.15.17:41664) 2024-09-13T16:02:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.336+0000 7f9119200640 1 -- 172.21.15.17:0/1204825128 learned_addr learned my addr 172.21.15.17:0/1204825128 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:05.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.337+0000 7f9119200640 1 -- 172.21.15.17:0/1204825128 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a55416650 msgr2=0x564a55421e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:05.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.337+0000 7f9119c00640 1 --2- 172.21.15.17:0/1204825128 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a55416650 0x564a55421e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.337+0000 7f911ea0a740 10 client.0 _ll_register_callbacks cb 0x564a55363a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:02:05.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.337+0000 7f9119200640 1 --2- 172.21.15.17:0/1204825128 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a55416650 0x564a55421e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.337+0000 7f9119200640 1 -- 172.21.15.17:0/1204825128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a554115c0 msgr2=0x564a5541adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:05.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.337+0000 7f9119200640 1 --2- 172.21.15.17:0/1204825128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a554115c0 0x564a5541adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.337+0000 7f9119200640 1 -- 172.21.15.17:0/1204825128 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911410abe0 con 0x564a55410c80 2024-09-13T16:02:05.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.337+0000 7f911ea0a740 1 -- 172.21.15.17:0/1204825128 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a5539dc90 con 0x564a55410c80 2024-09-13T16:02:05.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.338+0000 7f9119200640 1 --2- 172.21.15.17:0/1204825128 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a55410c80 0x564a5541a8b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9104046a90 tx=0x7f9104046670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5172e71bd77b7c3d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:05.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.338+0000 7f90fea00640 10 client.25723 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:02:05.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.338+0000 7f9119c00640 1 --2- 172.21.15.17:0/1204825128 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a55416650 0x564a55421e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:05.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.338+0000 7f90fea00640 1 -- 172.21.15.17:0/1204825128 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91040318d0 con 0x564a55410c80 2024-09-13T16:02:05.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.338+0000 7f90fea00640 1 -- 172.21.15.17:0/1204825128 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f9104031a30 con 0x564a55410c80 2024-09-13T16:02:05.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.338+0000 7f90fea00640 1 -- 172.21.15.17:0/1204825128 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91040467e0 con 0x564a55410c80 2024-09-13T16:02:05.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.339+0000 7f911ea0a740 10 client.25723 fetch_fsmap learned FSMap version 30 2024-09-13T16:02:05.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.339+0000 7f911ea0a740 1 -- 172.21.15.17:0/1204825128 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=30}) v3 -- 0x564a55372170 con 0x564a55410c80 2024-09-13T16:02:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.341+0000 7f90fea00640 1 -- 172.21.15.17:0/1204825128 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 30) v1 ==== 7490+0+0 (secure 0 0 0) 0x7f9104039070 con 0x564a55410c80 2024-09-13T16:02:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.341+0000 7f911ea0a740 10 client.25723 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T16:02:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.341+0000 7f911ea0a740 10 client.25723 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:02:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.341+0000 7f911ea0a740 20 client.25723 populate_metadata read hostname 'smithi017' 2024-09-13T16:02:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.341+0000 7f911ea0a740 1 --2- 172.21.15.17:0/1204825128 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564a554260b0 0x564a554284d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.341+0000 7f911ea0a740 4 client.25723 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:02:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.341+0000 7f911ea0a740 1 -- 172.21.15.17:0/1204825128 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a553667d0 con 0x564a554260b0 2024-09-13T16:02:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.341+0000 7f9113e00640 1 --2- 172.21.15.17:0/1204825128 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564a554260b0 0x564a554284d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.342+0000 7f9113e00640 1 --2- 172.21.15.17:0/1204825128 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564a554260b0 0x564a554284d0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a69c43e21ffc6d9 server_cookie=1255d7efba508fd6 in_seq=0 out_seq=0 2024-09-13T16:02:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.343+0000 7f90fea00640 10 client.25723 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:02:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.343+0000 7f90fea00640 1 -- 172.21.15.17:0/1204825128 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564a553667d0 con 0x564a554260b0 2024-09-13T16:02:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.343+0000 7f90fea00640 10 client.25723 handle_command_reply: tid=0 2024-09-13T16:02:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.344+0000 7f911ea0a740 1 client.25723 shutdown 2024-09-13T16:02:05.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.344+0000 7f911ea0a740 1 -- 172.21.15.17:0/1204825128 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a55410c80 msgr2=0x564a5541a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.344+0000 7f911ea0a740 1 --2- 172.21.15.17:0/1204825128 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a55410c80 0x564a5541a8b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9104046a90 tx=0x7f9104046670 comp rx=0 tx=0).stop 2024-09-13T16:02:05.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.344+0000 7f911ea0a740 1 -- 172.21.15.17:0/1204825128 shutdown_connections 2024-09-13T16:02:05.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.344+0000 7f911ea0a740 1 --2- 172.21.15.17:0/1204825128 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564a554260b0 0x564a554284d0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.344+0000 7f911ea0a740 1 --2- 172.21.15.17:0/1204825128 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a55416650 0x564a55421e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.344+0000 7f911ea0a740 1 --2- 172.21.15.17:0/1204825128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a554115c0 0x564a5541adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.344+0000 7f911ea0a740 1 --2- 172.21.15.17:0/1204825128 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a55410c80 0x564a5541a8b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.344+0000 7f911ea0a740 1 -- 172.21.15.17:0/1204825128 >> 172.21.15.17:0/1204825128 conn(0x564a5540c2f0 msgr2=0x564a5540db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:05.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.345+0000 7f90fea00640 0 client.25723 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:02:05.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.345+0000 7f911ea0a740 1 -- 172.21.15.17:0/1204825128 shutdown_connections 2024-09-13T16:02:05.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.345+0000 7f911ea0a740 1 -- 172.21.15.17:0/1204825128 wait complete. 2024-09-13T16:02:05.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.345+0000 7f911ea0a740 20 client.25723 trim_cache size 0 max 16384 2024-09-13T16:02:05.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.374+0000 7f911ea0a740 1 Processor -- start 2024-09-13T16:02:05.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.375+0000 7f911ea0a740 1 -- start start 2024-09-13T16:02:05.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.375+0000 7f911ea0a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a55410c80 0x564a55415ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.375+0000 7f911ea0a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a554115c0 0x564a55416020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.375+0000 7f911ea0a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a55416650 0x564a55421df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.375+0000 7f911ea0a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91141048b0 con 0x564a554115c0 2024-09-13T16:02:05.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.375+0000 7f911ea0a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a550dae60 con 0x564a55410c80 2024-09-13T16:02:05.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.375+0000 7f911ea0a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a55419810 con 0x564a55416650 2024-09-13T16:02:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.377+0000 7f9113e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a554115c0 0x564a55416020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.377+0000 7f9113e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a554115c0 0x564a55416020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40098/0 (socket says 172.21.15.17:40098) 2024-09-13T16:02:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.377+0000 7f9113e00640 1 -- 172.21.15.17:0/3263963641 learned_addr learned my addr 172.21.15.17:0/3263963641 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.377+0000 7f9119c00640 1 --2- 172.21.15.17:0/3263963641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a55416650 0x564a55421df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.377+0000 7f9119200640 1 --2- 172.21.15.17:0/3263963641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a55410c80 0x564a55415ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.378+0000 7f9113e00640 1 -- 172.21.15.17:0/3263963641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a55416650 msgr2=0x564a55421df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:05.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.378+0000 7f9113e00640 1 --2- 172.21.15.17:0/3263963641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a55416650 0x564a55421df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.378+0000 7f9113e00640 1 -- 172.21.15.17:0/3263963641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a55410c80 msgr2=0x564a55415ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:05.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.378+0000 7f9113e00640 1 --2- 172.21.15.17:0/3263963641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a55410c80 0x564a55415ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.378+0000 7f9113e00640 1 -- 172.21.15.17:0/3263963641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a55314180 con 0x564a554115c0 2024-09-13T16:02:05.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.378+0000 7f9119200640 1 --2- 172.21.15.17:0/3263963641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a55410c80 0x564a55415ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:05.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.378+0000 7f9113e00640 1 --2- 172.21.15.17:0/3263963641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a554115c0 0x564a55416020 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9100096ab0 tx=0x7f91000ca5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8af10ea386c87b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.379+0000 7f910aa00640 1 -- 172.21.15.17:0/3263963641 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910009de70 con 0x564a554115c0 2024-09-13T16:02:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.379+0000 7f910aa00640 1 -- 172.21.15.17:0/3263963641 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91000a24c0 con 0x564a554115c0 2024-09-13T16:02:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.379+0000 7f910aa00640 1 -- 172.21.15.17:0/3263963641 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9100010ba0 con 0x564a554115c0 2024-09-13T16:02:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.380+0000 7f911ea0a740 1 -- 172.21.15.17:0/3263963641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a554115c0 msgr2=0x564a55416020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.380+0000 7f911ea0a740 1 --2- 172.21.15.17:0/3263963641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a554115c0 0x564a55416020 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9100096ab0 tx=0x7f91000ca5c0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.380+0000 7f911ea0a740 1 -- 172.21.15.17:0/3263963641 shutdown_connections 2024-09-13T16:02:05.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.380+0000 7f911ea0a740 1 --2- 172.21.15.17:0/3263963641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a55416650 0x564a55421df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.380+0000 7f911ea0a740 1 --2- 172.21.15.17:0/3263963641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a554115c0 0x564a55416020 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.380+0000 7f911ea0a740 1 --2- 172.21.15.17:0/3263963641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a55410c80 0x564a55415ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.380+0000 7f911ea0a740 1 -- 172.21.15.17:0/3263963641 >> 172.21.15.17:0/3263963641 conn(0x564a5540c2f0 msgr2=0x564a5542ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:05.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.380+0000 7f911ea0a740 1 -- 172.21.15.17:0/3263963641 shutdown_connections 2024-09-13T16:02:05.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.380+0000 7f911ea0a740 1 -- 172.21.15.17:0/3263963641 wait complete. 2024-09-13T16:02:05.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.380+0000 7f911ea0a740 1 -- start start 2024-09-13T16:02:05.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.380+0000 7f911ea0a740 1 Processor -- start 2024-09-13T16:02:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.381+0000 7f911ea0a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a55410c80 0x564a5541dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.381+0000 7f911ea0a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a554115c0 0x564a5541e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.381+0000 7f911ea0a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a55416650 0x564a554212a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.381+0000 7f911ea0a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a554217e0 con 0x564a55410c80 2024-09-13T16:02:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.381+0000 7f911ea0a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a55421950 con 0x564a55416650 2024-09-13T16:02:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.381+0000 7f911ea0a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a55421b10 con 0x564a554115c0 2024-09-13T16:02:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.381+0000 7f911ea0a740 10 client.0 _ll_register_callbacks cb 0x7f9100005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:02:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.381+0000 7f9119200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a55410c80 0x564a5541dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.381+0000 7f9119c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a55416650 0x564a554212a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.381+0000 7f9119200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a55410c80 0x564a5541dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40106/0 (socket says 172.21.15.17:40106) 2024-09-13T16:02:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.381+0000 7f9119200640 1 -- 172.21.15.17:0/2698525668 learned_addr learned my addr 172.21.15.17:0/2698525668 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.381+0000 7f9113e00640 1 --2- 172.21.15.17:0/2698525668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a554115c0 0x564a5541e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.382+0000 7f9119c00640 1 -- 172.21.15.17:0/2698525668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a554115c0 msgr2=0x564a5541e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.382+0000 7f9119c00640 1 --2- 172.21.15.17:0/2698525668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a554115c0 0x564a5541e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.382+0000 7f9119c00640 1 -- 172.21.15.17:0/2698525668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a55410c80 msgr2=0x564a5541dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.382+0000 7f9119c00640 1 --2- 172.21.15.17:0/2698525668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a55410c80 0x564a5541dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.382+0000 7f9119c00640 1 -- 172.21.15.17:0/2698525668 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a55372170 con 0x564a55416650 2024-09-13T16:02:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.382+0000 7f9113e00640 1 --2- 172.21.15.17:0/2698525668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a554115c0 0x564a5541e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.382+0000 7f9119200640 1 --2- 172.21.15.17:0/2698525668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a55410c80 0x564a5541dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.382+0000 7f9119c00640 1 --2- 172.21.15.17:0/2698525668 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a55416650 0x564a554212a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x564a5541b720 tx=0x7f910c012f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=233b78879dded51b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.382+0000 7f90fea00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:02:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.382+0000 7f90fea00640 1 -- 172.21.15.17:0/2698525668 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c023040 con 0x564a55416650 2024-09-13T16:02:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.383+0000 7f90fea00640 1 -- 172.21.15.17:0/2698525668 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f910c010c90 con 0x564a55416650 2024-09-13T16:02:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.383+0000 7f911ea0a740 1 -- 172.21.15.17:0/2698525668 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9104031ce0 con 0x564a55416650 2024-09-13T16:02:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.383+0000 7f90fea00640 1 -- 172.21.15.17:0/2698525668 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f910c010e50 con 0x564a55416650 2024-09-13T16:02:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.384+0000 7f911ea0a740 10 client.25706 fetch_fsmap learned FSMap version 30 2024-09-13T16:02:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.384+0000 7f911ea0a740 1 -- 172.21.15.17:0/2698525668 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7f9114100c90 con 0x564a55416650 2024-09-13T16:02:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.384+0000 7f90fea00640 1 -- 172.21.15.17:0/2698525668 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9104031ce0 con 0x564a55416650 2024-09-13T16:02:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.385+0000 7f90fea00640 1 -- 172.21.15.17:0/2698525668 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) v1 ==== 7490+0+0 (secure 0 0 0) 0x7f910c019410 con 0x564a55416650 2024-09-13T16:02:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.385+0000 7f911ea0a740 10 client.25706 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T16:02:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.385+0000 7f911ea0a740 10 client.25706 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:02:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.385+0000 7f911ea0a740 20 client.25706 populate_metadata read hostname 'smithi017' 2024-09-13T16:02:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.385+0000 7f911ea0a740 1 --2- 172.21.15.17:0/2698525668 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564a5547d7e0 0x564a5547fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.385+0000 7f911ea0a740 4 client.25706 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:02:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.385+0000 7f911ea0a740 1 -- 172.21.15.17:0/2698525668 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564a55067300 con 0x564a5547d7e0 2024-09-13T16:02:05.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.386+0000 7f9119200640 1 --2- 172.21.15.17:0/2698525668 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564a5547d7e0 0x564a5547fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.388+0000 7f9119200640 1 --2- 172.21.15.17:0/2698525668 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564a5547d7e0 0x564a5547fc00 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf1d9a92e4aab8b8 server_cookie=129fd24daad0c7a8 in_seq=0 out_seq=0 2024-09-13T16:02:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.388+0000 7f90fea00640 10 client.25706 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:02:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.395+0000 7f90fea00640 1 -- 172.21.15.17:0/2698525668 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564a55067300 con 0x564a5547d7e0 2024-09-13T16:02:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.395+0000 7f90fea00640 10 client.25706 handle_command_reply: tid=0 2024-09-13T16:02:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.395+0000 7f911ea0a740 1 client.25706 shutdown 2024-09-13T16:02:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.396+0000 7f911ea0a740 1 -- 172.21.15.17:0/2698525668 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a55416650 msgr2=0x564a554212a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.396+0000 7f911ea0a740 1 --2- 172.21.15.17:0/2698525668 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a55416650 0x564a554212a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x564a5541b720 tx=0x7f910c012f90 comp rx=0 tx=0).stop 2024-09-13T16:02:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.396+0000 7f911ea0a740 1 -- 172.21.15.17:0/2698525668 shutdown_connections 2024-09-13T16:02:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.396+0000 7f911ea0a740 1 --2- 172.21.15.17:0/2698525668 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564a5547d7e0 0x564a5547fc00 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.396+0000 7f911ea0a740 1 --2- 172.21.15.17:0/2698525668 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a55416650 0x564a554212a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.396+0000 7f911ea0a740 1 --2- 172.21.15.17:0/2698525668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a554115c0 0x564a5541e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.396+0000 7f911ea0a740 1 --2- 172.21.15.17:0/2698525668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a55410c80 0x564a5541dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.396+0000 7f90fea00640 0 client.25706 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:02:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.396+0000 7f911ea0a740 1 -- 172.21.15.17:0/2698525668 >> 172.21.15.17:0/2698525668 conn(0x564a5540c2f0 msgr2=0x564a55415a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.396+0000 7f911ea0a740 1 -- 172.21.15.17:0/2698525668 shutdown_connections 2024-09-13T16:02:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.396+0000 7f911ea0a740 1 -- 172.21.15.17:0/2698525668 wait complete. 2024-09-13T16:02:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.397+0000 7f911ea0a740 20 client.25706 trim_cache size 0 max 16384 2024-09-13T16:02:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:02:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:02:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:02:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:02:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.397+0000 7f911a600640 1 -- 172.21.15.17:0/938436305 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f90f80a1370 msgr2=0x7f90f80a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.397+0000 7f911a600640 1 --2- 172.21.15.17:0/938436305 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f90f80a1370 0x7f90f80a3830 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f910c00a760 tx=0x7f910c004a40 comp rx=0 tx=0).stop 2024-09-13T16:02:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.397+0000 7f911a600640 1 -- 172.21.15.17:0/938436305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91140fed10 msgr2=0x7f9114198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.397+0000 7f911a600640 1 --2- 172.21.15.17:0/938436305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91140fed10 0x7f9114198280 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f910000e9f0 tx=0x7f910000eeb0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.398+0000 7f911a600640 1 -- 172.21.15.17:0/938436305 shutdown_connections 2024-09-13T16:02:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.398+0000 7f911a600640 1 --2- 172.21.15.17:0/938436305 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f90f80a1370 0x7f90f80a3830 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.398+0000 7f911a600640 1 --2- 172.21.15.17:0/938436305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91140ff6b0 0x7f911419f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.398+0000 7f911a600640 1 --2- 172.21.15.17:0/938436305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91140fed10 0x7f9114198280 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.398+0000 7f911a600640 1 --2- 172.21.15.17:0/938436305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91140fe3d0 0x7f9114197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.398+0000 7f911a600640 1 -- 172.21.15.17:0/938436305 >> 172.21.15.17:0/938436305 conn(0x7f91140fa1c0 msgr2=0x7f91140fb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.398+0000 7f911a600640 1 -- 172.21.15.17:0/938436305 shutdown_connections 2024-09-13T16:02:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:05.398+0000 7f911a600640 1 -- 172.21.15.17:0/938436305 wait complete. 2024-09-13T16:02:06.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:06 smithi193 ceph-mon[35248]: pgmap v516: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.8 MiB/s wr, 633 op/s 2024-09-13T16:02:06.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:06 smithi017 ceph-mon[30494]: pgmap v516: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.8 MiB/s wr, 633 op/s 2024-09-13T16:02:06.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:06 smithi189 ceph-mon[34790]: pgmap v516: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.8 MiB/s wr, 633 op/s 2024-09-13T16:02:08.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:08 smithi193 ceph-mon[35248]: pgmap v517: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 5.3 MiB/s wr, 566 op/s 2024-09-13T16:02:08.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:08 smithi017 ceph-mon[30494]: pgmap v517: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 5.3 MiB/s wr, 566 op/s 2024-09-13T16:02:08.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:08 smithi189 ceph-mon[34790]: pgmap v517: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 5.3 MiB/s wr, 566 op/s 2024-09-13T16:02:10.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 265.0 s, 725.2 tps, lat 138.291 ms stddev 168.394 2024-09-13T16:02:10.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:10 smithi193 ceph-mon[35248]: pgmap v518: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.2 MiB/s wr, 576 op/s 2024-09-13T16:02:10.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:10 smithi017 ceph-mon[30494]: pgmap v518: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.2 MiB/s wr, 576 op/s 2024-09-13T16:02:10.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:10 smithi189 ceph-mon[34790]: pgmap v518: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.2 MiB/s wr, 576 op/s 2024-09-13T16:02:12.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:12 smithi193 ceph-mon[35248]: pgmap v519: 129 pgs: 129 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.4 MiB/s wr, 596 op/s 2024-09-13T16:02:12.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:12 smithi017 ceph-mon[30494]: pgmap v519: 129 pgs: 129 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.4 MiB/s wr, 596 op/s 2024-09-13T16:02:12.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:12 smithi189 ceph-mon[34790]: pgmap v519: 129 pgs: 129 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.4 MiB/s wr, 596 op/s 2024-09-13T16:02:14.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:14 smithi193 ceph-mon[35248]: pgmap v520: 129 pgs: 129 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.1 MiB/s wr, 554 op/s 2024-09-13T16:02:14.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:14 smithi017 ceph-mon[30494]: pgmap v520: 129 pgs: 129 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.1 MiB/s wr, 554 op/s 2024-09-13T16:02:14.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:14 smithi189 ceph-mon[34790]: pgmap v520: 129 pgs: 129 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.1 MiB/s wr, 554 op/s 2024-09-13T16:02:15.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 270.0 s, 1047.8 tps, lat 97.310 ms stddev 147.064 2024-09-13T16:02:16.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:16 smithi193 ceph-mon[35248]: pgmap v521: 129 pgs: 129 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 683 op/s 2024-09-13T16:02:16.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:16 smithi017 ceph-mon[30494]: pgmap v521: 129 pgs: 129 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 683 op/s 2024-09-13T16:02:16.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:16 smithi189 ceph-mon[34790]: pgmap v521: 129 pgs: 129 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 683 op/s 2024-09-13T16:02:18.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.616+0000 7fe1b3c00640 1 -- 172.21.15.17:0/2305578399 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1ac101f20 msgr2=0x7fe1ac102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.616+0000 7fe1b3c00640 1 --2- 172.21.15.17:0/2305578399 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1ac101f20 0x7fe1ac102340 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009900 tx=0x7fe1a002a400 comp rx=0 tx=0).stop 2024-09-13T16:02:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.617+0000 7fe1b3c00640 1 -- 172.21.15.17:0/2305578399 shutdown_connections 2024-09-13T16:02:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.617+0000 7fe1b3c00640 1 --2- 172.21.15.17:0/2305578399 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1ac103ab0 0x7fe1ac10a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.617+0000 7fe1b3c00640 1 --2- 172.21.15.17:0/2305578399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1ac1030f0 0x7fe1ac103570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.617+0000 7fe1b3c00640 1 --2- 172.21.15.17:0/2305578399 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1ac101f20 0x7fe1ac102340 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.617+0000 7fe1b3c00640 1 -- 172.21.15.17:0/2305578399 >> 172.21.15.17:0/2305578399 conn(0x7fe1ac0fd6d0 msgr2=0x7fe1ac0ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.617+0000 7fe1b3c00640 1 -- 172.21.15.17:0/2305578399 shutdown_connections 2024-09-13T16:02:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.617+0000 7fe1b3c00640 1 -- 172.21.15.17:0/2305578399 wait complete. 2024-09-13T16:02:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.619+0000 7fe1b3c00640 1 Processor -- start 2024-09-13T16:02:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.619+0000 7fe1b3c00640 1 -- start start 2024-09-13T16:02:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.619+0000 7fe1b3c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1ac101f20 0x7fe1ac10eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.619+0000 7fe1b3c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1ac1030f0 0x7fe1ac10f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.619+0000 7fe1b3c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1ac103ab0 0x7fe1ac1ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.619+0000 7fe1b3c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac1ac730 con 0x7fe1ac101f20 2024-09-13T16:02:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.619+0000 7fe1b3c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac1ac870 con 0x7fe1ac1030f0 2024-09-13T16:02:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.619+0000 7fe1b3c00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac1ac9e0 con 0x7fe1ac103ab0 2024-09-13T16:02:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.620+0000 7fe1abe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1ac1030f0 0x7fe1ac10f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.620+0000 7fe1abe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1ac1030f0 0x7fe1ac10f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:55220/0 (socket says 172.21.15.17:55220) 2024-09-13T16:02:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.620+0000 7fe1abe00640 1 -- 172.21.15.17:0/953116301 learned_addr learned my addr 172.21.15.17:0/953116301 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.620+0000 7fe1b1c00640 1 --2- 172.21.15.17:0/953116301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1ac103ab0 0x7fe1ac1ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.621+0000 7fe1b1c00640 1 -- 172.21.15.17:0/953116301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1ac1030f0 msgr2=0x7fe1ac10f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.621+0000 7fe1b1c00640 1 --2- 172.21.15.17:0/953116301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1ac1030f0 0x7fe1ac10f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.621+0000 7fe1b1c00640 1 -- 172.21.15.17:0/953116301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1ac101f20 msgr2=0x7fe1ac10eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.621+0000 7fe1b1c00640 1 --2- 172.21.15.17:0/953116301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1ac101f20 0x7fe1ac10eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.621+0000 7fe1b1c00640 1 -- 172.21.15.17:0/953116301 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe198009490 con 0x7fe1ac103ab0 2024-09-13T16:02:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.621+0000 7fe1b1c00640 1 --2- 172.21.15.17:0/953116301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1ac103ab0 0x7fe1ac1ac1f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400ec50 tx=0x7fe1a400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.630+0000 7fe1a9600640 1 -- 172.21.15.17:0/953116301 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4003b70 con 0x7fe1ac103ab0 2024-09-13T16:02:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.630+0000 7fe1a9600640 1 -- 172.21.15.17:0/953116301 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1a400ce70 con 0x7fe1ac103ab0 2024-09-13T16:02:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.630+0000 7fe1a9600640 1 -- 172.21.15.17:0/953116301 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a40107a0 con 0x7fe1ac103ab0 2024-09-13T16:02:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.633+0000 7fe1b3c00640 1 -- 172.21.15.17:0/953116301 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a4009840 con 0x7fe1ac103ab0 2024-09-13T16:02:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.633+0000 7fe1b3c00640 1 -- 172.21.15.17:0/953116301 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a0009560 con 0x7fe1ac103ab0 2024-09-13T16:02:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.640+0000 7fe1a9600640 1 -- 172.21.15.17:0/953116301 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe1a4010900 con 0x7fe1ac103ab0 2024-09-13T16:02:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.641+0000 7fe1b6a7c740 1 Processor -- start 2024-09-13T16:02:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.642+0000 7fe1b6a7c740 1 -- start start 2024-09-13T16:02:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.643+0000 7fe1b6a7c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439c9aa70 0x55e439c9ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.643+0000 7fe1b6a7c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e439c9b3b0 0x55e439c9fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.643+0000 7fe1b6a7c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439ca0440 0x55e439ca2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.643+0000 7fe1b6a7c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e439ba6bb0 con 0x55e439c9b3b0 2024-09-13T16:02:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.643+0000 7fe1b6a7c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e439c04a70 con 0x55e439c9aa70 2024-09-13T16:02:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.643+0000 7fe1b6a7c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e439c02200 con 0x55e439ca0440 2024-09-13T16:02:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.643+0000 7fe1abe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439c9aa70 0x55e439c9ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.643+0000 7fe1a9600640 1 --2- 172.21.15.17:0/953116301 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe1940a1210 0x7fe1940a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.643+0000 7fe1abe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439c9aa70 0x55e439c9ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:55228/0 (socket says 172.21.15.17:55228) 2024-09-13T16:02:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.643+0000 7fe1abe00640 1 -- 172.21.15.17:0/3962729691 learned_addr learned my addr 172.21.15.17:0/3962729691 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.643+0000 7fe1abe00640 1 --2- 172.21.15.17:0/3962729691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439ca0440 0x55e439ca2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.644+0000 7fe1a9600640 1 -- 172.21.15.17:0/953116301 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fe1a4014070 con 0x7fe1ac103ab0 2024-09-13T16:02:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.644+0000 7fe1abe00640 1 -- 172.21.15.17:0/3962729691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439ca0440 msgr2=0x55e439ca2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.644+0000 7fe1abe00640 1 --2- 172.21.15.17:0/3962729691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439ca0440 0x55e439ca2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.644+0000 7fe1abe00640 1 -- 172.21.15.17:0/3962729691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e439c9b3b0 msgr2=0x55e439c9fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.644+0000 7fe1b1200640 1 --2- 172.21.15.17:0/3962729691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e439c9b3b0 0x55e439c9fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.644+0000 7fe1abe00640 1 --2- 172.21.15.17:0/3962729691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e439c9b3b0 0x55e439c9fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.644+0000 7fe1abe00640 1 -- 172.21.15.17:0/3962729691 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e439b9f940 con 0x55e439c9aa70 2024-09-13T16:02:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.644+0000 7fe1b1c00640 1 --2- 172.21.15.17:0/953116301 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe1940a1210 0x7fe1940a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.645+0000 7fe1abe00640 1 --2- 172.21.15.17:0/3962729691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439c9aa70 0x55e439c9ae70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe1980129f0 tx=0x7fe198009950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dedf285f1e2dff35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.645+0000 7fe1b1c00640 1 --2- 172.21.15.17:0/953116301 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe1940a1210 0x7fe1940a36d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4005fd0 tx=0x7fe1a400ef50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.645+0000 7fe19e000640 1 -- 172.21.15.17:0/3962729691 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1980120f0 con 0x55e439c9aa70 2024-09-13T16:02:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.646+0000 7fe19e000640 1 -- 172.21.15.17:0/3962729691 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe198012250 con 0x55e439c9aa70 2024-09-13T16:02:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.646+0000 7fe19e000640 1 -- 172.21.15.17:0/3962729691 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1980120f0 con 0x55e439c9aa70 2024-09-13T16:02:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.647+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3962729691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439c9aa70 msgr2=0x55e439c9ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:18.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.647+0000 7fe1b6a7c740 1 --2- 172.21.15.17:0/3962729691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439c9aa70 0x55e439c9ae70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe1980129f0 tx=0x7fe198009950 comp rx=0 tx=0).stop 2024-09-13T16:02:18.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.647+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3962729691 shutdown_connections 2024-09-13T16:02:18.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.647+0000 7fe1b6a7c740 1 --2- 172.21.15.17:0/3962729691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439ca0440 0x55e439ca2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.647+0000 7fe1b6a7c740 1 --2- 172.21.15.17:0/3962729691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e439c9b3b0 0x55e439c9fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.647+0000 7fe1b6a7c740 1 --2- 172.21.15.17:0/3962729691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439c9aa70 0x55e439c9ae70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.647+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3962729691 >> 172.21.15.17:0/3962729691 conn(0x55e439c960e0 msgr2=0x55e439c964e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:18.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.647+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3962729691 shutdown_connections 2024-09-13T16:02:18.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.647+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3962729691 wait complete. 2024-09-13T16:02:18.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.648+0000 7fe1b6a7c740 1 -- start start 2024-09-13T16:02:18.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.648+0000 7fe1b6a7c740 1 Processor -- start 2024-09-13T16:02:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.649+0000 7fe1b6a7c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439c9aa70 0x55e439ca4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.649+0000 7fe1b6a7c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e439c9b3b0 0x55e439ca4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.649+0000 7fe1b6a7c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439ca0440 0x55e439cabc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.649+0000 7fe1b6a7c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e439bfdaf0 con 0x55e439c9b3b0 2024-09-13T16:02:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.649+0000 7fe1b6a7c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e439bbbf20 con 0x55e439ca0440 2024-09-13T16:02:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.649+0000 7fe1b6a7c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e439bbbbc0 con 0x55e439c9aa70 2024-09-13T16:02:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.649+0000 7fe1b6a7c740 10 client.0 _ll_register_callbacks cb 0x55e439beda70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:02:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.650+0000 7fe1b1200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e439c9b3b0 0x55e439ca4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.650+0000 7fe1abe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439c9aa70 0x55e439ca4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.650+0000 7fe1b1200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e439c9b3b0 0x55e439ca4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60976/0 (socket says 172.21.15.17:60976) 2024-09-13T16:02:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.650+0000 7fe1b1200640 1 -- 172.21.15.17:0/3496577805 learned_addr learned my addr 172.21.15.17:0/3496577805 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.650+0000 7fe1abe00640 1 --2- 172.21.15.17:0/3496577805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439ca0440 0x55e439cabc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.651+0000 7fe1b1200640 1 -- 172.21.15.17:0/3496577805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439c9aa70 msgr2=0x55e439ca4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.651+0000 7fe1b1200640 1 --2- 172.21.15.17:0/3496577805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439c9aa70 0x55e439ca4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.651+0000 7fe1b1200640 1 -- 172.21.15.17:0/3496577805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439ca0440 msgr2=0x55e439cabc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.651+0000 7fe1b1200640 1 --2- 172.21.15.17:0/3496577805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439ca0440 0x55e439cabc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.651+0000 7fe1b1200640 1 -- 172.21.15.17:0/3496577805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19801a040 con 0x55e439c9b3b0 2024-09-13T16:02:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.651+0000 7fe1b1200640 1 --2- 172.21.15.17:0/3496577805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e439c9b3b0 0x55e439ca4c40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00057c0 tx=0x7fe1a0003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ecf308c6dbc4f5e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.651+0000 7fe192a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T16:02:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.653+0000 7fe192a00640 1 -- 172.21.15.17:0/3496577805 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00044b0 con 0x55e439c9b3b0 2024-09-13T16:02:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.653+0000 7fe192a00640 1 -- 172.21.15.17:0/3496577805 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fe1a0003ba0 con 0x55e439c9b3b0 2024-09-13T16:02:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.653+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3496577805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e439c27c90 con 0x55e439c9b3b0 2024-09-13T16:02:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.654+0000 7fe192a00640 1 -- 172.21.15.17:0/3496577805 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1a0003d60 con 0x55e439c9b3b0 2024-09-13T16:02:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.655+0000 7fe1b6a7c740 10 client.15582 fetch_fsmap learned FSMap version 30 2024-09-13T16:02:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.655+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3496577805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55e439bfc170 con 0x55e439c9b3b0 2024-09-13T16:02:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.657+0000 7fe192a00640 1 -- 172.21.15.17:0/3496577805 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1a0003ec0 con 0x55e439c9b3b0 2024-09-13T16:02:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.657+0000 7fe192a00640 1 -- 172.21.15.17:0/3496577805 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) v1 ==== 7490+0+0 (secure 0 0 0) 0x7fe1a003c6e0 con 0x55e439c9b3b0 2024-09-13T16:02:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.658+0000 7fe1b6a7c740 10 client.15582 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T16:02:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.658+0000 7fe1b6a7c740 10 client.15582 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:02:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.658+0000 7fe1b6a7c740 20 client.15582 populate_metadata read hostname 'smithi017' 2024-09-13T16:02:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.658+0000 7fe1b6a7c740 1 --2- 172.21.15.17:0/3496577805 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e439cb0410 0x55e439cb2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.658+0000 7fe1b6a7c740 4 client.15582 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:02:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.658+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3496577805 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e439c27c90 con 0x55e439cb0410 2024-09-13T16:02:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.659+0000 7fe1abe00640 1 --2- 172.21.15.17:0/3496577805 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e439cb0410 0x55e439cb2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.659+0000 7fe1abe00640 1 --2- 172.21.15.17:0/3496577805 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e439cb0410 0x55e439cb2830 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df176d28f9a4fe2d server_cookie=ce9a43772920c9cf in_seq=0 out_seq=0 2024-09-13T16:02:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.660+0000 7fe192a00640 10 client.15582 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:02:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.660+0000 7fe192a00640 1 -- 172.21.15.17:0/3496577805 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e439c27c90 con 0x55e439cb0410 2024-09-13T16:02:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.660+0000 7fe192a00640 10 client.15582 handle_command_reply: tid=0 2024-09-13T16:02:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.660+0000 7fe1b6a7c740 1 client.15582 shutdown 2024-09-13T16:02:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.661+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3496577805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e439c9b3b0 msgr2=0x55e439ca4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.661+0000 7fe1b6a7c740 1 --2- 172.21.15.17:0/3496577805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e439c9b3b0 0x55e439ca4c40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00057c0 tx=0x7fe1a0003820 comp rx=0 tx=0).stop 2024-09-13T16:02:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.661+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3496577805 shutdown_connections 2024-09-13T16:02:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.662+0000 7fe1b6a7c740 1 --2- 172.21.15.17:0/3496577805 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e439cb0410 0x55e439cb2830 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.662+0000 7fe1b6a7c740 1 --2- 172.21.15.17:0/3496577805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439ca0440 0x55e439cabc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.662+0000 7fe1b6a7c740 1 --2- 172.21.15.17:0/3496577805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e439c9b3b0 0x55e439ca4c40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.662+0000 7fe1b6a7c740 1 --2- 172.21.15.17:0/3496577805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439c9aa70 0x55e439ca4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.662+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3496577805 >> 172.21.15.17:0/3496577805 conn(0x55e439c960e0 msgr2=0x55e439c978f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.664+0000 7fe192a00640 0 client.15582 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:02:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.664+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3496577805 shutdown_connections 2024-09-13T16:02:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.664+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3496577805 wait complete. 2024-09-13T16:02:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.666+0000 7fe1b6a7c740 20 client.15582 trim_cache size 0 max 16384 2024-09-13T16:02:18.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.703+0000 7fe1b6a7c740 1 Processor -- start 2024-09-13T16:02:18.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.703+0000 7fe1b6a7c740 1 -- start start 2024-09-13T16:02:18.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.704+0000 7fe1b6a7c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439c9aa70 0x55e439c9c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:18.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.704+0000 7fe1b6a7c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439c9b3b0 0x55e439cabc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:18.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.704+0000 7fe1abe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439c9aa70 0x55e439c9c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:18.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.704+0000 7fe1b6a7c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e439ca0440 0x55e439c9c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:18.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.704+0000 7fe1b6a7c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e439964e60 con 0x55e439ca0440 2024-09-13T16:02:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.704+0000 7fe1b6a7c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e439c9b890 con 0x55e439c9aa70 2024-09-13T16:02:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.704+0000 7fe1b6a7c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e439c9f4e0 con 0x55e439c9b3b0 2024-09-13T16:02:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.705+0000 7fe1b1200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439c9b3b0 0x55e439cabc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.705+0000 7fe1b1200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439c9b3b0 0x55e439cabc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:50668/0 (socket says 172.21.15.17:50668) 2024-09-13T16:02:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.705+0000 7fe1b1200640 1 -- 172.21.15.17:0/2660483484 learned_addr learned my addr 172.21.15.17:0/2660483484 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.706+0000 7fe1abe00640 1 -- 172.21.15.17:0/2660483484 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439c9b3b0 msgr2=0x55e439cabc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.706+0000 7fe1abe00640 1 --2- 172.21.15.17:0/2660483484 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439c9b3b0 0x55e439cabc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.706+0000 7fe1abe00640 1 -- 172.21.15.17:0/2660483484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e439ca0440 msgr2=0x55e439c9c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.706+0000 7fe1abe00640 1 --2- 172.21.15.17:0/2660483484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e439ca0440 0x55e439c9c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.706+0000 7fe1abe00640 1 -- 172.21.15.17:0/2660483484 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e439b9e180 con 0x55e439c9aa70 2024-09-13T16:02:18.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.707+0000 7fe1b1200640 1 --2- 172.21.15.17:0/2660483484 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439c9b3b0 0x55e439cabc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:02:18.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.707+0000 7fe1abe00640 1 --2- 172.21.15.17:0/2660483484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439c9aa70 0x55e439c9c270 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe198009760 tx=0x7fe198009950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85338a37e0a2aeb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.710+0000 7fe19ea00640 1 -- 172.21.15.17:0/2660483484 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1980120f0 con 0x55e439c9aa70 2024-09-13T16:02:18.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.710+0000 7fe19ea00640 1 -- 172.21.15.17:0/2660483484 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe198009d50 con 0x55e439c9aa70 2024-09-13T16:02:18.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.710+0000 7fe19ea00640 1 -- 172.21.15.17:0/2660483484 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe198030380 con 0x55e439c9aa70 2024-09-13T16:02:18.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.711+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/2660483484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439c9aa70 msgr2=0x55e439c9c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:18.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.711+0000 7fe1b6a7c740 1 --2- 172.21.15.17:0/2660483484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439c9aa70 0x55e439c9c270 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe198009760 tx=0x7fe198009950 comp rx=0 tx=0).stop 2024-09-13T16:02:18.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.711+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/2660483484 shutdown_connections 2024-09-13T16:02:18.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.711+0000 7fe1b6a7c740 1 --2- 172.21.15.17:0/2660483484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e439ca0440 0x55e439c9c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.711+0000 7fe1b6a7c740 1 --2- 172.21.15.17:0/2660483484 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439c9b3b0 0x55e439cabc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.711+0000 7fe1b6a7c740 1 --2- 172.21.15.17:0/2660483484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439c9aa70 0x55e439c9c270 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.712+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/2660483484 >> 172.21.15.17:0/2660483484 conn(0x55e439c960e0 msgr2=0x55e439c9f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:18.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.712+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/2660483484 shutdown_connections 2024-09-13T16:02:18.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.712+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/2660483484 wait complete. 2024-09-13T16:02:18.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.713+0000 7fe1b6a7c740 1 -- start start 2024-09-13T16:02:18.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.713+0000 7fe1b6a7c740 1 Processor -- start 2024-09-13T16:02:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.714+0000 7fe1b6a7c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439c9aa70 0x55e439cab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.714+0000 7fe1b6a7c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439c9b3b0 0x55e439ca82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.715+0000 7fe1abe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439c9aa70 0x55e439cab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:18.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.715+0000 7fe1abe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439c9aa70 0x55e439cab7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:55242/0 (socket says 172.21.15.17:55242) 2024-09-13T16:02:18.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.715+0000 7fe1abe00640 1 -- 172.21.15.17:0/3888504450 learned_addr learned my addr 172.21.15.17:0/3888504450 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.715+0000 7fe1b6a7c740 1 --2- 172.21.15.17:0/3888504450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e439ca0440 0x55e439ca8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.715+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3888504450 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e439ca8f20 con 0x55e439ca0440 2024-09-13T16:02:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.715+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3888504450 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e439cabe50 con 0x55e439c9aa70 2024-09-13T16:02:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.715+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3888504450 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e439cac010 con 0x55e439c9b3b0 2024-09-13T16:02:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.715+0000 7fe1b6a7c740 10 client.0 _ll_register_callbacks cb 0x7fe198009ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:02:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.716+0000 7fe1b1200640 1 --2- 172.21.15.17:0/3888504450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439c9b3b0 0x55e439ca82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.716+0000 7fe1abe00640 1 -- 172.21.15.17:0/3888504450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439c9b3b0 msgr2=0x55e439ca82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.716+0000 7fe1abe00640 1 --2- 172.21.15.17:0/3888504450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439c9b3b0 0x55e439ca82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.716+0000 7fe1abe00640 1 -- 172.21.15.17:0/3888504450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e439ca0440 msgr2=0x55e439ca8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.716+0000 7fe1abe00640 1 --2- 172.21.15.17:0/3888504450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e439ca0440 0x55e439ca8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.716+0000 7fe1abe00640 1 -- 172.21.15.17:0/3888504450 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e439bfc170 con 0x55e439c9aa70 2024-09-13T16:02:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.716+0000 7fe1b1200640 1 --2- 172.21.15.17:0/3888504450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439c9b3b0 0x55e439ca82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.716+0000 7fe192a00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:02:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.716+0000 7fe1abe00640 1 --2- 172.21.15.17:0/3888504450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439c9aa70 0x55e439cab7f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe198010b30 tx=0x7fe198010b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8286a467210e8c34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:18.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.717+0000 7fe192a00640 1 -- 172.21.15.17:0/3888504450 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe198012560 con 0x55e439c9aa70 2024-09-13T16:02:18.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.717+0000 7fe192a00640 1 -- 172.21.15.17:0/3888504450 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fe198024040 con 0x55e439c9aa70 2024-09-13T16:02:18.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.718+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3888504450 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe198012250 con 0x55e439c9aa70 2024-09-13T16:02:18.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.719+0000 7fe192a00640 1 -- 172.21.15.17:0/3888504450 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe198030380 con 0x55e439c9aa70 2024-09-13T16:02:18.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.719+0000 7fe1b6a7c740 10 client.25724 fetch_fsmap learned FSMap version 30 2024-09-13T16:02:18.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.719+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3888504450 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7fe198029040 con 0x55e439c9aa70 2024-09-13T16:02:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.719+0000 7fe192a00640 1 -- 172.21.15.17:0/3888504450 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe198012250 con 0x55e439c9aa70 2024-09-13T16:02:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.719+0000 7fe192a00640 1 -- 172.21.15.17:0/3888504450 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) v1 ==== 7490+0+0 (secure 0 0 0) 0x7fe198037070 con 0x55e439c9aa70 2024-09-13T16:02:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.719+0000 7fe1b6a7c740 10 client.25724 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T16:02:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.720+0000 7fe1b6a7c740 10 client.25724 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:02:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.720+0000 7fe1b6a7c740 20 client.25724 populate_metadata read hostname 'smithi017' 2024-09-13T16:02:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.720+0000 7fe1b6a7c740 1 --2- 172.21.15.17:0/3888504450 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e439d07e50 0x55e439d0a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.720+0000 7fe1b6a7c740 4 client.25724 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:02:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.720+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3888504450 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e439bf07d0 con 0x55e439d07e50 2024-09-13T16:02:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.720+0000 7fe1b1200640 1 --2- 172.21.15.17:0/3888504450 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e439d07e50 0x55e439d0a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:18.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.721+0000 7fe192a00640 10 client.25724 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:02:18.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.722+0000 7fe1b1200640 1 --2- 172.21.15.17:0/3888504450 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e439d07e50 0x55e439d0a270 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5742f9237eda8ede server_cookie=79621c0f4ab9cfbc in_seq=0 out_seq=0 2024-09-13T16:02:18.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.740+0000 7fe192a00640 1 -- 172.21.15.17:0/3888504450 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e439bf07d0 con 0x55e439d07e50 2024-09-13T16:02:18.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.740+0000 7fe192a00640 10 client.25724 handle_command_reply: tid=0 2024-09-13T16:02:18.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.740+0000 7fe1b6a7c740 1 client.25724 shutdown 2024-09-13T16:02:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.743+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3888504450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439c9aa70 msgr2=0x55e439cab7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.743+0000 7fe1b6a7c740 1 --2- 172.21.15.17:0/3888504450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439c9aa70 0x55e439cab7f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe198010b30 tx=0x7fe198010b60 comp rx=0 tx=0).stop 2024-09-13T16:02:18.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.743+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3888504450 shutdown_connections 2024-09-13T16:02:18.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.743+0000 7fe1b6a7c740 1 --2- 172.21.15.17:0/3888504450 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e439d07e50 0x55e439d0a270 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.743+0000 7fe1b6a7c740 1 --2- 172.21.15.17:0/3888504450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e439ca0440 0x55e439ca8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.743+0000 7fe1b6a7c740 1 --2- 172.21.15.17:0/3888504450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e439c9b3b0 0x55e439ca82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.743+0000 7fe1b6a7c740 1 --2- 172.21.15.17:0/3888504450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e439c9aa70 0x55e439cab7f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.743+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3888504450 >> 172.21.15.17:0/3888504450 conn(0x55e439c960e0 msgr2=0x55e439c9c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:18.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.745+0000 7fe192a00640 0 client.25724 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:02:18.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.745+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3888504450 shutdown_connections 2024-09-13T16:02:18.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.745+0000 7fe1b6a7c740 1 -- 172.21.15.17:0/3888504450 wait complete. 2024-09-13T16:02:18.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.746+0000 7fe1b6a7c740 20 client.25724 trim_cache size 0 max 16384 2024-09-13T16:02:18.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:02:18.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:02:18.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:02:18.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:02:18.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.747+0000 7fe1b3c00640 1 -- 172.21.15.17:0/953116301 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe1940a1210 msgr2=0x7fe1940a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:18.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.747+0000 7fe1b3c00640 1 --2- 172.21.15.17:0/953116301 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe1940a1210 0x7fe1940a36d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4005fd0 tx=0x7fe1a400ef50 comp rx=0 tx=0).stop 2024-09-13T16:02:18.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.747+0000 7fe1b3c00640 1 -- 172.21.15.17:0/953116301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1ac103ab0 msgr2=0x7fe1ac1ac1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:18.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.747+0000 7fe1b3c00640 1 --2- 172.21.15.17:0/953116301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1ac103ab0 0x7fe1ac1ac1f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400ec50 tx=0x7fe1a400c6a0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.747+0000 7fe1b3c00640 1 -- 172.21.15.17:0/953116301 shutdown_connections 2024-09-13T16:02:18.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.747+0000 7fe1b3c00640 1 --2- 172.21.15.17:0/953116301 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe1940a1210 0x7fe1940a36d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.747+0000 7fe1b3c00640 1 --2- 172.21.15.17:0/953116301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1ac103ab0 0x7fe1ac1ac1f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.747+0000 7fe1b3c00640 1 --2- 172.21.15.17:0/953116301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1ac1030f0 0x7fe1ac10f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.747+0000 7fe1b3c00640 1 --2- 172.21.15.17:0/953116301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1ac101f20 0x7fe1ac10eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.747+0000 7fe1b3c00640 1 -- 172.21.15.17:0/953116301 >> 172.21.15.17:0/953116301 conn(0x7fe1ac0fd6d0 msgr2=0x7fe1ac0fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.748+0000 7fe1b3c00640 1 -- 172.21.15.17:0/953116301 shutdown_connections 2024-09-13T16:02:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:18.748+0000 7fe1b3c00640 1 -- 172.21.15.17:0/953116301 wait complete. 2024-09-13T16:02:18.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:18 smithi193 ceph-mon[35248]: pgmap v522: 129 pgs: 129 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.0 MiB/s wr, 600 op/s 2024-09-13T16:02:18.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:18 smithi017 ceph-mon[30494]: pgmap v522: 129 pgs: 129 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.0 MiB/s wr, 600 op/s 2024-09-13T16:02:18.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:18 smithi189 ceph-mon[34790]: pgmap v522: 129 pgs: 129 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.0 MiB/s wr, 600 op/s 2024-09-13T16:02:20.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 275.0 s, 1245.2 tps, lat 79.072 ms stddev 98.670 2024-09-13T16:02:20.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:20 smithi193 ceph-mon[35248]: pgmap v523: 129 pgs: 129 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 MiB/s wr, 707 op/s 2024-09-13T16:02:20.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:20 smithi017 ceph-mon[30494]: pgmap v523: 129 pgs: 129 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 MiB/s wr, 707 op/s 2024-09-13T16:02:20.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:20 smithi189 ceph-mon[34790]: pgmap v523: 129 pgs: 129 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 MiB/s wr, 707 op/s 2024-09-13T16:02:22.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:22 smithi193 ceph-mon[35248]: pgmap v524: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.1 MiB/s wr, 742 op/s 2024-09-13T16:02:22.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:22 smithi017 ceph-mon[30494]: pgmap v524: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.1 MiB/s wr, 742 op/s 2024-09-13T16:02:22.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:22 smithi189 ceph-mon[34790]: pgmap v524: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.1 MiB/s wr, 742 op/s 2024-09-13T16:02:24.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:24 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:02:24.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:24 smithi193 ceph-mon[35248]: pgmap v525: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 MiB/s wr, 699 op/s 2024-09-13T16:02:24.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:24 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:02:24.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:24 smithi017 ceph-mon[30494]: pgmap v525: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 MiB/s wr, 699 op/s 2024-09-13T16:02:24.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:24 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:02:24.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:24 smithi189 ceph-mon[34790]: pgmap v525: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 MiB/s wr, 699 op/s 2024-09-13T16:02:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 280.0 s, 798.6 tps, lat 126.564 ms stddev 135.482 2024-09-13T16:02:26.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:26 smithi193 ceph-mon[35248]: pgmap v526: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.6 MiB/s wr, 737 op/s 2024-09-13T16:02:26.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:26 smithi017 ceph-mon[30494]: pgmap v526: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.6 MiB/s wr, 737 op/s 2024-09-13T16:02:26.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:26 smithi189 ceph-mon[34790]: pgmap v526: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.6 MiB/s wr, 737 op/s 2024-09-13T16:02:28.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:28 smithi193 ceph-mon[35248]: pgmap v527: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.4 MiB/s wr, 552 op/s 2024-09-13T16:02:28.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:28 smithi017 ceph-mon[30494]: pgmap v527: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.4 MiB/s wr, 552 op/s 2024-09-13T16:02:28.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:28 smithi189 ceph-mon[34790]: pgmap v527: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.4 MiB/s wr, 552 op/s 2024-09-13T16:02:30.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 285.0 s, 689.2 tps, lat 143.721 ms stddev 167.999 2024-09-13T16:02:30.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:30 smithi193 ceph-mon[35248]: pgmap v528: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.9 MiB/s wr, 631 op/s 2024-09-13T16:02:30.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:30 smithi017 ceph-mon[30494]: pgmap v528: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.9 MiB/s wr, 631 op/s 2024-09-13T16:02:30.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:30 smithi189 ceph-mon[34790]: pgmap v528: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.9 MiB/s wr, 631 op/s 2024-09-13T16:02:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.944+0000 7f6453000640 1 -- 172.21.15.17:0/582086178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f644c107ef0 msgr2=0x7f644c078710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:31.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.944+0000 7f6453000640 1 --2- 172.21.15.17:0/582086178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f644c107ef0 0x7f644c078710 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6444009860 tx=0x7f644402a340 comp rx=0 tx=0).stop 2024-09-13T16:02:31.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.946+0000 7f6453000640 1 -- 172.21.15.17:0/582086178 shutdown_connections 2024-09-13T16:02:31.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.946+0000 7f6453000640 1 --2- 172.21.15.17:0/582086178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f644c107ef0 0x7f644c078710 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:31.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.946+0000 7f6453000640 1 --2- 172.21.15.17:0/582086178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f644c107550 0x7f644c1079b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:31.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.946+0000 7f6453000640 1 --2- 172.21.15.17:0/582086178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f644c0715b0 0x7f644c0719b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:31.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.946+0000 7f6453000640 1 -- 172.21.15.17:0/582086178 >> 172.21.15.17:0/582086178 conn(0x7f644c06cf30 msgr2=0x7f644c06f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:31.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.947+0000 7f6453000640 1 -- 172.21.15.17:0/582086178 shutdown_connections 2024-09-13T16:02:31.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.947+0000 7f6453000640 1 -- 172.21.15.17:0/582086178 wait complete. 2024-09-13T16:02:31.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.948+0000 7f6453000640 1 Processor -- start 2024-09-13T16:02:31.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.948+0000 7f6453000640 1 -- start start 2024-09-13T16:02:31.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.949+0000 7f6453000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f644c0715b0 0x7f644c082ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:31.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.949+0000 7f6453000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f644c107550 0x7f644c0812e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:31.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.949+0000 7f6453000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f644c107ef0 0x7f644c081820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:31.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.949+0000 7f6453000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c083550 con 0x7f644c107ef0 2024-09-13T16:02:31.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.949+0000 7f6453000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c081d60 con 0x7f644c107550 2024-09-13T16:02:31.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.949+0000 7f6453000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c081ef0 con 0x7f644c0715b0 2024-09-13T16:02:31.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.949+0000 7f644be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f644c0715b0 0x7f644c082ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:31.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.949+0000 7f644be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f644c0715b0 0x7f644c082ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:41868/0 (socket says 172.21.15.17:41868) 2024-09-13T16:02:31.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.949+0000 7f644be00640 1 -- 172.21.15.17:0/585227014 learned_addr learned my addr 172.21.15.17:0/585227014 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:31.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.949+0000 7f6443400640 1 --2- 172.21.15.17:0/585227014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f644c107550 0x7f644c0812e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:31.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.950+0000 7f6451000640 1 --2- 172.21.15.17:0/585227014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f644c107ef0 0x7f644c081820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:31.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.950+0000 7f644be00640 1 -- 172.21.15.17:0/585227014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f644c107550 msgr2=0x7f644c0812e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:31.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.950+0000 7f644be00640 1 --2- 172.21.15.17:0/585227014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f644c107550 0x7f644c0812e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:31.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.950+0000 7f644be00640 1 -- 172.21.15.17:0/585227014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f644c107ef0 msgr2=0x7f644c081820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:31.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.950+0000 7f644be00640 1 --2- 172.21.15.17:0/585227014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f644c107ef0 0x7f644c081820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:31.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.950+0000 7f644be00640 1 -- 172.21.15.17:0/585227014 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6444009490 con 0x7f644c0715b0 2024-09-13T16:02:31.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.950+0000 7f6451000640 1 --2- 172.21.15.17:0/585227014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f644c107ef0 0x7f644c081820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:31.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.952+0000 7f644be00640 1 --2- 172.21.15.17:0/585227014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f644c0715b0 0x7f644c082ca0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f643c00ebc0 tx=0x7f643c00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:31.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.952+0000 7f6449600640 1 -- 172.21.15.17:0/585227014 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c0099b0 con 0x7f644c0715b0 2024-09-13T16:02:31.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.952+0000 7f6449600640 1 -- 172.21.15.17:0/585227014 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f643c00eec0 con 0x7f644c0715b0 2024-09-13T16:02:31.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.952+0000 7f6449600640 1 -- 172.21.15.17:0/585227014 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c018aa0 con 0x7f644c0715b0 2024-09-13T16:02:31.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.952+0000 7f6453000640 1 -- 172.21.15.17:0/585227014 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644c1bdcd0 con 0x7f644c0715b0 2024-09-13T16:02:31.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.952+0000 7f6453000640 1 -- 172.21.15.17:0/585227014 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f644c1be0a0 con 0x7f644c0715b0 2024-09-13T16:02:31.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.957+0000 7f6455e05740 1 Processor -- start 2024-09-13T16:02:31.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.958+0000 7f6455e05740 1 -- start start 2024-09-13T16:02:31.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.960+0000 7f6455e05740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b3852e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:31.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.960+0000 7f6455e05740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605b38533b0 0x5605b3857e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:31.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.960+0000 7f6455e05740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b3858440 0x5605b385a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:31.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.960+0000 7f6443400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b3858440 0x5605b385a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:31.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.960+0000 7f6451000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b3852e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:31.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.960+0000 7f6451000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b3852e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:41870/0 (socket says 172.21.15.17:41870) 2024-09-13T16:02:31.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.960+0000 7f6443400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b3858440 0x5605b385a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:55198/0 (socket says 172.21.15.17:55198) 2024-09-13T16:02:31.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.960+0000 7f6451000640 1 -- 172.21.15.17:0/4189300886 learned_addr learned my addr 172.21.15.17:0/4189300886 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:31.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.960+0000 7f6449600640 1 -- 172.21.15.17:0/585227014 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f643c018c00 con 0x7f644c0715b0 2024-09-13T16:02:31.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.961+0000 7f644be00640 1 --2- 172.21.15.17:0/4189300886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605b38533b0 0x5605b3857e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:31.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.961+0000 7f6455e05740 1 -- 172.21.15.17:0/4189300886 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605b375ebb0 con 0x5605b38533b0 2024-09-13T16:02:31.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.961+0000 7f6455e05740 1 -- 172.21.15.17:0/4189300886 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605b37bca70 con 0x5605b3858440 2024-09-13T16:02:31.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.961+0000 7f6455e05740 1 -- 172.21.15.17:0/4189300886 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605b37ba200 con 0x5605b3852a70 2024-09-13T16:02:31.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.963+0000 7f6449600640 1 --2- 172.21.15.17:0/585227014 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f64300a1110 0x7f64300a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:31.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.963+0000 7f6449600640 1 -- 172.21.15.17:0/585227014 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f643c014070 con 0x7f644c0715b0 2024-09-13T16:02:31.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.964+0000 7f6443400640 1 -- 172.21.15.17:0/4189300886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 msgr2=0x5605b3852e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:31.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.964+0000 7f6443400640 1 --2- 172.21.15.17:0/4189300886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b3852e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:31.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.964+0000 7f6443400640 1 -- 172.21.15.17:0/4189300886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605b38533b0 msgr2=0x5605b3857e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:31.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.964+0000 7f6451000640 1 --2- 172.21.15.17:0/585227014 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f64300a1110 0x7f64300a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:31.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.964+0000 7f6443400640 1 --2- 172.21.15.17:0/4189300886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605b38533b0 0x5605b3857e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:31.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.964+0000 7f6443400640 1 -- 172.21.15.17:0/4189300886 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605b3757940 con 0x5605b3858440 2024-09-13T16:02:31.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.965+0000 7f6443400640 1 --2- 172.21.15.17:0/4189300886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b3858440 0x5605b385a900 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f643400aa60 tx=0x7f643400ae60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3025d79d486e604 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:31.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.965+0000 7f6441600640 1 -- 172.21.15.17:0/4189300886 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643400f040 con 0x5605b3858440 2024-09-13T16:02:31.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.965+0000 7f6441600640 1 -- 172.21.15.17:0/4189300886 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6434005020 con 0x5605b3858440 2024-09-13T16:02:31.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.965+0000 7f6441600640 1 -- 172.21.15.17:0/4189300886 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6434004ca0 con 0x5605b3858440 2024-09-13T16:02:31.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.966+0000 7f6451000640 1 --2- 172.21.15.17:0/585227014 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f64300a1110 0x7f64300a35d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6444009780 tx=0x7f6444005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:31.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.967+0000 7f6455e05740 1 -- 172.21.15.17:0/4189300886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b3858440 msgr2=0x5605b385a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:31.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.967+0000 7f6455e05740 1 --2- 172.21.15.17:0/4189300886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b3858440 0x5605b385a900 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f643400aa60 tx=0x7f643400ae60 comp rx=0 tx=0).stop 2024-09-13T16:02:31.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.968+0000 7f6455e05740 1 -- 172.21.15.17:0/4189300886 shutdown_connections 2024-09-13T16:02:31.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.968+0000 7f6455e05740 1 --2- 172.21.15.17:0/4189300886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b3858440 0x5605b385a900 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:31.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.968+0000 7f6455e05740 1 --2- 172.21.15.17:0/4189300886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605b38533b0 0x5605b3857e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:31.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.968+0000 7f6455e05740 1 --2- 172.21.15.17:0/4189300886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b3852e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:31.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.968+0000 7f6455e05740 1 -- 172.21.15.17:0/4189300886 >> 172.21.15.17:0/4189300886 conn(0x5605b384e0e0 msgr2=0x5605b384e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:31.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.969+0000 7f6455e05740 1 -- 172.21.15.17:0/4189300886 shutdown_connections 2024-09-13T16:02:31.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.969+0000 7f6455e05740 1 -- 172.21.15.17:0/4189300886 wait complete. 2024-09-13T16:02:31.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.970+0000 7f6455e05740 1 -- start start 2024-09-13T16:02:31.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.970+0000 7f6455e05740 1 Processor -- start 2024-09-13T16:02:31.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.971+0000 7f6455e05740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b385c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:31.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.971+0000 7f6455e05740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605b38533b0 0x5605b385cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:31.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.971+0000 7f6455e05740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b3858440 0x5605b3863bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:31.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.971+0000 7f6455e05740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605b37b5af0 con 0x5605b38533b0 2024-09-13T16:02:31.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.971+0000 7f6455e05740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605b3773f20 con 0x5605b3858440 2024-09-13T16:02:31.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.971+0000 7f6455e05740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605b3773bc0 con 0x5605b3852a70 2024-09-13T16:02:31.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.971+0000 7f6455e05740 10 client.0 _ll_register_callbacks cb 0x5605b37a5a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:02:31.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.971+0000 7f644be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b385c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:31.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.971+0000 7f644be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b385c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:41874/0 (socket says 172.21.15.17:41874) 2024-09-13T16:02:31.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.971+0000 7f644be00640 1 -- 172.21.15.17:0/963642289 learned_addr learned my addr 172.21.15.17:0/963642289 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.971+0000 7f6451000640 1 --2- 172.21.15.17:0/963642289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b3858440 0x5605b3863bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.972+0000 7f644be00640 1 -- 172.21.15.17:0/963642289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b3858440 msgr2=0x5605b3863bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.972+0000 7f644be00640 1 --2- 172.21.15.17:0/963642289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b3858440 0x5605b3863bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.972+0000 7f644be00640 1 -- 172.21.15.17:0/963642289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605b38533b0 msgr2=0x5605b385cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.972+0000 7f644be00640 1 --2- 172.21.15.17:0/963642289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605b38533b0 0x5605b385cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.972+0000 7f644be00640 1 -- 172.21.15.17:0/963642289 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643400a6c0 con 0x5605b3852a70 2024-09-13T16:02:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.972+0000 7f644be00640 1 --2- 172.21.15.17:0/963642289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b385c650 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f643c096860 tx=0x7f643c09a360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51e8ba244487d6ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.972+0000 7f643a000640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:02:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.972+0000 7f643a000640 1 -- 172.21.15.17:0/963642289 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c0cd160 con 0x5605b3852a70 2024-09-13T16:02:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.972+0000 7f643a000640 1 -- 172.21.15.17:0/963642289 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f643c0a27e0 con 0x5605b3852a70 2024-09-13T16:02:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.972+0000 7f6455e05740 1 -- 172.21.15.17:0/963642289 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5605b37dfc90 con 0x5605b3852a70 2024-09-13T16:02:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.972+0000 7f643a000640 1 -- 172.21.15.17:0/963642289 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f643c085070 con 0x5605b3852a70 2024-09-13T16:02:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.972+0000 7f6455e05740 10 client.25756 fetch_fsmap learned FSMap version 31 2024-09-13T16:02:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.972+0000 7f6455e05740 1 -- 172.21.15.17:0/963642289 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5605b37b4170 con 0x5605b3852a70 2024-09-13T16:02:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.973+0000 7f643a000640 1 -- 172.21.15.17:0/963642289 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5605b37dfc90 con 0x5605b3852a70 2024-09-13T16:02:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.973+0000 7f643a000640 1 -- 172.21.15.17:0/963642289 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f643c0cf0b0 con 0x5605b3852a70 2024-09-13T16:02:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.973+0000 7f6455e05740 10 client.25756 fetch_fsmap finished waiting for FSMap version 31 2024-09-13T16:02:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.973+0000 7f6455e05740 10 client.25756 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:02:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.973+0000 7f6455e05740 20 client.25756 populate_metadata read hostname 'smithi017' 2024-09-13T16:02:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.973+0000 7f6455e05740 1 --2- 172.21.15.17:0/963642289 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5605b3868360 0x5605b386a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.973+0000 7f6455e05740 4 client.25756 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:02:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.973+0000 7f6455e05740 1 -- 172.21.15.17:0/963642289 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5605b37a87d0 con 0x5605b3868360 2024-09-13T16:02:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.973+0000 7f6443400640 1 --2- 172.21.15.17:0/963642289 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5605b3868360 0x5605b386a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.974+0000 7f6443400640 1 --2- 172.21.15.17:0/963642289 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5605b3868360 0x5605b386a780 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63b3c0fecdb9b394 server_cookie=fb9ba676613095fa in_seq=0 out_seq=0 2024-09-13T16:02:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.974+0000 7f643a000640 10 client.25756 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:02:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.975+0000 7f643a000640 1 -- 172.21.15.17:0/963642289 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5605b37a87d0 con 0x5605b3868360 2024-09-13T16:02:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.975+0000 7f643a000640 10 client.25756 handle_command_reply: tid=0 2024-09-13T16:02:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.975+0000 7f6455e05740 1 client.25756 shutdown 2024-09-13T16:02:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.975+0000 7f6455e05740 1 -- 172.21.15.17:0/963642289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 msgr2=0x5605b385c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.975+0000 7f6455e05740 1 --2- 172.21.15.17:0/963642289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b385c650 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f643c096860 tx=0x7f643c09a360 comp rx=0 tx=0).stop 2024-09-13T16:02:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.976+0000 7f6455e05740 1 -- 172.21.15.17:0/963642289 shutdown_connections 2024-09-13T16:02:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.976+0000 7f6455e05740 1 --2- 172.21.15.17:0/963642289 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5605b3868360 0x5605b386a780 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.976+0000 7f6455e05740 1 --2- 172.21.15.17:0/963642289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b3858440 0x5605b3863bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.976+0000 7f6455e05740 1 --2- 172.21.15.17:0/963642289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605b38533b0 0x5605b385cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.976+0000 7f6455e05740 1 --2- 172.21.15.17:0/963642289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b385c650 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.976+0000 7f6455e05740 1 -- 172.21.15.17:0/963642289 >> 172.21.15.17:0/963642289 conn(0x5605b384e0e0 msgr2=0x5605b384f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:31.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.976+0000 7f643a000640 0 client.25756 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:02:31.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.976+0000 7f6455e05740 1 -- 172.21.15.17:0/963642289 shutdown_connections 2024-09-13T16:02:31.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.976+0000 7f6455e05740 1 -- 172.21.15.17:0/963642289 wait complete. 2024-09-13T16:02:31.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.977+0000 7f6455e05740 20 client.25756 trim_cache size 0 max 16384 2024-09-13T16:02:32.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.993+0000 7f6455e05740 1 Processor -- start 2024-09-13T16:02:32.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.993+0000 7f6455e05740 1 -- start start 2024-09-13T16:02:32.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.993+0000 7f6455e05740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b38577a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:32.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.993+0000 7f6455e05740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605b38533b0 0x5605b3863b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:32.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.993+0000 7f6455e05740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b3858440 0x5605b3857ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:32.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.993+0000 7f6455e05740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605b351ce60 con 0x5605b38533b0 2024-09-13T16:02:32.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.993+0000 7f6455e05740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605b38526d0 con 0x5605b3858440 2024-09-13T16:02:32.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.993+0000 7f6455e05740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605b385b010 con 0x5605b3852a70 2024-09-13T16:02:32.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.994+0000 7f644be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b38577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:32.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.994+0000 7f644be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b38577a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:41878/0 (socket says 172.21.15.17:41878) 2024-09-13T16:02:32.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.994+0000 7f644be00640 1 -- 172.21.15.17:0/3756794333 learned_addr learned my addr 172.21.15.17:0/3756794333 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:32.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.994+0000 7f6443400640 1 --2- 172.21.15.17:0/3756794333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605b38533b0 0x5605b3863b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:32.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.994+0000 7f644be00640 1 -- 172.21.15.17:0/3756794333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b3858440 msgr2=0x5605b3857ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:02:32.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.994+0000 7f644be00640 1 --2- 172.21.15.17:0/3756794333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b3858440 0x5605b3857ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:32.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.994+0000 7f644be00640 1 -- 172.21.15.17:0/3756794333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605b38533b0 msgr2=0x5605b3863b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:32.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.994+0000 7f644be00640 1 --2- 172.21.15.17:0/3756794333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605b38533b0 0x5605b3863b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:32.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.994+0000 7f644be00640 1 -- 172.21.15.17:0/3756794333 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605b3756180 con 0x5605b3852a70 2024-09-13T16:02:32.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.995+0000 7f644be00640 1 --2- 172.21.15.17:0/3756794333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b38577a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f643c096810 tx=0x7f643c09e190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e7f7a860c8c9f51 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.995+0000 7f6442000640 1 -- 172.21.15.17:0/3756794333 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c0cd160 con 0x5605b3852a70 2024-09-13T16:02:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.995+0000 7f6442000640 1 -- 172.21.15.17:0/3756794333 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f643c099cc0 con 0x5605b3852a70 2024-09-13T16:02:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.995+0000 7f6442000640 1 -- 172.21.15.17:0/3756794333 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c083bb0 con 0x5605b3852a70 2024-09-13T16:02:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.996+0000 7f6455e05740 1 -- 172.21.15.17:0/3756794333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 msgr2=0x5605b38577a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.996+0000 7f6455e05740 1 --2- 172.21.15.17:0/3756794333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b38577a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f643c096810 tx=0x7f643c09e190 comp rx=0 tx=0).stop 2024-09-13T16:02:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.996+0000 7f6455e05740 1 -- 172.21.15.17:0/3756794333 shutdown_connections 2024-09-13T16:02:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.996+0000 7f6455e05740 1 --2- 172.21.15.17:0/3756794333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b3858440 0x5605b3857ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.996+0000 7f6455e05740 1 --2- 172.21.15.17:0/3756794333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605b38533b0 0x5605b3863b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.996+0000 7f6455e05740 1 --2- 172.21.15.17:0/3756794333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b38577a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.996+0000 7f6455e05740 1 -- 172.21.15.17:0/3756794333 >> 172.21.15.17:0/3756794333 conn(0x5605b384e0e0 msgr2=0x5605b3854160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.997+0000 7f6455e05740 1 -- 172.21.15.17:0/3756794333 shutdown_connections 2024-09-13T16:02:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.997+0000 7f6455e05740 1 -- 172.21.15.17:0/3756794333 wait complete. 2024-09-13T16:02:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.997+0000 7f6455e05740 1 -- start start 2024-09-13T16:02:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.997+0000 7f6455e05740 1 Processor -- start 2024-09-13T16:02:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.998+0000 7f6455e05740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b3863550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.998+0000 7f6455e05740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605b38533b0 0x5605b3863a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.998+0000 7f6455e05740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b3858440 0x5605b3861bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.998+0000 7f6455e05740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605b38622d0 con 0x5605b38533b0 2024-09-13T16:02:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.998+0000 7f6455e05740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605b3862440 con 0x5605b3858440 2024-09-13T16:02:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.998+0000 7f6455e05740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605b3862600 con 0x5605b3852a70 2024-09-13T16:02:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.998+0000 7f6455e05740 10 client.0 _ll_register_callbacks cb 0x7f643400a610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:02:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.998+0000 7f644be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b3863550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.998+0000 7f644be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b3863550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:41892/0 (socket says 172.21.15.17:41892) 2024-09-13T16:02:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.998+0000 7f6451000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b3858440 0x5605b3861bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.998+0000 7f644be00640 1 -- 172.21.15.17:0/1904972944 learned_addr learned my addr 172.21.15.17:0/1904972944 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.998+0000 7f6443400640 1 --2- 172.21.15.17:0/1904972944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605b38533b0 0x5605b3863a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.998+0000 7f644be00640 1 -- 172.21.15.17:0/1904972944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b3858440 msgr2=0x5605b3861bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.998+0000 7f644be00640 1 --2- 172.21.15.17:0/1904972944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b3858440 0x5605b3861bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.998+0000 7f644be00640 1 -- 172.21.15.17:0/1904972944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605b38533b0 msgr2=0x5605b3863a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.998+0000 7f644be00640 1 --2- 172.21.15.17:0/1904972944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605b38533b0 0x5605b3863a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.998+0000 7f644be00640 1 -- 172.21.15.17:0/1904972944 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605b37b4170 con 0x5605b3852a70 2024-09-13T16:02:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.998+0000 7f6443400640 1 --2- 172.21.15.17:0/1904972944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605b38533b0 0x5605b3863a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.999+0000 7f644be00640 1 --2- 172.21.15.17:0/1904972944 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b3863550 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f643c0a22b0 tx=0x7f643c09e200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74189b7226abcfe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.999+0000 7f643a000640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:02:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.999+0000 7f643a000640 1 -- 172.21.15.17:0/1904972944 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c0992c0 con 0x5605b3852a70 2024-09-13T16:02:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.999+0000 7f643a000640 1 -- 172.21.15.17:0/1904972944 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f643c085020 con 0x5605b3852a70 2024-09-13T16:02:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.999+0000 7f6455e05740 1 -- 172.21.15.17:0/1904972944 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6434005020 con 0x5605b3852a70 2024-09-13T16:02:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.999+0000 7f643a000640 1 -- 172.21.15.17:0/1904972944 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f643c0a2560 con 0x5605b3852a70 2024-09-13T16:02:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.999+0000 7f6455e05740 10 client.25762 fetch_fsmap learned FSMap version 31 2024-09-13T16:02:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.999+0000 7f6455e05740 1 -- 172.21.15.17:0/1904972944 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5605b377b560 con 0x5605b3852a70 2024-09-13T16:02:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.999+0000 7f643a000640 1 -- 172.21.15.17:0/1904972944 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6434005020 con 0x5605b3852a70 2024-09-13T16:02:32.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:31.999+0000 7f643a000640 1 -- 172.21.15.17:0/1904972944 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f643c004a40 con 0x5605b3852a70 2024-09-13T16:02:32.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.000+0000 7f6455e05740 10 client.25762 fetch_fsmap finished waiting for FSMap version 31 2024-09-13T16:02:32.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.000+0000 7f6455e05740 10 client.25762 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:02:32.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.000+0000 7f6455e05740 20 client.25762 populate_metadata read hostname 'smithi017' 2024-09-13T16:02:32.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.000+0000 7f6455e05740 1 --2- 172.21.15.17:0/1904972944 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5605b38bf880 0x5605b38c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:32.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.000+0000 7f6455e05740 4 client.25762 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:02:32.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.000+0000 7f6455e05740 1 -- 172.21.15.17:0/1904972944 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5605b34a9300 con 0x5605b38bf880 2024-09-13T16:02:32.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.000+0000 7f6443400640 1 --2- 172.21.15.17:0/1904972944 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5605b38bf880 0x5605b38c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:32.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.001+0000 7f6443400640 1 --2- 172.21.15.17:0/1904972944 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5605b38bf880 0x5605b38c1ca0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c1828399b91bda6 server_cookie=db8d383f3a9e328d in_seq=0 out_seq=0 2024-09-13T16:02:32.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.001+0000 7f643a000640 10 client.25762 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:02:32.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.008+0000 7f643a000640 1 -- 172.21.15.17:0/1904972944 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5605b34a9300 con 0x5605b38bf880 2024-09-13T16:02:32.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.008+0000 7f643a000640 10 client.25762 handle_command_reply: tid=0 2024-09-13T16:02:32.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.008+0000 7f6455e05740 1 client.25762 shutdown 2024-09-13T16:02:32.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.010+0000 7f6455e05740 1 -- 172.21.15.17:0/1904972944 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 msgr2=0x5605b3863550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:32.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.010+0000 7f6455e05740 1 --2- 172.21.15.17:0/1904972944 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b3863550 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f643c0a22b0 tx=0x7f643c09e200 comp rx=0 tx=0).stop 2024-09-13T16:02:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.010+0000 7f6455e05740 1 -- 172.21.15.17:0/1904972944 shutdown_connections 2024-09-13T16:02:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.010+0000 7f6455e05740 1 --2- 172.21.15.17:0/1904972944 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5605b38bf880 0x5605b38c1ca0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.010+0000 7f6455e05740 1 --2- 172.21.15.17:0/1904972944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605b3858440 0x5605b3861bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.010+0000 7f6455e05740 1 --2- 172.21.15.17:0/1904972944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605b38533b0 0x5605b3863a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.010+0000 7f6455e05740 1 --2- 172.21.15.17:0/1904972944 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605b3852a70 0x5605b3863550 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.010+0000 7f6455e05740 1 -- 172.21.15.17:0/1904972944 >> 172.21.15.17:0/1904972944 conn(0x5605b384e0e0 msgr2=0x5605b3857630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.010+0000 7f643a000640 0 client.25762 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:02:32.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.011+0000 7f6455e05740 1 -- 172.21.15.17:0/1904972944 shutdown_connections 2024-09-13T16:02:32.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.011+0000 7f6455e05740 1 -- 172.21.15.17:0/1904972944 wait complete. 2024-09-13T16:02:32.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.011+0000 7f6455e05740 20 client.25762 trim_cache size 0 max 16384 2024-09-13T16:02:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:02:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:02:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:02:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:02:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.012+0000 7f6453000640 1 -- 172.21.15.17:0/585227014 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f64300a1110 msgr2=0x7f64300a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.012+0000 7f6453000640 1 --2- 172.21.15.17:0/585227014 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f64300a1110 0x7f64300a35d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6444009780 tx=0x7f6444005f90 comp rx=0 tx=0).stop 2024-09-13T16:02:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.012+0000 7f6453000640 1 -- 172.21.15.17:0/585227014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f644c0715b0 msgr2=0x7f644c082ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.012+0000 7f6453000640 1 --2- 172.21.15.17:0/585227014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f644c0715b0 0x7f644c082ca0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f643c00ebc0 tx=0x7f643c00c6a0 comp rx=0 tx=0).stop 2024-09-13T16:02:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.012+0000 7f6453000640 1 -- 172.21.15.17:0/585227014 shutdown_connections 2024-09-13T16:02:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.012+0000 7f6453000640 1 --2- 172.21.15.17:0/585227014 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f64300a1110 0x7f64300a35d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.012+0000 7f6453000640 1 --2- 172.21.15.17:0/585227014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f644c107ef0 0x7f644c081820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.012+0000 7f6453000640 1 --2- 172.21.15.17:0/585227014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f644c107550 0x7f644c0812e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.012+0000 7f6453000640 1 --2- 172.21.15.17:0/585227014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f644c0715b0 0x7f644c082ca0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.012+0000 7f6453000640 1 -- 172.21.15.17:0/585227014 >> 172.21.15.17:0/585227014 conn(0x7f644c06cf30 msgr2=0x7f644c0749f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.012+0000 7f6453000640 1 -- 172.21.15.17:0/585227014 shutdown_connections 2024-09-13T16:02:32.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:32.012+0000 7f6453000640 1 -- 172.21.15.17:0/585227014 wait complete. 2024-09-13T16:02:32.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:32 smithi193 ceph-mon[35248]: pgmap v529: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.3 MiB/s wr, 580 op/s 2024-09-13T16:02:32.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:32 smithi017 ceph-mon[30494]: pgmap v529: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.3 MiB/s wr, 580 op/s 2024-09-13T16:02:32.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:32 smithi189 ceph-mon[34790]: pgmap v529: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.3 MiB/s wr, 580 op/s 2024-09-13T16:02:34.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:34 smithi193 ceph-mon[35248]: pgmap v530: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.1 MiB/s wr, 533 op/s 2024-09-13T16:02:34.764 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:34 smithi017 ceph-mon[30494]: pgmap v530: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.1 MiB/s wr, 533 op/s 2024-09-13T16:02:34.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:34 smithi189 ceph-mon[34790]: pgmap v530: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.1 MiB/s wr, 533 op/s 2024-09-13T16:02:35.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 290.0 s, 754.4 tps, lat 127.295 ms stddev 139.850 2024-09-13T16:02:36.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:36 smithi193 ceph-mon[35248]: pgmap v531: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.3 MiB/s wr, 565 op/s 2024-09-13T16:02:36.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:36 smithi017 ceph-mon[30494]: pgmap v531: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.3 MiB/s wr, 565 op/s 2024-09-13T16:02:36.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:36 smithi189 ceph-mon[34790]: pgmap v531: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.3 MiB/s wr, 565 op/s 2024-09-13T16:02:38.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:38 smithi193 ceph-mon[35248]: pgmap v532: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.2 MiB/s wr, 482 op/s 2024-09-13T16:02:38.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:38 smithi017 ceph-mon[30494]: pgmap v532: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.2 MiB/s wr, 482 op/s 2024-09-13T16:02:38.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:38 smithi189 ceph-mon[34790]: pgmap v532: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.2 MiB/s wr, 482 op/s 2024-09-13T16:02:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 295.0 s, 698.6 tps, lat 149.746 ms stddev 177.803 2024-09-13T16:02:40.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:40 smithi193 ceph-mon[35248]: pgmap v533: 129 pgs: 129 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.6 MiB/s wr, 609 op/s 2024-09-13T16:02:40.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:40 smithi017 ceph-mon[30494]: pgmap v533: 129 pgs: 129 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.6 MiB/s wr, 609 op/s 2024-09-13T16:02:40.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:40 smithi189 ceph-mon[34790]: pgmap v533: 129 pgs: 129 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.6 MiB/s wr, 609 op/s 2024-09-13T16:02:42.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:41 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:42.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:41 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:42.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:41 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:02:43.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:42 smithi189 ceph-mon[34790]: pgmap v534: 129 pgs: 129 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 10 MiB/s wr, 634 op/s 2024-09-13T16:02:43.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:42 smithi193 ceph-mon[35248]: pgmap v534: 129 pgs: 129 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 10 MiB/s wr, 634 op/s 2024-09-13T16:02:43.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:42 smithi017 ceph-mon[30494]: pgmap v534: 129 pgs: 129 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 10 MiB/s wr, 634 op/s 2024-09-13T16:02:44.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:44.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:02:44.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T16:02:44.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:44.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:02:44.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T16:02:44.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:02:44.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:02:44.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T16:02:45.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:44 smithi189 ceph-mon[34790]: pgmap v535: 129 pgs: 129 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 595 op/s 2024-09-13T16:02:45.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.190+0000 7f409be00640 1 -- 172.21.15.17:0/4079920342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f409c101d70 msgr2=0x7f409c102170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:45.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.190+0000 7f409be00640 1 --2- 172.21.15.17:0/4079920342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f409c101d70 0x7f409c102170 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f408c009900 tx=0x7f408c02a410 comp rx=0 tx=0).stop 2024-09-13T16:02:45.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.193+0000 7f409be00640 1 -- 172.21.15.17:0/4079920342 shutdown_connections 2024-09-13T16:02:45.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.193+0000 7f409be00640 1 --2- 172.21.15.17:0/4079920342 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f409c103920 0x7f409c10a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.193+0000 7f409be00640 1 --2- 172.21.15.17:0/4079920342 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f409c102f60 0x7f409c1033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.193+0000 7f409be00640 1 --2- 172.21.15.17:0/4079920342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f409c101d70 0x7f409c102170 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.193+0000 7f409be00640 1 -- 172.21.15.17:0/4079920342 >> 172.21.15.17:0/4079920342 conn(0x7f409c0fd4d0 msgr2=0x7f409c0ff910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:45.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.193+0000 7f409be00640 1 -- 172.21.15.17:0/4079920342 shutdown_connections 2024-09-13T16:02:45.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.193+0000 7f409be00640 1 -- 172.21.15.17:0/4079920342 wait complete. 2024-09-13T16:02:45.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.195+0000 7f409be00640 1 Processor -- start 2024-09-13T16:02:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.195+0000 7f409be00640 1 -- start start 2024-09-13T16:02:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.196+0000 7f409be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f409c101d70 0x7f409c19c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.196+0000 7f409be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f409c102f60 0x7f409c19c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.196+0000 7f409be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f409c103920 0x7f409c1a3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.196+0000 7f409be00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409c1a3c40 con 0x7f409c101d70 2024-09-13T16:02:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.196+0000 7f409be00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409c10ca10 con 0x7f409c102f60 2024-09-13T16:02:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.196+0000 7f409be00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409c10cbd0 con 0x7f409c103920 2024-09-13T16:02:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.197+0000 7f409aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f409c101d70 0x7f409c19c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.197+0000 7f409aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f409c101d70 0x7f409c19c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43046/0 (socket says 172.21.15.17:43046) 2024-09-13T16:02:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.197+0000 7f409aa00640 1 -- 172.21.15.17:0/2604683622 learned_addr learned my addr 172.21.15.17:0/2604683622 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.197+0000 7f409a000640 1 --2- 172.21.15.17:0/2604683622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f409c102f60 0x7f409c19c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.197+0000 7f409b400640 1 --2- 172.21.15.17:0/2604683622 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f409c103920 0x7f409c1a3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:45.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.198+0000 7f409aa00640 1 -- 172.21.15.17:0/2604683622 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f409c103920 msgr2=0x7f409c1a3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:45.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.198+0000 7f409aa00640 1 --2- 172.21.15.17:0/2604683622 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f409c103920 0x7f409c1a3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.198+0000 7f409aa00640 1 -- 172.21.15.17:0/2604683622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f409c102f60 msgr2=0x7f409c19c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:45.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.198+0000 7f409aa00640 1 --2- 172.21.15.17:0/2604683622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f409c102f60 0x7f409c19c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.198+0000 7f409aa00640 1 -- 172.21.15.17:0/2604683622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c009560 con 0x7f409c101d70 2024-09-13T16:02:45.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.198+0000 7f409b400640 1 --2- 172.21.15.17:0/2604683622 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f409c103920 0x7f409c1a3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:45.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.198+0000 7f409aa00640 1 --2- 172.21.15.17:0/2604683622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f409c101d70 0x7f409c19c150 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f408c031500 tx=0x7f408c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:45.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.200+0000 7f40a0a00640 1 -- 172.21.15.17:0/2604683622 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c003e00 con 0x7f409c101d70 2024-09-13T16:02:45.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.200+0000 7f40a0a00640 1 -- 172.21.15.17:0/2604683622 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f408c031c70 con 0x7f409c101d70 2024-09-13T16:02:45.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.200+0000 7f40a0a00640 1 -- 172.21.15.17:0/2604683622 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c03bd80 con 0x7f409c101d70 2024-09-13T16:02:45.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.201+0000 7f409be00640 1 -- 172.21.15.17:0/2604683622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f409c10ce50 con 0x7f409c101d70 2024-09-13T16:02:45.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.201+0000 7f409be00640 1 -- 172.21.15.17:0/2604683622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f409c10d2b0 con 0x7f409c101d70 2024-09-13T16:02:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.208+0000 7f40a4c14740 1 Processor -- start 2024-09-13T16:02:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.208+0000 7f40a4c14740 1 -- start start 2024-09-13T16:02:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.208+0000 7f40a0a00640 1 -- 172.21.15.17:0/2604683622 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f408c03b460 con 0x7f409c101d70 2024-09-13T16:02:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.209+0000 7f40a4c14740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6970ac80 0x55bb6970b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.209+0000 7f40a4c14740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6970b5c0 0x55bb69710080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.209+0000 7f40a4c14740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb69710650 0x55bb69712b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.209+0000 7f40a4c14740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb69616bb0 con 0x55bb6970b5c0 2024-09-13T16:02:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.209+0000 7f40a4c14740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb69674a70 con 0x55bb6970ac80 2024-09-13T16:02:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.209+0000 7f40a4c14740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb69672200 con 0x55bb69710650 2024-09-13T16:02:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.209+0000 7f409b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6970ac80 0x55bb6970b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.209+0000 7f409b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6970ac80 0x55bb6970b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:58878/0 (socket says 172.21.15.17:58878) 2024-09-13T16:02:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.209+0000 7f409b400640 1 -- 172.21.15.17:0/851645704 learned_addr learned my addr 172.21.15.17:0/851645704 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.210+0000 7f409aa00640 1 --2- 172.21.15.17:0/851645704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6970b5c0 0x55bb69710080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.211+0000 7f40a0a00640 1 --2- 172.21.15.17:0/2604683622 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f40800a11b0 0x7f40800a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.211+0000 7f409b400640 1 -- 172.21.15.17:0/851645704 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb69710650 msgr2=0x55bb69712b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.211+0000 7f40a0a00640 1 -- 172.21.15.17:0/2604683622 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f408c0ed290 con 0x7f409c101d70 2024-09-13T16:02:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.211+0000 7f409b400640 1 --2- 172.21.15.17:0/851645704 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb69710650 0x55bb69712b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.211+0000 7f409b400640 1 -- 172.21.15.17:0/851645704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6970b5c0 msgr2=0x55bb69710080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:45.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.211+0000 7f409b400640 1 --2- 172.21.15.17:0/851645704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6970b5c0 0x55bb69710080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.211+0000 7f409b400640 1 -- 172.21.15.17:0/851645704 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb6960f940 con 0x55bb6970ac80 2024-09-13T16:02:45.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.212+0000 7f409b400640 1 --2- 172.21.15.17:0/2604683622 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f40800a11b0 0x7f40800a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:45.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.212+0000 7f409b400640 1 --2- 172.21.15.17:0/851645704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6970ac80 0x55bb6970b080 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4094009fd0 tx=0x7f4094010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6b2c0b6a84cd707 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:45.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.213+0000 7f4090c00640 1 -- 172.21.15.17:0/851645704 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4094011ae0 con 0x55bb6970ac80 2024-09-13T16:02:45.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.214+0000 7f4090c00640 1 -- 172.21.15.17:0/851645704 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4094015070 con 0x55bb6970ac80 2024-09-13T16:02:45.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.214+0000 7f4090c00640 1 -- 172.21.15.17:0/851645704 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4094011ae0 con 0x55bb6970ac80 2024-09-13T16:02:45.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.218+0000 7f40a4c14740 1 -- 172.21.15.17:0/851645704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6970ac80 msgr2=0x55bb6970b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:45.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.218+0000 7f40a4c14740 1 --2- 172.21.15.17:0/851645704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6970ac80 0x55bb6970b080 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4094009fd0 tx=0x7f4094010860 comp rx=0 tx=0).stop 2024-09-13T16:02:45.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.219+0000 7f409b400640 1 --2- 172.21.15.17:0/2604683622 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f40800a11b0 0x7f40800a3670 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f409401f000 tx=0x7f409401b970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:45.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.219+0000 7f40a4c14740 1 -- 172.21.15.17:0/851645704 shutdown_connections 2024-09-13T16:02:45.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.219+0000 7f40a4c14740 1 --2- 172.21.15.17:0/851645704 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb69710650 0x55bb69712b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.219+0000 7f40a4c14740 1 --2- 172.21.15.17:0/851645704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6970b5c0 0x55bb69710080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.219+0000 7f40a4c14740 1 --2- 172.21.15.17:0/851645704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6970ac80 0x55bb6970b080 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.219+0000 7f40a4c14740 1 -- 172.21.15.17:0/851645704 >> 172.21.15.17:0/851645704 conn(0x55bb697062f0 msgr2=0x55bb697066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:45.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.219+0000 7f40a4c14740 1 -- 172.21.15.17:0/851645704 shutdown_connections 2024-09-13T16:02:45.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.220+0000 7f40a4c14740 1 -- 172.21.15.17:0/851645704 wait complete. 2024-09-13T16:02:45.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.220+0000 7f40a4c14740 1 -- start start 2024-09-13T16:02:45.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.221+0000 7f40a4c14740 1 Processor -- start 2024-09-13T16:02:45.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.222+0000 7f40a4c14740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6970ac80 0x55bb69714a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:45.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.222+0000 7f40a4c14740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6970b5c0 0x55bb69714f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:45.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.222+0000 7f40a4c14740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb69710650 0x55bb6971bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:45.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.223+0000 7f409a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6970b5c0 0x55bb69714f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:45.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.223+0000 7f409a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6970b5c0 0x55bb69714f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:58886/0 (socket says 172.21.15.17:58886) 2024-09-13T16:02:45.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.223+0000 7f409aa00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6970ac80 0x55bb69714a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:45.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.223+0000 7f409b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb69710650 0x55bb6971bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:45.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.223+0000 7f409aa00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6970ac80 0x55bb69714a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:44420/0 (socket says 172.21.15.17:44420) 2024-09-13T16:02:45.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.223+0000 7f40a4c14740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6966daf0 con 0x55bb69710650 2024-09-13T16:02:45.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.223+0000 7f40a4c14740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6962bf20 con 0x55bb6970b5c0 2024-09-13T16:02:45.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.223+0000 7f40a4c14740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6962bbc0 con 0x55bb6970ac80 2024-09-13T16:02:45.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.223+0000 7f40a4c14740 10 client.0 _ll_register_callbacks cb 0x55bb6965da70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:02:45.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.224+0000 7f409b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb69710650 0x55bb6971bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43062/0 (socket says 172.21.15.17:43062) 2024-09-13T16:02:45.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.224+0000 7f409b400640 1 -- 172.21.15.17:0/119669077 learned_addr learned my addr 172.21.15.17:0/119669077 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:45.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.225+0000 7f409b400640 1 -- 172.21.15.17:0/119669077 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6970ac80 msgr2=0x55bb69714a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:45.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.225+0000 7f409b400640 1 --2- 172.21.15.17:0/119669077 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6970ac80 0x55bb69714a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.225+0000 7f409b400640 1 -- 172.21.15.17:0/119669077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6970b5c0 msgr2=0x55bb69714f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:45.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.225+0000 7f409b400640 1 --2- 172.21.15.17:0/119669077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6970b5c0 0x55bb69714f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.225+0000 7f409b400640 1 -- 172.21.15.17:0/119669077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4094009c30 con 0x55bb69710650 2024-09-13T16:02:45.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.225+0000 7f409aa00640 1 --2- 172.21.15.17:0/119669077 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6970ac80 0x55bb69714a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.225+0000 7f409b400640 1 --2- 172.21.15.17:0/119669077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb69710650 0x55bb6971bf40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f409401cdf0 tx=0x7f4094017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aeabdd5e6ffbf1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.225+0000 7f4085600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T16:02:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.226+0000 7f4085600640 1 -- 172.21.15.17:0/119669077 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409402d070 con 0x55bb69710650 2024-09-13T16:02:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.226+0000 7f4085600640 1 -- 172.21.15.17:0/119669077 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f4094017070 con 0x55bb69710650 2024-09-13T16:02:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.226+0000 7f40a4c14740 1 -- 172.21.15.17:0/119669077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bb69697c90 con 0x55bb69710650 2024-09-13T16:02:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.227+0000 7f4085600640 1 -- 172.21.15.17:0/119669077 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f409401cb40 con 0x55bb69710650 2024-09-13T16:02:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.227+0000 7f40a4c14740 10 client.15603 fetch_fsmap learned FSMap version 31 2024-09-13T16:02:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.227+0000 7f40a4c14740 1 -- 172.21.15.17:0/119669077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55bb6966c170 con 0x55bb69710650 2024-09-13T16:02:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.230+0000 7f4085600640 1 -- 172.21.15.17:0/119669077 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bb69697c90 con 0x55bb69710650 2024-09-13T16:02:45.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.231+0000 7f4085600640 1 -- 172.21.15.17:0/119669077 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f4094024030 con 0x55bb69710650 2024-09-13T16:02:45.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.232+0000 7f40a4c14740 10 client.15603 fetch_fsmap finished waiting for FSMap version 31 2024-09-13T16:02:45.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.232+0000 7f40a4c14740 10 client.15603 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:02:45.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.232+0000 7f40a4c14740 20 client.15603 populate_metadata read hostname 'smithi017' 2024-09-13T16:02:45.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.232+0000 7f40a4c14740 1 --2- 172.21.15.17:0/119669077 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55bb69720670 0x55bb69722a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:45.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.232+0000 7f40a4c14740 4 client.15603 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:02:45.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.232+0000 7f40a4c14740 1 -- 172.21.15.17:0/119669077 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bb696607d0 con 0x55bb69720670 2024-09-13T16:02:45.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.233+0000 7f409aa00640 1 --2- 172.21.15.17:0/119669077 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55bb69720670 0x55bb69722a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:45.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.234+0000 7f409aa00640 1 --2- 172.21.15.17:0/119669077 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55bb69720670 0x55bb69722a90 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f765a6fd87d9cdae server_cookie=8b5f2ea0fe62380b in_seq=0 out_seq=0 2024-09-13T16:02:45.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.235+0000 7f4085600640 10 client.15603 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:02:45.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.235+0000 7f4085600640 1 -- 172.21.15.17:0/119669077 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bb696607d0 con 0x55bb69720670 2024-09-13T16:02:45.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.235+0000 7f4085600640 10 client.15603 handle_command_reply: tid=0 2024-09-13T16:02:45.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.236+0000 7f40a4c14740 1 client.15603 shutdown 2024-09-13T16:02:45.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.236+0000 7f40a4c14740 1 -- 172.21.15.17:0/119669077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb69710650 msgr2=0x55bb6971bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:45.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.236+0000 7f40a4c14740 1 --2- 172.21.15.17:0/119669077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb69710650 0x55bb6971bf40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f409401cdf0 tx=0x7f4094017000 comp rx=0 tx=0).stop 2024-09-13T16:02:45.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.237+0000 7f40a4c14740 1 -- 172.21.15.17:0/119669077 shutdown_connections 2024-09-13T16:02:45.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.238+0000 7f40a4c14740 1 --2- 172.21.15.17:0/119669077 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55bb69720670 0x55bb69722a90 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.238+0000 7f40a4c14740 1 --2- 172.21.15.17:0/119669077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb69710650 0x55bb6971bf40 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.238+0000 7f40a4c14740 1 --2- 172.21.15.17:0/119669077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6970b5c0 0x55bb69714f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.238+0000 7f40a4c14740 1 --2- 172.21.15.17:0/119669077 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6970ac80 0x55bb69714a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.238+0000 7f40a4c14740 1 -- 172.21.15.17:0/119669077 >> 172.21.15.17:0/119669077 conn(0x55bb697062f0 msgr2=0x55bb69707b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:45.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.238+0000 7f4085600640 0 client.15603 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:02:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.238+0000 7f40a4c14740 1 -- 172.21.15.17:0/119669077 shutdown_connections 2024-09-13T16:02:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.238+0000 7f40a4c14740 1 -- 172.21.15.17:0/119669077 wait complete. 2024-09-13T16:02:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.239+0000 7f40a4c14740 20 client.15603 trim_cache size 0 max 16384 2024-09-13T16:02:45.253 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:44 smithi193 ceph-mon[35248]: pgmap v535: 129 pgs: 129 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 595 op/s 2024-09-13T16:02:45.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:44 smithi017 ceph-mon[30494]: pgmap v535: 129 pgs: 129 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 595 op/s 2024-09-13T16:02:45.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.269+0000 7f40a4c14740 1 Processor -- start 2024-09-13T16:02:45.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.269+0000 7f40a4c14740 1 -- start start 2024-09-13T16:02:45.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.270+0000 7f40a4c14740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6970ac80 0x55bb6970c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:45.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.270+0000 7f40a4c14740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6970b5c0 0x55bb6971bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:45.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.270+0000 7f40a4c14740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb69710650 0x55bb6970cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:45.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.270+0000 7f40a4c14740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb693d4e60 con 0x55bb6970ac80 2024-09-13T16:02:45.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.270+0000 7f40a4c14740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb69715be0 con 0x55bb69710650 2024-09-13T16:02:45.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.270+0000 7f40a4c14740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb69706ef0 con 0x55bb6970b5c0 2024-09-13T16:02:45.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.270+0000 7f409b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb69710650 0x55bb6970cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:45.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.270+0000 7f409b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb69710650 0x55bb6970cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:58890/0 (socket says 172.21.15.17:58890) 2024-09-13T16:02:45.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.270+0000 7f409a000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6970b5c0 0x55bb6971bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:45.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.270+0000 7f409b400640 1 -- 172.21.15.17:0/2039541043 learned_addr learned my addr 172.21.15.17:0/2039541043 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:45.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.270+0000 7f409aa00640 1 --2- 172.21.15.17:0/2039541043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6970ac80 0x55bb6970c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:45.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.270+0000 7f409b400640 1 -- 172.21.15.17:0/2039541043 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6970b5c0 msgr2=0x55bb6971bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:45.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.271+0000 7f409b400640 1 --2- 172.21.15.17:0/2039541043 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6970b5c0 0x55bb6971bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.271+0000 7f409b400640 1 -- 172.21.15.17:0/2039541043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6970ac80 msgr2=0x55bb6970c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:45.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.271+0000 7f409b400640 1 --2- 172.21.15.17:0/2039541043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6970ac80 0x55bb6970c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.271+0000 7f409b400640 1 -- 172.21.15.17:0/2039541043 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb6960e180 con 0x55bb69710650 2024-09-13T16:02:45.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.271+0000 7f409aa00640 1 --2- 172.21.15.17:0/2039541043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6970ac80 0x55bb6970c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:02:45.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.271+0000 7f409a000640 1 --2- 172.21.15.17:0/2039541043 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6970b5c0 0x55bb6971bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:45.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.271+0000 7f409b400640 1 --2- 172.21.15.17:0/2039541043 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb69710650 0x55bb6970cb60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f409400e630 tx=0x7f4094005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bf8c31ae1c09bbe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:45.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.271+0000 7f4091600640 1 -- 172.21.15.17:0/2039541043 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409402d040 con 0x55bb69710650 2024-09-13T16:02:45.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.271+0000 7f4091600640 1 -- 172.21.15.17:0/2039541043 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f409400e8a0 con 0x55bb69710650 2024-09-13T16:02:45.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.271+0000 7f4091600640 1 -- 172.21.15.17:0/2039541043 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4094011bc0 con 0x55bb69710650 2024-09-13T16:02:45.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.272+0000 7f40a4c14740 1 -- 172.21.15.17:0/2039541043 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb69710650 msgr2=0x55bb6970cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:45.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.272+0000 7f40a4c14740 1 --2- 172.21.15.17:0/2039541043 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb69710650 0x55bb6970cb60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f409400e630 tx=0x7f4094005fd0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.272+0000 7f40a4c14740 1 -- 172.21.15.17:0/2039541043 shutdown_connections 2024-09-13T16:02:45.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.272+0000 7f40a4c14740 1 --2- 172.21.15.17:0/2039541043 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb69710650 0x55bb6970cb60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.272+0000 7f40a4c14740 1 --2- 172.21.15.17:0/2039541043 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6970b5c0 0x55bb6971bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.272+0000 7f40a4c14740 1 --2- 172.21.15.17:0/2039541043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6970ac80 0x55bb6970c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.272+0000 7f40a4c14740 1 -- 172.21.15.17:0/2039541043 >> 172.21.15.17:0/2039541043 conn(0x55bb697062f0 msgr2=0x55bb697273f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.272+0000 7f40a4c14740 1 -- 172.21.15.17:0/2039541043 shutdown_connections 2024-09-13T16:02:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.272+0000 7f40a4c14740 1 -- 172.21.15.17:0/2039541043 wait complete. 2024-09-13T16:02:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.273+0000 7f40a4c14740 1 -- start start 2024-09-13T16:02:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.273+0000 7f40a4c14740 1 Processor -- start 2024-09-13T16:02:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.274+0000 7f40a4c14740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6970ac80 0x55bb6971ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.274+0000 7f40a4c14740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6970b5c0 0x55bb6971a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.274+0000 7f40a4c14740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb69710650 0x55bb6971a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.274+0000 7f40a4c14740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6971c270 con 0x55bb6970b5c0 2024-09-13T16:02:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.274+0000 7f40a4c14740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6971aae0 con 0x55bb6970ac80 2024-09-13T16:02:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.274+0000 7f40a4c14740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6971aca0 con 0x55bb69710650 2024-09-13T16:02:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.274+0000 7f40a4c14740 10 client.0 _ll_register_callbacks cb 0x7f4094009a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:02:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.274+0000 7f409aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6970ac80 0x55bb6971ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:45.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.274+0000 7f409b400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb69710650 0x55bb6971a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:45.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.274+0000 7f409aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6970ac80 0x55bb6971ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:58898/0 (socket says 172.21.15.17:58898) 2024-09-13T16:02:45.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.274+0000 7f409aa00640 1 -- 172.21.15.17:0/3038256596 learned_addr learned my addr 172.21.15.17:0/3038256596 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:45.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.274+0000 7f409a000640 1 --2- 172.21.15.17:0/3038256596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6970b5c0 0x55bb6971a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:45.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.274+0000 7f409aa00640 1 -- 172.21.15.17:0/3038256596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb69710650 msgr2=0x55bb6971a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:45.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.275+0000 7f409aa00640 1 --2- 172.21.15.17:0/3038256596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb69710650 0x55bb6971a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.275+0000 7f409aa00640 1 -- 172.21.15.17:0/3038256596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6970b5c0 msgr2=0x55bb6971a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:45.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.275+0000 7f409aa00640 1 --2- 172.21.15.17:0/3038256596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6970b5c0 0x55bb6971a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.275+0000 7f409aa00640 1 -- 172.21.15.17:0/3038256596 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bb6966c170 con 0x55bb6970ac80 2024-09-13T16:02:45.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.275+0000 7f409aa00640 1 --2- 172.21.15.17:0/3038256596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6970ac80 0x55bb6971ba50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f408c0eadb0 tx=0x7f408c0b6040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4be0847dd2b41ada server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:45.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.275+0000 7f4085600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:02:45.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.275+0000 7f4085600640 1 -- 172.21.15.17:0/3038256596 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c0baa90 con 0x55bb6970ac80 2024-09-13T16:02:45.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.275+0000 7f4085600640 1 -- 172.21.15.17:0/3038256596 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f408c0ed0b0 con 0x55bb6970ac80 2024-09-13T16:02:45.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.275+0000 7f40a4c14740 1 -- 172.21.15.17:0/3038256596 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4094015070 con 0x55bb6970ac80 2024-09-13T16:02:45.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.276+0000 7f4085600640 1 -- 172.21.15.17:0/3038256596 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f408c0ba390 con 0x55bb6970ac80 2024-09-13T16:02:45.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.276+0000 7f40a4c14740 10 client.25757 fetch_fsmap learned FSMap version 31 2024-09-13T16:02:45.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.276+0000 7f40a4c14740 1 -- 172.21.15.17:0/3038256596 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55bb69633560 con 0x55bb6970ac80 2024-09-13T16:02:45.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.276+0000 7f4085600640 1 -- 172.21.15.17:0/3038256596 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4094015070 con 0x55bb6970ac80 2024-09-13T16:02:45.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.276+0000 7f4085600640 1 -- 172.21.15.17:0/3038256596 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f408c0a3c70 con 0x55bb6970ac80 2024-09-13T16:02:45.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.277+0000 7f40a4c14740 10 client.25757 fetch_fsmap finished waiting for FSMap version 31 2024-09-13T16:02:45.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.277+0000 7f40a4c14740 10 client.25757 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:02:45.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.277+0000 7f40a4c14740 20 client.25757 populate_metadata read hostname 'smithi017' 2024-09-13T16:02:45.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.277+0000 7f40a4c14740 1 --2- 172.21.15.17:0/3038256596 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55bb69777ed0 0x55bb6977a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:45.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.277+0000 7f40a4c14740 4 client.25757 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:02:45.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.277+0000 7f40a4c14740 1 -- 172.21.15.17:0/3038256596 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bb69361300 con 0x55bb69777ed0 2024-09-13T16:02:45.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.277+0000 7f409a000640 1 --2- 172.21.15.17:0/3038256596 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55bb69777ed0 0x55bb6977a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:45.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.278+0000 7f409a000640 1 --2- 172.21.15.17:0/3038256596 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55bb69777ed0 0x55bb6977a2f0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e882b47a182659e6 server_cookie=87ebf0b106607d21 in_seq=0 out_seq=0 2024-09-13T16:02:45.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.278+0000 7f4085600640 10 client.25757 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:02:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.288+0000 7f4085600640 1 -- 172.21.15.17:0/3038256596 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bb69361300 con 0x55bb69777ed0 2024-09-13T16:02:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.288+0000 7f4085600640 10 client.25757 handle_command_reply: tid=0 2024-09-13T16:02:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.288+0000 7f40a4c14740 1 client.25757 shutdown 2024-09-13T16:02:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.288+0000 7f40a4c14740 1 -- 172.21.15.17:0/3038256596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6970ac80 msgr2=0x55bb6971ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:45.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.288+0000 7f40a4c14740 1 --2- 172.21.15.17:0/3038256596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6970ac80 0x55bb6971ba50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f408c0eadb0 tx=0x7f408c0b6040 comp rx=0 tx=0).stop 2024-09-13T16:02:45.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.289+0000 7f40a4c14740 1 -- 172.21.15.17:0/3038256596 shutdown_connections 2024-09-13T16:02:45.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.289+0000 7f40a4c14740 1 --2- 172.21.15.17:0/3038256596 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55bb69777ed0 0x55bb6977a2f0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.289+0000 7f40a4c14740 1 --2- 172.21.15.17:0/3038256596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb69710650 0x55bb6971a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.289+0000 7f40a4c14740 1 --2- 172.21.15.17:0/3038256596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6970b5c0 0x55bb6971a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.289+0000 7f40a4c14740 1 --2- 172.21.15.17:0/3038256596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6970ac80 0x55bb6971ba50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.289+0000 7f40a4c14740 1 -- 172.21.15.17:0/3038256596 >> 172.21.15.17:0/3038256596 conn(0x55bb697062f0 msgr2=0x55bb6970c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:45.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.289+0000 7f4085600640 0 client.25757 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:02:45.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.289+0000 7f40a4c14740 1 -- 172.21.15.17:0/3038256596 shutdown_connections 2024-09-13T16:02:45.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.289+0000 7f40a4c14740 1 -- 172.21.15.17:0/3038256596 wait complete. 2024-09-13T16:02:45.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.290+0000 7f40a4c14740 20 client.25757 trim_cache size 0 max 16384 2024-09-13T16:02:45.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:02:45.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:02:45.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:02:45.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:02:45.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.292+0000 7f409be00640 1 -- 172.21.15.17:0/2604683622 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f40800a11b0 msgr2=0x7f40800a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:45.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.292+0000 7f409be00640 1 --2- 172.21.15.17:0/2604683622 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f40800a11b0 0x7f40800a3670 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f409401f000 tx=0x7f409401b970 comp rx=0 tx=0).stop 2024-09-13T16:02:45.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.292+0000 7f409be00640 1 -- 172.21.15.17:0/2604683622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f409c101d70 msgr2=0x7f409c19c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:45.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.292+0000 7f409be00640 1 --2- 172.21.15.17:0/2604683622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f409c101d70 0x7f409c19c150 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f408c031500 tx=0x7f408c003c10 comp rx=0 tx=0).stop 2024-09-13T16:02:45.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.293+0000 7f409be00640 1 -- 172.21.15.17:0/2604683622 shutdown_connections 2024-09-13T16:02:45.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.293+0000 7f409be00640 1 --2- 172.21.15.17:0/2604683622 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f40800a11b0 0x7f40800a3670 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.293+0000 7f409be00640 1 --2- 172.21.15.17:0/2604683622 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f409c103920 0x7f409c1a3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.293+0000 7f409be00640 1 --2- 172.21.15.17:0/2604683622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f409c102f60 0x7f409c19c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.293+0000 7f409be00640 1 --2- 172.21.15.17:0/2604683622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f409c101d70 0x7f409c19c150 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:45.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.293+0000 7f409be00640 1 -- 172.21.15.17:0/2604683622 >> 172.21.15.17:0/2604683622 conn(0x7f409c0fd4d0 msgr2=0x7f409c078270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:45.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.293+0000 7f409be00640 1 -- 172.21.15.17:0/2604683622 shutdown_connections 2024-09-13T16:02:45.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:45.294+0000 7f409be00640 1 -- 172.21.15.17:0/2604683622 wait complete. 2024-09-13T16:02:45.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 300.0 s, 541.6 tps, lat 185.016 ms stddev 206.457 2024-09-13T16:02:46.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:46 smithi193 ceph-mon[35248]: pgmap v536: 129 pgs: 129 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 626 op/s 2024-09-13T16:02:46.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:46 smithi017 ceph-mon[30494]: pgmap v536: 129 pgs: 129 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 626 op/s 2024-09-13T16:02:46.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:46 smithi189 ceph-mon[34790]: pgmap v536: 129 pgs: 129 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 626 op/s 2024-09-13T16:02:48.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:48 smithi193 ceph-mon[35248]: pgmap v537: 129 pgs: 129 active+clean; 1.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 554 op/s 2024-09-13T16:02:48.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:48 smithi017 ceph-mon[30494]: pgmap v537: 129 pgs: 129 active+clean; 1.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 554 op/s 2024-09-13T16:02:48.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:48 smithi189 ceph-mon[34790]: pgmap v537: 129 pgs: 129 active+clean; 1.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 554 op/s 2024-09-13T16:02:50.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 305.0 s, 778.4 tps, lat 127.598 ms stddev 150.656 2024-09-13T16:02:50.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:50 smithi193 ceph-mon[35248]: pgmap v538: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 666 op/s 2024-09-13T16:02:50.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:50 smithi017 ceph-mon[30494]: pgmap v538: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 666 op/s 2024-09-13T16:02:50.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:50 smithi189 ceph-mon[34790]: pgmap v538: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 666 op/s 2024-09-13T16:02:52.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:52 smithi189 ceph-mon[34790]: pgmap v539: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 630 op/s 2024-09-13T16:02:53.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:52 smithi193 ceph-mon[35248]: pgmap v539: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 630 op/s 2024-09-13T16:02:53.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:52 smithi017 ceph-mon[30494]: pgmap v539: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 630 op/s 2024-09-13T16:02:54.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:54 smithi193 ceph-mon[35248]: pgmap v540: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 16 MiB/s wr, 609 op/s 2024-09-13T16:02:54.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:54 smithi017 ceph-mon[30494]: pgmap v540: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 16 MiB/s wr, 609 op/s 2024-09-13T16:02:54.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:54 smithi189 ceph-mon[34790]: pgmap v540: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 16 MiB/s wr, 609 op/s 2024-09-13T16:02:55.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 310.0 s, 563.0 tps, lat 179.478 ms stddev 239.308 2024-09-13T16:02:56.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:56 smithi193 ceph-mon[35248]: pgmap v541: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 622 op/s 2024-09-13T16:02:56.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:56 smithi017 ceph-mon[30494]: pgmap v541: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 622 op/s 2024-09-13T16:02:56.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:56 smithi189 ceph-mon[34790]: pgmap v541: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 622 op/s 2024-09-13T16:02:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.504+0000 7f76ca600640 1 -- 172.21.15.17:0/3383090729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76c4076a50 msgr2=0x7f76c40772f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.504+0000 7f76ca600640 1 --2- 172.21.15.17:0/3383090729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76c4076a50 0x7f76c40772f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f76bc009ca0 tx=0x7f76bc02a8e0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.504+0000 7f76ca600640 1 -- 172.21.15.17:0/3383090729 shutdown_connections 2024-09-13T16:02:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.504+0000 7f76ca600640 1 --2- 172.21.15.17:0/3383090729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76c4076a50 0x7f76c40772f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.504+0000 7f76ca600640 1 --2- 172.21.15.17:0/3383090729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76c40760b0 0x7f76c4076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.504+0000 7f76ca600640 1 --2- 172.21.15.17:0/3383090729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76c4074e70 0x7f76c4075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.504+0000 7f76ca600640 1 -- 172.21.15.17:0/3383090729 >> 172.21.15.17:0/3383090729 conn(0x7f76c40fd6b0 msgr2=0x7f76c40ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:58.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.506+0000 7f76ca600640 1 -- 172.21.15.17:0/3383090729 shutdown_connections 2024-09-13T16:02:58.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.506+0000 7f76ca600640 1 -- 172.21.15.17:0/3383090729 wait complete. 2024-09-13T16:02:58.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.507+0000 7f76ca600640 1 Processor -- start 2024-09-13T16:02:58.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.508+0000 7f76ca600640 1 -- start start 2024-09-13T16:02:58.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.508+0000 7f76ca600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76c4074e70 0x7f76c419c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:58.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.509+0000 7f76ca600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76c40760b0 0x7f76c419c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:58.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.509+0000 7f76ca600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76c4076a50 0x7f76c41a3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:58.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.509+0000 7f76c3400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76c4074e70 0x7f76c419c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:58.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.509+0000 7f76c3400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76c4074e70 0x7f76c419c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:43532/0 (socket says 172.21.15.17:43532) 2024-09-13T16:02:58.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.509+0000 7f76c3400640 1 -- 172.21.15.17:0/4272238975 learned_addr learned my addr 172.21.15.17:0/4272238975 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:58.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.509+0000 7f76ca600640 1 -- 172.21.15.17:0/4272238975 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c41a3eb0 con 0x7f76c4076a50 2024-09-13T16:02:58.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.509+0000 7f76ca600640 1 -- 172.21.15.17:0/4272238975 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c41a4020 con 0x7f76c40760b0 2024-09-13T16:02:58.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.509+0000 7f76ca600640 1 -- 172.21.15.17:0/4272238975 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c41a41e0 con 0x7f76c4074e70 2024-09-13T16:02:58.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.510+0000 7f76baa00640 1 --2- 172.21.15.17:0/4272238975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76c40760b0 0x7f76c419c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:58.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.510+0000 7f76c3e00640 1 --2- 172.21.15.17:0/4272238975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76c4076a50 0x7f76c41a3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.511+0000 7f76c3400640 1 -- 172.21.15.17:0/4272238975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76c40760b0 msgr2=0x7f76c419c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.511+0000 7f76c3400640 1 --2- 172.21.15.17:0/4272238975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76c40760b0 0x7f76c419c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.511+0000 7f76c3400640 1 -- 172.21.15.17:0/4272238975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76c4076a50 msgr2=0x7f76c41a3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.511+0000 7f76c3400640 1 --2- 172.21.15.17:0/4272238975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76c4076a50 0x7f76c41a3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.511+0000 7f76c3400640 1 -- 172.21.15.17:0/4272238975 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76bc009900 con 0x7f76c4074e70 2024-09-13T16:02:58.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.512+0000 7f76c3400640 1 --2- 172.21.15.17:0/4272238975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76c4074e70 0x7f76c419c3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f76b400b4a0 tx=0x7f76b400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.515+0000 7f76c0c00640 1 -- 172.21.15.17:0/4272238975 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4010610 con 0x7f76c4074e70 2024-09-13T16:02:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.515+0000 7f76c0c00640 1 -- 172.21.15.17:0/4272238975 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76b4010c30 con 0x7f76c4074e70 2024-09-13T16:02:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.515+0000 7f76ca600640 1 -- 172.21.15.17:0/4272238975 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c41a44c0 con 0x7f76c4074e70 2024-09-13T16:02:58.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.515+0000 7f76ca600640 1 -- 172.21.15.17:0/4272238975 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c41a4aa0 con 0x7f76c4074e70 2024-09-13T16:02:58.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.515+0000 7f76c0c00640 1 -- 172.21.15.17:0/4272238975 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4017d40 con 0x7f76c4074e70 2024-09-13T16:02:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.521+0000 7f76c0c00640 1 -- 172.21.15.17:0/4272238975 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f76b4017360 con 0x7f76c4074e70 2024-09-13T16:02:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.523+0000 7f76cd42a740 1 Processor -- start 2024-09-13T16:02:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.526+0000 7f76cd42a740 1 -- start start 2024-09-13T16:02:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.526+0000 7f76cd42a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50aa70 0x560f9f50ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.527+0000 7f76c0c00640 1 --2- 172.21.15.17:0/4272238975 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f76a80a1190 0x7f76a80a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:58.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.527+0000 7f76c0c00640 1 -- 172.21.15.17:0/4272238975 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f76b40cc2a0 con 0x7f76c4074e70 2024-09-13T16:02:58.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.528+0000 7f76cd42a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f9f50b3b0 0x560f9f50fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:58.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.528+0000 7f76cd42a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f9f510440 0x560f9f512900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:58.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.528+0000 7f76cd42a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f9f416bb0 con 0x560f9f510440 2024-09-13T16:02:58.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.528+0000 7f76cd42a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f9f474a70 con 0x560f9f50aa70 2024-09-13T16:02:58.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.528+0000 7f76cd42a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f9f472200 con 0x560f9f50b3b0 2024-09-13T16:02:58.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.529+0000 7f76c3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50aa70 0x560f9f50ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:58.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.529+0000 7f76c3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50aa70 0x560f9f50ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:41300/0 (socket says 172.21.15.17:41300) 2024-09-13T16:02:58.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.529+0000 7f76c3e00640 1 -- 172.21.15.17:0/1337885682 learned_addr learned my addr 172.21.15.17:0/1337885682 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:58.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.529+0000 7f76c3e00640 1 --2- 172.21.15.17:0/1337885682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f9f510440 0x560f9f512900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:58.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.530+0000 7f76c3400640 1 --2- 172.21.15.17:0/4272238975 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f76a80a1190 0x7f76a80a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:58.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.530+0000 7f76baa00640 1 --2- 172.21.15.17:0/1337885682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f9f50b3b0 0x560f9f50fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:58.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.532+0000 7f76c3e00640 1 -- 172.21.15.17:0/1337885682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f9f50b3b0 msgr2=0x560f9f50fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:58.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.532+0000 7f76c3400640 1 --2- 172.21.15.17:0/4272238975 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f76a80a1190 0x7f76a80a3650 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f76b4095840 tx=0x7f76b40046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:58.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.532+0000 7f76c3e00640 1 --2- 172.21.15.17:0/1337885682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f9f50b3b0 0x560f9f50fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.532+0000 7f76c3e00640 1 -- 172.21.15.17:0/1337885682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50aa70 msgr2=0x560f9f50ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:58.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.532+0000 7f76c3e00640 1 --2- 172.21.15.17:0/1337885682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50aa70 0x560f9f50ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.532+0000 7f76c3e00640 1 -- 172.21.15.17:0/1337885682 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f9f40f940 con 0x560f9f510440 2024-09-13T16:02:58.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.533+0000 7f76c3e00640 1 --2- 172.21.15.17:0/1337885682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f9f510440 0x560f9f512900 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0098d0 tx=0x7f76bc02a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaec98ae7a89310d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:58.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.534+0000 7f76b8c00640 1 -- 172.21.15.17:0/1337885682 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc0317c0 con 0x560f9f510440 2024-09-13T16:02:58.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.534+0000 7f76b8c00640 1 -- 172.21.15.17:0/1337885682 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76bc030aa0 con 0x560f9f510440 2024-09-13T16:02:58.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.534+0000 7f76b8c00640 1 -- 172.21.15.17:0/1337885682 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc02fc60 con 0x560f9f510440 2024-09-13T16:02:58.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.536+0000 7f76cd42a740 1 -- 172.21.15.17:0/1337885682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f9f510440 msgr2=0x560f9f512900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:58.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.536+0000 7f76cd42a740 1 --2- 172.21.15.17:0/1337885682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f9f510440 0x560f9f512900 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0098d0 tx=0x7f76bc02a8e0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.537+0000 7f76cd42a740 1 -- 172.21.15.17:0/1337885682 shutdown_connections 2024-09-13T16:02:58.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.537+0000 7f76cd42a740 1 --2- 172.21.15.17:0/1337885682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f9f510440 0x560f9f512900 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.537+0000 7f76cd42a740 1 --2- 172.21.15.17:0/1337885682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f9f50b3b0 0x560f9f50fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.537+0000 7f76cd42a740 1 --2- 172.21.15.17:0/1337885682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50aa70 0x560f9f50ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.537+0000 7f76cd42a740 1 -- 172.21.15.17:0/1337885682 >> 172.21.15.17:0/1337885682 conn(0x560f9f5060e0 msgr2=0x560f9f5064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:58.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.538+0000 7f76cd42a740 1 -- 172.21.15.17:0/1337885682 shutdown_connections 2024-09-13T16:02:58.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.538+0000 7f76cd42a740 1 -- 172.21.15.17:0/1337885682 wait complete. 2024-09-13T16:02:58.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.539+0000 7f76cd42a740 1 -- start start 2024-09-13T16:02:58.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.539+0000 7f76cd42a740 1 Processor -- start 2024-09-13T16:02:58.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.544+0000 7f76cd42a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50aa70 0x560f9f5147c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:58.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.544+0000 7f76cd42a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f9f50b3b0 0x560f9f514d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:58.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.544+0000 7f76cd42a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f9f510440 0x560f9f51bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:58.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.545+0000 7f76c3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50aa70 0x560f9f5147c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:58.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.545+0000 7f76c3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50aa70 0x560f9f5147c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:41306/0 (socket says 172.21.15.17:41306) 2024-09-13T16:02:58.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.545+0000 7f76c3e00640 1 -- 172.21.15.17:0/2687959207 learned_addr learned my addr 172.21.15.17:0/2687959207 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:58.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.545+0000 7f76cd42a740 1 -- 172.21.15.17:0/2687959207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f9f46daf0 con 0x560f9f510440 2024-09-13T16:02:58.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.545+0000 7f76cd42a740 1 -- 172.21.15.17:0/2687959207 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f9f42bf20 con 0x560f9f50aa70 2024-09-13T16:02:58.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.545+0000 7f76cd42a740 1 -- 172.21.15.17:0/2687959207 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f9f42bbc0 con 0x560f9f50b3b0 2024-09-13T16:02:58.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.545+0000 7f76cd42a740 10 client.0 _ll_register_callbacks cb 0x560f9f45da70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:02:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.546+0000 7f76c3e00640 1 -- 172.21.15.17:0/2687959207 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f9f50b3b0 msgr2=0x560f9f514d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.546+0000 7f76c3e00640 1 --2- 172.21.15.17:0/2687959207 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f9f50b3b0 0x560f9f514d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.546+0000 7f76c3e00640 1 -- 172.21.15.17:0/2687959207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f9f510440 msgr2=0x560f9f51bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.546+0000 7f76c3e00640 1 --2- 172.21.15.17:0/2687959207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f9f510440 0x560f9f51bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.546+0000 7f76c3e00640 1 -- 172.21.15.17:0/2687959207 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76bc044040 con 0x560f9f50aa70 2024-09-13T16:02:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.547+0000 7f76c3e00640 1 --2- 172.21.15.17:0/2687959207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50aa70 0x560f9f5147c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f76bc02f440 tx=0x7f76bc02afe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d89d2acb8a57f001 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:58.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.547+0000 7f76b1600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:02:58.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.547+0000 7f76b1600640 1 -- 172.21.15.17:0/2687959207 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc02f9e0 con 0x560f9f50aa70 2024-09-13T16:02:58.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.547+0000 7f76b1600640 1 -- 172.21.15.17:0/2687959207 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f76bc03f040 con 0x560f9f50aa70 2024-09-13T16:02:58.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.547+0000 7f76cd42a740 1 -- 172.21.15.17:0/2687959207 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560f9f497c90 con 0x560f9f50aa70 2024-09-13T16:02:58.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.548+0000 7f76b1600640 1 -- 172.21.15.17:0/2687959207 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76bc02fb40 con 0x560f9f50aa70 2024-09-13T16:02:58.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.548+0000 7f76cd42a740 10 client.25769 fetch_fsmap learned FSMap version 32 2024-09-13T16:02:58.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.548+0000 7f76cd42a740 1 -- 172.21.15.17:0/2687959207 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x560f9f46c170 con 0x560f9f50aa70 2024-09-13T16:02:58.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.548+0000 7f76b1600640 1 -- 172.21.15.17:0/2687959207 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560f9f497c90 con 0x560f9f50aa70 2024-09-13T16:02:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.548+0000 7f76b1600640 1 -- 172.21.15.17:0/2687959207 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 32) v1 ==== 7490+0+0 (secure 0 0 0) 0x7f76bc048070 con 0x560f9f50aa70 2024-09-13T16:02:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.548+0000 7f76cd42a740 10 client.25769 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T16:02:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.548+0000 7f76cd42a740 10 client.25769 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:02:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.548+0000 7f76cd42a740 20 client.25769 populate_metadata read hostname 'smithi017' 2024-09-13T16:02:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.548+0000 7f76cd42a740 1 --2- 172.21.15.17:0/2687959207 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x560f9f5200d0 0x560f9f5224f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.549+0000 7f76cd42a740 4 client.25769 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:02:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.549+0000 7f76cd42a740 1 -- 172.21.15.17:0/2687959207 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560f9f4607d0 con 0x560f9f5200d0 2024-09-13T16:02:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.549+0000 7f76baa00640 1 --2- 172.21.15.17:0/2687959207 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x560f9f5200d0 0x560f9f5224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.550+0000 7f76baa00640 1 --2- 172.21.15.17:0/2687959207 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x560f9f5200d0 0x560f9f5224f0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0cea6adbb09a8ca server_cookie=fbd7e6314737b346 in_seq=0 out_seq=0 2024-09-13T16:02:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.550+0000 7f76b1600640 10 client.25769 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:02:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.551+0000 7f76b1600640 1 -- 172.21.15.17:0/2687959207 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560f9f4607d0 con 0x560f9f5200d0 2024-09-13T16:02:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.551+0000 7f76b1600640 10 client.25769 handle_command_reply: tid=0 2024-09-13T16:02:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.551+0000 7f76cd42a740 1 client.25769 shutdown 2024-09-13T16:02:58.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.553+0000 7f76cd42a740 1 -- 172.21.15.17:0/2687959207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50aa70 msgr2=0x560f9f5147c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:58.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.553+0000 7f76cd42a740 1 --2- 172.21.15.17:0/2687959207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50aa70 0x560f9f5147c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f76bc02f440 tx=0x7f76bc02afe0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.553+0000 7f76cd42a740 1 -- 172.21.15.17:0/2687959207 shutdown_connections 2024-09-13T16:02:58.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.553+0000 7f76cd42a740 1 --2- 172.21.15.17:0/2687959207 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x560f9f5200d0 0x560f9f5224f0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.553+0000 7f76cd42a740 1 --2- 172.21.15.17:0/2687959207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f9f510440 0x560f9f51bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.553+0000 7f76cd42a740 1 --2- 172.21.15.17:0/2687959207 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f9f50b3b0 0x560f9f514d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.553+0000 7f76cd42a740 1 --2- 172.21.15.17:0/2687959207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50aa70 0x560f9f5147c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.553+0000 7f76cd42a740 1 -- 172.21.15.17:0/2687959207 >> 172.21.15.17:0/2687959207 conn(0x560f9f5060e0 msgr2=0x560f9f5078f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:58.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.553+0000 7f76b1600640 0 client.25769 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:02:58.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.554+0000 7f76cd42a740 1 -- 172.21.15.17:0/2687959207 shutdown_connections 2024-09-13T16:02:58.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.554+0000 7f76cd42a740 1 -- 172.21.15.17:0/2687959207 wait complete. 2024-09-13T16:02:58.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.554+0000 7f76cd42a740 20 client.25769 trim_cache size 0 max 16384 2024-09-13T16:02:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.592+0000 7f76cd42a740 1 Processor -- start 2024-09-13T16:02:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.592+0000 7f76cd42a740 1 -- start start 2024-09-13T16:02:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.593+0000 7f76cd42a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f9f50aa70 0x560f9f526e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.593+0000 7f76cd42a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50b3b0 0x560f9f51bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.593+0000 7f76cd42a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f9f510440 0x560f9f50c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.593+0000 7f76cd42a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f9f1d4e60 con 0x560f9f510440 2024-09-13T16:02:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.593+0000 7f76cd42a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f9f507fa0 con 0x560f9f50b3b0 2024-09-13T16:02:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.593+0000 7f76cd42a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f9f514300 con 0x560f9f50aa70 2024-09-13T16:02:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.594+0000 7f76baa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50b3b0 0x560f9f51bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.594+0000 7f76baa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50b3b0 0x560f9f51bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:41322/0 (socket says 172.21.15.17:41322) 2024-09-13T16:02:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.594+0000 7f76c3e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f9f50aa70 0x560f9f526e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.594+0000 7f76baa00640 1 -- 172.21.15.17:0/303075168 learned_addr learned my addr 172.21.15.17:0/303075168 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.594+0000 7f76baa00640 1 -- 172.21.15.17:0/303075168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f9f50aa70 msgr2=0x560f9f526e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.594+0000 7f76baa00640 1 --2- 172.21.15.17:0/303075168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f9f50aa70 0x560f9f526e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.594+0000 7f76baa00640 1 -- 172.21.15.17:0/303075168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f9f510440 msgr2=0x560f9f50c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.594+0000 7f76baa00640 1 --2- 172.21.15.17:0/303075168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f9f510440 0x560f9f50c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.594+0000 7f76baa00640 1 -- 172.21.15.17:0/303075168 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f9f40e180 con 0x560f9f50b3b0 2024-09-13T16:02:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.595+0000 7f76baa00640 1 --2- 172.21.15.17:0/303075168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50b3b0 0x560f9f51bc60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x560f9f506f60 tx=0x7f76ac009820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bd7b7df2f7345ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.595+0000 7f76b9600640 1 -- 172.21.15.17:0/303075168 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac018040 con 0x560f9f50b3b0 2024-09-13T16:02:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.595+0000 7f76b9600640 1 -- 172.21.15.17:0/303075168 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76ac014e60 con 0x560f9f50b3b0 2024-09-13T16:02:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.595+0000 7f76b9600640 1 -- 172.21.15.17:0/303075168 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac01a510 con 0x560f9f50b3b0 2024-09-13T16:02:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.598+0000 7f76cd42a740 1 -- 172.21.15.17:0/303075168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50b3b0 msgr2=0x560f9f51bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.598+0000 7f76cd42a740 1 --2- 172.21.15.17:0/303075168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50b3b0 0x560f9f51bc60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x560f9f506f60 tx=0x7f76ac009820 comp rx=0 tx=0).stop 2024-09-13T16:02:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.598+0000 7f76cd42a740 1 -- 172.21.15.17:0/303075168 shutdown_connections 2024-09-13T16:02:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.598+0000 7f76cd42a740 1 --2- 172.21.15.17:0/303075168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f9f510440 0x560f9f50c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.598+0000 7f76cd42a740 1 --2- 172.21.15.17:0/303075168 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50b3b0 0x560f9f51bc60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.598+0000 7f76cd42a740 1 --2- 172.21.15.17:0/303075168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f9f50aa70 0x560f9f526e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.598+0000 7f76cd42a740 1 -- 172.21.15.17:0/303075168 >> 172.21.15.17:0/303075168 conn(0x560f9f5060e0 msgr2=0x560f9f5064c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.598+0000 7f76cd42a740 1 -- 172.21.15.17:0/303075168 shutdown_connections 2024-09-13T16:02:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.600+0000 7f76cd42a740 1 -- 172.21.15.17:0/303075168 wait complete. 2024-09-13T16:02:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.601+0000 7f76cd42a740 1 -- start start 2024-09-13T16:02:58.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.601+0000 7f76cd42a740 1 Processor -- start 2024-09-13T16:02:58.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.603+0000 7f76cd42a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50aa70 0x560f9f517d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:58.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.603+0000 7f76cd42a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f9f50b3b0 0x560f9f518270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:58.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.603+0000 7f76cd42a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f9f510440 0x560f9f51b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:58.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.603+0000 7f76cd42a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f9f51b7d0 con 0x560f9f50b3b0 2024-09-13T16:02:58.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.603+0000 7f76cd42a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f9f51b940 con 0x560f9f50aa70 2024-09-13T16:02:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.603+0000 7f76cd42a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f9f51bb00 con 0x560f9f510440 2024-09-13T16:02:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.603+0000 7f76cd42a740 10 client.0 _ll_register_callbacks cb 0x7f76bc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:02:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.604+0000 7f76c3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50aa70 0x560f9f517d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.604+0000 7f76c3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50aa70 0x560f9f517d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:41334/0 (socket says 172.21.15.17:41334) 2024-09-13T16:02:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.604+0000 7f76c3e00640 1 -- 172.21.15.17:0/880254849 learned_addr learned my addr 172.21.15.17:0/880254849 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:02:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.604+0000 7f76c3e00640 1 --2- 172.21.15.17:0/880254849 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f9f510440 0x560f9f51b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.604+0000 7f76c3e00640 1 -- 172.21.15.17:0/880254849 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f9f510440 msgr2=0x560f9f51b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:02:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.604+0000 7f76c3e00640 1 --2- 172.21.15.17:0/880254849 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f9f510440 0x560f9f51b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.604+0000 7f76c3e00640 1 -- 172.21.15.17:0/880254849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f9f50b3b0 msgr2=0x560f9f518270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:02:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.605+0000 7f76baa00640 1 --2- 172.21.15.17:0/880254849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f9f50b3b0 0x560f9f518270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.605+0000 7f76c3e00640 1 --2- 172.21.15.17:0/880254849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f9f50b3b0 0x560f9f518270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.605+0000 7f76c3e00640 1 -- 172.21.15.17:0/880254849 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ac0099b0 con 0x560f9f50aa70 2024-09-13T16:02:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.605+0000 7f76baa00640 1 --2- 172.21.15.17:0/880254849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f9f50b3b0 0x560f9f518270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:02:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.605+0000 7f76c3e00640 1 --2- 172.21.15.17:0/880254849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50aa70 0x560f9f517d30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f76bc009bf0 tx=0x7f76bc02a8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24fdb8fe87025e4f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:02:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.607+0000 7f76b1600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:02:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.607+0000 7f76b1600640 1 -- 172.21.15.17:0/880254849 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc0308f0 con 0x560f9f50aa70 2024-09-13T16:02:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.607+0000 7f76b1600640 1 -- 172.21.15.17:0/880254849 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f76bc03f040 con 0x560f9f50aa70 2024-09-13T16:02:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.607+0000 7f76cd42a740 1 -- 172.21.15.17:0/880254849 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f76bc030aa0 con 0x560f9f50aa70 2024-09-13T16:02:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.607+0000 7f76b1600640 1 -- 172.21.15.17:0/880254849 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76bc030c10 con 0x560f9f50aa70 2024-09-13T16:02:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.608+0000 7f76cd42a740 10 client.25775 fetch_fsmap learned FSMap version 32 2024-09-13T16:02:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.608+0000 7f76cd42a740 1 -- 172.21.15.17:0/880254849 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x560f9f433560 con 0x560f9f50aa70 2024-09-13T16:02:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.608+0000 7f76b1600640 1 -- 172.21.15.17:0/880254849 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76bc030aa0 con 0x560f9f50aa70 2024-09-13T16:02:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.608+0000 7f76b1600640 1 -- 172.21.15.17:0/880254849 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 32) v1 ==== 7490+0+0 (secure 0 0 0) 0x7f76bc069070 con 0x560f9f50aa70 2024-09-13T16:02:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.608+0000 7f76cd42a740 10 client.25775 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T16:02:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.608+0000 7f76cd42a740 10 client.25775 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:02:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.608+0000 7f76cd42a740 20 client.25775 populate_metadata read hostname 'smithi017' 2024-09-13T16:02:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.608+0000 7f76cd42a740 1 --2- 172.21.15.17:0/880254849 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x560f9f5773a0 0x560f9f579790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:02:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.608+0000 7f76cd42a740 4 client.25775 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:02:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.608+0000 7f76cd42a740 1 -- 172.21.15.17:0/880254849 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560f9f161300 con 0x560f9f5773a0 2024-09-13T16:02:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.609+0000 7f76baa00640 1 --2- 172.21.15.17:0/880254849 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x560f9f5773a0 0x560f9f579790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:02:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.610+0000 7f76baa00640 1 --2- 172.21.15.17:0/880254849 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x560f9f5773a0 0x560f9f579790 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbd733898b97a3d3 server_cookie=384b68085c092900 in_seq=0 out_seq=0 2024-09-13T16:02:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.610+0000 7f76b1600640 10 client.25775 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:02:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.641+0000 7f76b1600640 1 -- 172.21.15.17:0/880254849 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560f9f161300 con 0x560f9f5773a0 2024-09-13T16:02:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.641+0000 7f76b1600640 10 client.25775 handle_command_reply: tid=0 2024-09-13T16:02:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.641+0000 7f76cd42a740 1 client.25775 shutdown 2024-09-13T16:02:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.642+0000 7f76cd42a740 1 -- 172.21.15.17:0/880254849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50aa70 msgr2=0x560f9f517d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.642+0000 7f76cd42a740 1 --2- 172.21.15.17:0/880254849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50aa70 0x560f9f517d30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f76bc009bf0 tx=0x7f76bc02a8e0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.642+0000 7f76cd42a740 1 -- 172.21.15.17:0/880254849 shutdown_connections 2024-09-13T16:02:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.642+0000 7f76cd42a740 1 --2- 172.21.15.17:0/880254849 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x560f9f5773a0 0x560f9f579790 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.642+0000 7f76cd42a740 1 --2- 172.21.15.17:0/880254849 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f9f510440 0x560f9f51b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.642+0000 7f76cd42a740 1 --2- 172.21.15.17:0/880254849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f9f50b3b0 0x560f9f518270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.642+0000 7f76cd42a740 1 --2- 172.21.15.17:0/880254849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f9f50aa70 0x560f9f517d30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.642+0000 7f76cd42a740 1 -- 172.21.15.17:0/880254849 >> 172.21.15.17:0/880254849 conn(0x560f9f5060e0 msgr2=0x560f9f5064c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.642+0000 7f76b1600640 0 client.25775 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:02:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.643+0000 7f76cd42a740 1 -- 172.21.15.17:0/880254849 shutdown_connections 2024-09-13T16:02:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.643+0000 7f76cd42a740 1 -- 172.21.15.17:0/880254849 wait complete. 2024-09-13T16:02:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.644+0000 7f76cd42a740 20 client.25775 trim_cache size 0 max 16384 2024-09-13T16:02:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:02:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:02:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:02:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:02:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.644+0000 7f76ca600640 1 -- 172.21.15.17:0/4272238975 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f76a80a1190 msgr2=0x7f76a80a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.644+0000 7f76ca600640 1 --2- 172.21.15.17:0/4272238975 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f76a80a1190 0x7f76a80a3650 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f76b4095840 tx=0x7f76b40046c0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.645+0000 7f76ca600640 1 -- 172.21.15.17:0/4272238975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76c4074e70 msgr2=0x7f76c419c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:02:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.645+0000 7f76ca600640 1 --2- 172.21.15.17:0/4272238975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76c4074e70 0x7f76c419c3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f76b400b4a0 tx=0x7f76b400b960 comp rx=0 tx=0).stop 2024-09-13T16:02:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.645+0000 7f76ca600640 1 -- 172.21.15.17:0/4272238975 shutdown_connections 2024-09-13T16:02:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.645+0000 7f76ca600640 1 --2- 172.21.15.17:0/4272238975 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f76a80a1190 0x7f76a80a3650 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.645+0000 7f76ca600640 1 --2- 172.21.15.17:0/4272238975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76c4076a50 0x7f76c41a3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.645+0000 7f76ca600640 1 --2- 172.21.15.17:0/4272238975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76c40760b0 0x7f76c419c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.645+0000 7f76ca600640 1 --2- 172.21.15.17:0/4272238975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76c4074e70 0x7f76c419c3c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:02:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.645+0000 7f76ca600640 1 -- 172.21.15.17:0/4272238975 >> 172.21.15.17:0/4272238975 conn(0x7f76c40fd6b0 msgr2=0x7f76c40feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:02:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.645+0000 7f76ca600640 1 -- 172.21.15.17:0/4272238975 shutdown_connections 2024-09-13T16:02:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:02:58.645+0000 7f76ca600640 1 -- 172.21.15.17:0/4272238975 wait complete. 2024-09-13T16:02:58.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:58 smithi193 ceph-mon[35248]: pgmap v542: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 MiB/s wr, 567 op/s 2024-09-13T16:02:58.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:02:58 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:02:58.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:58 smithi017 ceph-mon[30494]: pgmap v542: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 MiB/s wr, 567 op/s 2024-09-13T16:02:58.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:02:58 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:02:58.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:58 smithi189 ceph-mon[34790]: pgmap v542: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 MiB/s wr, 567 op/s 2024-09-13T16:02:58.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:02:58 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:03:00.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 315.0 s, 822.2 tps, lat 121.155 ms stddev 151.198 2024-09-13T16:03:00.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:00 smithi193 ceph-mon[35248]: pgmap v543: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 650 op/s 2024-09-13T16:03:00.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:00 smithi017 ceph-mon[30494]: pgmap v543: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 650 op/s 2024-09-13T16:03:00.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:00 smithi189 ceph-mon[34790]: pgmap v543: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 650 op/s 2024-09-13T16:03:03.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:02 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:03:03.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:02 smithi193 ceph-mon[35248]: pgmap v544: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 14 MiB/s wr, 593 op/s 2024-09-13T16:03:03.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:02 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:03:03.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:02 smithi017 ceph-mon[30494]: pgmap v544: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 14 MiB/s wr, 593 op/s 2024-09-13T16:03:03.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:02 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:03:03.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:02 smithi189 ceph-mon[34790]: pgmap v544: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 14 MiB/s wr, 593 op/s 2024-09-13T16:03:05.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:04 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:03:05.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:04 smithi017 ceph-mon[30494]: pgmap v545: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 573 op/s 2024-09-13T16:03:05.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:04 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:03:05.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:04 smithi189 ceph-mon[34790]: pgmap v545: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 573 op/s 2024-09-13T16:03:05.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:04 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:03:05.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:04 smithi193 ceph-mon[35248]: pgmap v545: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 573 op/s 2024-09-13T16:03:05.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 320.0 s, 651.6 tps, lat 149.085 ms stddev 173.178 2024-09-13T16:03:06.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:06 smithi193 ceph-mon[35248]: pgmap v546: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 566 op/s 2024-09-13T16:03:06.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:06 smithi017 ceph-mon[30494]: pgmap v546: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 566 op/s 2024-09-13T16:03:06.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:06 smithi189 ceph-mon[34790]: pgmap v546: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 566 op/s 2024-09-13T16:03:08.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:08 smithi193 ceph-mon[35248]: pgmap v547: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 520 op/s 2024-09-13T16:03:08.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:08 smithi017 ceph-mon[30494]: pgmap v547: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 520 op/s 2024-09-13T16:03:08.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:08 smithi189 ceph-mon[34790]: pgmap v547: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 520 op/s 2024-09-13T16:03:10.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 325.0 s, 864.2 tps, lat 119.698 ms stddev 158.635 2024-09-13T16:03:10.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:10 smithi193 ceph-mon[35248]: pgmap v548: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 15 MiB/s wr, 595 op/s 2024-09-13T16:03:10.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:10 smithi017 ceph-mon[30494]: pgmap v548: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 15 MiB/s wr, 595 op/s 2024-09-13T16:03:10.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:10 smithi189 ceph-mon[34790]: pgmap v548: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 15 MiB/s wr, 595 op/s 2024-09-13T16:03:11.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.844+0000 7f8d6a600640 1 -- 172.21.15.17:0/983403315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d6410b8c0 msgr2=0x7f8d6410bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:11.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.844+0000 7f8d6a600640 1 --2- 172.21.15.17:0/983403315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d6410b8c0 0x7f8d6410bd40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8d54009910 tx=0x7f8d5402a490 comp rx=0 tx=0).stop 2024-09-13T16:03:11.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.844+0000 7f8d6a600640 1 -- 172.21.15.17:0/983403315 shutdown_connections 2024-09-13T16:03:11.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.844+0000 7f8d6a600640 1 --2- 172.21.15.17:0/983403315 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d6410c280 0x7f8d64112ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.844+0000 7f8d6a600640 1 --2- 172.21.15.17:0/983403315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d6410b8c0 0x7f8d6410bd40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.844+0000 7f8d6a600640 1 --2- 172.21.15.17:0/983403315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d6410a8c0 0x7f8d6410acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.844+0000 7f8d6a600640 1 -- 172.21.15.17:0/983403315 >> 172.21.15.17:0/983403315 conn(0x7f8d6406a260 msgr2=0x7f8d6406a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:11.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.846+0000 7f8d6a600640 1 -- 172.21.15.17:0/983403315 shutdown_connections 2024-09-13T16:03:11.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.846+0000 7f8d6a600640 1 -- 172.21.15.17:0/983403315 wait complete. 2024-09-13T16:03:11.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.847+0000 7f8d6a600640 1 Processor -- start 2024-09-13T16:03:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.848+0000 7f8d6a600640 1 -- start start 2024-09-13T16:03:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.848+0000 7f8d6a600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d6410a8c0 0x7f8d641a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.848+0000 7f8d6a600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d6410b8c0 0x7f8d641a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.848+0000 7f8d6a600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d6410c280 0x7f8d641a7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.848+0000 7f8d6a600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d641a8260 con 0x7f8d6410c280 2024-09-13T16:03:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.848+0000 7f8d6a600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d641a83d0 con 0x7f8d6410a8c0 2024-09-13T16:03:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.848+0000 7f8d6a600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d641a8590 con 0x7f8d6410b8c0 2024-09-13T16:03:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.849+0000 7f8d62a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d6410b8c0 0x7f8d641a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.849+0000 7f8d62a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d6410b8c0 0x7f8d641a0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:51170/0 (socket says 172.21.15.17:51170) 2024-09-13T16:03:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.849+0000 7f8d62a00640 1 -- 172.21.15.17:0/4080674507 learned_addr learned my addr 172.21.15.17:0/4080674507 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:03:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.849+0000 7f8d62a00640 1 -- 172.21.15.17:0/4080674507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d6410a8c0 msgr2=0x7f8d641a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.849+0000 7f8d62a00640 1 --2- 172.21.15.17:0/4080674507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d6410a8c0 0x7f8d641a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.849+0000 7f8d62a00640 1 -- 172.21.15.17:0/4080674507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d6410c280 msgr2=0x7f8d641a7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.849+0000 7f8d62a00640 1 --2- 172.21.15.17:0/4080674507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d6410c280 0x7f8d641a7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.849+0000 7f8d62a00640 1 -- 172.21.15.17:0/4080674507 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d54009500 con 0x7f8d6410b8c0 2024-09-13T16:03:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.850+0000 7f8d62a00640 1 --2- 172.21.15.17:0/4080674507 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d6410b8c0 0x7f8d641a0cb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8d54000c00 tx=0x7f8d540052f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.850+0000 7f8d5be00640 1 -- 172.21.15.17:0/4080674507 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d540056f0 con 0x7f8d6410b8c0 2024-09-13T16:03:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.850+0000 7f8d6a600640 1 -- 172.21.15.17:0/4080674507 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d641a8810 con 0x7f8d6410b8c0 2024-09-13T16:03:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.850+0000 7f8d6a600640 1 -- 172.21.15.17:0/4080674507 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d641a8d10 con 0x7f8d6410b8c0 2024-09-13T16:03:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.851+0000 7f8d5be00640 1 -- 172.21.15.17:0/4080674507 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d54004250 con 0x7f8d6410b8c0 2024-09-13T16:03:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.851+0000 7f8d5be00640 1 -- 172.21.15.17:0/4080674507 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d54003990 con 0x7f8d6410b8c0 2024-09-13T16:03:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.856+0000 7f8d5be00640 1 -- 172.21.15.17:0/4080674507 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8d54003af0 con 0x7f8d6410b8c0 2024-09-13T16:03:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.858+0000 7f8d5be00640 1 --2- 172.21.15.17:0/4080674507 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8d480a1190 0x7f8d480a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.858+0000 7f8d5be00640 1 -- 172.21.15.17:0/4080674507 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f8d540eda60 con 0x7f8d6410b8c0 2024-09-13T16:03:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.858+0000 7f8d63400640 1 --2- 172.21.15.17:0/4080674507 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8d480a1190 0x7f8d480a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.860+0000 7f8d63400640 1 --2- 172.21.15.17:0/4080674507 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8d480a1190 0x7f8d480a3650 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8d50005fd0 tx=0x7f8d50005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.861+0000 7f8d6d476740 1 Processor -- start 2024-09-13T16:03:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.862+0000 7f8d6d476740 1 -- start start 2024-09-13T16:03:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.862+0000 7f8d6d476740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f2b2a0 0x5652d8f2b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.862+0000 7f8d6d476740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652d8f2bbe0 0x5652d8f306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.862+0000 7f8d6d476740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f30c70 0x5652d8f33130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.862+0000 7f8d6d476740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d8e2ebb0 con 0x5652d8f30c70 2024-09-13T16:03:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.862+0000 7f8d6d476740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d8e8ca70 con 0x5652d8f2bbe0 2024-09-13T16:03:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.862+0000 7f8d6d476740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d8e8a200 con 0x5652d8f2b2a0 2024-09-13T16:03:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.863+0000 7f8d63400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f2b2a0 0x5652d8f2b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.863+0000 7f8d63400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f2b2a0 0x5652d8f2b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:51174/0 (socket says 172.21.15.17:51174) 2024-09-13T16:03:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.863+0000 7f8d63400640 1 -- 172.21.15.17:0/818989577 learned_addr learned my addr 172.21.15.17:0/818989577 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:03:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.863+0000 7f8d63400640 1 -- 172.21.15.17:0/818989577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652d8f2bbe0 msgr2=0x5652d8f306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.863+0000 7f8d63400640 1 --2- 172.21.15.17:0/818989577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652d8f2bbe0 0x5652d8f306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.863+0000 7f8d63e00640 1 --2- 172.21.15.17:0/818989577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f30c70 0x5652d8f33130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.864+0000 7f8d63400640 1 -- 172.21.15.17:0/818989577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f30c70 msgr2=0x5652d8f33130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.864+0000 7f8d63400640 1 --2- 172.21.15.17:0/818989577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f30c70 0x5652d8f33130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.864+0000 7f8d63400640 1 -- 172.21.15.17:0/818989577 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652d8e27940 con 0x5652d8f2b2a0 2024-09-13T16:03:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.865+0000 7f8d63e00640 1 --2- 172.21.15.17:0/818989577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f30c70 0x5652d8f33130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:03:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.865+0000 7f8d63400640 1 --2- 172.21.15.17:0/818989577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f2b2a0 0x5652d8f2b6a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000ddc0 tx=0x7f8d50010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9881fddf9a7f2915 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.865+0000 7f8d58c00640 1 -- 172.21.15.17:0/818989577 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d50018040 con 0x5652d8f2b2a0 2024-09-13T16:03:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.865+0000 7f8d58c00640 1 -- 172.21.15.17:0/818989577 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d5001e930 con 0x5652d8f2b2a0 2024-09-13T16:03:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.866+0000 7f8d6d476740 1 -- 172.21.15.17:0/818989577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f2b2a0 msgr2=0x5652d8f2b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.866+0000 7f8d6d476740 1 --2- 172.21.15.17:0/818989577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f2b2a0 0x5652d8f2b6a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000ddc0 tx=0x7f8d50010000 comp rx=0 tx=0).stop 2024-09-13T16:03:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.866+0000 7f8d6d476740 1 -- 172.21.15.17:0/818989577 shutdown_connections 2024-09-13T16:03:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.866+0000 7f8d6d476740 1 --2- 172.21.15.17:0/818989577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f30c70 0x5652d8f33130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.866+0000 7f8d6d476740 1 --2- 172.21.15.17:0/818989577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652d8f2bbe0 0x5652d8f306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.866+0000 7f8d6d476740 1 --2- 172.21.15.17:0/818989577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f2b2a0 0x5652d8f2b6a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.866+0000 7f8d6d476740 1 -- 172.21.15.17:0/818989577 >> 172.21.15.17:0/818989577 conn(0x5652d8f1e100 msgr2=0x5652d8f1e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.867+0000 7f8d6d476740 1 -- 172.21.15.17:0/818989577 shutdown_connections 2024-09-13T16:03:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.868+0000 7f8d6d476740 1 -- 172.21.15.17:0/818989577 wait complete. 2024-09-13T16:03:11.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.868+0000 7f8d6d476740 1 -- start start 2024-09-13T16:03:11.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.869+0000 7f8d6d476740 1 Processor -- start 2024-09-13T16:03:11.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.870+0000 7f8d6d476740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f2b2a0 0x5652d8f34f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:11.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.870+0000 7f8d6d476740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652d8f2bbe0 0x5652d8f35490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:11.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.870+0000 7f8d6d476740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f30c70 0x5652d8f3c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:11.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.870+0000 7f8d6d476740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d8e85af0 con 0x5652d8f2b2a0 2024-09-13T16:03:11.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.870+0000 7f8d6d476740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d8e43f20 con 0x5652d8f2bbe0 2024-09-13T16:03:11.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.870+0000 7f8d6d476740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d8e43bc0 con 0x5652d8f30c70 2024-09-13T16:03:11.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.871+0000 7f8d6d476740 10 client.0 _ll_register_callbacks cb 0x5652d8e75a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:03:11.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.871+0000 7f8d63e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f30c70 0x5652d8f3c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.871+0000 7f8d63e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f30c70 0x5652d8f3c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:51184/0 (socket says 172.21.15.17:51184) 2024-09-13T16:03:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.871+0000 7f8d63e00640 1 -- 172.21.15.17:0/3012943354 learned_addr learned my addr 172.21.15.17:0/3012943354 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:03:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.871+0000 7f8d62a00640 1 --2- 172.21.15.17:0/3012943354 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652d8f2bbe0 0x5652d8f35490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.871+0000 7f8d63e00640 1 -- 172.21.15.17:0/3012943354 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652d8f2bbe0 msgr2=0x5652d8f35490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.871+0000 7f8d63e00640 1 --2- 172.21.15.17:0/3012943354 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652d8f2bbe0 0x5652d8f35490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.871+0000 7f8d63e00640 1 -- 172.21.15.17:0/3012943354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f2b2a0 msgr2=0x5652d8f34f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.872+0000 7f8d63400640 1 --2- 172.21.15.17:0/3012943354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f2b2a0 0x5652d8f34f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.872+0000 7f8d63e00640 1 --2- 172.21.15.17:0/3012943354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f2b2a0 0x5652d8f34f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.872+0000 7f8d63e00640 1 -- 172.21.15.17:0/3012943354 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5000da70 con 0x5652d8f30c70 2024-09-13T16:03:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.872+0000 7f8d63400640 1 --2- 172.21.15.17:0/3012943354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f2b2a0 0x5652d8f34f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:03:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.872+0000 7f8d4d600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:03:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.872+0000 7f8d63e00640 1 --2- 172.21.15.17:0/3012943354 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f30c70 0x5652d8f3c4d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00f5e0 tx=0x7f8d5c00faa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f8f9766ba0088f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.873+0000 7f8d4d600640 1 -- 172.21.15.17:0/3012943354 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c004d20 con 0x5652d8f30c70 2024-09-13T16:03:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.873+0000 7f8d6d476740 1 -- 172.21.15.17:0/3012943354 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5652d8eafc90 con 0x5652d8f30c70 2024-09-13T16:03:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.874+0000 7f8d4d600640 1 -- 172.21.15.17:0/3012943354 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f8d5c011710 con 0x5652d8f30c70 2024-09-13T16:03:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.874+0000 7f8d4d600640 1 -- 172.21.15.17:0/3012943354 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d5c004d20 con 0x5652d8f30c70 2024-09-13T16:03:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.874+0000 7f8d6d476740 10 client.25798 fetch_fsmap learned FSMap version 34 2024-09-13T16:03:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.874+0000 7f8d6d476740 1 -- 172.21.15.17:0/3012943354 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5652d8e84170 con 0x5652d8f30c70 2024-09-13T16:03:11.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.875+0000 7f8d4d600640 1 -- 172.21.15.17:0/3012943354 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5652d8eafc90 con 0x5652d8f30c70 2024-09-13T16:03:11.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.875+0000 7f8d4d600640 1 -- 172.21.15.17:0/3012943354 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 34) v1 ==== 7490+0+0 (secure 0 0 0) 0x7f8d5c01ba80 con 0x5652d8f30c70 2024-09-13T16:03:11.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.875+0000 7f8d6d476740 10 client.25798 fetch_fsmap finished waiting for FSMap version 34 2024-09-13T16:03:11.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.875+0000 7f8d6d476740 10 client.25798 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:03:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.875+0000 7f8d6d476740 20 client.25798 populate_metadata read hostname 'smithi017' 2024-09-13T16:03:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.875+0000 7f8d6d476740 1 --2- 172.21.15.17:0/3012943354 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5652d8f24170 0x5652d8f26590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.875+0000 7f8d6d476740 4 client.25798 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:03:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.875+0000 7f8d6d476740 1 -- 172.21.15.17:0/3012943354 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5652d8e787d0 con 0x5652d8f24170 2024-09-13T16:03:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.876+0000 7f8d63400640 1 --2- 172.21.15.17:0/3012943354 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5652d8f24170 0x5652d8f26590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.877+0000 7f8d63400640 1 --2- 172.21.15.17:0/3012943354 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5652d8f24170 0x5652d8f26590 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d460f9ef03f92b3 server_cookie=fb2567e0bcfbfdca in_seq=0 out_seq=0 2024-09-13T16:03:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.877+0000 7f8d4d600640 10 client.25798 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:03:11.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.877+0000 7f8d4d600640 1 -- 172.21.15.17:0/3012943354 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5652d8e787d0 con 0x5652d8f24170 2024-09-13T16:03:11.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.877+0000 7f8d4d600640 10 client.25798 handle_command_reply: tid=0 2024-09-13T16:03:11.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.878+0000 7f8d6d476740 1 client.25798 shutdown 2024-09-13T16:03:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.878+0000 7f8d6d476740 1 -- 172.21.15.17:0/3012943354 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f30c70 msgr2=0x5652d8f3c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.878+0000 7f8d6d476740 1 --2- 172.21.15.17:0/3012943354 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f30c70 0x5652d8f3c4d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00f5e0 tx=0x7f8d5c00faa0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.878+0000 7f8d6d476740 1 -- 172.21.15.17:0/3012943354 shutdown_connections 2024-09-13T16:03:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.878+0000 7f8d6d476740 1 --2- 172.21.15.17:0/3012943354 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5652d8f24170 0x5652d8f26590 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.878+0000 7f8d6d476740 1 --2- 172.21.15.17:0/3012943354 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f30c70 0x5652d8f3c4d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.878+0000 7f8d4d600640 0 client.25798 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:03:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.879+0000 7f8d6d476740 1 --2- 172.21.15.17:0/3012943354 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652d8f2bbe0 0x5652d8f35490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.879+0000 7f8d6d476740 1 --2- 172.21.15.17:0/3012943354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f2b2a0 0x5652d8f34f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.879+0000 7f8d6d476740 1 -- 172.21.15.17:0/3012943354 >> 172.21.15.17:0/3012943354 conn(0x5652d8f1e100 msgr2=0x5652d8f1d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.881+0000 7f8d6d476740 1 -- 172.21.15.17:0/3012943354 shutdown_connections 2024-09-13T16:03:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.881+0000 7f8d6d476740 1 -- 172.21.15.17:0/3012943354 wait complete. 2024-09-13T16:03:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.881+0000 7f8d6d476740 20 client.25798 trim_cache size 0 max 16384 2024-09-13T16:03:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.914+0000 7f8d6d476740 1 Processor -- start 2024-09-13T16:03:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.914+0000 7f8d6d476740 1 -- start start 2024-09-13T16:03:11.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.915+0000 7f8d6d476740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652d8f24170 0x5652d8f43110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:11.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.915+0000 7f8d6d476740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f2b2a0 0x5652d8f43650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:11.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.915+0000 7f8d6d476740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f2bbe0 0x5652d8f1f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:11.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.915+0000 7f8d6d476740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d8bece60 con 0x5652d8f2bbe0 2024-09-13T16:03:11.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.915+0000 7f8d6d476740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d8f35fc0 con 0x5652d8f24170 2024-09-13T16:03:11.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.915+0000 7f8d6d476740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d8e787d0 con 0x5652d8f2b2a0 2024-09-13T16:03:11.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.915+0000 7f8d63e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f2bbe0 0x5652d8f1f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:11.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.915+0000 7f8d63e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f2bbe0 0x5652d8f1f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42498/0 (socket says 172.21.15.17:42498) 2024-09-13T16:03:11.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.915+0000 7f8d63e00640 1 -- 172.21.15.17:0/902961526 learned_addr learned my addr 172.21.15.17:0/902961526 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:03:11.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.916+0000 7f8d63e00640 1 -- 172.21.15.17:0/902961526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f2b2a0 msgr2=0x5652d8f43650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:03:11.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.916+0000 7f8d63e00640 1 --2- 172.21.15.17:0/902961526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f2b2a0 0x5652d8f43650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.916+0000 7f8d63e00640 1 -- 172.21.15.17:0/902961526 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652d8f24170 msgr2=0x5652d8f43110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:03:11.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.917+0000 7f8d63e00640 1 --2- 172.21.15.17:0/902961526 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652d8f24170 0x5652d8f43110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.917+0000 7f8d63e00640 1 -- 172.21.15.17:0/902961526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652d8e26180 con 0x5652d8f2bbe0 2024-09-13T16:03:11.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.917+0000 7f8d63e00640 1 --2- 172.21.15.17:0/902961526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f2bbe0 0x5652d8f1f4f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009f60 tx=0x7f8d5c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91fb74a2df618167 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.920+0000 7f8d59600640 1 -- 172.21.15.17:0/902961526 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c010430 con 0x5652d8f2bbe0 2024-09-13T16:03:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.920+0000 7f8d59600640 1 -- 172.21.15.17:0/902961526 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d5c003e30 con 0x5652d8f2bbe0 2024-09-13T16:03:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.920+0000 7f8d59600640 1 -- 172.21.15.17:0/902961526 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c010df0 con 0x5652d8f2bbe0 2024-09-13T16:03:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.921+0000 7f8d6d476740 1 -- 172.21.15.17:0/902961526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f2bbe0 msgr2=0x5652d8f1f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.921+0000 7f8d6d476740 1 --2- 172.21.15.17:0/902961526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f2bbe0 0x5652d8f1f4f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009f60 tx=0x7f8d5c009f90 comp rx=0 tx=0).stop 2024-09-13T16:03:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.922+0000 7f8d6d476740 1 -- 172.21.15.17:0/902961526 shutdown_connections 2024-09-13T16:03:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.922+0000 7f8d6d476740 1 --2- 172.21.15.17:0/902961526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f2bbe0 0x5652d8f1f4f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.922+0000 7f8d6d476740 1 --2- 172.21.15.17:0/902961526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f2b2a0 0x5652d8f43650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.922+0000 7f8d6d476740 1 --2- 172.21.15.17:0/902961526 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652d8f24170 0x5652d8f43110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.922+0000 7f8d6d476740 1 -- 172.21.15.17:0/902961526 >> 172.21.15.17:0/902961526 conn(0x5652d8f1e100 msgr2=0x5652d8f1cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.922+0000 7f8d6d476740 1 -- 172.21.15.17:0/902961526 shutdown_connections 2024-09-13T16:03:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.927+0000 7f8d6d476740 1 -- 172.21.15.17:0/902961526 wait complete. 2024-09-13T16:03:11.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.927+0000 7f8d6d476740 1 -- start start 2024-09-13T16:03:11.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.928+0000 7f8d6d476740 1 Processor -- start 2024-09-13T16:03:11.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.929+0000 7f8d6d476740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f24170 0x5652d8f87520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:11.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.929+0000 7f8d6d476740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652d8f2b2a0 0x5652d8f87a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:11.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.929+0000 7f8d6d476740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f2bbe0 0x5652d8f8eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:11.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.929+0000 7f8d6d476740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d8f8efe0 con 0x5652d8f2bbe0 2024-09-13T16:03:11.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.929+0000 7f8d6d476740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d8f8f120 con 0x5652d8f2b2a0 2024-09-13T16:03:11.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.929+0000 7f8d6d476740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d8f8f2b0 con 0x5652d8f24170 2024-09-13T16:03:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.929+0000 7f8d6d476740 10 client.0 _ll_register_callbacks cb 0x7f8d5000b6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:03:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.930+0000 7f8d62a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652d8f2b2a0 0x5652d8f87a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.930+0000 7f8d62a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652d8f2b2a0 0x5652d8f87a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:50996/0 (socket says 172.21.15.17:50996) 2024-09-13T16:03:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.930+0000 7f8d62a00640 1 -- 172.21.15.17:0/2061755424 learned_addr learned my addr 172.21.15.17:0/2061755424 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:03:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.930+0000 7f8d63400640 1 --2- 172.21.15.17:0/2061755424 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f24170 0x5652d8f87520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.930+0000 7f8d63400640 1 -- 172.21.15.17:0/2061755424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652d8f2b2a0 msgr2=0x5652d8f87a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.930+0000 7f8d63400640 1 --2- 172.21.15.17:0/2061755424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652d8f2b2a0 0x5652d8f87a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.930+0000 7f8d63400640 1 -- 172.21.15.17:0/2061755424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f2bbe0 msgr2=0x5652d8f8eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.930+0000 7f8d63400640 1 --2- 172.21.15.17:0/2061755424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f2bbe0 0x5652d8f8eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.931+0000 7f8d63400640 1 -- 172.21.15.17:0/2061755424 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5652d8e84170 con 0x5652d8f24170 2024-09-13T16:03:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.931+0000 7f8d62a00640 1 --2- 172.21.15.17:0/2061755424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652d8f2b2a0 0x5652d8f87a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:03:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.931+0000 7f8d63400640 1 --2- 172.21.15.17:0/2061755424 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f24170 0x5652d8f87520 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000b840 tx=0x7f8d5000f3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efb4350e814189b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.931+0000 7f8d4d600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:03:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.932+0000 7f8d4d600640 1 -- 172.21.15.17:0/2061755424 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5002e070 con 0x5652d8f24170 2024-09-13T16:03:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.932+0000 7f8d4d600640 1 -- 172.21.15.17:0/2061755424 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f8d5000fc80 con 0x5652d8f24170 2024-09-13T16:03:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.932+0000 7f8d6d476740 1 -- 172.21.15.17:0/2061755424 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8d5001e930 con 0x5652d8f24170 2024-09-13T16:03:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.932+0000 7f8d4d600640 1 -- 172.21.15.17:0/2061755424 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d5000fe40 con 0x5652d8f24170 2024-09-13T16:03:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.932+0000 7f8d6d476740 10 client.25801 fetch_fsmap learned FSMap version 34 2024-09-13T16:03:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.932+0000 7f8d6d476740 1 -- 172.21.15.17:0/2061755424 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5652d8e4b560 con 0x5652d8f24170 2024-09-13T16:03:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.933+0000 7f8d4d600640 1 -- 172.21.15.17:0/2061755424 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d5001e930 con 0x5652d8f24170 2024-09-13T16:03:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.933+0000 7f8d4d600640 1 -- 172.21.15.17:0/2061755424 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 34) v1 ==== 7490+0+0 (secure 0 0 0) 0x7f8d50039070 con 0x5652d8f24170 2024-09-13T16:03:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.933+0000 7f8d6d476740 10 client.25801 fetch_fsmap finished waiting for FSMap version 34 2024-09-13T16:03:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.933+0000 7f8d6d476740 10 client.25801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:03:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.933+0000 7f8d6d476740 20 client.25801 populate_metadata read hostname 'smithi017' 2024-09-13T16:03:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.933+0000 7f8d6d476740 1 --2- 172.21.15.17:0/2061755424 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5652d8f30c70 0x5652d8f92db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.933+0000 7f8d6d476740 4 client.25801 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:03:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.933+0000 7f8d6d476740 1 -- 172.21.15.17:0/2061755424 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5652d8b79300 con 0x5652d8f30c70 2024-09-13T16:03:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.934+0000 7f8d62a00640 1 --2- 172.21.15.17:0/2061755424 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5652d8f30c70 0x5652d8f92db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.935+0000 7f8d4d600640 10 client.25801 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:03:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:11.935+0000 7f8d62a00640 1 --2- 172.21.15.17:0/2061755424 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5652d8f30c70 0x5652d8f92db0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b890e171fd414b76 server_cookie=380de0edce1d8b98 in_seq=0 out_seq=0 2024-09-13T16:03:12.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.014+0000 7f8d4d600640 1 -- 172.21.15.17:0/2061755424 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5652d8b79300 con 0x5652d8f30c70 2024-09-13T16:03:12.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.014+0000 7f8d4d600640 10 client.25801 handle_command_reply: tid=0 2024-09-13T16:03:12.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.014+0000 7f8d6d476740 1 client.25801 shutdown 2024-09-13T16:03:12.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.017+0000 7f8d6d476740 1 -- 172.21.15.17:0/2061755424 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f24170 msgr2=0x5652d8f87520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:12.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.017+0000 7f8d6d476740 1 --2- 172.21.15.17:0/2061755424 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f24170 0x5652d8f87520 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000b840 tx=0x7f8d5000f3c0 comp rx=0 tx=0).stop 2024-09-13T16:03:12.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.017+0000 7f8d6d476740 1 -- 172.21.15.17:0/2061755424 shutdown_connections 2024-09-13T16:03:12.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.017+0000 7f8d6d476740 1 --2- 172.21.15.17:0/2061755424 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5652d8f30c70 0x5652d8f92db0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:12.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.017+0000 7f8d6d476740 1 --2- 172.21.15.17:0/2061755424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652d8f2bbe0 0x5652d8f8eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:12.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.017+0000 7f8d6d476740 1 --2- 172.21.15.17:0/2061755424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5652d8f2b2a0 0x5652d8f87a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:12.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.017+0000 7f8d4d600640 0 client.25801 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:03:12.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.017+0000 7f8d6d476740 1 --2- 172.21.15.17:0/2061755424 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652d8f24170 0x5652d8f87520 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:12.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.017+0000 7f8d6d476740 1 -- 172.21.15.17:0/2061755424 >> 172.21.15.17:0/2061755424 conn(0x5652d8f1e100 msgr2=0x5652d8f1d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:12.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.019+0000 7f8d6d476740 1 -- 172.21.15.17:0/2061755424 shutdown_connections 2024-09-13T16:03:12.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.019+0000 7f8d6d476740 1 -- 172.21.15.17:0/2061755424 wait complete. 2024-09-13T16:03:12.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.019+0000 7f8d6d476740 20 client.25801 trim_cache size 0 max 16384 2024-09-13T16:03:12.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:03:12.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:03:12.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:03:12.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:03:12.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.020+0000 7f8d6a600640 1 -- 172.21.15.17:0/4080674507 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8d480a1190 msgr2=0x7f8d480a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:12.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.020+0000 7f8d6a600640 1 --2- 172.21.15.17:0/4080674507 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8d480a1190 0x7f8d480a3650 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8d50005fd0 tx=0x7f8d50005850 comp rx=0 tx=0).stop 2024-09-13T16:03:12.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.020+0000 7f8d6a600640 1 -- 172.21.15.17:0/4080674507 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d6410b8c0 msgr2=0x7f8d641a0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:12.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.020+0000 7f8d6a600640 1 --2- 172.21.15.17:0/4080674507 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d6410b8c0 0x7f8d641a0cb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8d54000c00 tx=0x7f8d540052f0 comp rx=0 tx=0).stop 2024-09-13T16:03:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.025+0000 7f8d6a600640 1 -- 172.21.15.17:0/4080674507 shutdown_connections 2024-09-13T16:03:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.025+0000 7f8d6a600640 1 --2- 172.21.15.17:0/4080674507 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8d480a1190 0x7f8d480a3650 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.025+0000 7f8d6a600640 1 --2- 172.21.15.17:0/4080674507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d6410c280 0x7f8d641a7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.025+0000 7f8d6a600640 1 --2- 172.21.15.17:0/4080674507 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d6410b8c0 0x7f8d641a0cb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.026+0000 7f8d6a600640 1 --2- 172.21.15.17:0/4080674507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d6410a8c0 0x7f8d641a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.026+0000 7f8d6a600640 1 -- 172.21.15.17:0/4080674507 >> 172.21.15.17:0/4080674507 conn(0x7f8d6406a260 msgr2=0x7f8d6410ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.026+0000 7f8d6a600640 1 -- 172.21.15.17:0/4080674507 shutdown_connections 2024-09-13T16:03:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:12.026+0000 7f8d6a600640 1 -- 172.21.15.17:0/4080674507 wait complete. 2024-09-13T16:03:12.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:12 smithi193 ceph-mon[35248]: pgmap v549: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 569 op/s 2024-09-13T16:03:12.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:12 smithi017 ceph-mon[30494]: pgmap v549: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 569 op/s 2024-09-13T16:03:12.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:12 smithi189 ceph-mon[34790]: pgmap v549: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 569 op/s 2024-09-13T16:03:14.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:14 smithi193 ceph-mon[35248]: pgmap v550: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 550 op/s 2024-09-13T16:03:14.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:14 smithi017 ceph-mon[30494]: pgmap v550: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 550 op/s 2024-09-13T16:03:14.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:14 smithi189 ceph-mon[34790]: pgmap v550: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 550 op/s 2024-09-13T16:03:15.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 330.0 s, 760.4 tps, lat 128.699 ms stddev 142.657 2024-09-13T16:03:16.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:16 smithi193 ceph-mon[35248]: pgmap v551: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 557 op/s 2024-09-13T16:03:16.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:16 smithi017 ceph-mon[30494]: pgmap v551: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 557 op/s 2024-09-13T16:03:16.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:16 smithi189 ceph-mon[34790]: pgmap v551: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 557 op/s 2024-09-13T16:03:18.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:18 smithi193 ceph-mon[35248]: pgmap v552: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 509 op/s 2024-09-13T16:03:18.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:18 smithi017 ceph-mon[30494]: pgmap v552: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 509 op/s 2024-09-13T16:03:18.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:18 smithi189 ceph-mon[34790]: pgmap v552: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 509 op/s 2024-09-13T16:03:20.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 335.0 s, 614.0 tps, lat 164.470 ms stddev 201.607 2024-09-13T16:03:20.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:20 smithi193 ceph-mon[35248]: pgmap v553: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 604 op/s 2024-09-13T16:03:20.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:20 smithi017 ceph-mon[30494]: pgmap v553: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 604 op/s 2024-09-13T16:03:20.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:20 smithi189 ceph-mon[34790]: pgmap v553: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 604 op/s 2024-09-13T16:03:23.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:22 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:03:23.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:22 smithi193 ceph-mon[35248]: pgmap v554: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 603 op/s 2024-09-13T16:03:23.014 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:22 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:03:23.014 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:22 smithi017 ceph-mon[30494]: pgmap v554: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 603 op/s 2024-09-13T16:03:23.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:22 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:03:23.159 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:22 smithi189 ceph-mon[34790]: pgmap v554: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 603 op/s 2024-09-13T16:03:24.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:24 smithi193 ceph-mon[35248]: pgmap v555: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 596 op/s 2024-09-13T16:03:24.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:24 smithi017 ceph-mon[30494]: pgmap v555: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 596 op/s 2024-09-13T16:03:24.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:24 smithi189 ceph-mon[34790]: pgmap v555: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 596 op/s 2024-09-13T16:03:25.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.228+0000 7f039a600640 1 -- 172.21.15.17:0/3548716317 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0394107a20 msgr2=0x7f0394109ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:25.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.228+0000 7f039a600640 1 --2- 172.21.15.17:0/3548716317 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0394107a20 0x7f0394109ee0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f038c009860 tx=0x7f038c02a3d0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.228+0000 7f039a600640 1 -- 172.21.15.17:0/3548716317 shutdown_connections 2024-09-13T16:03:25.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.229+0000 7f039a600640 1 --2- 172.21.15.17:0/3548716317 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0394107a20 0x7f0394109ee0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.229+0000 7f039a600640 1 --2- 172.21.15.17:0/3548716317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0394072eb0 0x7f0394073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.229+0000 7f039a600640 1 --2- 172.21.15.17:0/3548716317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0394074490 0x7f03940728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.229+0000 7f039a600640 1 -- 172.21.15.17:0/3548716317 >> 172.21.15.17:0/3548716317 conn(0x7f03940fb2f0 msgr2=0x7f03940fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:25.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.229+0000 7f039a600640 1 -- 172.21.15.17:0/3548716317 shutdown_connections 2024-09-13T16:03:25.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.229+0000 7f039a600640 1 -- 172.21.15.17:0/3548716317 wait complete. 2024-09-13T16:03:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.230+0000 7f039a600640 1 Processor -- start 2024-09-13T16:03:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.230+0000 7f039a600640 1 -- start start 2024-09-13T16:03:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.231+0000 7f039a600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0394072eb0 0x7f0394197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.231+0000 7f039a600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0394074490 0x7f03941982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.231+0000 7f039a600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0394107a20 0x7f039419f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.231+0000 7f039a600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039419f830 con 0x7f0394107a20 2024-09-13T16:03:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.231+0000 7f039a600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039419f9a0 con 0x7f0394072eb0 2024-09-13T16:03:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.231+0000 7f039a600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039419fb60 con 0x7f0394074490 2024-09-13T16:03:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.231+0000 7f0393400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0394072eb0 0x7f0394197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.231+0000 7f0393400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0394072eb0 0x7f0394197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:40334/0 (socket says 172.21.15.17:40334) 2024-09-13T16:03:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.231+0000 7f0393400640 1 -- 172.21.15.17:0/1613784228 learned_addr learned my addr 172.21.15.17:0/1613784228 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:03:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.231+0000 7f038aa00640 1 --2- 172.21.15.17:0/1613784228 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0394074490 0x7f03941982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.231+0000 7f0399000640 1 --2- 172.21.15.17:0/1613784228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0394107a20 0x7f039419f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.231+0000 7f038aa00640 1 -- 172.21.15.17:0/1613784228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0394072eb0 msgr2=0x7f0394197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.231+0000 7f038aa00640 1 --2- 172.21.15.17:0/1613784228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0394072eb0 0x7f0394197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.231+0000 7f038aa00640 1 -- 172.21.15.17:0/1613784228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0394107a20 msgr2=0x7f039419f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.231+0000 7f038aa00640 1 --2- 172.21.15.17:0/1613784228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0394107a20 0x7f039419f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.231+0000 7f038aa00640 1 -- 172.21.15.17:0/1613784228 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0384009900 con 0x7f0394074490 2024-09-13T16:03:25.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.232+0000 7f038aa00640 1 --2- 172.21.15.17:0/1613784228 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0394074490 0x7f03941982e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f037c00e9f0 tx=0x7f037c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:25.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.232+0000 7f0390c00640 1 -- 172.21.15.17:0/1613784228 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c00ccc0 con 0x7f0394074490 2024-09-13T16:03:25.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.232+0000 7f0390c00640 1 -- 172.21.15.17:0/1613784228 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f037c00ce20 con 0x7f0394074490 2024-09-13T16:03:25.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.232+0000 7f039a600640 1 -- 172.21.15.17:0/1613784228 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f038c009490 con 0x7f0394074490 2024-09-13T16:03:25.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.232+0000 7f0390c00640 1 -- 172.21.15.17:0/1613784228 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c0187e0 con 0x7f0394074490 2024-09-13T16:03:25.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.233+0000 7f039a600640 1 -- 172.21.15.17:0/1613784228 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03941a01c0 con 0x7f0394074490 2024-09-13T16:03:25.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.238+0000 7f0390c00640 1 -- 172.21.15.17:0/1613784228 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f037c018940 con 0x7f0394074490 2024-09-13T16:03:25.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.239+0000 7f039d5c5740 1 Processor -- start 2024-09-13T16:03:25.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.239+0000 7f039d5c5740 1 -- start start 2024-09-13T16:03:25.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.239+0000 7f039d5c5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5615dbc82c90 0x5615dbc83090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:25.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.239+0000 7f039d5c5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc835d0 0x5615dbc88090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:25.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.239+0000 7f039d5c5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5615dbc88660 0x5615dbc8ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:25.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.239+0000 7f039d5c5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615dbb7dbb0 con 0x5615dbc82c90 2024-09-13T16:03:25.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.239+0000 7f039d5c5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615dbbdba70 con 0x5615dbc835d0 2024-09-13T16:03:25.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.239+0000 7f039d5c5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615dbbd9200 con 0x5615dbc88660 2024-09-13T16:03:25.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.240+0000 7f0393400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc835d0 0x5615dbc88090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:25.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.240+0000 7f0393400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc835d0 0x5615dbc88090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:40348/0 (socket says 172.21.15.17:40348) 2024-09-13T16:03:25.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.240+0000 7f0393400640 1 -- 172.21.15.17:0/758427331 learned_addr learned my addr 172.21.15.17:0/758427331 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:03:25.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.240+0000 7f038aa00640 1 --2- 172.21.15.17:0/758427331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5615dbc88660 0x5615dbc8ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:25.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.240+0000 7f0393400640 1 -- 172.21.15.17:0/758427331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5615dbc88660 msgr2=0x5615dbc8ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:25.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.240+0000 7f0393400640 1 --2- 172.21.15.17:0/758427331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5615dbc88660 0x5615dbc8ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.240+0000 7f0393400640 1 -- 172.21.15.17:0/758427331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5615dbc82c90 msgr2=0x5615dbc83090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:25.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.240+0000 7f0393400640 1 --2- 172.21.15.17:0/758427331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5615dbc82c90 0x5615dbc83090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.240+0000 7f0393400640 1 -- 172.21.15.17:0/758427331 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615dbb76940 con 0x5615dbc835d0 2024-09-13T16:03:25.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.241+0000 7f0393400640 1 --2- 172.21.15.17:0/758427331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc835d0 0x5615dbc88090 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f038400e820 tx=0x7f03840095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f48fff78615e4f54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:25.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.241+0000 7f0390c00640 1 --2- 172.21.15.17:0/1613784228 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f03780a11e0 0x7f03780a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:25.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.241+0000 7f0390c00640 1 -- 172.21.15.17:0/1613784228 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f037c014070 con 0x7f0394074490 2024-09-13T16:03:25.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.241+0000 7f0388c00640 1 -- 172.21.15.17:0/758427331 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384013040 con 0x5615dbc835d0 2024-09-13T16:03:25.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.241+0000 7f0388c00640 1 -- 172.21.15.17:0/758427331 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f038400dbc0 con 0x5615dbc835d0 2024-09-13T16:03:25.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.241+0000 7f0388c00640 1 -- 172.21.15.17:0/758427331 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03840165e0 con 0x5615dbc835d0 2024-09-13T16:03:25.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.241+0000 7f0399000640 1 --2- 172.21.15.17:0/1613784228 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f03780a11e0 0x7f03780a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:25.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.242+0000 7f039d5c5740 1 -- 172.21.15.17:0/758427331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc835d0 msgr2=0x5615dbc88090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:25.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.242+0000 7f039d5c5740 1 --2- 172.21.15.17:0/758427331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc835d0 0x5615dbc88090 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f038400e820 tx=0x7f03840095c0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.242+0000 7f0399000640 1 --2- 172.21.15.17:0/1613784228 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f03780a11e0 0x7f03780a36a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f038c009830 tx=0x7f038c0303c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:25.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.243+0000 7f039d5c5740 1 -- 172.21.15.17:0/758427331 shutdown_connections 2024-09-13T16:03:25.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.243+0000 7f039d5c5740 1 --2- 172.21.15.17:0/758427331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5615dbc88660 0x5615dbc8ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.243+0000 7f039d5c5740 1 --2- 172.21.15.17:0/758427331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc835d0 0x5615dbc88090 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.243+0000 7f039d5c5740 1 --2- 172.21.15.17:0/758427331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5615dbc82c90 0x5615dbc83090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.243+0000 7f039d5c5740 1 -- 172.21.15.17:0/758427331 >> 172.21.15.17:0/758427331 conn(0x5615dbc6d2f0 msgr2=0x5615dbc6d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:25.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.244+0000 7f039d5c5740 1 -- 172.21.15.17:0/758427331 shutdown_connections 2024-09-13T16:03:25.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.244+0000 7f039d5c5740 1 -- 172.21.15.17:0/758427331 wait complete. 2024-09-13T16:03:25.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.244+0000 7f039d5c5740 1 -- start start 2024-09-13T16:03:25.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.245+0000 7f039d5c5740 1 Processor -- start 2024-09-13T16:03:25.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.245+0000 7f039d5c5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc82c90 0x5615dbc8c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:25.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.245+0000 7f039d5c5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5615dbc835d0 0x5615dbc8cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:25.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.245+0000 7f039d5c5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5615dbc88660 0x5615dbc93f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:25.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.245+0000 7f039d5c5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615dbbd4af0 con 0x5615dbc835d0 2024-09-13T16:03:25.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.245+0000 7f039d5c5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615dbb92f20 con 0x5615dbc82c90 2024-09-13T16:03:25.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.245+0000 7f039d5c5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615dbb92bc0 con 0x5615dbc88660 2024-09-13T16:03:25.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.246+0000 7f039d5c5740 10 client.0 _ll_register_callbacks cb 0x5615dbbc4a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:03:25.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.246+0000 7f0399000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5615dbc88660 0x5615dbc93f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:25.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.247+0000 7f038aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5615dbc835d0 0x5615dbc8cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:25.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.247+0000 7f0399000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5615dbc88660 0x5615dbc93f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:59628/0 (socket says 172.21.15.17:59628) 2024-09-13T16:03:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.247+0000 7f0399000640 1 -- 172.21.15.17:0/1004365822 learned_addr learned my addr 172.21.15.17:0/1004365822 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:03:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.247+0000 7f0393400640 1 --2- 172.21.15.17:0/1004365822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc82c90 0x5615dbc8c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.247+0000 7f0393400640 1 -- 172.21.15.17:0/1004365822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5615dbc88660 msgr2=0x5615dbc93f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.247+0000 7f0393400640 1 --2- 172.21.15.17:0/1004365822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5615dbc88660 0x5615dbc93f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.247+0000 7f0393400640 1 -- 172.21.15.17:0/1004365822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5615dbc835d0 msgr2=0x5615dbc8cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.247+0000 7f0393400640 1 --2- 172.21.15.17:0/1004365822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5615dbc835d0 0x5615dbc8cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.247+0000 7f0393400640 1 -- 172.21.15.17:0/1004365822 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038400e450 con 0x5615dbc82c90 2024-09-13T16:03:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.248+0000 7f038aa00640 1 --2- 172.21.15.17:0/1004365822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5615dbc835d0 0x5615dbc8cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:03:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.248+0000 7f0393400640 1 --2- 172.21.15.17:0/1004365822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc82c90 0x5615dbc8c980 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x5615dbc6e170 tx=0x7f0384018fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a917f164217ad52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.248+0000 7f0381600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:03:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.248+0000 7f0381600640 1 -- 172.21.15.17:0/1004365822 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384004c40 con 0x5615dbc82c90 2024-09-13T16:03:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.248+0000 7f0381600640 1 -- 172.21.15.17:0/1004365822 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f0384004da0 con 0x5615dbc82c90 2024-09-13T16:03:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.248+0000 7f039d5c5740 1 -- 172.21.15.17:0/1004365822 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5615dbbfec90 con 0x5615dbc82c90 2024-09-13T16:03:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.249+0000 7f0381600640 1 -- 172.21.15.17:0/1004365822 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f038400da40 con 0x5615dbc82c90 2024-09-13T16:03:25.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.249+0000 7f039d5c5740 10 client.25796 fetch_fsmap learned FSMap version 35 2024-09-13T16:03:25.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.249+0000 7f039d5c5740 1 -- 172.21.15.17:0/1004365822 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x5615dbbd3170 con 0x5615dbc82c90 2024-09-13T16:03:25.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.250+0000 7f0381600640 1 -- 172.21.15.17:0/1004365822 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5615dbbfec90 con 0x5615dbc82c90 2024-09-13T16:03:25.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.250+0000 7f0381600640 1 -- 172.21.15.17:0/1004365822 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 35) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f03840056c0 con 0x5615dbc82c90 2024-09-13T16:03:25.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.250+0000 7f039d5c5740 10 client.25796 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T16:03:25.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.250+0000 7f039d5c5740 10 client.25796 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:03:25.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.250+0000 7f039d5c5740 20 client.25796 populate_metadata read hostname 'smithi017' 2024-09-13T16:03:25.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.250+0000 7f039d5c5740 1 --2- 172.21.15.17:0/1004365822 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5615dbc984b0 0x5615dbc9a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:25.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.250+0000 7f039d5c5740 4 client.25796 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:03:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.250+0000 7f039d5c5740 1 -- 172.21.15.17:0/1004365822 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5615dbbc77d0 con 0x5615dbc984b0 2024-09-13T16:03:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.251+0000 7f038aa00640 1 --2- 172.21.15.17:0/1004365822 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5615dbc984b0 0x5615dbc9a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.251+0000 7f038aa00640 1 --2- 172.21.15.17:0/1004365822 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5615dbc984b0 0x5615dbc9a8d0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55cdb91d1332b7fe server_cookie=ec1816cc92a500ec in_seq=0 out_seq=0 2024-09-13T16:03:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.251+0000 7f0381600640 10 client.25796 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:03:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.252+0000 7f0381600640 1 -- 172.21.15.17:0/1004365822 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5615dbbc77d0 con 0x5615dbc984b0 2024-09-13T16:03:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.252+0000 7f0381600640 10 client.25796 handle_command_reply: tid=0 2024-09-13T16:03:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.252+0000 7f039d5c5740 1 client.25796 shutdown 2024-09-13T16:03:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.252+0000 7f039d5c5740 1 -- 172.21.15.17:0/1004365822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc82c90 msgr2=0x5615dbc8c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.252+0000 7f039d5c5740 1 --2- 172.21.15.17:0/1004365822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc82c90 0x5615dbc8c980 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x5615dbc6e170 tx=0x7f0384018fd0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.252+0000 7f039d5c5740 1 -- 172.21.15.17:0/1004365822 shutdown_connections 2024-09-13T16:03:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.252+0000 7f039d5c5740 1 --2- 172.21.15.17:0/1004365822 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5615dbc984b0 0x5615dbc9a8d0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.252+0000 7f039d5c5740 1 --2- 172.21.15.17:0/1004365822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5615dbc88660 0x5615dbc93f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.252+0000 7f039d5c5740 1 --2- 172.21.15.17:0/1004365822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5615dbc835d0 0x5615dbc8cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.252+0000 7f039d5c5740 1 --2- 172.21.15.17:0/1004365822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc82c90 0x5615dbc8c980 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.252+0000 7f039d5c5740 1 -- 172.21.15.17:0/1004365822 >> 172.21.15.17:0/1004365822 conn(0x5615dbc6d2f0 msgr2=0x5615dbc6eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.252+0000 7f0381600640 0 client.25796 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:03:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.253+0000 7f039d5c5740 1 -- 172.21.15.17:0/1004365822 shutdown_connections 2024-09-13T16:03:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.253+0000 7f039d5c5740 1 -- 172.21.15.17:0/1004365822 wait complete. 2024-09-13T16:03:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.253+0000 7f039d5c5740 20 client.25796 trim_cache size 0 max 16384 2024-09-13T16:03:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.273+0000 7f039d5c5740 1 Processor -- start 2024-09-13T16:03:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.273+0000 7f039d5c5740 1 -- start start 2024-09-13T16:03:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.273+0000 7f039d5c5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5615dbc82c90 0x5615dbc844f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.273+0000 7f039d5c5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5615dbc835d0 0x5615dbc93ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.274+0000 7f039d5c5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc88660 0x5615dbc84a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.274+0000 7f039d5c5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615db93be60 con 0x5615dbc835d0 2024-09-13T16:03:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.274+0000 7f039d5c5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615dbbc77d0 con 0x5615dbc88660 2024-09-13T16:03:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.274+0000 7f039d5c5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615dbbfec90 con 0x5615dbc82c90 2024-09-13T16:03:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.274+0000 7f0399000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc88660 0x5615dbc84a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.274+0000 7f0399000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc88660 0x5615dbc84a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:40370/0 (socket says 172.21.15.17:40370) 2024-09-13T16:03:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.274+0000 7f0399000640 1 -- 172.21.15.17:0/2148251285 learned_addr learned my addr 172.21.15.17:0/2148251285 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:03:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.274+0000 7f038aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5615dbc835d0 0x5615dbc93ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.274+0000 7f0393400640 1 --2- 172.21.15.17:0/2148251285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5615dbc82c90 0x5615dbc844f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.275+0000 7f0393400640 1 -- 172.21.15.17:0/2148251285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc88660 msgr2=0x5615dbc84a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.275+0000 7f0393400640 1 --2- 172.21.15.17:0/2148251285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc88660 0x5615dbc84a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.275+0000 7f0393400640 1 -- 172.21.15.17:0/2148251285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5615dbc835d0 msgr2=0x5615dbc93ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.275+0000 7f0393400640 1 --2- 172.21.15.17:0/2148251285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5615dbc835d0 0x5615dbc93ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.275+0000 7f0393400640 1 -- 172.21.15.17:0/2148251285 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615dbb75180 con 0x5615dbc82c90 2024-09-13T16:03:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.275+0000 7f0393400640 1 --2- 172.21.15.17:0/2148251285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5615dbc82c90 0x5615dbc844f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f03840324d0 tx=0x7f03840021d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e04cd4cea71ee767 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.275+0000 7f0389600640 1 -- 172.21.15.17:0/2148251285 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384013070 con 0x5615dbc82c90 2024-09-13T16:03:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.275+0000 7f0389600640 1 -- 172.21.15.17:0/2148251285 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f038402e070 con 0x5615dbc82c90 2024-09-13T16:03:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.275+0000 7f0389600640 1 -- 172.21.15.17:0/2148251285 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384003d90 con 0x5615dbc82c90 2024-09-13T16:03:25.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.276+0000 7f039d5c5740 1 -- 172.21.15.17:0/2148251285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5615dbc82c90 msgr2=0x5615dbc844f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.276+0000 7f039d5c5740 1 --2- 172.21.15.17:0/2148251285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5615dbc82c90 0x5615dbc844f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f03840324d0 tx=0x7f03840021d0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.276+0000 7f039d5c5740 1 -- 172.21.15.17:0/2148251285 shutdown_connections 2024-09-13T16:03:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.276+0000 7f039d5c5740 1 --2- 172.21.15.17:0/2148251285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc88660 0x5615dbc84a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.276+0000 7f039d5c5740 1 --2- 172.21.15.17:0/2148251285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5615dbc835d0 0x5615dbc93ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.276+0000 7f039d5c5740 1 --2- 172.21.15.17:0/2148251285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5615dbc82c90 0x5615dbc844f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.276+0000 7f039d5c5740 1 -- 172.21.15.17:0/2148251285 >> 172.21.15.17:0/2148251285 conn(0x5615dbc6d2f0 msgr2=0x5615dbc6d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.276+0000 7f039d5c5740 1 -- 172.21.15.17:0/2148251285 shutdown_connections 2024-09-13T16:03:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.276+0000 7f039d5c5740 1 -- 172.21.15.17:0/2148251285 wait complete. 2024-09-13T16:03:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.277+0000 7f039d5c5740 1 -- start start 2024-09-13T16:03:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.277+0000 7f039d5c5740 1 Processor -- start 2024-09-13T16:03:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.277+0000 7f039d5c5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5615dbc82c90 0x5615dbc93730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.277+0000 7f039d5c5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc835d0 0x5615dbc93c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.277+0000 7f039d5c5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5615dbc88660 0x5615dbc901d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.278+0000 7f039d5c5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615dbc907e0 con 0x5615dbc88660 2024-09-13T16:03:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.278+0000 7f039d5c5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615dbc90950 con 0x5615dbc835d0 2024-09-13T16:03:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.278+0000 7f039d5c5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615dbc90b10 con 0x5615dbc82c90 2024-09-13T16:03:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.278+0000 7f039d5c5740 10 client.0 _ll_register_callbacks cb 0x7f0384009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:03:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.278+0000 7f038aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc835d0 0x5615dbc93c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:25.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.278+0000 7f038aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc835d0 0x5615dbc93c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:40380/0 (socket says 172.21.15.17:40380) 2024-09-13T16:03:25.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.278+0000 7f038aa00640 1 -- 172.21.15.17:0/1819151679 learned_addr learned my addr 172.21.15.17:0/1819151679 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:03:25.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.278+0000 7f0393400640 1 --2- 172.21.15.17:0/1819151679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5615dbc82c90 0x5615dbc93730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.278+0000 7f038aa00640 1 -- 172.21.15.17:0/1819151679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5615dbc82c90 msgr2=0x5615dbc93730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.279+0000 7f038aa00640 1 --2- 172.21.15.17:0/1819151679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5615dbc82c90 0x5615dbc93730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.279+0000 7f038aa00640 1 -- 172.21.15.17:0/1819151679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5615dbc88660 msgr2=0x5615dbc901d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:03:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.279+0000 7f038aa00640 1 --2- 172.21.15.17:0/1819151679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5615dbc88660 0x5615dbc901d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.279+0000 7f038aa00640 1 -- 172.21.15.17:0/1819151679 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5615dbbd3170 con 0x5615dbc835d0 2024-09-13T16:03:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.279+0000 7f038aa00640 1 --2- 172.21.15.17:0/1819151679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc835d0 0x5615dbc93c70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f037c00e9c0 tx=0x7f037c010df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50a238e95205494e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.279+0000 7f0381600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:03:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.279+0000 7f0381600640 1 -- 172.21.15.17:0/1819151679 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c09afc0 con 0x5615dbc835d0 2024-09-13T16:03:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.279+0000 7f0381600640 1 -- 172.21.15.17:0/1819151679 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f037c0a2530 con 0x5615dbc835d0 2024-09-13T16:03:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.279+0000 7f039d5c5740 1 -- 172.21.15.17:0/1819151679 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f038400dbc0 con 0x5615dbc835d0 2024-09-13T16:03:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.280+0000 7f0381600640 1 -- 172.21.15.17:0/1819151679 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f037c0a20a0 con 0x5615dbc835d0 2024-09-13T16:03:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.281+0000 7f039d5c5740 10 client.25802 fetch_fsmap learned FSMap version 35 2024-09-13T16:03:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.281+0000 7f039d5c5740 1 -- 172.21.15.17:0/1819151679 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x5615dbb9a560 con 0x5615dbc835d0 2024-09-13T16:03:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.281+0000 7f0381600640 1 -- 172.21.15.17:0/1819151679 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f038400dbc0 con 0x5615dbc835d0 2024-09-13T16:03:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.281+0000 7f0381600640 1 -- 172.21.15.17:0/1819151679 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 35) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f037c099f20 con 0x5615dbc835d0 2024-09-13T16:03:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.281+0000 7f039d5c5740 10 client.25802 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T16:03:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.281+0000 7f039d5c5740 10 client.25802 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:03:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.281+0000 7f039d5c5740 20 client.25802 populate_metadata read hostname 'smithi017' 2024-09-13T16:03:25.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.281+0000 7f039d5c5740 1 --2- 172.21.15.17:0/1819151679 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5615dbceff70 0x5615dbcf2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:25.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.281+0000 7f039d5c5740 4 client.25802 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:03:25.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.281+0000 7f039d5c5740 1 -- 172.21.15.17:0/1819151679 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5615db8c8300 con 0x5615dbceff70 2024-09-13T16:03:25.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.282+0000 7f0393400640 1 --2- 172.21.15.17:0/1819151679 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5615dbceff70 0x5615dbcf2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:25.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.282+0000 7f0393400640 1 --2- 172.21.15.17:0/1819151679 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5615dbceff70 0x5615dbcf2390 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47579f2775c687b2 server_cookie=12434a61b683b911 in_seq=0 out_seq=0 2024-09-13T16:03:25.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.282+0000 7f0381600640 10 client.25802 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:03:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.290+0000 7f0381600640 1 -- 172.21.15.17:0/1819151679 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5615db8c8300 con 0x5615dbceff70 2024-09-13T16:03:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.290+0000 7f0381600640 10 client.25802 handle_command_reply: tid=0 2024-09-13T16:03:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.290+0000 7f039d5c5740 1 client.25802 shutdown 2024-09-13T16:03:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.291+0000 7f039d5c5740 1 -- 172.21.15.17:0/1819151679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc835d0 msgr2=0x5615dbc93c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.291+0000 7f039d5c5740 1 --2- 172.21.15.17:0/1819151679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc835d0 0x5615dbc93c70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f037c00e9c0 tx=0x7f037c010df0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.291+0000 7f039d5c5740 1 -- 172.21.15.17:0/1819151679 shutdown_connections 2024-09-13T16:03:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.291+0000 7f039d5c5740 1 --2- 172.21.15.17:0/1819151679 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5615dbceff70 0x5615dbcf2390 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.291+0000 7f039d5c5740 1 --2- 172.21.15.17:0/1819151679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5615dbc88660 0x5615dbc901d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.291+0000 7f039d5c5740 1 --2- 172.21.15.17:0/1819151679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5615dbc835d0 0x5615dbc93c70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.291+0000 7f0381600640 0 client.25802 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:03:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.291+0000 7f039d5c5740 1 --2- 172.21.15.17:0/1819151679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5615dbc82c90 0x5615dbc93730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.291+0000 7f039d5c5740 1 -- 172.21.15.17:0/1819151679 >> 172.21.15.17:0/1819151679 conn(0x5615dbc6d2f0 msgr2=0x5615dbc8c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.292+0000 7f039d5c5740 1 -- 172.21.15.17:0/1819151679 shutdown_connections 2024-09-13T16:03:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.292+0000 7f039d5c5740 1 -- 172.21.15.17:0/1819151679 wait complete. 2024-09-13T16:03:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.293+0000 7f039d5c5740 20 client.25802 trim_cache size 0 max 16384 2024-09-13T16:03:25.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:03:25.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:03:25.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:03:25.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:03:25.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.294+0000 7f039a600640 1 -- 172.21.15.17:0/1613784228 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f03780a11e0 msgr2=0x7f03780a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:25.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.294+0000 7f039a600640 1 --2- 172.21.15.17:0/1613784228 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f03780a11e0 0x7f03780a36a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f038c009830 tx=0x7f038c0303c0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.294+0000 7f039a600640 1 -- 172.21.15.17:0/1613784228 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0394074490 msgr2=0x7f03941982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:25.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.294+0000 7f039a600640 1 --2- 172.21.15.17:0/1613784228 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0394074490 0x7f03941982e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f037c00e9f0 tx=0x7f037c00eeb0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.295+0000 7f039a600640 1 -- 172.21.15.17:0/1613784228 shutdown_connections 2024-09-13T16:03:25.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.295+0000 7f039a600640 1 --2- 172.21.15.17:0/1613784228 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f03780a11e0 0x7f03780a36a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.295+0000 7f039a600640 1 --2- 172.21.15.17:0/1613784228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0394107a20 0x7f039419f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.295+0000 7f039a600640 1 --2- 172.21.15.17:0/1613784228 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0394074490 0x7f03941982e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.295+0000 7f039a600640 1 --2- 172.21.15.17:0/1613784228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0394072eb0 0x7f0394197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:25.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.295+0000 7f039a600640 1 -- 172.21.15.17:0/1613784228 >> 172.21.15.17:0/1613784228 conn(0x7f03940fb2f0 msgr2=0x7f03941039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:25.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.295+0000 7f039a600640 1 -- 172.21.15.17:0/1613784228 shutdown_connections 2024-09-13T16:03:25.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:25.295+0000 7f039a600640 1 -- 172.21.15.17:0/1613784228 wait complete. 2024-09-13T16:03:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 340.0 s, 767.8 tps, lat 129.180 ms stddev 185.149 2024-09-13T16:03:26.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:26 smithi193 ceph-mon[35248]: pgmap v556: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 614 op/s 2024-09-13T16:03:26.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:26 smithi017 ceph-mon[30494]: pgmap v556: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 614 op/s 2024-09-13T16:03:26.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:26 smithi189 ceph-mon[34790]: pgmap v556: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 614 op/s 2024-09-13T16:03:28.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:28 smithi193 ceph-mon[35248]: pgmap v557: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 11 MiB/s wr, 565 op/s 2024-09-13T16:03:28.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:28 smithi017 ceph-mon[30494]: pgmap v557: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 11 MiB/s wr, 565 op/s 2024-09-13T16:03:28.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:28 smithi189 ceph-mon[34790]: pgmap v557: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 11 MiB/s wr, 565 op/s 2024-09-13T16:03:30.316 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 345.0 s, 667.4 tps, lat 150.519 ms stddev 216.280 2024-09-13T16:03:30.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:30 smithi193 ceph-mon[35248]: pgmap v558: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 631 op/s 2024-09-13T16:03:30.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:30 smithi017 ceph-mon[30494]: pgmap v558: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 631 op/s 2024-09-13T16:03:30.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:30 smithi189 ceph-mon[34790]: pgmap v558: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 631 op/s 2024-09-13T16:03:32.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:32 smithi193 ceph-mon[35248]: pgmap v559: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 11 MiB/s wr, 586 op/s 2024-09-13T16:03:32.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:32 smithi017 ceph-mon[30494]: pgmap v559: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 11 MiB/s wr, 586 op/s 2024-09-13T16:03:32.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:32 smithi189 ceph-mon[34790]: pgmap v559: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 11 MiB/s wr, 586 op/s 2024-09-13T16:03:34.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:34 smithi193 ceph-mon[35248]: pgmap v560: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 9.7 MiB/s wr, 548 op/s 2024-09-13T16:03:34.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:34 smithi017 ceph-mon[30494]: pgmap v560: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 9.7 MiB/s wr, 548 op/s 2024-09-13T16:03:34.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:34 smithi189 ceph-mon[34790]: pgmap v560: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 9.7 MiB/s wr, 548 op/s 2024-09-13T16:03:35.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 350.0 s, 901.8 tps, lat 112.393 ms stddev 123.099 2024-09-13T16:03:36.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:36 smithi193 ceph-mon[35248]: pgmap v561: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 572 op/s 2024-09-13T16:03:36.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:36 smithi017 ceph-mon[30494]: pgmap v561: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 572 op/s 2024-09-13T16:03:36.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:36 smithi189 ceph-mon[34790]: pgmap v561: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 572 op/s 2024-09-13T16:03:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.498+0000 7f2770a00640 1 -- 172.21.15.17:0/3565333590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c102f60 msgr2=0x7f276c1033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.498+0000 7f2770a00640 1 --2- 172.21.15.17:0/3565333590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c102f60 0x7f276c1033e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2758009900 tx=0x7f275802a410 comp rx=0 tx=0).stop 2024-09-13T16:03:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.499+0000 7f2770a00640 1 -- 172.21.15.17:0/3565333590 shutdown_connections 2024-09-13T16:03:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.499+0000 7f2770a00640 1 --2- 172.21.15.17:0/3565333590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f276c103920 0x7f276c10a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.499+0000 7f2770a00640 1 --2- 172.21.15.17:0/3565333590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c102f60 0x7f276c1033e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.499+0000 7f2770a00640 1 --2- 172.21.15.17:0/3565333590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f276c101d70 0x7f276c102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.499+0000 7f2770a00640 1 -- 172.21.15.17:0/3565333590 >> 172.21.15.17:0/3565333590 conn(0x7f276c0fd510 msgr2=0x7f276c0ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.499+0000 7f2770a00640 1 -- 172.21.15.17:0/3565333590 shutdown_connections 2024-09-13T16:03:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.499+0000 7f2770a00640 1 -- 172.21.15.17:0/3565333590 wait complete. 2024-09-13T16:03:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.501+0000 7f2770a00640 1 Processor -- start 2024-09-13T16:03:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.501+0000 7f2770a00640 1 -- start start 2024-09-13T16:03:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.502+0000 7f2770a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c101d70 0x7f276c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.502+0000 7f2770a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f276c102f60 0x7f276c06f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.502+0000 7f2770a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f276c103920 0x7f276c1ac780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.502+0000 7f2770a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c078910 con 0x7f276c103920 2024-09-13T16:03:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.502+0000 7f2770a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c078a80 con 0x7f276c101d70 2024-09-13T16:03:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.502+0000 7f2770a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c0722a0 con 0x7f276c102f60 2024-09-13T16:03:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.503+0000 7f276a800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c101d70 0x7f276c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.503+0000 7f276a800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c101d70 0x7f276c06ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:54734/0 (socket says 172.21.15.17:54734) 2024-09-13T16:03:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.503+0000 7f276a800640 1 -- 172.21.15.17:0/1488347804 learned_addr learned my addr 172.21.15.17:0/1488347804 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:03:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.503+0000 7f2769e00640 1 --2- 172.21.15.17:0/1488347804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f276c102f60 0x7f276c06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.503+0000 7f276b200640 1 --2- 172.21.15.17:0/1488347804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f276c103920 0x7f276c1ac780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.503+0000 7f276a800640 1 -- 172.21.15.17:0/1488347804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f276c102f60 msgr2=0x7f276c06f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.503+0000 7f276a800640 1 --2- 172.21.15.17:0/1488347804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f276c102f60 0x7f276c06f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.503+0000 7f276a800640 1 -- 172.21.15.17:0/1488347804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f276c103920 msgr2=0x7f276c1ac780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.503+0000 7f276a800640 1 --2- 172.21.15.17:0/1488347804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f276c103920 0x7f276c1ac780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.503+0000 7f276a800640 1 -- 172.21.15.17:0/1488347804 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2758009560 con 0x7f276c101d70 2024-09-13T16:03:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.504+0000 7f276a800640 1 --2- 172.21.15.17:0/1488347804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c101d70 0x7f276c06ed10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f275c00b470 tx=0x7f275c00b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.509+0000 7f2763400640 1 -- 172.21.15.17:0/1488347804 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c011890 con 0x7f276c101d70 2024-09-13T16:03:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.509+0000 7f2763400640 1 -- 172.21.15.17:0/1488347804 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f275c0103e0 con 0x7f276c101d70 2024-09-13T16:03:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.509+0000 7f2763400640 1 -- 172.21.15.17:0/1488347804 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c00f5a0 con 0x7f276c101d70 2024-09-13T16:03:38.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.510+0000 7f2770a00640 1 -- 172.21.15.17:0/1488347804 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276c1accc0 con 0x7f276c101d70 2024-09-13T16:03:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.513+0000 7f2770a00640 1 -- 172.21.15.17:0/1488347804 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276c1ad030 con 0x7f276c101d70 2024-09-13T16:03:38.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.519+0000 7f277425e740 1 Processor -- start 2024-09-13T16:03:38.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.519+0000 7f277425e740 1 -- start start 2024-09-13T16:03:38.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.520+0000 7f2763400640 1 -- 172.21.15.17:0/1488347804 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f275c010850 con 0x7f276c101d70 2024-09-13T16:03:38.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.525+0000 7f277425e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4a9c80 0x55d4aa4aa080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.525+0000 7f277425e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4aa4aa5c0 0x55d4aa4af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.525+0000 7f277425e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4af650 0x55d4aa4b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.526+0000 7f277425e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4aa3b5bb0 con 0x55d4aa4aa5c0 2024-09-13T16:03:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.526+0000 7f277425e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4aa413a70 con 0x55d4aa4a9c80 2024-09-13T16:03:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.526+0000 7f277425e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4aa411200 con 0x55d4aa4af650 2024-09-13T16:03:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.526+0000 7f276b200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4a9c80 0x55d4aa4aa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.526+0000 7f276b200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4a9c80 0x55d4aa4aa080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:54736/0 (socket says 172.21.15.17:54736) 2024-09-13T16:03:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.526+0000 7f276b200640 1 -- 172.21.15.17:0/3877541450 learned_addr learned my addr 172.21.15.17:0/3877541450 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:03:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.526+0000 7f2769e00640 1 --2- 172.21.15.17:0/3877541450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4af650 0x55d4aa4b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.527+0000 7f276a800640 1 --2- 172.21.15.17:0/3877541450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4aa4aa5c0 0x55d4aa4af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.527+0000 7f2763400640 1 --2- 172.21.15.17:0/1488347804 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f27500a1230 0x7f27500a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.527+0000 7f276b200640 1 -- 172.21.15.17:0/3877541450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4af650 msgr2=0x55d4aa4b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.527+0000 7f276b200640 1 --2- 172.21.15.17:0/3877541450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4af650 0x55d4aa4b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.527+0000 7f276b200640 1 -- 172.21.15.17:0/3877541450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4aa4aa5c0 msgr2=0x55d4aa4af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.527+0000 7f276b200640 1 --2- 172.21.15.17:0/3877541450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4aa4aa5c0 0x55d4aa4af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.527+0000 7f276b200640 1 -- 172.21.15.17:0/3877541450 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4aa3ae940 con 0x55d4aa4a9c80 2024-09-13T16:03:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.527+0000 7f276a800640 1 --2- 172.21.15.17:0/3877541450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4aa4aa5c0 0x55d4aa4af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:03:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.527+0000 7f2763400640 1 -- 172.21.15.17:0/1488347804 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f275c0cf170 con 0x7f276c101d70 2024-09-13T16:03:38.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.529+0000 7f276b200640 1 --2- 172.21.15.17:0/1488347804 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f27500a1230 0x7f27500a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:38.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.529+0000 7f276b200640 1 --2- 172.21.15.17:0/3877541450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4a9c80 0x55d4aa4aa080 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f276400f390 tx=0x7f276400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c0557855554fb7c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:38.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.530+0000 7f2757e00640 1 -- 172.21.15.17:0/3877541450 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2764011ae0 con 0x55d4aa4a9c80 2024-09-13T16:03:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.531+0000 7f2757e00640 1 -- 172.21.15.17:0/3877541450 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2764015070 con 0x55d4aa4a9c80 2024-09-13T16:03:38.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.531+0000 7f2757e00640 1 -- 172.21.15.17:0/3877541450 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276401a370 con 0x55d4aa4a9c80 2024-09-13T16:03:38.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.531+0000 7f276b200640 1 --2- 172.21.15.17:0/1488347804 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f27500a1230 0x7f27500a36f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f276401e000 tx=0x7f2764021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:38.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.532+0000 7f277425e740 1 -- 172.21.15.17:0/3877541450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4a9c80 msgr2=0x55d4aa4aa080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:38.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.532+0000 7f277425e740 1 --2- 172.21.15.17:0/3877541450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4a9c80 0x55d4aa4aa080 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f276400f390 tx=0x7f276400f790 comp rx=0 tx=0).stop 2024-09-13T16:03:38.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.534+0000 7f277425e740 1 -- 172.21.15.17:0/3877541450 shutdown_connections 2024-09-13T16:03:38.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.534+0000 7f277425e740 1 --2- 172.21.15.17:0/3877541450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4af650 0x55d4aa4b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.534+0000 7f277425e740 1 --2- 172.21.15.17:0/3877541450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4aa4aa5c0 0x55d4aa4af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.534+0000 7f277425e740 1 --2- 172.21.15.17:0/3877541450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4a9c80 0x55d4aa4aa080 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.534+0000 7f277425e740 1 -- 172.21.15.17:0/3877541450 >> 172.21.15.17:0/3877541450 conn(0x55d4aa4a52f0 msgr2=0x55d4aa4a56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.535+0000 7f277425e740 1 -- 172.21.15.17:0/3877541450 shutdown_connections 2024-09-13T16:03:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.536+0000 7f277425e740 1 -- 172.21.15.17:0/3877541450 wait complete. 2024-09-13T16:03:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.537+0000 7f277425e740 1 -- start start 2024-09-13T16:03:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.538+0000 7f277425e740 1 Processor -- start 2024-09-13T16:03:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.539+0000 7f277425e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4a9c80 0x55d4aa4b3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.540+0000 7f277425e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4aa5c0 0x55d4aa4b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.540+0000 7f276a800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4a9c80 0x55d4aa4b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.540+0000 7f276a800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4a9c80 0x55d4aa4b3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:54740/0 (socket says 172.21.15.17:54740) 2024-09-13T16:03:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.540+0000 7f276a800640 1 -- 172.21.15.17:0/3451014267 learned_addr learned my addr 172.21.15.17:0/3451014267 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:03:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.540+0000 7f277425e740 1 --2- 172.21.15.17:0/3451014267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4aa4af650 0x55d4aa4bae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.541+0000 7f276b200640 1 --2- 172.21.15.17:0/3451014267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4aa4af650 0x55d4aa4bae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.542+0000 7f277425e740 1 -- 172.21.15.17:0/3451014267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4aa40caf0 con 0x55d4aa4af650 2024-09-13T16:03:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.542+0000 7f277425e740 1 -- 172.21.15.17:0/3451014267 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4aa3caf20 con 0x55d4aa4a9c80 2024-09-13T16:03:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.542+0000 7f2769e00640 1 --2- 172.21.15.17:0/3451014267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4aa5c0 0x55d4aa4b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.542+0000 7f277425e740 1 -- 172.21.15.17:0/3451014267 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4aa3cabc0 con 0x55d4aa4aa5c0 2024-09-13T16:03:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.544+0000 7f277425e740 10 client.0 _ll_register_callbacks cb 0x55d4aa3fca70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:03:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.544+0000 7f2769e00640 1 -- 172.21.15.17:0/3451014267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4a9c80 msgr2=0x55d4aa4b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.544+0000 7f2769e00640 1 --2- 172.21.15.17:0/3451014267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4a9c80 0x55d4aa4b3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.544+0000 7f2769e00640 1 -- 172.21.15.17:0/3451014267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4aa4af650 msgr2=0x55d4aa4bae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.544+0000 7f2769e00640 1 --2- 172.21.15.17:0/3451014267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4aa4af650 0x55d4aa4bae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.544+0000 7f2769e00640 1 -- 172.21.15.17:0/3451014267 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2764009c50 con 0x55d4aa4aa5c0 2024-09-13T16:03:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.544+0000 7f277425e740 1 -- 172.21.15.17:0/3451014267 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4aa436c90 con 0x55d4aa4aa5c0 2024-09-13T16:03:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.544+0000 7f2769e00640 1 --2- 172.21.15.17:0/3451014267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4aa5c0 0x55d4aa4b3e40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f275802a930 tx=0x7f2758003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eee2010733dea831 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.544+0000 7f2754c00640 10 client.25828 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:03:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.545+0000 7f2754c00640 1 -- 172.21.15.17:0/3451014267 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2758003e20 con 0x55d4aa4aa5c0 2024-09-13T16:03:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.545+0000 7f2754c00640 1 -- 172.21.15.17:0/3451014267 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f27580315a0 con 0x55d4aa4aa5c0 2024-09-13T16:03:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.546+0000 7f2754c00640 1 -- 172.21.15.17:0/3451014267 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2758031760 con 0x55d4aa4aa5c0 2024-09-13T16:03:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.546+0000 7f277425e740 10 client.25828 fetch_fsmap learned FSMap version 36 2024-09-13T16:03:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.546+0000 7f277425e740 1 -- 172.21.15.17:0/3451014267 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=36}) v3 -- 0x55d4aa40b170 con 0x55d4aa4aa5c0 2024-09-13T16:03:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.547+0000 7f2754c00640 1 -- 172.21.15.17:0/3451014267 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 36) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f27580318c0 con 0x55d4aa4aa5c0 2024-09-13T16:03:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.548+0000 7f277425e740 10 client.25828 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T16:03:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.548+0000 7f277425e740 10 client.25828 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:03:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.548+0000 7f277425e740 20 client.25828 populate_metadata read hostname 'smithi017' 2024-09-13T16:03:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.548+0000 7f277425e740 1 --2- 172.21.15.17:0/3451014267 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55d4aa4bf400 0x55d4aa4c17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.548+0000 7f277425e740 4 client.25828 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:03:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.548+0000 7f277425e740 1 -- 172.21.15.17:0/3451014267 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d4aa3ff7d0 con 0x55d4aa4bf400 2024-09-13T16:03:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.548+0000 7f276a800640 1 --2- 172.21.15.17:0/3451014267 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55d4aa4bf400 0x55d4aa4c17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:38.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.551+0000 7f2754c00640 10 client.25828 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:03:38.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.551+0000 7f276a800640 1 --2- 172.21.15.17:0/3451014267 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55d4aa4bf400 0x55d4aa4c17f0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee1105260691b551 server_cookie=2ade91b848e7f675 in_seq=0 out_seq=0 2024-09-13T16:03:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.551+0000 7f2754c00640 1 -- 172.21.15.17:0/3451014267 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d4aa3ff7d0 con 0x55d4aa4bf400 2024-09-13T16:03:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.551+0000 7f2754c00640 10 client.25828 handle_command_reply: tid=0 2024-09-13T16:03:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.552+0000 7f277425e740 1 client.25828 shutdown 2024-09-13T16:03:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.552+0000 7f277425e740 1 -- 172.21.15.17:0/3451014267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4aa5c0 msgr2=0x55d4aa4b3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.552+0000 7f277425e740 1 --2- 172.21.15.17:0/3451014267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4aa5c0 0x55d4aa4b3e40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f275802a930 tx=0x7f2758003820 comp rx=0 tx=0).stop 2024-09-13T16:03:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.552+0000 7f277425e740 1 -- 172.21.15.17:0/3451014267 shutdown_connections 2024-09-13T16:03:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.552+0000 7f277425e740 1 --2- 172.21.15.17:0/3451014267 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55d4aa4bf400 0x55d4aa4c17f0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.552+0000 7f277425e740 1 --2- 172.21.15.17:0/3451014267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4aa4af650 0x55d4aa4bae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.552+0000 7f277425e740 1 --2- 172.21.15.17:0/3451014267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4aa5c0 0x55d4aa4b3e40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.552+0000 7f277425e740 1 --2- 172.21.15.17:0/3451014267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4a9c80 0x55d4aa4b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.552+0000 7f2754c00640 0 client.25828 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:03:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.552+0000 7f277425e740 1 -- 172.21.15.17:0/3451014267 >> 172.21.15.17:0/3451014267 conn(0x55d4aa4a52f0 msgr2=0x55d4aa4a6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.553+0000 7f277425e740 1 -- 172.21.15.17:0/3451014267 shutdown_connections 2024-09-13T16:03:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.553+0000 7f277425e740 1 -- 172.21.15.17:0/3451014267 wait complete. 2024-09-13T16:03:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.553+0000 7f277425e740 20 client.25828 trim_cache size 0 max 16384 2024-09-13T16:03:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.583+0000 7f277425e740 1 Processor -- start 2024-09-13T16:03:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.584+0000 7f277425e740 1 -- start start 2024-09-13T16:03:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.584+0000 7f277425e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4a9c80 0x55d4aa4b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.584+0000 7f277425e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4aa5c0 0x55d4aa4bae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.584+0000 7f277425e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4aa4af650 0x55d4aa4b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.584+0000 7f277425e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4aa4a51b0 con 0x55d4aa4af650 2024-09-13T16:03:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.584+0000 7f277425e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4aa173e60 con 0x55d4aa4a9c80 2024-09-13T16:03:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.584+0000 7f277425e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4aa4b4800 con 0x55d4aa4aa5c0 2024-09-13T16:03:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.585+0000 7f2769e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4aa5c0 0x55d4aa4bae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.585+0000 7f2769e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4aa5c0 0x55d4aa4bae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:49684/0 (socket says 172.21.15.17:49684) 2024-09-13T16:03:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.585+0000 7f2769e00640 1 -- 172.21.15.17:0/2509341499 learned_addr learned my addr 172.21.15.17:0/2509341499 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:03:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.585+0000 7f276a800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4a9c80 0x55d4aa4b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.586+0000 7f2769e00640 1 -- 172.21.15.17:0/2509341499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4a9c80 msgr2=0x55d4aa4b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.586+0000 7f2769e00640 1 --2- 172.21.15.17:0/2509341499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4a9c80 0x55d4aa4b2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.586+0000 7f2769e00640 1 -- 172.21.15.17:0/2509341499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4aa4af650 msgr2=0x55d4aa4b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.586+0000 7f2769e00640 1 --2- 172.21.15.17:0/2509341499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4aa4af650 0x55d4aa4b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.586+0000 7f2769e00640 1 -- 172.21.15.17:0/2509341499 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4aa3ad180 con 0x55d4aa4aa5c0 2024-09-13T16:03:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.586+0000 7f276a800640 1 --2- 172.21.15.17:0/2509341499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4a9c80 0x55d4aa4b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:03:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.587+0000 7f2769e00640 1 --2- 172.21.15.17:0/2509341499 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4aa5c0 0x55d4aa4bae40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2758031500 tx=0x7f2758040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae0eb1dfd547ca7b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.588+0000 7f2760c00640 1 -- 172.21.15.17:0/2509341499 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2758003e20 con 0x55d4aa4aa5c0 2024-09-13T16:03:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.588+0000 7f2760c00640 1 -- 172.21.15.17:0/2509341499 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d4aa436c90 con 0x55d4aa4aa5c0 2024-09-13T16:03:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.588+0000 7f2760c00640 1 -- 172.21.15.17:0/2509341499 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27580317e0 con 0x55d4aa4aa5c0 2024-09-13T16:03:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.589+0000 7f277425e740 1 -- 172.21.15.17:0/2509341499 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4aa5c0 msgr2=0x55d4aa4bae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.589+0000 7f277425e740 1 --2- 172.21.15.17:0/2509341499 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4aa5c0 0x55d4aa4bae40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2758031500 tx=0x7f2758040000 comp rx=0 tx=0).stop 2024-09-13T16:03:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.590+0000 7f277425e740 1 -- 172.21.15.17:0/2509341499 shutdown_connections 2024-09-13T16:03:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.590+0000 7f277425e740 1 --2- 172.21.15.17:0/2509341499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4aa4af650 0x55d4aa4b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.590+0000 7f277425e740 1 --2- 172.21.15.17:0/2509341499 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4aa5c0 0x55d4aa4bae40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.590+0000 7f277425e740 1 --2- 172.21.15.17:0/2509341499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4a9c80 0x55d4aa4b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.591+0000 7f277425e740 1 -- 172.21.15.17:0/2509341499 >> 172.21.15.17:0/2509341499 conn(0x55d4aa4a52f0 msgr2=0x55d4aa4aea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.591+0000 7f277425e740 1 -- 172.21.15.17:0/2509341499 shutdown_connections 2024-09-13T16:03:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.591+0000 7f277425e740 1 -- 172.21.15.17:0/2509341499 wait complete. 2024-09-13T16:03:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.592+0000 7f277425e740 1 -- start start 2024-09-13T16:03:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.593+0000 7f277425e740 1 Processor -- start 2024-09-13T16:03:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.594+0000 7f277425e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4aa4a9c80 0x55d4aa4bab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.594+0000 7f277425e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4aa5c0 0x55d4aa4b7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.594+0000 7f277425e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4af650 0x55d4aa4b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.594+0000 7f277425e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4aa4b80c0 con 0x55d4aa4a9c80 2024-09-13T16:03:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.594+0000 7f277425e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4aa4b8230 con 0x55d4aa4af650 2024-09-13T16:03:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.594+0000 7f277425e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4aa515900 con 0x55d4aa4aa5c0 2024-09-13T16:03:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.594+0000 7f277425e740 10 client.0 _ll_register_callbacks cb 0x7f27640097b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:03:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.594+0000 7f276a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4aa4a9c80 0x55d4aa4bab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.594+0000 7f276b200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4af650 0x55d4aa4b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.594+0000 7f2769e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4aa5c0 0x55d4aa4b7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.595+0000 7f276b200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4af650 0x55d4aa4b7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:54758/0 (socket says 172.21.15.17:54758) 2024-09-13T16:03:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.595+0000 7f276b200640 1 -- 172.21.15.17:0/3350129027 learned_addr learned my addr 172.21.15.17:0/3350129027 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:03:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.595+0000 7f276b200640 1 -- 172.21.15.17:0/3350129027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4aa5c0 msgr2=0x55d4aa4b7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.595+0000 7f276b200640 1 --2- 172.21.15.17:0/3350129027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4aa5c0 0x55d4aa4b7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.595+0000 7f276b200640 1 -- 172.21.15.17:0/3350129027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4aa4a9c80 msgr2=0x55d4aa4bab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.595+0000 7f276b200640 1 --2- 172.21.15.17:0/3350129027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4aa4a9c80 0x55d4aa4bab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.595+0000 7f276b200640 1 -- 172.21.15.17:0/3350129027 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276c1ad030 con 0x55d4aa4af650 2024-09-13T16:03:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.595+0000 7f2769e00640 1 --2- 172.21.15.17:0/3350129027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4aa5c0 0x55d4aa4b7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:03:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.595+0000 7f276a800640 1 --2- 172.21.15.17:0/3350129027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4aa4a9c80 0x55d4aa4bab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:03:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.596+0000 7f276b200640 1 --2- 172.21.15.17:0/3350129027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4af650 0x55d4aa4b7b80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f276400f390 tx=0x7f2764009890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b40aa5217dae7f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.596+0000 7f2754c00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:03:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.596+0000 7f2754c00640 1 -- 172.21.15.17:0/3350129027 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276402b070 con 0x55d4aa4af650 2024-09-13T16:03:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.596+0000 7f2754c00640 1 -- 172.21.15.17:0/3350129027 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f2764010e40 con 0x55d4aa4af650 2024-09-13T16:03:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.596+0000 7f277425e740 1 -- 172.21.15.17:0/3350129027 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2764015070 con 0x55d4aa4af650 2024-09-13T16:03:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.597+0000 7f2754c00640 1 -- 172.21.15.17:0/3350129027 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2764011700 con 0x55d4aa4af650 2024-09-13T16:03:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.597+0000 7f277425e740 10 client.25820 fetch_fsmap learned FSMap version 36 2024-09-13T16:03:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.597+0000 7f277425e740 1 -- 172.21.15.17:0/3350129027 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55d4aa40b170 con 0x55d4aa4af650 2024-09-13T16:03:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.598+0000 7f2754c00640 1 -- 172.21.15.17:0/3350129027 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2764015070 con 0x55d4aa4af650 2024-09-13T16:03:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.598+0000 7f2754c00640 1 -- 172.21.15.17:0/3350129027 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 36) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f2764010600 con 0x55d4aa4af650 2024-09-13T16:03:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.598+0000 7f277425e740 10 client.25820 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T16:03:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.598+0000 7f277425e740 10 client.25820 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:03:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.598+0000 7f277425e740 20 client.25820 populate_metadata read hostname 'smithi017' 2024-09-13T16:03:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.598+0000 7f277425e740 1 --2- 172.21.15.17:0/3350129027 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55d4aa517370 0x55d4aa519790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.598+0000 7f277425e740 4 client.25820 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:03:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.598+0000 7f277425e740 1 -- 172.21.15.17:0/3350129027 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d4aa100300 con 0x55d4aa517370 2024-09-13T16:03:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.601+0000 7f276a800640 1 --2- 172.21.15.17:0/3350129027 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55d4aa517370 0x55d4aa519790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.602+0000 7f276a800640 1 --2- 172.21.15.17:0/3350129027 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55d4aa517370 0x55d4aa519790 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50d88dd0af2c094b server_cookie=cc35432dc8c9159b in_seq=0 out_seq=0 2024-09-13T16:03:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.602+0000 7f2754c00640 10 client.25820 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:03:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.618+0000 7f2754c00640 1 -- 172.21.15.17:0/3350129027 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d4aa100300 con 0x55d4aa517370 2024-09-13T16:03:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.619+0000 7f2754c00640 10 client.25820 handle_command_reply: tid=0 2024-09-13T16:03:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.619+0000 7f277425e740 1 client.25820 shutdown 2024-09-13T16:03:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.619+0000 7f277425e740 1 -- 172.21.15.17:0/3350129027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4af650 msgr2=0x55d4aa4b7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.619+0000 7f277425e740 1 --2- 172.21.15.17:0/3350129027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4af650 0x55d4aa4b7b80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f276400f390 tx=0x7f2764009890 comp rx=0 tx=0).stop 2024-09-13T16:03:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.619+0000 7f277425e740 1 -- 172.21.15.17:0/3350129027 shutdown_connections 2024-09-13T16:03:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.619+0000 7f277425e740 1 --2- 172.21.15.17:0/3350129027 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55d4aa517370 0x55d4aa519790 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.619+0000 7f277425e740 1 --2- 172.21.15.17:0/3350129027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4aa4af650 0x55d4aa4b7b80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.619+0000 7f277425e740 1 --2- 172.21.15.17:0/3350129027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d4aa4aa5c0 0x55d4aa4b7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.619+0000 7f277425e740 1 --2- 172.21.15.17:0/3350129027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4aa4a9c80 0x55d4aa4bab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.619+0000 7f277425e740 1 -- 172.21.15.17:0/3350129027 >> 172.21.15.17:0/3350129027 conn(0x55d4aa4a52f0 msgr2=0x55d4aa4b38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.619+0000 7f2754c00640 0 client.25820 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:03:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.620+0000 7f277425e740 1 -- 172.21.15.17:0/3350129027 shutdown_connections 2024-09-13T16:03:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.620+0000 7f277425e740 1 -- 172.21.15.17:0/3350129027 wait complete. 2024-09-13T16:03:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.620+0000 7f277425e740 20 client.25820 trim_cache size 0 max 16384 2024-09-13T16:03:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:03:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:03:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:03:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:03:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.621+0000 7f2770a00640 1 -- 172.21.15.17:0/1488347804 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f27500a1230 msgr2=0x7f27500a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.621+0000 7f2770a00640 1 --2- 172.21.15.17:0/1488347804 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f27500a1230 0x7f27500a36f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f276401e000 tx=0x7f2764021000 comp rx=0 tx=0).stop 2024-09-13T16:03:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.621+0000 7f2770a00640 1 -- 172.21.15.17:0/1488347804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c101d70 msgr2=0x7f276c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.621+0000 7f2770a00640 1 --2- 172.21.15.17:0/1488347804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c101d70 0x7f276c06ed10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f275c00b470 tx=0x7f275c00b930 comp rx=0 tx=0).stop 2024-09-13T16:03:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.621+0000 7f2770a00640 1 -- 172.21.15.17:0/1488347804 shutdown_connections 2024-09-13T16:03:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.621+0000 7f2770a00640 1 --2- 172.21.15.17:0/1488347804 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f27500a1230 0x7f27500a36f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.621+0000 7f2770a00640 1 --2- 172.21.15.17:0/1488347804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f276c103920 0x7f276c1ac780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.621+0000 7f2770a00640 1 --2- 172.21.15.17:0/1488347804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f276c102f60 0x7f276c06f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.621+0000 7f2770a00640 1 --2- 172.21.15.17:0/1488347804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f276c101d70 0x7f276c06ed10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.621+0000 7f2770a00640 1 -- 172.21.15.17:0/1488347804 >> 172.21.15.17:0/1488347804 conn(0x7f276c0fd510 msgr2=0x7f276c1062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.622+0000 7f2770a00640 1 -- 172.21.15.17:0/1488347804 shutdown_connections 2024-09-13T16:03:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:38.623+0000 7f2770a00640 1 -- 172.21.15.17:0/1488347804 wait complete. 2024-09-13T16:03:39.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:38 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:03:39.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:38 smithi193 ceph-mon[35248]: pgmap v562: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 10 MiB/s wr, 518 op/s 2024-09-13T16:03:39.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:38 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:03:39.014 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:38 smithi017 ceph-mon[30494]: pgmap v562: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 10 MiB/s wr, 518 op/s 2024-09-13T16:03:39.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:38 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:03:39.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:38 smithi189 ceph-mon[34790]: pgmap v562: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 10 MiB/s wr, 518 op/s 2024-09-13T16:03:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 355.0 s, 678.0 tps, lat 142.284 ms stddev 170.047 2024-09-13T16:03:40.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:40 smithi193 ceph-mon[35248]: pgmap v563: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 583 op/s 2024-09-13T16:03:40.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:40 smithi017 ceph-mon[30494]: pgmap v563: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 583 op/s 2024-09-13T16:03:40.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:40 smithi189 ceph-mon[34790]: pgmap v563: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 583 op/s 2024-09-13T16:03:42.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:42 smithi193 ceph-mon[35248]: pgmap v564: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 557 op/s 2024-09-13T16:03:42.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:42 smithi017 ceph-mon[30494]: pgmap v564: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 557 op/s 2024-09-13T16:03:42.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:42 smithi189 ceph-mon[34790]: pgmap v564: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 557 op/s 2024-09-13T16:03:43.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:43 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:03:43.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:43 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:03:43.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:43 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:03:44.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:44 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:44.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:44 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:44.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:44 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:44.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:44 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:44.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:44 smithi193 ceph-mon[35248]: Adjusting osd_memory_target on smithi189 to 176.0M 2024-09-13T16:03:44.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:44 smithi193 ceph-mon[35248]: Unable to set osd_memory_target on smithi189 to 184593203: error parsing value: Value '184593203' is below minimum 939524096 2024-09-13T16:03:44.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:44 smithi193 ceph-mon[35248]: pgmap v565: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 549 op/s 2024-09-13T16:03:44.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:44 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:44.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:44 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:44.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:44 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:44.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:44 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:44.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:44 smithi017 ceph-mon[30494]: Adjusting osd_memory_target on smithi189 to 176.0M 2024-09-13T16:03:44.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:44 smithi017 ceph-mon[30494]: Unable to set osd_memory_target on smithi189 to 184593203: error parsing value: Value '184593203' is below minimum 939524096 2024-09-13T16:03:44.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:44 smithi017 ceph-mon[30494]: pgmap v565: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 549 op/s 2024-09-13T16:03:44.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:44 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:44.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:44 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:44.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:44 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:44.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:44 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:44.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:44 smithi189 ceph-mon[34790]: Adjusting osd_memory_target on smithi189 to 176.0M 2024-09-13T16:03:44.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:44 smithi189 ceph-mon[34790]: Unable to set osd_memory_target on smithi189 to 184593203: error parsing value: Value '184593203' is below minimum 939524096 2024-09-13T16:03:44.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:44 smithi189 ceph-mon[34790]: pgmap v565: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 549 op/s 2024-09-13T16:03:45.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 360.0 s, 676.6 tps, lat 150.025 ms stddev 196.994 2024-09-13T16:03:45.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:45 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:45.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:45 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:45.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:45 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:45.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:45 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:45.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:45 smithi193 ceph-mon[35248]: Adjusting osd_memory_target on smithi017 to 177.5M 2024-09-13T16:03:45.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:45 smithi193 ceph-mon[35248]: Unable to set osd_memory_target on smithi017 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-13T16:03:45.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:45 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:45.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:45 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:03:45.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:45 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T16:03:45.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:45 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:45.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:45 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:45.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:45 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:45.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:45 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:45.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:45 smithi017 ceph-mon[30494]: Adjusting osd_memory_target on smithi017 to 177.5M 2024-09-13T16:03:45.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:45 smithi017 ceph-mon[30494]: Unable to set osd_memory_target on smithi017 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-13T16:03:45.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:45 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:45.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:45 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:03:45.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:45 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T16:03:45.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:45.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:45.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:45.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:03:45.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:45 smithi189 ceph-mon[34790]: Adjusting osd_memory_target on smithi017 to 177.5M 2024-09-13T16:03:45.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:45 smithi189 ceph-mon[34790]: Unable to set osd_memory_target on smithi017 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-13T16:03:45.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:03:45.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:03:45.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:45 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' 2024-09-13T16:03:46.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:46 smithi193 ceph-mon[35248]: pgmap v566: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 541 op/s 2024-09-13T16:03:46.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:46 smithi017 ceph-mon[30494]: pgmap v566: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 541 op/s 2024-09-13T16:03:46.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:46 smithi189 ceph-mon[34790]: pgmap v566: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 541 op/s 2024-09-13T16:03:48.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:48 smithi193 ceph-mon[35248]: pgmap v567: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.7 MiB/s wr, 501 op/s 2024-09-13T16:03:48.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:48 smithi017 ceph-mon[30494]: pgmap v567: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.7 MiB/s wr, 501 op/s 2024-09-13T16:03:48.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:48 smithi189 ceph-mon[34790]: pgmap v567: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.7 MiB/s wr, 501 op/s 2024-09-13T16:03:50.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 365.0 s, 921.8 tps, lat 107.424 ms stddev 128.561 2024-09-13T16:03:50.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:50 smithi193 ceph-mon[35248]: pgmap v568: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.0 MiB/s wr, 553 op/s 2024-09-13T16:03:50.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:50 smithi017 ceph-mon[30494]: pgmap v568: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.0 MiB/s wr, 553 op/s 2024-09-13T16:03:50.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:50 smithi189 ceph-mon[34790]: pgmap v568: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.0 MiB/s wr, 553 op/s 2024-09-13T16:03:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.804+0000 7fbacca00640 1 -- 172.21.15.17:0/3867352389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbac8103a40 msgr2=0x7fbac810a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.804+0000 7fbacca00640 1 --2- 172.21.15.17:0/3867352389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbac8103a40 0x7fbac810a360 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009be0 tx=0x7fbac002a6b0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.805+0000 7fbacca00640 1 -- 172.21.15.17:0/3867352389 shutdown_connections 2024-09-13T16:03:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.805+0000 7fbacca00640 1 --2- 172.21.15.17:0/3867352389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbac8103a40 0x7fbac810a360 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.805+0000 7fbacca00640 1 --2- 172.21.15.17:0/3867352389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbac8103080 0x7fbac8103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.805+0000 7fbacca00640 1 --2- 172.21.15.17:0/3867352389 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbac8101f30 0x7fbac8102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.805+0000 7fbacca00640 1 -- 172.21.15.17:0/3867352389 >> 172.21.15.17:0/3867352389 conn(0x7fbac80fd6b0 msgr2=0x7fbac80ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.805+0000 7fbacca00640 1 -- 172.21.15.17:0/3867352389 shutdown_connections 2024-09-13T16:03:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.805+0000 7fbacca00640 1 -- 172.21.15.17:0/3867352389 wait complete. 2024-09-13T16:03:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.807+0000 7fbacca00640 1 Processor -- start 2024-09-13T16:03:51.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.807+0000 7fbacca00640 1 -- start start 2024-09-13T16:03:51.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.808+0000 7fbacca00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbac8101f30 0x7fbac819c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:51.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.808+0000 7fbacca00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbac8103080 0x7fbac819c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.808+0000 7fbacca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbac8103a40 0x7fbac81a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.808+0000 7fbacca00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac81a3e80 con 0x7fbac8103a40 2024-09-13T16:03:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.808+0000 7fbacca00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac81a3ff0 con 0x7fbac8103080 2024-09-13T16:03:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.808+0000 7fbacca00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac81a41b0 con 0x7fbac8101f30 2024-09-13T16:03:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.808+0000 7fbac5e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbac8101f30 0x7fbac819c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.808+0000 7fbac5400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbac8103080 0x7fbac819c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.808+0000 7fbac5e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbac8101f30 0x7fbac819c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:52770/0 (socket says 172.21.15.17:52770) 2024-09-13T16:03:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.808+0000 7fbac5e00640 1 -- 172.21.15.17:0/1693465020 learned_addr learned my addr 172.21.15.17:0/1693465020 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:03:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.808+0000 7fbac6800640 1 --2- 172.21.15.17:0/1693465020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbac8103a40 0x7fbac81a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.809+0000 7fbac5400640 1 -- 172.21.15.17:0/1693465020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbac8101f30 msgr2=0x7fbac819c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.809+0000 7fbac5400640 1 --2- 172.21.15.17:0/1693465020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbac8101f30 0x7fbac819c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.809+0000 7fbac5400640 1 -- 172.21.15.17:0/1693465020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbac8103a40 msgr2=0x7fbac81a3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.809+0000 7fbac5400640 1 --2- 172.21.15.17:0/1693465020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbac8103a40 0x7fbac81a3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.809+0000 7fbac5400640 1 -- 172.21.15.17:0/1693465020 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac0009840 con 0x7fbac8103080 2024-09-13T16:03:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.809+0000 7fbac5e00640 1 --2- 172.21.15.17:0/1693465020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbac8101f30 0x7fbac819c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:03:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.809+0000 7fbac5400640 1 --2- 172.21.15.17:0/1693465020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbac8103080 0x7fbac819c8d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbab4005fd0 tx=0x7fbab400ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.810+0000 7fbabea00640 1 -- 172.21.15.17:0/1693465020 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab400ccc0 con 0x7fbac8103080 2024-09-13T16:03:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.810+0000 7fbacca00640 1 -- 172.21.15.17:0/1693465020 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac81a4490 con 0x7fbac8103080 2024-09-13T16:03:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.810+0000 7fbabea00640 1 -- 172.21.15.17:0/1693465020 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbab40044e0 con 0x7fbac8103080 2024-09-13T16:03:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.810+0000 7fbabea00640 1 -- 172.21.15.17:0/1693465020 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab4003da0 con 0x7fbac8103080 2024-09-13T16:03:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.810+0000 7fbacca00640 1 -- 172.21.15.17:0/1693465020 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac81a49f0 con 0x7fbac8103080 2024-09-13T16:03:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.813+0000 7fbacf880740 1 Processor -- start 2024-09-13T16:03:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.813+0000 7fbacf880740 1 -- start start 2024-09-13T16:03:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.813+0000 7fbabea00640 1 -- 172.21.15.17:0/1693465020 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fbab4004000 con 0x7fbac8103080 2024-09-13T16:03:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.813+0000 7fbacf880740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61ccca70 0x555a61ccce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.813+0000 7fbacf880740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555a61ccd3b0 0x555a61cd1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.813+0000 7fbacf880740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a61cd2440 0x555a61cd4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.813+0000 7fbacf880740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a61bd8bb0 con 0x555a61ccd3b0 2024-09-13T16:03:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.813+0000 7fbacf880740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a61c36a70 con 0x555a61ccca70 2024-09-13T16:03:51.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.813+0000 7fbacf880740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a61c34200 con 0x555a61cd2440 2024-09-13T16:03:51.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.814+0000 7fbac6800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61ccca70 0x555a61ccce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.814+0000 7fbac6800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61ccca70 0x555a61ccce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:38200/0 (socket says 172.21.15.17:38200) 2024-09-13T16:03:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.814+0000 7fbac6800640 1 -- 172.21.15.17:0/2901548799 learned_addr learned my addr 172.21.15.17:0/2901548799 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:03:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.814+0000 7fbac5400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a61cd2440 0x555a61cd4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.814+0000 7fbac5e00640 1 --2- 172.21.15.17:0/2901548799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555a61ccd3b0 0x555a61cd1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.814+0000 7fbac5400640 1 -- 172.21.15.17:0/2901548799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61ccca70 msgr2=0x555a61ccce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.814+0000 7fbac5400640 1 --2- 172.21.15.17:0/2901548799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61ccca70 0x555a61ccce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.815+0000 7fbac5400640 1 -- 172.21.15.17:0/2901548799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555a61ccd3b0 msgr2=0x555a61cd1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.815+0000 7fbac5400640 1 --2- 172.21.15.17:0/2901548799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555a61ccd3b0 0x555a61cd1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.815+0000 7fbac5400640 1 -- 172.21.15.17:0/2901548799 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a61bd1940 con 0x555a61cd2440 2024-09-13T16:03:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.815+0000 7fbac5e00640 1 --2- 172.21.15.17:0/2901548799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555a61ccd3b0 0x555a61cd1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:03:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.816+0000 7fbabea00640 1 --2- 172.21.15.17:0/1693465020 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbaac0a1090 0x7fbaac0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.816+0000 7fbabea00640 1 -- 172.21.15.17:0/1693465020 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fbab4014070 con 0x7fbac8103080 2024-09-13T16:03:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.816+0000 7fbac5400640 1 --2- 172.21.15.17:0/2901548799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a61cd2440 0x555a61cd4900 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbab40ca630 tx=0x7fbab40d5790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10109c4f24c9edf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.816+0000 7fbac6800640 1 --2- 172.21.15.17:0/1693465020 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbaac0a1090 0x7fbaac0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.817+0000 7fbab3400640 1 -- 172.21.15.17:0/2901548799 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab40ce030 con 0x555a61cd2440 2024-09-13T16:03:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.817+0000 7fbab3400640 1 -- 172.21.15.17:0/2901548799 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbab4096320 con 0x555a61cd2440 2024-09-13T16:03:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.817+0000 7fbab3400640 1 -- 172.21.15.17:0/2901548799 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab4099db0 con 0x555a61cd2440 2024-09-13T16:03:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.818+0000 7fbacf880740 1 -- 172.21.15.17:0/2901548799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a61cd2440 msgr2=0x555a61cd4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.818+0000 7fbacf880740 1 --2- 172.21.15.17:0/2901548799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a61cd2440 0x555a61cd4900 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbab40ca630 tx=0x7fbab40d5790 comp rx=0 tx=0).stop 2024-09-13T16:03:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.818+0000 7fbacf880740 1 -- 172.21.15.17:0/2901548799 shutdown_connections 2024-09-13T16:03:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.818+0000 7fbacf880740 1 --2- 172.21.15.17:0/2901548799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a61cd2440 0x555a61cd4900 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.818+0000 7fbacf880740 1 --2- 172.21.15.17:0/2901548799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555a61ccd3b0 0x555a61cd1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.818+0000 7fbacf880740 1 --2- 172.21.15.17:0/2901548799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61ccca70 0x555a61ccce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.818+0000 7fbacf880740 1 -- 172.21.15.17:0/2901548799 >> 172.21.15.17:0/2901548799 conn(0x555a61cc80e0 msgr2=0x555a61cc84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.818+0000 7fbac6800640 1 --2- 172.21.15.17:0/1693465020 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbaac0a1090 0x7fbaac0a3550 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbac0031040 tx=0x7fbac0005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.818+0000 7fbacf880740 1 -- 172.21.15.17:0/2901548799 shutdown_connections 2024-09-13T16:03:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.818+0000 7fbacf880740 1 -- 172.21.15.17:0/2901548799 wait complete. 2024-09-13T16:03:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.820+0000 7fbacf880740 1 -- start start 2024-09-13T16:03:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.820+0000 7fbacf880740 1 Processor -- start 2024-09-13T16:03:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.820+0000 7fbacf880740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555a61ccca70 0x555a61cd6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.821+0000 7fbacf880740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61ccd3b0 0x555a61cd6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.821+0000 7fbacf880740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a61cd2440 0x555a61cddce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:51.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.821+0000 7fbac5400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61ccd3b0 0x555a61cd6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:51.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.821+0000 7fbac5400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61ccd3b0 0x555a61cd6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:38206/0 (socket says 172.21.15.17:38206) 2024-09-13T16:03:51.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.821+0000 7fbac5400640 1 -- 172.21.15.17:0/1860130458 learned_addr learned my addr 172.21.15.17:0/1860130458 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:03:51.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.821+0000 7fbac6800640 1 --2- 172.21.15.17:0/1860130458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a61cd2440 0x555a61cddce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:51.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.821+0000 7fbacf880740 1 -- 172.21.15.17:0/1860130458 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a61c2faf0 con 0x555a61ccca70 2024-09-13T16:03:51.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.821+0000 7fbacf880740 1 -- 172.21.15.17:0/1860130458 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a61bedf20 con 0x555a61ccd3b0 2024-09-13T16:03:51.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.821+0000 7fbacf880740 1 -- 172.21.15.17:0/1860130458 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a61bedbc0 con 0x555a61cd2440 2024-09-13T16:03:51.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.821+0000 7fbacf880740 10 client.0 _ll_register_callbacks cb 0x555a61c1fa70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:03:51.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.821+0000 7fbac5e00640 1 --2- 172.21.15.17:0/1860130458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555a61ccca70 0x555a61cd6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.821+0000 7fbac5400640 1 -- 172.21.15.17:0/1860130458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a61cd2440 msgr2=0x555a61cddce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.821+0000 7fbac5400640 1 --2- 172.21.15.17:0/1860130458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a61cd2440 0x555a61cddce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.822+0000 7fbac5400640 1 -- 172.21.15.17:0/1860130458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555a61ccca70 msgr2=0x555a61cd6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.822+0000 7fbac5400640 1 --2- 172.21.15.17:0/1860130458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555a61ccca70 0x555a61cd6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.822+0000 7fbac5400640 1 -- 172.21.15.17:0/1860130458 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac81a49f0 con 0x555a61ccd3b0 2024-09-13T16:03:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.822+0000 7fbac5e00640 1 --2- 172.21.15.17:0/1860130458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555a61ccca70 0x555a61cd6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:03:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.822+0000 7fbac5400640 1 --2- 172.21.15.17:0/1860130458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61ccd3b0 0x555a61cd6ca0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbab40a1f30 tx=0x7fbab4009670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91774f859a30add8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.822+0000 7fbaa7e00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:03:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.822+0000 7fbaa7e00640 1 -- 172.21.15.17:0/1860130458 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab40ce030 con 0x555a61ccd3b0 2024-09-13T16:03:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.822+0000 7fbaa7e00640 1 -- 172.21.15.17:0/1860130458 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fbab40cf070 con 0x555a61ccd3b0 2024-09-13T16:03:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.822+0000 7fbacf880740 1 -- 172.21.15.17:0/1860130458 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555a61c59c90 con 0x555a61ccd3b0 2024-09-13T16:03:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.823+0000 7fbaa7e00640 1 -- 172.21.15.17:0/1860130458 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbab4099b20 con 0x555a61ccd3b0 2024-09-13T16:03:51.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.823+0000 7fbacf880740 10 client.25832 fetch_fsmap learned FSMap version 36 2024-09-13T16:03:51.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.823+0000 7fbacf880740 1 -- 172.21.15.17:0/1860130458 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x555a61c2e170 con 0x555a61ccd3b0 2024-09-13T16:03:51.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.824+0000 7fbaa7e00640 1 -- 172.21.15.17:0/1860130458 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbab407d080 con 0x555a61ccd3b0 2024-09-13T16:03:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.825+0000 7fbaa7e00640 1 -- 172.21.15.17:0/1860130458 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 36) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fbab40d1040 con 0x555a61ccd3b0 2024-09-13T16:03:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.825+0000 7fbacf880740 10 client.25832 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T16:03:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.825+0000 7fbacf880740 10 client.25832 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:03:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.825+0000 7fbacf880740 20 client.25832 populate_metadata read hostname 'smithi017' 2024-09-13T16:03:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.825+0000 7fbacf880740 1 --2- 172.21.15.17:0/1860130458 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555a61ce1ff0 0x555a61ce4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.826+0000 7fbacf880740 4 client.25832 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:03:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.826+0000 7fbacf880740 1 -- 172.21.15.17:0/1860130458 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555a61c227d0 con 0x555a61ce1ff0 2024-09-13T16:03:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.826+0000 7fbac5e00640 1 --2- 172.21.15.17:0/1860130458 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555a61ce1ff0 0x555a61ce4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.827+0000 7fbac5e00640 1 --2- 172.21.15.17:0/1860130458 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555a61ce1ff0 0x555a61ce4410 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebeec6fe62dd8536 server_cookie=798b55fc6f48d568 in_seq=0 out_seq=0 2024-09-13T16:03:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.827+0000 7fbaa7e00640 10 client.25832 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:03:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.828+0000 7fbaa7e00640 1 -- 172.21.15.17:0/1860130458 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555a61c227d0 con 0x555a61ce1ff0 2024-09-13T16:03:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.828+0000 7fbaa7e00640 10 client.25832 handle_command_reply: tid=0 2024-09-13T16:03:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.828+0000 7fbacf880740 1 client.25832 shutdown 2024-09-13T16:03:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.828+0000 7fbacf880740 1 -- 172.21.15.17:0/1860130458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61ccd3b0 msgr2=0x555a61cd6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.828+0000 7fbacf880740 1 --2- 172.21.15.17:0/1860130458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61ccd3b0 0x555a61cd6ca0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbab40a1f30 tx=0x7fbab4009670 comp rx=0 tx=0).stop 2024-09-13T16:03:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.828+0000 7fbacf880740 1 -- 172.21.15.17:0/1860130458 shutdown_connections 2024-09-13T16:03:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.828+0000 7fbacf880740 1 --2- 172.21.15.17:0/1860130458 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555a61ce1ff0 0x555a61ce4410 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.828+0000 7fbacf880740 1 --2- 172.21.15.17:0/1860130458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a61cd2440 0x555a61cddce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.828+0000 7fbacf880740 1 --2- 172.21.15.17:0/1860130458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61ccd3b0 0x555a61cd6ca0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.828+0000 7fbacf880740 1 --2- 172.21.15.17:0/1860130458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555a61ccca70 0x555a61cd6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.828+0000 7fbaa7e00640 0 client.25832 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:03:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.828+0000 7fbacf880740 1 -- 172.21.15.17:0/1860130458 >> 172.21.15.17:0/1860130458 conn(0x555a61cc80e0 msgr2=0x555a61cc98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.828+0000 7fbacf880740 1 -- 172.21.15.17:0/1860130458 shutdown_connections 2024-09-13T16:03:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.829+0000 7fbacf880740 1 -- 172.21.15.17:0/1860130458 wait complete. 2024-09-13T16:03:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.829+0000 7fbacf880740 20 client.25832 trim_cache size 0 max 16384 2024-09-13T16:03:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.847+0000 7fbacf880740 1 Processor -- start 2024-09-13T16:03:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.847+0000 7fbacf880740 1 -- start start 2024-09-13T16:03:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.848+0000 7fbacf880740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555a61ccca70 0x555a61cd1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.848+0000 7fbacf880740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a61ccd3b0 0x555a61cd1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.848+0000 7fbacf880740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61cd2440 0x555a61cddca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.848+0000 7fbacf880740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a61996e60 con 0x555a61ccca70 2024-09-13T16:03:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.848+0000 7fbacf880740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a61cc9fd0 con 0x555a61cd2440 2024-09-13T16:03:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.848+0000 7fbacf880740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a61ccde90 con 0x555a61ccd3b0 2024-09-13T16:03:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.848+0000 7fbac6800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61cd2440 0x555a61cddca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.848+0000 7fbac5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555a61ccca70 0x555a61cd1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:51.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.848+0000 7fbac6800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61cd2440 0x555a61cddca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:38222/0 (socket says 172.21.15.17:38222) 2024-09-13T16:03:51.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.848+0000 7fbac6800640 1 -- 172.21.15.17:0/995165860 learned_addr learned my addr 172.21.15.17:0/995165860 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:03:51.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.848+0000 7fbac5400640 1 --2- 172.21.15.17:0/995165860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a61ccd3b0 0x555a61cd1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.848+0000 7fbac6800640 1 -- 172.21.15.17:0/995165860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a61ccd3b0 msgr2=0x555a61cd1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.848+0000 7fbac6800640 1 --2- 172.21.15.17:0/995165860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a61ccd3b0 0x555a61cd1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.848+0000 7fbac6800640 1 -- 172.21.15.17:0/995165860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555a61ccca70 msgr2=0x555a61cd1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.848+0000 7fbac6800640 1 --2- 172.21.15.17:0/995165860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555a61ccca70 0x555a61cd1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.848+0000 7fbac6800640 1 -- 172.21.15.17:0/995165860 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a61bd0180 con 0x555a61cd2440 2024-09-13T16:03:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.848+0000 7fbac5e00640 1 --2- 172.21.15.17:0/995165860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555a61ccca70 0x555a61cd1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:03:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.849+0000 7fbac6800640 1 --2- 172.21.15.17:0/995165860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61cd2440 0x555a61cddca0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbac002aca0 tx=0x7fbac0041000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b615dc61d227f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.849+0000 7fbab3e00640 1 -- 172.21.15.17:0/995165860 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac0041070 con 0x555a61cd2440 2024-09-13T16:03:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.849+0000 7fbab3e00640 1 -- 172.21.15.17:0/995165860 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbac0030bd0 con 0x555a61cd2440 2024-09-13T16:03:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.849+0000 7fbab3e00640 1 -- 172.21.15.17:0/995165860 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac00317c0 con 0x555a61cd2440 2024-09-13T16:03:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.850+0000 7fbacf880740 1 -- 172.21.15.17:0/995165860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61cd2440 msgr2=0x555a61cddca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.850+0000 7fbacf880740 1 --2- 172.21.15.17:0/995165860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61cd2440 0x555a61cddca0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbac002aca0 tx=0x7fbac0041000 comp rx=0 tx=0).stop 2024-09-13T16:03:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.850+0000 7fbacf880740 1 -- 172.21.15.17:0/995165860 shutdown_connections 2024-09-13T16:03:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.850+0000 7fbacf880740 1 --2- 172.21.15.17:0/995165860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61cd2440 0x555a61cddca0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.850+0000 7fbacf880740 1 --2- 172.21.15.17:0/995165860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a61ccd3b0 0x555a61cd1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.850+0000 7fbacf880740 1 --2- 172.21.15.17:0/995165860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555a61ccca70 0x555a61cd1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.850+0000 7fbacf880740 1 -- 172.21.15.17:0/995165860 >> 172.21.15.17:0/995165860 conn(0x555a61cc80e0 msgr2=0x555a61ce8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.850+0000 7fbacf880740 1 -- 172.21.15.17:0/995165860 shutdown_connections 2024-09-13T16:03:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.850+0000 7fbacf880740 1 -- 172.21.15.17:0/995165860 wait complete. 2024-09-13T16:03:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.851+0000 7fbacf880740 1 -- start start 2024-09-13T16:03:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.852+0000 7fbacf880740 1 Processor -- start 2024-09-13T16:03:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.852+0000 7fbacf880740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61ccca70 0x555a61cdd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.852+0000 7fbacf880740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555a61ccd3b0 0x555a61cdda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.852+0000 7fbacf880740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a61cd2440 0x555a61cd9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.853+0000 7fbacf880740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a61cda5f0 con 0x555a61ccd3b0 2024-09-13T16:03:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.853+0000 7fbacf880740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a61cda760 con 0x555a61ccca70 2024-09-13T16:03:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.853+0000 7fbacf880740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a61cda920 con 0x555a61cd2440 2024-09-13T16:03:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.853+0000 7fbac5e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61ccca70 0x555a61cdd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.853+0000 7fbac5e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61ccca70 0x555a61cdd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:38226/0 (socket says 172.21.15.17:38226) 2024-09-13T16:03:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.853+0000 7fbac5e00640 1 -- 172.21.15.17:0/3183321171 learned_addr learned my addr 172.21.15.17:0/3183321171 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:03:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.853+0000 7fbacf880740 10 client.0 _ll_register_callbacks cb 0x7fbab40d0650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:03:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.853+0000 7fbac6800640 1 --2- 172.21.15.17:0/3183321171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a61cd2440 0x555a61cd9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.853+0000 7fbac5e00640 1 -- 172.21.15.17:0/3183321171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a61cd2440 msgr2=0x555a61cd9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.853+0000 7fbac5e00640 1 --2- 172.21.15.17:0/3183321171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a61cd2440 0x555a61cd9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.853+0000 7fbac5e00640 1 -- 172.21.15.17:0/3183321171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555a61ccd3b0 msgr2=0x555a61cdda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:03:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.853+0000 7fbac5e00640 1 --2- 172.21.15.17:0/3183321171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555a61ccd3b0 0x555a61cdda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.853+0000 7fbac5e00640 1 -- 172.21.15.17:0/3183321171 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac810ac90 con 0x555a61ccca70 2024-09-13T16:03:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.854+0000 7fbac5e00640 1 --2- 172.21.15.17:0/3183321171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61ccca70 0x555a61cdd540 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x555a61ce4d20 tx=0x7fbab8010cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5c5c1183cfc223a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:03:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.854+0000 7fbaa7e00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:03:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.854+0000 7fbaa7e00640 1 -- 172.21.15.17:0/3183321171 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab801e610 con 0x555a61ccca70 2024-09-13T16:03:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.854+0000 7fbaa7e00640 1 -- 172.21.15.17:0/3183321171 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fbab801e770 con 0x555a61ccca70 2024-09-13T16:03:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.854+0000 7fbacf880740 1 -- 172.21.15.17:0/3183321171 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbab4096320 con 0x555a61ccca70 2024-09-13T16:03:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.854+0000 7fbaa7e00640 1 -- 172.21.15.17:0/3183321171 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbab801e930 con 0x555a61ccca70 2024-09-13T16:03:51.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.854+0000 7fbacf880740 10 client.25838 fetch_fsmap learned FSMap version 36 2024-09-13T16:03:51.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.854+0000 7fbacf880740 1 -- 172.21.15.17:0/3183321171 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x555a61bf5560 con 0x555a61ccca70 2024-09-13T16:03:51.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.855+0000 7fbaa7e00640 1 -- 172.21.15.17:0/3183321171 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbab4096320 con 0x555a61ccca70 2024-09-13T16:03:51.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.855+0000 7fbaa7e00640 1 -- 172.21.15.17:0/3183321171 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 36) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fbab801b040 con 0x555a61ccca70 2024-09-13T16:03:51.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.856+0000 7fbacf880740 10 client.25838 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T16:03:51.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.856+0000 7fbacf880740 10 client.25838 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:03:51.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.856+0000 7fbacf880740 20 client.25838 populate_metadata read hostname 'smithi017' 2024-09-13T16:03:51.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.856+0000 7fbacf880740 1 --2- 172.21.15.17:0/3183321171 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555a61d39bd0 0x555a61d3bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:03:51.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.856+0000 7fbacf880740 4 client.25838 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:03:51.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.856+0000 7fbacf880740 1 -- 172.21.15.17:0/3183321171 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555a61923300 con 0x555a61d39bd0 2024-09-13T16:03:51.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.856+0000 7fbac5400640 1 --2- 172.21.15.17:0/3183321171 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555a61d39bd0 0x555a61d3bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:03:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.860+0000 7fbaa7e00640 10 client.25838 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:03:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:51.860+0000 7fbac5400640 1 --2- 172.21.15.17:0/3183321171 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555a61d39bd0 0x555a61d3bff0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7800b0a50a994208 server_cookie=9a0322f81fcfaedb in_seq=0 out_seq=0 2024-09-13T16:03:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.025+0000 7fbaa7e00640 1 -- 172.21.15.17:0/3183321171 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555a61923300 con 0x555a61d39bd0 2024-09-13T16:03:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.025+0000 7fbaa7e00640 10 client.25838 handle_command_reply: tid=0 2024-09-13T16:03:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.026+0000 7fbacf880740 1 client.25838 shutdown 2024-09-13T16:03:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.026+0000 7fbacf880740 1 -- 172.21.15.17:0/3183321171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61ccca70 msgr2=0x555a61cdd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.026+0000 7fbacf880740 1 --2- 172.21.15.17:0/3183321171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61ccca70 0x555a61cdd540 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x555a61ce4d20 tx=0x7fbab8010cf0 comp rx=0 tx=0).stop 2024-09-13T16:03:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.027+0000 7fbacf880740 1 -- 172.21.15.17:0/3183321171 shutdown_connections 2024-09-13T16:03:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.027+0000 7fbacf880740 1 --2- 172.21.15.17:0/3183321171 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555a61d39bd0 0x555a61d3bff0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.027+0000 7fbacf880740 1 --2- 172.21.15.17:0/3183321171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a61cd2440 0x555a61cd9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.027+0000 7fbacf880740 1 --2- 172.21.15.17:0/3183321171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555a61ccd3b0 0x555a61cdda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.027+0000 7fbacf880740 1 --2- 172.21.15.17:0/3183321171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555a61ccca70 0x555a61cdd540 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.027+0000 7fbaa7e00640 0 client.25838 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:03:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.027+0000 7fbacf880740 1 -- 172.21.15.17:0/3183321171 >> 172.21.15.17:0/3183321171 conn(0x555a61cc80e0 msgr2=0x555a61cce310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.028+0000 7fbacf880740 1 -- 172.21.15.17:0/3183321171 shutdown_connections 2024-09-13T16:03:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.028+0000 7fbacf880740 1 -- 172.21.15.17:0/3183321171 wait complete. 2024-09-13T16:03:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.032+0000 7fbacf880740 20 client.25838 trim_cache size 0 max 16384 2024-09-13T16:03:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:03:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:03:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:03:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:03:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.034+0000 7fbacca00640 1 -- 172.21.15.17:0/1693465020 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbaac0a1090 msgr2=0x7fbaac0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.034+0000 7fbacca00640 1 --2- 172.21.15.17:0/1693465020 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbaac0a1090 0x7fbaac0a3550 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbac0031040 tx=0x7fbac0005fd0 comp rx=0 tx=0).stop 2024-09-13T16:03:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.034+0000 7fbacca00640 1 -- 172.21.15.17:0/1693465020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbac8103080 msgr2=0x7fbac819c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:03:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.034+0000 7fbacca00640 1 --2- 172.21.15.17:0/1693465020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbac8103080 0x7fbac819c8d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbab4005fd0 tx=0x7fbab400ec20 comp rx=0 tx=0).stop 2024-09-13T16:03:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.035+0000 7fbacca00640 1 -- 172.21.15.17:0/1693465020 shutdown_connections 2024-09-13T16:03:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.035+0000 7fbacca00640 1 --2- 172.21.15.17:0/1693465020 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbaac0a1090 0x7fbaac0a3550 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.035+0000 7fbacca00640 1 --2- 172.21.15.17:0/1693465020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbac8103a40 0x7fbac81a3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.035+0000 7fbacca00640 1 --2- 172.21.15.17:0/1693465020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbac8103080 0x7fbac819c8d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.035+0000 7fbacca00640 1 --2- 172.21.15.17:0/1693465020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbac8101f30 0x7fbac819c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:03:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.035+0000 7fbacca00640 1 -- 172.21.15.17:0/1693465020 >> 172.21.15.17:0/1693465020 conn(0x7fbac80fd6b0 msgr2=0x7fbac8076af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:03:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.035+0000 7fbacca00640 1 -- 172.21.15.17:0/1693465020 shutdown_connections 2024-09-13T16:03:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:03:52.035+0000 7fbacca00640 1 -- 172.21.15.17:0/1693465020 wait complete. 2024-09-13T16:03:52.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:52 smithi193 ceph-mon[35248]: pgmap v569: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 613 op/s 2024-09-13T16:03:52.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:52 smithi017 ceph-mon[30494]: pgmap v569: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 613 op/s 2024-09-13T16:03:52.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:52 smithi189 ceph-mon[34790]: pgmap v569: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 613 op/s 2024-09-13T16:03:54.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:54 smithi193 ceph-mon[35248]: pgmap v570: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 622 op/s 2024-09-13T16:03:54.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:54 smithi017 ceph-mon[30494]: pgmap v570: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 622 op/s 2024-09-13T16:03:54.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:54 smithi189 ceph-mon[34790]: pgmap v570: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 622 op/s 2024-09-13T16:03:55.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 370.0 s, 777.4 tps, lat 131.587 ms stddev 172.465 2024-09-13T16:03:56.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:56 smithi193 ceph-mon[35248]: pgmap v571: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 10 MiB/s wr, 608 op/s 2024-09-13T16:03:56.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:56 smithi017 ceph-mon[30494]: pgmap v571: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 10 MiB/s wr, 608 op/s 2024-09-13T16:03:56.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:56 smithi189 ceph-mon[34790]: pgmap v571: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 10 MiB/s wr, 608 op/s 2024-09-13T16:03:58.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:03:58 smithi193 ceph-mon[35248]: pgmap v572: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9.5 MiB/s wr, 595 op/s 2024-09-13T16:03:58.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:03:58 smithi017 ceph-mon[30494]: pgmap v572: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9.5 MiB/s wr, 595 op/s 2024-09-13T16:03:58.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:03:58 smithi189 ceph-mon[34790]: pgmap v572: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9.5 MiB/s wr, 595 op/s 2024-09-13T16:04:00.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 375.0 s, 613.9 tps, lat 156.039 ms stddev 177.072 2024-09-13T16:04:00.755 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:00 smithi193 ceph-mon[35248]: pgmap v573: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 11 MiB/s wr, 627 op/s 2024-09-13T16:04:00.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:00 smithi017 ceph-mon[30494]: pgmap v573: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 11 MiB/s wr, 627 op/s 2024-09-13T16:04:00.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:00 smithi189 ceph-mon[34790]: pgmap v573: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 11 MiB/s wr, 627 op/s 2024-09-13T16:04:02.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:02 smithi193 ceph-mon[35248]: pgmap v574: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 10 MiB/s wr, 604 op/s 2024-09-13T16:04:02.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:02 smithi017 ceph-mon[30494]: pgmap v574: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 10 MiB/s wr, 604 op/s 2024-09-13T16:04:02.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:02 smithi189 ceph-mon[34790]: pgmap v574: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 10 MiB/s wr, 604 op/s 2024-09-13T16:04:04.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:04 smithi193 ceph-mon[35248]: pgmap v575: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.7 MiB/s wr, 562 op/s 2024-09-13T16:04:04.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:04 smithi017 ceph-mon[30494]: pgmap v575: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.7 MiB/s wr, 562 op/s 2024-09-13T16:04:04.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:04 smithi189 ceph-mon[34790]: pgmap v575: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.7 MiB/s wr, 562 op/s 2024-09-13T16:04:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.231+0000 7f4acb600640 1 -- 172.21.15.17:0/3727296471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ac41059f0 msgr2=0x7f4ac4107e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.231+0000 7f4acb600640 1 --2- 172.21.15.17:0/3727296471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ac41059f0 0x7f4ac4107e60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4abc009ca0 tx=0x7f4abc02a8c0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.232+0000 7f4acb600640 1 -- 172.21.15.17:0/3727296471 shutdown_connections 2024-09-13T16:04:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.232+0000 7f4acb600640 1 --2- 172.21.15.17:0/3727296471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ac41059f0 0x7f4ac4107e60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.232+0000 7f4acb600640 1 --2- 172.21.15.17:0/3727296471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ac41030c0 0x7f4ac41054b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.232+0000 7f4acb600640 1 --2- 172.21.15.17:0/3727296471 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ac4100790 0x7f4ac4102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.232+0000 7f4acb600640 1 -- 172.21.15.17:0/3727296471 >> 172.21.15.17:0/3727296471 conn(0x7f4ac40fa370 msgr2=0x7f4ac40fc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.232+0000 7f4acb600640 1 -- 172.21.15.17:0/3727296471 shutdown_connections 2024-09-13T16:04:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.232+0000 7f4acb600640 1 -- 172.21.15.17:0/3727296471 wait complete. 2024-09-13T16:04:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.233+0000 7f4acb600640 1 Processor -- start 2024-09-13T16:04:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.233+0000 7f4acb600640 1 -- start start 2024-09-13T16:04:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.234+0000 7f4acb600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ac4100790 0x7f4ac41939c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.234+0000 7f4acb600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ac41030c0 0x7f4ac4193f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.234+0000 7f4acb600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ac41059f0 0x7f4ac41a3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.234+0000 7f4acb600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac41947d0 con 0x7f4ac41059f0 2024-09-13T16:04:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.234+0000 7f4acb600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac41a40a0 con 0x7f4ac4100790 2024-09-13T16:04:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.234+0000 7f4acb600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac41a41e0 con 0x7f4ac41030c0 2024-09-13T16:04:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.234+0000 7f4ac3e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ac41030c0 0x7f4ac4193f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.234+0000 7f4ac8c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ac4100790 0x7f4ac41939c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:05.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.234+0000 7f4ac8c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ac4100790 0x7f4ac41939c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:56716/0 (socket says 172.21.15.17:56716) 2024-09-13T16:04:05.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.234+0000 7f4ac3e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ac41030c0 0x7f4ac4193f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:59580/0 (socket says 172.21.15.17:59580) 2024-09-13T16:04:05.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.234+0000 7f4ac8c00640 1 -- 172.21.15.17:0/1807156338 learned_addr learned my addr 172.21.15.17:0/1807156338 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:05.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.234+0000 7f4ac9600640 1 --2- 172.21.15.17:0/1807156338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ac41059f0 0x7f4ac41a3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:05.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.235+0000 7f4ac8c00640 1 -- 172.21.15.17:0/1807156338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ac41030c0 msgr2=0x7f4ac4193f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:05.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.235+0000 7f4ac8c00640 1 --2- 172.21.15.17:0/1807156338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ac41030c0 0x7f4ac4193f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.235+0000 7f4ac8c00640 1 -- 172.21.15.17:0/1807156338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ac41059f0 msgr2=0x7f4ac41a3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:05.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.235+0000 7f4ac8c00640 1 --2- 172.21.15.17:0/1807156338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ac41059f0 0x7f4ac41a3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.235+0000 7f4ac8c00640 1 -- 172.21.15.17:0/1807156338 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab8009490 con 0x7f4ac4100790 2024-09-13T16:04:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.235+0000 7f4ac8c00640 1 --2- 172.21.15.17:0/1807156338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ac4100790 0x7f4ac41939c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800ea60 tx=0x7f4ab800ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.235+0000 7f4ac1600640 1 -- 172.21.15.17:0/1807156338 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab800cd20 con 0x7f4ac4100790 2024-09-13T16:04:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.235+0000 7f4ac1600640 1 -- 172.21.15.17:0/1807156338 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ab800ce80 con 0x7f4ac4100790 2024-09-13T16:04:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.235+0000 7f4ac1600640 1 -- 172.21.15.17:0/1807156338 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8010450 con 0x7f4ac4100790 2024-09-13T16:04:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.235+0000 7f4acb600640 1 -- 172.21.15.17:0/1807156338 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4abc009900 con 0x7f4ac4100790 2024-09-13T16:04:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.236+0000 7f4acb600640 1 -- 172.21.15.17:0/1807156338 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac41a4870 con 0x7f4ac4100790 2024-09-13T16:04:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.239+0000 7f4ace4da740 1 Processor -- start 2024-09-13T16:04:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.240+0000 7f4ace4da740 1 -- start start 2024-09-13T16:04:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.240+0000 7f4ace4da740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b67380fa70 0x55b67380fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:05.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.240+0000 7f4ace4da740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6738103b0 0x55b673814e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:05.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.240+0000 7f4ace4da740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b673815440 0x55b673817900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:05.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.240+0000 7f4ace4da740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b67371bbb0 con 0x55b67380fa70 2024-09-13T16:04:05.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.240+0000 7f4ace4da740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b673779a70 con 0x55b6738103b0 2024-09-13T16:04:05.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.240+0000 7f4ace4da740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b673777200 con 0x55b673815440 2024-09-13T16:04:05.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.240+0000 7f4ac9600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b67380fa70 0x55b67380fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:05.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.240+0000 7f4ac3e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b673815440 0x55b673817900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:05.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.240+0000 7f4ac3e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b673815440 0x55b673817900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:59588/0 (socket says 172.21.15.17:59588) 2024-09-13T16:04:05.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.240+0000 7f4ac3e00640 1 -- 172.21.15.17:0/3411965530 learned_addr learned my addr 172.21.15.17:0/3411965530 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.241+0000 7f4ac3e00640 1 -- 172.21.15.17:0/3411965530 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6738103b0 msgr2=0x55b673814e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:04:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.241+0000 7f4ac3e00640 1 --2- 172.21.15.17:0/3411965530 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6738103b0 0x55b673814e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.241+0000 7f4ac3e00640 1 -- 172.21.15.17:0/3411965530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b67380fa70 msgr2=0x55b67380fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.241+0000 7f4ac3e00640 1 --2- 172.21.15.17:0/3411965530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b67380fa70 0x55b67380fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.241+0000 7f4ac3e00640 1 -- 172.21.15.17:0/3411965530 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b673714940 con 0x55b673815440 2024-09-13T16:04:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.242+0000 7f4ac3e00640 1 --2- 172.21.15.17:0/3411965530 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b673815440 0x55b673817900 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0009a40 tx=0x7f4ab0009f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=406d4abb8cd6d562 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.242+0000 7f4ab6000640 1 -- 172.21.15.17:0/3411965530 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab000eb40 con 0x55b673815440 2024-09-13T16:04:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.242+0000 7f4ab6000640 1 -- 172.21.15.17:0/3411965530 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ab000eca0 con 0x55b673815440 2024-09-13T16:04:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.243+0000 7f4ab6000640 1 -- 172.21.15.17:0/3411965530 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0012630 con 0x55b673815440 2024-09-13T16:04:05.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.243+0000 7f4ac1600640 1 -- 172.21.15.17:0/1807156338 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4ab80035f0 con 0x7f4ac4100790 2024-09-13T16:04:05.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.244+0000 7f4ace4da740 1 -- 172.21.15.17:0/3411965530 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b673815440 msgr2=0x55b673817900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:05.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.244+0000 7f4ace4da740 1 --2- 172.21.15.17:0/3411965530 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b673815440 0x55b673817900 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0009a40 tx=0x7f4ab0009f00 comp rx=0 tx=0).stop 2024-09-13T16:04:05.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.244+0000 7f4ace4da740 1 -- 172.21.15.17:0/3411965530 shutdown_connections 2024-09-13T16:04:05.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.244+0000 7f4ace4da740 1 --2- 172.21.15.17:0/3411965530 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b673815440 0x55b673817900 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.244+0000 7f4ace4da740 1 --2- 172.21.15.17:0/3411965530 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b6738103b0 0x55b673814e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.244+0000 7f4ace4da740 1 --2- 172.21.15.17:0/3411965530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b67380fa70 0x55b67380fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.244+0000 7f4ace4da740 1 -- 172.21.15.17:0/3411965530 >> 172.21.15.17:0/3411965530 conn(0x55b67380b0e0 msgr2=0x55b67380b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:05.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.246+0000 7f4ace4da740 1 -- 172.21.15.17:0/3411965530 shutdown_connections 2024-09-13T16:04:05.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.246+0000 7f4ace4da740 1 -- 172.21.15.17:0/3411965530 wait complete. 2024-09-13T16:04:05.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.247+0000 7f4ace4da740 1 -- start start 2024-09-13T16:04:05.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.247+0000 7f4ace4da740 1 Processor -- start 2024-09-13T16:04:05.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.248+0000 7f4ac1600640 1 --2- 172.21.15.17:0/1807156338 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4aac0a1020 0x7f4aac0a34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:05.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.248+0000 7f4ace4da740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b67380fa70 0x55b67382a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:05.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.248+0000 7f4ace4da740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b673815440 0x55b67382ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.248+0000 7f4ace4da740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b67382fe90 0x55b673832280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.248+0000 7f4ace4da740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b673772af0 con 0x55b67380fa70 2024-09-13T16:04:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.248+0000 7f4ace4da740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b673730f20 con 0x55b67382fe90 2024-09-13T16:04:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.248+0000 7f4ace4da740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b673730bc0 con 0x55b673815440 2024-09-13T16:04:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.248+0000 7f4ace4da740 10 client.0 _ll_register_callbacks cb 0x55b673762a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:04:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.249+0000 7f4ac8c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b67380fa70 0x55b67382a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.249+0000 7f4ac8c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b67380fa70 0x55b67382a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57834/0 (socket says 172.21.15.17:57834) 2024-09-13T16:04:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.249+0000 7f4ac8c00640 1 -- 172.21.15.17:0/4069805985 learned_addr learned my addr 172.21.15.17:0/4069805985 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.249+0000 7f4ac3e00640 1 --2- 172.21.15.17:0/4069805985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b673815440 0x55b67382ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.249+0000 7f4ac3e00640 1 -- 172.21.15.17:0/4069805985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b67382fe90 msgr2=0x55b673832280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:04:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.249+0000 7f4ac3e00640 1 --2- 172.21.15.17:0/4069805985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b67382fe90 0x55b673832280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.249+0000 7f4ac3e00640 1 -- 172.21.15.17:0/4069805985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b67380fa70 msgr2=0x55b67382a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.250+0000 7f4ac9600640 1 --2- 172.21.15.17:0/1807156338 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4aac0a1020 0x7f4aac0a34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.250+0000 7f4ac3e00640 1 --2- 172.21.15.17:0/4069805985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b67380fa70 0x55b67382a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.250+0000 7f4ac3e00640 1 -- 172.21.15.17:0/4069805985 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab0009670 con 0x55b673815440 2024-09-13T16:04:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.250+0000 7f4ac8c00640 1 --2- 172.21.15.17:0/4069805985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b67380fa70 0x55b67382a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:04:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.251+0000 7f4ac3e00640 1 --2- 172.21.15.17:0/4069805985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b673815440 0x55b67382ae60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0009a40 tx=0x7f4ab0013b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af941e9e8c7eb69b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.251+0000 7f4aaaa00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:04:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.251+0000 7f4aaaa00640 1 -- 172.21.15.17:0/4069805985 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab000eb40 con 0x55b673815440 2024-09-13T16:04:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.252+0000 7f4aaaa00640 1 -- 172.21.15.17:0/4069805985 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f4ab001c660 con 0x55b673815440 2024-09-13T16:04:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.252+0000 7f4ac1600640 1 -- 172.21.15.17:0/1807156338 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f4ab8014070 con 0x7f4ac4100790 2024-09-13T16:04:05.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.252+0000 7f4ace4da740 1 -- 172.21.15.17:0/4069805985 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b67379cc90 con 0x55b673815440 2024-09-13T16:04:05.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.252+0000 7f4aaaa00640 1 -- 172.21.15.17:0/4069805985 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ab001c820 con 0x55b673815440 2024-09-13T16:04:05.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.252+0000 7f4ace4da740 10 client.25864 fetch_fsmap learned FSMap version 36 2024-09-13T16:04:05.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.252+0000 7f4ace4da740 1 -- 172.21.15.17:0/4069805985 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55b673771170 con 0x55b673815440 2024-09-13T16:04:05.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.253+0000 7f4aaaa00640 1 -- 172.21.15.17:0/4069805985 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b67379cc90 con 0x55b673815440 2024-09-13T16:04:05.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.253+0000 7f4aaaa00640 1 -- 172.21.15.17:0/4069805985 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 36) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f4ab0011070 con 0x55b673815440 2024-09-13T16:04:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.253+0000 7f4ace4da740 10 client.25864 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T16:04:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.253+0000 7f4ace4da740 10 client.25864 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:04:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.253+0000 7f4ace4da740 20 client.25864 populate_metadata read hostname 'smithi017' 2024-09-13T16:04:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.253+0000 7f4ace4da740 1 --2- 172.21.15.17:0/4069805985 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55b673836850 0x55b673838c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.253+0000 7f4ace4da740 4 client.25864 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:04:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.253+0000 7f4ace4da740 1 -- 172.21.15.17:0/4069805985 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b6737657d0 con 0x55b673836850 2024-09-13T16:04:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.254+0000 7f4ac8c00640 1 --2- 172.21.15.17:0/4069805985 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55b673836850 0x55b673838c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.255+0000 7f4ac9600640 1 --2- 172.21.15.17:0/1807156338 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4aac0a1020 0x7f4aac0a34e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4abc031b10 tx=0x7f4abc031be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.255+0000 7f4aaaa00640 10 client.25864 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:04:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.255+0000 7f4ac8c00640 1 --2- 172.21.15.17:0/4069805985 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55b673836850 0x55b673838c70 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5d8a2246b9b5a5d server_cookie=1ead524e0f385750 in_seq=0 out_seq=0 2024-09-13T16:04:05.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.256+0000 7f4aaaa00640 1 -- 172.21.15.17:0/4069805985 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b6737657d0 con 0x55b673836850 2024-09-13T16:04:05.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.256+0000 7f4aaaa00640 10 client.25864 handle_command_reply: tid=0 2024-09-13T16:04:05.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.256+0000 7f4ace4da740 1 client.25864 shutdown 2024-09-13T16:04:05.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.258+0000 7f4ace4da740 1 -- 172.21.15.17:0/4069805985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b673815440 msgr2=0x55b67382ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:05.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.258+0000 7f4ace4da740 1 --2- 172.21.15.17:0/4069805985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b673815440 0x55b67382ae60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0009a40 tx=0x7f4ab0013b80 comp rx=0 tx=0).stop 2024-09-13T16:04:05.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.258+0000 7f4ace4da740 1 -- 172.21.15.17:0/4069805985 shutdown_connections 2024-09-13T16:04:05.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.258+0000 7f4ace4da740 1 --2- 172.21.15.17:0/4069805985 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55b673836850 0x55b673838c70 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.258+0000 7f4ace4da740 1 --2- 172.21.15.17:0/4069805985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b67382fe90 0x55b673832280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.258+0000 7f4ace4da740 1 --2- 172.21.15.17:0/4069805985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b673815440 0x55b67382ae60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.258+0000 7f4ace4da740 1 --2- 172.21.15.17:0/4069805985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b67380fa70 0x55b67382a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.258+0000 7f4ace4da740 1 -- 172.21.15.17:0/4069805985 >> 172.21.15.17:0/4069805985 conn(0x55b67380b0e0 msgr2=0x55b67380c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.258+0000 7f4aaaa00640 0 client.25864 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:04:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.259+0000 7f4ace4da740 1 -- 172.21.15.17:0/4069805985 shutdown_connections 2024-09-13T16:04:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.259+0000 7f4ace4da740 1 -- 172.21.15.17:0/4069805985 wait complete. 2024-09-13T16:04:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.259+0000 7f4ace4da740 20 client.25864 trim_cache size 0 max 16384 2024-09-13T16:04:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.288+0000 7f4ace4da740 1 Processor -- start 2024-09-13T16:04:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.288+0000 7f4ace4da740 1 -- start start 2024-09-13T16:04:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.289+0000 7f4ace4da740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b67380fa70 0x55b673846b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.289+0000 7f4ace4da740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b673815440 0x55b673847050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.289+0000 7f4ace4da740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b67382fe90 0x55b67380b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.289+0000 7f4ace4da740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6734d9e60 con 0x55b673815440 2024-09-13T16:04:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.289+0000 7f4ace4da740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b67380cfa0 con 0x55b67382fe90 2024-09-13T16:04:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.289+0000 7f4ace4da740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b67382ba80 con 0x55b67380fa70 2024-09-13T16:04:05.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.290+0000 7f4ac8c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b67380fa70 0x55b673846b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:05.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.290+0000 7f4ac3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b673815440 0x55b673847050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:05.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.290+0000 7f4ac8c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b67380fa70 0x55b673846b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:59610/0 (socket says 172.21.15.17:59610) 2024-09-13T16:04:05.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.290+0000 7f4ac3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b673815440 0x55b673847050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57842/0 (socket says 172.21.15.17:57842) 2024-09-13T16:04:05.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.290+0000 7f4ac8c00640 1 -- 172.21.15.17:0/3221087395 learned_addr learned my addr 172.21.15.17:0/3221087395 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:05.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.290+0000 7f4ac9600640 1 --2- 172.21.15.17:0/3221087395 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b67382fe90 0x55b67380b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:05.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.290+0000 7f4ac8c00640 1 -- 172.21.15.17:0/3221087395 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b67382fe90 msgr2=0x55b67380b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:05.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.290+0000 7f4ac8c00640 1 --2- 172.21.15.17:0/3221087395 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b67382fe90 0x55b67380b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.290+0000 7f4ac8c00640 1 -- 172.21.15.17:0/3221087395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b673815440 msgr2=0x55b673847050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.290+0000 7f4ac8c00640 1 --2- 172.21.15.17:0/3221087395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b673815440 0x55b673847050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.290+0000 7f4ac8c00640 1 -- 172.21.15.17:0/3221087395 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b673713180 con 0x55b67380fa70 2024-09-13T16:04:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.291+0000 7f4ac8c00640 1 --2- 172.21.15.17:0/3221087395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b67380fa70 0x55b673846b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800d010 tx=0x7f4ab8095eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e627029efda1dd2d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.291+0000 7f4ab6a00640 1 -- 172.21.15.17:0/3221087395 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab809e070 con 0x55b67380fa70 2024-09-13T16:04:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.291+0000 7f4ab6a00640 1 -- 172.21.15.17:0/3221087395 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ab80a26c0 con 0x55b67380fa70 2024-09-13T16:04:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.291+0000 7f4ab6a00640 1 -- 172.21.15.17:0/3221087395 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab80ae110 con 0x55b67380fa70 2024-09-13T16:04:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.292+0000 7f4ace4da740 1 -- 172.21.15.17:0/3221087395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b67380fa70 msgr2=0x55b673846b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.292+0000 7f4ace4da740 1 --2- 172.21.15.17:0/3221087395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b67380fa70 0x55b673846b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800d010 tx=0x7f4ab8095eb0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.292+0000 7f4ace4da740 1 -- 172.21.15.17:0/3221087395 shutdown_connections 2024-09-13T16:04:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.292+0000 7f4ace4da740 1 --2- 172.21.15.17:0/3221087395 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b67382fe90 0x55b67380b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.292+0000 7f4ace4da740 1 --2- 172.21.15.17:0/3221087395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b673815440 0x55b673847050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.292+0000 7f4ace4da740 1 --2- 172.21.15.17:0/3221087395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b67380fa70 0x55b673846b10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.292+0000 7f4ace4da740 1 -- 172.21.15.17:0/3221087395 >> 172.21.15.17:0/3221087395 conn(0x55b67380b0e0 msgr2=0x55b67383d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.292+0000 7f4ace4da740 1 -- 172.21.15.17:0/3221087395 shutdown_connections 2024-09-13T16:04:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.292+0000 7f4ace4da740 1 -- 172.21.15.17:0/3221087395 wait complete. 2024-09-13T16:04:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.293+0000 7f4ace4da740 1 -- start start 2024-09-13T16:04:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.293+0000 7f4ace4da740 1 Processor -- start 2024-09-13T16:04:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.293+0000 7f4ace4da740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b67380fa70 0x55b6738467c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.293+0000 7f4ace4da740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b673815440 0x55b673846d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.293+0000 7f4ace4da740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b67382fe90 0x55b67388bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.293+0000 7f4ace4da740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b67388c470 con 0x55b673815440 2024-09-13T16:04:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.293+0000 7f4ace4da740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b67388c5b0 con 0x55b67382fe90 2024-09-13T16:04:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.293+0000 7f4ace4da740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b67388c740 con 0x55b67380fa70 2024-09-13T16:04:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.294+0000 7f4ace4da740 10 client.0 _ll_register_callbacks cb 0x7f4ab0009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:04:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.294+0000 7f4ac9600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b67382fe90 0x55b67388bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.294+0000 7f4ac3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b673815440 0x55b673846d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.294+0000 7f4ac9600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b67382fe90 0x55b67388bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:56746/0 (socket says 172.21.15.17:56746) 2024-09-13T16:04:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.294+0000 7f4ac8c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b67380fa70 0x55b6738467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.294+0000 7f4ac9600640 1 -- 172.21.15.17:0/775847279 learned_addr learned my addr 172.21.15.17:0/775847279 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.295+0000 7f4ac8c00640 1 -- 172.21.15.17:0/775847279 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b67382fe90 msgr2=0x55b67388bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.295+0000 7f4ac8c00640 1 --2- 172.21.15.17:0/775847279 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b67382fe90 0x55b67388bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.295+0000 7f4ac8c00640 1 -- 172.21.15.17:0/775847279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b673815440 msgr2=0x55b673846d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.295+0000 7f4ac8c00640 1 --2- 172.21.15.17:0/775847279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b673815440 0x55b673846d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.295+0000 7f4ac8c00640 1 -- 172.21.15.17:0/775847279 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac41a4870 con 0x55b67380fa70 2024-09-13T16:04:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.295+0000 7f4ac3e00640 1 --2- 172.21.15.17:0/775847279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b673815440 0x55b673846d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:04:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.296+0000 7f4ac8c00640 1 --2- 172.21.15.17:0/775847279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b67380fa70 0x55b6738467c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55b67382a520 tx=0x7f4ab80cd150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6fa0147f2ef9367 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.296+0000 7f4aaaa00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:04:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.296+0000 7f4aaaa00640 1 -- 172.21.15.17:0/775847279 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8020590 con 0x55b67380fa70 2024-09-13T16:04:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.296+0000 7f4aaaa00640 1 -- 172.21.15.17:0/775847279 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f4ab80ae110 con 0x55b67380fa70 2024-09-13T16:04:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.297+0000 7f4ace4da740 1 -- 172.21.15.17:0/775847279 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4ab000eca0 con 0x55b67380fa70 2024-09-13T16:04:05.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.297+0000 7f4aaaa00640 1 -- 172.21.15.17:0/775847279 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ab80ae2d0 con 0x55b67380fa70 2024-09-13T16:04:05.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.297+0000 7f4ace4da740 10 client.25870 fetch_fsmap learned FSMap version 36 2024-09-13T16:04:05.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.297+0000 7f4ace4da740 1 -- 172.21.15.17:0/775847279 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55b673738560 con 0x55b67380fa70 2024-09-13T16:04:05.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.298+0000 7f4aaaa00640 1 -- 172.21.15.17:0/775847279 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ab000eca0 con 0x55b67380fa70 2024-09-13T16:04:05.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.299+0000 7f4aaaa00640 1 -- 172.21.15.17:0/775847279 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 36) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f4ab80991a0 con 0x55b67380fa70 2024-09-13T16:04:05.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.299+0000 7f4ace4da740 10 client.25870 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T16:04:05.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.299+0000 7f4ace4da740 10 client.25870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:04:05.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.299+0000 7f4ace4da740 20 client.25870 populate_metadata read hostname 'smithi017' 2024-09-13T16:04:05.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.299+0000 7f4ace4da740 1 --2- 172.21.15.17:0/775847279 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55b67388dea0 0x55b673890290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:05.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.299+0000 7f4ace4da740 4 client.25870 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:04:05.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.299+0000 7f4ace4da740 1 -- 172.21.15.17:0/775847279 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b673466300 con 0x55b67388dea0 2024-09-13T16:04:05.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.300+0000 7f4ac3e00640 1 --2- 172.21.15.17:0/775847279 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55b67388dea0 0x55b673890290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:05.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.300+0000 7f4ac3e00640 1 --2- 172.21.15.17:0/775847279 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55b67388dea0 0x55b673890290 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab170247bad3fbda server_cookie=c1dedbe494f4d4e7 in_seq=0 out_seq=0 2024-09-13T16:04:05.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.300+0000 7f4aaaa00640 10 client.25870 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:04:05.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.308+0000 7f4aaaa00640 1 -- 172.21.15.17:0/775847279 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b673466300 con 0x55b67388dea0 2024-09-13T16:04:05.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.308+0000 7f4aaaa00640 10 client.25870 handle_command_reply: tid=0 2024-09-13T16:04:05.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.308+0000 7f4ace4da740 1 client.25870 shutdown 2024-09-13T16:04:05.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.309+0000 7f4ace4da740 1 -- 172.21.15.17:0/775847279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b67380fa70 msgr2=0x55b6738467c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:05.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.309+0000 7f4ace4da740 1 --2- 172.21.15.17:0/775847279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b67380fa70 0x55b6738467c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55b67382a520 tx=0x7f4ab80cd150 comp rx=0 tx=0).stop 2024-09-13T16:04:05.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.310+0000 7f4ace4da740 1 -- 172.21.15.17:0/775847279 shutdown_connections 2024-09-13T16:04:05.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.310+0000 7f4ace4da740 1 --2- 172.21.15.17:0/775847279 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55b67388dea0 0x55b673890290 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.310+0000 7f4ace4da740 1 --2- 172.21.15.17:0/775847279 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b67382fe90 0x55b67388bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.310+0000 7f4ace4da740 1 --2- 172.21.15.17:0/775847279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b673815440 0x55b673846d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.310+0000 7f4ace4da740 1 --2- 172.21.15.17:0/775847279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b67380fa70 0x55b6738467c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.310+0000 7f4ace4da740 1 -- 172.21.15.17:0/775847279 >> 172.21.15.17:0/775847279 conn(0x55b67380b0e0 msgr2=0x55b673811410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.310+0000 7f4aaaa00640 0 client.25870 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:04:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.310+0000 7f4ace4da740 1 -- 172.21.15.17:0/775847279 shutdown_connections 2024-09-13T16:04:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.310+0000 7f4ace4da740 1 -- 172.21.15.17:0/775847279 wait complete. 2024-09-13T16:04:05.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.311+0000 7f4ace4da740 20 client.25870 trim_cache size 0 max 16384 2024-09-13T16:04:05.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:04:05.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:04:05.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:04:05.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:04:05.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.312+0000 7f4acb600640 1 -- 172.21.15.17:0/1807156338 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4aac0a1020 msgr2=0x7f4aac0a34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:05.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.312+0000 7f4acb600640 1 --2- 172.21.15.17:0/1807156338 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4aac0a1020 0x7f4aac0a34e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4abc031b10 tx=0x7f4abc031be0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.312+0000 7f4acb600640 1 -- 172.21.15.17:0/1807156338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ac4100790 msgr2=0x7f4ac41939c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:05.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.312+0000 7f4acb600640 1 --2- 172.21.15.17:0/1807156338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ac4100790 0x7f4ac41939c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800ea60 tx=0x7f4ab800ee60 comp rx=0 tx=0).stop 2024-09-13T16:04:05.317 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 380.0 s, 633.1 tps, lat 162.601 ms stddev 203.775 2024-09-13T16:04:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.312+0000 7f4acb600640 1 -- 172.21.15.17:0/1807156338 shutdown_connections 2024-09-13T16:04:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.312+0000 7f4acb600640 1 --2- 172.21.15.17:0/1807156338 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f4aac0a1020 0x7f4aac0a34e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.312+0000 7f4acb600640 1 --2- 172.21.15.17:0/1807156338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ac41059f0 0x7f4ac41a3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.312+0000 7f4acb600640 1 --2- 172.21.15.17:0/1807156338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ac41030c0 0x7f4ac4193f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.312+0000 7f4acb600640 1 --2- 172.21.15.17:0/1807156338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ac4100790 0x7f4ac41939c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.312+0000 7f4acb600640 1 -- 172.21.15.17:0/1807156338 >> 172.21.15.17:0/1807156338 conn(0x7f4ac40fa370 msgr2=0x7f4ac40ffe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.312+0000 7f4acb600640 1 -- 172.21.15.17:0/1807156338 shutdown_connections 2024-09-13T16:04:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:05.312+0000 7f4acb600640 1 -- 172.21.15.17:0/1807156338 wait complete. 2024-09-13T16:04:06.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:06 smithi193 ceph-mon[35248]: pgmap v576: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 8.0 MiB/s wr, 537 op/s 2024-09-13T16:04:06.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:06 smithi017 ceph-mon[30494]: pgmap v576: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 8.0 MiB/s wr, 537 op/s 2024-09-13T16:04:06.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:06 smithi189 ceph-mon[34790]: pgmap v576: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 8.0 MiB/s wr, 537 op/s 2024-09-13T16:04:09.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:08 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:04:09.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:08 smithi193 ceph-mon[35248]: pgmap v577: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.7 MiB/s wr, 526 op/s 2024-09-13T16:04:09.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:08 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:04:09.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:08 smithi017 ceph-mon[30494]: pgmap v577: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.7 MiB/s wr, 526 op/s 2024-09-13T16:04:09.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:08 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:04:09.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:08 smithi189 ceph-mon[34790]: pgmap v577: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.7 MiB/s wr, 526 op/s 2024-09-13T16:04:10.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:09 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:04:10.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:09 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:04:10.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:09 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:04:10.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:09 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:04:10.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:09 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:09 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:09 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:09 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:09 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:09 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:09 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:09 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:09 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:10.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:09 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:04:10.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:09 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:04:10.006 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:09 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:04:10.006 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:09 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:04:10.006 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:09 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:04:10.006 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:09 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:04:10.006 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:09 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.006 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:09 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.006 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:09 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.006 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:09 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.006 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:09 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.007 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:09 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.007 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:09 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.007 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:09 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.007 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:09 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:10.007 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:09 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:04:10.007 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:09 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:04:10.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:09 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T16:04:10.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:09 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T16:04:10.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:09 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T16:04:10.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:09 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:04:10.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:09 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:09 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:09 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:09 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:09 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:09 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:09 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:09 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T16:04:10.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:09 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:04:10.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:09 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:04:10.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:09 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:04:10.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 385.0 s, 630.4 tps, lat 149.551 ms stddev 177.390 2024-09-13T16:04:14.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:13 smithi193 ceph-mon[35248]: Adjusting osd_memory_target on smithi193 to 176.0M 2024-09-13T16:04:14.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:13 smithi193 ceph-mon[35248]: Unable to set osd_memory_target on smithi193 to 184596070: error parsing value: Value '184596070' is below minimum 939524096 2024-09-13T16:04:14.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:13 smithi193 ceph-mon[35248]: pgmap v578: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.6 MiB/s wr, 596 op/s 2024-09-13T16:04:14.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:13 smithi193 ceph-mon[35248]: pgmap v579: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 855 op/s 2024-09-13T16:04:14.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:13 smithi017 ceph-mon[30494]: Adjusting osd_memory_target on smithi193 to 176.0M 2024-09-13T16:04:14.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:13 smithi017 ceph-mon[30494]: Unable to set osd_memory_target on smithi193 to 184596070: error parsing value: Value '184596070' is below minimum 939524096 2024-09-13T16:04:14.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:13 smithi017 ceph-mon[30494]: pgmap v578: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.6 MiB/s wr, 596 op/s 2024-09-13T16:04:14.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:13 smithi017 ceph-mon[30494]: pgmap v579: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 855 op/s 2024-09-13T16:04:14.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:13 smithi189 ceph-mon[34790]: Adjusting osd_memory_target on smithi193 to 176.0M 2024-09-13T16:04:14.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:13 smithi189 ceph-mon[34790]: Unable to set osd_memory_target on smithi193 to 184596070: error parsing value: Value '184596070' is below minimum 939524096 2024-09-13T16:04:14.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:13 smithi189 ceph-mon[34790]: pgmap v578: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.6 MiB/s wr, 596 op/s 2024-09-13T16:04:14.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:13 smithi189 ceph-mon[34790]: pgmap v579: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 855 op/s 2024-09-13T16:04:15.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:14 smithi193 ceph-mon[35248]: pgmap v580: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 16 MiB/s wr, 1.31k op/s 2024-09-13T16:04:15.264 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:14 smithi017 ceph-mon[30494]: pgmap v580: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 16 MiB/s wr, 1.31k op/s 2024-09-13T16:04:15.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 390.0 s, 647.2 tps, lat 166.698 ms stddev 258.571 2024-09-13T16:04:15.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:14 smithi189 ceph-mon[34790]: pgmap v580: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 16 MiB/s wr, 1.31k op/s 2024-09-13T16:04:17.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:17 smithi193 ceph-mon[35248]: pgmap v581: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 15 MiB/s wr, 1.30k op/s 2024-09-13T16:04:17.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:17 smithi017 ceph-mon[30494]: pgmap v581: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 15 MiB/s wr, 1.30k op/s 2024-09-13T16:04:17.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:17 smithi189 ceph-mon[34790]: pgmap v581: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 15 MiB/s wr, 1.30k op/s 2024-09-13T16:04:18.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.511+0000 7fb496800640 1 -- 172.21.15.17:0/3796386667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb490105a10 msgr2=0x7fb490107e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.511+0000 7fb496800640 1 --2- 172.21.15.17:0/3796386667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb490105a10 0x7fb490107e80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb488009be0 tx=0x7fb48802a6c0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.511+0000 7fb496800640 1 -- 172.21.15.17:0/3796386667 shutdown_connections 2024-09-13T16:04:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.511+0000 7fb496800640 1 --2- 172.21.15.17:0/3796386667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb490105a10 0x7fb490107e80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.511+0000 7fb496800640 1 --2- 172.21.15.17:0/3796386667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4901030e0 0x7fb4901054d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.511+0000 7fb496800640 1 --2- 172.21.15.17:0/3796386667 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4901007b0 0x7fb490102ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.511+0000 7fb496800640 1 -- 172.21.15.17:0/3796386667 >> 172.21.15.17:0/3796386667 conn(0x7fb4900fa3b0 msgr2=0x7fb4900fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.511+0000 7fb496800640 1 -- 172.21.15.17:0/3796386667 shutdown_connections 2024-09-13T16:04:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.512+0000 7fb496800640 1 -- 172.21.15.17:0/3796386667 wait complete. 2024-09-13T16:04:18.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.513+0000 7fb496800640 1 Processor -- start 2024-09-13T16:04:18.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.513+0000 7fb496800640 1 -- start start 2024-09-13T16:04:18.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.514+0000 7fb496800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4901007b0 0x7fb490100120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:18.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.514+0000 7fb496800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4901030e0 0x7fb4900fe760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:18.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.514+0000 7fb496800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb490105a10 0x7fb4900feca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:18.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.514+0000 7fb496800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4900ff400 con 0x7fb4901007b0 2024-09-13T16:04:18.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.514+0000 7fb496800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4900ff570 con 0x7fb490105a10 2024-09-13T16:04:18.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.514+0000 7fb496800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49019ff50 con 0x7fb4901030e0 2024-09-13T16:04:18.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.514+0000 7fb48fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb490105a10 0x7fb4900feca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:18.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.514+0000 7fb48ea00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4901030e0 0x7fb4900fe760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:18.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.514+0000 7fb48fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb490105a10 0x7fb4900feca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:49274/0 (socket says 172.21.15.17:49274) 2024-09-13T16:04:18.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.514+0000 7fb48fe00640 1 -- 172.21.15.17:0/824214487 learned_addr learned my addr 172.21.15.17:0/824214487 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:18.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.515+0000 7fb48fe00640 1 -- 172.21.15.17:0/824214487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4901030e0 msgr2=0x7fb4900fe760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:18.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.515+0000 7fb48f400640 1 --2- 172.21.15.17:0/824214487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4901007b0 0x7fb490100120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:18.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.515+0000 7fb48fe00640 1 --2- 172.21.15.17:0/824214487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4901030e0 0x7fb4900fe760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.515+0000 7fb48fe00640 1 -- 172.21.15.17:0/824214487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4901007b0 msgr2=0x7fb490100120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:18.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.515+0000 7fb48fe00640 1 --2- 172.21.15.17:0/824214487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4901007b0 0x7fb490100120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.515+0000 7fb48fe00640 1 -- 172.21.15.17:0/824214487 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb488009840 con 0x7fb490105a10 2024-09-13T16:04:18.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.515+0000 7fb48fe00640 1 --2- 172.21.15.17:0/824214487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb490105a10 0x7fb4900feca0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb488030860 tx=0x7fb488003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:18.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.516+0000 7fb487e00640 1 -- 172.21.15.17:0/824214487 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb488004040 con 0x7fb490105a10 2024-09-13T16:04:18.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.516+0000 7fb487e00640 1 -- 172.21.15.17:0/824214487 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb488004660 con 0x7fb490105a10 2024-09-13T16:04:18.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.516+0000 7fb487e00640 1 -- 172.21.15.17:0/824214487 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb488031c30 con 0x7fb490105a10 2024-09-13T16:04:18.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.516+0000 7fb496800640 1 -- 172.21.15.17:0/824214487 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4901a01a0 con 0x7fb490105a10 2024-09-13T16:04:18.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.517+0000 7fb496800640 1 -- 172.21.15.17:0/824214487 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4901a06d0 con 0x7fb490105a10 2024-09-13T16:04:18.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.523+0000 7fb487e00640 1 -- 172.21.15.17:0/824214487 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb488038070 con 0x7fb490105a10 2024-09-13T16:04:18.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.524+0000 7fb49964e740 1 Processor -- start 2024-09-13T16:04:18.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.524+0000 7fb49964e740 1 -- start start 2024-09-13T16:04:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.525+0000 7fb49964e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec5a70 0x559f36ec5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.525+0000 7fb49964e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f36ec63b0 0x559f36ecae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.525+0000 7fb49964e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ecb440 0x559f36ecd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.525+0000 7fb49964e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36dd1bb0 con 0x559f36ec63b0 2024-09-13T16:04:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.525+0000 7fb49964e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36e2fa70 con 0x559f36ecb440 2024-09-13T16:04:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.525+0000 7fb49964e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36e2d200 con 0x559f36ec5a70 2024-09-13T16:04:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.525+0000 7fb48ea00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec5a70 0x559f36ec5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.525+0000 7fb48ea00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec5a70 0x559f36ec5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:59616/0 (socket says 172.21.15.17:59616) 2024-09-13T16:04:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.525+0000 7fb48ea00640 1 -- 172.21.15.17:0/3731045600 learned_addr learned my addr 172.21.15.17:0/3731045600 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.525+0000 7fb48ea00640 1 --2- 172.21.15.17:0/3731045600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ecb440 0x559f36ecd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.525+0000 7fb48f400640 1 --2- 172.21.15.17:0/3731045600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f36ec63b0 0x559f36ecae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.526+0000 7fb487e00640 1 --2- 172.21.15.17:0/824214487 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb4740a1210 0x7fb4740a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.526+0000 7fb48ea00640 1 -- 172.21.15.17:0/3731045600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ecb440 msgr2=0x559f36ecd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.526+0000 7fb48ea00640 1 --2- 172.21.15.17:0/3731045600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ecb440 0x559f36ecd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.526+0000 7fb48ea00640 1 -- 172.21.15.17:0/3731045600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f36ec63b0 msgr2=0x559f36ecae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.526+0000 7fb48ea00640 1 --2- 172.21.15.17:0/3731045600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f36ec63b0 0x559f36ecae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.526+0000 7fb48ea00640 1 -- 172.21.15.17:0/3731045600 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f36dca940 con 0x559f36ec5a70 2024-09-13T16:04:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.526+0000 7fb48ea00640 1 --2- 172.21.15.17:0/3731045600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec5a70 0x559f36ec5e70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb480017700 tx=0x7fb4800094d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91e3233666af7271 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.526+0000 7fb48fe00640 1 --2- 172.21.15.17:0/824214487 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb4740a1210 0x7fb4740a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.527+0000 7fb484c00640 1 -- 172.21.15.17:0/3731045600 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480017e90 con 0x559f36ec5a70 2024-09-13T16:04:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.527+0000 7fb487e00640 1 -- 172.21.15.17:0/824214487 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fb4880ed190 con 0x7fb490105a10 2024-09-13T16:04:18.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.527+0000 7fb484c00640 1 -- 172.21.15.17:0/3731045600 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb480015c20 con 0x559f36ec5a70 2024-09-13T16:04:18.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.527+0000 7fb484c00640 1 -- 172.21.15.17:0/3731045600 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480018ad0 con 0x559f36ec5a70 2024-09-13T16:04:18.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.530+0000 7fb49964e740 1 -- 172.21.15.17:0/3731045600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec5a70 msgr2=0x559f36ec5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:18.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.530+0000 7fb49964e740 1 --2- 172.21.15.17:0/3731045600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec5a70 0x559f36ec5e70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb480017700 tx=0x7fb4800094d0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.530+0000 7fb48fe00640 1 --2- 172.21.15.17:0/824214487 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb4740a1210 0x7fb4740a36d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb4880ba220 tx=0x7fb488047000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:18.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.530+0000 7fb49964e740 1 -- 172.21.15.17:0/3731045600 shutdown_connections 2024-09-13T16:04:18.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.530+0000 7fb49964e740 1 --2- 172.21.15.17:0/3731045600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ecb440 0x559f36ecd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.530+0000 7fb49964e740 1 --2- 172.21.15.17:0/3731045600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f36ec63b0 0x559f36ecae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.530+0000 7fb49964e740 1 --2- 172.21.15.17:0/3731045600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec5a70 0x559f36ec5e70 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.530+0000 7fb49964e740 1 -- 172.21.15.17:0/3731045600 >> 172.21.15.17:0/3731045600 conn(0x559f36ec10e0 msgr2=0x559f36ec14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:18.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.531+0000 7fb49964e740 1 -- 172.21.15.17:0/3731045600 shutdown_connections 2024-09-13T16:04:18.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.531+0000 7fb49964e740 1 -- 172.21.15.17:0/3731045600 wait complete. 2024-09-13T16:04:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.533+0000 7fb49964e740 1 -- start start 2024-09-13T16:04:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.533+0000 7fb49964e740 1 Processor -- start 2024-09-13T16:04:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.534+0000 7fb49964e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f36ec5a70 0x559f36ed7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.534+0000 7fb49964e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec63b0 0x559f36ed8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.535+0000 7fb48ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f36ec5a70 0x559f36ed7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.538+0000 7fb49964e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ecb440 0x559f36edf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.538+0000 7fb49964e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36e28af0 con 0x559f36ec5a70 2024-09-13T16:04:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.538+0000 7fb49964e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36de6f20 con 0x559f36ecb440 2024-09-13T16:04:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.538+0000 7fb49964e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36de6bc0 con 0x559f36ec63b0 2024-09-13T16:04:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.538+0000 7fb49964e740 10 client.0 _ll_register_callbacks cb 0x559f36e18a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:04:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.538+0000 7fb48f400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec63b0 0x559f36ed8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.538+0000 7fb48f400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec63b0 0x559f36ed8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:59618/0 (socket says 172.21.15.17:59618) 2024-09-13T16:04:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.538+0000 7fb48f400640 1 -- 172.21.15.17:0/908651466 learned_addr learned my addr 172.21.15.17:0/908651466 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.538+0000 7fb48ea00640 1 --2- 172.21.15.17:0/908651466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ecb440 0x559f36edf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.539+0000 7fb48f400640 1 -- 172.21.15.17:0/908651466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ecb440 msgr2=0x559f36edf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.539+0000 7fb48f400640 1 --2- 172.21.15.17:0/908651466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ecb440 0x559f36edf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.539+0000 7fb48f400640 1 -- 172.21.15.17:0/908651466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f36ec5a70 msgr2=0x559f36ed7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.539+0000 7fb48f400640 1 --2- 172.21.15.17:0/908651466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f36ec5a70 0x559f36ed7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.539+0000 7fb48f400640 1 -- 172.21.15.17:0/908651466 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4800173e0 con 0x559f36ec63b0 2024-09-13T16:04:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.539+0000 7fb48ea00640 1 --2- 172.21.15.17:0/908651466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ecb440 0x559f36edf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:04:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.540+0000 7fb48f400640 1 --2- 172.21.15.17:0/908651466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec63b0 0x559f36ed8510 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00dd50 tx=0x7fb47c00f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9f96cede4da12c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.540+0000 7fb479600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:04:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.540+0000 7fb479600640 1 -- 172.21.15.17:0/908651466 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c011650 con 0x559f36ec63b0 2024-09-13T16:04:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.540+0000 7fb479600640 1 -- 172.21.15.17:0/908651466 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fb47c015070 con 0x559f36ec63b0 2024-09-13T16:04:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.540+0000 7fb49964e740 1 -- 172.21.15.17:0/908651466 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f36e52c90 con 0x559f36ec63b0 2024-09-13T16:04:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.540+0000 7fb479600640 1 -- 172.21.15.17:0/908651466 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb47c0117b0 con 0x559f36ec63b0 2024-09-13T16:04:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.540+0000 7fb49964e740 10 client.25882 fetch_fsmap learned FSMap version 37 2024-09-13T16:04:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.540+0000 7fb49964e740 1 -- 172.21.15.17:0/908651466 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x559f36e27170 con 0x559f36ec63b0 2024-09-13T16:04:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.541+0000 7fb479600640 1 -- 172.21.15.17:0/908651466 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb47c011dd0 con 0x559f36ec63b0 2024-09-13T16:04:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.541+0000 7fb479600640 1 -- 172.21.15.17:0/908651466 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 37) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fb47c019b50 con 0x559f36ec63b0 2024-09-13T16:04:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.541+0000 7fb49964e740 10 client.25882 fetch_fsmap finished waiting for FSMap version 37 2024-09-13T16:04:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.541+0000 7fb49964e740 10 client.25882 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:04:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.541+0000 7fb49964e740 20 client.25882 populate_metadata read hostname 'smithi017' 2024-09-13T16:04:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.541+0000 7fb49964e740 1 --2- 172.21.15.17:0/908651466 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x559f36ee3c70 0x559f36ee60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.541+0000 7fb49964e740 4 client.25882 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:04:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.541+0000 7fb49964e740 1 -- 172.21.15.17:0/908651466 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f36e52c90 con 0x559f36ee3c70 2024-09-13T16:04:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.541+0000 7fb48ea00640 1 --2- 172.21.15.17:0/908651466 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x559f36ee3c70 0x559f36ee60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.542+0000 7fb48ea00640 1 --2- 172.21.15.17:0/908651466 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x559f36ee3c70 0x559f36ee60b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1e5864c40156fd1 server_cookie=28112247597ee9eb in_seq=0 out_seq=0 2024-09-13T16:04:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.542+0000 7fb479600640 10 client.25882 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:04:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.543+0000 7fb479600640 1 -- 172.21.15.17:0/908651466 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559f36e52c90 con 0x559f36ee3c70 2024-09-13T16:04:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.543+0000 7fb479600640 10 client.25882 handle_command_reply: tid=0 2024-09-13T16:04:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.543+0000 7fb49964e740 1 client.25882 shutdown 2024-09-13T16:04:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.548+0000 7fb49964e740 1 -- 172.21.15.17:0/908651466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec63b0 msgr2=0x559f36ed8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.548+0000 7fb49964e740 1 --2- 172.21.15.17:0/908651466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec63b0 0x559f36ed8510 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00dd50 tx=0x7fb47c00f730 comp rx=0 tx=0).stop 2024-09-13T16:04:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.548+0000 7fb49964e740 1 -- 172.21.15.17:0/908651466 shutdown_connections 2024-09-13T16:04:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.548+0000 7fb49964e740 1 --2- 172.21.15.17:0/908651466 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x559f36ee3c70 0x559f36ee60b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.548+0000 7fb49964e740 1 --2- 172.21.15.17:0/908651466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ecb440 0x559f36edf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.548+0000 7fb49964e740 1 --2- 172.21.15.17:0/908651466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec63b0 0x559f36ed8510 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.548+0000 7fb49964e740 1 --2- 172.21.15.17:0/908651466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f36ec5a70 0x559f36ed7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.548+0000 7fb479600640 0 client.25882 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:04:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.548+0000 7fb49964e740 1 -- 172.21.15.17:0/908651466 >> 172.21.15.17:0/908651466 conn(0x559f36ec10e0 msgr2=0x559f36ec28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.549+0000 7fb49964e740 1 -- 172.21.15.17:0/908651466 shutdown_connections 2024-09-13T16:04:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.549+0000 7fb49964e740 1 -- 172.21.15.17:0/908651466 wait complete. 2024-09-13T16:04:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.549+0000 7fb49964e740 20 client.25882 trim_cache size 0 max 16384 2024-09-13T16:04:18.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.579+0000 7fb49964e740 1 Processor -- start 2024-09-13T16:04:18.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.579+0000 7fb49964e740 1 -- start start 2024-09-13T16:04:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.580+0000 7fb49964e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec5a70 0x559f36ec7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.580+0000 7fb49964e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ec63b0 0x559f36ec7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.580+0000 7fb49964e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f36ecb440 0x559f36edf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.580+0000 7fb49964e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36ec0fa0 con 0x559f36ecb440 2024-09-13T16:04:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.580+0000 7fb49964e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36b8fe60 con 0x559f36ec63b0 2024-09-13T16:04:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.580+0000 7fb49964e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36ec6f80 con 0x559f36ec5a70 2024-09-13T16:04:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.580+0000 7fb48f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ec63b0 0x559f36ec7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.581+0000 7fb48f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ec63b0 0x559f36ec7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:49296/0 (socket says 172.21.15.17:49296) 2024-09-13T16:04:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.581+0000 7fb48f400640 1 -- 172.21.15.17:0/2569007520 learned_addr learned my addr 172.21.15.17:0/2569007520 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.581+0000 7fb48ea00640 1 --2- 172.21.15.17:0/2569007520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec5a70 0x559f36ec7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:18.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.581+0000 7fb48ea00640 1 --2- 172.21.15.17:0/2569007520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f36ecb440 0x559f36edf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:18.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.581+0000 7fb48ea00640 1 -- 172.21.15.17:0/2569007520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ec63b0 msgr2=0x559f36ec7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:18.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.581+0000 7fb48ea00640 1 --2- 172.21.15.17:0/2569007520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ec63b0 0x559f36ec7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.581+0000 7fb48ea00640 1 -- 172.21.15.17:0/2569007520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f36ecb440 msgr2=0x559f36edf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:18.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.581+0000 7fb48ea00640 1 --2- 172.21.15.17:0/2569007520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f36ecb440 0x559f36edf4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.581+0000 7fb48ea00640 1 -- 172.21.15.17:0/2569007520 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f36dc9180 con 0x559f36ec5a70 2024-09-13T16:04:18.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.582+0000 7fb48ea00640 1 --2- 172.21.15.17:0/2569007520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec5a70 0x559f36ec7410 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb480018010 tx=0x7fb480023040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b111a4e7367ea297 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:18.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.582+0000 7fb485600640 1 -- 172.21.15.17:0/2569007520 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480026040 con 0x559f36ec5a70 2024-09-13T16:04:18.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.582+0000 7fb485600640 1 -- 172.21.15.17:0/2569007520 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb480027040 con 0x559f36ec5a70 2024-09-13T16:04:18.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.582+0000 7fb485600640 1 -- 172.21.15.17:0/2569007520 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4800189b0 con 0x559f36ec5a70 2024-09-13T16:04:18.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.583+0000 7fb49964e740 1 -- 172.21.15.17:0/2569007520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec5a70 msgr2=0x559f36ec7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:18.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.583+0000 7fb49964e740 1 --2- 172.21.15.17:0/2569007520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec5a70 0x559f36ec7410 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb480018010 tx=0x7fb480023040 comp rx=0 tx=0).stop 2024-09-13T16:04:18.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.584+0000 7fb49964e740 1 -- 172.21.15.17:0/2569007520 shutdown_connections 2024-09-13T16:04:18.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.584+0000 7fb49964e740 1 --2- 172.21.15.17:0/2569007520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f36ecb440 0x559f36edf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.584+0000 7fb49964e740 1 --2- 172.21.15.17:0/2569007520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ec63b0 0x559f36ec7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.584+0000 7fb49964e740 1 --2- 172.21.15.17:0/2569007520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec5a70 0x559f36ec7410 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.584+0000 7fb49964e740 1 -- 172.21.15.17:0/2569007520 >> 172.21.15.17:0/2569007520 conn(0x559f36ec10e0 msgr2=0x559f36ed7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:18.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.584+0000 7fb49964e740 1 -- 172.21.15.17:0/2569007520 shutdown_connections 2024-09-13T16:04:18.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.584+0000 7fb49964e740 1 -- 172.21.15.17:0/2569007520 wait complete. 2024-09-13T16:04:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.584+0000 7fb49964e740 1 -- start start 2024-09-13T16:04:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.585+0000 7fb49964e740 1 Processor -- start 2024-09-13T16:04:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.585+0000 7fb49964e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f36ec5a70 0x559f36edf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.585+0000 7fb49964e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec63b0 0x559f36eddae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.586+0000 7fb48f400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec63b0 0x559f36eddae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.586+0000 7fb48f400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec63b0 0x559f36eddae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:59632/0 (socket says 172.21.15.17:59632) 2024-09-13T16:04:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.586+0000 7fb48f400640 1 -- 172.21.15.17:0/724628281 learned_addr learned my addr 172.21.15.17:0/724628281 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.586+0000 7fb48ea00640 1 --2- 172.21.15.17:0/724628281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f36ec5a70 0x559f36edf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.586+0000 7fb49964e740 1 --2- 172.21.15.17:0/724628281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ecb440 0x559f36ede0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.587+0000 7fb49964e740 1 -- 172.21.15.17:0/724628281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36ede7a0 con 0x559f36ec5a70 2024-09-13T16:04:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.587+0000 7fb49964e740 1 -- 172.21.15.17:0/724628281 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36ede910 con 0x559f36ecb440 2024-09-13T16:04:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.587+0000 7fb49964e740 1 -- 172.21.15.17:0/724628281 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36f3a1c0 con 0x559f36ec63b0 2024-09-13T16:04:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.587+0000 7fb49964e740 10 client.0 _ll_register_callbacks cb 0x7fb480009820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:04:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.588+0000 7fb48f400640 1 -- 172.21.15.17:0/724628281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ecb440 msgr2=0x559f36ede0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.588+0000 7fb48ea00640 1 --2- 172.21.15.17:0/724628281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ecb440 0x559f36ede0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.588+0000 7fb48f400640 1 --2- 172.21.15.17:0/724628281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ecb440 0x559f36ede0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.588+0000 7fb48f400640 1 -- 172.21.15.17:0/724628281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f36ec5a70 msgr2=0x559f36edf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.588+0000 7fb48f400640 1 --2- 172.21.15.17:0/724628281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f36ec5a70 0x559f36edf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.588+0000 7fb48f400640 1 -- 172.21.15.17:0/724628281 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f36dca940 con 0x559f36ec63b0 2024-09-13T16:04:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.588+0000 7fb48ea00640 1 --2- 172.21.15.17:0/724628281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ecb440 0x559f36ede0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:04:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.590+0000 7fb48f400640 1 --2- 172.21.15.17:0/724628281 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec63b0 0x559f36eddae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00de40 tx=0x7fb47c0056a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b52dab7ebe010ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.590+0000 7fb479600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:04:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.590+0000 7fb479600640 1 -- 172.21.15.17:0/724628281 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c018970 con 0x559f36ec63b0 2024-09-13T16:04:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.590+0000 7fb479600640 1 -- 172.21.15.17:0/724628281 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fb47c015040 con 0x559f36ec63b0 2024-09-13T16:04:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.590+0000 7fb49964e740 1 -- 172.21.15.17:0/724628281 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb480015c20 con 0x559f36ec63b0 2024-09-13T16:04:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.591+0000 7fb479600640 1 -- 172.21.15.17:0/724628281 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb47c018ad0 con 0x559f36ec63b0 2024-09-13T16:04:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.591+0000 7fb49964e740 10 client.25888 fetch_fsmap learned FSMap version 37 2024-09-13T16:04:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.591+0000 7fb49964e740 1 -- 172.21.15.17:0/724628281 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x559f36dee560 con 0x559f36ec63b0 2024-09-13T16:04:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.591+0000 7fb479600640 1 -- 172.21.15.17:0/724628281 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb480015c20 con 0x559f36ec63b0 2024-09-13T16:04:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.591+0000 7fb479600640 1 -- 172.21.15.17:0/724628281 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 37) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fb47c019420 con 0x559f36ec63b0 2024-09-13T16:04:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.592+0000 7fb49964e740 10 client.25888 fetch_fsmap finished waiting for FSMap version 37 2024-09-13T16:04:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.592+0000 7fb49964e740 10 client.25888 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:04:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.592+0000 7fb49964e740 20 client.25888 populate_metadata read hostname 'smithi017' 2024-09-13T16:04:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.592+0000 7fb49964e740 1 --2- 172.21.15.17:0/724628281 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x559f36f3bbf0 0x559f36f3e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.592+0000 7fb49964e740 4 client.25888 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:04:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.592+0000 7fb49964e740 1 -- 172.21.15.17:0/724628281 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559f36e1b7d0 con 0x559f36f3bbf0 2024-09-13T16:04:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.592+0000 7fb48ea00640 1 --2- 172.21.15.17:0/724628281 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x559f36f3bbf0 0x559f36f3e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:18.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.594+0000 7fb48ea00640 1 --2- 172.21.15.17:0/724628281 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x559f36f3bbf0 0x559f36f3e010 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c8b013621cf0540 server_cookie=194cc7579a33c165 in_seq=0 out_seq=0 2024-09-13T16:04:18.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.594+0000 7fb479600640 10 client.25888 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:04:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.616+0000 7fb479600640 1 -- 172.21.15.17:0/724628281 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559f36e1b7d0 con 0x559f36f3bbf0 2024-09-13T16:04:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.616+0000 7fb479600640 10 client.25888 handle_command_reply: tid=0 2024-09-13T16:04:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.616+0000 7fb49964e740 1 client.25888 shutdown 2024-09-13T16:04:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.616+0000 7fb49964e740 1 -- 172.21.15.17:0/724628281 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec63b0 msgr2=0x559f36eddae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.616+0000 7fb49964e740 1 --2- 172.21.15.17:0/724628281 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec63b0 0x559f36eddae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00de40 tx=0x7fb47c0056a0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.617+0000 7fb49964e740 1 -- 172.21.15.17:0/724628281 shutdown_connections 2024-09-13T16:04:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.617+0000 7fb49964e740 1 --2- 172.21.15.17:0/724628281 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x559f36f3bbf0 0x559f36f3e010 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.617+0000 7fb49964e740 1 --2- 172.21.15.17:0/724628281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559f36ecb440 0x559f36ede0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.617+0000 7fb49964e740 1 --2- 172.21.15.17:0/724628281 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559f36ec63b0 0x559f36eddae0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.617+0000 7fb49964e740 1 --2- 172.21.15.17:0/724628281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f36ec5a70 0x559f36edf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.617+0000 7fb479600640 0 client.25888 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:04:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.617+0000 7fb49964e740 1 -- 172.21.15.17:0/724628281 >> 172.21.15.17:0/724628281 conn(0x559f36ec10e0 msgr2=0x559f36ed7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.618+0000 7fb49964e740 1 -- 172.21.15.17:0/724628281 shutdown_connections 2024-09-13T16:04:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.618+0000 7fb49964e740 1 -- 172.21.15.17:0/724628281 wait complete. 2024-09-13T16:04:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.619+0000 7fb49964e740 20 client.25888 trim_cache size 0 max 16384 2024-09-13T16:04:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:04:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:04:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:04:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:04:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.619+0000 7fb496800640 1 -- 172.21.15.17:0/824214487 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb4740a1210 msgr2=0x7fb4740a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.619+0000 7fb496800640 1 --2- 172.21.15.17:0/824214487 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb4740a1210 0x7fb4740a36d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb4880ba220 tx=0x7fb488047000 comp rx=0 tx=0).stop 2024-09-13T16:04:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.619+0000 7fb496800640 1 -- 172.21.15.17:0/824214487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb490105a10 msgr2=0x7fb4900feca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.619+0000 7fb496800640 1 --2- 172.21.15.17:0/824214487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb490105a10 0x7fb4900feca0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb488030860 tx=0x7fb488003c10 comp rx=0 tx=0).stop 2024-09-13T16:04:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.620+0000 7fb496800640 1 -- 172.21.15.17:0/824214487 shutdown_connections 2024-09-13T16:04:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.620+0000 7fb496800640 1 --2- 172.21.15.17:0/824214487 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb4740a1210 0x7fb4740a36d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.620+0000 7fb496800640 1 --2- 172.21.15.17:0/824214487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb490105a10 0x7fb4900feca0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.620+0000 7fb496800640 1 --2- 172.21.15.17:0/824214487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4901030e0 0x7fb4900fe760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.620+0000 7fb496800640 1 --2- 172.21.15.17:0/824214487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4901007b0 0x7fb490100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.620+0000 7fb496800640 1 -- 172.21.15.17:0/824214487 >> 172.21.15.17:0/824214487 conn(0x7fb4900fa3b0 msgr2=0x7fb490101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.620+0000 7fb496800640 1 -- 172.21.15.17:0/824214487 shutdown_connections 2024-09-13T16:04:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:18.620+0000 7fb496800640 1 -- 172.21.15.17:0/824214487 wait complete. 2024-09-13T16:04:19.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:19 smithi193 ceph-mon[35248]: pgmap v582: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 15 MiB/s wr, 1.28k op/s 2024-09-13T16:04:19.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:19 smithi017 ceph-mon[30494]: pgmap v582: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 15 MiB/s wr, 1.28k op/s 2024-09-13T16:04:19.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:19 smithi189 ceph-mon[34790]: pgmap v582: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 15 MiB/s wr, 1.28k op/s 2024-09-13T16:04:20.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 395.0 s, 668.8 tps, lat 142.390 ms stddev 174.784 2024-09-13T16:04:21.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:21 smithi193 ceph-mon[35248]: pgmap v583: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 15 MiB/s wr, 1.33k op/s 2024-09-13T16:04:21.764 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:21 smithi017 ceph-mon[30494]: pgmap v583: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 15 MiB/s wr, 1.33k op/s 2024-09-13T16:04:21.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:21 smithi189 ceph-mon[34790]: pgmap v583: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 15 MiB/s wr, 1.33k op/s 2024-09-13T16:04:23.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:23 smithi193 ceph-mon[35248]: pgmap v584: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 14 MiB/s wr, 1.32k op/s 2024-09-13T16:04:23.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:23 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:04:23.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:23 smithi017 ceph-mon[30494]: pgmap v584: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 14 MiB/s wr, 1.32k op/s 2024-09-13T16:04:23.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:23 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:04:23.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:23 smithi189 ceph-mon[34790]: pgmap v584: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 14 MiB/s wr, 1.32k op/s 2024-09-13T16:04:23.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:23 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:04:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 400.0 s, 877.2 tps, lat 118.116 ms stddev 163.221 2024-09-13T16:04:25.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:25 smithi193 ceph-mon[35248]: pgmap v585: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 12 MiB/s wr, 1.13k op/s 2024-09-13T16:04:25.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:25 smithi017 ceph-mon[30494]: pgmap v585: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 12 MiB/s wr, 1.13k op/s 2024-09-13T16:04:25.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:25 smithi189 ceph-mon[34790]: pgmap v585: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 12 MiB/s wr, 1.13k op/s 2024-09-13T16:04:27.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:27 smithi189 ceph-mon[34790]: pgmap v586: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 6.8 MiB/s wr, 655 op/s 2024-09-13T16:04:28.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:27 smithi193 ceph-mon[35248]: pgmap v586: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 6.8 MiB/s wr, 655 op/s 2024-09-13T16:04:28.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:27 smithi017 ceph-mon[30494]: pgmap v586: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 6.8 MiB/s wr, 655 op/s 2024-09-13T16:04:28.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:28 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:04:29.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:28 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:04:29.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:28 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:04:29.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:29 smithi189 ceph-mon[34790]: pgmap v587: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.8 MiB/s wr, 624 op/s 2024-09-13T16:04:30.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:29 smithi193 ceph-mon[35248]: pgmap v587: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.8 MiB/s wr, 624 op/s 2024-09-13T16:04:30.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:29 smithi017 ceph-mon[30494]: pgmap v587: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.8 MiB/s wr, 624 op/s 2024-09-13T16:04:30.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 405.0 s, 627.0 tps, lat 157.946 ms stddev 180.167 2024-09-13T16:04:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.817+0000 7fe1d2000640 1 -- 172.21.15.17:0/3114729386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1cc107d30 msgr2=0x7fe1cc10e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.817+0000 7fe1d2000640 1 --2- 172.21.15.17:0/3114729386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1cc107d30 0x7fe1cc10e5e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4009be0 tx=0x7fe1c402a6c0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.817+0000 7fe1d2000640 1 -- 172.21.15.17:0/3114729386 shutdown_connections 2024-09-13T16:04:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.817+0000 7fe1d2000640 1 --2- 172.21.15.17:0/3114729386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1cc107d30 0x7fe1cc10e5e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.817+0000 7fe1d2000640 1 --2- 172.21.15.17:0/3114729386 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1cc107390 0x7fe1cc1077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.817+0000 7fe1d2000640 1 --2- 172.21.15.17:0/3114729386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1cc106680 0x7fe1cc106a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.817+0000 7fe1d2000640 1 -- 172.21.15.17:0/3114729386 >> 172.21.15.17:0/3114729386 conn(0x7fe1cc0696e0 msgr2=0x7fe1cc077b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:31.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.817+0000 7fe1d2000640 1 -- 172.21.15.17:0/3114729386 shutdown_connections 2024-09-13T16:04:31.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.817+0000 7fe1d2000640 1 -- 172.21.15.17:0/3114729386 wait complete. 2024-09-13T16:04:31.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.818+0000 7fe1d2000640 1 Processor -- start 2024-09-13T16:04:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.819+0000 7fe1d2000640 1 -- start start 2024-09-13T16:04:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.820+0000 7fe1d2000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1cc106680 0x7fe1cc19c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.820+0000 7fe1d2000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1cc107390 0x7fe1cc19c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.820+0000 7fe1d2000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1cc107d30 0x7fe1cc1a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.820+0000 7fe1d2000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc1a3c50 con 0x7fe1cc107390 2024-09-13T16:04:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.820+0000 7fe1d2000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc1a3dc0 con 0x7fe1cc106680 2024-09-13T16:04:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.820+0000 7fe1d2000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc1a3f80 con 0x7fe1cc107d30 2024-09-13T16:04:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.820+0000 7fe1d1600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1cc107d30 0x7fe1cc1a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.820+0000 7fe1d0c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1cc106680 0x7fe1cc19c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.820+0000 7fe1d1600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1cc107d30 0x7fe1cc1a3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:60120/0 (socket says 172.21.15.17:60120) 2024-09-13T16:04:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.820+0000 7fe1d1600640 1 -- 172.21.15.17:0/411466783 learned_addr learned my addr 172.21.15.17:0/411466783 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.821+0000 7fe1cbe00640 1 --2- 172.21.15.17:0/411466783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1cc107390 0x7fe1cc19c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.821+0000 7fe1d0c00640 1 -- 172.21.15.17:0/411466783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1cc107d30 msgr2=0x7fe1cc1a3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.821+0000 7fe1d0c00640 1 --2- 172.21.15.17:0/411466783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1cc107d30 0x7fe1cc1a3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.821+0000 7fe1d0c00640 1 -- 172.21.15.17:0/411466783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1cc107390 msgr2=0x7fe1cc19c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.821+0000 7fe1d0c00640 1 --2- 172.21.15.17:0/411466783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1cc107390 0x7fe1cc19c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.821+0000 7fe1d0c00640 1 -- 172.21.15.17:0/411466783 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b8009560 con 0x7fe1cc106680 2024-09-13T16:04:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.822+0000 7fe1cbe00640 1 --2- 172.21.15.17:0/411466783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1cc107390 0x7fe1cc19c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:04:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.822+0000 7fe1d1600640 1 --2- 172.21.15.17:0/411466783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1cc107d30 0x7fe1cc1a3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:04:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.822+0000 7fe1d0c00640 1 --2- 172.21.15.17:0/411466783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1cc106680 0x7fe1cc19c160 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe1c000b3f0 tx=0x7fe1c000b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:31.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.823+0000 7fe1c9600640 1 -- 172.21.15.17:0/411466783 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0011830 con 0x7fe1cc106680 2024-09-13T16:04:31.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.823+0000 7fe1c9600640 1 -- 172.21.15.17:0/411466783 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1c0011e50 con 0x7fe1cc106680 2024-09-13T16:04:31.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.823+0000 7fe1c9600640 1 -- 172.21.15.17:0/411466783 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c000f2e0 con 0x7fe1cc106680 2024-09-13T16:04:31.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.823+0000 7fe1d2000640 1 -- 172.21.15.17:0/411466783 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c4009840 con 0x7fe1cc106680 2024-09-13T16:04:31.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.823+0000 7fe1d2000640 1 -- 172.21.15.17:0/411466783 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1cc1a4610 con 0x7fe1cc106680 2024-09-13T16:04:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.830+0000 7fe1d63be740 1 Processor -- start 2024-09-13T16:04:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.831+0000 7fe1d63be740 1 -- start start 2024-09-13T16:04:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.832+0000 7fe1d63be740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0d6ee3c80 0x55d0d6ee4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.832+0000 7fe1d63be740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d0d6ee45c0 0x55d0d6ee9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.832+0000 7fe1d63be740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 0x55d0d6eebb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.832+0000 7fe1d63be740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0d6defbb0 con 0x55d0d6ee45c0 2024-09-13T16:04:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.832+0000 7fe1d63be740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0d6e4da70 con 0x55d0d6ee9650 2024-09-13T16:04:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.832+0000 7fe1d63be740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0d6e4b200 con 0x55d0d6ee3c80 2024-09-13T16:04:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.833+0000 7fe1d1600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0d6ee3c80 0x55d0d6ee4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.833+0000 7fe1d1600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0d6ee3c80 0x55d0d6ee4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:60128/0 (socket says 172.21.15.17:60128) 2024-09-13T16:04:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.833+0000 7fe1d1600640 1 -- 172.21.15.17:0/702145138 learned_addr learned my addr 172.21.15.17:0/702145138 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.834+0000 7fe1cbe00640 1 --2- 172.21.15.17:0/702145138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 0x55d0d6eebb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.834+0000 7fe1d1600640 1 -- 172.21.15.17:0/702145138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 msgr2=0x55d0d6eebb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.834+0000 7fe1d1600640 1 --2- 172.21.15.17:0/702145138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 0x55d0d6eebb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.834+0000 7fe1d1600640 1 -- 172.21.15.17:0/702145138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d0d6ee45c0 msgr2=0x55d0d6ee9080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:04:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.834+0000 7fe1d1600640 1 --2- 172.21.15.17:0/702145138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d0d6ee45c0 0x55d0d6ee9080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.835+0000 7fe1d1600640 1 -- 172.21.15.17:0/702145138 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0d6de8940 con 0x55d0d6ee3c80 2024-09-13T16:04:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.836+0000 7fe1d1600640 1 --2- 172.21.15.17:0/702145138 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0d6ee3c80 0x55d0d6ee4080 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40303a0 tx=0x7fe1c40303d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b92bb918e660a7e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.836+0000 7fe1be000640 1 -- 172.21.15.17:0/702145138 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4030c30 con 0x55d0d6ee3c80 2024-09-13T16:04:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.837+0000 7fe1c9600640 1 -- 172.21.15.17:0/411466783 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe1c00105f0 con 0x7fe1cc106680 2024-09-13T16:04:31.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.837+0000 7fe1be000640 1 -- 172.21.15.17:0/702145138 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1c4030d90 con 0x55d0d6ee3c80 2024-09-13T16:04:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.843+0000 7fe1be000640 1 -- 172.21.15.17:0/702145138 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c40048a0 con 0x55d0d6ee3c80 2024-09-13T16:04:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.844+0000 7fe1d63be740 1 -- 172.21.15.17:0/702145138 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0d6ee3c80 msgr2=0x55d0d6ee4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.844+0000 7fe1d63be740 1 --2- 172.21.15.17:0/702145138 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0d6ee3c80 0x55d0d6ee4080 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40303a0 tx=0x7fe1c40303d0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.847+0000 7fe1c9600640 1 --2- 172.21.15.17:0/411466783 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe1b40a11b0 0x7fe1b40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.848+0000 7fe1c9600640 1 -- 172.21.15.17:0/411466783 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fe1c00cc7e0 con 0x7fe1cc106680 2024-09-13T16:04:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.849+0000 7fe1d63be740 1 -- 172.21.15.17:0/702145138 shutdown_connections 2024-09-13T16:04:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.849+0000 7fe1d63be740 1 --2- 172.21.15.17:0/702145138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 0x55d0d6eebb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.849+0000 7fe1d63be740 1 --2- 172.21.15.17:0/702145138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d0d6ee45c0 0x55d0d6ee9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.849+0000 7fe1d63be740 1 --2- 172.21.15.17:0/702145138 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0d6ee3c80 0x55d0d6ee4080 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.849+0000 7fe1d63be740 1 -- 172.21.15.17:0/702145138 >> 172.21.15.17:0/702145138 conn(0x55d0d6edf2f0 msgr2=0x55d0d6edf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.850+0000 7fe1d1600640 1 --2- 172.21.15.17:0/411466783 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe1b40a11b0 0x7fe1b40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.851+0000 7fe1d63be740 1 -- 172.21.15.17:0/702145138 shutdown_connections 2024-09-13T16:04:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.851+0000 7fe1d63be740 1 -- 172.21.15.17:0/702145138 wait complete. 2024-09-13T16:04:31.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.852+0000 7fe1d63be740 1 -- start start 2024-09-13T16:04:31.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.853+0000 7fe1d63be740 1 Processor -- start 2024-09-13T16:04:31.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:31 smithi189 ceph-mon[34790]: pgmap v588: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.2 MiB/s wr, 668 op/s 2024-09-13T16:04:31.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.856+0000 7fe1d63be740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0d6ee3c80 0x55d0d6eed930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:31.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.857+0000 7fe1d63be740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d0d6ee45c0 0x55d0d6eede70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:31.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.857+0000 7fe1d63be740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 0x55d0d6ef4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:31.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.857+0000 7fe1d63be740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0d6e46af0 con 0x55d0d6ee45c0 2024-09-13T16:04:31.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.857+0000 7fe1d63be740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0d6e04f20 con 0x55d0d6ee9650 2024-09-13T16:04:31.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.857+0000 7fe1d63be740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0d6e04bc0 con 0x55d0d6ee3c80 2024-09-13T16:04:31.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.857+0000 7fe1d1600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 0x55d0d6ef4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:31.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.857+0000 7fe1d63be740 10 client.0 _ll_register_callbacks cb 0x55d0d6e36a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:04:31.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.857+0000 7fe1d1600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 0x55d0d6ef4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:41656/0 (socket says 172.21.15.17:41656) 2024-09-13T16:04:31.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.857+0000 7fe1d1600640 1 -- 172.21.15.17:0/914222807 learned_addr learned my addr 172.21.15.17:0/914222807 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:31.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.858+0000 7fe1d1600640 1 --2- 172.21.15.17:0/411466783 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe1b40a11b0 0x7fe1b40a3670 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4009b30 tx=0x7fe1c40043a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:31.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.858+0000 7fe1d1600640 1 -- 172.21.15.17:0/914222807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0d6ee3c80 msgr2=0x55d0d6eed930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:31.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.858+0000 7fe1d1600640 1 --2- 172.21.15.17:0/914222807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0d6ee3c80 0x55d0d6eed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.858+0000 7fe1d1600640 1 -- 172.21.15.17:0/914222807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d0d6ee45c0 msgr2=0x55d0d6eede70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:31.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.858+0000 7fe1d1600640 1 --2- 172.21.15.17:0/914222807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d0d6ee45c0 0x55d0d6eede70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.858+0000 7fe1d1600640 1 -- 172.21.15.17:0/914222807 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1cc10eee0 con 0x55d0d6ee9650 2024-09-13T16:04:31.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.859+0000 7fe1d1600640 1 --2- 172.21.15.17:0/914222807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 0x55d0d6ef4e60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40303a0 tx=0x7fe1c4009280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1d27114f6b4e09a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:31.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.860+0000 7fe1b2a00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:04:31.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.860+0000 7fe1b2a00640 1 -- 172.21.15.17:0/914222807 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4049040 con 0x55d0d6ee9650 2024-09-13T16:04:31.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.860+0000 7fe1b2a00640 1 -- 172.21.15.17:0/914222807 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fe1c4032860 con 0x55d0d6ee9650 2024-09-13T16:04:31.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.861+0000 7fe1d63be740 1 -- 172.21.15.17:0/914222807 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d0d6e70c90 con 0x55d0d6ee9650 2024-09-13T16:04:31.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.861+0000 7fe1b2a00640 1 -- 172.21.15.17:0/914222807 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1c4032a20 con 0x55d0d6ee9650 2024-09-13T16:04:31.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.861+0000 7fe1d63be740 10 client.25874 fetch_fsmap learned FSMap version 39 2024-09-13T16:04:31.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.861+0000 7fe1d63be740 1 -- 172.21.15.17:0/914222807 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55d0d6e45170 con 0x55d0d6ee9650 2024-09-13T16:04:31.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.862+0000 7fe1b2a00640 1 -- 172.21.15.17:0/914222807 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d0d6e70c90 con 0x55d0d6ee9650 2024-09-13T16:04:31.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.865+0000 7fe1b2a00640 1 -- 172.21.15.17:0/914222807 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 39) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fe1c4058070 con 0x55d0d6ee9650 2024-09-13T16:04:31.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.866+0000 7fe1d63be740 10 client.25874 fetch_fsmap finished waiting for FSMap version 39 2024-09-13T16:04:31.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.866+0000 7fe1d63be740 10 client.25874 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:04:31.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.866+0000 7fe1d63be740 20 client.25874 populate_metadata read hostname 'smithi017' 2024-09-13T16:04:31.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.866+0000 7fe1d63be740 1 --2- 172.21.15.17:0/914222807 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55d0d6ef9280 0x55d0d6efb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:31.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.866+0000 7fe1d63be740 4 client.25874 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:04:31.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.866+0000 7fe1d63be740 1 -- 172.21.15.17:0/914222807 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d0d6e397d0 con 0x55d0d6ef9280 2024-09-13T16:04:31.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.866+0000 7fe1d0c00640 1 --2- 172.21.15.17:0/914222807 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55d0d6ef9280 0x55d0d6efb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:31.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.867+0000 7fe1d0c00640 1 --2- 172.21.15.17:0/914222807 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55d0d6ef9280 0x55d0d6efb6a0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea50453acea4b4f server_cookie=9b09fd046d5edb60 in_seq=0 out_seq=0 2024-09-13T16:04:31.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.869+0000 7fe1b2a00640 10 client.25874 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:04:31.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.869+0000 7fe1b2a00640 1 -- 172.21.15.17:0/914222807 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d0d6e397d0 con 0x55d0d6ef9280 2024-09-13T16:04:31.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.869+0000 7fe1b2a00640 10 client.25874 handle_command_reply: tid=0 2024-09-13T16:04:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.869+0000 7fe1d63be740 1 client.25874 shutdown 2024-09-13T16:04:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.871+0000 7fe1d63be740 1 -- 172.21.15.17:0/914222807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 msgr2=0x55d0d6ef4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.871+0000 7fe1d63be740 1 --2- 172.21.15.17:0/914222807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 0x55d0d6ef4e60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40303a0 tx=0x7fe1c4009280 comp rx=0 tx=0).stop 2024-09-13T16:04:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.872+0000 7fe1d63be740 1 -- 172.21.15.17:0/914222807 shutdown_connections 2024-09-13T16:04:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.872+0000 7fe1d63be740 1 --2- 172.21.15.17:0/914222807 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55d0d6ef9280 0x55d0d6efb6a0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.872+0000 7fe1d63be740 1 --2- 172.21.15.17:0/914222807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 0x55d0d6ef4e60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.872+0000 7fe1b2a00640 0 client.25874 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:04:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.872+0000 7fe1d63be740 1 --2- 172.21.15.17:0/914222807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d0d6ee45c0 0x55d0d6eede70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.872+0000 7fe1d63be740 1 --2- 172.21.15.17:0/914222807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0d6ee3c80 0x55d0d6eed930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.872+0000 7fe1d63be740 1 -- 172.21.15.17:0/914222807 >> 172.21.15.17:0/914222807 conn(0x55d0d6edf2f0 msgr2=0x55d0d6ee0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.872+0000 7fe1d63be740 1 -- 172.21.15.17:0/914222807 shutdown_connections 2024-09-13T16:04:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.872+0000 7fe1d63be740 1 -- 172.21.15.17:0/914222807 wait complete. 2024-09-13T16:04:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.873+0000 7fe1d63be740 20 client.25874 trim_cache size 0 max 16384 2024-09-13T16:04:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.910+0000 7fe1d63be740 1 Processor -- start 2024-09-13T16:04:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.910+0000 7fe1d63be740 1 -- start start 2024-09-13T16:04:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.911+0000 7fe1d63be740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d0d6ee3c80 0x55d0d6ee8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.911+0000 7fe1d63be740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0d6ee45c0 0x55d0d6ee90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.911+0000 7fe1d63be740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 0x55d0d6ef4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.911+0000 7fe1d63be740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0d6bade60 con 0x55d0d6ee3c80 2024-09-13T16:04:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.911+0000 7fe1d63be740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0d6ef8e20 con 0x55d0d6ee9650 2024-09-13T16:04:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.911+0000 7fe1d63be740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0d6ee4e10 con 0x55d0d6ee45c0 2024-09-13T16:04:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.912+0000 7fe1d1600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 0x55d0d6ef4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.912+0000 7fe1d0c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d0d6ee3c80 0x55d0d6ee8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.912+0000 7fe1d1600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 0x55d0d6ef4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:41660/0 (socket says 172.21.15.17:41660) 2024-09-13T16:04:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.912+0000 7fe1d1600640 1 -- 172.21.15.17:0/2138369703 learned_addr learned my addr 172.21.15.17:0/2138369703 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.912+0000 7fe1cbe00640 1 --2- 172.21.15.17:0/2138369703 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0d6ee45c0 0x55d0d6ee90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.913+0000 7fe1d1600640 1 -- 172.21.15.17:0/2138369703 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0d6ee45c0 msgr2=0x55d0d6ee90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.913+0000 7fe1d1600640 1 --2- 172.21.15.17:0/2138369703 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0d6ee45c0 0x55d0d6ee90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.913+0000 7fe1d1600640 1 -- 172.21.15.17:0/2138369703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d0d6ee3c80 msgr2=0x55d0d6ee8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.913+0000 7fe1d1600640 1 --2- 172.21.15.17:0/2138369703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d0d6ee3c80 0x55d0d6ee8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.913+0000 7fe1d1600640 1 -- 172.21.15.17:0/2138369703 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0d6de7180 con 0x55d0d6ee9650 2024-09-13T16:04:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.913+0000 7fe1d1600640 1 --2- 172.21.15.17:0/2138369703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 0x55d0d6ef4e20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe1c402ac80 tx=0x7fe1c4031000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98b8eb5145e12242 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.913+0000 7fe1bea00640 1 -- 172.21.15.17:0/2138369703 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4049070 con 0x55d0d6ee9650 2024-09-13T16:04:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.913+0000 7fe1bea00640 1 -- 172.21.15.17:0/2138369703 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1c4055040 con 0x55d0d6ee9650 2024-09-13T16:04:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.913+0000 7fe1bea00640 1 -- 172.21.15.17:0/2138369703 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4032ca0 con 0x55d0d6ee9650 2024-09-13T16:04:31.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.915+0000 7fe1d63be740 1 -- 172.21.15.17:0/2138369703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 msgr2=0x55d0d6ef4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.915+0000 7fe1d63be740 1 --2- 172.21.15.17:0/2138369703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 0x55d0d6ef4e20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe1c402ac80 tx=0x7fe1c4031000 comp rx=0 tx=0).stop 2024-09-13T16:04:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.915+0000 7fe1d63be740 1 -- 172.21.15.17:0/2138369703 shutdown_connections 2024-09-13T16:04:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.915+0000 7fe1d63be740 1 --2- 172.21.15.17:0/2138369703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 0x55d0d6ef4e20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.915+0000 7fe1d63be740 1 --2- 172.21.15.17:0/2138369703 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0d6ee45c0 0x55d0d6ee90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.915+0000 7fe1d63be740 1 --2- 172.21.15.17:0/2138369703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d0d6ee3c80 0x55d0d6ee8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.915+0000 7fe1d63be740 1 -- 172.21.15.17:0/2138369703 >> 172.21.15.17:0/2138369703 conn(0x55d0d6edf2f0 msgr2=0x55d0d6edf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:31.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.916+0000 7fe1d63be740 1 -- 172.21.15.17:0/2138369703 shutdown_connections 2024-09-13T16:04:31.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.916+0000 7fe1d63be740 1 -- 172.21.15.17:0/2138369703 wait complete. 2024-09-13T16:04:31.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.916+0000 7fe1d63be740 1 -- start start 2024-09-13T16:04:31.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.917+0000 7fe1d63be740 1 Processor -- start 2024-09-13T16:04:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.918+0000 7fe1d63be740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d0d6ee3c80 0x55d0d6ef2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.918+0000 7fe1d63be740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0d6ee45c0 0x55d0d6ef3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.918+0000 7fe1d63be740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 0x55d0d6ef4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.918+0000 7fe1cbe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0d6ee45c0 0x55d0d6ef3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.918+0000 7fe1d1600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 0x55d0d6ef4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.918+0000 7fe1cbe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0d6ee45c0 0x55d0d6ef3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:60152/0 (socket says 172.21.15.17:60152) 2024-09-13T16:04:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.918+0000 7fe1cbe00640 1 -- 172.21.15.17:0/301928780 learned_addr learned my addr 172.21.15.17:0/301928780 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.918+0000 7fe1d63be740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0d6ef4790 con 0x55d0d6ee3c80 2024-09-13T16:04:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.919+0000 7fe1d63be740 1 -- 172.21.15.17:0/301928780 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0d6ef4900 con 0x55d0d6ee9650 2024-09-13T16:04:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.919+0000 7fe1d63be740 1 -- 172.21.15.17:0/301928780 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0d6ef4ac0 con 0x55d0d6ee45c0 2024-09-13T16:04:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.919+0000 7fe1d63be740 10 client.0 _ll_register_callbacks cb 0x7fe1c4034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:04:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.919+0000 7fe1d0c00640 1 --2- 172.21.15.17:0/301928780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d0d6ee3c80 0x55d0d6ef2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.919+0000 7fe1d1600640 1 -- 172.21.15.17:0/301928780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0d6ee45c0 msgr2=0x55d0d6ef3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.919+0000 7fe1d1600640 1 --2- 172.21.15.17:0/301928780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0d6ee45c0 0x55d0d6ef3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.919+0000 7fe1d1600640 1 -- 172.21.15.17:0/301928780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d0d6ee3c80 msgr2=0x55d0d6ef2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.919+0000 7fe1d1600640 1 --2- 172.21.15.17:0/301928780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d0d6ee3c80 0x55d0d6ef2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.919+0000 7fe1d1600640 1 -- 172.21.15.17:0/301928780 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d0d6e45170 con 0x55d0d6ee9650 2024-09-13T16:04:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.919+0000 7fe1d0c00640 1 --2- 172.21.15.17:0/301928780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d0d6ee3c80 0x55d0d6ef2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:04:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.920+0000 7fe1d1600640 1 --2- 172.21.15.17:0/301928780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 0x55d0d6ef4250 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4006010 tx=0x7fe1c4000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa4cdd8faf9c8e82 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.920+0000 7fe1b2a00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:04:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.920+0000 7fe1b2a00640 1 -- 172.21.15.17:0/301928780 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4049040 con 0x55d0d6ee9650 2024-09-13T16:04:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.920+0000 7fe1b2a00640 1 -- 172.21.15.17:0/301928780 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fe1c404f410 con 0x55d0d6ee9650 2024-09-13T16:04:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.921+0000 7fe1d63be740 1 -- 172.21.15.17:0/301928780 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe1c4030d90 con 0x55d0d6ee9650 2024-09-13T16:04:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.921+0000 7fe1b2a00640 1 -- 172.21.15.17:0/301928780 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1c4004860 con 0x55d0d6ee9650 2024-09-13T16:04:31.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.921+0000 7fe1d63be740 10 client.25880 fetch_fsmap learned FSMap version 39 2024-09-13T16:04:31.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.921+0000 7fe1d63be740 1 -- 172.21.15.17:0/301928780 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55d0d6e0c560 con 0x55d0d6ee9650 2024-09-13T16:04:31.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.921+0000 7fe1b2a00640 1 -- 172.21.15.17:0/301928780 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1c4030d90 con 0x55d0d6ee9650 2024-09-13T16:04:31.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.922+0000 7fe1b2a00640 1 -- 172.21.15.17:0/301928780 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 39) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fe1c4058040 con 0x55d0d6ee9650 2024-09-13T16:04:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.923+0000 7fe1d63be740 10 client.25880 fetch_fsmap finished waiting for FSMap version 39 2024-09-13T16:04:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.923+0000 7fe1d63be740 10 client.25880 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:04:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.923+0000 7fe1d63be740 20 client.25880 populate_metadata read hostname 'smithi017' 2024-09-13T16:04:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.923+0000 7fe1d63be740 1 --2- 172.21.15.17:0/301928780 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55d0d6ef9280 0x55d0d6f523c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.923+0000 7fe1d63be740 4 client.25880 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:04:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.923+0000 7fe1d63be740 1 -- 172.21.15.17:0/301928780 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d0d6b3a300 con 0x55d0d6ef9280 2024-09-13T16:04:31.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.923+0000 7fe1d0c00640 1 --2- 172.21.15.17:0/301928780 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55d0d6ef9280 0x55d0d6f523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:31.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.926+0000 7fe1d0c00640 1 --2- 172.21.15.17:0/301928780 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55d0d6ef9280 0x55d0d6f523c0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43c7cb5454ce0e67 server_cookie=7756d32f6d2c1ce3 in_seq=0 out_seq=0 2024-09-13T16:04:31.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.926+0000 7fe1b2a00640 10 client.25880 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:04:31.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.969+0000 7fe1b2a00640 1 -- 172.21.15.17:0/301928780 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d0d6b3a300 con 0x55d0d6ef9280 2024-09-13T16:04:31.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.969+0000 7fe1b2a00640 10 client.25880 handle_command_reply: tid=0 2024-09-13T16:04:31.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.969+0000 7fe1d63be740 1 client.25880 shutdown 2024-09-13T16:04:31.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.970+0000 7fe1d63be740 1 -- 172.21.15.17:0/301928780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 msgr2=0x55d0d6ef4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:31.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.970+0000 7fe1d63be740 1 --2- 172.21.15.17:0/301928780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 0x55d0d6ef4250 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4006010 tx=0x7fe1c4000f40 comp rx=0 tx=0).stop 2024-09-13T16:04:31.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.971+0000 7fe1d63be740 1 -- 172.21.15.17:0/301928780 shutdown_connections 2024-09-13T16:04:31.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.971+0000 7fe1d63be740 1 --2- 172.21.15.17:0/301928780 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55d0d6ef9280 0x55d0d6f523c0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.971+0000 7fe1d63be740 1 --2- 172.21.15.17:0/301928780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0d6ee9650 0x55d0d6ef4250 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.971+0000 7fe1d63be740 1 --2- 172.21.15.17:0/301928780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0d6ee45c0 0x55d0d6ef3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.971+0000 7fe1b2a00640 0 client.25880 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:04:31.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.971+0000 7fe1d63be740 1 --2- 172.21.15.17:0/301928780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d0d6ee3c80 0x55d0d6ef2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.971+0000 7fe1d63be740 1 -- 172.21.15.17:0/301928780 >> 172.21.15.17:0/301928780 conn(0x55d0d6edf2f0 msgr2=0x55d0d6ee5580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:31.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.971+0000 7fe1d63be740 1 -- 172.21.15.17:0/301928780 shutdown_connections 2024-09-13T16:04:31.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.971+0000 7fe1d63be740 1 -- 172.21.15.17:0/301928780 wait complete. 2024-09-13T16:04:31.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.971+0000 7fe1d63be740 20 client.25880 trim_cache size 0 max 16384 2024-09-13T16:04:31.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:04:31.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:04:31.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:04:31.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:04:31.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.973+0000 7fe1d2000640 1 -- 172.21.15.17:0/411466783 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe1b40a11b0 msgr2=0x7fe1b40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:31.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.973+0000 7fe1d2000640 1 --2- 172.21.15.17:0/411466783 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe1b40a11b0 0x7fe1b40a3670 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4009b30 tx=0x7fe1c40043a0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.973+0000 7fe1d2000640 1 -- 172.21.15.17:0/411466783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1cc106680 msgr2=0x7fe1cc19c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:31.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.973+0000 7fe1d2000640 1 --2- 172.21.15.17:0/411466783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1cc106680 0x7fe1cc19c160 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe1c000b3f0 tx=0x7fe1c000b8b0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.974+0000 7fe1d2000640 1 -- 172.21.15.17:0/411466783 shutdown_connections 2024-09-13T16:04:31.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.974+0000 7fe1d2000640 1 --2- 172.21.15.17:0/411466783 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe1b40a11b0 0x7fe1b40a3670 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.974+0000 7fe1d2000640 1 --2- 172.21.15.17:0/411466783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1cc107d30 0x7fe1cc1a3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.974+0000 7fe1d2000640 1 --2- 172.21.15.17:0/411466783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1cc107390 0x7fe1cc19c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.974+0000 7fe1d2000640 1 --2- 172.21.15.17:0/411466783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe1cc106680 0x7fe1cc19c160 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:31.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.974+0000 7fe1d2000640 1 -- 172.21.15.17:0/411466783 >> 172.21.15.17:0/411466783 conn(0x7fe1cc0696e0 msgr2=0x7fe1cc10a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:31.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.974+0000 7fe1d2000640 1 -- 172.21.15.17:0/411466783 shutdown_connections 2024-09-13T16:04:31.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:31.975+0000 7fe1d2000640 1 -- 172.21.15.17:0/411466783 wait complete. 2024-09-13T16:04:32.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:31 smithi193 ceph-mon[35248]: pgmap v588: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.2 MiB/s wr, 668 op/s 2024-09-13T16:04:32.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:31 smithi017 ceph-mon[30494]: pgmap v588: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.2 MiB/s wr, 668 op/s 2024-09-13T16:04:33.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:33 smithi189 ceph-mon[34790]: pgmap v589: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.1 MiB/s wr, 614 op/s 2024-09-13T16:04:34.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:33 smithi193 ceph-mon[35248]: pgmap v589: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.1 MiB/s wr, 614 op/s 2024-09-13T16:04:34.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:33 smithi017 ceph-mon[30494]: pgmap v589: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.1 MiB/s wr, 614 op/s 2024-09-13T16:04:35.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 410.0 s, 549.8 tps, lat 180.921 ms stddev 199.541 2024-09-13T16:04:35.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:35 smithi189 ceph-mon[34790]: pgmap v590: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.0 MiB/s wr, 649 op/s 2024-09-13T16:04:36.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:35 smithi193 ceph-mon[35248]: pgmap v590: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.0 MiB/s wr, 649 op/s 2024-09-13T16:04:36.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:35 smithi017 ceph-mon[30494]: pgmap v590: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.0 MiB/s wr, 649 op/s 2024-09-13T16:04:37.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:37 smithi189 ceph-mon[34790]: pgmap v591: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.8 MiB/s wr, 527 op/s 2024-09-13T16:04:38.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:37 smithi193 ceph-mon[35248]: pgmap v591: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.8 MiB/s wr, 527 op/s 2024-09-13T16:04:38.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:37 smithi017 ceph-mon[30494]: pgmap v591: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.8 MiB/s wr, 527 op/s 2024-09-13T16:04:39.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:39 smithi189 ceph-mon[34790]: pgmap v592: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.4 MiB/s wr, 523 op/s 2024-09-13T16:04:40.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:39 smithi193 ceph-mon[35248]: pgmap v592: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.4 MiB/s wr, 523 op/s 2024-09-13T16:04:40.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:39 smithi017 ceph-mon[30494]: pgmap v592: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.4 MiB/s wr, 523 op/s 2024-09-13T16:04:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 415.0 s, 672.4 tps, lat 148.293 ms stddev 168.880 2024-09-13T16:04:41.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:41 smithi189 ceph-mon[34790]: pgmap v593: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.1 MiB/s wr, 547 op/s 2024-09-13T16:04:42.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:41 smithi193 ceph-mon[35248]: pgmap v593: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.1 MiB/s wr, 547 op/s 2024-09-13T16:04:42.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:41 smithi017 ceph-mon[30494]: pgmap v593: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.1 MiB/s wr, 547 op/s 2024-09-13T16:04:43.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:43 smithi189 ceph-mon[34790]: pgmap v594: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.3 MiB/s wr, 523 op/s 2024-09-13T16:04:44.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:43 smithi193 ceph-mon[35248]: pgmap v594: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.3 MiB/s wr, 523 op/s 2024-09-13T16:04:44.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:43 smithi017 ceph-mon[30494]: pgmap v594: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.3 MiB/s wr, 523 op/s 2024-09-13T16:04:45.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.171+0000 7f5d7a000640 1 -- 172.21.15.17:0/2822054344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d74074470 msgr2=0x7f5d740728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:45.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.171+0000 7f5d7a000640 1 --2- 172.21.15.17:0/2822054344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d74074470 0x7f5d740728c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5d64009ca0 tx=0x7f5d6402a950 comp rx=0 tx=0).stop 2024-09-13T16:04:45.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.171+0000 7f5d7a000640 1 -- 172.21.15.17:0/2822054344 shutdown_connections 2024-09-13T16:04:45.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.171+0000 7f5d7a000640 1 --2- 172.21.15.17:0/2822054344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d74107bc0 0x7f5d7410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.171+0000 7f5d7a000640 1 --2- 172.21.15.17:0/2822054344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d74072e90 0x7f5d740732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.171+0000 7f5d7a000640 1 --2- 172.21.15.17:0/2822054344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d74074470 0x7f5d740728c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.171+0000 7f5d7a000640 1 -- 172.21.15.17:0/2822054344 >> 172.21.15.17:0/2822054344 conn(0x7f5d740fb4b0 msgr2=0x7f5d740fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:45.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.171+0000 7f5d7a000640 1 -- 172.21.15.17:0/2822054344 shutdown_connections 2024-09-13T16:04:45.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.171+0000 7f5d7a000640 1 -- 172.21.15.17:0/2822054344 wait complete. 2024-09-13T16:04:45.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.173+0000 7f5d7a000640 1 Processor -- start 2024-09-13T16:04:45.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.173+0000 7f5d7a000640 1 -- start start 2024-09-13T16:04:45.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.174+0000 7f5d7a000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d74072e90 0x7f5d7406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:45.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.174+0000 7f5d7a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d74074470 0x7f5d7406f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:45.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.174+0000 7f5d7a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d74107bc0 0x7f5d741a80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:45.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.174+0000 7f5d73400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d74072e90 0x7f5d7406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:45.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.174+0000 7f5d73400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d74072e90 0x7f5d7406ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:40074/0 (socket says 172.21.15.17:40074) 2024-09-13T16:04:45.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.175+0000 7f5d73400640 1 -- 172.21.15.17:0/2826907108 learned_addr learned my addr 172.21.15.17:0/2826907108 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:45.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.175+0000 7f5d7a000640 1 -- 172.21.15.17:0/2826907108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7406f900 con 0x7f5d74107bc0 2024-09-13T16:04:45.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.175+0000 7f5d7a000640 1 -- 172.21.15.17:0/2826907108 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7406fa70 con 0x7f5d74074470 2024-09-13T16:04:45.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.175+0000 7f5d7a000640 1 -- 172.21.15.17:0/2826907108 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d741a8600 con 0x7f5d74072e90 2024-09-13T16:04:45.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.175+0000 7f5d6aa00640 1 --2- 172.21.15.17:0/2826907108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d74074470 0x7f5d7406f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:45.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.176+0000 7f5d73e00640 1 --2- 172.21.15.17:0/2826907108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d74107bc0 0x7f5d741a80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:45.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.176+0000 7f5d73400640 1 -- 172.21.15.17:0/2826907108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d74074470 msgr2=0x7f5d7406f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:45.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.176+0000 7f5d73400640 1 --2- 172.21.15.17:0/2826907108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d74074470 0x7f5d7406f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.176+0000 7f5d73400640 1 -- 172.21.15.17:0/2826907108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d74107bc0 msgr2=0x7f5d741a80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:45.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.176+0000 7f5d73400640 1 --2- 172.21.15.17:0/2826907108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d74107bc0 0x7f5d741a80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.176+0000 7f5d73400640 1 -- 172.21.15.17:0/2826907108 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d64009900 con 0x7f5d74072e90 2024-09-13T16:04:45.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.176+0000 7f5d6aa00640 1 --2- 172.21.15.17:0/2826907108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d74074470 0x7f5d7406f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:04:45.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.176+0000 7f5d73e00640 1 --2- 172.21.15.17:0/2826907108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d74107bc0 0x7f5d741a80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:04:45.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.177+0000 7f5d73400640 1 --2- 172.21.15.17:0/2826907108 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d74072e90 0x7f5d7406ee80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5d6402f8e0 tx=0x7f5d64003c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:45.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.178+0000 7f5d70c00640 1 -- 172.21.15.17:0/2826907108 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d64030850 con 0x7f5d74072e90 2024-09-13T16:04:45.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.178+0000 7f5d70c00640 1 -- 172.21.15.17:0/2826907108 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d6402fe20 con 0x7f5d74072e90 2024-09-13T16:04:45.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.178+0000 7f5d70c00640 1 -- 172.21.15.17:0/2826907108 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d640396b0 con 0x7f5d74072e90 2024-09-13T16:04:45.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.178+0000 7f5d7a000640 1 -- 172.21.15.17:0/2826907108 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d741a8850 con 0x7f5d74072e90 2024-09-13T16:04:45.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.178+0000 7f5d7a000640 1 -- 172.21.15.17:0/2826907108 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d741a8d30 con 0x7f5d74072e90 2024-09-13T16:04:45.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.187+0000 7f5d70c00640 1 -- 172.21.15.17:0/2826907108 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5d6402e050 con 0x7f5d74072e90 2024-09-13T16:04:45.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.190+0000 7f5d7cdfd740 1 Processor -- start 2024-09-13T16:04:45.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.191+0000 7f5d70c00640 1 --2- 172.21.15.17:0/2826907108 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5d580a1190 0x7f5d580a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:45.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.191+0000 7f5d70c00640 1 -- 172.21.15.17:0/2826907108 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f5d640ede10 con 0x7f5d74072e90 2024-09-13T16:04:45.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.193+0000 7f5d7cdfd740 1 -- start start 2024-09-13T16:04:45.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.193+0000 7f5d73e00640 1 --2- 172.21.15.17:0/2826907108 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5d580a1190 0x7f5d580a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:45.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.193+0000 7f5d7cdfd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e930b97280 0x55e930b97680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:45.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.193+0000 7f5d7cdfd740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e930b97bc0 0x55e930b9c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:45.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.193+0000 7f5d7cdfd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b9cc50 0x55e930b9f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:45.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.193+0000 7f5d7cdfd740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e930a9abb0 con 0x55e930b97bc0 2024-09-13T16:04:45.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.193+0000 7f5d7cdfd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e930af8a70 con 0x55e930b97280 2024-09-13T16:04:45.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.193+0000 7f5d7cdfd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e930af6200 con 0x55e930b9cc50 2024-09-13T16:04:45.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.194+0000 7f5d73e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b9cc50 0x55e930b9f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:45.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.194+0000 7f5d73e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b9cc50 0x55e930b9f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:40084/0 (socket says 172.21.15.17:40084) 2024-09-13T16:04:45.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.194+0000 7f5d73e00640 1 -- 172.21.15.17:0/4097844030 learned_addr learned my addr 172.21.15.17:0/4097844030 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:45.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.194+0000 7f5d73e00640 1 -- 172.21.15.17:0/4097844030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e930b97280 msgr2=0x55e930b97680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:04:45.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.194+0000 7f5d73e00640 1 --2- 172.21.15.17:0/4097844030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e930b97280 0x55e930b97680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.194+0000 7f5d73e00640 1 -- 172.21.15.17:0/4097844030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e930b97bc0 msgr2=0x55e930b9c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:45.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.194+0000 7f5d73e00640 1 --2- 172.21.15.17:0/4097844030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e930b97bc0 0x55e930b9c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.194+0000 7f5d73e00640 1 -- 172.21.15.17:0/4097844030 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e930a93940 con 0x55e930b9cc50 2024-09-13T16:04:45.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.195+0000 7f5d73e00640 1 --2- 172.21.15.17:0/4097844030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b9cc50 0x55e930b9f110 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c012a90 tx=0x7f5d6c012f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6a600e41e74aca1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:45.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.195+0000 7f5d68c00640 1 -- 172.21.15.17:0/4097844030 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c012250 con 0x55e930b9cc50 2024-09-13T16:04:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.197+0000 7f5d68c00640 1 -- 172.21.15.17:0/4097844030 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d6c00a2b0 con 0x55e930b9cc50 2024-09-13T16:04:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.197+0000 7f5d68c00640 1 -- 172.21.15.17:0/4097844030 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c01db30 con 0x55e930b9cc50 2024-09-13T16:04:45.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.198+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/4097844030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b9cc50 msgr2=0x55e930b9f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:45.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.198+0000 7f5d7cdfd740 1 --2- 172.21.15.17:0/4097844030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b9cc50 0x55e930b9f110 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c012a90 tx=0x7f5d6c012f50 comp rx=0 tx=0).stop 2024-09-13T16:04:45.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.198+0000 7f5d73e00640 1 --2- 172.21.15.17:0/2826907108 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5d580a1190 0x7f5d580a3650 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c015000 tx=0x7f5d6c01b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:45.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.199+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/4097844030 shutdown_connections 2024-09-13T16:04:45.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.199+0000 7f5d7cdfd740 1 --2- 172.21.15.17:0/4097844030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b9cc50 0x55e930b9f110 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.199+0000 7f5d7cdfd740 1 --2- 172.21.15.17:0/4097844030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e930b97bc0 0x55e930b9c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.202+0000 7f5d7cdfd740 1 --2- 172.21.15.17:0/4097844030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e930b97280 0x55e930b97680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.202+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/4097844030 >> 172.21.15.17:0/4097844030 conn(0x55e930b928f0 msgr2=0x55e930b92cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:45.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.204+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/4097844030 shutdown_connections 2024-09-13T16:04:45.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.204+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/4097844030 wait complete. 2024-09-13T16:04:45.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.205+0000 7f5d7cdfd740 1 -- start start 2024-09-13T16:04:45.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.205+0000 7f5d7cdfd740 1 Processor -- start 2024-09-13T16:04:45.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.206+0000 7f5d7cdfd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b97280 0x55e930ba0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:45.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.206+0000 7f5d7cdfd740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e930b97bc0 0x55e930ba14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:45.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.206+0000 7f5d7cdfd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e930b9cc50 0x55e930ba8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:45.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.206+0000 7f5d7cdfd740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e930af1af0 con 0x55e930b97bc0 2024-09-13T16:04:45.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.206+0000 7f5d7cdfd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e930aaff20 con 0x55e930b9cc50 2024-09-13T16:04:45.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.206+0000 7f5d7cdfd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e930aafbc0 con 0x55e930b97280 2024-09-13T16:04:45.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.206+0000 7f5d7cdfd740 10 client.0 _ll_register_callbacks cb 0x55e930ae1a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:04:45.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.207+0000 7f5d73400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b97280 0x55e930ba0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:45.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.207+0000 7f5d73400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b97280 0x55e930ba0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:40090/0 (socket says 172.21.15.17:40090) 2024-09-13T16:04:45.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.207+0000 7f5d73400640 1 -- 172.21.15.17:0/1129317720 learned_addr learned my addr 172.21.15.17:0/1129317720 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:45.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.208+0000 7f5d73e00640 1 --2- 172.21.15.17:0/1129317720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e930b9cc50 0x55e930ba8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:45.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.208+0000 7f5d6aa00640 1 --2- 172.21.15.17:0/1129317720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e930b97bc0 0x55e930ba14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:45.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.210+0000 7f5d73400640 1 -- 172.21.15.17:0/1129317720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e930b9cc50 msgr2=0x55e930ba8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:45.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.210+0000 7f5d73400640 1 --2- 172.21.15.17:0/1129317720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e930b9cc50 0x55e930ba8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.210+0000 7f5d73400640 1 -- 172.21.15.17:0/1129317720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e930b97bc0 msgr2=0x55e930ba14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:45.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.210+0000 7f5d73400640 1 --2- 172.21.15.17:0/1129317720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e930b97bc0 0x55e930ba14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.210+0000 7f5d73400640 1 -- 172.21.15.17:0/1129317720 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6c0126c0 con 0x55e930b97280 2024-09-13T16:04:45.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.210+0000 7f5d6aa00640 1 --2- 172.21.15.17:0/1129317720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e930b97bc0 0x55e930ba14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:04:45.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.210+0000 7f5d73400640 1 --2- 172.21.15.17:0/1129317720 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b97280 0x55e930ba0fa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5d640bae40 tx=0x7f5d64003ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33295557f09f6b37 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:45.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.210+0000 7f5d61600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:04:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.212+0000 7f5d61600640 1 -- 172.21.15.17:0/1129317720 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d640baeb0 con 0x55e930b97280 2024-09-13T16:04:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.212+0000 7f5d61600640 1 -- 172.21.15.17:0/1129317720 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f5d640bece0 con 0x55e930b97280 2024-09-13T16:04:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.212+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/1129317720 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e930ae47d0 con 0x55e930b97280 2024-09-13T16:04:45.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.212+0000 7f5d61600640 1 -- 172.21.15.17:0/1129317720 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d640c3330 con 0x55e930b97280 2024-09-13T16:04:45.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.213+0000 7f5d7cdfd740 10 client.25912 fetch_fsmap learned FSMap version 39 2024-09-13T16:04:45.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.213+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/1129317720 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55e930af0170 con 0x55e930b97280 2024-09-13T16:04:45.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.214+0000 7f5d61600640 1 -- 172.21.15.17:0/1129317720 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e930ae47d0 con 0x55e930b97280 2024-09-13T16:04:45.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.215+0000 7f5d61600640 1 -- 172.21.15.17:0/1129317720 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 39) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f5d640b6ca0 con 0x55e930b97280 2024-09-13T16:04:45.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.215+0000 7f5d7cdfd740 10 client.25912 fetch_fsmap finished waiting for FSMap version 39 2024-09-13T16:04:45.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.215+0000 7f5d7cdfd740 10 client.25912 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:04:45.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.215+0000 7f5d7cdfd740 20 client.25912 populate_metadata read hostname 'smithi017' 2024-09-13T16:04:45.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.215+0000 7f5d7cdfd740 1 --2- 172.21.15.17:0/1129317720 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e930bac9b0 0x55e930baedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:45.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.215+0000 7f5d7cdfd740 4 client.25912 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:04:45.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.215+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/1129317720 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e9307e5300 con 0x55e930bac9b0 2024-09-13T16:04:45.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.215+0000 7f5d6aa00640 1 --2- 172.21.15.17:0/1129317720 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e930bac9b0 0x55e930baedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:45.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.216+0000 7f5d6aa00640 1 --2- 172.21.15.17:0/1129317720 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e930bac9b0 0x55e930baedd0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=926368042ef87edb server_cookie=1168fb1040d257c8 in_seq=0 out_seq=0 2024-09-13T16:04:45.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.216+0000 7f5d61600640 10 client.25912 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:04:45.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.217+0000 7f5d61600640 1 -- 172.21.15.17:0/1129317720 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e9307e5300 con 0x55e930bac9b0 2024-09-13T16:04:45.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.217+0000 7f5d61600640 10 client.25912 handle_command_reply: tid=0 2024-09-13T16:04:45.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.217+0000 7f5d7cdfd740 1 client.25912 shutdown 2024-09-13T16:04:45.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.218+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/1129317720 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b97280 msgr2=0x55e930ba0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:45.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.218+0000 7f5d7cdfd740 1 --2- 172.21.15.17:0/1129317720 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b97280 0x55e930ba0fa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5d640bae40 tx=0x7f5d64003ed0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.218+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/1129317720 shutdown_connections 2024-09-13T16:04:45.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.218+0000 7f5d7cdfd740 1 --2- 172.21.15.17:0/1129317720 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e930bac9b0 0x55e930baedd0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.218+0000 7f5d7cdfd740 1 --2- 172.21.15.17:0/1129317720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e930b9cc50 0x55e930ba8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.218+0000 7f5d61600640 0 client.25912 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:04:45.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.219+0000 7f5d7cdfd740 1 --2- 172.21.15.17:0/1129317720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e930b97bc0 0x55e930ba14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.219+0000 7f5d7cdfd740 1 --2- 172.21.15.17:0/1129317720 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b97280 0x55e930ba0fa0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.219+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/1129317720 >> 172.21.15.17:0/1129317720 conn(0x55e930b928f0 msgr2=0x55e930b94100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:45.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.219+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/1129317720 shutdown_connections 2024-09-13T16:04:45.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.219+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/1129317720 wait complete. 2024-09-13T16:04:45.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.220+0000 7f5d7cdfd740 20 client.25912 trim_cache size 0 max 16384 2024-09-13T16:04:45.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.257+0000 7f5d7cdfd740 1 Processor -- start 2024-09-13T16:04:45.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.259+0000 7f5d7cdfd740 1 -- start start 2024-09-13T16:04:45.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.260+0000 7f5d7cdfd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e930b97280 0x55e930ba0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:45.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.260+0000 7f5d7cdfd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b97bc0 0x55e930ba84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:45.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.260+0000 7f5d7cdfd740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e930b9cc50 0x55e930ba1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:45.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.261+0000 7f5d7cdfd740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e930858e60 con 0x55e930b9cc50 2024-09-13T16:04:45.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.261+0000 7f5d7cdfd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e930b85c90 con 0x55e930b97280 2024-09-13T16:04:45.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.261+0000 7f5d7cdfd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e930b9f540 con 0x55e930b97bc0 2024-09-13T16:04:45.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.261+0000 7f5d73400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e930b97280 0x55e930ba0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:45.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.261+0000 7f5d6aa00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b97bc0 0x55e930ba84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:45.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.261+0000 7f5d73400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e930b97280 0x55e930ba0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:49798/0 (socket says 172.21.15.17:49798) 2024-09-13T16:04:45.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.261+0000 7f5d73400640 1 -- 172.21.15.17:0/2787899692 learned_addr learned my addr 172.21.15.17:0/2787899692 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:45.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.262+0000 7f5d73400640 1 -- 172.21.15.17:0/2787899692 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b97bc0 msgr2=0x55e930ba84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:45.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.262+0000 7f5d73400640 1 --2- 172.21.15.17:0/2787899692 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b97bc0 0x55e930ba84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.262+0000 7f5d73400640 1 -- 172.21.15.17:0/2787899692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e930b9cc50 msgr2=0x55e930ba1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:45.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.262+0000 7f5d73400640 1 --2- 172.21.15.17:0/2787899692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e930b9cc50 0x55e930ba1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.262+0000 7f5d73400640 1 -- 172.21.15.17:0/2787899692 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e930a92180 con 0x55e930b97280 2024-09-13T16:04:45.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.265+0000 7f5d73400640 1 --2- 172.21.15.17:0/2787899692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e930b97280 0x55e930ba0d50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5d640b7920 tx=0x7f5d640b9460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=985b20922c04c9ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:45.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.265+0000 7f5d69600640 1 -- 172.21.15.17:0/2787899692 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d640bac80 con 0x55e930b97280 2024-09-13T16:04:45.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.266+0000 7f5d69600640 1 -- 172.21.15.17:0/2787899692 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d640bece0 con 0x55e930b97280 2024-09-13T16:04:45.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.266+0000 7f5d69600640 1 -- 172.21.15.17:0/2787899692 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d640ba600 con 0x55e930b97280 2024-09-13T16:04:45.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.267+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/2787899692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e930b97280 msgr2=0x55e930ba0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:45.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.267+0000 7f5d7cdfd740 1 --2- 172.21.15.17:0/2787899692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e930b97280 0x55e930ba0d50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5d640b7920 tx=0x7f5d640b9460 comp rx=0 tx=0).stop 2024-09-13T16:04:45.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.268+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/2787899692 shutdown_connections 2024-09-13T16:04:45.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.268+0000 7f5d7cdfd740 1 --2- 172.21.15.17:0/2787899692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e930b9cc50 0x55e930ba1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.268+0000 7f5d7cdfd740 1 --2- 172.21.15.17:0/2787899692 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b97bc0 0x55e930ba84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.268+0000 7f5d7cdfd740 1 --2- 172.21.15.17:0/2787899692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e930b97280 0x55e930ba0d50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.268+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/2787899692 >> 172.21.15.17:0/2787899692 conn(0x55e930b928f0 msgr2=0x55e930b98b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:45.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.269+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/2787899692 shutdown_connections 2024-09-13T16:04:45.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.269+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/2787899692 wait complete. 2024-09-13T16:04:45.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.269+0000 7f5d7cdfd740 1 -- start start 2024-09-13T16:04:45.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.270+0000 7f5d7cdfd740 1 Processor -- start 2024-09-13T16:04:45.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.274+0000 7f5d7cdfd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b97280 0x55e930ba8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:45.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.275+0000 7f5d7cdfd740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e930b97bc0 0x55e930ba4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:45.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.275+0000 7f5d7cdfd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e930b9cc50 0x55e930ba5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:45.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.275+0000 7f5d73400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b97280 0x55e930ba8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:45.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.275+0000 7f5d73400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b97280 0x55e930ba8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:40106/0 (socket says 172.21.15.17:40106) 2024-09-13T16:04:45.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.275+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/3719133822 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e930ba57b0 con 0x55e930b97bc0 2024-09-13T16:04:45.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.275+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/3719133822 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e930ba5920 con 0x55e930b9cc50 2024-09-13T16:04:45.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.275+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/3719133822 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e930c02ed0 con 0x55e930b97280 2024-09-13T16:04:45.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.275+0000 7f5d7cdfd740 10 client.0 _ll_register_callbacks cb 0x7f5d6c00aee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:04:45.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.275+0000 7f5d73e00640 1 --2- 172.21.15.17:0/3719133822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e930b9cc50 0x55e930ba5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:45.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.275+0000 7f5d73400640 1 -- 172.21.15.17:0/3719133822 learned_addr learned my addr 172.21.15.17:0/3719133822 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:45.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.276+0000 7f5d6aa00640 1 --2- 172.21.15.17:0/3719133822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e930b97bc0 0x55e930ba4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:45.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.276+0000 7f5d73e00640 1 -- 172.21.15.17:0/3719133822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b97280 msgr2=0x55e930ba8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.276+0000 7f5d73e00640 1 --2- 172.21.15.17:0/3719133822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b97280 0x55e930ba8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.276+0000 7f5d73e00640 1 -- 172.21.15.17:0/3719133822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e930b97bc0 msgr2=0x55e930ba4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.276+0000 7f5d73e00640 1 --2- 172.21.15.17:0/3719133822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e930b97bc0 0x55e930ba4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.276+0000 7f5d73e00640 1 -- 172.21.15.17:0/3719133822 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e930af0170 con 0x55e930b9cc50 2024-09-13T16:04:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.276+0000 7f5d73400640 1 --2- 172.21.15.17:0/3719133822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b97280 0x55e930ba8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:04:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.277+0000 7f5d73e00640 1 --2- 172.21.15.17:0/3719133822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e930b9cc50 0x55e930ba5240 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c005fd0 tx=0x7f5d6c0052b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f9dcd8603c9aee0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.277+0000 7f5d61600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:04:45.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.277+0000 7f5d61600640 1 -- 172.21.15.17:0/3719133822 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c02b070 con 0x55e930b9cc50 2024-09-13T16:04:45.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.277+0000 7f5d61600640 1 -- 172.21.15.17:0/3719133822 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f5d6c00a860 con 0x55e930b9cc50 2024-09-13T16:04:45.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.278+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/3719133822 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e930b1bc90 con 0x55e930b9cc50 2024-09-13T16:04:45.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.278+0000 7f5d61600640 1 -- 172.21.15.17:0/3719133822 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d6c012450 con 0x55e930b9cc50 2024-09-13T16:04:45.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.278+0000 7f5d7cdfd740 10 client.25895 fetch_fsmap learned FSMap version 39 2024-09-13T16:04:45.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.278+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/3719133822 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55e930ab7560 con 0x55e930b9cc50 2024-09-13T16:04:45.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.280+0000 7f5d61600640 1 -- 172.21.15.17:0/3719133822 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e930b1bc90 con 0x55e930b9cc50 2024-09-13T16:04:45.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.280+0000 7f5d61600640 1 -- 172.21.15.17:0/3719133822 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 39) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f5d6c036050 con 0x55e930b9cc50 2024-09-13T16:04:45.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.280+0000 7f5d7cdfd740 10 client.25895 fetch_fsmap finished waiting for FSMap version 39 2024-09-13T16:04:45.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.280+0000 7f5d7cdfd740 10 client.25895 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:04:45.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.280+0000 7f5d7cdfd740 20 client.25895 populate_metadata read hostname 'smithi017' 2024-09-13T16:04:45.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.280+0000 7f5d7cdfd740 1 --2- 172.21.15.17:0/3719133822 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e930bac9b0 0x55e930c06900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:45.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.280+0000 7f5d7cdfd740 4 client.25895 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:04:45.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.280+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/3719133822 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e9307f6600 con 0x55e930bac9b0 2024-09-13T16:04:45.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.280+0000 7f5d73400640 1 --2- 172.21.15.17:0/3719133822 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e930bac9b0 0x55e930c06900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:45.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.281+0000 7f5d73400640 1 --2- 172.21.15.17:0/3719133822 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e930bac9b0 0x55e930c06900 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edd148f856da0769 server_cookie=b0faf54a1412881e in_seq=0 out_seq=0 2024-09-13T16:04:45.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.281+0000 7f5d61600640 10 client.25895 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:04:45.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 420.0 s, 542.0 tps, lat 181.042 ms stddev 254.728 2024-09-13T16:04:45.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.370+0000 7f5d61600640 1 -- 172.21.15.17:0/3719133822 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e9307f6600 con 0x55e930bac9b0 2024-09-13T16:04:45.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.370+0000 7f5d61600640 10 client.25895 handle_command_reply: tid=0 2024-09-13T16:04:45.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.370+0000 7f5d7cdfd740 1 client.25895 shutdown 2024-09-13T16:04:45.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.372+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/3719133822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e930b9cc50 msgr2=0x55e930ba5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:45.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.372+0000 7f5d7cdfd740 1 --2- 172.21.15.17:0/3719133822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e930b9cc50 0x55e930ba5240 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c005fd0 tx=0x7f5d6c0052b0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.372+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/3719133822 shutdown_connections 2024-09-13T16:04:45.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.372+0000 7f5d7cdfd740 1 --2- 172.21.15.17:0/3719133822 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e930bac9b0 0x55e930c06900 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.372+0000 7f5d7cdfd740 1 --2- 172.21.15.17:0/3719133822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e930b9cc50 0x55e930ba5240 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.372+0000 7f5d61600640 0 client.25895 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:04:45.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.372+0000 7f5d7cdfd740 1 --2- 172.21.15.17:0/3719133822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e930b97bc0 0x55e930ba4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.372+0000 7f5d7cdfd740 1 --2- 172.21.15.17:0/3719133822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e930b97280 0x55e930ba8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.372+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/3719133822 >> 172.21.15.17:0/3719133822 conn(0x55e930b928f0 msgr2=0x55e930ba0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.372+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/3719133822 shutdown_connections 2024-09-13T16:04:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.373+0000 7f5d7cdfd740 1 -- 172.21.15.17:0/3719133822 wait complete. 2024-09-13T16:04:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.373+0000 7f5d7cdfd740 20 client.25895 trim_cache size 0 max 16384 2024-09-13T16:04:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:04:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:04:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:04:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:04:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.373+0000 7f5d7a000640 1 -- 172.21.15.17:0/2826907108 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5d580a1190 msgr2=0x7f5d580a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.374+0000 7f5d7a000640 1 --2- 172.21.15.17:0/2826907108 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5d580a1190 0x7f5d580a3650 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c015000 tx=0x7f5d6c01b000 comp rx=0 tx=0).stop 2024-09-13T16:04:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.374+0000 7f5d7a000640 1 -- 172.21.15.17:0/2826907108 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d74072e90 msgr2=0x7f5d7406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.374+0000 7f5d7a000640 1 --2- 172.21.15.17:0/2826907108 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d74072e90 0x7f5d7406ee80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5d6402f8e0 tx=0x7f5d64003c20 comp rx=0 tx=0).stop 2024-09-13T16:04:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.374+0000 7f5d7a000640 1 -- 172.21.15.17:0/2826907108 shutdown_connections 2024-09-13T16:04:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.374+0000 7f5d7a000640 1 --2- 172.21.15.17:0/2826907108 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5d580a1190 0x7f5d580a3650 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.374+0000 7f5d7a000640 1 --2- 172.21.15.17:0/2826907108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d74107bc0 0x7f5d741a80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.374+0000 7f5d7a000640 1 --2- 172.21.15.17:0/2826907108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d74074470 0x7f5d7406f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.374+0000 7f5d7a000640 1 --2- 172.21.15.17:0/2826907108 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d74072e90 0x7f5d7406ee80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.374+0000 7f5d7a000640 1 -- 172.21.15.17:0/2826907108 >> 172.21.15.17:0/2826907108 conn(0x7f5d740fb4b0 msgr2=0x7f5d74103b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.374+0000 7f5d7a000640 1 -- 172.21.15.17:0/2826907108 shutdown_connections 2024-09-13T16:04:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:45.374+0000 7f5d7a000640 1 -- 172.21.15.17:0/2826907108 wait complete. 2024-09-13T16:04:45.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:45 smithi189 ceph-mon[34790]: pgmap v595: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.3 MiB/s wr, 599 op/s 2024-09-13T16:04:46.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:45 smithi193 ceph-mon[35248]: pgmap v595: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.3 MiB/s wr, 599 op/s 2024-09-13T16:04:46.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:45 smithi017 ceph-mon[30494]: pgmap v595: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.3 MiB/s wr, 599 op/s 2024-09-13T16:04:48.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:47 smithi193 ceph-mon[35248]: pgmap v596: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.2 MiB/s wr, 509 op/s 2024-09-13T16:04:48.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:47 smithi017 ceph-mon[30494]: pgmap v596: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.2 MiB/s wr, 509 op/s 2024-09-13T16:04:48.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:47 smithi189 ceph-mon[34790]: pgmap v596: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.2 MiB/s wr, 509 op/s 2024-09-13T16:04:50.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:49 smithi193 ceph-mon[35248]: pgmap v597: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.2 MiB/s wr, 510 op/s 2024-09-13T16:04:50.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:49 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:04:50.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:49 smithi017 ceph-mon[30494]: pgmap v597: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.2 MiB/s wr, 510 op/s 2024-09-13T16:04:50.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:49 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:04:50.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:49 smithi189 ceph-mon[34790]: pgmap v597: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.2 MiB/s wr, 510 op/s 2024-09-13T16:04:50.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:49 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:04:50.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 425.0 s, 577.2 tps, lat 173.898 ms stddev 213.818 2024-09-13T16:04:52.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:51 smithi193 ceph-mon[35248]: pgmap v598: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 563 op/s 2024-09-13T16:04:52.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:51 smithi017 ceph-mon[30494]: pgmap v598: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 563 op/s 2024-09-13T16:04:52.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:51 smithi189 ceph-mon[34790]: pgmap v598: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 563 op/s 2024-09-13T16:04:54.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:53 smithi193 ceph-mon[35248]: pgmap v599: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.4 MiB/s wr, 534 op/s 2024-09-13T16:04:54.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:53 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:04:54.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:53 smithi017 ceph-mon[30494]: pgmap v599: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.4 MiB/s wr, 534 op/s 2024-09-13T16:04:54.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:53 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:04:54.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:53 smithi189 ceph-mon[34790]: pgmap v599: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.4 MiB/s wr, 534 op/s 2024-09-13T16:04:54.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:53 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:04:55.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 430.0 s, 579.8 tps, lat 167.304 ms stddev 258.705 2024-09-13T16:04:56.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:55 smithi193 ceph-mon[35248]: pgmap v600: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.3 MiB/s wr, 578 op/s 2024-09-13T16:04:56.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:55 smithi017 ceph-mon[30494]: pgmap v600: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.3 MiB/s wr, 578 op/s 2024-09-13T16:04:56.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:55 smithi189 ceph-mon[34790]: pgmap v600: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.3 MiB/s wr, 578 op/s 2024-09-13T16:04:58.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:57 smithi193 ceph-mon[35248]: pgmap v601: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 542 op/s 2024-09-13T16:04:58.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:57 smithi017 ceph-mon[30494]: pgmap v601: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 542 op/s 2024-09-13T16:04:58.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:57 smithi189 ceph-mon[34790]: pgmap v601: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 542 op/s 2024-09-13T16:04:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.679+0000 7f5edf200640 1 -- 172.21.15.17:0/1335396260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ed8105a10 msgr2=0x7f5ed8107e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:58.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.679+0000 7f5edf200640 1 --2- 172.21.15.17:0/1335396260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ed8105a10 0x7f5ed8107e80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009be0 tx=0x7f5ed002a6c0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.681+0000 7f5edf200640 1 -- 172.21.15.17:0/1335396260 shutdown_connections 2024-09-13T16:04:58.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.681+0000 7f5edf200640 1 --2- 172.21.15.17:0/1335396260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ed8105a10 0x7f5ed8107e80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.681+0000 7f5edf200640 1 --2- 172.21.15.17:0/1335396260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ed81030e0 0x7f5ed81054d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.681+0000 7f5edf200640 1 --2- 172.21.15.17:0/1335396260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ed81007b0 0x7f5ed8102ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.681+0000 7f5edf200640 1 -- 172.21.15.17:0/1335396260 >> 172.21.15.17:0/1335396260 conn(0x7f5ed80fa3b0 msgr2=0x7f5ed80fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:58.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.682+0000 7f5edf200640 1 -- 172.21.15.17:0/1335396260 shutdown_connections 2024-09-13T16:04:58.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.682+0000 7f5edf200640 1 -- 172.21.15.17:0/1335396260 wait complete. 2024-09-13T16:04:58.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.683+0000 7f5edf200640 1 Processor -- start 2024-09-13T16:04:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.685+0000 7f5edf200640 1 -- start start 2024-09-13T16:04:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.685+0000 7f5edf200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ed81007b0 0x7f5ed81980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.685+0000 7f5edf200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ed81030e0 0x7f5ed81985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.685+0000 7f5edf200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ed8105a10 0x7f5ed819f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.685+0000 7f5edf200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed819fb90 con 0x7f5ed81030e0 2024-09-13T16:04:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.685+0000 7f5edf200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed819fd00 con 0x7f5ed81007b0 2024-09-13T16:04:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.685+0000 7f5edf200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed819fec0 con 0x7f5ed8105a10 2024-09-13T16:04:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.686+0000 7f5edd200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ed8105a10 0x7f5ed819f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.686+0000 7f5ed7e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ed81007b0 0x7f5ed81980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.686+0000 7f5edd200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ed8105a10 0x7f5ed819f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:56908/0 (socket says 172.21.15.17:56908) 2024-09-13T16:04:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.686+0000 7f5ed7e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ed81007b0 0x7f5ed81980a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:40690/0 (socket says 172.21.15.17:40690) 2024-09-13T16:04:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.686+0000 7f5edd200640 1 -- 172.21.15.17:0/924069186 learned_addr learned my addr 172.21.15.17:0/924069186 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.686+0000 7f5ed7400640 1 --2- 172.21.15.17:0/924069186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ed81030e0 0x7f5ed81985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.686+0000 7f5ed7e00640 1 -- 172.21.15.17:0/924069186 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ed8105a10 msgr2=0x7f5ed819f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.686+0000 7f5ed7e00640 1 --2- 172.21.15.17:0/924069186 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ed8105a10 0x7f5ed819f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.686+0000 7f5ed7e00640 1 -- 172.21.15.17:0/924069186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ed81030e0 msgr2=0x7f5ed81985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.686+0000 7f5ed7e00640 1 --2- 172.21.15.17:0/924069186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ed81030e0 0x7f5ed81985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.687+0000 7f5ed7e00640 1 -- 172.21.15.17:0/924069186 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec4009560 con 0x7f5ed81007b0 2024-09-13T16:04:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.687+0000 7f5edd200640 1 --2- 172.21.15.17:0/924069186 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ed8105a10 0x7f5ed819f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:04:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.689+0000 7f5ed7e00640 1 --2- 172.21.15.17:0/924069186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ed81007b0 0x7f5ed81980a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4005fd0 tx=0x7f5ec400ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.691+0000 7f5ed4c00640 1 -- 172.21.15.17:0/924069186 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec400ccc0 con 0x7f5ed81007b0 2024-09-13T16:04:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.691+0000 7f5ed4c00640 1 -- 172.21.15.17:0/924069186 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ec400ce20 con 0x7f5ed81007b0 2024-09-13T16:04:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.691+0000 7f5ed4c00640 1 -- 172.21.15.17:0/924069186 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4010430 con 0x7f5ed81007b0 2024-09-13T16:04:58.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.693+0000 7f5edf200640 1 -- 172.21.15.17:0/924069186 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed0009840 con 0x7f5ed81007b0 2024-09-13T16:04:58.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.693+0000 7f5edf200640 1 -- 172.21.15.17:0/924069186 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed81a0520 con 0x7f5ed81007b0 2024-09-13T16:04:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.698+0000 7f5ee2022740 1 Processor -- start 2024-09-13T16:04:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.704+0000 7f5ed4c00640 1 -- 172.21.15.17:0/924069186 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5ec4003f60 con 0x7f5ed81007b0 2024-09-13T16:04:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.706+0000 7f5ee2022740 1 -- start start 2024-09-13T16:04:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.706+0000 7f5ed4c00640 1 --2- 172.21.15.17:0/924069186 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5ebc0a11e0 0x7f5ebc0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.706+0000 7f5ee2022740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f877ea70 0x55e1f877ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.706+0000 7f5ee2022740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1f877f3b0 0x55e1f8783e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.706+0000 7f5ee2022740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e1f8784440 0x55e1f8786900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.706+0000 7f5ee2022740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f868abb0 con 0x55e1f8784440 2024-09-13T16:04:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.706+0000 7f5ee2022740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f86e8a70 con 0x55e1f877f3b0 2024-09-13T16:04:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.706+0000 7f5ee2022740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f86e6200 con 0x55e1f877ea70 2024-09-13T16:04:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.706+0000 7f5ed4c00640 1 -- 172.21.15.17:0/924069186 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f5ec4014070 con 0x7f5ed81007b0 2024-09-13T16:04:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.707+0000 7f5ed7e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f877ea70 0x55e1f877ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.707+0000 7f5ed7e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f877ea70 0x55e1f877ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:56920/0 (socket says 172.21.15.17:56920) 2024-09-13T16:04:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.707+0000 7f5ed7e00640 1 -- 172.21.15.17:0/2854669264 learned_addr learned my addr 172.21.15.17:0/2854669264 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.708+0000 7f5ed7e00640 1 -- 172.21.15.17:0/2854669264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1f877f3b0 msgr2=0x55e1f8783e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:04:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.708+0000 7f5ed7e00640 1 --2- 172.21.15.17:0/2854669264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1f877f3b0 0x55e1f8783e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.708+0000 7f5ed7e00640 1 -- 172.21.15.17:0/2854669264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e1f8784440 msgr2=0x55e1f8786900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:04:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.708+0000 7f5ed7e00640 1 --2- 172.21.15.17:0/2854669264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e1f8784440 0x55e1f8786900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.708+0000 7f5ed7e00640 1 -- 172.21.15.17:0/2854669264 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1f8683940 con 0x55e1f877ea70 2024-09-13T16:04:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.708+0000 7f5edd200640 1 --2- 172.21.15.17:0/924069186 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5ebc0a11e0 0x7f5ebc0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.709+0000 7f5ed7e00640 1 --2- 172.21.15.17:0/2854669264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f877ea70 0x55e1f877ee70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4096af0 tx=0x7f5ec4005790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bcdd40abd01fee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:58.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.709+0000 7f5ecd600640 1 -- 172.21.15.17:0/2854669264 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec409d030 con 0x55e1f877ea70 2024-09-13T16:04:58.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.710+0000 7f5ecd600640 1 -- 172.21.15.17:0/2854669264 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ec409deb0 con 0x55e1f877ea70 2024-09-13T16:04:58.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.710+0000 7f5ecd600640 1 -- 172.21.15.17:0/2854669264 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4004210 con 0x55e1f877ea70 2024-09-13T16:04:58.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.711+0000 7f5ee2022740 1 -- 172.21.15.17:0/2854669264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f877ea70 msgr2=0x55e1f877ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:58.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.711+0000 7f5ee2022740 1 --2- 172.21.15.17:0/2854669264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f877ea70 0x55e1f877ee70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4096af0 tx=0x7f5ec4005790 comp rx=0 tx=0).stop 2024-09-13T16:04:58.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.712+0000 7f5edd200640 1 --2- 172.21.15.17:0/924069186 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5ebc0a11e0 0x7f5ebc0a36a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00307c0 tx=0x7f5ed0030750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:58.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.712+0000 7f5ee2022740 1 -- 172.21.15.17:0/2854669264 shutdown_connections 2024-09-13T16:04:58.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.712+0000 7f5ee2022740 1 --2- 172.21.15.17:0/2854669264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e1f8784440 0x55e1f8786900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.712+0000 7f5ee2022740 1 --2- 172.21.15.17:0/2854669264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1f877f3b0 0x55e1f8783e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.712+0000 7f5ee2022740 1 --2- 172.21.15.17:0/2854669264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f877ea70 0x55e1f877ee70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.712+0000 7f5ee2022740 1 -- 172.21.15.17:0/2854669264 >> 172.21.15.17:0/2854669264 conn(0x55e1f877a0e0 msgr2=0x55e1f877a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:58.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.712+0000 7f5ee2022740 1 -- 172.21.15.17:0/2854669264 shutdown_connections 2024-09-13T16:04:58.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.713+0000 7f5ee2022740 1 -- 172.21.15.17:0/2854669264 wait complete. 2024-09-13T16:04:58.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.713+0000 7f5ee2022740 1 -- start start 2024-09-13T16:04:58.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.714+0000 7f5ee2022740 1 Processor -- start 2024-09-13T16:04:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.717+0000 7f5ee2022740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e1f877ea70 0x55e1f87a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.717+0000 7f5ee2022740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1f877f3b0 0x55e1f87a2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.717+0000 7f5ee2022740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f8784440 0x55e1f87a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.717+0000 7f5ee2022740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f86e1af0 con 0x55e1f877ea70 2024-09-13T16:04:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.717+0000 7f5ee2022740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f869ff20 con 0x55e1f877f3b0 2024-09-13T16:04:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.717+0000 7f5ee2022740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f869fbc0 con 0x55e1f8784440 2024-09-13T16:04:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.717+0000 7f5ee2022740 10 client.0 _ll_register_callbacks cb 0x55e1f86d1a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:04:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.717+0000 7f5edd200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f8784440 0x55e1f87a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.717+0000 7f5edd200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f8784440 0x55e1f87a94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:56928/0 (socket says 172.21.15.17:56928) 2024-09-13T16:04:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.717+0000 7f5edd200640 1 -- 172.21.15.17:0/243746964 learned_addr learned my addr 172.21.15.17:0/243746964 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.718+0000 7f5ed7e00640 1 --2- 172.21.15.17:0/243746964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e1f877ea70 0x55e1f87a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.718+0000 7f5ed7400640 1 --2- 172.21.15.17:0/243746964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1f877f3b0 0x55e1f87a2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.718+0000 7f5edd200640 1 -- 172.21.15.17:0/243746964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1f877f3b0 msgr2=0x55e1f87a2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.718+0000 7f5edd200640 1 --2- 172.21.15.17:0/243746964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1f877f3b0 0x55e1f87a2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.718+0000 7f5edd200640 1 -- 172.21.15.17:0/243746964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e1f877ea70 msgr2=0x55e1f87a1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.718+0000 7f5edd200640 1 --2- 172.21.15.17:0/243746964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e1f877ea70 0x55e1f87a1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.718+0000 7f5edd200640 1 -- 172.21.15.17:0/243746964 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed81a0520 con 0x55e1f8784440 2024-09-13T16:04:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.719+0000 7f5ed7400640 1 --2- 172.21.15.17:0/243746964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1f877f3b0 0x55e1f87a2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:04:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.719+0000 7f5ed7e00640 1 --2- 172.21.15.17:0/243746964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e1f877ea70 0x55e1f87a1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:04:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.719+0000 7f5edd200640 1 --2- 172.21.15.17:0/243746964 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f8784440 0x55e1f87a94c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0030860 tx=0x7f5ed002a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb613789e9887949 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.719+0000 7f5ec2000640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:04:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.721+0000 7f5ec2000640 1 -- 172.21.15.17:0/243746964 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0009280 con 0x55e1f8784440 2024-09-13T16:04:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.721+0000 7f5ec2000640 1 -- 172.21.15.17:0/243746964 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f5ed0042070 con 0x55e1f8784440 2024-09-13T16:04:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.721+0000 7f5ee2022740 1 -- 172.21.15.17:0/243746964 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e1f870bc90 con 0x55e1f8784440 2024-09-13T16:04:58.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.722+0000 7f5ec2000640 1 -- 172.21.15.17:0/243746964 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ed0049450 con 0x55e1f8784440 2024-09-13T16:04:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.722+0000 7f5ee2022740 10 client.25930 fetch_fsmap learned FSMap version 41 2024-09-13T16:04:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.722+0000 7f5ee2022740 1 -- 172.21.15.17:0/243746964 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55e1f86e0170 con 0x55e1f8784440 2024-09-13T16:04:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.722+0000 7f5ec2000640 1 -- 172.21.15.17:0/243746964 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e1f870bc90 con 0x55e1f8784440 2024-09-13T16:04:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.722+0000 7f5ec2000640 1 -- 172.21.15.17:0/243746964 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 41) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f5ed0031740 con 0x55e1f8784440 2024-09-13T16:04:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.722+0000 7f5ee2022740 10 client.25930 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T16:04:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.722+0000 7f5ee2022740 10 client.25930 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:04:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.722+0000 7f5ee2022740 20 client.25930 populate_metadata read hostname 'smithi017' 2024-09-13T16:04:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.722+0000 7f5ee2022740 1 --2- 172.21.15.17:0/243746964 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e1f87adc20 0x55e1f87b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.722+0000 7f5ee2022740 4 client.25930 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:04:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.722+0000 7f5ee2022740 1 -- 172.21.15.17:0/243746964 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e1f86d47d0 con 0x55e1f87adc20 2024-09-13T16:04:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.723+0000 7f5ed7e00640 1 --2- 172.21.15.17:0/243746964 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e1f87adc20 0x55e1f87b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.724+0000 7f5ed7e00640 1 --2- 172.21.15.17:0/243746964 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e1f87adc20 0x55e1f87b0040 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a27ca424c018fbd server_cookie=eea9b096d26e1798 in_seq=0 out_seq=0 2024-09-13T16:04:58.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.724+0000 7f5ec2000640 10 client.25930 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:04:58.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.724+0000 7f5ec2000640 1 -- 172.21.15.17:0/243746964 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e1f86d47d0 con 0x55e1f87adc20 2024-09-13T16:04:58.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.724+0000 7f5ec2000640 10 client.25930 handle_command_reply: tid=0 2024-09-13T16:04:58.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.725+0000 7f5ee2022740 1 client.25930 shutdown 2024-09-13T16:04:58.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.725+0000 7f5ee2022740 1 -- 172.21.15.17:0/243746964 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f8784440 msgr2=0x55e1f87a94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.725+0000 7f5ee2022740 1 --2- 172.21.15.17:0/243746964 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f8784440 0x55e1f87a94c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0030860 tx=0x7f5ed002a6c0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.726+0000 7f5ee2022740 1 -- 172.21.15.17:0/243746964 shutdown_connections 2024-09-13T16:04:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.726+0000 7f5ee2022740 1 --2- 172.21.15.17:0/243746964 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e1f87adc20 0x55e1f87b0040 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.726+0000 7f5ee2022740 1 --2- 172.21.15.17:0/243746964 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f8784440 0x55e1f87a94c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.726+0000 7f5ee2022740 1 --2- 172.21.15.17:0/243746964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1f877f3b0 0x55e1f87a2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.726+0000 7f5ee2022740 1 --2- 172.21.15.17:0/243746964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e1f877ea70 0x55e1f87a1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.726+0000 7f5ec2000640 0 client.25930 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:04:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.726+0000 7f5ee2022740 1 -- 172.21.15.17:0/243746964 >> 172.21.15.17:0/243746964 conn(0x55e1f877a0e0 msgr2=0x55e1f877b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.726+0000 7f5ee2022740 1 -- 172.21.15.17:0/243746964 shutdown_connections 2024-09-13T16:04:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.726+0000 7f5ee2022740 1 -- 172.21.15.17:0/243746964 wait complete. 2024-09-13T16:04:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.726+0000 7f5ee2022740 20 client.25930 trim_cache size 0 max 16384 2024-09-13T16:04:58.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.776+0000 7f5ee2022740 1 Processor -- start 2024-09-13T16:04:58.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.778+0000 7f5ee2022740 1 -- start start 2024-09-13T16:04:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.778+0000 7f5ee2022740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e1f877ea70 0x55e1f87a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.778+0000 7f5ee2022740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f877f3b0 0x55e1f87a9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.779+0000 7f5ee2022740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1f8784440 0x55e1f87a2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.779+0000 7f5ee2022740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f8448e60 con 0x55e1f877ea70 2024-09-13T16:04:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.779+0000 7f5ee2022740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f8779a20 con 0x55e1f8784440 2024-09-13T16:04:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.779+0000 7f5ee2022740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f877fe10 con 0x55e1f877f3b0 2024-09-13T16:04:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.779+0000 7f5ed7400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f877f3b0 0x55e1f87a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.779+0000 7f5ed7400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f877f3b0 0x55e1f87a9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:56936/0 (socket says 172.21.15.17:56936) 2024-09-13T16:04:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.779+0000 7f5ed7400640 1 -- 172.21.15.17:0/3246299155 learned_addr learned my addr 172.21.15.17:0/3246299155 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.779+0000 7f5edd200640 1 --2- 172.21.15.17:0/3246299155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1f8784440 0x55e1f87a2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.780+0000 7f5ed7400640 1 -- 172.21.15.17:0/3246299155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1f8784440 msgr2=0x55e1f87a2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.780+0000 7f5ed7400640 1 --2- 172.21.15.17:0/3246299155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1f8784440 0x55e1f87a2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.780+0000 7f5ed7400640 1 -- 172.21.15.17:0/3246299155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e1f877ea70 msgr2=0x55e1f87a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.780+0000 7f5ed7400640 1 --2- 172.21.15.17:0/3246299155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e1f877ea70 0x55e1f87a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.780+0000 7f5ed7400640 1 -- 172.21.15.17:0/3246299155 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1f8682180 con 0x55e1f877f3b0 2024-09-13T16:04:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.780+0000 7f5ed7400640 1 --2- 172.21.15.17:0/3246299155 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f877f3b0 0x55e1f87a9480 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80099b0 tx=0x7f5ec8009110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fc9e78841d88bb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.781+0000 7f5ece000640 1 -- 172.21.15.17:0/3246299155 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8010c20 con 0x55e1f877f3b0 2024-09-13T16:04:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.781+0000 7f5ece000640 1 -- 172.21.15.17:0/3246299155 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ec8010d80 con 0x55e1f877f3b0 2024-09-13T16:04:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.781+0000 7f5ece000640 1 -- 172.21.15.17:0/3246299155 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec80136e0 con 0x55e1f877f3b0 2024-09-13T16:04:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.782+0000 7f5ee2022740 1 -- 172.21.15.17:0/3246299155 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f877f3b0 msgr2=0x55e1f87a9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.782+0000 7f5ee2022740 1 --2- 172.21.15.17:0/3246299155 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f877f3b0 0x55e1f87a9480 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80099b0 tx=0x7f5ec8009110 comp rx=0 tx=0).stop 2024-09-13T16:04:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.783+0000 7f5ee2022740 1 -- 172.21.15.17:0/3246299155 shutdown_connections 2024-09-13T16:04:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.783+0000 7f5ee2022740 1 --2- 172.21.15.17:0/3246299155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1f8784440 0x55e1f87a2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.783+0000 7f5ee2022740 1 --2- 172.21.15.17:0/3246299155 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f877f3b0 0x55e1f87a9480 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.783+0000 7f5ee2022740 1 --2- 172.21.15.17:0/3246299155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e1f877ea70 0x55e1f87a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.783+0000 7f5ee2022740 1 -- 172.21.15.17:0/3246299155 >> 172.21.15.17:0/3246299155 conn(0x55e1f877a0e0 msgr2=0x55e1f87838d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.783+0000 7f5ee2022740 1 -- 172.21.15.17:0/3246299155 shutdown_connections 2024-09-13T16:04:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.783+0000 7f5ee2022740 1 -- 172.21.15.17:0/3246299155 wait complete. 2024-09-13T16:04:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.784+0000 7f5ee2022740 1 -- start start 2024-09-13T16:04:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.784+0000 7f5ee2022740 1 Processor -- start 2024-09-13T16:04:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.785+0000 7f5ee2022740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e1f877ea70 0x55e1f87a3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.785+0000 7f5ee2022740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f877f3b0 0x55e1f87a44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.785+0000 7f5ee2022740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1f8784440 0x55e1f879a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.786+0000 7f5ed7400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f877f3b0 0x55e1f87a44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.786+0000 7f5ed7400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f877f3b0 0x55e1f87a44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:56950/0 (socket says 172.21.15.17:56950) 2024-09-13T16:04:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.786+0000 7f5edd200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1f8784440 0x55e1f879a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.786+0000 7f5edd200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1f8784440 0x55e1f879a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:40724/0 (socket says 172.21.15.17:40724) 2024-09-13T16:04:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.786+0000 7f5edd200640 1 -- 172.21.15.17:0/3625861099 learned_addr learned my addr 172.21.15.17:0/3625861099 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:04:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.786+0000 7f5ee2022740 1 -- 172.21.15.17:0/3625861099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f87a9510 con 0x55e1f877ea70 2024-09-13T16:04:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.786+0000 7f5ee2022740 1 -- 172.21.15.17:0/3625861099 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f87a9680 con 0x55e1f8784440 2024-09-13T16:04:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.786+0000 7f5ee2022740 1 -- 172.21.15.17:0/3625861099 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f87a9840 con 0x55e1f877f3b0 2024-09-13T16:04:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.786+0000 7f5ee2022740 10 client.0 _ll_register_callbacks cb 0x7f5ec4096440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:04:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.786+0000 7f5ed7e00640 1 --2- 172.21.15.17:0/3625861099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e1f877ea70 0x55e1f87a3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.787+0000 7f5edd200640 1 -- 172.21.15.17:0/3625861099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f877f3b0 msgr2=0x55e1f87a44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.787+0000 7f5edd200640 1 --2- 172.21.15.17:0/3625861099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f877f3b0 0x55e1f87a44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.787+0000 7f5edd200640 1 -- 172.21.15.17:0/3625861099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e1f877ea70 msgr2=0x55e1f87a3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:04:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.787+0000 7f5edd200640 1 --2- 172.21.15.17:0/3625861099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e1f877ea70 0x55e1f87a3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.787+0000 7f5edd200640 1 -- 172.21.15.17:0/3625861099 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec8009660 con 0x55e1f8784440 2024-09-13T16:04:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.787+0000 7f5ed7e00640 1 --2- 172.21.15.17:0/3625861099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e1f877ea70 0x55e1f87a3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:04:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.788+0000 7f5edd200640 1 --2- 172.21.15.17:0/3625861099 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1f8784440 0x55e1f879a6a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0030990 tx=0x7f5ed0030b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6c597a4f1bb13f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:04:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.788+0000 7f5ec2000640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:04:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.788+0000 7f5ec2000640 1 -- 172.21.15.17:0/3625861099 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0049860 con 0x55e1f8784440 2024-09-13T16:04:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.788+0000 7f5ec2000640 1 -- 172.21.15.17:0/3625861099 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f5ed0042070 con 0x55e1f8784440 2024-09-13T16:04:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.788+0000 7f5ee2022740 1 -- 172.21.15.17:0/3625861099 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5ec409deb0 con 0x55e1f8784440 2024-09-13T16:04:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.790+0000 7f5ec2000640 1 -- 172.21.15.17:0/3625861099 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ed0009280 con 0x55e1f8784440 2024-09-13T16:04:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.790+0000 7f5ee2022740 10 client.25907 fetch_fsmap learned FSMap version 41 2024-09-13T16:04:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.790+0000 7f5ee2022740 1 -- 172.21.15.17:0/3625861099 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55e1f86a7560 con 0x55e1f8784440 2024-09-13T16:04:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.790+0000 7f5ec2000640 1 -- 172.21.15.17:0/3625861099 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ec409deb0 con 0x55e1f8784440 2024-09-13T16:04:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.790+0000 7f5ec2000640 1 -- 172.21.15.17:0/3625861099 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 41) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f5ed0052770 con 0x55e1f8784440 2024-09-13T16:04:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.790+0000 7f5ee2022740 10 client.25907 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T16:04:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.790+0000 7f5ee2022740 10 client.25907 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:04:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.790+0000 7f5ee2022740 20 client.25907 populate_metadata read hostname 'smithi017' 2024-09-13T16:04:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.790+0000 7f5ee2022740 1 --2- 172.21.15.17:0/3625861099 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e1f879c130 0x55e1f879e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:04:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.790+0000 7f5ee2022740 4 client.25907 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:04:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.790+0000 7f5ee2022740 1 -- 172.21.15.17:0/3625861099 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e1f83d5300 con 0x55e1f879c130 2024-09-13T16:04:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.791+0000 7f5ed7e00640 1 --2- 172.21.15.17:0/3625861099 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e1f879c130 0x55e1f879e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:04:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.792+0000 7f5ed7e00640 1 --2- 172.21.15.17:0/3625861099 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e1f879c130 0x55e1f879e550 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e64464568f2102d6 server_cookie=f4b517fae7a22cb3 in_seq=0 out_seq=0 2024-09-13T16:04:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.792+0000 7f5ec2000640 10 client.25907 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:04:58.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.808+0000 7f5ec2000640 1 -- 172.21.15.17:0/3625861099 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e1f83d5300 con 0x55e1f879c130 2024-09-13T16:04:58.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.808+0000 7f5ec2000640 10 client.25907 handle_command_reply: tid=0 2024-09-13T16:04:58.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.808+0000 7f5ee2022740 1 client.25907 shutdown 2024-09-13T16:04:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.809+0000 7f5ee2022740 1 -- 172.21.15.17:0/3625861099 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1f8784440 msgr2=0x55e1f879a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.809+0000 7f5ee2022740 1 --2- 172.21.15.17:0/3625861099 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1f8784440 0x55e1f879a6a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0030990 tx=0x7f5ed0030b60 comp rx=0 tx=0).stop 2024-09-13T16:04:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.809+0000 7f5ee2022740 1 -- 172.21.15.17:0/3625861099 shutdown_connections 2024-09-13T16:04:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.809+0000 7f5ee2022740 1 --2- 172.21.15.17:0/3625861099 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55e1f879c130 0x55e1f879e550 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.809+0000 7f5ee2022740 1 --2- 172.21.15.17:0/3625861099 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e1f8784440 0x55e1f879a6a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.809+0000 7f5ee2022740 1 --2- 172.21.15.17:0/3625861099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e1f877f3b0 0x55e1f87a44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.809+0000 7f5ee2022740 1 --2- 172.21.15.17:0/3625861099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e1f877ea70 0x55e1f87a3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.809+0000 7f5ee2022740 1 -- 172.21.15.17:0/3625861099 >> 172.21.15.17:0/3625861099 conn(0x55e1f877a0e0 msgr2=0x55e1f87802d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.809+0000 7f5ec2000640 0 client.25907 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:04:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.809+0000 7f5ee2022740 1 -- 172.21.15.17:0/3625861099 shutdown_connections 2024-09-13T16:04:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.809+0000 7f5ee2022740 1 -- 172.21.15.17:0/3625861099 wait complete. 2024-09-13T16:04:58.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.812+0000 7f5ee2022740 20 client.25907 trim_cache size 0 max 16384 2024-09-13T16:04:58.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:04:58.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:04:58.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:04:58.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:04:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.814+0000 7f5edf200640 1 -- 172.21.15.17:0/924069186 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5ebc0a11e0 msgr2=0x7f5ebc0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.814+0000 7f5edf200640 1 --2- 172.21.15.17:0/924069186 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5ebc0a11e0 0x7f5ebc0a36a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00307c0 tx=0x7f5ed0030750 comp rx=0 tx=0).stop 2024-09-13T16:04:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.814+0000 7f5edf200640 1 -- 172.21.15.17:0/924069186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ed81007b0 msgr2=0x7f5ed81980a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:04:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.814+0000 7f5edf200640 1 --2- 172.21.15.17:0/924069186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ed81007b0 0x7f5ed81980a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4005fd0 tx=0x7f5ec400ed90 comp rx=0 tx=0).stop 2024-09-13T16:04:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.814+0000 7f5edf200640 1 -- 172.21.15.17:0/924069186 shutdown_connections 2024-09-13T16:04:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.814+0000 7f5edf200640 1 --2- 172.21.15.17:0/924069186 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5ebc0a11e0 0x7f5ebc0a36a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.814+0000 7f5edf200640 1 --2- 172.21.15.17:0/924069186 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ed8105a10 0x7f5ed819f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.814+0000 7f5edf200640 1 --2- 172.21.15.17:0/924069186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ed81030e0 0x7f5ed81985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.814+0000 7f5edf200640 1 --2- 172.21.15.17:0/924069186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ed81007b0 0x7f5ed81980a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:04:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.814+0000 7f5edf200640 1 -- 172.21.15.17:0/924069186 >> 172.21.15.17:0/924069186 conn(0x7f5ed80fa3b0 msgr2=0x7f5ed80fff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:04:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.815+0000 7f5edf200640 1 -- 172.21.15.17:0/924069186 shutdown_connections 2024-09-13T16:04:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:04:58.815+0000 7f5edf200640 1 -- 172.21.15.17:0/924069186 wait complete. 2024-09-13T16:05:00.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:04:59 smithi193 ceph-mon[35248]: pgmap v602: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.0 MiB/s wr, 544 op/s 2024-09-13T16:05:00.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:04:59 smithi017 ceph-mon[30494]: pgmap v602: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.0 MiB/s wr, 544 op/s 2024-09-13T16:05:00.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:04:59 smithi189 ceph-mon[34790]: pgmap v602: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.0 MiB/s wr, 544 op/s 2024-09-13T16:05:00.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 435.0 s, 579.0 tps, lat 181.230 ms stddev 240.492 2024-09-13T16:05:02.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:01 smithi193 ceph-mon[35248]: pgmap v603: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 605 op/s 2024-09-13T16:05:02.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:01 smithi189 ceph-mon[34790]: pgmap v603: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 605 op/s 2024-09-13T16:05:02.154 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:01 smithi017 ceph-mon[30494]: pgmap v603: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 605 op/s 2024-09-13T16:05:04.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:03 smithi193 ceph-mon[35248]: pgmap v604: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 MiB/s wr, 560 op/s 2024-09-13T16:05:04.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:03 smithi189 ceph-mon[34790]: pgmap v604: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 MiB/s wr, 560 op/s 2024-09-13T16:05:04.253 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:03 smithi017 ceph-mon[30494]: pgmap v604: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 MiB/s wr, 560 op/s 2024-09-13T16:05:05.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 440.0 s, 577.4 tps, lat 174.238 ms stddev 235.191 2024-09-13T16:05:06.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:05 smithi193 ceph-mon[35248]: pgmap v605: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 679 op/s 2024-09-13T16:05:06.014 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:05 smithi017 ceph-mon[30494]: pgmap v605: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 679 op/s 2024-09-13T16:05:06.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:05 smithi189 ceph-mon[34790]: pgmap v605: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 679 op/s 2024-09-13T16:05:08.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:07 smithi193 ceph-mon[35248]: pgmap v606: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 699 op/s 2024-09-13T16:05:08.014 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:07 smithi017 ceph-mon[30494]: pgmap v606: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 699 op/s 2024-09-13T16:05:08.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:07 smithi189 ceph-mon[34790]: pgmap v606: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 699 op/s 2024-09-13T16:05:10.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:09 smithi193 ceph-mon[35248]: pgmap v607: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 724 op/s 2024-09-13T16:05:10.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:09 smithi017 ceph-mon[30494]: pgmap v607: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 724 op/s 2024-09-13T16:05:10.108 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:09 smithi189 ceph-mon[34790]: pgmap v607: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 724 op/s 2024-09-13T16:05:10.315 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 445.0 s, 649.6 tps, lat 151.218 ms stddev 177.390 2024-09-13T16:05:11.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:10 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:05:11.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:10 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:05:11.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:10 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:05:12.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:11 smithi193 ceph-mon[35248]: pgmap v608: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 753 op/s 2024-09-13T16:05:12.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:11 smithi017 ceph-mon[30494]: pgmap v608: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 753 op/s 2024-09-13T16:05:12.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:11 smithi189 ceph-mon[34790]: pgmap v608: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 753 op/s 2024-09-13T16:05:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.401+0000 7f78c9600640 1 -- 172.21.15.17:0/3922888753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78c4071870 msgr2=0x7f78c4110800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.401+0000 7f78c9600640 1 --2- 172.21.15.17:0/3922888753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78c4071870 0x7f78c4110800 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009860 tx=0x7f78b002a340 comp rx=0 tx=0).stop 2024-09-13T16:05:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.401+0000 7f78c9600640 1 -- 172.21.15.17:0/3922888753 shutdown_connections 2024-09-13T16:05:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.401+0000 7f78c9600640 1 --2- 172.21.15.17:0/3922888753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78c4071870 0x7f78c4110800 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.401+0000 7f78c9600640 1 --2- 172.21.15.17:0/3922888753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c4070eb0 0x7f78c4071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.401+0000 7f78c9600640 1 --2- 172.21.15.17:0/3922888753 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78c4107ad0 0x7f78c4107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.401+0000 7f78c9600640 1 -- 172.21.15.17:0/3922888753 >> 172.21.15.17:0/3922888753 conn(0x7f78c406cf30 msgr2=0x7f78c406f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.402+0000 7f78c9600640 1 -- 172.21.15.17:0/3922888753 shutdown_connections 2024-09-13T16:05:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.402+0000 7f78c9600640 1 -- 172.21.15.17:0/3922888753 wait complete. 2024-09-13T16:05:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.405+0000 7f78c9600640 1 Processor -- start 2024-09-13T16:05:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.405+0000 7f78c9600640 1 -- start start 2024-09-13T16:05:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.405+0000 7f78c9600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c4070eb0 0x7f78c41a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.405+0000 7f78c9600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78c4071870 0x7f78c41a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.406+0000 7f78c9600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78c4107ad0 0x7f78c41a7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.406+0000 7f78c9600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c41a81b0 con 0x7f78c4070eb0 2024-09-13T16:05:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.406+0000 7f78c9600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c41a8320 con 0x7f78c4071870 2024-09-13T16:05:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.406+0000 7f78c9600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c41a84e0 con 0x7f78c4107ad0 2024-09-13T16:05:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.406+0000 7f78c2000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78c4071870 0x7f78c41a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.406+0000 7f78c2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c4070eb0 0x7f78c41a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.406+0000 7f78c3400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78c4107ad0 0x7f78c41a7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.406+0000 7f78c3400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78c4107ad0 0x7f78c41a7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:33154/0 (socket says 172.21.15.17:33154) 2024-09-13T16:05:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.406+0000 7f78c3400640 1 -- 172.21.15.17:0/2333893103 learned_addr learned my addr 172.21.15.17:0/2333893103 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:05:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.407+0000 7f78c2000640 1 -- 172.21.15.17:0/2333893103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78c4107ad0 msgr2=0x7f78c41a7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.407+0000 7f78c2000640 1 --2- 172.21.15.17:0/2333893103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78c4107ad0 0x7f78c41a7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.407+0000 7f78c2000640 1 -- 172.21.15.17:0/2333893103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c4070eb0 msgr2=0x7f78c41a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.407+0000 7f78c2000640 1 --2- 172.21.15.17:0/2333893103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c4070eb0 0x7f78c41a06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.407+0000 7f78c2000640 1 -- 172.21.15.17:0/2333893103 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b0009490 con 0x7f78c4071870 2024-09-13T16:05:12.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.411+0000 7f78c2000640 1 --2- 172.21.15.17:0/2333893103 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78c4071870 0x7f78c41a0c00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f78b400afd0 tx=0x7f78b40076d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.411+0000 7f78bb400640 1 -- 172.21.15.17:0/2333893103 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b401a520 con 0x7f78c4071870 2024-09-13T16:05:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.411+0000 7f78bb400640 1 -- 172.21.15.17:0/2333893103 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78b401ab40 con 0x7f78c4071870 2024-09-13T16:05:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.411+0000 7f78bb400640 1 -- 172.21.15.17:0/2333893103 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b401cb60 con 0x7f78c4071870 2024-09-13T16:05:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.411+0000 7f78c9600640 1 -- 172.21.15.17:0/2333893103 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c410a830 con 0x7f78c4071870 2024-09-13T16:05:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.411+0000 7f78c9600640 1 -- 172.21.15.17:0/2333893103 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c410ad40 con 0x7f78c4071870 2024-09-13T16:05:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.419+0000 7f78bb400640 1 -- 172.21.15.17:0/2333893103 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f78b401ccc0 con 0x7f78c4071870 2024-09-13T16:05:12.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.419+0000 7f78cc40d740 1 Processor -- start 2024-09-13T16:05:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.422+0000 7f78cc40d740 1 -- start start 2024-09-13T16:05:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.423+0000 7f78bb400640 1 --2- 172.21.15.17:0/2333893103 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f78a80a1110 0x7f78a80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:12.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.423+0000 7f78cc40d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55841e83aa70 0x55841e83ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:12.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.423+0000 7f78cc40d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e83b3b0 0x55841e83fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:12.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.423+0000 7f78cc40d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e840440 0x55841e842900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:12.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.423+0000 7f78cc40d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55841e746bb0 con 0x55841e83b3b0 2024-09-13T16:05:12.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.423+0000 7f78cc40d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55841e7a4a70 con 0x55841e840440 2024-09-13T16:05:12.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.423+0000 7f78cc40d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55841e7a2200 con 0x55841e83aa70 2024-09-13T16:05:12.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.423+0000 7f78c2a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55841e83aa70 0x55841e83ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:12.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.423+0000 7f78c2a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55841e83aa70 0x55841e83ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:33160/0 (socket says 172.21.15.17:33160) 2024-09-13T16:05:12.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.423+0000 7f78c2a00640 1 -- 172.21.15.17:0/2468258463 learned_addr learned my addr 172.21.15.17:0/2468258463 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:05:12.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.424+0000 7f78c2000640 1 --2- 172.21.15.17:0/2468258463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e83b3b0 0x55841e83fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:12.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.424+0000 7f78c3400640 1 --2- 172.21.15.17:0/2468258463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e840440 0x55841e842900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:12.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.424+0000 7f78c2a00640 1 -- 172.21.15.17:0/2468258463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e840440 msgr2=0x55841e842900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:12.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.424+0000 7f78c2a00640 1 --2- 172.21.15.17:0/2468258463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e840440 0x55841e842900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.424+0000 7f78c2a00640 1 -- 172.21.15.17:0/2468258463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e83b3b0 msgr2=0x55841e83fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:12.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.424+0000 7f78c2a00640 1 --2- 172.21.15.17:0/2468258463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e83b3b0 0x55841e83fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.424+0000 7f78c2a00640 1 -- 172.21.15.17:0/2468258463 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55841e73f940 con 0x55841e83aa70 2024-09-13T16:05:12.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.424+0000 7f78c2000640 1 --2- 172.21.15.17:0/2468258463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e83b3b0 0x55841e83fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:05:12.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.424+0000 7f78bb400640 1 -- 172.21.15.17:0/2333893103 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f78b40d4990 con 0x7f78c4071870 2024-09-13T16:05:12.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.425+0000 7f78c3400640 1 --2- 172.21.15.17:0/2333893103 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f78a80a1110 0x7f78a80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:12.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.425+0000 7f78c2a00640 1 --2- 172.21.15.17:0/2468258463 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55841e83aa70 0x55841e83ae70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f78bc00e600 tx=0x7f78bc0095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=775435ab15cfc713 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:12.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.426+0000 7f78afe00640 1 -- 172.21.15.17:0/2468258463 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc01b070 con 0x55841e83aa70 2024-09-13T16:05:12.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.426+0000 7f78afe00640 1 -- 172.21.15.17:0/2468258463 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78bc003e30 con 0x55841e83aa70 2024-09-13T16:05:12.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.426+0000 7f78afe00640 1 -- 172.21.15.17:0/2468258463 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc013040 con 0x55841e83aa70 2024-09-13T16:05:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.428+0000 7f78cc40d740 1 -- 172.21.15.17:0/2468258463 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55841e83aa70 msgr2=0x55841e83ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.428+0000 7f78cc40d740 1 --2- 172.21.15.17:0/2468258463 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55841e83aa70 0x55841e83ae70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f78bc00e600 tx=0x7f78bc0095c0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.428+0000 7f78c3400640 1 --2- 172.21.15.17:0/2333893103 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f78a80a1110 0x7f78a80a35d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f78b0005b60 tx=0x7f78b0005ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.428+0000 7f78cc40d740 1 -- 172.21.15.17:0/2468258463 shutdown_connections 2024-09-13T16:05:12.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.428+0000 7f78cc40d740 1 --2- 172.21.15.17:0/2468258463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e840440 0x55841e842900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.428+0000 7f78cc40d740 1 --2- 172.21.15.17:0/2468258463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e83b3b0 0x55841e83fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.429+0000 7f78cc40d740 1 --2- 172.21.15.17:0/2468258463 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55841e83aa70 0x55841e83ae70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.429+0000 7f78cc40d740 1 -- 172.21.15.17:0/2468258463 >> 172.21.15.17:0/2468258463 conn(0x55841e8360e0 msgr2=0x55841e8364e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:12.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.429+0000 7f78cc40d740 1 -- 172.21.15.17:0/2468258463 shutdown_connections 2024-09-13T16:05:12.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.429+0000 7f78cc40d740 1 -- 172.21.15.17:0/2468258463 wait complete. 2024-09-13T16:05:12.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.430+0000 7f78cc40d740 1 -- start start 2024-09-13T16:05:12.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.430+0000 7f78cc40d740 1 Processor -- start 2024-09-13T16:05:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.432+0000 7f78cc40d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e83aa70 0x55841e844700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.432+0000 7f78cc40d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e83b3b0 0x55841e844c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.432+0000 7f78c2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e83aa70 0x55841e844700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.432+0000 7f78c2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e83aa70 0x55841e844700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:49786/0 (socket says 172.21.15.17:49786) 2024-09-13T16:05:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.432+0000 7f78cc40d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55841e840440 0x55841e84bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.433+0000 7f78cc40d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55841e79daf0 con 0x55841e83b3b0 2024-09-13T16:05:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.433+0000 7f78cc40d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55841e75bf20 con 0x55841e83aa70 2024-09-13T16:05:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.433+0000 7f78cc40d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55841e75bbc0 con 0x55841e840440 2024-09-13T16:05:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.433+0000 7f78c2000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e83b3b0 0x55841e844c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.433+0000 7f78cc40d740 10 client.0 _ll_register_callbacks cb 0x55841e78da70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:05:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.433+0000 7f78c2000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e83b3b0 0x55841e844c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49484/0 (socket says 172.21.15.17:49484) 2024-09-13T16:05:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.433+0000 7f78c2000640 1 -- 172.21.15.17:0/1469999496 learned_addr learned my addr 172.21.15.17:0/1469999496 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:05:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.433+0000 7f78c2000640 1 -- 172.21.15.17:0/1469999496 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55841e840440 msgr2=0x55841e84bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:05:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.433+0000 7f78c2000640 1 --2- 172.21.15.17:0/1469999496 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55841e840440 0x55841e84bc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.433+0000 7f78c2000640 1 -- 172.21.15.17:0/1469999496 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e83aa70 msgr2=0x55841e844700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.433+0000 7f78c2000640 1 --2- 172.21.15.17:0/1469999496 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e83aa70 0x55841e844700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.433+0000 7f78c2000640 1 -- 172.21.15.17:0/1469999496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc009d40 con 0x55841e83b3b0 2024-09-13T16:05:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.434+0000 7f78c2000640 1 --2- 172.21.15.17:0/1469999496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e83b3b0 0x55841e844c40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f78b4007bd0 tx=0x7f78b406e3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a8116cad8039d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.434+0000 7f78acc00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T16:05:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.435+0000 7f78acc00640 1 -- 172.21.15.17:0/1469999496 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b40a67e0 con 0x55841e83b3b0 2024-09-13T16:05:12.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.435+0000 7f78acc00640 1 -- 172.21.15.17:0/1469999496 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f78b40a2190 con 0x55841e83b3b0 2024-09-13T16:05:12.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.435+0000 7f78cc40d740 1 -- 172.21.15.17:0/1469999496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55841e7c7c90 con 0x55841e83b3b0 2024-09-13T16:05:12.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.436+0000 7f78acc00640 1 -- 172.21.15.17:0/1469999496 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78b40a1a90 con 0x55841e83b3b0 2024-09-13T16:05:12.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.436+0000 7f78cc40d740 10 client.15699 fetch_fsmap learned FSMap version 41 2024-09-13T16:05:12.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.436+0000 7f78cc40d740 1 -- 172.21.15.17:0/1469999496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55841e79c170 con 0x55841e83b3b0 2024-09-13T16:05:12.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.437+0000 7f78acc00640 1 -- 172.21.15.17:0/1469999496 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55841e7c7c90 con 0x55841e83b3b0 2024-09-13T16:05:12.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.438+0000 7f78acc00640 1 -- 172.21.15.17:0/1469999496 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 41) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f78b40ba300 con 0x55841e83b3b0 2024-09-13T16:05:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.438+0000 7f78cc40d740 10 client.15699 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T16:05:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.438+0000 7f78cc40d740 10 client.15699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:05:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.438+0000 7f78cc40d740 20 client.15699 populate_metadata read hostname 'smithi017' 2024-09-13T16:05:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.438+0000 7f78cc40d740 1 --2- 172.21.15.17:0/1469999496 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55841e8503e0 0x55841e852800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.438+0000 7f78cc40d740 4 client.15699 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:05:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.438+0000 7f78cc40d740 1 -- 172.21.15.17:0/1469999496 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55841e7907d0 con 0x55841e8503e0 2024-09-13T16:05:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.440+0000 7f78c2a00640 1 --2- 172.21.15.17:0/1469999496 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55841e8503e0 0x55841e852800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:12.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.441+0000 7f78c2a00640 1 --2- 172.21.15.17:0/1469999496 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55841e8503e0 0x55841e852800 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5b17e2bf8e257fe server_cookie=aae425c3a548b17e in_seq=0 out_seq=0 2024-09-13T16:05:12.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.441+0000 7f78acc00640 10 client.15699 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:05:12.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.442+0000 7f78acc00640 1 -- 172.21.15.17:0/1469999496 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55841e7907d0 con 0x55841e8503e0 2024-09-13T16:05:12.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.442+0000 7f78acc00640 10 client.15699 handle_command_reply: tid=0 2024-09-13T16:05:12.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.442+0000 7f78cc40d740 1 client.15699 shutdown 2024-09-13T16:05:12.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.444+0000 7f78cc40d740 1 -- 172.21.15.17:0/1469999496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e83b3b0 msgr2=0x55841e844c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:12.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.444+0000 7f78cc40d740 1 --2- 172.21.15.17:0/1469999496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e83b3b0 0x55841e844c40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f78b4007bd0 tx=0x7f78b406e3d0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.444+0000 7f78cc40d740 1 -- 172.21.15.17:0/1469999496 shutdown_connections 2024-09-13T16:05:12.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.444+0000 7f78cc40d740 1 --2- 172.21.15.17:0/1469999496 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55841e8503e0 0x55841e852800 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.444+0000 7f78cc40d740 1 --2- 172.21.15.17:0/1469999496 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55841e840440 0x55841e84bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.445+0000 7f78acc00640 0 client.15699 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:05:12.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.445+0000 7f78cc40d740 1 --2- 172.21.15.17:0/1469999496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e83b3b0 0x55841e844c40 secure :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f78b4007bd0 tx=0x7f78b406e3d0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.445+0000 7f78cc40d740 1 --2- 172.21.15.17:0/1469999496 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e83aa70 0x55841e844700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.445+0000 7f78cc40d740 1 -- 172.21.15.17:0/1469999496 >> 172.21.15.17:0/1469999496 conn(0x55841e8360e0 msgr2=0x55841e8378f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.445+0000 7f78cc40d740 1 -- 172.21.15.17:0/1469999496 shutdown_connections 2024-09-13T16:05:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.445+0000 7f78cc40d740 1 -- 172.21.15.17:0/1469999496 wait complete. 2024-09-13T16:05:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.446+0000 7f78cc40d740 20 client.15699 trim_cache size 0 max 16384 2024-09-13T16:05:12.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.476+0000 7f78cc40d740 1 Processor -- start 2024-09-13T16:05:12.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.477+0000 7f78cc40d740 1 -- start start 2024-09-13T16:05:12.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.477+0000 7f78cc40d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e83aa70 0x55841e843630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:12.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.477+0000 7f78cc40d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e840440 0x55841e84bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:12.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.477+0000 7f78cc40d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55841e83c9e0 0x55841e843b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:12.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.477+0000 7f78cc40d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55841e504e60 con 0x55841e83aa70 2024-09-13T16:05:12.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.477+0000 7f78cc40d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55841e835a20 con 0x55841e840440 2024-09-13T16:05:12.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.477+0000 7f78cc40d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55841e857a20 con 0x55841e83c9e0 2024-09-13T16:05:12.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.478+0000 7f78c2000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e840440 0x55841e84bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:12.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.478+0000 7f78c2000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e840440 0x55841e84bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:49800/0 (socket says 172.21.15.17:49800) 2024-09-13T16:05:12.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.478+0000 7f78c2000640 1 -- 172.21.15.17:0/575492397 learned_addr learned my addr 172.21.15.17:0/575492397 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:05:12.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.478+0000 7f78c3400640 1 --2- 172.21.15.17:0/575492397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55841e83c9e0 0x55841e843b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:12.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.479+0000 7f78c3400640 1 -- 172.21.15.17:0/575492397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e840440 msgr2=0x55841e84bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:12.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.479+0000 7f78c3400640 1 --2- 172.21.15.17:0/575492397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e840440 0x55841e84bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.479+0000 7f78c3400640 1 -- 172.21.15.17:0/575492397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e83aa70 msgr2=0x55841e843630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:12.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.479+0000 7f78c3400640 1 --2- 172.21.15.17:0/575492397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e83aa70 0x55841e843630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.479+0000 7f78c3400640 1 -- 172.21.15.17:0/575492397 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55841e73e180 con 0x55841e83c9e0 2024-09-13T16:05:12.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.481+0000 7f78c3400640 1 --2- 172.21.15.17:0/575492397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55841e83c9e0 0x55841e843b70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f78b00305e0 tx=0x7f78b003e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=439ea22f38da3a8b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:12.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.482+0000 7f78b8c00640 1 -- 172.21.15.17:0/575492397 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0032a70 con 0x55841e83c9e0 2024-09-13T16:05:12.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.482+0000 7f78b8c00640 1 -- 172.21.15.17:0/575492397 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78b0004500 con 0x55841e83c9e0 2024-09-13T16:05:12.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.482+0000 7f78b8c00640 1 -- 172.21.15.17:0/575492397 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0032a70 con 0x55841e83c9e0 2024-09-13T16:05:12.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.485+0000 7f78cc40d740 1 -- 172.21.15.17:0/575492397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55841e83c9e0 msgr2=0x55841e843b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.485+0000 7f78cc40d740 1 --2- 172.21.15.17:0/575492397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55841e83c9e0 0x55841e843b70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f78b00305e0 tx=0x7f78b003e000 comp rx=0 tx=0).stop 2024-09-13T16:05:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.485+0000 7f78cc40d740 1 -- 172.21.15.17:0/575492397 shutdown_connections 2024-09-13T16:05:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.485+0000 7f78cc40d740 1 --2- 172.21.15.17:0/575492397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55841e83c9e0 0x55841e843b70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.485+0000 7f78cc40d740 1 --2- 172.21.15.17:0/575492397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e840440 0x55841e84bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.485+0000 7f78cc40d740 1 --2- 172.21.15.17:0/575492397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e83aa70 0x55841e843630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.485+0000 7f78cc40d740 1 -- 172.21.15.17:0/575492397 >> 172.21.15.17:0/575492397 conn(0x55841e8360e0 msgr2=0x55841e83c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.486+0000 7f78cc40d740 1 -- 172.21.15.17:0/575492397 shutdown_connections 2024-09-13T16:05:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.486+0000 7f78cc40d740 1 -- 172.21.15.17:0/575492397 wait complete. 2024-09-13T16:05:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.486+0000 7f78cc40d740 1 -- start start 2024-09-13T16:05:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.487+0000 7f78cc40d740 1 Processor -- start 2024-09-13T16:05:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.488+0000 7f78cc40d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e83aa70 0x55841e84bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.488+0000 7f78cc40d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55841e83c9e0 0x55841e8a4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.488+0000 7f78cc40d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e840440 0x55841e8a6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.489+0000 7f78c3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e840440 0x55841e8a6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.489+0000 7f78c3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e840440 0x55841e8a6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49504/0 (socket says 172.21.15.17:49504) 2024-09-13T16:05:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.489+0000 7f78c3400640 1 -- 172.21.15.17:0/500595170 learned_addr learned my addr 172.21.15.17:0/500595170 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:05:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.490+0000 7f78c2000640 1 --2- 172.21.15.17:0/500595170 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55841e83c9e0 0x55841e8a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.490+0000 7f78cc40d740 1 -- 172.21.15.17:0/500595170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55841e8a7570 con 0x55841e840440 2024-09-13T16:05:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.490+0000 7f78c2a00640 1 --2- 172.21.15.17:0/500595170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e83aa70 0x55841e84bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.491+0000 7f78cc40d740 1 -- 172.21.15.17:0/500595170 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55841e8a76e0 con 0x55841e83aa70 2024-09-13T16:05:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.491+0000 7f78cc40d740 1 -- 172.21.15.17:0/500595170 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55841e8a78a0 con 0x55841e83c9e0 2024-09-13T16:05:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.492+0000 7f78c2a00640 1 -- 172.21.15.17:0/500595170 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55841e83c9e0 msgr2=0x55841e8a4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.492+0000 7f78c2a00640 1 --2- 172.21.15.17:0/500595170 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55841e83c9e0 0x55841e8a4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.492+0000 7f78c2a00640 1 -- 172.21.15.17:0/500595170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e840440 msgr2=0x55841e8a6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.493+0000 7f78c2a00640 1 --2- 172.21.15.17:0/500595170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e840440 0x55841e8a6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.493+0000 7f78cc40d740 10 client.0 _ll_register_callbacks cb 0x7f78bc009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:05:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.493+0000 7f78c2a00640 1 -- 172.21.15.17:0/500595170 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c4111290 con 0x55841e83aa70 2024-09-13T16:05:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.493+0000 7f78c3400640 1 --2- 172.21.15.17:0/500595170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e840440 0x55841e8a6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:05:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.493+0000 7f78cc40d740 1 -- 172.21.15.17:0/500595170 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55841e491300 con 0x55841e83aa70 2024-09-13T16:05:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.493+0000 7f78c2a00640 1 --2- 172.21.15.17:0/500595170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e83aa70 0x55841e84bbc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f78bc00e5d0 tx=0x7f78bc003ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c194ed5c2a8607a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.493+0000 7f78acc00640 10 client.25925 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:05:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.494+0000 7f78acc00640 1 -- 172.21.15.17:0/500595170 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc01b040 con 0x55841e83aa70 2024-09-13T16:05:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.495+0000 7f78acc00640 1 -- 172.21.15.17:0/500595170 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f78bc027070 con 0x55841e83aa70 2024-09-13T16:05:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.495+0000 7f78acc00640 1 -- 172.21.15.17:0/500595170 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78bc013040 con 0x55841e83aa70 2024-09-13T16:05:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.495+0000 7f78cc40d740 10 client.25925 fetch_fsmap learned FSMap version 41 2024-09-13T16:05:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.495+0000 7f78cc40d740 1 -- 172.21.15.17:0/500595170 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({fsmap=41}) v3 -- 0x55841e763560 con 0x55841e83aa70 2024-09-13T16:05:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.496+0000 7f78acc00640 1 -- 172.21.15.17:0/500595170 <== mon.2 v2:172.21.15.189:3300/0 4 ==== fsmap(e 41) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f78bc029b70 con 0x55841e83aa70 2024-09-13T16:05:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.496+0000 7f78cc40d740 10 client.25925 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T16:05:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.496+0000 7f78cc40d740 10 client.25925 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:05:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.497+0000 7f78cc40d740 20 client.25925 populate_metadata read hostname 'smithi017' 2024-09-13T16:05:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.497+0000 7f78cc40d740 1 --2- 172.21.15.17:0/500595170 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55841e8a9090 0x55841e8ab480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.497+0000 7f78cc40d740 4 client.25925 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:05:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.497+0000 7f78cc40d740 1 -- 172.21.15.17:0/500595170 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55841e4a2600 con 0x55841e8a9090 2024-09-13T16:05:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.497+0000 7f78c2000640 1 --2- 172.21.15.17:0/500595170 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55841e8a9090 0x55841e8ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.499+0000 7f78c2000640 1 --2- 172.21.15.17:0/500595170 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55841e8a9090 0x55841e8ab480 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25a8afc5b4b58984 server_cookie=f317e0307ca36b02 in_seq=0 out_seq=0 2024-09-13T16:05:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.499+0000 7f78acc00640 10 client.25925 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:05:12.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.539+0000 7f78acc00640 1 -- 172.21.15.17:0/500595170 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55841e4a2600 con 0x55841e8a9090 2024-09-13T16:05:12.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.539+0000 7f78acc00640 10 client.25925 handle_command_reply: tid=0 2024-09-13T16:05:12.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.540+0000 7f78cc40d740 1 client.25925 shutdown 2024-09-13T16:05:12.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.543+0000 7f78cc40d740 1 -- 172.21.15.17:0/500595170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e83aa70 msgr2=0x55841e84bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:12.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.543+0000 7f78cc40d740 1 --2- 172.21.15.17:0/500595170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e83aa70 0x55841e84bbc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f78bc00e5d0 tx=0x7f78bc003ab0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.547+0000 7f78cc40d740 1 -- 172.21.15.17:0/500595170 shutdown_connections 2024-09-13T16:05:12.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.547+0000 7f78cc40d740 1 --2- 172.21.15.17:0/500595170 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55841e8a9090 0x55841e8ab480 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.547+0000 7f78cc40d740 1 --2- 172.21.15.17:0/500595170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55841e840440 0x55841e8a6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.547+0000 7f78cc40d740 1 --2- 172.21.15.17:0/500595170 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55841e83c9e0 0x55841e8a4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.547+0000 7f78cc40d740 1 --2- 172.21.15.17:0/500595170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55841e83aa70 0x55841e84bbc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.547+0000 7f78acc00640 0 client.25925 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:05:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.547+0000 7f78cc40d740 1 -- 172.21.15.17:0/500595170 >> 172.21.15.17:0/500595170 conn(0x55841e8360e0 msgr2=0x55841e843630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:12.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.551+0000 7f78cc40d740 1 -- 172.21.15.17:0/500595170 shutdown_connections 2024-09-13T16:05:12.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.551+0000 7f78cc40d740 1 -- 172.21.15.17:0/500595170 wait complete. 2024-09-13T16:05:12.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:05:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:05:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:05:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:05:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.551+0000 7f78cc40d740 20 client.25925 trim_cache size 0 max 16384 2024-09-13T16:05:12.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.554+0000 7f78c9600640 1 -- 172.21.15.17:0/2333893103 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f78a80a1110 msgr2=0x7f78a80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:12.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.554+0000 7f78c9600640 1 --2- 172.21.15.17:0/2333893103 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f78a80a1110 0x7f78a80a35d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f78b0005b60 tx=0x7f78b0005ab0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.554+0000 7f78c9600640 1 -- 172.21.15.17:0/2333893103 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78c4071870 msgr2=0x7f78c41a0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:12.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.554+0000 7f78c9600640 1 --2- 172.21.15.17:0/2333893103 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78c4071870 0x7f78c41a0c00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f78b400afd0 tx=0x7f78b40076d0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.555+0000 7f78c9600640 1 -- 172.21.15.17:0/2333893103 shutdown_connections 2024-09-13T16:05:12.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.555+0000 7f78c9600640 1 --2- 172.21.15.17:0/2333893103 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f78a80a1110 0x7f78a80a35d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.555+0000 7f78c9600640 1 --2- 172.21.15.17:0/2333893103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78c4107ad0 0x7f78c41a7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.555+0000 7f78c9600640 1 --2- 172.21.15.17:0/2333893103 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78c4071870 0x7f78c41a0c00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.555+0000 7f78c9600640 1 --2- 172.21.15.17:0/2333893103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c4070eb0 0x7f78c41a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:12.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.555+0000 7f78c9600640 1 -- 172.21.15.17:0/2333893103 >> 172.21.15.17:0/2333893103 conn(0x7f78c406cf30 msgr2=0x7f78c410ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:12.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.555+0000 7f78c9600640 1 -- 172.21.15.17:0/2333893103 shutdown_connections 2024-09-13T16:05:12.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:12.555+0000 7f78c9600640 1 -- 172.21.15.17:0/2333893103 wait complete. 2024-09-13T16:05:14.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:13 smithi193 ceph-mon[35248]: pgmap v609: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 MiB/s wr, 730 op/s 2024-09-13T16:05:14.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:13 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:14.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:13 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:05:14.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:13 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:05:14.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:13 smithi017 ceph-mon[30494]: pgmap v609: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 MiB/s wr, 730 op/s 2024-09-13T16:05:14.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:13 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:14.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:13 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:05:14.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:13 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:05:14.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:13 smithi189 ceph-mon[34790]: pgmap v609: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 MiB/s wr, 730 op/s 2024-09-13T16:05:14.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:13 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:05:14.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:13 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:05:14.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:13 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:05:15.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 450.0 s, 666.8 tps, lat 152.861 ms stddev 203.740 2024-09-13T16:05:16.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:15 smithi017 ceph-mon[30494]: pgmap v610: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 771 op/s 2024-09-13T16:05:16.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:15 smithi189 ceph-mon[34790]: pgmap v610: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 771 op/s 2024-09-13T16:05:16.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:15 smithi193 ceph-mon[35248]: pgmap v610: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 771 op/s 2024-09-13T16:05:18.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:17 smithi189 ceph-mon[34790]: pgmap v611: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 708 op/s 2024-09-13T16:05:18.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:17 smithi193 ceph-mon[35248]: pgmap v611: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 708 op/s 2024-09-13T16:05:18.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:17 smithi017 ceph-mon[30494]: pgmap v611: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 708 op/s 2024-09-13T16:05:20.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:19 smithi189 ceph-mon[34790]: pgmap v612: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.3 MiB/s wr, 672 op/s 2024-09-13T16:05:20.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:19 smithi193 ceph-mon[35248]: pgmap v612: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.3 MiB/s wr, 672 op/s 2024-09-13T16:05:20.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:19 smithi017 ceph-mon[30494]: pgmap v612: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.3 MiB/s wr, 672 op/s 2024-09-13T16:05:20.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 455.0 s, 567.2 tps, lat 166.933 ms stddev 188.996 2024-09-13T16:05:22.066 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:21 smithi017 ceph-mon[30494]: pgmap v613: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.0 MiB/s wr, 641 op/s 2024-09-13T16:05:22.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:21 smithi189 ceph-mon[34790]: pgmap v613: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.0 MiB/s wr, 641 op/s 2024-09-13T16:05:22.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:21 smithi193 ceph-mon[35248]: pgmap v613: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.0 MiB/s wr, 641 op/s 2024-09-13T16:05:24.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:23 smithi189 ceph-mon[34790]: pgmap v614: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.8 MiB/s wr, 614 op/s 2024-09-13T16:05:24.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:23 smithi193 ceph-mon[35248]: pgmap v614: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.8 MiB/s wr, 614 op/s 2024-09-13T16:05:24.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:23 smithi017 ceph-mon[30494]: pgmap v614: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.8 MiB/s wr, 614 op/s 2024-09-13T16:05:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 460.0 s, 603.6 tps, lat 172.828 ms stddev 215.261 2024-09-13T16:05:26.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:25 smithi189 ceph-mon[34790]: pgmap v615: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.8 MiB/s wr, 626 op/s 2024-09-13T16:05:26.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:25 smithi193 ceph-mon[35248]: pgmap v615: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.8 MiB/s wr, 626 op/s 2024-09-13T16:05:26.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:25 smithi017 ceph-mon[30494]: pgmap v615: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.8 MiB/s wr, 626 op/s 2024-09-13T16:05:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.548+0000 7f198be00640 1 -- 172.21.15.17:0/4242555260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1984105ab0 msgr2=0x7f1984107ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.548+0000 7f198be00640 1 --2- 172.21.15.17:0/4242555260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1984105ab0 0x7f1984107ea0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f197c009be0 tx=0x7f197c02e840 comp rx=0 tx=0).stop 2024-09-13T16:05:26.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.549+0000 7f198be00640 1 -- 172.21.15.17:0/4242555260 shutdown_connections 2024-09-13T16:05:26.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.549+0000 7f198be00640 1 --2- 172.21.15.17:0/4242555260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1984105ab0 0x7f1984107ea0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.549+0000 7f198be00640 1 --2- 172.21.15.17:0/4242555260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1984103180 0x7f1984105570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.549+0000 7f198be00640 1 --2- 172.21.15.17:0/4242555260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1984100850 0x7f1984102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.549+0000 7f198be00640 1 -- 172.21.15.17:0/4242555260 >> 172.21.15.17:0/4242555260 conn(0x7f19840fa3b0 msgr2=0x7f19840fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:26.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.549+0000 7f198be00640 1 -- 172.21.15.17:0/4242555260 shutdown_connections 2024-09-13T16:05:26.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.549+0000 7f198be00640 1 -- 172.21.15.17:0/4242555260 wait complete. 2024-09-13T16:05:26.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.551+0000 7f198be00640 1 Processor -- start 2024-09-13T16:05:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.551+0000 7f198be00640 1 -- start start 2024-09-13T16:05:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.552+0000 7f198be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1984100850 0x7f1984193b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.552+0000 7f198be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1984103180 0x7f1984194080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.552+0000 7f198be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1984105ab0 0x7f198419b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.552+0000 7f198be00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198419b630 con 0x7f1984103180 2024-09-13T16:05:26.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.552+0000 7f198be00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198419b7a0 con 0x7f1984100850 2024-09-13T16:05:26.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.552+0000 7f198be00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198419b960 con 0x7f1984105ab0 2024-09-13T16:05:26.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.552+0000 7f1989400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1984100850 0x7f1984193b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:26.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.552+0000 7f1989e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1984105ab0 0x7f198419b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:26.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.552+0000 7f1989e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1984105ab0 0x7f198419b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:42976/0 (socket says 172.21.15.17:42976) 2024-09-13T16:05:26.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.552+0000 7f1989e00640 1 -- 172.21.15.17:0/156439479 learned_addr learned my addr 172.21.15.17:0/156439479 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:05:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.553+0000 7f1989400640 1 -- 172.21.15.17:0/156439479 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1984105ab0 msgr2=0x7f198419b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.553+0000 7f1989400640 1 --2- 172.21.15.17:0/156439479 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1984105ab0 0x7f198419b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.553+0000 7f1989400640 1 -- 172.21.15.17:0/156439479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1984103180 msgr2=0x7f1984194080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.553+0000 7f1989400640 1 --2- 172.21.15.17:0/156439479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1984103180 0x7f1984194080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.553+0000 7f1989400640 1 -- 172.21.15.17:0/156439479 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c009840 con 0x7f1984100850 2024-09-13T16:05:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.554+0000 7f1989400640 1 --2- 172.21.15.17:0/156439479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1984100850 0x7f1984193b40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f197800e9f0 tx=0x7f197800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.554+0000 7f1982000640 1 -- 172.21.15.17:0/156439479 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197800ccc0 con 0x7f1984100850 2024-09-13T16:05:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.555+0000 7f1982000640 1 -- 172.21.15.17:0/156439479 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f197800ce20 con 0x7f1984100850 2024-09-13T16:05:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.555+0000 7f1982000640 1 -- 172.21.15.17:0/156439479 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19780187e0 con 0x7f1984100850 2024-09-13T16:05:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.555+0000 7f198be00640 1 -- 172.21.15.17:0/156439479 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198419bc40 con 0x7f1984100850 2024-09-13T16:05:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.556+0000 7f198be00640 1 -- 172.21.15.17:0/156439479 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198419c100 con 0x7f1984100850 2024-09-13T16:05:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.560+0000 7f1982000640 1 -- 172.21.15.17:0/156439479 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1978010430 con 0x7f1984100850 2024-09-13T16:05:26.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.562+0000 7f1982000640 1 --2- 172.21.15.17:0/156439479 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f196c0a1110 0x7f196c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:26.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.562+0000 7f1982000640 1 -- 172.21.15.17:0/156439479 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f1978014070 con 0x7f1984100850 2024-09-13T16:05:26.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.563+0000 7f1988a00640 1 --2- 172.21.15.17:0/156439479 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f196c0a1110 0x7f196c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:26.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.565+0000 7f1988a00640 1 --2- 172.21.15.17:0/156439479 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f196c0a1110 0x7f196c0a35d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f19700058c0 tx=0x7f1970005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.594+0000 7f198ec1f740 1 Processor -- start 2024-09-13T16:05:26.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.595+0000 7f198ec1f740 1 -- start start 2024-09-13T16:05:26.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.595+0000 7f198ec1f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868ee280 0x557e868ee680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:26.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.595+0000 7f198ec1f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868eebc0 0x557e868f3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:26.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.595+0000 7f198ec1f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868f3c50 0x557e868f6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:26.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.595+0000 7f198ec1f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e867f1bb0 con 0x557e868eebc0 2024-09-13T16:05:26.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.595+0000 7f198ec1f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e8684fa70 con 0x557e868ee280 2024-09-13T16:05:26.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.595+0000 7f198ec1f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e8684d200 con 0x557e868f3c50 2024-09-13T16:05:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.595+0000 7f1989400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868ee280 0x557e868ee680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.595+0000 7f1989400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868ee280 0x557e868ee680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:57038/0 (socket says 172.21.15.17:57038) 2024-09-13T16:05:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.596+0000 7f1989400640 1 -- 172.21.15.17:0/4081100224 learned_addr learned my addr 172.21.15.17:0/4081100224 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:05:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.596+0000 7f1989e00640 1 --2- 172.21.15.17:0/4081100224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868f3c50 0x557e868f6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.596+0000 7f1988a00640 1 --2- 172.21.15.17:0/4081100224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868eebc0 0x557e868f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.597+0000 7f1989e00640 1 -- 172.21.15.17:0/4081100224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868ee280 msgr2=0x557e868ee680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.597+0000 7f1989e00640 1 --2- 172.21.15.17:0/4081100224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868ee280 0x557e868ee680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.597+0000 7f1989e00640 1 -- 172.21.15.17:0/4081100224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868eebc0 msgr2=0x557e868f3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.597+0000 7f1989e00640 1 --2- 172.21.15.17:0/4081100224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868eebc0 0x557e868f3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.597+0000 7f1989e00640 1 -- 172.21.15.17:0/4081100224 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e867ea940 con 0x557e868f3c50 2024-09-13T16:05:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.597+0000 7f1988a00640 1 --2- 172.21.15.17:0/4081100224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868eebc0 0x557e868f3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:05:26.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.599+0000 7f1989e00640 1 --2- 172.21.15.17:0/4081100224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868f3c50 0x557e868f6110 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f197c02ed60 tx=0x7f197c005ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a4d167fccccc01a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:26.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.600+0000 7f1976a00640 1 -- 172.21.15.17:0/4081100224 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c00f3c0 con 0x557e868f3c50 2024-09-13T16:05:26.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.600+0000 7f1976a00640 1 -- 172.21.15.17:0/4081100224 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f197c0353d0 con 0x557e868f3c50 2024-09-13T16:05:26.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.600+0000 7f1976a00640 1 -- 172.21.15.17:0/4081100224 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c036470 con 0x557e868f3c50 2024-09-13T16:05:26.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.601+0000 7f198ec1f740 1 -- 172.21.15.17:0/4081100224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868f3c50 msgr2=0x557e868f6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:26.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.601+0000 7f198ec1f740 1 --2- 172.21.15.17:0/4081100224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868f3c50 0x557e868f6110 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f197c02ed60 tx=0x7f197c005ec0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.602+0000 7f198ec1f740 1 -- 172.21.15.17:0/4081100224 shutdown_connections 2024-09-13T16:05:26.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.602+0000 7f198ec1f740 1 --2- 172.21.15.17:0/4081100224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868f3c50 0x557e868f6110 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.602+0000 7f198ec1f740 1 --2- 172.21.15.17:0/4081100224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868eebc0 0x557e868f3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.602+0000 7f198ec1f740 1 --2- 172.21.15.17:0/4081100224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868ee280 0x557e868ee680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.602+0000 7f198ec1f740 1 -- 172.21.15.17:0/4081100224 >> 172.21.15.17:0/4081100224 conn(0x557e868e10e0 msgr2=0x557e868e14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:26.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.602+0000 7f198ec1f740 1 -- 172.21.15.17:0/4081100224 shutdown_connections 2024-09-13T16:05:26.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.602+0000 7f198ec1f740 1 -- 172.21.15.17:0/4081100224 wait complete. 2024-09-13T16:05:26.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.603+0000 7f198ec1f740 1 -- start start 2024-09-13T16:05:26.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.603+0000 7f198ec1f740 1 Processor -- start 2024-09-13T16:05:26.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.604+0000 7f198ec1f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868ee280 0x557e868f7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:26.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.604+0000 7f198ec1f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868eebc0 0x557e868f83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:26.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.604+0000 7f198ec1f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868f3c50 0x557e868ff420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:26.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.605+0000 7f1989400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868ee280 0x557e868f7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:26.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.605+0000 7f1989400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868ee280 0x557e868f7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40700/0 (socket says 172.21.15.17:40700) 2024-09-13T16:05:26.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.605+0000 7f1988a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868eebc0 0x557e868f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:26.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.605+0000 7f1988a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868eebc0 0x557e868f83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:42990/0 (socket says 172.21.15.17:42990) 2024-09-13T16:05:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.606+0000 7f198ec1f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e86848af0 con 0x557e868ee280 2024-09-13T16:05:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.606+0000 7f198ec1f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e86806f20 con 0x557e868f3c50 2024-09-13T16:05:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.606+0000 7f198ec1f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e86806bc0 con 0x557e868eebc0 2024-09-13T16:05:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.606+0000 7f198ec1f740 10 client.0 _ll_register_callbacks cb 0x557e86838a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:05:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.606+0000 7f1989e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868f3c50 0x557e868ff420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.606+0000 7f1989e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868f3c50 0x557e868ff420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:57048/0 (socket says 172.21.15.17:57048) 2024-09-13T16:05:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.606+0000 7f1989e00640 1 -- 172.21.15.17:0/3004171374 learned_addr learned my addr 172.21.15.17:0/3004171374 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:05:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.607+0000 7f1988a00640 1 -- 172.21.15.17:0/3004171374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868f3c50 msgr2=0x557e868ff420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.607+0000 7f1988a00640 1 --2- 172.21.15.17:0/3004171374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868f3c50 0x557e868ff420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.607+0000 7f1988a00640 1 -- 172.21.15.17:0/3004171374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868ee280 msgr2=0x557e868f7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.607+0000 7f1988a00640 1 --2- 172.21.15.17:0/3004171374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868ee280 0x557e868f7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.607+0000 7f1988a00640 1 -- 172.21.15.17:0/3004171374 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1984108a60 con 0x557e868eebc0 2024-09-13T16:05:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.607+0000 7f1989400640 1 --2- 172.21.15.17:0/3004171374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868ee280 0x557e868f7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:05:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.608+0000 7f1989e00640 1 --2- 172.21.15.17:0/3004171374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868f3c50 0x557e868ff420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:05:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.608+0000 7f196b400640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:05:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.608+0000 7f1988a00640 1 --2- 172.21.15.17:0/3004171374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868eebc0 0x557e868f83e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1984195050 tx=0x7f19700046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd736bc0f3844c05 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.608+0000 7f196b400640 1 -- 172.21.15.17:0/3004171374 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1970005220 con 0x557e868eebc0 2024-09-13T16:05:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.608+0000 7f198ec1f740 1 -- 172.21.15.17:0/3004171374 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557e86872c90 con 0x557e868eebc0 2024-09-13T16:05:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.608+0000 7f196b400640 1 -- 172.21.15.17:0/3004171374 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f1970005380 con 0x557e868eebc0 2024-09-13T16:05:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.609+0000 7f196b400640 1 -- 172.21.15.17:0/3004171374 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1970005220 con 0x557e868eebc0 2024-09-13T16:05:26.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.609+0000 7f198ec1f740 10 client.25963 fetch_fsmap learned FSMap version 41 2024-09-13T16:05:26.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.609+0000 7f198ec1f740 1 -- 172.21.15.17:0/3004171374 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x557e86847170 con 0x557e868eebc0 2024-09-13T16:05:26.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.609+0000 7f196b400640 1 -- 172.21.15.17:0/3004171374 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557e86872c90 con 0x557e868eebc0 2024-09-13T16:05:26.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.610+0000 7f196b400640 1 -- 172.21.15.17:0/3004171374 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 41) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f1970018040 con 0x557e868eebc0 2024-09-13T16:05:26.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.611+0000 7f198ec1f740 10 client.25963 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T16:05:26.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.611+0000 7f198ec1f740 10 client.25963 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:05:26.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.611+0000 7f198ec1f740 20 client.25963 populate_metadata read hostname 'smithi017' 2024-09-13T16:05:26.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.611+0000 7f198ec1f740 1 --2- 172.21.15.17:0/3004171374 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557e86903a60 0x557e86905e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:26.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.611+0000 7f198ec1f740 4 client.25963 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:05:26.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.611+0000 7f198ec1f740 1 -- 172.21.15.17:0/3004171374 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557e8683b7d0 con 0x557e86903a60 2024-09-13T16:05:26.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.612+0000 7f1989400640 1 --2- 172.21.15.17:0/3004171374 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557e86903a60 0x557e86905e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:26.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.613+0000 7f196b400640 10 client.25963 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:05:26.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.613+0000 7f1989400640 1 --2- 172.21.15.17:0/3004171374 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557e86903a60 0x557e86905e80 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9f1fd7894aaba41 server_cookie=d82a1250038ba958 in_seq=0 out_seq=0 2024-09-13T16:05:26.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.613+0000 7f196b400640 1 -- 172.21.15.17:0/3004171374 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557e8683b7d0 con 0x557e86903a60 2024-09-13T16:05:26.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.614+0000 7f196b400640 10 client.25963 handle_command_reply: tid=0 2024-09-13T16:05:26.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.614+0000 7f198ec1f740 1 client.25963 shutdown 2024-09-13T16:05:26.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.614+0000 7f198ec1f740 1 -- 172.21.15.17:0/3004171374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868eebc0 msgr2=0x557e868f83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:26.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.614+0000 7f198ec1f740 1 --2- 172.21.15.17:0/3004171374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868eebc0 0x557e868f83e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1984195050 tx=0x7f19700046c0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.614+0000 7f198ec1f740 1 -- 172.21.15.17:0/3004171374 shutdown_connections 2024-09-13T16:05:26.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.614+0000 7f198ec1f740 1 --2- 172.21.15.17:0/3004171374 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557e86903a60 0x557e86905e80 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.614+0000 7f198ec1f740 1 --2- 172.21.15.17:0/3004171374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868f3c50 0x557e868ff420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.614+0000 7f198ec1f740 1 --2- 172.21.15.17:0/3004171374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868eebc0 0x557e868f83e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.614+0000 7f198ec1f740 1 --2- 172.21.15.17:0/3004171374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868ee280 0x557e868f7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.614+0000 7f198ec1f740 1 -- 172.21.15.17:0/3004171374 >> 172.21.15.17:0/3004171374 conn(0x557e868e10e0 msgr2=0x557e868e28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:26.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.614+0000 7f196b400640 0 client.25963 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:05:26.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.615+0000 7f198ec1f740 1 -- 172.21.15.17:0/3004171374 shutdown_connections 2024-09-13T16:05:26.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.615+0000 7f198ec1f740 1 -- 172.21.15.17:0/3004171374 wait complete. 2024-09-13T16:05:26.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.615+0000 7f198ec1f740 20 client.25963 trim_cache size 0 max 16384 2024-09-13T16:05:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.653+0000 7f198ec1f740 1 Processor -- start 2024-09-13T16:05:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.653+0000 7f198ec1f740 1 -- start start 2024-09-13T16:05:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.653+0000 7f198ec1f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868ee280 0x557e868f7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.653+0000 7f198ec1f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868f3c50 0x557e868ff3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.653+0000 7f198ec1f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868f83e0 0x557e868efb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.653+0000 7f198ec1f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e865afe60 con 0x557e868f3c50 2024-09-13T16:05:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.653+0000 7f198ec1f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e86902060 con 0x557e868f83e0 2024-09-13T16:05:26.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.653+0000 7f198ec1f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e869035d0 con 0x557e868ee280 2024-09-13T16:05:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.654+0000 7f1989400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868ee280 0x557e868f7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.654+0000 7f1989400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868ee280 0x557e868f7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:42994/0 (socket says 172.21.15.17:42994) 2024-09-13T16:05:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.654+0000 7f1989400640 1 -- 172.21.15.17:0/1532336313 learned_addr learned my addr 172.21.15.17:0/1532336313 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:05:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.654+0000 7f1989e00640 1 --2- 172.21.15.17:0/1532336313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868f83e0 0x557e868efb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.654+0000 7f1989400640 1 -- 172.21.15.17:0/1532336313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868f83e0 msgr2=0x557e868efb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.654+0000 7f1989400640 1 --2- 172.21.15.17:0/1532336313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868f83e0 0x557e868efb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.654+0000 7f1989400640 1 -- 172.21.15.17:0/1532336313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868f3c50 msgr2=0x557e868ff3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.654+0000 7f1988a00640 1 --2- 172.21.15.17:0/1532336313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868f3c50 0x557e868ff3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.654+0000 7f1989400640 1 --2- 172.21.15.17:0/1532336313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868f3c50 0x557e868ff3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.655+0000 7f1989400640 1 -- 172.21.15.17:0/1532336313 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e867e9180 con 0x557e868ee280 2024-09-13T16:05:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.655+0000 7f1988a00640 1 --2- 172.21.15.17:0/1532336313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868f3c50 0x557e868ff3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:05:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.656+0000 7f1989400640 1 --2- 172.21.15.17:0/1532336313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868ee280 0x557e868f7ea0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f19780ca8c0 tx=0x7f197801a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e8bf2dd51bdea4a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.656+0000 7f1977400640 1 -- 172.21.15.17:0/1532336313 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19780b0070 con 0x557e868ee280 2024-09-13T16:05:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.656+0000 7f1977400640 1 -- 172.21.15.17:0/1532336313 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1978082070 con 0x557e868ee280 2024-09-13T16:05:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.656+0000 7f1977400640 1 -- 172.21.15.17:0/1532336313 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978098560 con 0x557e868ee280 2024-09-13T16:05:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.657+0000 7f198ec1f740 1 -- 172.21.15.17:0/1532336313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868ee280 msgr2=0x557e868f7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.657+0000 7f198ec1f740 1 --2- 172.21.15.17:0/1532336313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868ee280 0x557e868f7ea0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f19780ca8c0 tx=0x7f197801a040 comp rx=0 tx=0).stop 2024-09-13T16:05:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.658+0000 7f198ec1f740 1 -- 172.21.15.17:0/1532336313 shutdown_connections 2024-09-13T16:05:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.658+0000 7f198ec1f740 1 --2- 172.21.15.17:0/1532336313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868f83e0 0x557e868efb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.658+0000 7f198ec1f740 1 --2- 172.21.15.17:0/1532336313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868f3c50 0x557e868ff3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.658+0000 7f198ec1f740 1 --2- 172.21.15.17:0/1532336313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868ee280 0x557e868f7ea0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.658+0000 7f198ec1f740 1 -- 172.21.15.17:0/1532336313 >> 172.21.15.17:0/1532336313 conn(0x557e868e10e0 msgr2=0x557e868f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.658+0000 7f198ec1f740 1 -- 172.21.15.17:0/1532336313 shutdown_connections 2024-09-13T16:05:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.658+0000 7f198ec1f740 1 -- 172.21.15.17:0/1532336313 wait complete. 2024-09-13T16:05:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.658+0000 7f198ec1f740 1 -- start start 2024-09-13T16:05:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.659+0000 7f198ec1f740 1 Processor -- start 2024-09-13T16:05:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.659+0000 7f198ec1f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868f3c50 0x557e868fc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.659+0000 7f198ec1f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868f83e0 0x557e868fce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.659+0000 7f198ec1f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868fdd10 0x557e868fe190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.659+0000 7f198ec1f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e868fe6d0 con 0x557e868fdd10 2024-09-13T16:05:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.660+0000 7f198ec1f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e868fe840 con 0x557e868f83e0 2024-09-13T16:05:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.660+0000 7f198ec1f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e868fea00 con 0x557e868f3c50 2024-09-13T16:05:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.660+0000 7f198ec1f740 10 client.0 _ll_register_callbacks cb 0x7f1978005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:05:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.660+0000 7f1988a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868f83e0 0x557e868fce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.660+0000 7f1988a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868f83e0 0x557e868fce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:57070/0 (socket says 172.21.15.17:57070) 2024-09-13T16:05:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.660+0000 7f1988a00640 1 -- 172.21.15.17:0/2113775972 learned_addr learned my addr 172.21.15.17:0/2113775972 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:05:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.660+0000 7f1989400640 1 --2- 172.21.15.17:0/2113775972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868f3c50 0x557e868fc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.660+0000 7f1988a00640 1 -- 172.21.15.17:0/2113775972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868f3c50 msgr2=0x557e868fc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.660+0000 7f1988a00640 1 --2- 172.21.15.17:0/2113775972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868f3c50 0x557e868fc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.660+0000 7f1988a00640 1 -- 172.21.15.17:0/2113775972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868fdd10 msgr2=0x557e868fe190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:05:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.660+0000 7f1988a00640 1 --2- 172.21.15.17:0/2113775972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868fdd10 0x557e868fe190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.660+0000 7f1988a00640 1 -- 172.21.15.17:0/2113775972 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198419c100 con 0x557e868f83e0 2024-09-13T16:05:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.661+0000 7f1988a00640 1 --2- 172.21.15.17:0/2113775972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868f83e0 0x557e868fce90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f197001c6f0 tx=0x7f1970005220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dee6115fa9689ae1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.661+0000 7f196b400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:05:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.661+0000 7f196b400640 1 -- 172.21.15.17:0/2113775972 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197001c4e0 con 0x557e868f83e0 2024-09-13T16:05:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.661+0000 7f196b400640 1 -- 172.21.15.17:0/2113775972 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f1970005380 con 0x557e868f83e0 2024-09-13T16:05:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.661+0000 7f198ec1f740 1 -- 172.21.15.17:0/2113775972 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f197c0353d0 con 0x557e868f83e0 2024-09-13T16:05:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.661+0000 7f196b400640 1 -- 172.21.15.17:0/2113775972 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f197001ce30 con 0x557e868f83e0 2024-09-13T16:05:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.661+0000 7f198ec1f740 10 client.25943 fetch_fsmap learned FSMap version 41 2024-09-13T16:05:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.661+0000 7f198ec1f740 1 -- 172.21.15.17:0/2113775972 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x557e8680e560 con 0x557e868f83e0 2024-09-13T16:05:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.662+0000 7f196b400640 1 -- 172.21.15.17:0/2113775972 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f197c0353d0 con 0x557e868f83e0 2024-09-13T16:05:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.663+0000 7f196b400640 1 -- 172.21.15.17:0/2113775972 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 41) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f1970036070 con 0x557e868f83e0 2024-09-13T16:05:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.663+0000 7f198ec1f740 10 client.25943 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T16:05:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.663+0000 7f198ec1f740 10 client.25943 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:05:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.663+0000 7f198ec1f740 20 client.25943 populate_metadata read hostname 'smithi017' 2024-09-13T16:05:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.663+0000 7f198ec1f740 1 --2- 172.21.15.17:0/2113775972 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557e8695c8f0 0x557e8695ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.663+0000 7f198ec1f740 4 client.25943 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:05:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.663+0000 7f198ec1f740 1 -- 172.21.15.17:0/2113775972 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557e8653c300 con 0x557e8695c8f0 2024-09-13T16:05:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.663+0000 7f1989400640 1 --2- 172.21.15.17:0/2113775972 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557e8695c8f0 0x557e8695ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.664+0000 7f1989400640 1 --2- 172.21.15.17:0/2113775972 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557e8695c8f0 0x557e8695ed10 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=465c8f73342a9f03 server_cookie=1e1363da1db40d2a in_seq=0 out_seq=0 2024-09-13T16:05:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.664+0000 7f196b400640 10 client.25943 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:05:26.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.687+0000 7f196b400640 1 -- 172.21.15.17:0/2113775972 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557e8653c300 con 0x557e8695c8f0 2024-09-13T16:05:26.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.687+0000 7f196b400640 10 client.25943 handle_command_reply: tid=0 2024-09-13T16:05:26.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.687+0000 7f198ec1f740 1 client.25943 shutdown 2024-09-13T16:05:26.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.687+0000 7f198ec1f740 1 -- 172.21.15.17:0/2113775972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868f83e0 msgr2=0x557e868fce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:26.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.687+0000 7f198ec1f740 1 --2- 172.21.15.17:0/2113775972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868f83e0 0x557e868fce90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f197001c6f0 tx=0x7f1970005220 comp rx=0 tx=0).stop 2024-09-13T16:05:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.688+0000 7f198ec1f740 1 -- 172.21.15.17:0/2113775972 shutdown_connections 2024-09-13T16:05:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.688+0000 7f198ec1f740 1 --2- 172.21.15.17:0/2113775972 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557e8695c8f0 0x557e8695ed10 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.688+0000 7f198ec1f740 1 --2- 172.21.15.17:0/2113775972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e868fdd10 0x557e868fe190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.688+0000 7f198ec1f740 1 --2- 172.21.15.17:0/2113775972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e868f83e0 0x557e868fce90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.688+0000 7f198ec1f740 1 --2- 172.21.15.17:0/2113775972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557e868f3c50 0x557e868fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.688+0000 7f198ec1f740 1 -- 172.21.15.17:0/2113775972 >> 172.21.15.17:0/2113775972 conn(0x557e868e10e0 msgr2=0x557e868efb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.688+0000 7f196b400640 0 client.25943 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:05:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.688+0000 7f198ec1f740 1 -- 172.21.15.17:0/2113775972 shutdown_connections 2024-09-13T16:05:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.688+0000 7f198ec1f740 1 -- 172.21.15.17:0/2113775972 wait complete. 2024-09-13T16:05:26.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.688+0000 7f198ec1f740 20 client.25943 trim_cache size 0 max 16384 2024-09-13T16:05:26.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:05:26.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:05:26.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:05:26.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:05:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.689+0000 7f198be00640 1 -- 172.21.15.17:0/156439479 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f196c0a1110 msgr2=0x7f196c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.689+0000 7f198be00640 1 --2- 172.21.15.17:0/156439479 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f196c0a1110 0x7f196c0a35d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f19700058c0 tx=0x7f1970005850 comp rx=0 tx=0).stop 2024-09-13T16:05:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.689+0000 7f198be00640 1 -- 172.21.15.17:0/156439479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1984100850 msgr2=0x7f1984193b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.689+0000 7f198be00640 1 --2- 172.21.15.17:0/156439479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1984100850 0x7f1984193b40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f197800e9f0 tx=0x7f197800eeb0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.689+0000 7f198be00640 1 -- 172.21.15.17:0/156439479 shutdown_connections 2024-09-13T16:05:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.690+0000 7f198be00640 1 --2- 172.21.15.17:0/156439479 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f196c0a1110 0x7f196c0a35d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.690+0000 7f198be00640 1 --2- 172.21.15.17:0/156439479 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1984105ab0 0x7f198419b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.690+0000 7f198be00640 1 --2- 172.21.15.17:0/156439479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1984103180 0x7f1984194080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.690+0000 7f198be00640 1 --2- 172.21.15.17:0/156439479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1984100850 0x7f1984193b40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.690+0000 7f198be00640 1 -- 172.21.15.17:0/156439479 >> 172.21.15.17:0/156439479 conn(0x7f19840fa3b0 msgr2=0x7f1984101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.690+0000 7f198be00640 1 -- 172.21.15.17:0/156439479 shutdown_connections 2024-09-13T16:05:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:26.690+0000 7f198be00640 1 -- 172.21.15.17:0/156439479 wait complete. 2024-09-13T16:05:28.056 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:27 smithi193 ceph-mon[35248]: pgmap v616: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.7 MiB/s wr, 609 op/s 2024-09-13T16:05:28.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:27 smithi189 ceph-mon[34790]: pgmap v616: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.7 MiB/s wr, 609 op/s 2024-09-13T16:05:28.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:27 smithi017 ceph-mon[30494]: pgmap v616: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.7 MiB/s wr, 609 op/s 2024-09-13T16:05:30.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:29 smithi189 ceph-mon[34790]: pgmap v617: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.0 MiB/s wr, 566 op/s 2024-09-13T16:05:30.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:29 smithi193 ceph-mon[35248]: pgmap v617: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.0 MiB/s wr, 566 op/s 2024-09-13T16:05:30.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:29 smithi017 ceph-mon[30494]: pgmap v617: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.0 MiB/s wr, 566 op/s 2024-09-13T16:05:30.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 465.0 s, 800.2 tps, lat 126.748 ms stddev 146.997 2024-09-13T16:05:32.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:31 smithi189 ceph-mon[34790]: pgmap v618: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.4 MiB/s wr, 574 op/s 2024-09-13T16:05:32.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:31 smithi193 ceph-mon[35248]: pgmap v618: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.4 MiB/s wr, 574 op/s 2024-09-13T16:05:32.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:31 smithi017 ceph-mon[30494]: pgmap v618: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.4 MiB/s wr, 574 op/s 2024-09-13T16:05:34.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:33 smithi189 ceph-mon[34790]: pgmap v619: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.9 MiB/s wr, 539 op/s 2024-09-13T16:05:34.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:33 smithi193 ceph-mon[35248]: pgmap v619: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.9 MiB/s wr, 539 op/s 2024-09-13T16:05:34.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:33 smithi017 ceph-mon[30494]: pgmap v619: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.9 MiB/s wr, 539 op/s 2024-09-13T16:05:35.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 470.0 s, 796.4 tps, lat 123.487 ms stddev 153.541 2024-09-13T16:05:36.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:35 smithi189 ceph-mon[34790]: pgmap v620: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.8 MiB/s wr, 589 op/s 2024-09-13T16:05:36.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:35 smithi193 ceph-mon[35248]: pgmap v620: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.8 MiB/s wr, 589 op/s 2024-09-13T16:05:36.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:35 smithi017 ceph-mon[30494]: pgmap v620: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.8 MiB/s wr, 589 op/s 2024-09-13T16:05:38.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:37 smithi189 ceph-mon[34790]: pgmap v621: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.6 MiB/s wr, 581 op/s 2024-09-13T16:05:38.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:37 smithi193 ceph-mon[35248]: pgmap v621: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.6 MiB/s wr, 581 op/s 2024-09-13T16:05:38.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:37 smithi017 ceph-mon[30494]: pgmap v621: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.6 MiB/s wr, 581 op/s 2024-09-13T16:05:39.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.906+0000 7fc02b600640 1 -- 172.21.15.17:0/284895221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc024107530 msgr2=0x7fc024107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:39.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.906+0000 7fc02b600640 1 --2- 172.21.15.17:0/284895221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc024107530 0x7fc024107990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc010009900 tx=0x7fc01002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:05:39.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.907+0000 7fc02b600640 1 -- 172.21.15.17:0/284895221 shutdown_connections 2024-09-13T16:05:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.907+0000 7fc02b600640 1 --2- 172.21.15.17:0/284895221 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc024107ed0 0x7fc02410e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.907+0000 7fc02b600640 1 --2- 172.21.15.17:0/284895221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc024107530 0x7fc024107990 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.907+0000 7fc02b600640 1 --2- 172.21.15.17:0/284895221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc024106680 0x7fc024106a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.907+0000 7fc02b600640 1 -- 172.21.15.17:0/284895221 >> 172.21.15.17:0/284895221 conn(0x7fc024075730 msgr2=0x7fc024077b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.908+0000 7fc02b600640 1 -- 172.21.15.17:0/284895221 shutdown_connections 2024-09-13T16:05:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.908+0000 7fc02b600640 1 -- 172.21.15.17:0/284895221 wait complete. 2024-09-13T16:05:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.909+0000 7fc02b600640 1 Processor -- start 2024-09-13T16:05:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.909+0000 7fc02b600640 1 -- start start 2024-09-13T16:05:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.910+0000 7fc02b600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc024106680 0x7fc02419c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.910+0000 7fc02b600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc024107530 0x7fc02419c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.910+0000 7fc02b600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc024107ed0 0x7fc0241a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.910+0000 7fc023e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc024107530 0x7fc02419c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.910+0000 7fc023e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc024107530 0x7fc02419c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:56964/0 (socket says 172.21.15.17:56964) 2024-09-13T16:05:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.911+0000 7fc023e00640 1 -- 172.21.15.17:0/929132449 learned_addr learned my addr 172.21.15.17:0/929132449 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:05:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.911+0000 7fc02b600640 1 -- 172.21.15.17:0/929132449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0241a3e80 con 0x7fc024106680 2024-09-13T16:05:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.911+0000 7fc02b600640 1 -- 172.21.15.17:0/929132449 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0241a3ff0 con 0x7fc024107ed0 2024-09-13T16:05:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.911+0000 7fc02b600640 1 -- 172.21.15.17:0/929132449 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0241a41b0 con 0x7fc024107530 2024-09-13T16:05:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.911+0000 7fc029600640 1 --2- 172.21.15.17:0/929132449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc024107ed0 0x7fc0241a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.912+0000 7fc028c00640 1 --2- 172.21.15.17:0/929132449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc024106680 0x7fc02419c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.912+0000 7fc023e00640 1 -- 172.21.15.17:0/929132449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc024107ed0 msgr2=0x7fc0241a3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.912+0000 7fc023e00640 1 --2- 172.21.15.17:0/929132449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc024107ed0 0x7fc0241a3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.912+0000 7fc023e00640 1 -- 172.21.15.17:0/929132449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc024106680 msgr2=0x7fc02419c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:39.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.912+0000 7fc023e00640 1 --2- 172.21.15.17:0/929132449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc024106680 0x7fc02419c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:39.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.912+0000 7fc023e00640 1 -- 172.21.15.17:0/929132449 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc010009560 con 0x7fc024107530 2024-09-13T16:05:39.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.912+0000 7fc028c00640 1 --2- 172.21.15.17:0/929132449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc024106680 0x7fc02419c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:05:39.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.914+0000 7fc023e00640 1 --2- 172.21.15.17:0/929132449 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc024107530 0x7fc02419c920 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc010003b70 tx=0x7fc010003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:39.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.914+0000 7fc021600640 1 -- 172.21.15.17:0/929132449 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc010003e80 con 0x7fc024107530 2024-09-13T16:05:39.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.914+0000 7fc021600640 1 -- 172.21.15.17:0/929132449 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc010031c70 con 0x7fc024107530 2024-09-13T16:05:39.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.914+0000 7fc021600640 1 -- 172.21.15.17:0/929132449 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01003bd60 con 0x7fc024107530 2024-09-13T16:05:39.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.915+0000 7fc02b600640 1 -- 172.21.15.17:0/929132449 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0241a4430 con 0x7fc024107530 2024-09-13T16:05:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.915+0000 7fc02b600640 1 -- 172.21.15.17:0/929132449 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0241a4890 con 0x7fc024107530 2024-09-13T16:05:39.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.925+0000 7fc021600640 1 -- 172.21.15.17:0/929132449 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc01003b460 con 0x7fc024107530 2024-09-13T16:05:39.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.926+0000 7fc02e420740 1 Processor -- start 2024-09-13T16:05:39.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.930+0000 7fc021600640 1 --2- 172.21.15.17:0/929132449 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc00c0a1160 0x7fc00c0a3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:39.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.930+0000 7fc02e420740 1 -- start start 2024-09-13T16:05:39.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.930+0000 7fc02e420740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f8aa70 0x557179f8ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.930+0000 7fc02e420740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557179f8b3b0 0x557179f8fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.931+0000 7fc02e420740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f90440 0x557179f92900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.931+0000 7fc02e420740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557179e96bb0 con 0x557179f8b3b0 2024-09-13T16:05:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.931+0000 7fc02e420740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x557179ef4a70 con 0x557179f90440 2024-09-13T16:05:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.931+0000 7fc02e420740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x557179ef2200 con 0x557179f8aa70 2024-09-13T16:05:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.931+0000 7fc029600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f90440 0x557179f92900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.931+0000 7fc029600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f90440 0x557179f92900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:48406/0 (socket says 172.21.15.17:48406) 2024-09-13T16:05:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.931+0000 7fc029600640 1 -- 172.21.15.17:0/2892221962 learned_addr learned my addr 172.21.15.17:0/2892221962 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:05:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.931+0000 7fc028c00640 1 --2- 172.21.15.17:0/2892221962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f8aa70 0x557179f8ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.932+0000 7fc021600640 1 -- 172.21.15.17:0/929132449 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fc0100ecd40 con 0x7fc024107530 2024-09-13T16:05:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.932+0000 7fc023e00640 1 --2- 172.21.15.17:0/2892221962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557179f8b3b0 0x557179f8fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.932+0000 7fc028c00640 1 -- 172.21.15.17:0/2892221962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f90440 msgr2=0x557179f92900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.932+0000 7fc028c00640 1 --2- 172.21.15.17:0/2892221962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f90440 0x557179f92900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.932+0000 7fc028c00640 1 -- 172.21.15.17:0/2892221962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557179f8b3b0 msgr2=0x557179f8fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.932+0000 7fc028c00640 1 --2- 172.21.15.17:0/2892221962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557179f8b3b0 0x557179f8fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.932+0000 7fc028c00640 1 -- 172.21.15.17:0/2892221962 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557179e8f940 con 0x557179f8aa70 2024-09-13T16:05:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.933+0000 7fc028c00640 1 --2- 172.21.15.17:0/2892221962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f8aa70 0x557179f8ae70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc01800bab0 tx=0x7fc01800bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a210c0386b36eb9d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.933+0000 7fc016000640 1 -- 172.21.15.17:0/2892221962 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc018017420 con 0x557179f8aa70 2024-09-13T16:05:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.933+0000 7fc016000640 1 -- 172.21.15.17:0/2892221962 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc018017a40 con 0x557179f8aa70 2024-09-13T16:05:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.933+0000 7fc016000640 1 -- 172.21.15.17:0/2892221962 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01800fa20 con 0x557179f8aa70 2024-09-13T16:05:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.933+0000 7fc029600640 1 --2- 172.21.15.17:0/929132449 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc00c0a1160 0x7fc00c0a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:39.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.936+0000 7fc02e420740 1 -- 172.21.15.17:0/2892221962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f8aa70 msgr2=0x557179f8ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:39.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.936+0000 7fc02e420740 1 --2- 172.21.15.17:0/2892221962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f8aa70 0x557179f8ae70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc01800bab0 tx=0x7fc01800bf70 comp rx=0 tx=0).stop 2024-09-13T16:05:39.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.936+0000 7fc02e420740 1 -- 172.21.15.17:0/2892221962 shutdown_connections 2024-09-13T16:05:39.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.936+0000 7fc02e420740 1 --2- 172.21.15.17:0/2892221962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f90440 0x557179f92900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:39.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.936+0000 7fc02e420740 1 --2- 172.21.15.17:0/2892221962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557179f8b3b0 0x557179f8fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:39.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.936+0000 7fc02e420740 1 --2- 172.21.15.17:0/2892221962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f8aa70 0x557179f8ae70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:39.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.936+0000 7fc02e420740 1 -- 172.21.15.17:0/2892221962 >> 172.21.15.17:0/2892221962 conn(0x557179f860e0 msgr2=0x557179f864e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:39.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.937+0000 7fc029600640 1 --2- 172.21.15.17:0/929132449 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc00c0a1160 0x7fc00c0a3620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009270 tx=0x7fc01c014040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:39.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.937+0000 7fc02e420740 1 -- 172.21.15.17:0/2892221962 shutdown_connections 2024-09-13T16:05:39.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.939+0000 7fc02e420740 1 -- 172.21.15.17:0/2892221962 wait complete. 2024-09-13T16:05:39.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.939+0000 7fc02e420740 1 -- start start 2024-09-13T16:05:39.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.939+0000 7fc02e420740 1 Processor -- start 2024-09-13T16:05:39.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.941+0000 7fc02e420740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557179f8aa70 0x557179f946a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:39.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.941+0000 7fc02e420740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f8b3b0 0x557179f94be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:39.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.941+0000 7fc02e420740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f90440 0x557179f9bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:39.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.941+0000 7fc02e420740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557179eedaf0 con 0x557179f8aa70 2024-09-13T16:05:39.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.941+0000 7fc02e420740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x557179eabf20 con 0x557179f8b3b0 2024-09-13T16:05:39.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.941+0000 7fc02e420740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x557179eabbc0 con 0x557179f90440 2024-09-13T16:05:39.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.941+0000 7fc02e420740 10 client.0 _ll_register_callbacks cb 0x557179edda70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:05:39.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.942+0000 7fc023e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f8b3b0 0x557179f94be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:39.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.942+0000 7fc029600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f90440 0x557179f9bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:39.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.942+0000 7fc023e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f8b3b0 0x557179f94be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:48422/0 (socket says 172.21.15.17:48422) 2024-09-13T16:05:39.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.942+0000 7fc023e00640 1 -- 172.21.15.17:0/3461763809 learned_addr learned my addr 172.21.15.17:0/3461763809 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:05:39.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.943+0000 7fc029600640 1 -- 172.21.15.17:0/3461763809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f8b3b0 msgr2=0x557179f94be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:39.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.943+0000 7fc029600640 1 --2- 172.21.15.17:0/3461763809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f8b3b0 0x557179f94be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:39.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.943+0000 7fc029600640 1 -- 172.21.15.17:0/3461763809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557179f8aa70 msgr2=0x557179f946a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:39.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.943+0000 7fc029600640 1 --2- 172.21.15.17:0/3461763809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557179f8aa70 0x557179f946a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:39.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.943+0000 7fc029600640 1 -- 172.21.15.17:0/3461763809 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01800b710 con 0x557179f90440 2024-09-13T16:05:39.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.943+0000 7fc023e00640 1 --2- 172.21.15.17:0/3461763809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f8b3b0 0x557179f94be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:05:39.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.944+0000 7fc029600640 1 --2- 172.21.15.17:0/3461763809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f90440 0x557179f9bc20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc01c01f630 tx=0x7fc01c004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2e5b297a0cbda93 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:39.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.944+0000 7fc00aa00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:05:39.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.946+0000 7fc00aa00640 1 -- 172.21.15.17:0/3461763809 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c01d480 con 0x557179f90440 2024-09-13T16:05:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.946+0000 7fc00aa00640 1 -- 172.21.15.17:0/3461763809 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fc01c01d5e0 con 0x557179f90440 2024-09-13T16:05:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.946+0000 7fc02e420740 1 -- 172.21.15.17:0/3461763809 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557179f17c90 con 0x557179f90440 2024-09-13T16:05:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.947+0000 7fc00aa00640 1 -- 172.21.15.17:0/3461763809 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc01c01d7e0 con 0x557179f90440 2024-09-13T16:05:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.947+0000 7fc02e420740 10 client.25981 fetch_fsmap learned FSMap version 41 2024-09-13T16:05:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.947+0000 7fc02e420740 1 -- 172.21.15.17:0/3461763809 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x557179eec170 con 0x557179f90440 2024-09-13T16:05:39.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.948+0000 7fc00aa00640 1 -- 172.21.15.17:0/3461763809 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557179f17c90 con 0x557179f90440 2024-09-13T16:05:39.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.950+0000 7fc00aa00640 1 -- 172.21.15.17:0/3461763809 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 41) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fc01c02f070 con 0x557179f90440 2024-09-13T16:05:39.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.950+0000 7fc02e420740 10 client.25981 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T16:05:39.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.950+0000 7fc02e420740 10 client.25981 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:05:39.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.950+0000 7fc02e420740 20 client.25981 populate_metadata read hostname 'smithi017' 2024-09-13T16:05:39.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.950+0000 7fc02e420740 1 --2- 172.21.15.17:0/3461763809 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557179fa0370 0x557179fa27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:39.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.950+0000 7fc02e420740 4 client.25981 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:05:39.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.950+0000 7fc02e420740 1 -- 172.21.15.17:0/3461763809 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557179ee07d0 con 0x557179fa0370 2024-09-13T16:05:39.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.953+0000 7fc028c00640 1 --2- 172.21.15.17:0/3461763809 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557179fa0370 0x557179fa27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:39.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.956+0000 7fc00aa00640 10 client.25981 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:05:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.956+0000 7fc028c00640 1 --2- 172.21.15.17:0/3461763809 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557179fa0370 0x557179fa27b0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86b461d1be34d0c6 server_cookie=9dcd7bd843c8037e in_seq=0 out_seq=0 2024-09-13T16:05:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.956+0000 7fc00aa00640 1 -- 172.21.15.17:0/3461763809 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557179ee07d0 con 0x557179fa0370 2024-09-13T16:05:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.957+0000 7fc00aa00640 10 client.25981 handle_command_reply: tid=0 2024-09-13T16:05:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.957+0000 7fc02e420740 1 client.25981 shutdown 2024-09-13T16:05:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.957+0000 7fc02e420740 1 -- 172.21.15.17:0/3461763809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f90440 msgr2=0x557179f9bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.957+0000 7fc02e420740 1 --2- 172.21.15.17:0/3461763809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f90440 0x557179f9bc20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc01c01f630 tx=0x7fc01c004ab0 comp rx=0 tx=0).stop 2024-09-13T16:05:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.958+0000 7fc02e420740 1 -- 172.21.15.17:0/3461763809 shutdown_connections 2024-09-13T16:05:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.958+0000 7fc02e420740 1 --2- 172.21.15.17:0/3461763809 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557179fa0370 0x557179fa27b0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.958+0000 7fc02e420740 1 --2- 172.21.15.17:0/3461763809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f90440 0x557179f9bc20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.958+0000 7fc02e420740 1 --2- 172.21.15.17:0/3461763809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f8b3b0 0x557179f94be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.958+0000 7fc02e420740 1 --2- 172.21.15.17:0/3461763809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557179f8aa70 0x557179f946a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.958+0000 7fc02e420740 1 -- 172.21.15.17:0/3461763809 >> 172.21.15.17:0/3461763809 conn(0x557179f860e0 msgr2=0x557179f878f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.958+0000 7fc00aa00640 0 client.25981 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:05:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.959+0000 7fc02e420740 1 -- 172.21.15.17:0/3461763809 shutdown_connections 2024-09-13T16:05:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.959+0000 7fc02e420740 1 -- 172.21.15.17:0/3461763809 wait complete. 2024-09-13T16:05:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.959+0000 7fc02e420740 20 client.25981 trim_cache size 0 max 16384 2024-09-13T16:05:40.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.999+0000 7fc02e420740 1 Processor -- start 2024-09-13T16:05:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.999+0000 7fc02e420740 1 -- start start 2024-09-13T16:05:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.999+0000 7fc02e420740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557179f8aa70 0x557179f94450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.999+0000 7fc02e420740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f8b3b0 0x557179f9bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:40.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.999+0000 7fc02e420740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f90440 0x557179f94990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:40.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.999+0000 7fc02e420740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557179c54e60 con 0x557179f8aa70 2024-09-13T16:05:40.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.999+0000 7fc02e420740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x557179f87fa0 con 0x557179f8b3b0 2024-09-13T16:05:40.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:39.999+0000 7fc02e420740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x557179f8a5f0 con 0x557179f90440 2024-09-13T16:05:40.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.000+0000 7fc023e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f8b3b0 0x557179f9bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:40.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.000+0000 7fc023e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f8b3b0 0x557179f9bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:48438/0 (socket says 172.21.15.17:48438) 2024-09-13T16:05:40.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.000+0000 7fc023e00640 1 -- 172.21.15.17:0/4285807211 learned_addr learned my addr 172.21.15.17:0/4285807211 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:05:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.000+0000 7fc029600640 1 --2- 172.21.15.17:0/4285807211 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f90440 0x557179f94990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.000+0000 7fc023e00640 1 -- 172.21.15.17:0/4285807211 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f90440 msgr2=0x557179f94990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.000+0000 7fc023e00640 1 --2- 172.21.15.17:0/4285807211 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f90440 0x557179f94990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.000+0000 7fc023e00640 1 -- 172.21.15.17:0/4285807211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557179f8aa70 msgr2=0x557179f94450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.000+0000 7fc023e00640 1 --2- 172.21.15.17:0/4285807211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557179f8aa70 0x557179f94450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.000+0000 7fc023e00640 1 -- 172.21.15.17:0/4285807211 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557179e8e180 con 0x557179f8b3b0 2024-09-13T16:05:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.001+0000 7fc023e00640 1 --2- 172.21.15.17:0/4285807211 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f8b3b0 0x557179f9bbe0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc010004650 tx=0x7fc0100b9860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55e36b0fb3878153 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.001+0000 7fc016a00640 1 -- 172.21.15.17:0/4285807211 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0100bdc70 con 0x557179f8b3b0 2024-09-13T16:05:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.001+0000 7fc016a00640 1 -- 172.21.15.17:0/4285807211 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc0100c22c0 con 0x557179f8b3b0 2024-09-13T16:05:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.001+0000 7fc016a00640 1 -- 172.21.15.17:0/4285807211 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0100715b0 con 0x557179f8b3b0 2024-09-13T16:05:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.002+0000 7fc02e420740 1 -- 172.21.15.17:0/4285807211 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f8b3b0 msgr2=0x557179f9bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.002+0000 7fc02e420740 1 --2- 172.21.15.17:0/4285807211 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f8b3b0 0x557179f9bbe0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc010004650 tx=0x7fc0100b9860 comp rx=0 tx=0).stop 2024-09-13T16:05:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.004+0000 7fc02e420740 1 -- 172.21.15.17:0/4285807211 shutdown_connections 2024-09-13T16:05:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.004+0000 7fc02e420740 1 --2- 172.21.15.17:0/4285807211 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f90440 0x557179f94990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.004+0000 7fc02e420740 1 --2- 172.21.15.17:0/4285807211 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f8b3b0 0x557179f9bbe0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.004+0000 7fc02e420740 1 --2- 172.21.15.17:0/4285807211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557179f8aa70 0x557179f94450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.004+0000 7fc02e420740 1 -- 172.21.15.17:0/4285807211 >> 172.21.15.17:0/4285807211 conn(0x557179f860e0 msgr2=0x557179f8c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:40.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.005+0000 7fc02e420740 1 -- 172.21.15.17:0/4285807211 shutdown_connections 2024-09-13T16:05:40.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.005+0000 7fc02e420740 1 -- 172.21.15.17:0/4285807211 wait complete. 2024-09-13T16:05:40.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.005+0000 7fc02e420740 1 -- start start 2024-09-13T16:05:40.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.006+0000 7fc02e420740 1 Processor -- start 2024-09-13T16:05:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.007+0000 7fc02e420740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557179f8aa70 0x557179f9bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.007+0000 7fc02e420740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f8b3b0 0x557179f98610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.008+0000 7fc028c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557179f8aa70 0x557179f9bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.008+0000 7fc02e420740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f90440 0x557179f98c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.008+0000 7fc028c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557179f8aa70 0x557179f9bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44306/0 (socket says 172.21.15.17:44306) 2024-09-13T16:05:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.008+0000 7fc02e420740 1 -- 172.21.15.17:0/476297300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557179ff68c0 con 0x557179f8aa70 2024-09-13T16:05:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.008+0000 7fc028c00640 1 -- 172.21.15.17:0/476297300 learned_addr learned my addr 172.21.15.17:0/476297300 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:05:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.008+0000 7fc02e420740 1 -- 172.21.15.17:0/476297300 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x557179ff6a00 con 0x557179f90440 2024-09-13T16:05:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.008+0000 7fc02e420740 1 -- 172.21.15.17:0/476297300 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x557179ff6b40 con 0x557179f8b3b0 2024-09-13T16:05:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.008+0000 7fc02e420740 10 client.0 _ll_register_callbacks cb 0x7fc01800b2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:05:40.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.009+0000 7fc023e00640 1 --2- 172.21.15.17:0/476297300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f8b3b0 0x557179f98610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:40.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.009+0000 7fc029600640 1 --2- 172.21.15.17:0/476297300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f90440 0x557179f98c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:40.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.010+0000 7fc023e00640 1 -- 172.21.15.17:0/476297300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f90440 msgr2=0x557179f98c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:40.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.010+0000 7fc023e00640 1 --2- 172.21.15.17:0/476297300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f90440 0x557179f98c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:40.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.010+0000 7fc023e00640 1 -- 172.21.15.17:0/476297300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557179f8aa70 msgr2=0x557179f9bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:40.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.010+0000 7fc023e00640 1 --2- 172.21.15.17:0/476297300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557179f8aa70 0x557179f9bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:40.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.011+0000 7fc023e00640 1 -- 172.21.15.17:0/476297300 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0241a4890 con 0x557179f8b3b0 2024-09-13T16:05:40.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.011+0000 7fc029600640 1 --2- 172.21.15.17:0/476297300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f90440 0x557179f98c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:05:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.012+0000 7fc00aa00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:05:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.012+0000 7fc023e00640 1 --2- 172.21.15.17:0/476297300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f8b3b0 0x557179f98610 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc01003d040 tx=0x7fc0100ea490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=901352ee09082220 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.013+0000 7fc00aa00640 1 -- 172.21.15.17:0/476297300 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0100b9530 con 0x557179f8b3b0 2024-09-13T16:05:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.013+0000 7fc00aa00640 1 -- 172.21.15.17:0/476297300 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fc0100bdc70 con 0x557179f8b3b0 2024-09-13T16:05:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.014+0000 7fc02e420740 1 -- 172.21.15.17:0/476297300 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc018017a40 con 0x557179f8b3b0 2024-09-13T16:05:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.014+0000 7fc00aa00640 1 -- 172.21.15.17:0/476297300 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0100c1e30 con 0x557179f8b3b0 2024-09-13T16:05:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.014+0000 7fc02e420740 10 client.25987 fetch_fsmap learned FSMap version 41 2024-09-13T16:05:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.015+0000 7fc02e420740 1 -- 172.21.15.17:0/476297300 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x557179eb3560 con 0x557179f8b3b0 2024-09-13T16:05:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.015+0000 7fc00aa00640 1 -- 172.21.15.17:0/476297300 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc018017a40 con 0x557179f8b3b0 2024-09-13T16:05:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.017+0000 7fc00aa00640 1 -- 172.21.15.17:0/476297300 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 41) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fc0100cfd20 con 0x557179f8b3b0 2024-09-13T16:05:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.017+0000 7fc02e420740 10 client.25987 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T16:05:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.017+0000 7fc02e420740 10 client.25987 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:05:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.017+0000 7fc02e420740 20 client.25987 populate_metadata read hostname 'smithi017' 2024-09-13T16:05:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.017+0000 7fc02e420740 1 --2- 172.21.15.17:0/476297300 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557179ff81d0 0x557179ffa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.017+0000 7fc02e420740 4 client.25987 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:05:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.017+0000 7fc02e420740 1 -- 172.21.15.17:0/476297300 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557179be1300 con 0x557179ff81d0 2024-09-13T16:05:40.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.018+0000 7fc028c00640 1 --2- 172.21.15.17:0/476297300 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557179ff81d0 0x557179ffa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:40.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.020+0000 7fc00aa00640 10 client.25987 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:05:40.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.020+0000 7fc028c00640 1 --2- 172.21.15.17:0/476297300 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557179ff81d0 0x557179ffa5f0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccb87c7a950a0d64 server_cookie=bacd0589e91c04b1 in_seq=0 out_seq=0 2024-09-13T16:05:40.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:39 smithi189 ceph-mon[34790]: pgmap v622: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.5 MiB/s wr, 574 op/s 2024-09-13T16:05:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.206+0000 7fc00aa00640 1 -- 172.21.15.17:0/476297300 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557179be1300 con 0x557179ff81d0 2024-09-13T16:05:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.206+0000 7fc00aa00640 10 client.25987 handle_command_reply: tid=0 2024-09-13T16:05:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.206+0000 7fc02e420740 1 client.25987 shutdown 2024-09-13T16:05:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.206+0000 7fc02e420740 1 -- 172.21.15.17:0/476297300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f8b3b0 msgr2=0x557179f98610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.206+0000 7fc02e420740 1 --2- 172.21.15.17:0/476297300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f8b3b0 0x557179f98610 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc01003d040 tx=0x7fc0100ea490 comp rx=0 tx=0).stop 2024-09-13T16:05:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.206+0000 7fc02e420740 1 -- 172.21.15.17:0/476297300 shutdown_connections 2024-09-13T16:05:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.206+0000 7fc02e420740 1 --2- 172.21.15.17:0/476297300 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557179ff81d0 0x557179ffa5f0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.207+0000 7fc02e420740 1 --2- 172.21.15.17:0/476297300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557179f90440 0x557179f98c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.207+0000 7fc02e420740 1 --2- 172.21.15.17:0/476297300 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557179f8b3b0 0x557179f98610 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.207+0000 7fc02e420740 1 --2- 172.21.15.17:0/476297300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557179f8aa70 0x557179f9bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.207+0000 7fc02e420740 1 -- 172.21.15.17:0/476297300 >> 172.21.15.17:0/476297300 conn(0x557179f860e0 msgr2=0x557179f8f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.207+0000 7fc00aa00640 0 client.25987 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:05:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.208+0000 7fc02e420740 1 -- 172.21.15.17:0/476297300 shutdown_connections 2024-09-13T16:05:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.208+0000 7fc02e420740 1 -- 172.21.15.17:0/476297300 wait complete. 2024-09-13T16:05:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.208+0000 7fc02e420740 20 client.25987 trim_cache size 0 max 16384 2024-09-13T16:05:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:05:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:05:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:05:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:05:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.209+0000 7fc02b600640 1 -- 172.21.15.17:0/929132449 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc00c0a1160 msgr2=0x7fc00c0a3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.209+0000 7fc02b600640 1 --2- 172.21.15.17:0/929132449 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc00c0a1160 0x7fc00c0a3620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009270 tx=0x7fc01c014040 comp rx=0 tx=0).stop 2024-09-13T16:05:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.209+0000 7fc02b600640 1 -- 172.21.15.17:0/929132449 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc024107530 msgr2=0x7fc02419c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.209+0000 7fc02b600640 1 --2- 172.21.15.17:0/929132449 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc024107530 0x7fc02419c920 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc010003b70 tx=0x7fc010003ba0 comp rx=0 tx=0).stop 2024-09-13T16:05:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.210+0000 7fc02b600640 1 -- 172.21.15.17:0/929132449 shutdown_connections 2024-09-13T16:05:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.210+0000 7fc02b600640 1 --2- 172.21.15.17:0/929132449 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc00c0a1160 0x7fc00c0a3620 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:40.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.210+0000 7fc02b600640 1 --2- 172.21.15.17:0/929132449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc024107ed0 0x7fc0241a3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:40.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.210+0000 7fc02b600640 1 --2- 172.21.15.17:0/929132449 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc024107530 0x7fc02419c920 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:40.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.210+0000 7fc02b600640 1 --2- 172.21.15.17:0/929132449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc024106680 0x7fc02419c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:40.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.210+0000 7fc02b600640 1 -- 172.21.15.17:0/929132449 >> 172.21.15.17:0/929132449 conn(0x7fc024075730 msgr2=0x7fc02410a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:40.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.210+0000 7fc02b600640 1 -- 172.21.15.17:0/929132449 shutdown_connections 2024-09-13T16:05:40.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:40.210+0000 7fc02b600640 1 -- 172.21.15.17:0/929132449 wait complete. 2024-09-13T16:05:40.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:39 smithi193 ceph-mon[35248]: pgmap v622: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.5 MiB/s wr, 574 op/s 2024-09-13T16:05:40.266 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:39 smithi017 ceph-mon[30494]: pgmap v622: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.5 MiB/s wr, 574 op/s 2024-09-13T16:05:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 475.0 s, 985.8 tps, lat 103.663 ms stddev 132.490 2024-09-13T16:05:42.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:41 smithi189 ceph-mon[34790]: pgmap v623: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.9 MiB/s wr, 577 op/s 2024-09-13T16:05:42.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:41 smithi193 ceph-mon[35248]: pgmap v623: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.9 MiB/s wr, 577 op/s 2024-09-13T16:05:42.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:41 smithi017 ceph-mon[30494]: pgmap v623: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.9 MiB/s wr, 577 op/s 2024-09-13T16:05:44.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:43 smithi193 ceph-mon[35248]: pgmap v624: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 6.2 MiB/s wr, 618 op/s 2024-09-13T16:05:44.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:43 smithi017 ceph-mon[30494]: pgmap v624: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 6.2 MiB/s wr, 618 op/s 2024-09-13T16:05:44.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:43 smithi189 ceph-mon[34790]: pgmap v624: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 6.2 MiB/s wr, 618 op/s 2024-09-13T16:05:45.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 480.0 s, 888.4 tps, lat 112.989 ms stddev 127.196 2024-09-13T16:05:46.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:45 smithi193 ceph-mon[35248]: pgmap v625: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 7.9 MiB/s wr, 789 op/s 2024-09-13T16:05:46.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:45 smithi017 ceph-mon[30494]: pgmap v625: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 7.9 MiB/s wr, 789 op/s 2024-09-13T16:05:46.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:45 smithi189 ceph-mon[34790]: pgmap v625: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 7.9 MiB/s wr, 789 op/s 2024-09-13T16:05:48.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:47 smithi193 ceph-mon[35248]: pgmap v626: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 8.4 MiB/s wr, 883 op/s 2024-09-13T16:05:48.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:47 smithi017 ceph-mon[30494]: pgmap v626: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 8.4 MiB/s wr, 883 op/s 2024-09-13T16:05:48.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:47 smithi189 ceph-mon[34790]: pgmap v626: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 8.4 MiB/s wr, 883 op/s 2024-09-13T16:05:50.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:49 smithi193 ceph-mon[35248]: pgmap v627: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 8.5 MiB/s wr, 881 op/s 2024-09-13T16:05:50.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:49 smithi017 ceph-mon[30494]: pgmap v627: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 8.5 MiB/s wr, 881 op/s 2024-09-13T16:05:50.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 485.0 s, 551.0 tps, lat 180.398 ms stddev 222.495 2024-09-13T16:05:50.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:49 smithi189 ceph-mon[34790]: pgmap v627: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 8.5 MiB/s wr, 881 op/s 2024-09-13T16:05:52.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:51 smithi193 ceph-mon[35248]: pgmap v628: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 8.4 MiB/s wr, 866 op/s 2024-09-13T16:05:52.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:51 smithi017 ceph-mon[30494]: pgmap v628: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 8.4 MiB/s wr, 866 op/s 2024-09-13T16:05:52.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:51 smithi189 ceph-mon[34790]: pgmap v628: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 8.4 MiB/s wr, 866 op/s 2024-09-13T16:05:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.425+0000 7f3a43200640 1 -- 172.21.15.17:0/1521893191 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a44100140 msgr2=0x7f3a44100540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.425+0000 7f3a43200640 1 --2- 172.21.15.17:0/1521893191 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a44100140 0x7f3a44100540 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3a34009900 tx=0x7f3a3402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.425+0000 7f3a43200640 1 -- 172.21.15.17:0/1521893191 shutdown_connections 2024-09-13T16:05:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.425+0000 7f3a43200640 1 --2- 172.21.15.17:0/1521893191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a440ff030 0x7f3a44067830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.425+0000 7f3a43200640 1 --2- 172.21.15.17:0/1521893191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a440fe670 0x7f3a440feaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.425+0000 7f3a43200640 1 --2- 172.21.15.17:0/1521893191 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a44100140 0x7f3a44100540 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.425+0000 7f3a43200640 1 -- 172.21.15.17:0/1521893191 >> 172.21.15.17:0/1521893191 conn(0x7f3a440fa1c0 msgr2=0x7f3a440fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.425+0000 7f3a43200640 1 -- 172.21.15.17:0/1521893191 shutdown_connections 2024-09-13T16:05:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.425+0000 7f3a43200640 1 -- 172.21.15.17:0/1521893191 wait complete. 2024-09-13T16:05:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.427+0000 7f3a43200640 1 Processor -- start 2024-09-13T16:05:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.427+0000 7f3a43200640 1 -- start start 2024-09-13T16:05:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.427+0000 7f3a43200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a440fe670 0x7f3a441939f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.427+0000 7f3a43200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a440ff030 0x7f3a44193f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.427+0000 7f3a43200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a44100140 0x7f3a4419af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.427+0000 7f3a43200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4419b490 con 0x7f3a440ff030 2024-09-13T16:05:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.427+0000 7f3a43200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4419b600 con 0x7f3a440fe670 2024-09-13T16:05:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.427+0000 7f3a43200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a441ac810 con 0x7f3a44100140 2024-09-13T16:05:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.428+0000 7f3a42800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a44100140 0x7f3a4419af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.428+0000 7f3a42800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a44100140 0x7f3a4419af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:56016/0 (socket says 172.21.15.17:56016) 2024-09-13T16:05:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.428+0000 7f3a42800640 1 -- 172.21.15.17:0/2599648496 learned_addr learned my addr 172.21.15.17:0/2599648496 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:05:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.428+0000 7f3a41e00640 1 --2- 172.21.15.17:0/2599648496 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a440fe670 0x7f3a441939f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.428+0000 7f3a42800640 1 -- 172.21.15.17:0/2599648496 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a440fe670 msgr2=0x7f3a441939f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.428+0000 7f3a42800640 1 --2- 172.21.15.17:0/2599648496 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a440fe670 0x7f3a441939f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.428+0000 7f3a42800640 1 -- 172.21.15.17:0/2599648496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a440ff030 msgr2=0x7f3a44193f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:53.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.428+0000 7f3a42800640 1 --2- 172.21.15.17:0/2599648496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a440ff030 0x7f3a44193f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.428+0000 7f3a42800640 1 -- 172.21.15.17:0/2599648496 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a34009560 con 0x7f3a44100140 2024-09-13T16:05:53.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.428+0000 7f3a41e00640 1 --2- 172.21.15.17:0/2599648496 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a440fe670 0x7f3a441939f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:05:53.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.429+0000 7f3a42800640 1 --2- 172.21.15.17:0/2599648496 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a44100140 0x7f3a4419af50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00cce0 tx=0x7f3a3c00a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:53.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.430+0000 7f3a3aa00640 1 -- 172.21.15.17:0/2599648496 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c00f450 con 0x7f3a44100140 2024-09-13T16:05:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.430+0000 7f3a3aa00640 1 -- 172.21.15.17:0/2599648496 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a3c00fa70 con 0x7f3a44100140 2024-09-13T16:05:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.430+0000 7f3a3aa00640 1 -- 172.21.15.17:0/2599648496 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c018b00 con 0x7f3a44100140 2024-09-13T16:05:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.431+0000 7f3a43200640 1 -- 172.21.15.17:0/2599648496 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a441acac0 con 0x7f3a44100140 2024-09-13T16:05:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.432+0000 7f3a43200640 1 -- 172.21.15.17:0/2599648496 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a441acf80 con 0x7f3a44100140 2024-09-13T16:05:53.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.436+0000 7f3a3aa00640 1 -- 172.21.15.17:0/2599648496 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3a3c00fbe0 con 0x7f3a44100140 2024-09-13T16:05:53.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.436+0000 7f3a4bcc1740 1 Processor -- start 2024-09-13T16:05:53.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.437+0000 7f3a4bcc1740 1 -- start start 2024-09-13T16:05:53.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.437+0000 7f3a4bcc1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e35c80 0x5582c9e36080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:53.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.437+0000 7f3a4bcc1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582c9e365c0 0x5582c9e3b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:53.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.437+0000 7f3a4bcc1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e3b650 0x5582c9e3db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.437+0000 7f3a4bcc1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c9d41bb0 con 0x5582c9e365c0 2024-09-13T16:05:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.437+0000 7f3a4bcc1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c9d9fa70 con 0x5582c9e35c80 2024-09-13T16:05:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.437+0000 7f3a4bcc1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c9d9d200 con 0x5582c9e3b650 2024-09-13T16:05:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.438+0000 7f3a41400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e35c80 0x5582c9e36080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.438+0000 7f3a41400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e35c80 0x5582c9e36080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:47862/0 (socket says 172.21.15.17:47862) 2024-09-13T16:05:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.438+0000 7f3a41400640 1 -- 172.21.15.17:0/1493907718 learned_addr learned my addr 172.21.15.17:0/1493907718 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:05:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.438+0000 7f3a41400640 1 --2- 172.21.15.17:0/1493907718 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e3b650 0x5582c9e3db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.438+0000 7f3a41e00640 1 --2- 172.21.15.17:0/1493907718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582c9e365c0 0x5582c9e3b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.439+0000 7f3a3aa00640 1 --2- 172.21.15.17:0/2599648496 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3a280a12f0 0x7f3a280a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.439+0000 7f3a3aa00640 1 -- 172.21.15.17:0/2599648496 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f3a3c0cd470 con 0x7f3a44100140 2024-09-13T16:05:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.439+0000 7f3a41400640 1 -- 172.21.15.17:0/1493907718 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e3b650 msgr2=0x5582c9e3db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:53.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.439+0000 7f3a41400640 1 --2- 172.21.15.17:0/1493907718 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e3b650 0x5582c9e3db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.439+0000 7f3a41400640 1 -- 172.21.15.17:0/1493907718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582c9e365c0 msgr2=0x5582c9e3b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:53.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.439+0000 7f3a41400640 1 --2- 172.21.15.17:0/1493907718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582c9e365c0 0x5582c9e3b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.439+0000 7f3a41400640 1 -- 172.21.15.17:0/1493907718 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582c9d3a940 con 0x5582c9e35c80 2024-09-13T16:05:53.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.439+0000 7f3a42800640 1 --2- 172.21.15.17:0/2599648496 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3a280a12f0 0x7f3a280a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:53.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.439+0000 7f3a41400640 1 --2- 172.21.15.17:0/1493907718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e35c80 0x5582c9e36080 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3a300137d0 tx=0x7f3a300096e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99f8e14d5d3e3262 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:53.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.440+0000 7f3a2f400640 1 -- 172.21.15.17:0/1493907718 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a30005220 con 0x5582c9e35c80 2024-09-13T16:05:53.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.440+0000 7f3a2f400640 1 -- 172.21.15.17:0/1493907718 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a30019070 con 0x5582c9e35c80 2024-09-13T16:05:53.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.440+0000 7f3a2f400640 1 -- 172.21.15.17:0/1493907718 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a30005670 con 0x5582c9e35c80 2024-09-13T16:05:53.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.440+0000 7f3a42800640 1 --2- 172.21.15.17:0/2599648496 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3a280a12f0 0x7f3a280a37b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c0a2540 tx=0x7f3a3c0185a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.441+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/1493907718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e35c80 msgr2=0x5582c9e36080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.441+0000 7f3a4bcc1740 1 --2- 172.21.15.17:0/1493907718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e35c80 0x5582c9e36080 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3a300137d0 tx=0x7f3a300096e0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.441+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/1493907718 shutdown_connections 2024-09-13T16:05:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.441+0000 7f3a4bcc1740 1 --2- 172.21.15.17:0/1493907718 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e3b650 0x5582c9e3db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.441+0000 7f3a4bcc1740 1 --2- 172.21.15.17:0/1493907718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582c9e365c0 0x5582c9e3b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.441+0000 7f3a4bcc1740 1 --2- 172.21.15.17:0/1493907718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e35c80 0x5582c9e36080 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.441+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/1493907718 >> 172.21.15.17:0/1493907718 conn(0x5582c9e312f0 msgr2=0x5582c9e316f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.441+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/1493907718 shutdown_connections 2024-09-13T16:05:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.441+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/1493907718 wait complete. 2024-09-13T16:05:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.442+0000 7f3a4bcc1740 1 -- start start 2024-09-13T16:05:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.442+0000 7f3a4bcc1740 1 Processor -- start 2024-09-13T16:05:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.443+0000 7f3a4bcc1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e35c80 0x5582c9e3f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.443+0000 7f3a4bcc1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e365c0 0x5582c9e3fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.443+0000 7f3a4bcc1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582c9e3b650 0x5582c9e46dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.443+0000 7f3a4bcc1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c9d98af0 con 0x5582c9e3b650 2024-09-13T16:05:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.443+0000 7f3a4bcc1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c9d56f20 con 0x5582c9e365c0 2024-09-13T16:05:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.443+0000 7f3a4bcc1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c9d56bc0 con 0x5582c9e35c80 2024-09-13T16:05:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.443+0000 7f3a4bcc1740 10 client.0 _ll_register_callbacks cb 0x5582c9d88a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:05:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.443+0000 7f3a41400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e35c80 0x5582c9e3f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.443+0000 7f3a41400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e35c80 0x5582c9e3f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:56030/0 (socket says 172.21.15.17:56030) 2024-09-13T16:05:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.443+0000 7f3a41400640 1 -- 172.21.15.17:0/2388076808 learned_addr learned my addr 172.21.15.17:0/2388076808 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:05:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.443+0000 7f3a41e00640 1 --2- 172.21.15.17:0/2388076808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e365c0 0x5582c9e3fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.443+0000 7f3a41400640 1 --2- 172.21.15.17:0/2388076808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582c9e3b650 0x5582c9e46dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.444+0000 7f3a41e00640 1 -- 172.21.15.17:0/2388076808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e35c80 msgr2=0x5582c9e3f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.444+0000 7f3a41e00640 1 --2- 172.21.15.17:0/2388076808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e35c80 0x5582c9e3f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.444+0000 7f3a41e00640 1 -- 172.21.15.17:0/2388076808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582c9e3b650 msgr2=0x5582c9e46dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.444+0000 7f3a41e00640 1 --2- 172.21.15.17:0/2388076808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582c9e3b650 0x5582c9e46dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.444+0000 7f3a41e00640 1 -- 172.21.15.17:0/2388076808 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a30013480 con 0x5582c9e365c0 2024-09-13T16:05:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.444+0000 7f3a41400640 1 --2- 172.21.15.17:0/2388076808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582c9e3b650 0x5582c9e46dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:05:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.444+0000 7f3a41e00640 1 --2- 172.21.15.17:0/2388076808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e365c0 0x5582c9e3fd90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3a34009230 tx=0x7f3a340045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53d956c6f43c4721 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.444+0000 7f3a23e00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:05:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.444+0000 7f3a23e00640 1 -- 172.21.15.17:0/2388076808 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a340039b0 con 0x5582c9e365c0 2024-09-13T16:05:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.444+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/2388076808 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5582c9dc2c90 con 0x5582c9e365c0 2024-09-13T16:05:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.444+0000 7f3a23e00640 1 -- 172.21.15.17:0/2388076808 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f3a34003b10 con 0x5582c9e365c0 2024-09-13T16:05:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.445+0000 7f3a23e00640 1 -- 172.21.15.17:0/2388076808 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a34003cd0 con 0x5582c9e365c0 2024-09-13T16:05:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.445+0000 7f3a4bcc1740 10 client.25970 fetch_fsmap learned FSMap version 41 2024-09-13T16:05:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.445+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/2388076808 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x5582c9d97170 con 0x5582c9e365c0 2024-09-13T16:05:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.445+0000 7f3a23e00640 1 -- 172.21.15.17:0/2388076808 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5582c9dc2c90 con 0x5582c9e365c0 2024-09-13T16:05:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.445+0000 7f3a23e00640 1 -- 172.21.15.17:0/2388076808 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 41) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f3a34045500 con 0x5582c9e365c0 2024-09-13T16:05:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.445+0000 7f3a4bcc1740 10 client.25970 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T16:05:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.445+0000 7f3a4bcc1740 10 client.25970 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:05:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.445+0000 7f3a4bcc1740 20 client.25970 populate_metadata read hostname 'smithi017' 2024-09-13T16:05:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.445+0000 7f3a4bcc1740 1 --2- 172.21.15.17:0/2388076808 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5582c9e4b560 0x5582c9e4d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.445+0000 7f3a4bcc1740 4 client.25970 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:05:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.445+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/2388076808 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5582c9d8b7d0 con 0x5582c9e4b560 2024-09-13T16:05:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.446+0000 7f3a41400640 1 --2- 172.21.15.17:0/2388076808 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5582c9e4b560 0x5582c9e4d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:53.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.446+0000 7f3a41400640 1 --2- 172.21.15.17:0/2388076808 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5582c9e4b560 0x5582c9e4d980 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7febb16515ea034d server_cookie=dd2ceee0ed3da366 in_seq=0 out_seq=0 2024-09-13T16:05:53.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.446+0000 7f3a23e00640 10 client.25970 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:05:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.447+0000 7f3a23e00640 1 -- 172.21.15.17:0/2388076808 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5582c9d8b7d0 con 0x5582c9e4b560 2024-09-13T16:05:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.447+0000 7f3a23e00640 10 client.25970 handle_command_reply: tid=0 2024-09-13T16:05:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.447+0000 7f3a4bcc1740 1 client.25970 shutdown 2024-09-13T16:05:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.447+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/2388076808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e365c0 msgr2=0x5582c9e3fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.447+0000 7f3a4bcc1740 1 --2- 172.21.15.17:0/2388076808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e365c0 0x5582c9e3fd90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3a34009230 tx=0x7f3a340045d0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.447+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/2388076808 shutdown_connections 2024-09-13T16:05:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.447+0000 7f3a4bcc1740 1 --2- 172.21.15.17:0/2388076808 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5582c9e4b560 0x5582c9e4d980 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.447+0000 7f3a4bcc1740 1 --2- 172.21.15.17:0/2388076808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582c9e3b650 0x5582c9e46dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.447+0000 7f3a4bcc1740 1 --2- 172.21.15.17:0/2388076808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e365c0 0x5582c9e3fd90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.447+0000 7f3a4bcc1740 1 --2- 172.21.15.17:0/2388076808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e35c80 0x5582c9e3f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.447+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/2388076808 >> 172.21.15.17:0/2388076808 conn(0x5582c9e312f0 msgr2=0x5582c9e32b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.447+0000 7f3a23e00640 0 client.25970 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:05:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.448+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/2388076808 shutdown_connections 2024-09-13T16:05:53.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.448+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/2388076808 wait complete. 2024-09-13T16:05:53.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.449+0000 7f3a4bcc1740 20 client.25970 trim_cache size 0 max 16384 2024-09-13T16:05:53.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.474+0000 7f3a4bcc1740 1 Processor -- start 2024-09-13T16:05:53.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.474+0000 7f3a4bcc1740 1 -- start start 2024-09-13T16:05:53.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.474+0000 7f3a4bcc1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582c9e35c80 0x5582c9e30c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:53.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.474+0000 7f3a4bcc1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e365c0 0x5582c9e46d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:53.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.474+0000 7f3a4bcc1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e3b650 0x5582c9e37440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:53.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.474+0000 7f3a4bcc1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c9affe60 con 0x5582c9e35c80 2024-09-13T16:05:53.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.474+0000 7f3a4bcc1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c9e3f390 con 0x5582c9e3b650 2024-09-13T16:05:53.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.474+0000 7f3a4bcc1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c9e49a80 con 0x5582c9e365c0 2024-09-13T16:05:53.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.475+0000 7f3a41400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582c9e35c80 0x5582c9e30c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:53.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.475+0000 7f3a41400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582c9e35c80 0x5582c9e30c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52402/0 (socket says 172.21.15.17:52402) 2024-09-13T16:05:53.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.475+0000 7f3a41400640 1 -- 172.21.15.17:0/3010116177 learned_addr learned my addr 172.21.15.17:0/3010116177 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:05:53.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.475+0000 7f3a41e00640 1 --2- 172.21.15.17:0/3010116177 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e365c0 0x5582c9e46d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:53.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.475+0000 7f3a41400640 1 --2- 172.21.15.17:0/3010116177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e3b650 0x5582c9e37440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:53.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.475+0000 7f3a41e00640 1 -- 172.21.15.17:0/3010116177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e3b650 msgr2=0x5582c9e37440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:53.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.475+0000 7f3a41e00640 1 --2- 172.21.15.17:0/3010116177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e3b650 0x5582c9e37440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.475+0000 7f3a41e00640 1 -- 172.21.15.17:0/3010116177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582c9e35c80 msgr2=0x5582c9e30c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:53.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.475+0000 7f3a41e00640 1 --2- 172.21.15.17:0/3010116177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582c9e35c80 0x5582c9e30c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.475+0000 7f3a41e00640 1 -- 172.21.15.17:0/3010116177 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582c9d39180 con 0x5582c9e365c0 2024-09-13T16:05:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.475+0000 7f3a41e00640 1 --2- 172.21.15.17:0/3010116177 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e365c0 0x5582c9e46d90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3a34033000 tx=0x7f3a34009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acc4ff803fb31968 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.476+0000 7f3a2fe00640 1 -- 172.21.15.17:0/3010116177 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a34045b50 con 0x5582c9e365c0 2024-09-13T16:05:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.476+0000 7f3a2fe00640 1 -- 172.21.15.17:0/3010116177 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a34040070 con 0x5582c9e365c0 2024-09-13T16:05:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.476+0000 7f3a2fe00640 1 -- 172.21.15.17:0/3010116177 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3403a3c0 con 0x5582c9e365c0 2024-09-13T16:05:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.477+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/3010116177 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e365c0 msgr2=0x5582c9e46d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.477+0000 7f3a4bcc1740 1 --2- 172.21.15.17:0/3010116177 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e365c0 0x5582c9e46d90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3a34033000 tx=0x7f3a34009780 comp rx=0 tx=0).stop 2024-09-13T16:05:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.477+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/3010116177 shutdown_connections 2024-09-13T16:05:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.477+0000 7f3a4bcc1740 1 --2- 172.21.15.17:0/3010116177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e3b650 0x5582c9e37440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.477+0000 7f3a4bcc1740 1 --2- 172.21.15.17:0/3010116177 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e365c0 0x5582c9e46d90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.477+0000 7f3a4bcc1740 1 --2- 172.21.15.17:0/3010116177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582c9e35c80 0x5582c9e30c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.477+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/3010116177 >> 172.21.15.17:0/3010116177 conn(0x5582c9e312f0 msgr2=0x5582c9e3aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.477+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/3010116177 shutdown_connections 2024-09-13T16:05:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.477+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/3010116177 wait complete. 2024-09-13T16:05:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.477+0000 7f3a4bcc1740 1 -- start start 2024-09-13T16:05:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.478+0000 7f3a4bcc1740 1 Processor -- start 2024-09-13T16:05:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.479+0000 7f3a4bcc1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582c9e35c80 0x5582c9e42d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:53.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.479+0000 7f3a4bcc1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e365c0 0x5582c9e43270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:53.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.479+0000 7f3a4bcc1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e3b650 0x5582c9e46290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:53.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.479+0000 7f3a4bcc1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c9e467d0 con 0x5582c9e35c80 2024-09-13T16:05:53.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.479+0000 7f3a4bcc1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c9e46940 con 0x5582c9e365c0 2024-09-13T16:05:53.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.479+0000 7f3a4bcc1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c9e46b00 con 0x5582c9e3b650 2024-09-13T16:05:53.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.479+0000 7f3a4bcc1740 10 client.0 _ll_register_callbacks cb 0x7f3a300099b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:05:53.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.481+0000 7f3a41e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e365c0 0x5582c9e43270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:53.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.481+0000 7f3a41e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e365c0 0x5582c9e43270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:47908/0 (socket says 172.21.15.17:47908) 2024-09-13T16:05:53.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.481+0000 7f3a41e00640 1 -- 172.21.15.17:0/3124391411 learned_addr learned my addr 172.21.15.17:0/3124391411 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:05:53.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.482+0000 7f3a41400640 1 --2- 172.21.15.17:0/3124391411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e3b650 0x5582c9e46290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:53.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.482+0000 7f3a41400640 1 --2- 172.21.15.17:0/3124391411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582c9e35c80 0x5582c9e42d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:53.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.482+0000 7f3a41e00640 1 -- 172.21.15.17:0/3124391411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e3b650 msgr2=0x5582c9e46290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:53.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.483+0000 7f3a41e00640 1 --2- 172.21.15.17:0/3124391411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e3b650 0x5582c9e46290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.483+0000 7f3a41e00640 1 -- 172.21.15.17:0/3124391411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582c9e35c80 msgr2=0x5582c9e42d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:05:53.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.483+0000 7f3a41e00640 1 --2- 172.21.15.17:0/3124391411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582c9e35c80 0x5582c9e42d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.484+0000 7f3a41e00640 1 -- 172.21.15.17:0/3124391411 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a3404a040 con 0x5582c9e365c0 2024-09-13T16:05:53.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.484+0000 7f3a41400640 1 --2- 172.21.15.17:0/3124391411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e3b650 0x5582c9e46290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:05:53.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.484+0000 7f3a41e00640 1 --2- 172.21.15.17:0/3124391411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e365c0 0x5582c9e43270 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3a34005cd0 tx=0x7f3a34005760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ef90ada048b647f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:05:53.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.484+0000 7f3a23e00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:05:53.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.484+0000 7f3a23e00640 1 -- 172.21.15.17:0/3124391411 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a34045b50 con 0x5582c9e365c0 2024-09-13T16:05:53.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.485+0000 7f3a23e00640 1 -- 172.21.15.17:0/3124391411 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f3a34000e40 con 0x5582c9e365c0 2024-09-13T16:05:53.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.485+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/3124391411 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3a30019070 con 0x5582c9e365c0 2024-09-13T16:05:53.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.485+0000 7f3a23e00640 1 -- 172.21.15.17:0/3124391411 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a340039c0 con 0x5582c9e365c0 2024-09-13T16:05:53.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.485+0000 7f3a4bcc1740 10 client.25976 fetch_fsmap learned FSMap version 41 2024-09-13T16:05:53.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.485+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/3124391411 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x5582c9d5e560 con 0x5582c9e365c0 2024-09-13T16:05:53.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.485+0000 7f3a23e00640 1 -- 172.21.15.17:0/3124391411 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a34064030 con 0x5582c9e365c0 2024-09-13T16:05:53.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.485+0000 7f3a23e00640 1 -- 172.21.15.17:0/3124391411 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 41) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f3a34031ac0 con 0x5582c9e365c0 2024-09-13T16:05:53.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.485+0000 7f3a4bcc1740 10 client.25976 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T16:05:53.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.485+0000 7f3a4bcc1740 10 client.25976 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:05:53.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.485+0000 7f3a4bcc1740 20 client.25976 populate_metadata read hostname 'smithi017' 2024-09-13T16:05:53.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.485+0000 7f3a4bcc1740 1 --2- 172.21.15.17:0/3124391411 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5582c9ea27c0 0x5582c9ea4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:05:53.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.485+0000 7f3a4bcc1740 4 client.25976 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:05:53.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.485+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/3124391411 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5582c9a8c300 con 0x5582c9ea27c0 2024-09-13T16:05:53.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.486+0000 7f3a41400640 1 --2- 172.21.15.17:0/3124391411 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5582c9ea27c0 0x5582c9ea4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:05:53.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.486+0000 7f3a41400640 1 --2- 172.21.15.17:0/3124391411 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5582c9ea27c0 0x5582c9ea4bb0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecdeea118a3a62aa server_cookie=59221d09b8b9e4eb in_seq=0 out_seq=0 2024-09-13T16:05:53.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.486+0000 7f3a23e00640 10 client.25976 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:05:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.495+0000 7f3a23e00640 1 -- 172.21.15.17:0/3124391411 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5582c9a8c300 con 0x5582c9ea27c0 2024-09-13T16:05:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.495+0000 7f3a23e00640 10 client.25976 handle_command_reply: tid=0 2024-09-13T16:05:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.495+0000 7f3a4bcc1740 1 client.25976 shutdown 2024-09-13T16:05:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.496+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/3124391411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e365c0 msgr2=0x5582c9e43270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.496+0000 7f3a4bcc1740 1 --2- 172.21.15.17:0/3124391411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e365c0 0x5582c9e43270 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3a34005cd0 tx=0x7f3a34005760 comp rx=0 tx=0).stop 2024-09-13T16:05:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.496+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/3124391411 shutdown_connections 2024-09-13T16:05:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.496+0000 7f3a4bcc1740 1 --2- 172.21.15.17:0/3124391411 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5582c9ea27c0 0x5582c9ea4bb0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.496+0000 7f3a4bcc1740 1 --2- 172.21.15.17:0/3124391411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5582c9e3b650 0x5582c9e46290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.496+0000 7f3a4bcc1740 1 --2- 172.21.15.17:0/3124391411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582c9e365c0 0x5582c9e43270 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.496+0000 7f3a4bcc1740 1 --2- 172.21.15.17:0/3124391411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582c9e35c80 0x5582c9e42d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.496+0000 7f3a23e00640 0 client.25976 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:05:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.496+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/3124391411 >> 172.21.15.17:0/3124391411 conn(0x5582c9e312f0 msgr2=0x5582c9e3a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.496+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/3124391411 shutdown_connections 2024-09-13T16:05:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.496+0000 7f3a4bcc1740 1 -- 172.21.15.17:0/3124391411 wait complete. 2024-09-13T16:05:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.497+0000 7f3a4bcc1740 20 client.25976 trim_cache size 0 max 16384 2024-09-13T16:05:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:05:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:05:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:05:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:05:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.497+0000 7f3a43200640 1 -- 172.21.15.17:0/2599648496 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3a280a12f0 msgr2=0x7f3a280a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.497+0000 7f3a43200640 1 --2- 172.21.15.17:0/2599648496 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3a280a12f0 0x7f3a280a37b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c0a2540 tx=0x7f3a3c0185a0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.498+0000 7f3a43200640 1 -- 172.21.15.17:0/2599648496 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a44100140 msgr2=0x7f3a4419af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:05:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.498+0000 7f3a43200640 1 --2- 172.21.15.17:0/2599648496 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a44100140 0x7f3a4419af50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00cce0 tx=0x7f3a3c00a620 comp rx=0 tx=0).stop 2024-09-13T16:05:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.498+0000 7f3a43200640 1 -- 172.21.15.17:0/2599648496 shutdown_connections 2024-09-13T16:05:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.498+0000 7f3a43200640 1 --2- 172.21.15.17:0/2599648496 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f3a280a12f0 0x7f3a280a37b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.498+0000 7f3a43200640 1 --2- 172.21.15.17:0/2599648496 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a44100140 0x7f3a4419af50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.498+0000 7f3a43200640 1 --2- 172.21.15.17:0/2599648496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a440ff030 0x7f3a44193f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.498+0000 7f3a43200640 1 --2- 172.21.15.17:0/2599648496 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a440fe670 0x7f3a441939f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:05:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.498+0000 7f3a43200640 1 -- 172.21.15.17:0/2599648496 >> 172.21.15.17:0/2599648496 conn(0x7f3a440fa1c0 msgr2=0x7f3a44100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:05:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.498+0000 7f3a43200640 1 -- 172.21.15.17:0/2599648496 shutdown_connections 2024-09-13T16:05:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:05:53.498+0000 7f3a43200640 1 -- 172.21.15.17:0/2599648496 wait complete. 2024-09-13T16:05:54.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:53 smithi193 ceph-mon[35248]: pgmap v629: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 8.1 MiB/s wr, 850 op/s 2024-09-13T16:05:54.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:53 smithi017 ceph-mon[30494]: pgmap v629: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 8.1 MiB/s wr, 850 op/s 2024-09-13T16:05:54.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:53 smithi189 ceph-mon[34790]: pgmap v629: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 8.1 MiB/s wr, 850 op/s 2024-09-13T16:05:55.315 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 490.0 s, 512.8 tps, lat 193.729 ms stddev 232.581 2024-09-13T16:05:56.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:55 smithi193 ceph-mon[35248]: pgmap v630: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 7.1 MiB/s wr, 769 op/s 2024-09-13T16:05:56.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:55 smithi017 ceph-mon[30494]: pgmap v630: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 7.1 MiB/s wr, 769 op/s 2024-09-13T16:05:56.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:55 smithi189 ceph-mon[34790]: pgmap v630: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 7.1 MiB/s wr, 769 op/s 2024-09-13T16:05:58.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:57 smithi193 ceph-mon[35248]: pgmap v631: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 5.8 MiB/s wr, 631 op/s 2024-09-13T16:05:58.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:57 smithi017 ceph-mon[30494]: pgmap v631: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 5.8 MiB/s wr, 631 op/s 2024-09-13T16:05:58.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:57 smithi189 ceph-mon[34790]: pgmap v631: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 5.8 MiB/s wr, 631 op/s 2024-09-13T16:06:00.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:05:59 smithi193 ceph-mon[35248]: pgmap v632: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.4 MiB/s wr, 485 op/s 2024-09-13T16:06:00.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:05:59 smithi017 ceph-mon[30494]: pgmap v632: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.4 MiB/s wr, 485 op/s 2024-09-13T16:06:00.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 495.0 s, 500.0 tps, lat 186.179 ms stddev 215.276 2024-09-13T16:06:00.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:05:59 smithi189 ceph-mon[34790]: pgmap v632: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.4 MiB/s wr, 485 op/s 2024-09-13T16:06:02.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:01 smithi193 ceph-mon[35248]: pgmap v633: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.6 MiB/s wr, 522 op/s 2024-09-13T16:06:02.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:01 smithi017 ceph-mon[30494]: pgmap v633: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.6 MiB/s wr, 522 op/s 2024-09-13T16:06:02.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:01 smithi189 ceph-mon[34790]: pgmap v633: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.6 MiB/s wr, 522 op/s 2024-09-13T16:06:04.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:03 smithi193 ceph-mon[35248]: pgmap v634: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.4 MiB/s wr, 483 op/s 2024-09-13T16:06:04.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:03 smithi017 ceph-mon[30494]: pgmap v634: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.4 MiB/s wr, 483 op/s 2024-09-13T16:06:04.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:03 smithi189 ceph-mon[34790]: pgmap v634: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.4 MiB/s wr, 483 op/s 2024-09-13T16:06:05.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 500.0 s, 659.0 tps, lat 163.020 ms stddev 209.188 2024-09-13T16:06:06.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:05 smithi193 ceph-mon[35248]: pgmap v635: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.4 MiB/s wr, 492 op/s 2024-09-13T16:06:06.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:05 smithi017 ceph-mon[30494]: pgmap v635: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.4 MiB/s wr, 492 op/s 2024-09-13T16:06:06.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:05 smithi189 ceph-mon[34790]: pgmap v635: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.4 MiB/s wr, 492 op/s 2024-09-13T16:06:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.690+0000 7f8f72a00640 1 -- 172.21.15.17:0/772502879 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f6c102f10 msgr2=0x7f8f6c105300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.690+0000 7f8f72a00640 1 --2- 172.21.15.17:0/772502879 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f6c102f10 0x7f8f6c105300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009900 tx=0x7f8f6002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.691+0000 7f8f72a00640 1 -- 172.21.15.17:0/772502879 shutdown_connections 2024-09-13T16:06:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.691+0000 7f8f72a00640 1 --2- 172.21.15.17:0/772502879 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f6c105920 0x7f8f6c107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.691+0000 7f8f72a00640 1 --2- 172.21.15.17:0/772502879 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f6c102f10 0x7f8f6c105300 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.691+0000 7f8f72a00640 1 --2- 172.21.15.17:0/772502879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f6c1005e0 0x7f8f6c1029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.691+0000 7f8f72a00640 1 -- 172.21.15.17:0/772502879 >> 172.21.15.17:0/772502879 conn(0x7f8f6c0fa1c0 msgr2=0x7f8f6c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.691+0000 7f8f72a00640 1 -- 172.21.15.17:0/772502879 shutdown_connections 2024-09-13T16:06:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.691+0000 7f8f72a00640 1 -- 172.21.15.17:0/772502879 wait complete. 2024-09-13T16:06:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.693+0000 7f8f72a00640 1 Processor -- start 2024-09-13T16:06:06.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.693+0000 7f8f72a00640 1 -- start start 2024-09-13T16:06:06.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.694+0000 7f8f72a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f6c1005e0 0x7f8f6c195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:06.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.694+0000 7f8f72a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f6c102f10 0x7f8f6c1962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:06.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.694+0000 7f8f72a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f6c105920 0x7f8f6c19d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:06.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.695+0000 7f8f70c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f6c102f10 0x7f8f6c1962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:06.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.695+0000 7f8f70c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f6c102f10 0x7f8f6c1962a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:44796/0 (socket says 172.21.15.17:44796) 2024-09-13T16:06:06.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.695+0000 7f8f70c00640 1 -- 172.21.15.17:0/2241412583 learned_addr learned my addr 172.21.15.17:0/2241412583 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:06:06.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.695+0000 7f8f72000640 1 --2- 172.21.15.17:0/2241412583 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f6c105920 0x7f8f6c19d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:06.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.696+0000 7f8f72a00640 1 -- 172.21.15.17:0/2241412583 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c19d850 con 0x7f8f6c1005e0 2024-09-13T16:06:06.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.696+0000 7f8f72a00640 1 -- 172.21.15.17:0/2241412583 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c19d9c0 con 0x7f8f6c102f10 2024-09-13T16:06:06.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.696+0000 7f8f72a00640 1 -- 172.21.15.17:0/2241412583 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c19db80 con 0x7f8f6c105920 2024-09-13T16:06:06.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.696+0000 7f8f71600640 1 --2- 172.21.15.17:0/2241412583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f6c1005e0 0x7f8f6c195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:06.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.697+0000 7f8f70c00640 1 -- 172.21.15.17:0/2241412583 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f6c105920 msgr2=0x7f8f6c19d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:06.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.697+0000 7f8f70c00640 1 --2- 172.21.15.17:0/2241412583 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f6c105920 0x7f8f6c19d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.697+0000 7f8f70c00640 1 -- 172.21.15.17:0/2241412583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f6c1005e0 msgr2=0x7f8f6c195d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:06.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.697+0000 7f8f70c00640 1 --2- 172.21.15.17:0/2241412583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f6c1005e0 0x7f8f6c195d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.697+0000 7f8f70c00640 1 -- 172.21.15.17:0/2241412583 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f60009560 con 0x7f8f6c102f10 2024-09-13T16:06:06.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.697+0000 7f8f72000640 1 --2- 172.21.15.17:0/2241412583 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f6c105920 0x7f8f6c19d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:06:06.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.698+0000 7f8f70c00640 1 --2- 172.21.15.17:0/2241412583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f6c102f10 0x7f8f6c1962a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8f60031500 tx=0x7f8f60003d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:06.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.698+0000 7f8f6a000640 1 -- 172.21.15.17:0/2241412583 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f600317b0 con 0x7f8f6c102f10 2024-09-13T16:06:06.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.698+0000 7f8f72a00640 1 -- 172.21.15.17:0/2241412583 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6c19de00 con 0x7f8f6c102f10 2024-09-13T16:06:06.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.698+0000 7f8f6a000640 1 -- 172.21.15.17:0/2241412583 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f60031dd0 con 0x7f8f6c102f10 2024-09-13T16:06:06.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.698+0000 7f8f6a000640 1 -- 172.21.15.17:0/2241412583 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6003a3c0 con 0x7f8f6c102f10 2024-09-13T16:06:06.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.703+0000 7f8f72a00640 1 -- 172.21.15.17:0/2241412583 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6c0fe3d0 con 0x7f8f6c102f10 2024-09-13T16:06:06.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.704+0000 7f8f6a000640 1 -- 172.21.15.17:0/2241412583 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8f60031910 con 0x7f8f6c102f10 2024-09-13T16:06:06.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.709+0000 7f8f6a000640 1 --2- 172.21.15.17:0/2241412583 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8f540a55c0 0x7f8f540a7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:06.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.709+0000 7f8f6a000640 1 -- 172.21.15.17:0/2241412583 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f8f600f0170 con 0x7f8f6c102f10 2024-09-13T16:06:06.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.710+0000 7f8f76e51740 1 Processor -- start 2024-09-13T16:06:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.710+0000 7f8f76e51740 1 -- start start 2024-09-13T16:06:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.711+0000 7f8f76e51740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e55ec80 0x56322e55f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.711+0000 7f8f76e51740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56322e55f5c0 0x56322e564080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.711+0000 7f8f76e51740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56322e564650 0x56322e566b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.711+0000 7f8f76e51740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56322e46abb0 con 0x56322e55f5c0 2024-09-13T16:06:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.711+0000 7f8f72000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56322e564650 0x56322e566b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.711+0000 7f8f72000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56322e564650 0x56322e566b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:53334/0 (socket says 172.21.15.17:53334) 2024-09-13T16:06:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.711+0000 7f8f72000640 1 -- 172.21.15.17:0/2046996859 learned_addr learned my addr 172.21.15.17:0/2046996859 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:06:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.712+0000 7f8f76e51740 1 -- 172.21.15.17:0/2046996859 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x56322e4c8a70 con 0x56322e55ec80 2024-09-13T16:06:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.712+0000 7f8f70c00640 1 --2- 172.21.15.17:0/2046996859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56322e55f5c0 0x56322e564080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:06.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.712+0000 7f8f76e51740 1 -- 172.21.15.17:0/2046996859 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x56322e4c6200 con 0x56322e564650 2024-09-13T16:06:06.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.712+0000 7f8f71600640 1 --2- 172.21.15.17:0/2241412583 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8f540a55c0 0x7f8f540a7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:06.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.712+0000 7f8f71600640 1 --2- 172.21.15.17:0/2046996859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e55ec80 0x56322e55f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.713+0000 7f8f70c00640 1 -- 172.21.15.17:0/2046996859 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56322e564650 msgr2=0x56322e566b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.713+0000 7f8f70c00640 1 --2- 172.21.15.17:0/2046996859 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56322e564650 0x56322e566b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.713+0000 7f8f70c00640 1 -- 172.21.15.17:0/2046996859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e55ec80 msgr2=0x56322e55f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.713+0000 7f8f70c00640 1 --2- 172.21.15.17:0/2046996859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e55ec80 0x56322e55f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.713+0000 7f8f70c00640 1 -- 172.21.15.17:0/2046996859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56322e463940 con 0x56322e55f5c0 2024-09-13T16:06:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.713+0000 7f8f70c00640 1 --2- 172.21.15.17:0/2046996859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56322e55f5c0 0x56322e564080 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c19db50 tx=0x7f8f6002a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef84d658361b142 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:06.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.714+0000 7f8f5ea00640 1 -- 172.21.15.17:0/2046996859 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f600b9d20 con 0x56322e55f5c0 2024-09-13T16:06:06.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.714+0000 7f8f5ea00640 1 -- 172.21.15.17:0/2046996859 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f600bdb50 con 0x56322e55f5c0 2024-09-13T16:06:06.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.714+0000 7f8f71600640 1 --2- 172.21.15.17:0/2241412583 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8f540a55c0 0x7f8f540a7a80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009440 tx=0x7f8f640098a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:06.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.714+0000 7f8f5ea00640 1 -- 172.21.15.17:0/2046996859 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f600c1d10 con 0x56322e55f5c0 2024-09-13T16:06:06.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.715+0000 7f8f76e51740 1 -- 172.21.15.17:0/2046996859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56322e55f5c0 msgr2=0x56322e564080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:06.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.715+0000 7f8f76e51740 1 --2- 172.21.15.17:0/2046996859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56322e55f5c0 0x56322e564080 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c19db50 tx=0x7f8f6002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.717+0000 7f8f76e51740 1 -- 172.21.15.17:0/2046996859 shutdown_connections 2024-09-13T16:06:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.717+0000 7f8f76e51740 1 --2- 172.21.15.17:0/2046996859 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56322e564650 0x56322e566b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.717+0000 7f8f76e51740 1 --2- 172.21.15.17:0/2046996859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56322e55f5c0 0x56322e564080 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.717+0000 7f8f76e51740 1 --2- 172.21.15.17:0/2046996859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e55ec80 0x56322e55f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.717+0000 7f8f76e51740 1 -- 172.21.15.17:0/2046996859 >> 172.21.15.17:0/2046996859 conn(0x56322e55a2f0 msgr2=0x56322e55a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:06.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.717+0000 7f8f76e51740 1 -- 172.21.15.17:0/2046996859 shutdown_connections 2024-09-13T16:06:06.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.717+0000 7f8f76e51740 1 -- 172.21.15.17:0/2046996859 wait complete. 2024-09-13T16:06:06.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.718+0000 7f8f76e51740 1 -- start start 2024-09-13T16:06:06.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.718+0000 7f8f76e51740 1 Processor -- start 2024-09-13T16:06:06.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.719+0000 7f8f76e51740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56322e55ec80 0x56322e570ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:06.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.719+0000 7f8f76e51740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56322e55f5c0 0x56322e5713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:06.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.719+0000 7f8f76e51740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e564650 0x56322e578420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:06.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.720+0000 7f8f76e51740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56322e4c1af0 con 0x56322e55f5c0 2024-09-13T16:06:06.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.720+0000 7f8f76e51740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x56322e47ff20 con 0x56322e564650 2024-09-13T16:06:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.720+0000 7f8f72000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e564650 0x56322e578420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.720+0000 7f8f72000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e564650 0x56322e578420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:44810/0 (socket says 172.21.15.17:44810) 2024-09-13T16:06:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.720+0000 7f8f72000640 1 -- 172.21.15.17:0/1429591374 learned_addr learned my addr 172.21.15.17:0/1429591374 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:06:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.720+0000 7f8f71600640 1 --2- 172.21.15.17:0/1429591374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56322e55ec80 0x56322e570ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.720+0000 7f8f76e51740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x56322e47fbc0 con 0x56322e55ec80 2024-09-13T16:06:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.721+0000 7f8f72000640 1 -- 172.21.15.17:0/1429591374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56322e55ec80 msgr2=0x56322e570ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.721+0000 7f8f72000640 1 --2- 172.21.15.17:0/1429591374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56322e55ec80 0x56322e570ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.721+0000 7f8f72000640 1 -- 172.21.15.17:0/1429591374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56322e55f5c0 msgr2=0x56322e5713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:06.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.721+0000 7f8f72000640 1 --2- 172.21.15.17:0/1429591374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56322e55f5c0 0x56322e5713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.721+0000 7f8f72000640 1 -- 172.21.15.17:0/1429591374 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6c0fe3d0 con 0x56322e564650 2024-09-13T16:06:06.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.721+0000 7f8f76e51740 10 client.0 _ll_register_callbacks cb 0x56322e4b1a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:06:06.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.721+0000 7f8f76e51740 1 -- 172.21.15.17:0/1429591374 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56322e4ebc90 con 0x56322e564650 2024-09-13T16:06:06.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.721+0000 7f8f72000640 1 --2- 172.21.15.17:0/1429591374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e564650 0x56322e578420 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8f580118e0 tx=0x7f8f58011da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d023f8669287f60 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:06.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.721+0000 7f8f53400640 10 client.25988 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:06:06.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.722+0000 7f8f53400640 1 -- 172.21.15.17:0/1429591374 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5800faf0 con 0x56322e564650 2024-09-13T16:06:06.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.722+0000 7f8f53400640 1 -- 172.21.15.17:0/1429591374 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f8f5800fc50 con 0x56322e564650 2024-09-13T16:06:06.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.722+0000 7f8f53400640 1 -- 172.21.15.17:0/1429591374 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f5800fe70 con 0x56322e564650 2024-09-13T16:06:06.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.722+0000 7f8f76e51740 10 client.25988 fetch_fsmap learned FSMap version 41 2024-09-13T16:06:06.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.722+0000 7f8f76e51740 1 -- 172.21.15.17:0/1429591374 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({fsmap=41}) v3 -- 0x56322e4c0170 con 0x56322e564650 2024-09-13T16:06:06.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.722+0000 7f8f53400640 1 -- 172.21.15.17:0/1429591374 <== mon.2 v2:172.21.15.189:3300/0 4 ==== fsmap(e 41) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f8f5801b020 con 0x56322e564650 2024-09-13T16:06:06.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.723+0000 7f8f76e51740 10 client.25988 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T16:06:06.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.723+0000 7f8f76e51740 10 client.25988 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:06:06.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.723+0000 7f8f76e51740 20 client.25988 populate_metadata read hostname 'smithi017' 2024-09-13T16:06:06.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.723+0000 7f8f76e51740 1 --2- 172.21.15.17:0/1429591374 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56322e57ca70 0x56322e57ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:06.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.723+0000 7f8f76e51740 4 client.25988 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:06:06.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.723+0000 7f8f76e51740 1 -- 172.21.15.17:0/1429591374 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56322e4b47d0 con 0x56322e57ca70 2024-09-13T16:06:06.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.724+0000 7f8f71600640 1 --2- 172.21.15.17:0/1429591374 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56322e57ca70 0x56322e57ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:06.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.725+0000 7f8f71600640 1 --2- 172.21.15.17:0/1429591374 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56322e57ca70 0x56322e57ee90 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc0c0cfba623d4fd server_cookie=94df125a2ee201e9 in_seq=0 out_seq=0 2024-09-13T16:06:06.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.725+0000 7f8f53400640 10 client.25988 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:06:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.726+0000 7f8f53400640 1 -- 172.21.15.17:0/1429591374 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56322e4b47d0 con 0x56322e57ca70 2024-09-13T16:06:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.726+0000 7f8f53400640 10 client.25988 handle_command_reply: tid=0 2024-09-13T16:06:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.726+0000 7f8f76e51740 1 client.25988 shutdown 2024-09-13T16:06:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.729+0000 7f8f76e51740 1 -- 172.21.15.17:0/1429591374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e564650 msgr2=0x56322e578420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.729+0000 7f8f76e51740 1 --2- 172.21.15.17:0/1429591374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e564650 0x56322e578420 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8f580118e0 tx=0x7f8f58011da0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.729+0000 7f8f76e51740 1 -- 172.21.15.17:0/1429591374 shutdown_connections 2024-09-13T16:06:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.729+0000 7f8f76e51740 1 --2- 172.21.15.17:0/1429591374 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56322e57ca70 0x56322e57ee90 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.729+0000 7f8f76e51740 1 --2- 172.21.15.17:0/1429591374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e564650 0x56322e578420 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.729+0000 7f8f76e51740 1 --2- 172.21.15.17:0/1429591374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56322e55f5c0 0x56322e5713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.729+0000 7f8f76e51740 1 --2- 172.21.15.17:0/1429591374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56322e55ec80 0x56322e570ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.729+0000 7f8f76e51740 1 -- 172.21.15.17:0/1429591374 >> 172.21.15.17:0/1429591374 conn(0x56322e55a2f0 msgr2=0x56322e55bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:06.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.729+0000 7f8f53400640 0 client.25988 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:06:06.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.729+0000 7f8f76e51740 1 -- 172.21.15.17:0/1429591374 shutdown_connections 2024-09-13T16:06:06.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.730+0000 7f8f76e51740 1 -- 172.21.15.17:0/1429591374 wait complete. 2024-09-13T16:06:06.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.730+0000 7f8f76e51740 20 client.25988 trim_cache size 0 max 16384 2024-09-13T16:06:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.764+0000 7f8f76e51740 1 Processor -- start 2024-09-13T16:06:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.766+0000 7f8f76e51740 1 -- start start 2024-09-13T16:06:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.766+0000 7f8f76e51740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56322e55ec80 0x56322e560540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.766+0000 7f8f76e51740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56322e55f5c0 0x56322e560a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.766+0000 7f8f76e51740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e564650 0x56322e5783e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.766+0000 7f8f76e51740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56322e228e60 con 0x56322e55ec80 2024-09-13T16:06:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.766+0000 7f8f76e51740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x56322e4b47d0 con 0x56322e564650 2024-09-13T16:06:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.766+0000 7f8f76e51740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x56322e55f9a0 con 0x56322e55f5c0 2024-09-13T16:06:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.768+0000 7f8f72000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e564650 0x56322e5783e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:06.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.768+0000 7f8f70c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56322e55f5c0 0x56322e560a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:06.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.768+0000 7f8f72000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e564650 0x56322e5783e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:44812/0 (socket says 172.21.15.17:44812) 2024-09-13T16:06:06.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.768+0000 7f8f72000640 1 -- 172.21.15.17:0/2630406164 learned_addr learned my addr 172.21.15.17:0/2630406164 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:06:06.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.768+0000 7f8f72000640 1 -- 172.21.15.17:0/2630406164 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56322e55f5c0 msgr2=0x56322e560a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:06.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.768+0000 7f8f72000640 1 --2- 172.21.15.17:0/2630406164 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56322e55f5c0 0x56322e560a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.768+0000 7f8f72000640 1 -- 172.21.15.17:0/2630406164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56322e55ec80 msgr2=0x56322e560540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:06.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.768+0000 7f8f72000640 1 --2- 172.21.15.17:0/2630406164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56322e55ec80 0x56322e560540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.768+0000 7f8f72000640 1 -- 172.21.15.17:0/2630406164 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56322e462180 con 0x56322e564650 2024-09-13T16:06:06.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.769+0000 7f8f72000640 1 --2- 172.21.15.17:0/2630406164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e564650 0x56322e5783e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8f58011de0 tx=0x7f8f58016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17ddc7b3e34d302a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:06.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.770+0000 7f8f5f400640 1 -- 172.21.15.17:0/2630406164 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5800fcf0 con 0x56322e564650 2024-09-13T16:06:06.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.770+0000 7f8f5f400640 1 -- 172.21.15.17:0/2630406164 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56322e4ebc90 con 0x56322e564650 2024-09-13T16:06:06.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.770+0000 7f8f5f400640 1 -- 172.21.15.17:0/2630406164 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f58014ac0 con 0x56322e564650 2024-09-13T16:06:06.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.772+0000 7f8f76e51740 1 -- 172.21.15.17:0/2630406164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e564650 msgr2=0x56322e5783e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:06.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.772+0000 7f8f76e51740 1 --2- 172.21.15.17:0/2630406164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e564650 0x56322e5783e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8f58011de0 tx=0x7f8f58016000 comp rx=0 tx=0).stop 2024-09-13T16:06:06.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.773+0000 7f8f76e51740 1 -- 172.21.15.17:0/2630406164 shutdown_connections 2024-09-13T16:06:06.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.773+0000 7f8f76e51740 1 --2- 172.21.15.17:0/2630406164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e564650 0x56322e5783e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.773+0000 7f8f76e51740 1 --2- 172.21.15.17:0/2630406164 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56322e55f5c0 0x56322e560a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.773+0000 7f8f76e51740 1 --2- 172.21.15.17:0/2630406164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56322e55ec80 0x56322e560540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.773+0000 7f8f76e51740 1 -- 172.21.15.17:0/2630406164 >> 172.21.15.17:0/2630406164 conn(0x56322e55a2f0 msgr2=0x56322e570ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:06.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.773+0000 7f8f76e51740 1 -- 172.21.15.17:0/2630406164 shutdown_connections 2024-09-13T16:06:06.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.773+0000 7f8f76e51740 1 -- 172.21.15.17:0/2630406164 wait complete. 2024-09-13T16:06:06.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.774+0000 7f8f76e51740 1 -- start start 2024-09-13T16:06:06.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.774+0000 7f8f76e51740 1 Processor -- start 2024-09-13T16:06:06.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.775+0000 7f8f76e51740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56322e55ec80 0x56322e575150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:06.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.775+0000 7f8f76e51740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e55f5c0 0x56322e575690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:06.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.776+0000 7f8f76e51740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56322e564650 0x56322e56b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:06.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.776+0000 7f8f70c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e55f5c0 0x56322e575690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:06.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.776+0000 7f8f70c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e55f5c0 0x56322e575690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:44814/0 (socket says 172.21.15.17:44814) 2024-09-13T16:06:06.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.776+0000 7f8f70c00640 1 -- 172.21.15.17:0/1543915288 learned_addr learned my addr 172.21.15.17:0/1543915288 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:06:06.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.776+0000 7f8f76e51740 1 -- 172.21.15.17:0/1543915288 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56322e575c50 con 0x56322e55ec80 2024-09-13T16:06:06.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.776+0000 7f8f76e51740 1 -- 172.21.15.17:0/1543915288 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x56322e575dc0 con 0x56322e55f5c0 2024-09-13T16:06:06.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.776+0000 7f8f76e51740 1 -- 172.21.15.17:0/1543915288 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x56322e56bbe0 con 0x56322e564650 2024-09-13T16:06:06.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.777+0000 7f8f76e51740 10 client.0 _ll_register_callbacks cb 0x7f8f600ef070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:06:06.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.777+0000 7f8f70c00640 1 -- 172.21.15.17:0/1543915288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56322e564650 msgr2=0x56322e56b620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:06:06.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.777+0000 7f8f70c00640 1 --2- 172.21.15.17:0/1543915288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56322e564650 0x56322e56b620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.777+0000 7f8f70c00640 1 -- 172.21.15.17:0/1543915288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56322e55ec80 msgr2=0x56322e575150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:06.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.777+0000 7f8f70c00640 1 --2- 172.21.15.17:0/1543915288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56322e55ec80 0x56322e575150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.777+0000 7f8f70c00640 1 -- 172.21.15.17:0/1543915288 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56322e4c0170 con 0x56322e55f5c0 2024-09-13T16:06:06.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.778+0000 7f8f70c00640 1 --2- 172.21.15.17:0/1543915288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e55f5c0 0x56322e575690 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8f600b6790 tx=0x7f8f600b9700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20da6849428338f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:06.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.778+0000 7f8f53400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:06:06.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.778+0000 7f8f53400640 1 -- 172.21.15.17:0/1543915288 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f600c21a0 con 0x56322e55f5c0 2024-09-13T16:06:06.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.778+0000 7f8f53400640 1 -- 172.21.15.17:0/1543915288 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f8f600b6430 con 0x56322e55f5c0 2024-09-13T16:06:06.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.779+0000 7f8f76e51740 1 -- 172.21.15.17:0/1543915288 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f600bdb50 con 0x56322e55f5c0 2024-09-13T16:06:06.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.780+0000 7f8f53400640 1 -- 172.21.15.17:0/1543915288 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f600b65f0 con 0x56322e55f5c0 2024-09-13T16:06:06.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.780+0000 7f8f76e51740 10 client.25994 fetch_fsmap learned FSMap version 41 2024-09-13T16:06:06.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.780+0000 7f8f76e51740 1 -- 172.21.15.17:0/1543915288 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x56322e487560 con 0x56322e55f5c0 2024-09-13T16:06:06.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.780+0000 7f8f53400640 1 -- 172.21.15.17:0/1543915288 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f600c6080 con 0x56322e55f5c0 2024-09-13T16:06:06.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.781+0000 7f8f53400640 1 -- 172.21.15.17:0/1543915288 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 41) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f8f600b8c80 con 0x56322e55f5c0 2024-09-13T16:06:06.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.781+0000 7f8f76e51740 10 client.25994 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T16:06:06.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.781+0000 7f8f76e51740 10 client.25994 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:06:06.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.781+0000 7f8f76e51740 20 client.25994 populate_metadata read hostname 'smithi017' 2024-09-13T16:06:06.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.781+0000 7f8f76e51740 1 --2- 172.21.15.17:0/1543915288 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56322e56d440 0x56322e56f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:06.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.781+0000 7f8f76e51740 4 client.25994 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:06:06.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.781+0000 7f8f76e51740 1 -- 172.21.15.17:0/1543915288 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56322e1b5300 con 0x56322e56d440 2024-09-13T16:06:06.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.782+0000 7f8f71600640 1 --2- 172.21.15.17:0/1543915288 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56322e56d440 0x56322e56f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:06.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.783+0000 7f8f71600640 1 --2- 172.21.15.17:0/1543915288 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56322e56d440 0x56322e56f860 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=647cb1efdb1aad0c server_cookie=dab6da4aca92eb84 in_seq=0 out_seq=0 2024-09-13T16:06:06.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.783+0000 7f8f53400640 10 client.25994 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:06:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.792+0000 7f8f53400640 1 -- 172.21.15.17:0/1543915288 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56322e1b5300 con 0x56322e56d440 2024-09-13T16:06:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.792+0000 7f8f53400640 10 client.25994 handle_command_reply: tid=0 2024-09-13T16:06:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.792+0000 7f8f76e51740 1 client.25994 shutdown 2024-09-13T16:06:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.792+0000 7f8f76e51740 1 -- 172.21.15.17:0/1543915288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e55f5c0 msgr2=0x56322e575690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.792+0000 7f8f76e51740 1 --2- 172.21.15.17:0/1543915288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e55f5c0 0x56322e575690 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8f600b6790 tx=0x7f8f600b9700 comp rx=0 tx=0).stop 2024-09-13T16:06:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.793+0000 7f8f76e51740 1 -- 172.21.15.17:0/1543915288 shutdown_connections 2024-09-13T16:06:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.793+0000 7f8f76e51740 1 --2- 172.21.15.17:0/1543915288 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56322e56d440 0x56322e56f860 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.793+0000 7f8f76e51740 1 --2- 172.21.15.17:0/1543915288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56322e564650 0x56322e56b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.793+0000 7f8f76e51740 1 --2- 172.21.15.17:0/1543915288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56322e55f5c0 0x56322e575690 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.793+0000 7f8f76e51740 1 --2- 172.21.15.17:0/1543915288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56322e55ec80 0x56322e575150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.793+0000 7f8f76e51740 1 -- 172.21.15.17:0/1543915288 >> 172.21.15.17:0/1543915288 conn(0x56322e55a2f0 msgr2=0x56322e570e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:06.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.793+0000 7f8f53400640 0 client.25994 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:06:06.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.793+0000 7f8f76e51740 1 -- 172.21.15.17:0/1543915288 shutdown_connections 2024-09-13T16:06:06.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.793+0000 7f8f76e51740 1 -- 172.21.15.17:0/1543915288 wait complete. 2024-09-13T16:06:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.800+0000 7f8f76e51740 20 client.25994 trim_cache size 0 max 16384 2024-09-13T16:06:06.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:06:06.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:06:06.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:06:06.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:06:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.804+0000 7f8f72a00640 1 -- 172.21.15.17:0/2241412583 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8f540a55c0 msgr2=0x7f8f540a7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.804+0000 7f8f72a00640 1 --2- 172.21.15.17:0/2241412583 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8f540a55c0 0x7f8f540a7a80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009440 tx=0x7f8f640098a0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.804+0000 7f8f72a00640 1 -- 172.21.15.17:0/2241412583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f6c102f10 msgr2=0x7f8f6c1962a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.804+0000 7f8f72a00640 1 --2- 172.21.15.17:0/2241412583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f6c102f10 0x7f8f6c1962a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8f60031500 tx=0x7f8f60003d50 comp rx=0 tx=0).stop 2024-09-13T16:06:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.804+0000 7f8f72a00640 1 -- 172.21.15.17:0/2241412583 shutdown_connections 2024-09-13T16:06:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.804+0000 7f8f72a00640 1 --2- 172.21.15.17:0/2241412583 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8f540a55c0 0x7f8f540a7a80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.804+0000 7f8f72a00640 1 --2- 172.21.15.17:0/2241412583 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f6c105920 0x7f8f6c19d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.804+0000 7f8f72a00640 1 --2- 172.21.15.17:0/2241412583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f6c102f10 0x7f8f6c1962a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.804+0000 7f8f72a00640 1 --2- 172.21.15.17:0/2241412583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f6c1005e0 0x7f8f6c195d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.804+0000 7f8f72a00640 1 -- 172.21.15.17:0/2241412583 >> 172.21.15.17:0/2241412583 conn(0x7f8f6c0fa1c0 msgr2=0x7f8f6c100f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.804+0000 7f8f72a00640 1 -- 172.21.15.17:0/2241412583 shutdown_connections 2024-09-13T16:06:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:06.804+0000 7f8f72a00640 1 -- 172.21.15.17:0/2241412583 wait complete. 2024-09-13T16:06:07.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:06 smithi193 ceph-mon[35248]: pgmap v636: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.6 MiB/s wr, 509 op/s 2024-09-13T16:06:07.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:06 smithi017 ceph-mon[30494]: pgmap v636: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.6 MiB/s wr, 509 op/s 2024-09-13T16:06:07.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:06 smithi189 ceph-mon[34790]: pgmap v636: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.6 MiB/s wr, 509 op/s 2024-09-13T16:06:09.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:09 smithi189 ceph-mon[34790]: pgmap v637: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.2 MiB/s wr, 479 op/s 2024-09-13T16:06:10.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:09 smithi193 ceph-mon[35248]: pgmap v637: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.2 MiB/s wr, 479 op/s 2024-09-13T16:06:10.014 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:09 smithi017 ceph-mon[30494]: pgmap v637: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.2 MiB/s wr, 479 op/s 2024-09-13T16:06:10.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 505.0 s, 618.6 tps, lat 161.750 ms stddev 186.084 2024-09-13T16:06:11.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:11 smithi189 ceph-mon[34790]: pgmap v638: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.2 MiB/s wr, 568 op/s 2024-09-13T16:06:12.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:11 smithi193 ceph-mon[35248]: pgmap v638: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.2 MiB/s wr, 568 op/s 2024-09-13T16:06:12.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:11 smithi017 ceph-mon[30494]: pgmap v638: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.2 MiB/s wr, 568 op/s 2024-09-13T16:06:13.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:13 smithi189 ceph-mon[34790]: pgmap v639: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 4.1 MiB/s wr, 468 op/s 2024-09-13T16:06:13.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:13 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:06:14.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:13 smithi193 ceph-mon[35248]: pgmap v639: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 4.1 MiB/s wr, 468 op/s 2024-09-13T16:06:14.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:13 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:06:14.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:13 smithi017 ceph-mon[30494]: pgmap v639: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 4.1 MiB/s wr, 468 op/s 2024-09-13T16:06:14.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:13 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:06:14.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:14 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:14.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:14 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:06:14.857 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:14 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:06:15.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:14 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:15.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:14 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:06:15.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:14 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:06:15.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:14 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:06:15.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:14 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:06:15.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:14 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:06:15.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 510.0 s, 490.6 tps, lat 198.722 ms stddev 233.795 2024-09-13T16:06:15.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:15 smithi189 ceph-mon[34790]: pgmap v640: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 4.5 MiB/s wr, 511 op/s 2024-09-13T16:06:16.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:15 smithi193 ceph-mon[35248]: pgmap v640: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 4.5 MiB/s wr, 511 op/s 2024-09-13T16:06:16.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:15 smithi017 ceph-mon[30494]: pgmap v640: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 4.5 MiB/s wr, 511 op/s 2024-09-13T16:06:17.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:17 smithi189 ceph-mon[34790]: pgmap v641: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.0 MiB/s wr, 563 op/s 2024-09-13T16:06:18.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:17 smithi193 ceph-mon[35248]: pgmap v641: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.0 MiB/s wr, 563 op/s 2024-09-13T16:06:18.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:17 smithi017 ceph-mon[30494]: pgmap v641: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.0 MiB/s wr, 563 op/s 2024-09-13T16:06:19.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:19 smithi189 ceph-mon[34790]: pgmap v642: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 4.8 MiB/s wr, 540 op/s 2024-09-13T16:06:20.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:19 smithi193 ceph-mon[35248]: pgmap v642: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 4.8 MiB/s wr, 540 op/s 2024-09-13T16:06:20.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:19 smithi017 ceph-mon[30494]: pgmap v642: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 4.8 MiB/s wr, 540 op/s 2024-09-13T16:06:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.025+0000 7fe903e00640 1 -- 172.21.15.17:0/3160856832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe904102f60 msgr2=0x7fe9041033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.025+0000 7fe903e00640 1 --2- 172.21.15.17:0/3160856832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe904102f60 0x7fe9041033e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec009ca0 tx=0x7fe8ec02a8d0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.028+0000 7fe903e00640 1 -- 172.21.15.17:0/3160856832 shutdown_connections 2024-09-13T16:06:20.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.028+0000 7fe903e00640 1 --2- 172.21.15.17:0/3160856832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe904103920 0x7fe90410a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.028+0000 7fe903e00640 1 --2- 172.21.15.17:0/3160856832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe904102f60 0x7fe9041033e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.028+0000 7fe903e00640 1 --2- 172.21.15.17:0/3160856832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe904101d70 0x7fe904102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.028+0000 7fe903e00640 1 -- 172.21.15.17:0/3160856832 >> 172.21.15.17:0/3160856832 conn(0x7fe9040fd510 msgr2=0x7fe9040ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.029+0000 7fe903e00640 1 -- 172.21.15.17:0/3160856832 shutdown_connections 2024-09-13T16:06:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.029+0000 7fe903e00640 1 -- 172.21.15.17:0/3160856832 wait complete. 2024-09-13T16:06:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.030+0000 7fe903e00640 1 Processor -- start 2024-09-13T16:06:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.030+0000 7fe903e00640 1 -- start start 2024-09-13T16:06:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.031+0000 7fe903e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe904101d70 0x7fe904197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.031+0000 7fe903e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe904102f60 0x7fe9041983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.031+0000 7fe903e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe904103920 0x7fe90419f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.031+0000 7fe903e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90419f940 con 0x7fe904103920 2024-09-13T16:06:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.031+0000 7fe903e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90419fab0 con 0x7fe904102f60 2024-09-13T16:06:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.031+0000 7fe903e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90419fc70 con 0x7fe904101d70 2024-09-13T16:06:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.031+0000 7fe902a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe904101d70 0x7fe904197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.031+0000 7fe902a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe904101d70 0x7fe904197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:51502/0 (socket says 172.21.15.17:51502) 2024-09-13T16:06:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.031+0000 7fe902a00640 1 -- 172.21.15.17:0/4004428234 learned_addr learned my addr 172.21.15.17:0/4004428234 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:06:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.031+0000 7fe902000640 1 --2- 172.21.15.17:0/4004428234 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe904102f60 0x7fe9041983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.032+0000 7fe903400640 1 --2- 172.21.15.17:0/4004428234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe904103920 0x7fe90419f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.032+0000 7fe902a00640 1 -- 172.21.15.17:0/4004428234 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe904102f60 msgr2=0x7fe9041983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.032+0000 7fe902a00640 1 --2- 172.21.15.17:0/4004428234 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe904102f60 0x7fe9041983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.032+0000 7fe902a00640 1 -- 172.21.15.17:0/4004428234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe904103920 msgr2=0x7fe90419f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.032+0000 7fe902a00640 1 --2- 172.21.15.17:0/4004428234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe904103920 0x7fe90419f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.032+0000 7fe902a00640 1 -- 172.21.15.17:0/4004428234 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ec009900 con 0x7fe904101d70 2024-09-13T16:06:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.032+0000 7fe903400640 1 --2- 172.21.15.17:0/4004428234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe904103920 0x7fe90419f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:06:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.032+0000 7fe902a00640 1 --2- 172.21.15.17:0/4004428234 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe904101d70 0x7fe904197ea0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00e9c0 tx=0x7fe8fc00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.033+0000 7fe908a00640 1 -- 172.21.15.17:0/4004428234 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc009700 con 0x7fe904101d70 2024-09-13T16:06:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.033+0000 7fe903e00640 1 -- 172.21.15.17:0/4004428234 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe90419ff50 con 0x7fe904101d70 2024-09-13T16:06:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.033+0000 7fe908a00640 1 -- 172.21.15.17:0/4004428234 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe8fc0044e0 con 0x7fe904101d70 2024-09-13T16:06:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.034+0000 7fe903e00640 1 -- 172.21.15.17:0/4004428234 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9041a03d0 con 0x7fe904101d70 2024-09-13T16:06:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.034+0000 7fe908a00640 1 -- 172.21.15.17:0/4004428234 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc010430 con 0x7fe904101d70 2024-09-13T16:06:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.042+0000 7fe90cbc3740 1 Processor -- start 2024-09-13T16:06:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.042+0000 7fe908a00640 1 -- 172.21.15.17:0/4004428234 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe8fc0035f0 con 0x7fe904101d70 2024-09-13T16:06:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.044+0000 7fe90cbc3740 1 -- start start 2024-09-13T16:06:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.045+0000 7fe90cbc3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983f490 0x55c66983f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.046+0000 7fe903400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983f490 0x55c66983f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.046+0000 7fe903400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983f490 0x55c66983f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:34356/0 (socket says 172.21.15.17:34356) 2024-09-13T16:06:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.046+0000 7fe903400640 1 -- 172.21.15.17:0/346688480 learned_addr learned my addr 172.21.15.17:0/346688480 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:06:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.046+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/346688480 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c66983fdd0 0x55c669844890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.046+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/346688480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c669844e60 0x55c669847320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.046+0000 7fe90cbc3740 1 -- 172.21.15.17:0/346688480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c669742bb0 con 0x55c669844e60 2024-09-13T16:06:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.046+0000 7fe90cbc3740 1 -- 172.21.15.17:0/346688480 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6697a0a70 con 0x55c66983f490 2024-09-13T16:06:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.046+0000 7fe90cbc3740 1 -- 172.21.15.17:0/346688480 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c66979e200 con 0x55c66983fdd0 2024-09-13T16:06:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.047+0000 7fe903400640 1 -- 172.21.15.17:0/346688480 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c66983fdd0 msgr2=0x55c669844890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:06:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.047+0000 7fe903400640 1 --2- 172.21.15.17:0/346688480 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c66983fdd0 0x55c669844890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.047+0000 7fe903400640 1 -- 172.21.15.17:0/346688480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c669844e60 msgr2=0x55c669847320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.047+0000 7fe903400640 1 --2- 172.21.15.17:0/346688480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c669844e60 0x55c669847320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.047+0000 7fe903400640 1 -- 172.21.15.17:0/346688480 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c66973b940 con 0x55c66983f490 2024-09-13T16:06:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.047+0000 7fe908a00640 1 --2- 172.21.15.17:0/4004428234 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe8e80a1280 0x7fe8e80a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.047+0000 7fe908a00640 1 -- 172.21.15.17:0/4004428234 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fe8fc014070 con 0x7fe904101d70 2024-09-13T16:06:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.049+0000 7fe903400640 1 --2- 172.21.15.17:0/346688480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983f490 0x55c66983f890 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4009bd0 tx=0x7fe8f400e6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed358899f6640ff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:20.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.049+0000 7fe8f8c00640 1 -- 172.21.15.17:0/346688480 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4011470 con 0x55c66983f490 2024-09-13T16:06:20.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.049+0000 7fe8f8c00640 1 -- 172.21.15.17:0/346688480 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe8f4011a90 con 0x55c66983f490 2024-09-13T16:06:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.049+0000 7fe8f8c00640 1 -- 172.21.15.17:0/346688480 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4010980 con 0x55c66983f490 2024-09-13T16:06:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.050+0000 7fe902a00640 1 --2- 172.21.15.17:0/4004428234 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe8e80a1280 0x7fe8e80a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.051+0000 7fe90cbc3740 1 -- 172.21.15.17:0/346688480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983f490 msgr2=0x55c66983f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.051+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/346688480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983f490 0x55c66983f890 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4009bd0 tx=0x7fe8f400e6c0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.051+0000 7fe90cbc3740 1 -- 172.21.15.17:0/346688480 shutdown_connections 2024-09-13T16:06:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.051+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/346688480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c669844e60 0x55c669847320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.051+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/346688480 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c66983fdd0 0x55c669844890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.051+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/346688480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983f490 0x55c66983f890 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.051+0000 7fe90cbc3740 1 -- 172.21.15.17:0/346688480 >> 172.21.15.17:0/346688480 conn(0x55c66983ab00 msgr2=0x55c66983af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:20.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.052+0000 7fe90cbc3740 1 -- 172.21.15.17:0/346688480 shutdown_connections 2024-09-13T16:06:20.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.052+0000 7fe90cbc3740 1 -- 172.21.15.17:0/346688480 wait complete. 2024-09-13T16:06:20.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.052+0000 7fe90cbc3740 1 -- start start 2024-09-13T16:06:20.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.053+0000 7fe902a00640 1 --2- 172.21.15.17:0/4004428234 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe8e80a1280 0x7fe8e80a3740 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc096c90 tx=0x7fe8fc00efb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:20.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.053+0000 7fe90cbc3740 1 Processor -- start 2024-09-13T16:06:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.056+0000 7fe90cbc3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983f490 0x55c6698490f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.057+0000 7fe90cbc3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c66983fdd0 0x55c669849630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.057+0000 7fe903400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983f490 0x55c6698490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.057+0000 7fe903400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983f490 0x55c6698490f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:34372/0 (socket says 172.21.15.17:34372) 2024-09-13T16:06:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.057+0000 7fe903400640 1 -- 172.21.15.17:0/1833263258 learned_addr learned my addr 172.21.15.17:0/1833263258 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:06:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.057+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/1833263258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c669844e60 0x55c669850670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.057+0000 7fe90cbc3740 1 -- 172.21.15.17:0/1833263258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c669799af0 con 0x55c669844e60 2024-09-13T16:06:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.057+0000 7fe90cbc3740 1 -- 172.21.15.17:0/1833263258 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c669757f20 con 0x55c66983f490 2024-09-13T16:06:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.057+0000 7fe90cbc3740 1 -- 172.21.15.17:0/1833263258 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c669757bc0 con 0x55c66983fdd0 2024-09-13T16:06:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.058+0000 7fe902000640 1 --2- 172.21.15.17:0/1833263258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c66983fdd0 0x55c669849630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.058+0000 7fe903400640 1 -- 172.21.15.17:0/1833263258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c66983fdd0 msgr2=0x55c669849630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.058+0000 7fe903400640 1 --2- 172.21.15.17:0/1833263258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c66983fdd0 0x55c669849630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.058+0000 7fe903400640 1 -- 172.21.15.17:0/1833263258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c669844e60 msgr2=0x55c669850670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.058+0000 7fe903400640 1 --2- 172.21.15.17:0/1833263258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c669844e60 0x55c669850670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.058+0000 7fe90cbc3740 10 client.0 _ll_register_callbacks cb 0x55c669789a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:06:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.058+0000 7fe903400640 1 -- 172.21.15.17:0/1833263258 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f4009800 con 0x55c66983f490 2024-09-13T16:06:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.058+0000 7fe90cbc3740 1 -- 172.21.15.17:0/1833263258 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c6697c3c90 con 0x55c66983f490 2024-09-13T16:06:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.058+0000 7fe902000640 1 --2- 172.21.15.17:0/1833263258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c66983fdd0 0x55c669849630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:06:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.058+0000 7fe903400640 1 --2- 172.21.15.17:0/1833263258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983f490 0x55c6698490f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4010410 tx=0x7fe8f40116a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29a115d6f6be0326 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.058+0000 7fe8f1600640 10 client.26003 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:06:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.059+0000 7fe8f1600640 1 -- 172.21.15.17:0/1833263258 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f401f070 con 0x55c66983f490 2024-09-13T16:06:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.059+0000 7fe8f1600640 1 -- 172.21.15.17:0/1833263258 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fe8f4005240 con 0x55c66983f490 2024-09-13T16:06:20.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.059+0000 7fe8f1600640 1 -- 172.21.15.17:0/1833263258 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8f4005440 con 0x55c66983f490 2024-09-13T16:06:20.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.059+0000 7fe90cbc3740 10 client.26003 fetch_fsmap learned FSMap version 41 2024-09-13T16:06:20.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.059+0000 7fe90cbc3740 1 -- 172.21.15.17:0/1833263258 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({fsmap=41}) v3 -- 0x55c669798170 con 0x55c66983f490 2024-09-13T16:06:20.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.060+0000 7fe8f1600640 1 -- 172.21.15.17:0/1833263258 <== mon.2 v2:172.21.15.189:3300/0 4 ==== fsmap(e 41) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fe8f400c070 con 0x55c66983f490 2024-09-13T16:06:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.063+0000 7fe90cbc3740 10 client.26003 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T16:06:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.063+0000 7fe90cbc3740 10 client.26003 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:06:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.063+0000 7fe90cbc3740 20 client.26003 populate_metadata read hostname 'smithi017' 2024-09-13T16:06:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.063+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/1833263258 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c669854bf0 0x55c669857010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.063+0000 7fe90cbc3740 4 client.26003 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:06:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.063+0000 7fe90cbc3740 1 -- 172.21.15.17:0/1833263258 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c66978c7d0 con 0x55c669854bf0 2024-09-13T16:06:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.063+0000 7fe902000640 1 --2- 172.21.15.17:0/1833263258 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c669854bf0 0x55c669857010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.064+0000 7fe902000640 1 --2- 172.21.15.17:0/1833263258 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c669854bf0 0x55c669857010 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f66190ef256200f2 server_cookie=f41fca4a55b86595 in_seq=0 out_seq=0 2024-09-13T16:06:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.064+0000 7fe8f1600640 10 client.26003 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:06:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.065+0000 7fe8f1600640 1 -- 172.21.15.17:0/1833263258 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c66978c7d0 con 0x55c669854bf0 2024-09-13T16:06:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.065+0000 7fe8f1600640 10 client.26003 handle_command_reply: tid=0 2024-09-13T16:06:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.065+0000 7fe90cbc3740 1 client.26003 shutdown 2024-09-13T16:06:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.065+0000 7fe90cbc3740 1 -- 172.21.15.17:0/1833263258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983f490 msgr2=0x55c6698490f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.065+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/1833263258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983f490 0x55c6698490f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4010410 tx=0x7fe8f40116a0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.065+0000 7fe90cbc3740 1 -- 172.21.15.17:0/1833263258 shutdown_connections 2024-09-13T16:06:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.065+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/1833263258 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c669854bf0 0x55c669857010 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.065+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/1833263258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c669844e60 0x55c669850670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.065+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/1833263258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c66983fdd0 0x55c669849630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.065+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/1833263258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983f490 0x55c6698490f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.065+0000 7fe90cbc3740 1 -- 172.21.15.17:0/1833263258 >> 172.21.15.17:0/1833263258 conn(0x55c66983ab00 msgr2=0x55c66983c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.065+0000 7fe8f1600640 0 client.26003 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:06:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.066+0000 7fe90cbc3740 1 -- 172.21.15.17:0/1833263258 shutdown_connections 2024-09-13T16:06:20.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.066+0000 7fe90cbc3740 1 -- 172.21.15.17:0/1833263258 wait complete. 2024-09-13T16:06:20.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.067+0000 7fe90cbc3740 20 client.26003 trim_cache size 0 max 16384 2024-09-13T16:06:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.091+0000 7fe90cbc3740 1 Processor -- start 2024-09-13T16:06:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.091+0000 7fe90cbc3740 1 -- start start 2024-09-13T16:06:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.091+0000 7fe90cbc3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983ab00 0x55c669840c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.091+0000 7fe90cbc3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66983f490 0x55c669850630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.091+0000 7fe90cbc3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c66983fdd0 0x55c6698411d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.091+0000 7fe90cbc3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c669500e60 con 0x55c66983f490 2024-09-13T16:06:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.091+0000 7fe90cbc3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6698517d0 con 0x55c66983ab00 2024-09-13T16:06:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.091+0000 7fe90cbc3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c669847a60 con 0x55c66983fdd0 2024-09-13T16:06:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.092+0000 7fe903400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983ab00 0x55c669840c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.092+0000 7fe903400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983ab00 0x55c669840c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:34380/0 (socket says 172.21.15.17:34380) 2024-09-13T16:06:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.092+0000 7fe903400640 1 -- 172.21.15.17:0/2996440828 learned_addr learned my addr 172.21.15.17:0/2996440828 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:06:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.092+0000 7fe902000640 1 --2- 172.21.15.17:0/2996440828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66983f490 0x55c669850630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.092+0000 7fe903400640 1 --2- 172.21.15.17:0/2996440828 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c66983fdd0 0x55c6698411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.092+0000 7fe903400640 1 -- 172.21.15.17:0/2996440828 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c66983fdd0 msgr2=0x55c6698411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.093+0000 7fe903400640 1 --2- 172.21.15.17:0/2996440828 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c66983fdd0 0x55c6698411d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.093+0000 7fe903400640 1 -- 172.21.15.17:0/2996440828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66983f490 msgr2=0x55c669850630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.093+0000 7fe903400640 1 --2- 172.21.15.17:0/2996440828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66983f490 0x55c669850630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.093+0000 7fe903400640 1 -- 172.21.15.17:0/2996440828 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c66973a180 con 0x55c66983ab00 2024-09-13T16:06:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.093+0000 7fe902000640 1 --2- 172.21.15.17:0/2996440828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66983f490 0x55c669850630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:06:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.094+0000 7fe903400640 1 --2- 172.21.15.17:0/2996440828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983ab00 0x55c669840c90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe8f400ebc0 tx=0x7fe8f4021000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9b0cd426627cc82 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.094+0000 7fe8f9600640 1 -- 172.21.15.17:0/2996440828 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4036070 con 0x55c66983ab00 2024-09-13T16:06:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.094+0000 7fe8f9600640 1 -- 172.21.15.17:0/2996440828 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c6697c3c90 con 0x55c66983ab00 2024-09-13T16:06:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.094+0000 7fe8f9600640 1 -- 172.21.15.17:0/2996440828 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4005040 con 0x55c66983ab00 2024-09-13T16:06:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.096+0000 7fe90cbc3740 1 -- 172.21.15.17:0/2996440828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983ab00 msgr2=0x55c669840c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.096+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/2996440828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983ab00 0x55c669840c90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe8f400ebc0 tx=0x7fe8f4021000 comp rx=0 tx=0).stop 2024-09-13T16:06:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.096+0000 7fe90cbc3740 1 -- 172.21.15.17:0/2996440828 shutdown_connections 2024-09-13T16:06:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.096+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/2996440828 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c66983fdd0 0x55c6698411d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.096+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/2996440828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66983f490 0x55c669850630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.096+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/2996440828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983ab00 0x55c669840c90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.096+0000 7fe90cbc3740 1 -- 172.21.15.17:0/2996440828 >> 172.21.15.17:0/2996440828 conn(0x55c6698475c0 msgr2=0x55c669844250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.096+0000 7fe90cbc3740 1 -- 172.21.15.17:0/2996440828 shutdown_connections 2024-09-13T16:06:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.096+0000 7fe90cbc3740 1 -- 172.21.15.17:0/2996440828 wait complete. 2024-09-13T16:06:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.097+0000 7fe90cbc3740 1 -- start start 2024-09-13T16:06:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.097+0000 7fe90cbc3740 1 Processor -- start 2024-09-13T16:06:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.098+0000 7fe90cbc3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c66983ab00 0x55c66984ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.099+0000 7fe903400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c66983ab00 0x55c66984ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.099+0000 7fe903400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c66983ab00 0x55c66984ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:51530/0 (socket says 172.21.15.17:51530) 2024-09-13T16:06:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.099+0000 7fe903400640 1 -- 172.21.15.17:0/26792394 learned_addr learned my addr 172.21.15.17:0/26792394 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:06:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.099+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/26792394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66983f490 0x55c66984f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.099+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/26792394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983fdd0 0x55c66984f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.100+0000 7fe90cbc3740 1 -- 172.21.15.17:0/26792394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c669850a90 con 0x55c66983f490 2024-09-13T16:06:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.100+0000 7fe90cbc3740 1 -- 172.21.15.17:0/26792394 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6698ab0e0 con 0x55c66983fdd0 2024-09-13T16:06:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.100+0000 7fe90cbc3740 1 -- 172.21.15.17:0/26792394 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6698ab2a0 con 0x55c66983ab00 2024-09-13T16:06:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.100+0000 7fe902000640 1 --2- 172.21.15.17:0/26792394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66983f490 0x55c66984f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.100+0000 7fe90cbc3740 10 client.0 _ll_register_callbacks cb 0x7fe8f4009380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:06:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.100+0000 7fe903400640 1 --2- 172.21.15.17:0/26792394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983fdd0 0x55c66984f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.100+0000 7fe902000640 1 -- 172.21.15.17:0/26792394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c66983ab00 msgr2=0x55c66984ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.100+0000 7fe902000640 1 --2- 172.21.15.17:0/26792394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c66983ab00 0x55c66984ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.100+0000 7fe902000640 1 -- 172.21.15.17:0/26792394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983fdd0 msgr2=0x55c66984f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.100+0000 7fe902000640 1 --2- 172.21.15.17:0/26792394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983fdd0 0x55c66984f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.100+0000 7fe902000640 1 -- 172.21.15.17:0/26792394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe90410aab0 con 0x55c66983f490 2024-09-13T16:06:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.101+0000 7fe903400640 1 --2- 172.21.15.17:0/26792394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c66983ab00 0x55c66984ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:06:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.101+0000 7fe902000640 1 --2- 172.21.15.17:0/26792394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66983f490 0x55c66984f3a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec02aec0 tx=0x7fe8ec02b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4798f91279adc6e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.101+0000 7fe8f1600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T16:06:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.102+0000 7fe8f1600640 1 -- 172.21.15.17:0/26792394 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec041040 con 0x55c66983f490 2024-09-13T16:06:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.102+0000 7fe8f1600640 1 -- 172.21.15.17:0/26792394 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fe8ec043d70 con 0x55c66983f490 2024-09-13T16:06:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.102+0000 7fe90cbc3740 1 -- 172.21.15.17:0/26792394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe8f4011a90 con 0x55c66983f490 2024-09-13T16:06:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.102+0000 7fe8f1600640 1 -- 172.21.15.17:0/26792394 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8ec031460 con 0x55c66983f490 2024-09-13T16:06:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.102+0000 7fe90cbc3740 10 client.15741 fetch_fsmap learned FSMap version 41 2024-09-13T16:06:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.102+0000 7fe90cbc3740 1 -- 172.21.15.17:0/26792394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55c669798170 con 0x55c66983f490 2024-09-13T16:06:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.103+0000 7fe8f1600640 1 -- 172.21.15.17:0/26792394 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe8f4011a90 con 0x55c66983f490 2024-09-13T16:06:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.104+0000 7fe8f1600640 1 -- 172.21.15.17:0/26792394 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 41) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fe8ec043460 con 0x55c66983f490 2024-09-13T16:06:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.104+0000 7fe90cbc3740 10 client.15741 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T16:06:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.104+0000 7fe90cbc3740 10 client.15741 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:06:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.104+0000 7fe90cbc3740 20 client.15741 populate_metadata read hostname 'smithi017' 2024-09-13T16:06:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.104+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/26792394 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c669844e60 0x55c6698aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.104+0000 7fe90cbc3740 4 client.15741 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:06:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.104+0000 7fe90cbc3740 1 -- 172.21.15.17:0/26792394 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c66948d300 con 0x55c669844e60 2024-09-13T16:06:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.104+0000 7fe903400640 1 --2- 172.21.15.17:0/26792394 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c669844e60 0x55c6698aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.105+0000 7fe903400640 1 --2- 172.21.15.17:0/26792394 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c669844e60 0x55c6698aedb0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f246981ba841d519 server_cookie=228664a8405bb746 in_seq=0 out_seq=0 2024-09-13T16:06:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.105+0000 7fe8f1600640 10 client.15741 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:06:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.117+0000 7fe8f1600640 1 -- 172.21.15.17:0/26792394 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c66948d300 con 0x55c669844e60 2024-09-13T16:06:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.117+0000 7fe8f1600640 10 client.15741 handle_command_reply: tid=0 2024-09-13T16:06:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.117+0000 7fe90cbc3740 1 client.15741 shutdown 2024-09-13T16:06:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.117+0000 7fe90cbc3740 1 -- 172.21.15.17:0/26792394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66983f490 msgr2=0x55c66984f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.117+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/26792394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66983f490 0x55c66984f3a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec02aec0 tx=0x7fe8ec02b050 comp rx=0 tx=0).stop 2024-09-13T16:06:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.117+0000 7fe90cbc3740 1 -- 172.21.15.17:0/26792394 shutdown_connections 2024-09-13T16:06:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.118+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/26792394 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c669844e60 0x55c6698aedb0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.118+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/26792394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c66983fdd0 0x55c66984f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.118+0000 7fe8f1600640 0 client.15741 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:06:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.118+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/26792394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66983f490 0x55c66984f3a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.118+0000 7fe90cbc3740 1 --2- 172.21.15.17:0/26792394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c66983ab00 0x55c66984ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.118+0000 7fe90cbc3740 1 -- 172.21.15.17:0/26792394 >> 172.21.15.17:0/26792394 conn(0x55c6698475c0 msgr2=0x55c6698440c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.118+0000 7fe90cbc3740 1 -- 172.21.15.17:0/26792394 shutdown_connections 2024-09-13T16:06:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.118+0000 7fe90cbc3740 1 -- 172.21.15.17:0/26792394 wait complete. 2024-09-13T16:06:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.118+0000 7fe90cbc3740 20 client.15741 trim_cache size 0 max 16384 2024-09-13T16:06:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:06:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:06:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:06:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:06:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.119+0000 7fe903e00640 1 -- 172.21.15.17:0/4004428234 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe8e80a1280 msgr2=0x7fe8e80a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.119+0000 7fe903e00640 1 --2- 172.21.15.17:0/4004428234 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe8e80a1280 0x7fe8e80a3740 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc096c90 tx=0x7fe8fc00efb0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.119+0000 7fe903e00640 1 -- 172.21.15.17:0/4004428234 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe904101d70 msgr2=0x7fe904197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.119+0000 7fe903e00640 1 --2- 172.21.15.17:0/4004428234 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe904101d70 0x7fe904197ea0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00e9c0 tx=0x7fe8fc00ee80 comp rx=0 tx=0).stop 2024-09-13T16:06:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.119+0000 7fe903e00640 1 -- 172.21.15.17:0/4004428234 shutdown_connections 2024-09-13T16:06:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.119+0000 7fe903e00640 1 --2- 172.21.15.17:0/4004428234 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe8e80a1280 0x7fe8e80a3740 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.119+0000 7fe903e00640 1 --2- 172.21.15.17:0/4004428234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe904103920 0x7fe90419f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.119+0000 7fe903e00640 1 --2- 172.21.15.17:0/4004428234 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe904102f60 0x7fe9041983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.119+0000 7fe903e00640 1 --2- 172.21.15.17:0/4004428234 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe904101d70 0x7fe904197ea0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.119+0000 7fe903e00640 1 -- 172.21.15.17:0/4004428234 >> 172.21.15.17:0/4004428234 conn(0x7fe9040fd510 msgr2=0x7fe904106300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.120+0000 7fe903e00640 1 -- 172.21.15.17:0/4004428234 shutdown_connections 2024-09-13T16:06:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:20.120+0000 7fe903e00640 1 -- 172.21.15.17:0/4004428234 wait complete. 2024-09-13T16:06:20.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 515.0 s, 493.8 tps, lat 201.896 ms stddev 265.498 2024-09-13T16:06:21.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:21 smithi189 ceph-mon[34790]: pgmap v643: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 580 op/s 2024-09-13T16:06:22.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:21 smithi193 ceph-mon[35248]: pgmap v643: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 580 op/s 2024-09-13T16:06:22.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:21 smithi017 ceph-mon[30494]: pgmap v643: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 580 op/s 2024-09-13T16:06:24.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:23 smithi193 ceph-mon[35248]: pgmap v644: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 4.4 MiB/s wr, 494 op/s 2024-09-13T16:06:24.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:23 smithi017 ceph-mon[30494]: pgmap v644: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 4.4 MiB/s wr, 494 op/s 2024-09-13T16:06:24.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:23 smithi189 ceph-mon[34790]: pgmap v644: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 4.4 MiB/s wr, 494 op/s 2024-09-13T16:06:25.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:24 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:06:25.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:24 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:06:25.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:24 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:06:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 520.0 s, 571.8 tps, lat 177.594 ms stddev 199.397 2024-09-13T16:06:26.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:25 smithi193 ceph-mon[35248]: pgmap v645: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 4.7 MiB/s wr, 522 op/s 2024-09-13T16:06:26.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:25 smithi017 ceph-mon[30494]: pgmap v645: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 4.7 MiB/s wr, 522 op/s 2024-09-13T16:06:26.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:25 smithi189 ceph-mon[34790]: pgmap v645: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 4.7 MiB/s wr, 522 op/s 2024-09-13T16:06:28.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:27 smithi193 ceph-mon[35248]: pgmap v646: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.2 MiB/s wr, 565 op/s 2024-09-13T16:06:28.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:27 smithi017 ceph-mon[30494]: pgmap v646: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.2 MiB/s wr, 565 op/s 2024-09-13T16:06:28.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:27 smithi189 ceph-mon[34790]: pgmap v646: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.2 MiB/s wr, 565 op/s 2024-09-13T16:06:29.908 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:29 smithi189 ceph-mon[34790]: pgmap v647: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.3 MiB/s wr, 488 op/s 2024-09-13T16:06:30.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:29 smithi193 ceph-mon[35248]: pgmap v647: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.3 MiB/s wr, 488 op/s 2024-09-13T16:06:30.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:29 smithi017 ceph-mon[30494]: pgmap v647: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.3 MiB/s wr, 488 op/s 2024-09-13T16:06:30.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 525.0 s, 551.4 tps, lat 179.354 ms stddev 197.437 2024-09-13T16:06:32.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:31 smithi193 ceph-mon[35248]: pgmap v648: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.9 MiB/s wr, 537 op/s 2024-09-13T16:06:32.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:31 smithi017 ceph-mon[30494]: pgmap v648: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.9 MiB/s wr, 537 op/s 2024-09-13T16:06:32.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:31 smithi189 ceph-mon[34790]: pgmap v648: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.9 MiB/s wr, 537 op/s 2024-09-13T16:06:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.727+0000 7f8e80400640 1 -- 172.21.15.17:0/1843354198 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e78100f00 msgr2=0x7f8e78101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.727+0000 7f8e80400640 1 --2- 172.21.15.17:0/1843354198 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e78100f00 0x7f8e78101380 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8e64009900 tx=0x7f8e6402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.727+0000 7f8e80400640 1 -- 172.21.15.17:0/1843354198 shutdown_connections 2024-09-13T16:06:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.727+0000 7f8e80400640 1 --2- 172.21.15.17:0/1843354198 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e781018c0 0x7f8e78108150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.727+0000 7f8e80400640 1 --2- 172.21.15.17:0/1843354198 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e78100f00 0x7f8e78101380 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.727+0000 7f8e80400640 1 --2- 172.21.15.17:0/1843354198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e780ffd10 0x7f8e78100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.727+0000 7f8e80400640 1 -- 172.21.15.17:0/1843354198 >> 172.21.15.17:0/1843354198 conn(0x7f8e780fb4b0 msgr2=0x7f8e780fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.727+0000 7f8e80400640 1 -- 172.21.15.17:0/1843354198 shutdown_connections 2024-09-13T16:06:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.727+0000 7f8e80400640 1 -- 172.21.15.17:0/1843354198 wait complete. 2024-09-13T16:06:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.728+0000 7f8e80400640 1 Processor -- start 2024-09-13T16:06:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.728+0000 7f8e80400640 1 -- start start 2024-09-13T16:06:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.729+0000 7f8e80400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e780ffd10 0x7f8e78195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.729+0000 7f8e80400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e78100f00 0x7f8e78196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.729+0000 7f8e80400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e781018c0 0x7f8e7819d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.729+0000 7f8e80400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7819d7e0 con 0x7f8e781018c0 2024-09-13T16:06:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.729+0000 7f8e80400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7819d950 con 0x7f8e780ffd10 2024-09-13T16:06:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.729+0000 7f8e80400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7819db10 con 0x7f8e78100f00 2024-09-13T16:06:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.729+0000 7f8e7e400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e781018c0 0x7f8e7819d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.729+0000 7f8e7e400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e781018c0 0x7f8e7819d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46672/0 (socket says 172.21.15.17:46672) 2024-09-13T16:06:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.729+0000 7f8e7e400640 1 -- 172.21.15.17:0/2455226337 learned_addr learned my addr 172.21.15.17:0/2455226337 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:06:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.729+0000 7f8e7da00640 1 --2- 172.21.15.17:0/2455226337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e780ffd10 0x7f8e78195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.729+0000 7f8e7d000640 1 --2- 172.21.15.17:0/2455226337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e78100f00 0x7f8e78196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.729+0000 7f8e7e400640 1 -- 172.21.15.17:0/2455226337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e78100f00 msgr2=0x7f8e78196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.729+0000 7f8e7e400640 1 --2- 172.21.15.17:0/2455226337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e78100f00 0x7f8e78196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.729+0000 7f8e7e400640 1 -- 172.21.15.17:0/2455226337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e780ffd10 msgr2=0x7f8e78195d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.729+0000 7f8e7e400640 1 --2- 172.21.15.17:0/2455226337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e780ffd10 0x7f8e78195d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.729+0000 7f8e7e400640 1 -- 172.21.15.17:0/2455226337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c009840 con 0x7f8e781018c0 2024-09-13T16:06:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.730+0000 7f8e7e400640 1 --2- 172.21.15.17:0/2455226337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e781018c0 0x7f8e7819d270 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8e7000d750 tx=0x7f8e7000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.730+0000 7f8e76000640 1 -- 172.21.15.17:0/2455226337 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70009bd0 con 0x7f8e781018c0 2024-09-13T16:06:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.730+0000 7f8e76000640 1 -- 172.21.15.17:0/2455226337 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e7000de60 con 0x7f8e781018c0 2024-09-13T16:06:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.730+0000 7f8e80400640 1 -- 172.21.15.17:0/2455226337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e64009560 con 0x7f8e781018c0 2024-09-13T16:06:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.730+0000 7f8e76000640 1 -- 172.21.15.17:0/2455226337 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70004da0 con 0x7f8e781018c0 2024-09-13T16:06:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.730+0000 7f8e80400640 1 -- 172.21.15.17:0/2455226337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e7819e170 con 0x7f8e781018c0 2024-09-13T16:06:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.733+0000 7f8e832cc740 1 Processor -- start 2024-09-13T16:06:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.733+0000 7f8e76000640 1 -- 172.21.15.17:0/2455226337 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8e70004f00 con 0x7f8e781018c0 2024-09-13T16:06:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.733+0000 7f8e832cc740 1 -- start start 2024-09-13T16:06:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.734+0000 7f8e832cc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae9899f0 0x55f4ae989df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.734+0000 7f8e832cc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98a330 0x55f4ae98cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.734+0000 7f8e832cc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae98d400 0x55f4ae99a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.734+0000 7f8e832cc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ae895bb0 con 0x55f4ae98a330 2024-09-13T16:06:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.734+0000 7f8e832cc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ae8f3a70 con 0x55f4ae9899f0 2024-09-13T16:06:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.734+0000 7f8e832cc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ae8f1200 con 0x55f4ae98d400 2024-09-13T16:06:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.734+0000 7f8e7da00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98a330 0x55f4ae98cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.734+0000 7f8e7da00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98a330 0x55f4ae98cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46680/0 (socket says 172.21.15.17:46680) 2024-09-13T16:06:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.734+0000 7f8e7da00640 1 -- 172.21.15.17:0/3614184678 learned_addr learned my addr 172.21.15.17:0/3614184678 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:06:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.734+0000 7f8e7d000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae9899f0 0x55f4ae989df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.734+0000 7f8e7d000640 1 --2- 172.21.15.17:0/3614184678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae98d400 0x55f4ae99a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.734+0000 7f8e7da00640 1 -- 172.21.15.17:0/3614184678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae98d400 msgr2=0x55f4ae99a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.734+0000 7f8e7da00640 1 --2- 172.21.15.17:0/3614184678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae98d400 0x55f4ae99a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.734+0000 7f8e7da00640 1 -- 172.21.15.17:0/3614184678 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae9899f0 msgr2=0x55f4ae989df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.734+0000 7f8e7da00640 1 --2- 172.21.15.17:0/3614184678 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae9899f0 0x55f4ae989df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.735+0000 7f8e7da00640 1 -- 172.21.15.17:0/3614184678 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4ae88e940 con 0x55f4ae98a330 2024-09-13T16:06:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.735+0000 7f8e7d000640 1 --2- 172.21.15.17:0/3614184678 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae9899f0 0x55f4ae989df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:06:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.735+0000 7f8e7da00640 1 --2- 172.21.15.17:0/3614184678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98a330 0x55f4ae98cde0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c0115d0 tx=0x7f8e6c011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854b6b959fdcedfc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.735+0000 7f8e76000640 1 --2- 172.21.15.17:0/2455226337 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8e600a1090 0x7f8e600a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.735+0000 7f8e6aa00640 1 -- 172.21.15.17:0/3614184678 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c004d20 con 0x55f4ae98a330 2024-09-13T16:06:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.735+0000 7f8e76000640 1 -- 172.21.15.17:0/2455226337 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f8e700cc720 con 0x7f8e781018c0 2024-09-13T16:06:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.735+0000 7f8e6aa00640 1 -- 172.21.15.17:0/3614184678 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e6c004e80 con 0x55f4ae98a330 2024-09-13T16:06:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.735+0000 7f8e6aa00640 1 -- 172.21.15.17:0/3614184678 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c0042b0 con 0x55f4ae98a330 2024-09-13T16:06:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.735+0000 7f8e7d000640 1 --2- 172.21.15.17:0/2455226337 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8e600a1090 0x7f8e600a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.736+0000 7f8e832cc740 1 -- 172.21.15.17:0/3614184678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98a330 msgr2=0x55f4ae98cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.736+0000 7f8e832cc740 1 --2- 172.21.15.17:0/3614184678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98a330 0x55f4ae98cde0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c0115d0 tx=0x7f8e6c011a90 comp rx=0 tx=0).stop 2024-09-13T16:06:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.736+0000 7f8e7d000640 1 --2- 172.21.15.17:0/2455226337 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8e600a1090 0x7f8e600a3550 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8e6402a9e0 tx=0x7f8e6402a3f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.736+0000 7f8e832cc740 1 -- 172.21.15.17:0/3614184678 shutdown_connections 2024-09-13T16:06:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.736+0000 7f8e832cc740 1 --2- 172.21.15.17:0/3614184678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae98d400 0x55f4ae99a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.736+0000 7f8e832cc740 1 --2- 172.21.15.17:0/3614184678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98a330 0x55f4ae98cde0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.736+0000 7f8e832cc740 1 --2- 172.21.15.17:0/3614184678 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae9899f0 0x55f4ae989df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.736+0000 7f8e832cc740 1 -- 172.21.15.17:0/3614184678 >> 172.21.15.17:0/3614184678 conn(0x55f4ae9850e0 msgr2=0x55f4ae9854e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.736+0000 7f8e832cc740 1 -- 172.21.15.17:0/3614184678 shutdown_connections 2024-09-13T16:06:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.736+0000 7f8e832cc740 1 -- 172.21.15.17:0/3614184678 wait complete. 2024-09-13T16:06:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.737+0000 7f8e832cc740 1 -- start start 2024-09-13T16:06:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.737+0000 7f8e832cc740 1 Processor -- start 2024-09-13T16:06:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.737+0000 7f8e832cc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae9899f0 0x55f4ae99bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.737+0000 7f8e832cc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae98a330 0x55f4ae99c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.737+0000 7f8e832cc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98d400 0x55f4ae9a3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.737+0000 7f8e832cc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ae8ecaf0 con 0x55f4ae98d400 2024-09-13T16:06:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.737+0000 7f8e832cc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ae8aaf20 con 0x55f4ae98a330 2024-09-13T16:06:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.737+0000 7f8e832cc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ae8aabc0 con 0x55f4ae9899f0 2024-09-13T16:06:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.737+0000 7f8e832cc740 10 client.0 _ll_register_callbacks cb 0x55f4ae8dca70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:06:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.737+0000 7f8e7da00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae9899f0 0x55f4ae99bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.737+0000 7f8e7e400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98d400 0x55f4ae9a3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.737+0000 7f8e7da00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae9899f0 0x55f4ae99bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:55688/0 (socket says 172.21.15.17:55688) 2024-09-13T16:06:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.737+0000 7f8e7da00640 1 -- 172.21.15.17:0/54285277 learned_addr learned my addr 172.21.15.17:0/54285277 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:06:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.738+0000 7f8e7d000640 1 --2- 172.21.15.17:0/54285277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae98a330 0x55f4ae99c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.738+0000 7f8e7da00640 1 -- 172.21.15.17:0/54285277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae98a330 msgr2=0x55f4ae99c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.738+0000 7f8e7da00640 1 --2- 172.21.15.17:0/54285277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae98a330 0x55f4ae99c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.738+0000 7f8e7da00640 1 -- 172.21.15.17:0/54285277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98d400 msgr2=0x55f4ae9a3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.738+0000 7f8e7da00640 1 --2- 172.21.15.17:0/54285277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98d400 0x55f4ae9a3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.738+0000 7f8e7da00640 1 -- 172.21.15.17:0/54285277 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6c009d90 con 0x55f4ae9899f0 2024-09-13T16:06:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.738+0000 7f8e7da00640 1 --2- 172.21.15.17:0/54285277 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae9899f0 0x55f4ae99bf00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c0115a0 tx=0x7f8e6c004c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb51fc6999e001fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.738+0000 7f8e5f400640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:06:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.738+0000 7f8e5f400640 1 -- 172.21.15.17:0/54285277 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c004050 con 0x55f4ae9899f0 2024-09-13T16:06:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.739+0000 7f8e832cc740 1 -- 172.21.15.17:0/54285277 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4ae8df7d0 con 0x55f4ae9899f0 2024-09-13T16:06:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.739+0000 7f8e5f400640 1 -- 172.21.15.17:0/54285277 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f8e6c0041b0 con 0x55f4ae9899f0 2024-09-13T16:06:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.739+0000 7f8e5f400640 1 -- 172.21.15.17:0/54285277 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e6c004370 con 0x55f4ae9899f0 2024-09-13T16:06:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.739+0000 7f8e832cc740 10 client.26038 fetch_fsmap learned FSMap version 43 2024-09-13T16:06:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.739+0000 7f8e832cc740 1 -- 172.21.15.17:0/54285277 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55f4ae8eb170 con 0x55f4ae9899f0 2024-09-13T16:06:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.739+0000 7f8e5f400640 1 -- 172.21.15.17:0/54285277 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f4ae8df7d0 con 0x55f4ae9899f0 2024-09-13T16:06:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.739+0000 7f8e5f400640 1 -- 172.21.15.17:0/54285277 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 43) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f8e6c021040 con 0x55f4ae9899f0 2024-09-13T16:06:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.739+0000 7f8e832cc740 10 client.26038 fetch_fsmap finished waiting for FSMap version 43 2024-09-13T16:06:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.739+0000 7f8e832cc740 10 client.26038 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:06:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.739+0000 7f8e832cc740 20 client.26038 populate_metadata read hostname 'smithi017' 2024-09-13T16:06:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.739+0000 7f8e832cc740 1 --2- 172.21.15.17:0/54285277 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f4ae9a7a90 0x55f4ae9a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.739+0000 7f8e832cc740 4 client.26038 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:06:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.739+0000 7f8e832cc740 1 -- 172.21.15.17:0/54285277 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f4ae5e0300 con 0x55f4ae9a7a90 2024-09-13T16:06:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.740+0000 7f8e7d000640 1 --2- 172.21.15.17:0/54285277 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f4ae9a7a90 0x55f4ae9a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.740+0000 7f8e7d000640 1 --2- 172.21.15.17:0/54285277 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f4ae9a7a90 0x55f4ae9a9eb0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b426398a228105de server_cookie=fe72357b7e657f55 in_seq=0 out_seq=0 2024-09-13T16:06:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.740+0000 7f8e5f400640 10 client.26038 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:06:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.741+0000 7f8e5f400640 1 -- 172.21.15.17:0/54285277 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f4ae5e0300 con 0x55f4ae9a7a90 2024-09-13T16:06:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.741+0000 7f8e5f400640 10 client.26038 handle_command_reply: tid=0 2024-09-13T16:06:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.741+0000 7f8e832cc740 1 client.26038 shutdown 2024-09-13T16:06:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.741+0000 7f8e832cc740 1 -- 172.21.15.17:0/54285277 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae9899f0 msgr2=0x55f4ae99bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.741+0000 7f8e832cc740 1 --2- 172.21.15.17:0/54285277 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae9899f0 0x55f4ae99bf00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c0115a0 tx=0x7f8e6c004c70 comp rx=0 tx=0).stop 2024-09-13T16:06:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.741+0000 7f8e832cc740 1 -- 172.21.15.17:0/54285277 shutdown_connections 2024-09-13T16:06:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.741+0000 7f8e832cc740 1 --2- 172.21.15.17:0/54285277 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f4ae9a7a90 0x55f4ae9a9eb0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.741+0000 7f8e832cc740 1 --2- 172.21.15.17:0/54285277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98d400 0x55f4ae9a3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.741+0000 7f8e5f400640 0 client.26038 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:06:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.741+0000 7f8e832cc740 1 --2- 172.21.15.17:0/54285277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae98a330 0x55f4ae99c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.741+0000 7f8e832cc740 1 --2- 172.21.15.17:0/54285277 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae9899f0 0x55f4ae99bf00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.741+0000 7f8e832cc740 1 -- 172.21.15.17:0/54285277 >> 172.21.15.17:0/54285277 conn(0x55f4ae9850e0 msgr2=0x55f4ae9868f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.741+0000 7f8e832cc740 1 -- 172.21.15.17:0/54285277 shutdown_connections 2024-09-13T16:06:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.741+0000 7f8e832cc740 1 -- 172.21.15.17:0/54285277 wait complete. 2024-09-13T16:06:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.741+0000 7f8e832cc740 20 client.26038 trim_cache size 0 max 16384 2024-09-13T16:06:33.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.754+0000 7f8e832cc740 1 Processor -- start 2024-09-13T16:06:33.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.755+0000 7f8e832cc740 1 -- start start 2024-09-13T16:06:33.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.755+0000 7f8e832cc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae9899f0 0x55f4ae99c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:33.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.755+0000 7f8e832cc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98a330 0x55f4ae9a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:33.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.755+0000 7f8e832cc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae98d400 0x55f4ae983a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:33.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.755+0000 7f8e832cc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ae653e60 con 0x55f4ae98a330 2024-09-13T16:06:33.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.755+0000 7f8e832cc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ae9a38e0 con 0x55f4ae9899f0 2024-09-13T16:06:33.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.755+0000 7f8e832cc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ae8df7d0 con 0x55f4ae98d400 2024-09-13T16:06:33.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.755+0000 7f8e7d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98a330 0x55f4ae9a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:33.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.755+0000 7f8e7d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98a330 0x55f4ae9a33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46702/0 (socket says 172.21.15.17:46702) 2024-09-13T16:06:33.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.755+0000 7f8e7d000640 1 -- 172.21.15.17:0/3665370163 learned_addr learned my addr 172.21.15.17:0/3665370163 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:06:33.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.755+0000 7f8e7da00640 1 --2- 172.21.15.17:0/3665370163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae9899f0 0x55f4ae99c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:33.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.755+0000 7f8e7e400640 1 --2- 172.21.15.17:0/3665370163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae98d400 0x55f4ae983a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:33.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.755+0000 7f8e7d000640 1 -- 172.21.15.17:0/3665370163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae98d400 msgr2=0x55f4ae983a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:33.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.755+0000 7f8e7d000640 1 --2- 172.21.15.17:0/3665370163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae98d400 0x55f4ae983a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.755+0000 7f8e7d000640 1 -- 172.21.15.17:0/3665370163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae9899f0 msgr2=0x55f4ae99c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:33.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.755+0000 7f8e7d000640 1 --2- 172.21.15.17:0/3665370163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae9899f0 0x55f4ae99c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.755+0000 7f8e7d000640 1 -- 172.21.15.17:0/3665370163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4ae88d180 con 0x55f4ae98a330 2024-09-13T16:06:33.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.755+0000 7f8e7e400640 1 --2- 172.21.15.17:0/3665370163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae98d400 0x55f4ae983a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:06:33.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.755+0000 7f8e7da00640 1 --2- 172.21.15.17:0/3665370163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae9899f0 0x55f4ae99c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:06:33.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.756+0000 7f8e7d000640 1 --2- 172.21.15.17:0/3665370163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98a330 0x55f4ae9a33a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8e64004650 tx=0x7f8e64041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a5e53612424d32 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:33.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.756+0000 7f8e6b400640 1 -- 172.21.15.17:0/3665370163 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64053040 con 0x55f4ae98a330 2024-09-13T16:06:33.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.756+0000 7f8e6b400640 1 -- 172.21.15.17:0/3665370163 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e640046c0 con 0x55f4ae98a330 2024-09-13T16:06:33.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.756+0000 7f8e6b400640 1 -- 172.21.15.17:0/3665370163 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64044070 con 0x55f4ae98a330 2024-09-13T16:06:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.756+0000 7f8e832cc740 1 -- 172.21.15.17:0/3665370163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98a330 msgr2=0x55f4ae9a33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.756+0000 7f8e832cc740 1 --2- 172.21.15.17:0/3665370163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98a330 0x55f4ae9a33a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8e64004650 tx=0x7f8e64041000 comp rx=0 tx=0).stop 2024-09-13T16:06:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.757+0000 7f8e832cc740 1 -- 172.21.15.17:0/3665370163 shutdown_connections 2024-09-13T16:06:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.757+0000 7f8e832cc740 1 --2- 172.21.15.17:0/3665370163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae98d400 0x55f4ae983a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.757+0000 7f8e832cc740 1 --2- 172.21.15.17:0/3665370163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98a330 0x55f4ae9a33a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.757+0000 7f8e832cc740 1 --2- 172.21.15.17:0/3665370163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae9899f0 0x55f4ae99c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.757+0000 7f8e832cc740 1 -- 172.21.15.17:0/3665370163 >> 172.21.15.17:0/3665370163 conn(0x55f4ae9850e0 msgr2=0x55f4ae99bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.757+0000 7f8e832cc740 1 -- 172.21.15.17:0/3665370163 shutdown_connections 2024-09-13T16:06:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.757+0000 7f8e832cc740 1 -- 172.21.15.17:0/3665370163 wait complete. 2024-09-13T16:06:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.757+0000 7f8e832cc740 1 -- start start 2024-09-13T16:06:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.757+0000 7f8e832cc740 1 Processor -- start 2024-09-13T16:06:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.758+0000 7f8e832cc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae9899f0 0x55f4ae9a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.758+0000 7f8e832cc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98a330 0x55f4ae9a2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.758+0000 7f8e832cc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae98d400 0x55f4ae9fdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.758+0000 7f8e832cc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ae9a2c40 con 0x55f4ae98a330 2024-09-13T16:06:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.758+0000 7f8e832cc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ae9fe4a0 con 0x55f4ae9899f0 2024-09-13T16:06:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.758+0000 7f8e832cc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ae9fe5e0 con 0x55f4ae98d400 2024-09-13T16:06:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.758+0000 7f8e832cc740 10 client.0 _ll_register_callbacks cb 0x7f8e6c009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:06:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.758+0000 7f8e7d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98a330 0x55f4ae9a2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.758+0000 7f8e7da00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae9899f0 0x55f4ae9a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.758+0000 7f8e7da00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae9899f0 0x55f4ae9a1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:40326/0 (socket says 172.21.15.17:40326) 2024-09-13T16:06:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.758+0000 7f8e7da00640 1 -- 172.21.15.17:0/1382113233 learned_addr learned my addr 172.21.15.17:0/1382113233 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:06:33.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.758+0000 7f8e7e400640 1 --2- 172.21.15.17:0/1382113233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae98d400 0x55f4ae9fdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:33.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.758+0000 7f8e7da00640 1 -- 172.21.15.17:0/1382113233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae98d400 msgr2=0x55f4ae9fdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:33.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.758+0000 7f8e7da00640 1 --2- 172.21.15.17:0/1382113233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae98d400 0x55f4ae9fdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.758+0000 7f8e7da00640 1 -- 172.21.15.17:0/1382113233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98a330 msgr2=0x55f4ae9a2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:33.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.758+0000 7f8e7da00640 1 --2- 172.21.15.17:0/1382113233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98a330 0x55f4ae9a2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.758+0000 7f8e7da00640 1 -- 172.21.15.17:0/1382113233 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f4ae8eb170 con 0x55f4ae9899f0 2024-09-13T16:06:33.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.758+0000 7f8e7d000640 1 --2- 172.21.15.17:0/1382113233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98a330 0x55f4ae9a2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:06:33.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.758+0000 7f8e7e400640 1 --2- 172.21.15.17:0/1382113233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae98d400 0x55f4ae9fdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:06:33.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.759+0000 7f8e7da00640 1 --2- 172.21.15.17:0/1382113233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae9899f0 0x55f4ae9a1ec0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c009370 tx=0x7f8e6c009590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edd9a552a086c775 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:33.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.759+0000 7f8e5f400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:06:33.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.759+0000 7f8e5f400640 1 -- 172.21.15.17:0/1382113233 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c005990 con 0x55f4ae9899f0 2024-09-13T16:06:33.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.759+0000 7f8e5f400640 1 -- 172.21.15.17:0/1382113233 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f8e6c011280 con 0x55f4ae9899f0 2024-09-13T16:06:33.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.759+0000 7f8e832cc740 1 -- 172.21.15.17:0/1382113233 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4ae916c90 con 0x55f4ae9899f0 2024-09-13T16:06:33.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.759+0000 7f8e5f400640 1 -- 172.21.15.17:0/1382113233 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e6c005000 con 0x55f4ae9899f0 2024-09-13T16:06:33.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.759+0000 7f8e832cc740 10 client.26027 fetch_fsmap learned FSMap version 43 2024-09-13T16:06:33.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.759+0000 7f8e832cc740 1 -- 172.21.15.17:0/1382113233 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7f8e78108a50 con 0x55f4ae9899f0 2024-09-13T16:06:33.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.759+0000 7f8e5f400640 1 -- 172.21.15.17:0/1382113233 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f4ae916c90 con 0x55f4ae9899f0 2024-09-13T16:06:33.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.759+0000 7f8e5f400640 1 -- 172.21.15.17:0/1382113233 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 43) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f8e6c021070 con 0x55f4ae9899f0 2024-09-13T16:06:33.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.759+0000 7f8e832cc740 10 client.26027 fetch_fsmap finished waiting for FSMap version 43 2024-09-13T16:06:33.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.759+0000 7f8e832cc740 10 client.26027 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:06:33.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.759+0000 7f8e832cc740 20 client.26027 populate_metadata read hostname 'smithi017' 2024-09-13T16:06:33.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.760+0000 7f8e832cc740 1 --2- 172.21.15.17:0/1382113233 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f4ae9ffca0 0x55f4aea020c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:33.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.760+0000 7f8e832cc740 4 client.26027 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:06:33.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.760+0000 7f8e832cc740 1 -- 172.21.15.17:0/1382113233 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f4ae5f1600 con 0x55f4ae9ffca0 2024-09-13T16:06:33.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.760+0000 7f8e7d000640 1 --2- 172.21.15.17:0/1382113233 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f4ae9ffca0 0x55f4aea020c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:33.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.760+0000 7f8e7d000640 1 --2- 172.21.15.17:0/1382113233 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f4ae9ffca0 0x55f4aea020c0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6088f3c27c546757 server_cookie=4a3bcd5a0f5fbcc2 in_seq=0 out_seq=0 2024-09-13T16:06:33.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.760+0000 7f8e5f400640 10 client.26027 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:06:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.936+0000 7f8e5f400640 1 -- 172.21.15.17:0/1382113233 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f4ae5f1600 con 0x55f4ae9ffca0 2024-09-13T16:06:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.936+0000 7f8e5f400640 10 client.26027 handle_command_reply: tid=0 2024-09-13T16:06:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.936+0000 7f8e832cc740 1 client.26027 shutdown 2024-09-13T16:06:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.936+0000 7f8e832cc740 1 -- 172.21.15.17:0/1382113233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae9899f0 msgr2=0x55f4ae9a1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.936+0000 7f8e832cc740 1 --2- 172.21.15.17:0/1382113233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae9899f0 0x55f4ae9a1ec0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c009370 tx=0x7f8e6c009590 comp rx=0 tx=0).stop 2024-09-13T16:06:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.937+0000 7f8e832cc740 1 -- 172.21.15.17:0/1382113233 shutdown_connections 2024-09-13T16:06:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.937+0000 7f8e832cc740 1 --2- 172.21.15.17:0/1382113233 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f4ae9ffca0 0x55f4aea020c0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.937+0000 7f8e832cc740 1 --2- 172.21.15.17:0/1382113233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f4ae98d400 0x55f4ae9fdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.937+0000 7f8e832cc740 1 --2- 172.21.15.17:0/1382113233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4ae98a330 0x55f4ae9a2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.937+0000 7f8e832cc740 1 --2- 172.21.15.17:0/1382113233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f4ae9899f0 0x55f4ae9a1ec0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.937+0000 7f8e832cc740 1 -- 172.21.15.17:0/1382113233 >> 172.21.15.17:0/1382113233 conn(0x55f4ae9850e0 msgr2=0x55f4ae985d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.937+0000 7f8e5f400640 0 client.26027 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:06:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.937+0000 7f8e832cc740 1 -- 172.21.15.17:0/1382113233 shutdown_connections 2024-09-13T16:06:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.938+0000 7f8e832cc740 1 -- 172.21.15.17:0/1382113233 wait complete. 2024-09-13T16:06:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.938+0000 7f8e832cc740 20 client.26027 trim_cache size 0 max 16384 2024-09-13T16:06:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:06:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:06:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:06:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:06:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.940+0000 7f8e80400640 1 -- 172.21.15.17:0/2455226337 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8e600a1090 msgr2=0x7f8e600a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.940+0000 7f8e80400640 1 --2- 172.21.15.17:0/2455226337 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8e600a1090 0x7f8e600a3550 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8e6402a9e0 tx=0x7f8e6402a3f0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.940+0000 7f8e80400640 1 -- 172.21.15.17:0/2455226337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e781018c0 msgr2=0x7f8e7819d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.940+0000 7f8e80400640 1 --2- 172.21.15.17:0/2455226337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e781018c0 0x7f8e7819d270 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8e7000d750 tx=0x7f8e7000dc10 comp rx=0 tx=0).stop 2024-09-13T16:06:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.940+0000 7f8e80400640 1 -- 172.21.15.17:0/2455226337 shutdown_connections 2024-09-13T16:06:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.940+0000 7f8e80400640 1 --2- 172.21.15.17:0/2455226337 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8e600a1090 0x7f8e600a3550 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.940+0000 7f8e80400640 1 --2- 172.21.15.17:0/2455226337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e781018c0 0x7f8e7819d270 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.940+0000 7f8e80400640 1 --2- 172.21.15.17:0/2455226337 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e78100f00 0x7f8e78196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.940+0000 7f8e80400640 1 --2- 172.21.15.17:0/2455226337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e780ffd10 0x7f8e78195d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.940+0000 7f8e80400640 1 -- 172.21.15.17:0/2455226337 >> 172.21.15.17:0/2455226337 conn(0x7f8e780fb4b0 msgr2=0x7f8e78104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.940+0000 7f8e80400640 1 -- 172.21.15.17:0/2455226337 shutdown_connections 2024-09-13T16:06:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:33.940+0000 7f8e80400640 1 -- 172.21.15.17:0/2455226337 wait complete. 2024-09-13T16:06:34.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:33 smithi193 ceph-mon[35248]: pgmap v649: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.4 MiB/s wr, 504 op/s 2024-09-13T16:06:34.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:33 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:06:34.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:33 smithi017 ceph-mon[30494]: pgmap v649: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.4 MiB/s wr, 504 op/s 2024-09-13T16:06:34.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:33 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:06:34.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:33 smithi189 ceph-mon[34790]: pgmap v649: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.4 MiB/s wr, 504 op/s 2024-09-13T16:06:34.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:33 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:06:35.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 530.0 s, 427.4 tps, lat 231.077 ms stddev 240.897 2024-09-13T16:06:36.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:35 smithi193 ceph-mon[35248]: pgmap v650: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.5 MiB/s wr, 518 op/s 2024-09-13T16:06:36.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:35 smithi017 ceph-mon[30494]: pgmap v650: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.5 MiB/s wr, 518 op/s 2024-09-13T16:06:36.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:35 smithi189 ceph-mon[34790]: pgmap v650: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.5 MiB/s wr, 518 op/s 2024-09-13T16:06:38.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:37 smithi193 ceph-mon[35248]: pgmap v651: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.5 MiB/s wr, 635 op/s 2024-09-13T16:06:38.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:37 smithi017 ceph-mon[30494]: pgmap v651: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.5 MiB/s wr, 635 op/s 2024-09-13T16:06:38.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:37 smithi189 ceph-mon[34790]: pgmap v651: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.5 MiB/s wr, 635 op/s 2024-09-13T16:06:40.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:39 smithi193 ceph-mon[35248]: pgmap v652: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.8 MiB/s wr, 568 op/s 2024-09-13T16:06:40.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:39 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:06:40.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:39 smithi017 ceph-mon[30494]: pgmap v652: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.8 MiB/s wr, 568 op/s 2024-09-13T16:06:40.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:39 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:06:40.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:39 smithi189 ceph-mon[34790]: pgmap v652: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.8 MiB/s wr, 568 op/s 2024-09-13T16:06:40.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:39 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:06:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 535.0 s, 604.2 tps, lat 166.965 ms stddev 183.613 2024-09-13T16:06:42.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:41 smithi193 ceph-mon[35248]: pgmap v653: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.6 MiB/s wr, 655 op/s 2024-09-13T16:06:42.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:41 smithi017 ceph-mon[30494]: pgmap v653: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.6 MiB/s wr, 655 op/s 2024-09-13T16:06:42.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:41 smithi189 ceph-mon[34790]: pgmap v653: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.6 MiB/s wr, 655 op/s 2024-09-13T16:06:44.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:43 smithi193 ceph-mon[35248]: pgmap v654: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.4 MiB/s wr, 623 op/s 2024-09-13T16:06:44.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:43 smithi017 ceph-mon[30494]: pgmap v654: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.4 MiB/s wr, 623 op/s 2024-09-13T16:06:44.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:43 smithi189 ceph-mon[34790]: pgmap v654: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.4 MiB/s wr, 623 op/s 2024-09-13T16:06:45.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 540.0 s, 592.4 tps, lat 174.233 ms stddev 191.425 2024-09-13T16:06:46.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:45 smithi193 ceph-mon[35248]: pgmap v655: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.3 MiB/s wr, 613 op/s 2024-09-13T16:06:46.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:45 smithi017 ceph-mon[30494]: pgmap v655: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.3 MiB/s wr, 613 op/s 2024-09-13T16:06:46.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:45 smithi189 ceph-mon[34790]: pgmap v655: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.3 MiB/s wr, 613 op/s 2024-09-13T16:06:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.205+0000 7f5dda400640 1 -- 172.21.15.17:0/2971478393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5dd40fe430 msgr2=0x7f5dd4100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.205+0000 7f5dda400640 1 --2- 172.21.15.17:0/2971478393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5dd40fe430 0x7f5dd4100840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8009900 tx=0x7f5dc802a410 comp rx=0 tx=0).stop 2024-09-13T16:06:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.205+0000 7f5dda400640 1 -- 172.21.15.17:0/2971478393 shutdown_connections 2024-09-13T16:06:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.205+0000 7f5dda400640 1 --2- 172.21.15.17:0/2971478393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dd4103730 0x7f5dd4103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.205+0000 7f5dda400640 1 --2- 172.21.15.17:0/2971478393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5dd4100d80 0x7f5dd41031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.205+0000 7f5dda400640 1 --2- 172.21.15.17:0/2971478393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5dd40fe430 0x7f5dd4100840 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.205+0000 7f5dda400640 1 -- 172.21.15.17:0/2971478393 >> 172.21.15.17:0/2971478393 conn(0x7f5dd40fa1c0 msgr2=0x7f5dd40fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:47.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.206+0000 7f5dda400640 1 -- 172.21.15.17:0/2971478393 shutdown_connections 2024-09-13T16:06:47.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.206+0000 7f5dda400640 1 -- 172.21.15.17:0/2971478393 wait complete. 2024-09-13T16:06:47.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.208+0000 7f5dda400640 1 Processor -- start 2024-09-13T16:06:47.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.209+0000 7f5dda400640 1 -- start start 2024-09-13T16:06:47.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.209+0000 7f5dda400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5dd40fe430 0x7f5dd419c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:47.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.209+0000 7f5dda400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5dd4100d80 0x7f5dd419c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:47.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.209+0000 7f5dda400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dd4103730 0x7f5dd41a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:47.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.209+0000 7f5dda400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd41a3d30 con 0x7f5dd4103730 2024-09-13T16:06:47.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.209+0000 7f5dda400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd41a3ea0 con 0x7f5dd4100d80 2024-09-13T16:06:47.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.209+0000 7f5dda400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd41a4060 con 0x7f5dd40fe430 2024-09-13T16:06:47.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.210+0000 7f5dd9000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5dd40fe430 0x7f5dd419c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:47.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.210+0000 7f5dd9000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5dd40fe430 0x7f5dd419c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:44512/0 (socket says 172.21.15.17:44512) 2024-09-13T16:06:47.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.210+0000 7f5dd9000640 1 -- 172.21.15.17:0/4256938249 learned_addr learned my addr 172.21.15.17:0/4256938249 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:06:47.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.210+0000 7f5dd9a00640 1 --2- 172.21.15.17:0/4256938249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dd4103730 0x7f5dd41a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:47.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.211+0000 7f5dd9000640 1 -- 172.21.15.17:0/4256938249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5dd4100d80 msgr2=0x7f5dd419c780 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T16:06:47.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.211+0000 7f5dd9000640 1 --2- 172.21.15.17:0/4256938249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5dd4100d80 0x7f5dd419c780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.211+0000 7f5dd9000640 1 -- 172.21.15.17:0/4256938249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dd4103730 msgr2=0x7f5dd41a37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:47.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.211+0000 7f5dd9000640 1 --2- 172.21.15.17:0/4256938249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dd4103730 0x7f5dd41a37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.211+0000 7f5dd9000640 1 -- 172.21.15.17:0/4256938249 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc8009560 con 0x7f5dd40fe430 2024-09-13T16:06:47.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.212+0000 7f5dd9000640 1 --2- 172.21.15.17:0/4256938249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5dd40fe430 0x7f5dd419c240 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8031500 tx=0x7f5dc8003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:47.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.212+0000 7f5dd1600640 1 -- 172.21.15.17:0/4256938249 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8003e00 con 0x7f5dd40fe430 2024-09-13T16:06:47.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.212+0000 7f5dd1600640 1 -- 172.21.15.17:0/4256938249 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5dc8031c70 con 0x7f5dd40fe430 2024-09-13T16:06:47.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.212+0000 7f5dd1600640 1 -- 172.21.15.17:0/4256938249 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc803bd80 con 0x7f5dd40fe430 2024-09-13T16:06:47.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.212+0000 7f5dda400640 1 -- 172.21.15.17:0/4256938249 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd41a42e0 con 0x7f5dd40fe430 2024-09-13T16:06:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.213+0000 7f5dda400640 1 -- 172.21.15.17:0/4256938249 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd41a4810 con 0x7f5dd40fe430 2024-09-13T16:06:47.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.218+0000 7f5dd1600640 1 -- 172.21.15.17:0/4256938249 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5dc803b460 con 0x7f5dd40fe430 2024-09-13T16:06:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.219+0000 7f5dde886740 1 Processor -- start 2024-09-13T16:06:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.219+0000 7f5dde886740 1 -- start start 2024-09-13T16:06:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.220+0000 7f5dd1600640 1 --2- 172.21.15.17:0/4256938249 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5dbc0a12a0 0x7f5dbc0a3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.220+0000 7f5dde886740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab22cf3c90 0x55ab22cf4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.220+0000 7f5dde886740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf45d0 0x55ab22cf9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.220+0000 7f5dde886740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf9660 0x55ab22cfbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:47.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.220+0000 7f5dde886740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab22beebb0 con 0x55ab22cf3c90 2024-09-13T16:06:47.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.220+0000 7f5dde886740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab22c4ca70 con 0x55ab22cf9660 2024-09-13T16:06:47.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.220+0000 7f5dde886740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab22c4a200 con 0x55ab22cf45d0 2024-09-13T16:06:47.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.221+0000 7f5dd9a00640 1 --2- 172.21.15.17:0/4256938249 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5dbc0a12a0 0x7f5dbc0a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:47.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.221+0000 7f5dd3e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf45d0 0x55ab22cf9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:47.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.221+0000 7f5dd3e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf45d0 0x55ab22cf9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:44520/0 (socket says 172.21.15.17:44520) 2024-09-13T16:06:47.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.221+0000 7f5dd3e00640 1 -- 172.21.15.17:0/1547040597 learned_addr learned my addr 172.21.15.17:0/1547040597 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:06:47.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.221+0000 7f5dd1600640 1 -- 172.21.15.17:0/4256938249 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f5dc80ed600 con 0x7f5dd40fe430 2024-09-13T16:06:47.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.221+0000 7f5dd9a00640 1 --2- 172.21.15.17:0/1547040597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf9660 0x55ab22cfbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:47.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.222+0000 7f5dd3e00640 1 -- 172.21.15.17:0/1547040597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf9660 msgr2=0x55ab22cfbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:47.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.222+0000 7f5dd3e00640 1 --2- 172.21.15.17:0/1547040597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf9660 0x55ab22cfbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.222+0000 7f5dd3e00640 1 -- 172.21.15.17:0/1547040597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab22cf3c90 msgr2=0x55ab22cf4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:47.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.222+0000 7f5dd3e00640 1 --2- 172.21.15.17:0/1547040597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab22cf3c90 0x55ab22cf4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.222+0000 7f5dd3e00640 1 -- 172.21.15.17:0/1547040597 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab22be7940 con 0x55ab22cf45d0 2024-09-13T16:06:47.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.223+0000 7f5dd3e00640 1 --2- 172.21.15.17:0/1547040597 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf45d0 0x55ab22cf9090 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009b70 tx=0x7f5dc000e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bf80c900423bd27 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.223+0000 7f5dc6000640 1 -- 172.21.15.17:0/1547040597 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0009e60 con 0x55ab22cf45d0 2024-09-13T16:06:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.223+0000 7f5dc6000640 1 -- 172.21.15.17:0/1547040597 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5dc00054e0 con 0x55ab22cf45d0 2024-09-13T16:06:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.223+0000 7f5dc6000640 1 -- 172.21.15.17:0/1547040597 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0010430 con 0x55ab22cf45d0 2024-09-13T16:06:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.224+0000 7f5dd9a00640 1 --2- 172.21.15.17:0/4256938249 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5dbc0a12a0 0x7f5dbc0a3760 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00cc70 tx=0x7f5dcc00c760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:47.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.227+0000 7f5dde886740 1 -- 172.21.15.17:0/1547040597 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf45d0 msgr2=0x55ab22cf9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.227+0000 7f5dde886740 1 --2- 172.21.15.17:0/1547040597 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf45d0 0x55ab22cf9090 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009b70 tx=0x7f5dc000e720 comp rx=0 tx=0).stop 2024-09-13T16:06:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.227+0000 7f5dde886740 1 -- 172.21.15.17:0/1547040597 shutdown_connections 2024-09-13T16:06:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.227+0000 7f5dde886740 1 --2- 172.21.15.17:0/1547040597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf9660 0x55ab22cfbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.227+0000 7f5dde886740 1 --2- 172.21.15.17:0/1547040597 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf45d0 0x55ab22cf9090 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.227+0000 7f5dde886740 1 --2- 172.21.15.17:0/1547040597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab22cf3c90 0x55ab22cf4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.227+0000 7f5dde886740 1 -- 172.21.15.17:0/1547040597 >> 172.21.15.17:0/1547040597 conn(0x55ab22cde2f0 msgr2=0x55ab22cde6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.228+0000 7f5dde886740 1 -- 172.21.15.17:0/1547040597 shutdown_connections 2024-09-13T16:06:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.228+0000 7f5dde886740 1 -- 172.21.15.17:0/1547040597 wait complete. 2024-09-13T16:06:47.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.229+0000 7f5dde886740 1 -- start start 2024-09-13T16:06:47.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.229+0000 7f5dde886740 1 Processor -- start 2024-09-13T16:06:47.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.230+0000 7f5dde886740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab22cf3c90 0x55ab22cfd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:47.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.230+0000 7f5dde886740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf45d0 0x55ab22cfdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:47.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.231+0000 7f5dde886740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf9660 0x55ab22d04f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.231+0000 7f5dde886740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab22c45af0 con 0x55ab22cf3c90 2024-09-13T16:06:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.231+0000 7f5dd3e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf45d0 0x55ab22cfdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.231+0000 7f5dd3e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf45d0 0x55ab22cfdf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:44526/0 (socket says 172.21.15.17:44526) 2024-09-13T16:06:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.231+0000 7f5dd3e00640 1 -- 172.21.15.17:0/3070603760 learned_addr learned my addr 172.21.15.17:0/3070603760 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:06:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.231+0000 7f5dde886740 1 -- 172.21.15.17:0/3070603760 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab22c03f20 con 0x55ab22cf9660 2024-09-13T16:06:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.231+0000 7f5dde886740 1 -- 172.21.15.17:0/3070603760 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab22c03bc0 con 0x55ab22cf45d0 2024-09-13T16:06:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.231+0000 7f5dd9a00640 1 --2- 172.21.15.17:0/3070603760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf9660 0x55ab22d04f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.231+0000 7f5dde886740 10 client.0 _ll_register_callbacks cb 0x55ab22c35a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:06:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.232+0000 7f5dd9000640 1 --2- 172.21.15.17:0/3070603760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab22cf3c90 0x55ab22cfd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.232+0000 7f5dd9a00640 1 -- 172.21.15.17:0/3070603760 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf45d0 msgr2=0x55ab22cfdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.232+0000 7f5dd9a00640 1 --2- 172.21.15.17:0/3070603760 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf45d0 0x55ab22cfdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.232+0000 7f5dd9a00640 1 -- 172.21.15.17:0/3070603760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab22cf3c90 msgr2=0x55ab22cfd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.232+0000 7f5dd9a00640 1 --2- 172.21.15.17:0/3070603760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab22cf3c90 0x55ab22cfd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.232+0000 7f5dd9a00640 1 -- 172.21.15.17:0/3070603760 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc0009820 con 0x55ab22cf9660 2024-09-13T16:06:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.232+0000 7f5dd9000640 1 --2- 172.21.15.17:0/3070603760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab22cf3c90 0x55ab22cfd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:06:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.233+0000 7f5dd9a00640 1 --2- 172.21.15.17:0/3070603760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf9660 0x55ab22d04f60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc01d640 tx=0x7f5dcc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7433494f55589eeb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.233+0000 7f5dbaa00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:06:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.233+0000 7f5dbaa00640 1 -- 172.21.15.17:0/3070603760 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc00c480 con 0x55ab22cf9660 2024-09-13T16:06:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.233+0000 7f5dbaa00640 1 -- 172.21.15.17:0/3070603760 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f5dcc01b600 con 0x55ab22cf9660 2024-09-13T16:06:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.233+0000 7f5dde886740 1 -- 172.21.15.17:0/3070603760 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ab22c6fc90 con 0x55ab22cf9660 2024-09-13T16:06:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.234+0000 7f5dbaa00640 1 -- 172.21.15.17:0/3070603760 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5dcc007e60 con 0x55ab22cf9660 2024-09-13T16:06:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.234+0000 7f5dde886740 10 client.26036 fetch_fsmap learned FSMap version 44 2024-09-13T16:06:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.234+0000 7f5dde886740 1 -- 172.21.15.17:0/3070603760 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55ab22c44170 con 0x55ab22cf9660 2024-09-13T16:06:47.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.235+0000 7f5dbaa00640 1 -- 172.21.15.17:0/3070603760 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ab22c6fc90 con 0x55ab22cf9660 2024-09-13T16:06:47.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.235+0000 7f5dbaa00640 1 -- 172.21.15.17:0/3070603760 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 44) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f5dcc008040 con 0x55ab22cf9660 2024-09-13T16:06:47.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.235+0000 7f5dde886740 10 client.26036 fetch_fsmap finished waiting for FSMap version 44 2024-09-13T16:06:47.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.235+0000 7f5dde886740 10 client.26036 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:06:47.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.235+0000 7f5dde886740 20 client.26036 populate_metadata read hostname 'smithi017' 2024-09-13T16:06:47.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.235+0000 7f5dde886740 1 --2- 172.21.15.17:0/3070603760 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55ab22d09700 0x55ab22d0bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:47.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.235+0000 7f5dde886740 4 client.26036 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:06:47.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.235+0000 7f5dde886740 1 -- 172.21.15.17:0/3070603760 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ab22c387d0 con 0x55ab22d09700 2024-09-13T16:06:47.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.236+0000 7f5dd9000640 1 --2- 172.21.15.17:0/3070603760 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55ab22d09700 0x55ab22d0bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:47.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.238+0000 7f5dd9000640 1 --2- 172.21.15.17:0/3070603760 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55ab22d09700 0x55ab22d0bb20 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77fc36973ed9119d server_cookie=9f8642ba50f72896 in_seq=0 out_seq=0 2024-09-13T16:06:47.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.238+0000 7f5dbaa00640 10 client.26036 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:06:47.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.239+0000 7f5dbaa00640 1 -- 172.21.15.17:0/3070603760 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ab22c387d0 con 0x55ab22d09700 2024-09-13T16:06:47.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.239+0000 7f5dbaa00640 10 client.26036 handle_command_reply: tid=0 2024-09-13T16:06:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.239+0000 7f5dde886740 1 client.26036 shutdown 2024-09-13T16:06:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.240+0000 7f5dde886740 1 -- 172.21.15.17:0/3070603760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf9660 msgr2=0x55ab22d04f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.240+0000 7f5dde886740 1 --2- 172.21.15.17:0/3070603760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf9660 0x55ab22d04f60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc01d640 tx=0x7f5dcc004a40 comp rx=0 tx=0).stop 2024-09-13T16:06:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.240+0000 7f5dde886740 1 -- 172.21.15.17:0/3070603760 shutdown_connections 2024-09-13T16:06:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.240+0000 7f5dde886740 1 --2- 172.21.15.17:0/3070603760 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55ab22d09700 0x55ab22d0bb20 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.240+0000 7f5dde886740 1 --2- 172.21.15.17:0/3070603760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf9660 0x55ab22d04f60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.240+0000 7f5dde886740 1 --2- 172.21.15.17:0/3070603760 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf45d0 0x55ab22cfdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.240+0000 7f5dde886740 1 --2- 172.21.15.17:0/3070603760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab22cf3c90 0x55ab22cfd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.240+0000 7f5dbaa00640 0 client.26036 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:06:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.240+0000 7f5dde886740 1 -- 172.21.15.17:0/3070603760 >> 172.21.15.17:0/3070603760 conn(0x55ab22cde2f0 msgr2=0x55ab22cdfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.240+0000 7f5dde886740 1 -- 172.21.15.17:0/3070603760 shutdown_connections 2024-09-13T16:06:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.240+0000 7f5dde886740 1 -- 172.21.15.17:0/3070603760 wait complete. 2024-09-13T16:06:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.241+0000 7f5dde886740 20 client.26036 trim_cache size 0 max 16384 2024-09-13T16:06:47.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.269+0000 7f5dde886740 1 Processor -- start 2024-09-13T16:06:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.270+0000 7f5dde886740 1 -- start start 2024-09-13T16:06:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.270+0000 7f5dde886740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf3c90 0x55ab22d10480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.270+0000 7f5dde886740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab22cf45d0 0x55ab22d04f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.270+0000 7f5dde886740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf9660 0x55ab22cf5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.270+0000 7f5dde886740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab229ace60 con 0x55ab22cf45d0 2024-09-13T16:06:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.270+0000 7f5dde886740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab22cd9ce0 con 0x55ab22cf9660 2024-09-13T16:06:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.270+0000 7f5dde886740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab22cf3910 con 0x55ab22cf3c90 2024-09-13T16:06:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.271+0000 7f5dd9000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf3c90 0x55ab22d10480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.271+0000 7f5dd9000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf3c90 0x55ab22d10480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:44540/0 (socket says 172.21.15.17:44540) 2024-09-13T16:06:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.271+0000 7f5dd9000640 1 -- 172.21.15.17:0/1781565255 learned_addr learned my addr 172.21.15.17:0/1781565255 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:06:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.271+0000 7f5dd9a00640 1 --2- 172.21.15.17:0/1781565255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf9660 0x55ab22cf5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.271+0000 7f5dd9000640 1 -- 172.21.15.17:0/1781565255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf9660 msgr2=0x55ab22cf5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.272+0000 7f5dd9000640 1 --2- 172.21.15.17:0/1781565255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf9660 0x55ab22cf5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.272+0000 7f5dd9000640 1 -- 172.21.15.17:0/1781565255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab22cf45d0 msgr2=0x55ab22d04f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.272+0000 7f5dd9000640 1 --2- 172.21.15.17:0/1781565255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab22cf45d0 0x55ab22d04f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.272+0000 7f5dd9000640 1 -- 172.21.15.17:0/1781565255 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab22be6180 con 0x55ab22cf3c90 2024-09-13T16:06:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.272+0000 7f5dd9a00640 1 --2- 172.21.15.17:0/1781565255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf9660 0x55ab22cf5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:06:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.272+0000 7f5dd9000640 1 --2- 172.21.15.17:0/1781565255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf3c90 0x55ab22d10480 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5dc80ead50 tx=0x7f5dc8005be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d6b6525b5cf77e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:47.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.273+0000 7f5dc6a00640 1 -- 172.21.15.17:0/1781565255 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc80c2b20 con 0x55ab22cf3c90 2024-09-13T16:06:47.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.273+0000 7f5dc6a00640 1 -- 172.21.15.17:0/1781565255 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5dc80b87e0 con 0x55ab22cf3c90 2024-09-13T16:06:47.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.273+0000 7f5dc6a00640 1 -- 172.21.15.17:0/1781565255 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc80a51f0 con 0x55ab22cf3c90 2024-09-13T16:06:47.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.276+0000 7f5dde886740 1 -- 172.21.15.17:0/1781565255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf3c90 msgr2=0x55ab22d10480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:47.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.276+0000 7f5dde886740 1 --2- 172.21.15.17:0/1781565255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf3c90 0x55ab22d10480 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5dc80ead50 tx=0x7f5dc8005be0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.277+0000 7f5dde886740 1 -- 172.21.15.17:0/1781565255 shutdown_connections 2024-09-13T16:06:47.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.277+0000 7f5dde886740 1 --2- 172.21.15.17:0/1781565255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf9660 0x55ab22cf5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.277+0000 7f5dde886740 1 --2- 172.21.15.17:0/1781565255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab22cf45d0 0x55ab22d04f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.277+0000 7f5dde886740 1 --2- 172.21.15.17:0/1781565255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf3c90 0x55ab22d10480 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.277+0000 7f5dde886740 1 -- 172.21.15.17:0/1781565255 >> 172.21.15.17:0/1781565255 conn(0x55ab22cde2f0 msgr2=0x55ab22cf8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:47.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.277+0000 7f5dde886740 1 -- 172.21.15.17:0/1781565255 shutdown_connections 2024-09-13T16:06:47.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.277+0000 7f5dde886740 1 -- 172.21.15.17:0/1781565255 wait complete. 2024-09-13T16:06:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.278+0000 7f5dde886740 1 -- start start 2024-09-13T16:06:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.278+0000 7f5dde886740 1 Processor -- start 2024-09-13T16:06:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.283+0000 7f5dde886740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab22cf3c90 0x55ab22d00d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:47.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.283+0000 7f5dde886740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf45d0 0x55ab22d01290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:47.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.284+0000 7f5dde886740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf9660 0x55ab22d04210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.284+0000 7f5dde886740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab22d04750 con 0x55ab22cf3c90 2024-09-13T16:06:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.284+0000 7f5dde886740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab22d048c0 con 0x55ab22cf45d0 2024-09-13T16:06:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.284+0000 7f5dde886740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab22d04a80 con 0x55ab22cf9660 2024-09-13T16:06:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.284+0000 7f5dde886740 10 client.0 _ll_register_callbacks cb 0x7f5dc0009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:06:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.284+0000 7f5dd9000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab22cf3c90 0x55ab22d00d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.284+0000 7f5dd9000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab22cf3c90 0x55ab22d00d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57358/0 (socket says 172.21.15.17:57358) 2024-09-13T16:06:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.284+0000 7f5dd9000640 1 -- 172.21.15.17:0/3528507972 learned_addr learned my addr 172.21.15.17:0/3528507972 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:06:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.285+0000 7f5dd9000640 1 -- 172.21.15.17:0/3528507972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf9660 msgr2=0x55ab22d04210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.285+0000 7f5dd9000640 1 --2- 172.21.15.17:0/3528507972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf9660 0x55ab22d04210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.285+0000 7f5dd9000640 1 -- 172.21.15.17:0/3528507972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf45d0 msgr2=0x55ab22d01290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:06:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.284+0000 7f5dd3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf45d0 0x55ab22d01290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.286+0000 7f5dd9000640 1 --2- 172.21.15.17:0/3528507972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf45d0 0x55ab22d01290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.286+0000 7f5dd9000640 1 -- 172.21.15.17:0/3528507972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd41a4810 con 0x55ab22cf3c90 2024-09-13T16:06:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.286+0000 7f5dd3e00640 1 --2- 172.21.15.17:0/3528507972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf45d0 0x55ab22d01290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:06:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.286+0000 7f5dd9000640 1 --2- 172.21.15.17:0/3528507972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab22cf3c90 0x55ab22d00d50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5dc803bfd0 tx=0x7f5dc8003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5874ba29cd02af79 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:06:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.286+0000 7f5dbaa00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T16:06:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.287+0000 7f5dbaa00640 1 -- 172.21.15.17:0/3528507972 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc80d3070 con 0x55ab22cf3c90 2024-09-13T16:06:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.287+0000 7f5dbaa00640 1 -- 172.21.15.17:0/3528507972 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f5dc80c2b20 con 0x55ab22cf3c90 2024-09-13T16:06:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.287+0000 7f5dde886740 1 -- 172.21.15.17:0/3528507972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5dc00054e0 con 0x55ab22cf3c90 2024-09-13T16:06:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.288+0000 7f5dbaa00640 1 -- 172.21.15.17:0/3528507972 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5dc80b6db0 con 0x55ab22cf3c90 2024-09-13T16:06:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.288+0000 7f5dde886740 10 client.15765 fetch_fsmap learned FSMap version 44 2024-09-13T16:06:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.288+0000 7f5dde886740 1 -- 172.21.15.17:0/3528507972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55ab22c0b560 con 0x55ab22cf3c90 2024-09-13T16:06:47.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.288+0000 7f5dbaa00640 1 -- 172.21.15.17:0/3528507972 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5dc00054e0 con 0x55ab22cf3c90 2024-09-13T16:06:47.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.288+0000 7f5dbaa00640 1 -- 172.21.15.17:0/3528507972 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 44) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f5dc80b6040 con 0x55ab22cf3c90 2024-09-13T16:06:47.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.289+0000 7f5dde886740 10 client.15765 fetch_fsmap finished waiting for FSMap version 44 2024-09-13T16:06:47.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.289+0000 7f5dde886740 10 client.15765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:06:47.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.289+0000 7f5dde886740 20 client.15765 populate_metadata read hostname 'smithi017' 2024-09-13T16:06:47.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.289+0000 7f5dde886740 1 --2- 172.21.15.17:0/3528507972 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55ab22d71910 0x55ab22d73d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:06:47.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.289+0000 7f5dde886740 4 client.15765 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:06:47.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.289+0000 7f5dde886740 1 -- 172.21.15.17:0/3528507972 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ab22939300 con 0x55ab22d71910 2024-09-13T16:06:47.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.289+0000 7f5dd3e00640 1 --2- 172.21.15.17:0/3528507972 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55ab22d71910 0x55ab22d73d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:06:47.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.290+0000 7f5dd3e00640 1 --2- 172.21.15.17:0/3528507972 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55ab22d71910 0x55ab22d73d30 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e41b0b2c468c7ad5 server_cookie=5c01d67909494ef3 in_seq=0 out_seq=0 2024-09-13T16:06:47.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.290+0000 7f5dbaa00640 10 client.15765 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:06:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.437+0000 7f5dbaa00640 1 -- 172.21.15.17:0/3528507972 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ab22939300 con 0x55ab22d71910 2024-09-13T16:06:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.437+0000 7f5dbaa00640 10 client.15765 handle_command_reply: tid=0 2024-09-13T16:06:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.437+0000 7f5dde886740 1 client.15765 shutdown 2024-09-13T16:06:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.437+0000 7f5dde886740 1 -- 172.21.15.17:0/3528507972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab22cf3c90 msgr2=0x55ab22d00d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.437+0000 7f5dde886740 1 --2- 172.21.15.17:0/3528507972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab22cf3c90 0x55ab22d00d50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5dc803bfd0 tx=0x7f5dc8003f60 comp rx=0 tx=0).stop 2024-09-13T16:06:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.438+0000 7f5dde886740 1 -- 172.21.15.17:0/3528507972 shutdown_connections 2024-09-13T16:06:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.438+0000 7f5dde886740 1 --2- 172.21.15.17:0/3528507972 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55ab22d71910 0x55ab22d73d30 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.438+0000 7f5dde886740 1 --2- 172.21.15.17:0/3528507972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ab22cf9660 0x55ab22d04210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.438+0000 7f5dde886740 1 --2- 172.21.15.17:0/3528507972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab22cf45d0 0x55ab22d01290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.438+0000 7f5dde886740 1 --2- 172.21.15.17:0/3528507972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab22cf3c90 0x55ab22d00d50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.438+0000 7f5dde886740 1 -- 172.21.15.17:0/3528507972 >> 172.21.15.17:0/3528507972 conn(0x55ab22cde2f0 msgr2=0x55ab22cf5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.438+0000 7f5dbaa00640 0 client.15765 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:06:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.438+0000 7f5dde886740 1 -- 172.21.15.17:0/3528507972 shutdown_connections 2024-09-13T16:06:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.438+0000 7f5dde886740 1 -- 172.21.15.17:0/3528507972 wait complete. 2024-09-13T16:06:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.439+0000 7f5dde886740 20 client.15765 trim_cache size 0 max 16384 2024-09-13T16:06:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:06:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:06:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:06:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:06:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.440+0000 7f5dda400640 1 -- 172.21.15.17:0/4256938249 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5dbc0a12a0 msgr2=0x7f5dbc0a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.440+0000 7f5dda400640 1 --2- 172.21.15.17:0/4256938249 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5dbc0a12a0 0x7f5dbc0a3760 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00cc70 tx=0x7f5dcc00c760 comp rx=0 tx=0).stop 2024-09-13T16:06:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.440+0000 7f5dda400640 1 -- 172.21.15.17:0/4256938249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5dd40fe430 msgr2=0x7f5dd419c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:06:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.440+0000 7f5dda400640 1 --2- 172.21.15.17:0/4256938249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5dd40fe430 0x7f5dd419c240 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8031500 tx=0x7f5dc8003c10 comp rx=0 tx=0).stop 2024-09-13T16:06:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.440+0000 7f5dda400640 1 -- 172.21.15.17:0/4256938249 shutdown_connections 2024-09-13T16:06:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.440+0000 7f5dda400640 1 --2- 172.21.15.17:0/4256938249 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f5dbc0a12a0 0x7f5dbc0a3760 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.440+0000 7f5dda400640 1 --2- 172.21.15.17:0/4256938249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dd4103730 0x7f5dd41a37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.440+0000 7f5dda400640 1 --2- 172.21.15.17:0/4256938249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5dd4100d80 0x7f5dd419c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.440+0000 7f5dda400640 1 --2- 172.21.15.17:0/4256938249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5dd40fe430 0x7f5dd419c240 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:06:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.440+0000 7f5dda400640 1 -- 172.21.15.17:0/4256938249 >> 172.21.15.17:0/4256938249 conn(0x7f5dd40fa1c0 msgr2=0x7f5dd41016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:06:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.441+0000 7f5dda400640 1 -- 172.21.15.17:0/4256938249 shutdown_connections 2024-09-13T16:06:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:06:47.441+0000 7f5dda400640 1 -- 172.21.15.17:0/4256938249 wait complete. 2024-09-13T16:06:48.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:47 smithi193 ceph-mon[35248]: pgmap v656: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.5 MiB/s wr, 647 op/s 2024-09-13T16:06:48.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:47 smithi017 ceph-mon[30494]: pgmap v656: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.5 MiB/s wr, 647 op/s 2024-09-13T16:06:48.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:47 smithi189 ceph-mon[34790]: pgmap v656: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.5 MiB/s wr, 647 op/s 2024-09-13T16:06:50.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:49 smithi189 ceph-mon[34790]: pgmap v657: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.4 MiB/s wr, 514 op/s 2024-09-13T16:06:50.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:49 smithi193 ceph-mon[35248]: pgmap v657: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.4 MiB/s wr, 514 op/s 2024-09-13T16:06:50.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:49 smithi017 ceph-mon[30494]: pgmap v657: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.4 MiB/s wr, 514 op/s 2024-09-13T16:06:50.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 545.0 s, 1001.9 tps, lat 96.726 ms stddev 115.692 2024-09-13T16:06:52.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:51 smithi189 ceph-mon[34790]: pgmap v658: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.6 MiB/s wr, 627 op/s 2024-09-13T16:06:52.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:51 smithi193 ceph-mon[35248]: pgmap v658: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.6 MiB/s wr, 627 op/s 2024-09-13T16:06:52.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:51 smithi017 ceph-mon[30494]: pgmap v658: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.6 MiB/s wr, 627 op/s 2024-09-13T16:06:54.064 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:53 smithi017 ceph-mon[30494]: pgmap v659: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.9 MiB/s wr, 545 op/s 2024-09-13T16:06:54.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:53 smithi189 ceph-mon[34790]: pgmap v659: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.9 MiB/s wr, 545 op/s 2024-09-13T16:06:54.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:53 smithi193 ceph-mon[35248]: pgmap v659: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.9 MiB/s wr, 545 op/s 2024-09-13T16:06:55.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 550.0 s, 579.0 tps, lat 175.729 ms stddev 230.675 2024-09-13T16:06:56.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:55 smithi189 ceph-mon[34790]: pgmap v660: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.5 MiB/s wr, 526 op/s 2024-09-13T16:06:56.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:55 smithi193 ceph-mon[35248]: pgmap v660: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.5 MiB/s wr, 526 op/s 2024-09-13T16:06:56.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:55 smithi017 ceph-mon[30494]: pgmap v660: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.5 MiB/s wr, 526 op/s 2024-09-13T16:06:58.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:57 smithi189 ceph-mon[34790]: pgmap v661: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.0 MiB/s wr, 569 op/s 2024-09-13T16:06:58.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:57 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:06:58.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:57 smithi193 ceph-mon[35248]: pgmap v661: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.0 MiB/s wr, 569 op/s 2024-09-13T16:06:58.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:57 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:06:58.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:57 smithi017 ceph-mon[30494]: pgmap v661: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.0 MiB/s wr, 569 op/s 2024-09-13T16:06:58.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:57 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:07:00.056 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:06:59 smithi193 ceph-mon[35248]: pgmap v662: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.6 MiB/s wr, 504 op/s 2024-09-13T16:07:00.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:06:59 smithi189 ceph-mon[34790]: pgmap v662: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.6 MiB/s wr, 504 op/s 2024-09-13T16:07:00.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:06:59 smithi017 ceph-mon[30494]: pgmap v662: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.6 MiB/s wr, 504 op/s 2024-09-13T16:07:00.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 555.0 s, 594.2 tps, lat 162.472 ms stddev 234.084 2024-09-13T16:07:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.695+0000 7f0c46a00640 1 -- 172.21.15.17:0/3979935012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c40107d30 msgr2=0x7f0c4010e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.695+0000 7f0c46a00640 1 --2- 172.21.15.17:0/3979935012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c40107d30 0x7f0c4010e5e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009be0 tx=0x7f0c3802a6c0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.695+0000 7f0c46a00640 1 -- 172.21.15.17:0/3979935012 shutdown_connections 2024-09-13T16:07:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.695+0000 7f0c46a00640 1 --2- 172.21.15.17:0/3979935012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c40107d30 0x7f0c4010e5e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.695+0000 7f0c46a00640 1 --2- 172.21.15.17:0/3979935012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c40107390 0x7f0c401077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.695+0000 7f0c46a00640 1 --2- 172.21.15.17:0/3979935012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c40106680 0x7f0c40106aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.695+0000 7f0c46a00640 1 -- 172.21.15.17:0/3979935012 >> 172.21.15.17:0/3979935012 conn(0x7f0c400754c0 msgr2=0x7f0c40077900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:00.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.695+0000 7f0c46a00640 1 -- 172.21.15.17:0/3979935012 shutdown_connections 2024-09-13T16:07:00.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.695+0000 7f0c46a00640 1 -- 172.21.15.17:0/3979935012 wait complete. 2024-09-13T16:07:00.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.699+0000 7f0c46a00640 1 Processor -- start 2024-09-13T16:07:00.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.699+0000 7f0c46a00640 1 -- start start 2024-09-13T16:07:00.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.699+0000 7f0c46a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c40106680 0x7f0c4019c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:00.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.699+0000 7f0c46a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c40107390 0x7f0c4019c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:00.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.699+0000 7f0c46a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c40107d30 0x7f0c401a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:00.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.699+0000 7f0c46a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c401a3c20 con 0x7f0c40107d30 2024-09-13T16:07:00.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.699+0000 7f0c46a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c40078d30 con 0x7f0c40106680 2024-09-13T16:07:00.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.699+0000 7f0c46a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c40078ef0 con 0x7f0c40107390 2024-09-13T16:07:00.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.700+0000 7f0c46000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c40107d30 0x7f0c401a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.701+0000 7f0c45600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c40106680 0x7f0c4019c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.701+0000 7f0c45600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c40106680 0x7f0c4019c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:55532/0 (socket says 172.21.15.17:55532) 2024-09-13T16:07:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.701+0000 7f0c45600640 1 -- 172.21.15.17:0/2126630662 learned_addr learned my addr 172.21.15.17:0/2126630662 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.701+0000 7f0c44c00640 1 --2- 172.21.15.17:0/2126630662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c40107390 0x7f0c4019c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.702+0000 7f0c45600640 1 -- 172.21.15.17:0/2126630662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c40107390 msgr2=0x7f0c4019c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.702+0000 7f0c45600640 1 --2- 172.21.15.17:0/2126630662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c40107390 0x7f0c4019c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.702+0000 7f0c45600640 1 -- 172.21.15.17:0/2126630662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c40107d30 msgr2=0x7f0c401a36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.702+0000 7f0c45600640 1 --2- 172.21.15.17:0/2126630662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c40107d30 0x7f0c401a36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.702+0000 7f0c45600640 1 -- 172.21.15.17:0/2126630662 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c34009490 con 0x7f0c40106680 2024-09-13T16:07:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.703+0000 7f0c45600640 1 --2- 172.21.15.17:0/2126630662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c40106680 0x7f0c4019c130 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000d950 tx=0x7f0c3000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.704+0000 7f0c3e000640 1 -- 172.21.15.17:0/2126630662 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c30009c30 con 0x7f0c40106680 2024-09-13T16:07:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.704+0000 7f0c3e000640 1 -- 172.21.15.17:0/2126630662 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c30009d90 con 0x7f0c40106680 2024-09-13T16:07:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.704+0000 7f0c3e000640 1 -- 172.21.15.17:0/2126630662 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3000f740 con 0x7f0c40106680 2024-09-13T16:07:00.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.704+0000 7f0c46a00640 1 -- 172.21.15.17:0/2126630662 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c38009840 con 0x7f0c40106680 2024-09-13T16:07:00.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.707+0000 7f0c46a00640 1 -- 172.21.15.17:0/2126630662 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c40079440 con 0x7f0c40106680 2024-09-13T16:07:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.712+0000 7f0c4ae72740 1 Processor -- start 2024-09-13T16:07:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.714+0000 7f0c3e000640 1 -- 172.21.15.17:0/2126630662 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0c30010a20 con 0x7f0c40106680 2024-09-13T16:07:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.714+0000 7f0c4ae72740 1 -- start start 2024-09-13T16:07:00.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.714+0000 7f0c4ae72740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6fb61c80 0x55bb6fb62080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:00.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.714+0000 7f0c4ae72740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb625c0 0x55bb6fb67080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:00.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.714+0000 7f0c4ae72740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6fb67650 0x55bb6fb69b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:00.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.714+0000 7f0c4ae72740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6fa6dbb0 con 0x55bb6fb61c80 2024-09-13T16:07:00.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.714+0000 7f0c4ae72740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6facba70 con 0x55bb6fb67650 2024-09-13T16:07:00.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.714+0000 7f0c4ae72740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6fac9200 con 0x55bb6fb625c0 2024-09-13T16:07:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.716+0000 7f0c45600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb625c0 0x55bb6fb67080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.716+0000 7f0c45600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb625c0 0x55bb6fb67080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:41476/0 (socket says 172.21.15.17:41476) 2024-09-13T16:07:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.716+0000 7f0c45600640 1 -- 172.21.15.17:0/2421675933 learned_addr learned my addr 172.21.15.17:0/2421675933 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.717+0000 7f0c46000640 1 --2- 172.21.15.17:0/2421675933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6fb61c80 0x55bb6fb62080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.717+0000 7f0c45600640 1 -- 172.21.15.17:0/2421675933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6fb67650 msgr2=0x55bb6fb69b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.717+0000 7f0c45600640 1 --2- 172.21.15.17:0/2421675933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6fb67650 0x55bb6fb69b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.717+0000 7f0c45600640 1 -- 172.21.15.17:0/2421675933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6fb61c80 msgr2=0x55bb6fb62080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:00.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.717+0000 7f0c45600640 1 --2- 172.21.15.17:0/2421675933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6fb61c80 0x55bb6fb62080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.717+0000 7f0c45600640 1 -- 172.21.15.17:0/2421675933 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb6fa66940 con 0x55bb6fb625c0 2024-09-13T16:07:00.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.718+0000 7f0c45600640 1 --2- 172.21.15.17:0/2421675933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb625c0 0x55bb6fb67080 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0c300c93f0 tx=0x7f0c300cf540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdffe32b5d3ac3c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:00.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.719+0000 7f0c2ea00640 1 -- 172.21.15.17:0/2421675933 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c300c98d0 con 0x55bb6fb625c0 2024-09-13T16:07:00.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.719+0000 7f0c2ea00640 1 -- 172.21.15.17:0/2421675933 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c300cb110 con 0x55bb6fb625c0 2024-09-13T16:07:00.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.719+0000 7f0c2ea00640 1 -- 172.21.15.17:0/2421675933 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c300c98d0 con 0x55bb6fb625c0 2024-09-13T16:07:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.720+0000 7f0c4ae72740 1 -- 172.21.15.17:0/2421675933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb625c0 msgr2=0x55bb6fb67080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.720+0000 7f0c4ae72740 1 --2- 172.21.15.17:0/2421675933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb625c0 0x55bb6fb67080 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0c300c93f0 tx=0x7f0c300cf540 comp rx=0 tx=0).stop 2024-09-13T16:07:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.721+0000 7f0c3e000640 1 --2- 172.21.15.17:0/2126630662 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0c280a1200 0x7f0c280a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.721+0000 7f0c3e000640 1 -- 172.21.15.17:0/2126630662 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f0c300ccbc0 con 0x7f0c40106680 2024-09-13T16:07:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.721+0000 7f0c4ae72740 1 -- 172.21.15.17:0/2421675933 shutdown_connections 2024-09-13T16:07:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.721+0000 7f0c4ae72740 1 --2- 172.21.15.17:0/2421675933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6fb67650 0x55bb6fb69b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.721+0000 7f0c4ae72740 1 --2- 172.21.15.17:0/2421675933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb625c0 0x55bb6fb67080 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.721+0000 7f0c4ae72740 1 --2- 172.21.15.17:0/2421675933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6fb61c80 0x55bb6fb62080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.721+0000 7f0c4ae72740 1 -- 172.21.15.17:0/2421675933 >> 172.21.15.17:0/2421675933 conn(0x55bb6fb5d2f0 msgr2=0x55bb6fb5d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.722+0000 7f0c4ae72740 1 -- 172.21.15.17:0/2421675933 shutdown_connections 2024-09-13T16:07:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.722+0000 7f0c46000640 1 --2- 172.21.15.17:0/2126630662 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0c280a1200 0x7f0c280a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.723+0000 7f0c4ae72740 1 -- 172.21.15.17:0/2421675933 wait complete. 2024-09-13T16:07:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.724+0000 7f0c46000640 1 --2- 172.21.15.17:0/2126630662 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0c280a1200 0x7f0c280a36c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0c38006010 tx=0x7f0c38031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.724+0000 7f0c4ae72740 1 -- start start 2024-09-13T16:07:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.724+0000 7f0c4ae72740 1 Processor -- start 2024-09-13T16:07:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.727+0000 7f0c4ae72740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb61c80 0x55bb6fb6b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:00.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.727+0000 7f0c4ae72740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6fb625c0 0x55bb6fb6be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:00.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.727+0000 7f0c4ae72740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6fb67650 0x55bb6fb72e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:00.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.728+0000 7f0c4ae72740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6fac4af0 con 0x55bb6fb67650 2024-09-13T16:07:00.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.728+0000 7f0c4ae72740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6fa82f20 con 0x55bb6fb625c0 2024-09-13T16:07:00.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.728+0000 7f0c4ae72740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6fa82bc0 con 0x55bb6fb61c80 2024-09-13T16:07:00.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.728+0000 7f0c44c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6fb625c0 0x55bb6fb6be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:00.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.728+0000 7f0c44c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6fb625c0 0x55bb6fb6be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:55548/0 (socket says 172.21.15.17:55548) 2024-09-13T16:07:00.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.728+0000 7f0c44c00640 1 -- 172.21.15.17:0/729299910 learned_addr learned my addr 172.21.15.17:0/729299910 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:00.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.728+0000 7f0c4ae72740 10 client.0 _ll_register_callbacks cb 0x55bb6fab4a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:07:00.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.728+0000 7f0c46000640 1 --2- 172.21.15.17:0/729299910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6fb67650 0x55bb6fb72e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.729+0000 7f0c46000640 1 -- 172.21.15.17:0/729299910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb61c80 msgr2=0x55bb6fb6b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.729+0000 7f0c46000640 1 --2- 172.21.15.17:0/729299910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb61c80 0x55bb6fb6b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.729+0000 7f0c46000640 1 -- 172.21.15.17:0/729299910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6fb625c0 msgr2=0x55bb6fb6be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.729+0000 7f0c46000640 1 --2- 172.21.15.17:0/729299910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6fb625c0 0x55bb6fb6be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.729+0000 7f0c46000640 1 -- 172.21.15.17:0/729299910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c40079440 con 0x55bb6fb67650 2024-09-13T16:07:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.733+0000 7f0c46000640 1 --2- 172.21.15.17:0/729299910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6fb67650 0x55bb6fb72e90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0c38030860 tx=0x7f0c3802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d8698d44944fa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.733+0000 7f0c23400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T16:07:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.737+0000 7f0c23400640 1 -- 172.21.15.17:0/729299910 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c38004040 con 0x55bb6fb67650 2024-09-13T16:07:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.737+0000 7f0c23400640 1 -- 172.21.15.17:0/729299910 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f0c380041a0 con 0x55bb6fb67650 2024-09-13T16:07:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.737+0000 7f0c4ae72740 1 -- 172.21.15.17:0/729299910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bb6faeec90 con 0x55bb6fb67650 2024-09-13T16:07:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.738+0000 7f0c23400640 1 -- 172.21.15.17:0/729299910 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c38004360 con 0x55bb6fb67650 2024-09-13T16:07:00.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.738+0000 7f0c4ae72740 10 client.15774 fetch_fsmap learned FSMap version 45 2024-09-13T16:07:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.739+0000 7f0c4ae72740 1 -- 172.21.15.17:0/729299910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55bb6fac3170 con 0x55bb6fb67650 2024-09-13T16:07:00.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.742+0000 7f0c23400640 1 -- 172.21.15.17:0/729299910 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bb6faeec90 con 0x55bb6fb67650 2024-09-13T16:07:00.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.743+0000 7f0c23400640 1 -- 172.21.15.17:0/729299910 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 45) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f0c3804ad00 con 0x55bb6fb67650 2024-09-13T16:07:00.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.743+0000 7f0c4ae72740 10 client.15774 fetch_fsmap finished waiting for FSMap version 45 2024-09-13T16:07:00.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.743+0000 7f0c4ae72740 10 client.15774 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:07:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.743+0000 7f0c4ae72740 20 client.15774 populate_metadata read hostname 'smithi017' 2024-09-13T16:07:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.743+0000 7f0c4ae72740 1 --2- 172.21.15.17:0/729299910 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55bb6fb775b0 0x55bb6fb799d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.743+0000 7f0c4ae72740 4 client.15774 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:07:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.743+0000 7f0c4ae72740 1 -- 172.21.15.17:0/729299910 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bb6fab77d0 con 0x55bb6fb775b0 2024-09-13T16:07:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.743+0000 7f0c45600640 1 --2- 172.21.15.17:0/729299910 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55bb6fb775b0 0x55bb6fb799d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.744+0000 7f0c45600640 1 --2- 172.21.15.17:0/729299910 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55bb6fb775b0 0x55bb6fb799d0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af0cfeaac0159d88 server_cookie=711bd9fb729a7177 in_seq=0 out_seq=0 2024-09-13T16:07:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.744+0000 7f0c23400640 10 client.15774 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:07:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.745+0000 7f0c23400640 1 -- 172.21.15.17:0/729299910 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bb6fab77d0 con 0x55bb6fb775b0 2024-09-13T16:07:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.745+0000 7f0c23400640 10 client.15774 handle_command_reply: tid=0 2024-09-13T16:07:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.745+0000 7f0c4ae72740 1 client.15774 shutdown 2024-09-13T16:07:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.745+0000 7f0c4ae72740 1 -- 172.21.15.17:0/729299910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6fb67650 msgr2=0x55bb6fb72e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.745+0000 7f0c4ae72740 1 --2- 172.21.15.17:0/729299910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6fb67650 0x55bb6fb72e90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0c38030860 tx=0x7f0c3802a6c0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.746+0000 7f0c4ae72740 1 -- 172.21.15.17:0/729299910 shutdown_connections 2024-09-13T16:07:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.746+0000 7f0c4ae72740 1 --2- 172.21.15.17:0/729299910 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55bb6fb775b0 0x55bb6fb799d0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.746+0000 7f0c4ae72740 1 --2- 172.21.15.17:0/729299910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6fb67650 0x55bb6fb72e90 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.746+0000 7f0c4ae72740 1 --2- 172.21.15.17:0/729299910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6fb625c0 0x55bb6fb6be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.746+0000 7f0c4ae72740 1 --2- 172.21.15.17:0/729299910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb61c80 0x55bb6fb6b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.746+0000 7f0c4ae72740 1 -- 172.21.15.17:0/729299910 >> 172.21.15.17:0/729299910 conn(0x55bb6fb5d2f0 msgr2=0x55bb6fb5eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.746+0000 7f0c23400640 0 client.15774 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:07:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.746+0000 7f0c4ae72740 1 -- 172.21.15.17:0/729299910 shutdown_connections 2024-09-13T16:07:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.747+0000 7f0c4ae72740 1 -- 172.21.15.17:0/729299910 wait complete. 2024-09-13T16:07:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.748+0000 7f0c4ae72740 20 client.15774 trim_cache size 0 max 16384 2024-09-13T16:07:00.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.774+0000 7f0c4ae72740 1 Processor -- start 2024-09-13T16:07:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.774+0000 7f0c4ae72740 1 -- start start 2024-09-13T16:07:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.775+0000 7f0c4ae72740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6fb61c80 0x55bb6fb6bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.775+0000 7f0c4ae72740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6fb625c0 0x55bb6fb72e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.775+0000 7f0c4ae72740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb67650 0x55bb6fb5d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.775+0000 7f0c4ae72740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6f82be60 con 0x55bb6fb625c0 2024-09-13T16:07:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.775+0000 7f0c4ae72740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6fb61800 con 0x55bb6fb61c80 2024-09-13T16:07:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.775+0000 7f0c4ae72740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6fb6a8a0 con 0x55bb6fb67650 2024-09-13T16:07:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.775+0000 7f0c46000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb67650 0x55bb6fb5d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.775+0000 7f0c46000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb67650 0x55bb6fb5d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:41494/0 (socket says 172.21.15.17:41494) 2024-09-13T16:07:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.775+0000 7f0c46000640 1 -- 172.21.15.17:0/393250384 learned_addr learned my addr 172.21.15.17:0/393250384 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.776+0000 7f0c46000640 1 -- 172.21.15.17:0/393250384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6fb61c80 msgr2=0x55bb6fb6bdd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:07:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.776+0000 7f0c46000640 1 --2- 172.21.15.17:0/393250384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6fb61c80 0x55bb6fb6bdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.776+0000 7f0c46000640 1 -- 172.21.15.17:0/393250384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6fb625c0 msgr2=0x55bb6fb72e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.776+0000 7f0c46000640 1 --2- 172.21.15.17:0/393250384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6fb625c0 0x55bb6fb72e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.776+0000 7f0c46000640 1 -- 172.21.15.17:0/393250384 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb6fa65180 con 0x55bb6fb67650 2024-09-13T16:07:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.776+0000 7f0c46000640 1 --2- 172.21.15.17:0/393250384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb67650 0x55bb6fb5d6d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009b30 tx=0x7f0c380303a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48f542eb98252c02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.777+0000 7f0c2f400640 1 -- 172.21.15.17:0/393250384 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c38031bc0 con 0x55bb6fb67650 2024-09-13T16:07:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.777+0000 7f0c2f400640 1 -- 172.21.15.17:0/393250384 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c38031d20 con 0x55bb6fb67650 2024-09-13T16:07:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.777+0000 7f0c2f400640 1 -- 172.21.15.17:0/393250384 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3805d440 con 0x55bb6fb67650 2024-09-13T16:07:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.778+0000 7f0c4ae72740 1 -- 172.21.15.17:0/393250384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb67650 msgr2=0x55bb6fb5d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.778+0000 7f0c4ae72740 1 --2- 172.21.15.17:0/393250384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb67650 0x55bb6fb5d6d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009b30 tx=0x7f0c380303a0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.779+0000 7f0c4ae72740 1 -- 172.21.15.17:0/393250384 shutdown_connections 2024-09-13T16:07:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.779+0000 7f0c4ae72740 1 --2- 172.21.15.17:0/393250384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb67650 0x55bb6fb5d6d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.779+0000 7f0c4ae72740 1 --2- 172.21.15.17:0/393250384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6fb625c0 0x55bb6fb72e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.779+0000 7f0c4ae72740 1 --2- 172.21.15.17:0/393250384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6fb61c80 0x55bb6fb6bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.779+0000 7f0c4ae72740 1 -- 172.21.15.17:0/393250384 >> 172.21.15.17:0/393250384 conn(0x55bb6fb5d2f0 msgr2=0x55bb6fb6b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.780+0000 7f0c4ae72740 1 -- 172.21.15.17:0/393250384 shutdown_connections 2024-09-13T16:07:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.780+0000 7f0c4ae72740 1 -- 172.21.15.17:0/393250384 wait complete. 2024-09-13T16:07:00.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.782+0000 7f0c4ae72740 1 -- start start 2024-09-13T16:07:00.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.782+0000 7f0c4ae72740 1 Processor -- start 2024-09-13T16:07:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.783+0000 7f0c4ae72740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6fb61c80 0x55bb6fb71490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.783+0000 7f0c4ae72740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6fb625c0 0x55bb6fb719d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.783+0000 7f0c4ae72740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb67650 0x55bb6fb71f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.783+0000 7f0c4ae72740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6fb73110 con 0x55bb6fb625c0 2024-09-13T16:07:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.783+0000 7f0c4ae72740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6fbcdac0 con 0x55bb6fb61c80 2024-09-13T16:07:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.783+0000 7f0c4ae72740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6fbcdc00 con 0x55bb6fb67650 2024-09-13T16:07:00.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.783+0000 7f0c4ae72740 10 client.0 _ll_register_callbacks cb 0x7f0c300ce070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:07:00.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.784+0000 7f0c45600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6fb61c80 0x55bb6fb71490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:00.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.785+0000 7f0c45600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6fb61c80 0x55bb6fb71490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:55560/0 (socket says 172.21.15.17:55560) 2024-09-13T16:07:00.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.785+0000 7f0c45600640 1 -- 172.21.15.17:0/2899178567 learned_addr learned my addr 172.21.15.17:0/2899178567 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:00.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.785+0000 7f0c44c00640 1 --2- 172.21.15.17:0/2899178567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6fb625c0 0x55bb6fb719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:00.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.785+0000 7f0c46000640 1 --2- 172.21.15.17:0/2899178567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb67650 0x55bb6fb71f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.786+0000 7f0c45600640 1 -- 172.21.15.17:0/2899178567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb67650 msgr2=0x55bb6fb71f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.786+0000 7f0c45600640 1 --2- 172.21.15.17:0/2899178567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb67650 0x55bb6fb71f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.786+0000 7f0c45600640 1 -- 172.21.15.17:0/2899178567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6fb625c0 msgr2=0x55bb6fb719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.786+0000 7f0c45600640 1 --2- 172.21.15.17:0/2899178567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6fb625c0 0x55bb6fb719d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.786+0000 7f0c45600640 1 -- 172.21.15.17:0/2899178567 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bb6fac3170 con 0x55bb6fb61c80 2024-09-13T16:07:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.786+0000 7f0c44c00640 1 --2- 172.21.15.17:0/2899178567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6fb625c0 0x55bb6fb719d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:07:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.787+0000 7f0c46000640 1 --2- 172.21.15.17:0/2899178567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb67650 0x55bb6fb71f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:07:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.787+0000 7f0c45600640 1 --2- 172.21.15.17:0/2899178567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6fb61c80 0x55bb6fb71490 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0c300cfa40 tx=0x7f0c30005cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8772c8d563f5a4b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.787+0000 7f0c23400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:07:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.789+0000 7f0c23400640 1 -- 172.21.15.17:0/2899178567 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c30095140 con 0x55bb6fb61c80 2024-09-13T16:07:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.789+0000 7f0c23400640 1 -- 172.21.15.17:0/2899178567 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f0c300cce40 con 0x55bb6fb61c80 2024-09-13T16:07:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.789+0000 7f0c4ae72740 1 -- 172.21.15.17:0/2899178567 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0c300cb110 con 0x55bb6fb61c80 2024-09-13T16:07:00.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.793+0000 7f0c23400640 1 -- 172.21.15.17:0/2899178567 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c30098bd0 con 0x55bb6fb61c80 2024-09-13T16:07:00.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.793+0000 7f0c4ae72740 10 client.26051 fetch_fsmap learned FSMap version 45 2024-09-13T16:07:00.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.793+0000 7f0c4ae72740 1 -- 172.21.15.17:0/2899178567 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55bb6fa8a560 con 0x55bb6fb61c80 2024-09-13T16:07:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.793+0000 7f0c23400640 1 -- 172.21.15.17:0/2899178567 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c300cb110 con 0x55bb6fb61c80 2024-09-13T16:07:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.793+0000 7f0c23400640 1 -- 172.21.15.17:0/2899178567 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 45) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f0c30095510 con 0x55bb6fb61c80 2024-09-13T16:07:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.797+0000 7f0c4ae72740 10 client.26051 fetch_fsmap finished waiting for FSMap version 45 2024-09-13T16:07:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.797+0000 7f0c4ae72740 10 client.26051 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:07:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.797+0000 7f0c4ae72740 20 client.26051 populate_metadata read hostname 'smithi017' 2024-09-13T16:07:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.797+0000 7f0c4ae72740 1 --2- 172.21.15.17:0/2899178567 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55bb6fbcf1f0 0x55bb6fbd1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.797+0000 7f0c4ae72740 4 client.26051 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:07:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.797+0000 7f0c4ae72740 1 -- 172.21.15.17:0/2899178567 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bb6f7b8300 con 0x55bb6fbcf1f0 2024-09-13T16:07:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.799+0000 7f0c44c00640 1 --2- 172.21.15.17:0/2899178567 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55bb6fbcf1f0 0x55bb6fbd1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.800+0000 7f0c44c00640 1 --2- 172.21.15.17:0/2899178567 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55bb6fbcf1f0 0x55bb6fbd1610 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96a97dccc860aa58 server_cookie=5db309d533ca7eed in_seq=0 out_seq=0 2024-09-13T16:07:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:00.800+0000 7f0c23400640 10 client.26051 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:07:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.397+0000 7f0c23400640 1 -- 172.21.15.17:0/2899178567 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bb6f7b8300 con 0x55bb6fbcf1f0 2024-09-13T16:07:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.397+0000 7f0c23400640 10 client.26051 handle_command_reply: tid=0 2024-09-13T16:07:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.397+0000 7f0c4ae72740 1 client.26051 shutdown 2024-09-13T16:07:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.397+0000 7f0c4ae72740 1 -- 172.21.15.17:0/2899178567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6fb61c80 msgr2=0x55bb6fb71490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.397+0000 7f0c4ae72740 1 --2- 172.21.15.17:0/2899178567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6fb61c80 0x55bb6fb71490 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0c300cfa40 tx=0x7f0c30005cb0 comp rx=0 tx=0).stop 2024-09-13T16:07:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.398+0000 7f0c4ae72740 1 -- 172.21.15.17:0/2899178567 shutdown_connections 2024-09-13T16:07:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.398+0000 7f0c4ae72740 1 --2- 172.21.15.17:0/2899178567 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55bb6fbcf1f0 0x55bb6fbd1610 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.398+0000 7f0c4ae72740 1 --2- 172.21.15.17:0/2899178567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bb6fb67650 0x55bb6fb71f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.398+0000 7f0c4ae72740 1 --2- 172.21.15.17:0/2899178567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb6fb625c0 0x55bb6fb719d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.398+0000 7f0c4ae72740 1 --2- 172.21.15.17:0/2899178567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb6fb61c80 0x55bb6fb71490 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.398+0000 7f0c4ae72740 1 -- 172.21.15.17:0/2899178567 >> 172.21.15.17:0/2899178567 conn(0x55bb6fb5d2f0 msgr2=0x55bb6fb5bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.398+0000 7f0c23400640 0 client.26051 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:07:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.398+0000 7f0c4ae72740 1 -- 172.21.15.17:0/2899178567 shutdown_connections 2024-09-13T16:07:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.398+0000 7f0c4ae72740 1 -- 172.21.15.17:0/2899178567 wait complete. 2024-09-13T16:07:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:07:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:07:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:07:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:07:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.399+0000 7f0c4ae72740 20 client.26051 trim_cache size 0 max 16384 2024-09-13T16:07:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.402+0000 7f0c46a00640 1 -- 172.21.15.17:0/2126630662 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0c280a1200 msgr2=0x7f0c280a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:01.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.402+0000 7f0c46a00640 1 --2- 172.21.15.17:0/2126630662 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0c280a1200 0x7f0c280a36c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0c38006010 tx=0x7f0c38031000 comp rx=0 tx=0).stop 2024-09-13T16:07:01.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.402+0000 7f0c46a00640 1 -- 172.21.15.17:0/2126630662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c40106680 msgr2=0x7f0c4019c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:01.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.402+0000 7f0c46a00640 1 --2- 172.21.15.17:0/2126630662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c40106680 0x7f0c4019c130 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000d950 tx=0x7f0c3000de10 comp rx=0 tx=0).stop 2024-09-13T16:07:01.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.403+0000 7f0c46a00640 1 -- 172.21.15.17:0/2126630662 shutdown_connections 2024-09-13T16:07:01.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.403+0000 7f0c46a00640 1 --2- 172.21.15.17:0/2126630662 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0c280a1200 0x7f0c280a36c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:01.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.403+0000 7f0c46a00640 1 --2- 172.21.15.17:0/2126630662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c40107d30 0x7f0c401a36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:01.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.403+0000 7f0c46a00640 1 --2- 172.21.15.17:0/2126630662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c40107390 0x7f0c4019c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:01.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.403+0000 7f0c46a00640 1 --2- 172.21.15.17:0/2126630662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c40106680 0x7f0c4019c130 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:01.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.403+0000 7f0c46a00640 1 -- 172.21.15.17:0/2126630662 >> 172.21.15.17:0/2126630662 conn(0x7f0c400754c0 msgr2=0x7f0c4010a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:01.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.403+0000 7f0c46a00640 1 -- 172.21.15.17:0/2126630662 shutdown_connections 2024-09-13T16:07:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:01.403+0000 7f0c46a00640 1 -- 172.21.15.17:0/2126630662 wait complete. 2024-09-13T16:07:02.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:01 smithi189 ceph-mon[34790]: pgmap v663: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.3 MiB/s wr, 584 op/s 2024-09-13T16:07:02.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:01 smithi193 ceph-mon[35248]: pgmap v663: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.3 MiB/s wr, 584 op/s 2024-09-13T16:07:02.265 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:01 smithi017 ceph-mon[30494]: pgmap v663: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.3 MiB/s wr, 584 op/s 2024-09-13T16:07:04.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:03 smithi189 ceph-mon[34790]: pgmap v664: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.4 MiB/s wr, 511 op/s 2024-09-13T16:07:04.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:03 smithi193 ceph-mon[35248]: pgmap v664: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.4 MiB/s wr, 511 op/s 2024-09-13T16:07:04.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:03 smithi017 ceph-mon[30494]: pgmap v664: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.4 MiB/s wr, 511 op/s 2024-09-13T16:07:05.315 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 560.0 s, 568.4 tps, lat 179.289 ms stddev 275.577 2024-09-13T16:07:06.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:05 smithi189 ceph-mon[34790]: pgmap v665: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4.4 MiB/s wr, 505 op/s 2024-09-13T16:07:06.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:05 smithi193 ceph-mon[35248]: pgmap v665: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4.4 MiB/s wr, 505 op/s 2024-09-13T16:07:06.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:05 smithi017 ceph-mon[30494]: pgmap v665: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4.4 MiB/s wr, 505 op/s 2024-09-13T16:07:08.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:07 smithi189 ceph-mon[34790]: pgmap v666: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.9 MiB/s wr, 633 op/s 2024-09-13T16:07:08.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:07 smithi193 ceph-mon[35248]: pgmap v666: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.9 MiB/s wr, 633 op/s 2024-09-13T16:07:08.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:07 smithi017 ceph-mon[30494]: pgmap v666: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.9 MiB/s wr, 633 op/s 2024-09-13T16:07:10.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:09 smithi189 ceph-mon[34790]: pgmap v667: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.3 MiB/s wr, 579 op/s 2024-09-13T16:07:10.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:09 smithi193 ceph-mon[35248]: pgmap v667: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.3 MiB/s wr, 579 op/s 2024-09-13T16:07:10.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:09 smithi017 ceph-mon[30494]: pgmap v667: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.3 MiB/s wr, 579 op/s 2024-09-13T16:07:10.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 565.0 s, 784.6 tps, lat 129.910 ms stddev 165.737 2024-09-13T16:07:12.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:11 smithi189 ceph-mon[34790]: pgmap v668: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.2 MiB/s wr, 667 op/s 2024-09-13T16:07:12.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:11 smithi193 ceph-mon[35248]: pgmap v668: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.2 MiB/s wr, 667 op/s 2024-09-13T16:07:12.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:11 smithi017 ceph-mon[30494]: pgmap v668: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.2 MiB/s wr, 667 op/s 2024-09-13T16:07:14.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:13 smithi193 ceph-mon[35248]: pgmap v669: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.6 MiB/s wr, 613 op/s 2024-09-13T16:07:14.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:13 smithi017 ceph-mon[30494]: pgmap v669: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.6 MiB/s wr, 613 op/s 2024-09-13T16:07:14.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:13 smithi189 ceph-mon[34790]: pgmap v669: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.6 MiB/s wr, 613 op/s 2024-09-13T16:07:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.642+0000 7fd611000640 1 -- 172.21.15.17:0/1659543101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd60c1018c0 msgr2=0x7fd60c108150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.642+0000 7fd611000640 1 --2- 172.21.15.17:0/1659543101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd60c1018c0 0x7fd60c108150 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009900 tx=0x7fd5fc02a420 comp rx=0 tx=0).stop 2024-09-13T16:07:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.643+0000 7fd611000640 1 -- 172.21.15.17:0/1659543101 shutdown_connections 2024-09-13T16:07:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.643+0000 7fd611000640 1 --2- 172.21.15.17:0/1659543101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd60c1018c0 0x7fd60c108150 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.643+0000 7fd611000640 1 --2- 172.21.15.17:0/1659543101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd60c100f00 0x7fd60c101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.643+0000 7fd611000640 1 --2- 172.21.15.17:0/1659543101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd60c0ffd10 0x7fd60c100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.643+0000 7fd611000640 1 -- 172.21.15.17:0/1659543101 >> 172.21.15.17:0/1659543101 conn(0x7fd60c0fb4b0 msgr2=0x7fd60c0fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:14.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.646+0000 7fd611000640 1 -- 172.21.15.17:0/1659543101 shutdown_connections 2024-09-13T16:07:14.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.646+0000 7fd611000640 1 -- 172.21.15.17:0/1659543101 wait complete. 2024-09-13T16:07:14.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.648+0000 7fd611000640 1 Processor -- start 2024-09-13T16:07:14.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.648+0000 7fd611000640 1 -- start start 2024-09-13T16:07:14.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.649+0000 7fd611000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd60c0ffd10 0x7fd60c10ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:14.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.649+0000 7fd611000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd60c100f00 0x7fd60c10f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:14.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.649+0000 7fd611000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd60c1018c0 0x7fd60c110400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:14.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.649+0000 7fd611000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c110940 con 0x7fd60c100f00 2024-09-13T16:07:14.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.649+0000 7fd611000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c110ab0 con 0x7fd60c1018c0 2024-09-13T16:07:14.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.649+0000 7fd611000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c110c70 con 0x7fd60c0ffd10 2024-09-13T16:07:14.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.650+0000 7fd60a800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd60c1018c0 0x7fd60c110400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:14.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.650+0000 7fd60a800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd60c1018c0 0x7fd60c110400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:56826/0 (socket says 172.21.15.17:56826) 2024-09-13T16:07:14.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.650+0000 7fd60a800640 1 -- 172.21.15.17:0/463837203 learned_addr learned my addr 172.21.15.17:0/463837203 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:14.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.650+0000 7fd609400640 1 --2- 172.21.15.17:0/463837203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd60c100f00 0x7fd60c10f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:14.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.650+0000 7fd609e00640 1 --2- 172.21.15.17:0/463837203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd60c0ffd10 0x7fd60c10ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:14.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.650+0000 7fd60a800640 1 -- 172.21.15.17:0/463837203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd60c0ffd10 msgr2=0x7fd60c10ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:14.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.650+0000 7fd60a800640 1 --2- 172.21.15.17:0/463837203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd60c0ffd10 0x7fd60c10ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.650+0000 7fd60a800640 1 -- 172.21.15.17:0/463837203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd60c100f00 msgr2=0x7fd60c10f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:14.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.650+0000 7fd60a800640 1 --2- 172.21.15.17:0/463837203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd60c100f00 0x7fd60c10f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.650+0000 7fd60a800640 1 -- 172.21.15.17:0/463837203 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5fc009560 con 0x7fd60c1018c0 2024-09-13T16:07:14.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.651+0000 7fd60a800640 1 --2- 172.21.15.17:0/463837203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd60c1018c0 0x7fd60c110400 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc005ec0 tx=0x7fd5fc003d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:14.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.651+0000 7fd602a00640 1 -- 172.21.15.17:0/463837203 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc0317b0 con 0x7fd60c1018c0 2024-09-13T16:07:14.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.651+0000 7fd611000640 1 -- 172.21.15.17:0/463837203 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60c110ef0 con 0x7fd60c1018c0 2024-09-13T16:07:14.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.652+0000 7fd611000640 1 -- 172.21.15.17:0/463837203 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60c06ff00 con 0x7fd60c1018c0 2024-09-13T16:07:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.654+0000 7fd602a00640 1 -- 172.21.15.17:0/463837203 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5fc031dd0 con 0x7fd60c1018c0 2024-09-13T16:07:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.654+0000 7fd602a00640 1 -- 172.21.15.17:0/463837203 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc03bea0 con 0x7fd60c1018c0 2024-09-13T16:07:14.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.661+0000 7fd602a00640 1 -- 172.21.15.17:0/463837203 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd5fc03a3c0 con 0x7fd60c1018c0 2024-09-13T16:07:14.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.663+0000 7fd602a00640 1 --2- 172.21.15.17:0/463837203 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd5f00a10f0 0x7fd5f00a35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:14.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.663+0000 7fd613df9740 1 Processor -- start 2024-09-13T16:07:14.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.663+0000 7fd602a00640 1 -- 172.21.15.17:0/463837203 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fd5fc0ee7c0 con 0x7fd60c1018c0 2024-09-13T16:07:14.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.664+0000 7fd613df9740 1 -- start start 2024-09-13T16:07:14.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.664+0000 7fd609e00640 1 --2- 172.21.15.17:0/463837203 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd5f00a10f0 0x7fd5f00a35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:14.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.665+0000 7fd613df9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e599ba70 0x5646e599be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:14.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.665+0000 7fd613df9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e599c3b0 0x5646e59a0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:14.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.665+0000 7fd613df9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e59a1440 0x5646e59a3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.665+0000 7fd613df9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e58a7bb0 con 0x5646e599ba70 2024-09-13T16:07:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.665+0000 7fd613df9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e5905a70 con 0x5646e599c3b0 2024-09-13T16:07:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.665+0000 7fd613df9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e5903200 con 0x5646e59a1440 2024-09-13T16:07:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.665+0000 7fd609400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e599c3b0 0x5646e59a0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.665+0000 7fd609400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e599c3b0 0x5646e59a0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:56828/0 (socket says 172.21.15.17:56828) 2024-09-13T16:07:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.665+0000 7fd609400640 1 -- 172.21.15.17:0/1160747106 learned_addr learned my addr 172.21.15.17:0/1160747106 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.665+0000 7fd60a800640 1 --2- 172.21.15.17:0/1160747106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e59a1440 0x5646e59a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.666+0000 7fd609e00640 1 --2- 172.21.15.17:0/1160747106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e599ba70 0x5646e599be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.666+0000 7fd609400640 1 -- 172.21.15.17:0/1160747106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e59a1440 msgr2=0x5646e59a3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.666+0000 7fd609400640 1 --2- 172.21.15.17:0/1160747106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e59a1440 0x5646e59a3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.666+0000 7fd609400640 1 -- 172.21.15.17:0/1160747106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e599ba70 msgr2=0x5646e599be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:14.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.666+0000 7fd609400640 1 --2- 172.21.15.17:0/1160747106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e599ba70 0x5646e599be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.666+0000 7fd609400640 1 -- 172.21.15.17:0/1160747106 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646e58a0940 con 0x5646e599c3b0 2024-09-13T16:07:14.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.666+0000 7fd60a800640 1 --2- 172.21.15.17:0/1160747106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e59a1440 0x5646e59a3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:07:14.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.666+0000 7fd609e00640 1 --2- 172.21.15.17:0/1160747106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e599ba70 0x5646e599be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:07:14.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.666+0000 7fd609400640 1 --2- 172.21.15.17:0/1160747106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e599c3b0 0x5646e59a0e70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800b7f0 tx=0x7fd5f800bcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88a870b7b260d343 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:14.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.667+0000 7fd5f7400640 1 -- 172.21.15.17:0/1160747106 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f800d950 con 0x5646e599c3b0 2024-09-13T16:07:14.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.667+0000 7fd5f7400640 1 -- 172.21.15.17:0/1160747106 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5f800b460 con 0x5646e599c3b0 2024-09-13T16:07:14.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.668+0000 7fd613df9740 1 -- 172.21.15.17:0/1160747106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e599c3b0 msgr2=0x5646e59a0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:14.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.668+0000 7fd613df9740 1 --2- 172.21.15.17:0/1160747106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e599c3b0 0x5646e59a0e70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800b7f0 tx=0x7fd5f800bcb0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.668+0000 7fd609e00640 1 --2- 172.21.15.17:0/463837203 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd5f00a10f0 0x7fd5f00a35b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd60c100d60 tx=0x7fd604007730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:14.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.670+0000 7fd613df9740 1 -- 172.21.15.17:0/1160747106 shutdown_connections 2024-09-13T16:07:14.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.670+0000 7fd613df9740 1 --2- 172.21.15.17:0/1160747106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e59a1440 0x5646e59a3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.670+0000 7fd613df9740 1 --2- 172.21.15.17:0/1160747106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e599c3b0 0x5646e59a0e70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.670+0000 7fd613df9740 1 --2- 172.21.15.17:0/1160747106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e599ba70 0x5646e599be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.670+0000 7fd613df9740 1 -- 172.21.15.17:0/1160747106 >> 172.21.15.17:0/1160747106 conn(0x5646e59970e0 msgr2=0x5646e59974e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:14.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.670+0000 7fd613df9740 1 -- 172.21.15.17:0/1160747106 shutdown_connections 2024-09-13T16:07:14.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.670+0000 7fd613df9740 1 -- 172.21.15.17:0/1160747106 wait complete. 2024-09-13T16:07:14.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.671+0000 7fd613df9740 1 -- start start 2024-09-13T16:07:14.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.671+0000 7fd613df9740 1 Processor -- start 2024-09-13T16:07:14.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.672+0000 7fd613df9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e599ba70 0x5646e59a56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:14.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.672+0000 7fd613df9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e599c3b0 0x5646e59a5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:14.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.673+0000 7fd609e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e599ba70 0x5646e59a56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.673+0000 7fd609e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e599ba70 0x5646e59a56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:56832/0 (socket says 172.21.15.17:56832) 2024-09-13T16:07:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.674+0000 7fd609e00640 1 -- 172.21.15.17:0/3612072992 learned_addr learned my addr 172.21.15.17:0/3612072992 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.674+0000 7fd613df9740 1 --2- 172.21.15.17:0/3612072992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e59a1440 0x5646e59acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.674+0000 7fd613df9740 1 -- 172.21.15.17:0/3612072992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e58feaf0 con 0x5646e59a1440 2024-09-13T16:07:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.674+0000 7fd613df9740 1 -- 172.21.15.17:0/3612072992 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e58bcf20 con 0x5646e599ba70 2024-09-13T16:07:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.674+0000 7fd613df9740 1 -- 172.21.15.17:0/3612072992 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e58bcbc0 con 0x5646e599c3b0 2024-09-13T16:07:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.674+0000 7fd613df9740 10 client.0 _ll_register_callbacks cb 0x5646e58eea70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:07:14.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.675+0000 7fd609400640 1 --2- 172.21.15.17:0/3612072992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e599c3b0 0x5646e59a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:14.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.675+0000 7fd60a800640 1 --2- 172.21.15.17:0/3612072992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e59a1440 0x5646e59acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:14.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.675+0000 7fd609e00640 1 -- 172.21.15.17:0/3612072992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e599c3b0 msgr2=0x5646e59a5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:14.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.675+0000 7fd609e00640 1 --2- 172.21.15.17:0/3612072992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e599c3b0 0x5646e59a5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.675+0000 7fd609e00640 1 -- 172.21.15.17:0/3612072992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e59a1440 msgr2=0x5646e59acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:14.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.675+0000 7fd609e00640 1 --2- 172.21.15.17:0/3612072992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e59a1440 0x5646e59acc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.675+0000 7fd609e00640 1 -- 172.21.15.17:0/3612072992 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f800e040 con 0x5646e599ba70 2024-09-13T16:07:14.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.678+0000 7fd609e00640 1 --2- 172.21.15.17:0/3612072992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e599ba70 0x5646e59a56e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd604014d80 tx=0x7fd604004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2027705d79e7bcd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:14.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.678+0000 7fd5ebe00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:07:14.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.679+0000 7fd5ebe00640 1 -- 172.21.15.17:0/3612072992 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd604012e90 con 0x5646e599ba70 2024-09-13T16:07:14.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.679+0000 7fd5ebe00640 1 -- 172.21.15.17:0/3612072992 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fd60400d040 con 0x5646e599ba70 2024-09-13T16:07:14.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.679+0000 7fd613df9740 1 -- 172.21.15.17:0/3612072992 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5646e58f17d0 con 0x5646e599ba70 2024-09-13T16:07:14.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.679+0000 7fd5ebe00640 1 -- 172.21.15.17:0/3612072992 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd604003a10 con 0x5646e599ba70 2024-09-13T16:07:14.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.679+0000 7fd613df9740 10 client.26060 fetch_fsmap learned FSMap version 45 2024-09-13T16:07:14.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.679+0000 7fd613df9740 1 -- 172.21.15.17:0/3612072992 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5646e58fd170 con 0x5646e599ba70 2024-09-13T16:07:14.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.681+0000 7fd5ebe00640 1 -- 172.21.15.17:0/3612072992 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5646e58f17d0 con 0x5646e599ba70 2024-09-13T16:07:14.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.681+0000 7fd5ebe00640 1 -- 172.21.15.17:0/3612072992 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 45) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fd60401f400 con 0x5646e599ba70 2024-09-13T16:07:14.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.681+0000 7fd613df9740 10 client.26060 fetch_fsmap finished waiting for FSMap version 45 2024-09-13T16:07:14.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.681+0000 7fd613df9740 10 client.26060 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:07:14.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.681+0000 7fd613df9740 20 client.26060 populate_metadata read hostname 'smithi017' 2024-09-13T16:07:14.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.681+0000 7fd613df9740 1 --2- 172.21.15.17:0/3612072992 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5646e59b1480 0x5646e59b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:14.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.681+0000 7fd613df9740 4 client.26060 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:07:14.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.681+0000 7fd613df9740 1 -- 172.21.15.17:0/3612072992 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5646e55f2300 con 0x5646e59b1480 2024-09-13T16:07:14.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.682+0000 7fd609400640 1 --2- 172.21.15.17:0/3612072992 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5646e59b1480 0x5646e59b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:14.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.682+0000 7fd609400640 1 --2- 172.21.15.17:0/3612072992 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5646e59b1480 0x5646e59b38a0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f74a06845cd4038 server_cookie=17395d8c91744996 in_seq=0 out_seq=0 2024-09-13T16:07:14.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.683+0000 7fd5ebe00640 10 client.26060 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:07:14.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.683+0000 7fd5ebe00640 1 -- 172.21.15.17:0/3612072992 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5646e55f2300 con 0x5646e59b1480 2024-09-13T16:07:14.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.683+0000 7fd5ebe00640 10 client.26060 handle_command_reply: tid=0 2024-09-13T16:07:14.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.684+0000 7fd613df9740 1 client.26060 shutdown 2024-09-13T16:07:14.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.684+0000 7fd613df9740 1 -- 172.21.15.17:0/3612072992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e599ba70 msgr2=0x5646e59a56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:14.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.684+0000 7fd613df9740 1 --2- 172.21.15.17:0/3612072992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e599ba70 0x5646e59a56e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd604014d80 tx=0x7fd604004ad0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.684+0000 7fd613df9740 1 -- 172.21.15.17:0/3612072992 shutdown_connections 2024-09-13T16:07:14.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.684+0000 7fd613df9740 1 --2- 172.21.15.17:0/3612072992 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5646e59b1480 0x5646e59b38a0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.684+0000 7fd613df9740 1 --2- 172.21.15.17:0/3612072992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e59a1440 0x5646e59acc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.684+0000 7fd613df9740 1 --2- 172.21.15.17:0/3612072992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e599c3b0 0x5646e59a5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.684+0000 7fd613df9740 1 --2- 172.21.15.17:0/3612072992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e599ba70 0x5646e59a56e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.684+0000 7fd5ebe00640 0 client.26060 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:07:14.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.684+0000 7fd613df9740 1 -- 172.21.15.17:0/3612072992 >> 172.21.15.17:0/3612072992 conn(0x5646e59970e0 msgr2=0x5646e59988f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:14.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.688+0000 7fd613df9740 1 -- 172.21.15.17:0/3612072992 shutdown_connections 2024-09-13T16:07:14.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.690+0000 7fd613df9740 1 -- 172.21.15.17:0/3612072992 wait complete. 2024-09-13T16:07:14.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.693+0000 7fd613df9740 20 client.26060 trim_cache size 0 max 16384 2024-09-13T16:07:14.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.732+0000 7fd613df9740 1 Processor -- start 2024-09-13T16:07:14.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.733+0000 7fd613df9740 1 -- start start 2024-09-13T16:07:14.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.733+0000 7fd613df9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e59970e0 0x5646e59a0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:14.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.733+0000 7fd613df9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e599c3b0 0x5646e59acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:14.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.733+0000 7fd613df9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e59a1440 0x5646e59a5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:14.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.733+0000 7fd613df9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e5665e60 con 0x5646e599c3b0 2024-09-13T16:07:14.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.734+0000 7fd613df9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e58f17d0 con 0x5646e59970e0 2024-09-13T16:07:14.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.734+0000 7fd613df9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e5991780 con 0x5646e59a1440 2024-09-13T16:07:14.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.734+0000 7fd60a800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e59a1440 0x5646e59a5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:14.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.734+0000 7fd60a800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e59a1440 0x5646e59a5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:53718/0 (socket says 172.21.15.17:53718) 2024-09-13T16:07:14.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.734+0000 7fd60a800640 1 -- 172.21.15.17:0/1241369777 learned_addr learned my addr 172.21.15.17:0/1241369777 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:14.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.735+0000 7fd60a800640 1 -- 172.21.15.17:0/1241369777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e59970e0 msgr2=0x5646e59a0e70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:07:14.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.735+0000 7fd60a800640 1 --2- 172.21.15.17:0/1241369777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e59970e0 0x5646e59a0e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.735+0000 7fd60a800640 1 -- 172.21.15.17:0/1241369777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e599c3b0 msgr2=0x5646e59acc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:07:14.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.735+0000 7fd60a800640 1 --2- 172.21.15.17:0/1241369777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e599c3b0 0x5646e59acc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.735+0000 7fd60a800640 1 -- 172.21.15.17:0/1241369777 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646e589f180 con 0x5646e59a1440 2024-09-13T16:07:14.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.735+0000 7fd60a800640 1 --2- 172.21.15.17:0/1241369777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e59a1440 0x5646e59a5490 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0ec2e0 tx=0x7fd5fc005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1db4111fbb0bf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.736+0000 7fd5f7e00640 1 -- 172.21.15.17:0/1241369777 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc0c3d40 con 0x5646e59a1440 2024-09-13T16:07:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.736+0000 7fd5f7e00640 1 -- 172.21.15.17:0/1241369777 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5fc0b9a00 con 0x5646e59a1440 2024-09-13T16:07:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.736+0000 7fd5f7e00640 1 -- 172.21.15.17:0/1241369777 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc0c38b0 con 0x5646e59a1440 2024-09-13T16:07:14.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.737+0000 7fd613df9740 1 -- 172.21.15.17:0/1241369777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e59a1440 msgr2=0x5646e59a5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:14.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.737+0000 7fd613df9740 1 --2- 172.21.15.17:0/1241369777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e59a1440 0x5646e59a5490 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0ec2e0 tx=0x7fd5fc005bd0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.739+0000 7fd613df9740 1 -- 172.21.15.17:0/1241369777 shutdown_connections 2024-09-13T16:07:14.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.739+0000 7fd613df9740 1 --2- 172.21.15.17:0/1241369777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e59a1440 0x5646e59a5490 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.739+0000 7fd613df9740 1 --2- 172.21.15.17:0/1241369777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e599c3b0 0x5646e59acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.739+0000 7fd613df9740 1 --2- 172.21.15.17:0/1241369777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e59970e0 0x5646e59a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.739+0000 7fd613df9740 1 -- 172.21.15.17:0/1241369777 >> 172.21.15.17:0/1241369777 conn(0x5646e59a3ba0 msgr2=0x5646e59a0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.739+0000 7fd613df9740 1 -- 172.21.15.17:0/1241369777 shutdown_connections 2024-09-13T16:07:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.739+0000 7fd613df9740 1 -- 172.21.15.17:0/1241369777 wait complete. 2024-09-13T16:07:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.740+0000 7fd613df9740 1 -- start start 2024-09-13T16:07:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.740+0000 7fd613df9740 1 Processor -- start 2024-09-13T16:07:14.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.740+0000 7fd613df9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e59970e0 0x5646e59acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:14.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.740+0000 7fd613df9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e599c3b0 0x5646e59ab250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:14.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.740+0000 7fd613df9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e59a1440 0x5646e59ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:14.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.741+0000 7fd609400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e599c3b0 0x5646e59ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:14.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.741+0000 7fd609400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e599c3b0 0x5646e59ab250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:53720/0 (socket says 172.21.15.17:53720) 2024-09-13T16:07:14.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.741+0000 7fd609400640 1 -- 172.21.15.17:0/2150926078 learned_addr learned my addr 172.21.15.17:0/2150926078 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:14.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.741+0000 7fd609e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e59970e0 0x5646e59acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:14.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.741+0000 7fd613df9740 1 -- 172.21.15.17:0/2150926078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e59abfd0 con 0x5646e59a1440 2024-09-13T16:07:14.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.741+0000 7fd613df9740 1 -- 172.21.15.17:0/2150926078 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e5a07970 con 0x5646e59970e0 2024-09-13T16:07:14.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.742+0000 7fd613df9740 1 -- 172.21.15.17:0/2150926078 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e5a07ab0 con 0x5646e599c3b0 2024-09-13T16:07:14.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.742+0000 7fd613df9740 10 client.0 _ll_register_callbacks cb 0x7fd5f800b220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:07:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.742+0000 7fd60a800640 1 --2- 172.21.15.17:0/2150926078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e59a1440 0x5646e59ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.743+0000 7fd609e00640 1 -- 172.21.15.17:0/2150926078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e599c3b0 msgr2=0x5646e59ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:14.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.743+0000 7fd609e00640 1 --2- 172.21.15.17:0/2150926078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e599c3b0 0x5646e59ab250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.743+0000 7fd609e00640 1 -- 172.21.15.17:0/2150926078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e59a1440 msgr2=0x5646e59ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:14.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.743+0000 7fd609e00640 1 --2- 172.21.15.17:0/2150926078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e59a1440 0x5646e59ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:14.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.743+0000 7fd609e00640 1 -- 172.21.15.17:0/2150926078 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60c110ef0 con 0x5646e59970e0 2024-09-13T16:07:14.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.744+0000 7fd609e00640 1 --2- 172.21.15.17:0/2150926078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e59970e0 0x5646e59acbf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x5646e59a4b70 tx=0x7fd60401f630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dddcbe3f172cf0ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:14.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.744+0000 7fd5ebe00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:07:14.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.744+0000 7fd5ebe00640 1 -- 172.21.15.17:0/2150926078 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd604012e90 con 0x5646e59970e0 2024-09-13T16:07:14.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.745+0000 7fd5ebe00640 1 -- 172.21.15.17:0/2150926078 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fd604011320 con 0x5646e59970e0 2024-09-13T16:07:14.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.745+0000 7fd613df9740 1 -- 172.21.15.17:0/2150926078 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5646e5928c90 con 0x5646e59970e0 2024-09-13T16:07:14.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.745+0000 7fd5ebe00640 1 -- 172.21.15.17:0/2150926078 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6040114e0 con 0x5646e59970e0 2024-09-13T16:07:14.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.745+0000 7fd613df9740 10 client.26063 fetch_fsmap learned FSMap version 45 2024-09-13T16:07:14.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.745+0000 7fd613df9740 1 -- 172.21.15.17:0/2150926078 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5646e58c4560 con 0x5646e59970e0 2024-09-13T16:07:14.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.748+0000 7fd5ebe00640 1 -- 172.21.15.17:0/2150926078 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd604018030 con 0x5646e59970e0 2024-09-13T16:07:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.748+0000 7fd5ebe00640 1 -- 172.21.15.17:0/2150926078 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 45) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fd6040045b0 con 0x5646e59970e0 2024-09-13T16:07:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.748+0000 7fd613df9740 10 client.26063 fetch_fsmap finished waiting for FSMap version 45 2024-09-13T16:07:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.748+0000 7fd613df9740 10 client.26063 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:07:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.748+0000 7fd613df9740 20 client.26063 populate_metadata read hostname 'smithi017' 2024-09-13T16:07:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.748+0000 7fd613df9740 1 --2- 172.21.15.17:0/2150926078 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5646e5a09300 0x5646e5a0b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.748+0000 7fd613df9740 4 client.26063 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:07:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.748+0000 7fd613df9740 1 -- 172.21.15.17:0/2150926078 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5646e5928c90 con 0x5646e5a09300 2024-09-13T16:07:14.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.749+0000 7fd609400640 1 --2- 172.21.15.17:0/2150926078 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5646e5a09300 0x5646e5a0b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:14.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.749+0000 7fd5ebe00640 10 client.26063 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:07:14.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:14.749+0000 7fd609400640 1 --2- 172.21.15.17:0/2150926078 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5646e5a09300 0x5646e5a0b720 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=211da3e9bd728343 server_cookie=8bd2620a92fe1180 in_seq=0 out_seq=0 2024-09-13T16:07:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.032+0000 7fd5ebe00640 1 -- 172.21.15.17:0/2150926078 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5646e5928c90 con 0x5646e5a09300 2024-09-13T16:07:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.032+0000 7fd5ebe00640 10 client.26063 handle_command_reply: tid=0 2024-09-13T16:07:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.032+0000 7fd613df9740 1 client.26063 shutdown 2024-09-13T16:07:15.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.034+0000 7fd613df9740 1 -- 172.21.15.17:0/2150926078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e59970e0 msgr2=0x5646e59acbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:15.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.034+0000 7fd613df9740 1 --2- 172.21.15.17:0/2150926078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e59970e0 0x5646e59acbf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x5646e59a4b70 tx=0x7fd60401f630 comp rx=0 tx=0).stop 2024-09-13T16:07:15.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.034+0000 7fd613df9740 1 -- 172.21.15.17:0/2150926078 shutdown_connections 2024-09-13T16:07:15.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.034+0000 7fd613df9740 1 --2- 172.21.15.17:0/2150926078 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5646e5a09300 0x5646e5a0b720 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:15.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.034+0000 7fd613df9740 1 --2- 172.21.15.17:0/2150926078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e59a1440 0x5646e59ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:15.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.035+0000 7fd613df9740 1 --2- 172.21.15.17:0/2150926078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5646e599c3b0 0x5646e59ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:15.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.035+0000 7fd613df9740 1 --2- 172.21.15.17:0/2150926078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646e59970e0 0x5646e59acbf0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:15.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.035+0000 7fd613df9740 1 -- 172.21.15.17:0/2150926078 >> 172.21.15.17:0/2150926078 conn(0x5646e59a3ba0 msgr2=0x5646e59a5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:15.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.035+0000 7fd5ebe00640 0 client.26063 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:07:15.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.035+0000 7fd613df9740 1 -- 172.21.15.17:0/2150926078 shutdown_connections 2024-09-13T16:07:15.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.035+0000 7fd613df9740 1 -- 172.21.15.17:0/2150926078 wait complete. 2024-09-13T16:07:15.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.036+0000 7fd613df9740 20 client.26063 trim_cache size 0 max 16384 2024-09-13T16:07:15.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:07:15.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:07:15.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:07:15.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:07:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.037+0000 7fd611000640 1 -- 172.21.15.17:0/463837203 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd5f00a10f0 msgr2=0x7fd5f00a35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.037+0000 7fd611000640 1 --2- 172.21.15.17:0/463837203 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd5f00a10f0 0x7fd5f00a35b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd60c100d60 tx=0x7fd604007730 comp rx=0 tx=0).stop 2024-09-13T16:07:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.037+0000 7fd611000640 1 -- 172.21.15.17:0/463837203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd60c1018c0 msgr2=0x7fd60c110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.037+0000 7fd611000640 1 --2- 172.21.15.17:0/463837203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd60c1018c0 0x7fd60c110400 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc005ec0 tx=0x7fd5fc003d80 comp rx=0 tx=0).stop 2024-09-13T16:07:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.037+0000 7fd611000640 1 -- 172.21.15.17:0/463837203 shutdown_connections 2024-09-13T16:07:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.037+0000 7fd611000640 1 --2- 172.21.15.17:0/463837203 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd5f00a10f0 0x7fd5f00a35b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.037+0000 7fd611000640 1 --2- 172.21.15.17:0/463837203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd60c1018c0 0x7fd60c110400 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:15.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.037+0000 7fd611000640 1 --2- 172.21.15.17:0/463837203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd60c100f00 0x7fd60c10f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:15.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.037+0000 7fd611000640 1 --2- 172.21.15.17:0/463837203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd60c0ffd10 0x7fd60c10ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:15.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.037+0000 7fd611000640 1 -- 172.21.15.17:0/463837203 >> 172.21.15.17:0/463837203 conn(0x7fd60c0fb4b0 msgr2=0x7fd60c104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:15.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.038+0000 7fd611000640 1 -- 172.21.15.17:0/463837203 shutdown_connections 2024-09-13T16:07:15.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:15.038+0000 7fd611000640 1 -- 172.21.15.17:0/463837203 wait complete. 2024-09-13T16:07:15.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:14 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:07:15.265 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:14 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:07:15.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 570.0 s, 600.4 tps, lat 151.226 ms stddev 180.792 2024-09-13T16:07:15.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:14 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:07:16.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:15 smithi193 ceph-mon[35248]: pgmap v670: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.2 MiB/s wr, 574 op/s 2024-09-13T16:07:16.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:15 smithi017 ceph-mon[30494]: pgmap v670: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.2 MiB/s wr, 574 op/s 2024-09-13T16:07:16.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:15 smithi189 ceph-mon[34790]: pgmap v670: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.2 MiB/s wr, 574 op/s 2024-09-13T16:07:18.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:17 smithi193 ceph-mon[35248]: pgmap v671: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.4 MiB/s wr, 691 op/s 2024-09-13T16:07:18.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:17 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:18.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:17 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:07:18.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:17 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:07:18.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:17 smithi017 ceph-mon[30494]: pgmap v671: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.4 MiB/s wr, 691 op/s 2024-09-13T16:07:18.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:17 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:18.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:17 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:07:18.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:17 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:07:18.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:17 smithi189 ceph-mon[34790]: pgmap v671: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.4 MiB/s wr, 691 op/s 2024-09-13T16:07:18.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:17 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:07:18.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:17 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:07:18.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:17 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:07:20.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:19 smithi193 ceph-mon[35248]: pgmap v672: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.0 MiB/s wr, 582 op/s 2024-09-13T16:07:20.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:19 smithi017 ceph-mon[30494]: pgmap v672: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.0 MiB/s wr, 582 op/s 2024-09-13T16:07:20.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 575.0 s, 615.4 tps, lat 174.183 ms stddev 235.188 2024-09-13T16:07:20.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:19 smithi189 ceph-mon[34790]: pgmap v672: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.0 MiB/s wr, 582 op/s 2024-09-13T16:07:22.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:21 smithi193 ceph-mon[35248]: pgmap v673: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.1 MiB/s wr, 695 op/s 2024-09-13T16:07:22.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:21 smithi017 ceph-mon[30494]: pgmap v673: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.1 MiB/s wr, 695 op/s 2024-09-13T16:07:22.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:21 smithi189 ceph-mon[34790]: pgmap v673: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.1 MiB/s wr, 695 op/s 2024-09-13T16:07:24.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:23 smithi193 ceph-mon[35248]: pgmap v674: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.4 MiB/s wr, 629 op/s 2024-09-13T16:07:24.264 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:23 smithi017 ceph-mon[30494]: pgmap v674: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.4 MiB/s wr, 629 op/s 2024-09-13T16:07:24.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:23 smithi189 ceph-mon[34790]: pgmap v674: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.4 MiB/s wr, 629 op/s 2024-09-13T16:07:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 580.0 s, 530.8 tps, lat 191.860 ms stddev 212.849 2024-09-13T16:07:26.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:25 smithi193 ceph-mon[35248]: pgmap v675: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.2 MiB/s wr, 606 op/s 2024-09-13T16:07:26.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:25 smithi017 ceph-mon[30494]: pgmap v675: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.2 MiB/s wr, 606 op/s 2024-09-13T16:07:26.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:25 smithi189 ceph-mon[34790]: pgmap v675: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.2 MiB/s wr, 606 op/s 2024-09-13T16:07:28.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.251+0000 7f618b400640 1 -- 172.21.15.17:0/2844110846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6184103a40 msgr2=0x7f618410a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:28.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.251+0000 7f618b400640 1 --2- 172.21.15.17:0/2844110846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6184103a40 0x7f618410a360 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f617c009ca0 tx=0x7f617c02a8d0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:27 smithi193 ceph-mon[35248]: pgmap v676: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.7 MiB/s wr, 673 op/s 2024-09-13T16:07:28.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.252+0000 7f618b400640 1 -- 172.21.15.17:0/2844110846 shutdown_connections 2024-09-13T16:07:28.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.252+0000 7f618b400640 1 --2- 172.21.15.17:0/2844110846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6184103a40 0x7f618410a360 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.252+0000 7f618b400640 1 --2- 172.21.15.17:0/2844110846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6184103080 0x7f6184103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.252+0000 7f618b400640 1 --2- 172.21.15.17:0/2844110846 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6184101f30 0x7f6184102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.252+0000 7f618b400640 1 -- 172.21.15.17:0/2844110846 >> 172.21.15.17:0/2844110846 conn(0x7f61840fd6b0 msgr2=0x7f61840ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:28.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.252+0000 7f618b400640 1 -- 172.21.15.17:0/2844110846 shutdown_connections 2024-09-13T16:07:28.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.252+0000 7f618b400640 1 -- 172.21.15.17:0/2844110846 wait complete. 2024-09-13T16:07:28.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.254+0000 7f618b400640 1 Processor -- start 2024-09-13T16:07:28.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.257+0000 7f618b400640 1 -- start start 2024-09-13T16:07:28.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.257+0000 7f618b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6184101f30 0x7f6184197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:28.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.257+0000 7f618b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6184103080 0x7f61841983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:28.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.257+0000 7f618b400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6184103a40 0x7f618419f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:28.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.258+0000 7f6183e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6184103080 0x7f61841983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:28.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.258+0000 7f6183e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6184103080 0x7f61841983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:46374/0 (socket says 172.21.15.17:46374) 2024-09-13T16:07:28.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.258+0000 7f6183e00640 1 -- 172.21.15.17:0/274442497 learned_addr learned my addr 172.21.15.17:0/274442497 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:28.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.258+0000 7f618b400640 1 -- 172.21.15.17:0/274442497 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618419f990 con 0x7f6184101f30 2024-09-13T16:07:28.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.258+0000 7f618b400640 1 -- 172.21.15.17:0/274442497 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618419fb00 con 0x7f6184103080 2024-09-13T16:07:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.258+0000 7f618b400640 1 -- 172.21.15.17:0/274442497 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618419fcc0 con 0x7f6184103a40 2024-09-13T16:07:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.258+0000 7f6189400640 1 --2- 172.21.15.17:0/274442497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6184103a40 0x7f618419f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.259+0000 7f6188a00640 1 --2- 172.21.15.17:0/274442497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6184101f30 0x7f6184197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.259+0000 7f6189400640 1 -- 172.21.15.17:0/274442497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6184103080 msgr2=0x7f61841983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.259+0000 7f6189400640 1 --2- 172.21.15.17:0/274442497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6184103080 0x7f61841983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.259+0000 7f6189400640 1 -- 172.21.15.17:0/274442497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6184101f30 msgr2=0x7f6184197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.259+0000 7f6189400640 1 --2- 172.21.15.17:0/274442497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6184101f30 0x7f6184197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.259+0000 7f6189400640 1 -- 172.21.15.17:0/274442497 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617c009900 con 0x7f6184103a40 2024-09-13T16:07:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.259+0000 7f6188a00640 1 --2- 172.21.15.17:0/274442497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6184101f30 0x7f6184197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:07:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.259+0000 7f6189400640 1 --2- 172.21.15.17:0/274442497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6184103a40 0x7f618419f450 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f617c031a90 tx=0x7f617c031460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:28.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:27 smithi017 ceph-mon[30494]: pgmap v676: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.7 MiB/s wr, 673 op/s 2024-09-13T16:07:28.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.260+0000 7f6181600640 1 -- 172.21.15.17:0/274442497 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c045070 con 0x7f6184103a40 2024-09-13T16:07:28.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.260+0000 7f618b400640 1 -- 172.21.15.17:0/274442497 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61840748f0 con 0x7f6184103a40 2024-09-13T16:07:28.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.260+0000 7f618b400640 1 -- 172.21.15.17:0/274442497 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6184074ed0 con 0x7f6184103a40 2024-09-13T16:07:28.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.261+0000 7f6181600640 1 -- 172.21.15.17:0/274442497 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f617c0317e0 con 0x7f6184103a40 2024-09-13T16:07:28.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.261+0000 7f6181600640 1 -- 172.21.15.17:0/274442497 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c02fc50 con 0x7f6184103a40 2024-09-13T16:07:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.265+0000 7f6181600640 1 -- 172.21.15.17:0/274442497 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f617c02f070 con 0x7f6184103a40 2024-09-13T16:07:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.266+0000 7f618e2a1740 1 Processor -- start 2024-09-13T16:07:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.268+0000 7f6181600640 1 --2- 172.21.15.17:0/274442497 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f616c0a1190 0x7f616c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.268+0000 7f6181600640 1 -- 172.21.15.17:0/274442497 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f617c0f5f10 con 0x7f6184103a40 2024-09-13T16:07:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.269+0000 7f618e2a1740 1 -- start start 2024-09-13T16:07:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.269+0000 7f618e2a1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d15564a70 0x563d15564e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.270+0000 7f618e2a1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d155653b0 0x563d15569e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.270+0000 7f6188a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d15564a70 0x563d15564e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.270+0000 7f618e2a1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d1556a440 0x563d1556c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.270+0000 7f6188a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d15564a70 0x563d15564e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:44336/0 (socket says 172.21.15.17:44336) 2024-09-13T16:07:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.271+0000 7f618e2a1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d15470bb0 con 0x563d155653b0 2024-09-13T16:07:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.271+0000 7f618e2a1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d154cea70 con 0x563d1556a440 2024-09-13T16:07:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.271+0000 7f618e2a1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d154cc200 con 0x563d15564a70 2024-09-13T16:07:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.271+0000 7f6189400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d1556a440 0x563d1556c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.271+0000 7f6183e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d155653b0 0x563d15569e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.271+0000 7f6189400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d1556a440 0x563d1556c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:46382/0 (socket says 172.21.15.17:46382) 2024-09-13T16:07:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.271+0000 7f6189400640 1 -- 172.21.15.17:0/3303654013 learned_addr learned my addr 172.21.15.17:0/3303654013 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.271+0000 7f6183e00640 1 --2- 172.21.15.17:0/274442497 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f616c0a1190 0x7f616c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.271+0000 7f6189400640 1 -- 172.21.15.17:0/3303654013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d15564a70 msgr2=0x563d15564e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.271+0000 7f6189400640 1 --2- 172.21.15.17:0/3303654013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d15564a70 0x563d15564e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.271+0000 7f6189400640 1 -- 172.21.15.17:0/3303654013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d155653b0 msgr2=0x563d15569e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.271+0000 7f6189400640 1 --2- 172.21.15.17:0/3303654013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d155653b0 0x563d15569e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.271+0000 7f6189400640 1 -- 172.21.15.17:0/3303654013 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d15469940 con 0x563d1556a440 2024-09-13T16:07:28.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.271+0000 7f6188a00640 1 --2- 172.21.15.17:0/3303654013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d15564a70 0x563d15564e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-13T16:07:28.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.272+0000 7f6189400640 1 --2- 172.21.15.17:0/3303654013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d1556a440 0x563d1556c900 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f617c0bf4b0 tx=0x7f617c0c2c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9792247c18ec66dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:28.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.272+0000 7f6176000640 1 -- 172.21.15.17:0/3303654013 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c0c2fb0 con 0x563d1556a440 2024-09-13T16:07:28.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.272+0000 7f6176000640 1 -- 172.21.15.17:0/3303654013 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f617c0c6de0 con 0x563d1556a440 2024-09-13T16:07:28.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.272+0000 7f6176000640 1 -- 172.21.15.17:0/3303654013 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c0cafa0 con 0x563d1556a440 2024-09-13T16:07:28.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.273+0000 7f618e2a1740 1 -- 172.21.15.17:0/3303654013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d1556a440 msgr2=0x563d1556c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:28.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.273+0000 7f618e2a1740 1 --2- 172.21.15.17:0/3303654013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d1556a440 0x563d1556c900 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f617c0bf4b0 tx=0x7f617c0c2c20 comp rx=0 tx=0).stop 2024-09-13T16:07:28.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.274+0000 7f6183e00640 1 --2- 172.21.15.17:0/274442497 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f616c0a1190 0x7f616c0a3650 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x563d15565de0 tx=0x7f6170005f30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:28.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.274+0000 7f618e2a1740 1 -- 172.21.15.17:0/3303654013 shutdown_connections 2024-09-13T16:07:28.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.274+0000 7f618e2a1740 1 --2- 172.21.15.17:0/3303654013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d1556a440 0x563d1556c900 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.274+0000 7f618e2a1740 1 --2- 172.21.15.17:0/3303654013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d155653b0 0x563d15569e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.274+0000 7f618e2a1740 1 --2- 172.21.15.17:0/3303654013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d15564a70 0x563d15564e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.274+0000 7f618e2a1740 1 -- 172.21.15.17:0/3303654013 >> 172.21.15.17:0/3303654013 conn(0x563d155600e0 msgr2=0x563d155604e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:28.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.275+0000 7f618e2a1740 1 -- 172.21.15.17:0/3303654013 shutdown_connections 2024-09-13T16:07:28.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.275+0000 7f618e2a1740 1 -- 172.21.15.17:0/3303654013 wait complete. 2024-09-13T16:07:28.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.275+0000 7f618e2a1740 1 -- start start 2024-09-13T16:07:28.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.276+0000 7f618e2a1740 1 Processor -- start 2024-09-13T16:07:28.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.276+0000 7f618e2a1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d15564a70 0x563d1556e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:28.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.276+0000 7f618e2a1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d155653b0 0x563d1556e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:28.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.277+0000 7f618e2a1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d1556a440 0x563d15575a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:28.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.277+0000 7f618e2a1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d154c7af0 con 0x563d15564a70 2024-09-13T16:07:28.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.277+0000 7f618e2a1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d15485f20 con 0x563d155653b0 2024-09-13T16:07:28.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.277+0000 7f618e2a1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d15485bc0 con 0x563d1556a440 2024-09-13T16:07:28.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.277+0000 7f6188a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d15564a70 0x563d1556e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:28.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.277+0000 7f6183e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d155653b0 0x563d1556e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:28.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.277+0000 7f6183e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d155653b0 0x563d1556e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:46386/0 (socket says 172.21.15.17:46386) 2024-09-13T16:07:28.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.277+0000 7f6183e00640 1 -- 172.21.15.17:0/3917212758 learned_addr learned my addr 172.21.15.17:0/3917212758 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:28.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.277+0000 7f6188a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d15564a70 0x563d1556e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46708/0 (socket says 172.21.15.17:46708) 2024-09-13T16:07:28.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.277+0000 7f618e2a1740 10 client.0 _ll_register_callbacks cb 0x563d154b7a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:07:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.278+0000 7f6183e00640 1 -- 172.21.15.17:0/3917212758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d1556a440 msgr2=0x563d15575a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:07:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.278+0000 7f6183e00640 1 --2- 172.21.15.17:0/3917212758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d1556a440 0x563d15575a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.278+0000 7f6183e00640 1 -- 172.21.15.17:0/3917212758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d15564a70 msgr2=0x563d1556e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.278+0000 7f6183e00640 1 --2- 172.21.15.17:0/3917212758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d15564a70 0x563d1556e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.278+0000 7f6183e00640 1 -- 172.21.15.17:0/3917212758 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6184074ed0 con 0x563d155653b0 2024-09-13T16:07:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.278+0000 7f6188a00640 1 --2- 172.21.15.17:0/3917212758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d15564a70 0x563d1556e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:07:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.279+0000 7f616aa00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:07:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.279+0000 7f6183e00640 1 --2- 172.21.15.17:0/3917212758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d155653b0 0x563d1556e9d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6170011bb0 tx=0x7f6170004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fcaaa32e5afbb31 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.279+0000 7f616aa00640 1 -- 172.21.15.17:0/3917212758 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6170010e20 con 0x563d155653b0 2024-09-13T16:07:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.279+0000 7f618e2a1740 1 -- 172.21.15.17:0/3917212758 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d154f1c90 con 0x563d155653b0 2024-09-13T16:07:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.279+0000 7f616aa00640 1 -- 172.21.15.17:0/3917212758 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f617001a040 con 0x563d155653b0 2024-09-13T16:07:28.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.284+0000 7f616aa00640 1 -- 172.21.15.17:0/3917212758 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6170010e20 con 0x563d155653b0 2024-09-13T16:07:28.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.284+0000 7f618e2a1740 10 client.26072 fetch_fsmap learned FSMap version 45 2024-09-13T16:07:28.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.284+0000 7f618e2a1740 1 -- 172.21.15.17:0/3917212758 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x563d154c6170 con 0x563d155653b0 2024-09-13T16:07:28.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.284+0000 7f616aa00640 1 -- 172.21.15.17:0/3917212758 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563d154f1c90 con 0x563d155653b0 2024-09-13T16:07:28.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.285+0000 7f616aa00640 1 -- 172.21.15.17:0/3917212758 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 45) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f6170004bf0 con 0x563d155653b0 2024-09-13T16:07:28.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.285+0000 7f618e2a1740 10 client.26072 fetch_fsmap finished waiting for FSMap version 45 2024-09-13T16:07:28.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.285+0000 7f618e2a1740 10 client.26072 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:07:28.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.285+0000 7f618e2a1740 20 client.26072 populate_metadata read hostname 'smithi017' 2024-09-13T16:07:28.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.285+0000 7f618e2a1740 1 --2- 172.21.15.17:0/3917212758 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x563d1557a230 0x563d1557c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:28.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.285+0000 7f618e2a1740 4 client.26072 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:07:28.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.285+0000 7f618e2a1740 1 -- 172.21.15.17:0/3917212758 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563d154ba7d0 con 0x563d1557a230 2024-09-13T16:07:28.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.285+0000 7f6188a00640 1 --2- 172.21.15.17:0/3917212758 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x563d1557a230 0x563d1557c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:28.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.286+0000 7f6188a00640 1 --2- 172.21.15.17:0/3917212758 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x563d1557a230 0x563d1557c650 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f553250e761c945 server_cookie=6c19e02efd3491b7 in_seq=0 out_seq=0 2024-09-13T16:07:28.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.286+0000 7f616aa00640 10 client.26072 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:07:28.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.287+0000 7f616aa00640 1 -- 172.21.15.17:0/3917212758 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563d154ba7d0 con 0x563d1557a230 2024-09-13T16:07:28.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.287+0000 7f616aa00640 10 client.26072 handle_command_reply: tid=0 2024-09-13T16:07:28.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.287+0000 7f618e2a1740 1 client.26072 shutdown 2024-09-13T16:07:28.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.287+0000 7f618e2a1740 1 -- 172.21.15.17:0/3917212758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d155653b0 msgr2=0x563d1556e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:28.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.287+0000 7f618e2a1740 1 --2- 172.21.15.17:0/3917212758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d155653b0 0x563d1556e9d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6170011bb0 tx=0x7f6170004730 comp rx=0 tx=0).stop 2024-09-13T16:07:28.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.287+0000 7f618e2a1740 1 -- 172.21.15.17:0/3917212758 shutdown_connections 2024-09-13T16:07:28.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.287+0000 7f618e2a1740 1 --2- 172.21.15.17:0/3917212758 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x563d1557a230 0x563d1557c650 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.287+0000 7f618e2a1740 1 --2- 172.21.15.17:0/3917212758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d1556a440 0x563d15575a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.287+0000 7f618e2a1740 1 --2- 172.21.15.17:0/3917212758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d155653b0 0x563d1556e9d0 secure :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6170011bb0 tx=0x7f6170004730 comp rx=0 tx=0).stop 2024-09-13T16:07:28.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.287+0000 7f616aa00640 0 client.26072 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:07:28.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.287+0000 7f618e2a1740 1 --2- 172.21.15.17:0/3917212758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d15564a70 0x563d1556e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.287+0000 7f618e2a1740 1 -- 172.21.15.17:0/3917212758 >> 172.21.15.17:0/3917212758 conn(0x563d155600e0 msgr2=0x563d155618f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:28.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.289+0000 7f618e2a1740 1 -- 172.21.15.17:0/3917212758 shutdown_connections 2024-09-13T16:07:28.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.289+0000 7f618e2a1740 1 -- 172.21.15.17:0/3917212758 wait complete. 2024-09-13T16:07:28.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.290+0000 7f618e2a1740 20 client.26072 trim_cache size 0 max 16384 2024-09-13T16:07:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.320+0000 7f618e2a1740 1 Processor -- start 2024-09-13T16:07:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.320+0000 7f618e2a1740 1 -- start start 2024-09-13T16:07:28.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.321+0000 7f618e2a1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d15564a70 0x563d1556e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:28.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.321+0000 7f618e2a1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d1556a440 0x563d1556e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:28.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.321+0000 7f618e2a1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d155669e0 0x563d155759d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:28.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.321+0000 7f618e2a1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d1522ee60 con 0x563d15564a70 2024-09-13T16:07:28.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.321+0000 7f618e2a1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d15565e40 con 0x563d1556a440 2024-09-13T16:07:28.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.321+0000 7f618e2a1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d1556f120 con 0x563d155669e0 2024-09-13T16:07:28.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.322+0000 7f6189400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d155669e0 0x563d155759d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:28.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.322+0000 7f6183e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d1556a440 0x563d1556e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:28.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.322+0000 7f6189400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d155669e0 0x563d155759d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:44352/0 (socket says 172.21.15.17:44352) 2024-09-13T16:07:28.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.322+0000 7f6189400640 1 -- 172.21.15.17:0/653469026 learned_addr learned my addr 172.21.15.17:0/653469026 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:28.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.322+0000 7f6183e00640 1 -- 172.21.15.17:0/653469026 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d155669e0 msgr2=0x563d155759d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.322+0000 7f6183e00640 1 --2- 172.21.15.17:0/653469026 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d155669e0 0x563d155759d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.322+0000 7f6183e00640 1 -- 172.21.15.17:0/653469026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d15564a70 msgr2=0x563d1556e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.322+0000 7f6183e00640 1 --2- 172.21.15.17:0/653469026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d15564a70 0x563d1556e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.322+0000 7f6183e00640 1 -- 172.21.15.17:0/653469026 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d15468180 con 0x563d1556a440 2024-09-13T16:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.323+0000 7f6183e00640 1 --2- 172.21.15.17:0/653469026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d1556a440 0x563d1556e9d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f617001f000 tx=0x7f6170028530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c18b4768b7d074b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.323+0000 7f6176a00640 1 -- 172.21.15.17:0/653469026 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6170010e20 con 0x563d1556a440 2024-09-13T16:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.323+0000 7f6176a00640 1 -- 172.21.15.17:0/653469026 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6170011760 con 0x563d1556a440 2024-09-13T16:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.323+0000 7f6176a00640 1 -- 172.21.15.17:0/653469026 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6170005250 con 0x563d1556a440 2024-09-13T16:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.324+0000 7f6189400640 1 --2- 172.21.15.17:0/653469026 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d155669e0 0x563d155759d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.324+0000 7f618e2a1740 1 -- 172.21.15.17:0/653469026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d1556a440 msgr2=0x563d1556e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.324+0000 7f618e2a1740 1 --2- 172.21.15.17:0/653469026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d1556a440 0x563d1556e9d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f617001f000 tx=0x7f6170028530 comp rx=0 tx=0).stop 2024-09-13T16:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.324+0000 7f618e2a1740 1 -- 172.21.15.17:0/653469026 shutdown_connections 2024-09-13T16:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.324+0000 7f618e2a1740 1 --2- 172.21.15.17:0/653469026 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d155669e0 0x563d155759d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.324+0000 7f618e2a1740 1 --2- 172.21.15.17:0/653469026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d1556a440 0x563d1556e9d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.324+0000 7f618e2a1740 1 --2- 172.21.15.17:0/653469026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d15564a70 0x563d1556e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.324+0000 7f618e2a1740 1 -- 172.21.15.17:0/653469026 >> 172.21.15.17:0/653469026 conn(0x563d155600e0 msgr2=0x563d155662d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.324+0000 7f618e2a1740 1 -- 172.21.15.17:0/653469026 shutdown_connections 2024-09-13T16:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.324+0000 7f618e2a1740 1 -- 172.21.15.17:0/653469026 wait complete. 2024-09-13T16:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.325+0000 7f618e2a1740 1 -- start start 2024-09-13T16:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.325+0000 7f618e2a1740 1 Processor -- start 2024-09-13T16:07:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.327+0000 7f618e2a1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d15564a70 0x563d15572730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.327+0000 7f618e2a1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d155669e0 0x563d15572c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.327+0000 7f618e2a1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d1556a440 0x563d155d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.327+0000 7f618e2a1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d15575c90 con 0x563d15564a70 2024-09-13T16:07:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.327+0000 7f618e2a1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d15575e00 con 0x563d155669e0 2024-09-13T16:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.327+0000 7f618e2a1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d155d0c60 con 0x563d1556a440 2024-09-13T16:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.327+0000 7f618e2a1740 10 client.0 _ll_register_callbacks cb 0x7f617c005c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.328+0000 7f6189400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d1556a440 0x563d155d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.328+0000 7f6183e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d155669e0 0x563d15572c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.328+0000 7f6189400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d1556a440 0x563d155d0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:44364/0 (socket says 172.21.15.17:44364) 2024-09-13T16:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.328+0000 7f6183e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d155669e0 0x563d15572c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:46404/0 (socket says 172.21.15.17:46404) 2024-09-13T16:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.328+0000 7f6189400640 1 -- 172.21.15.17:0/337537048 learned_addr learned my addr 172.21.15.17:0/337537048 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.328+0000 7f6189400640 1 -- 172.21.15.17:0/337537048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d155669e0 msgr2=0x563d15572c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.328+0000 7f6189400640 1 --2- 172.21.15.17:0/337537048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d155669e0 0x563d15572c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.328+0000 7f6189400640 1 -- 172.21.15.17:0/337537048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d15564a70 msgr2=0x563d15572730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.328+0000 7f6189400640 1 --2- 172.21.15.17:0/337537048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d15564a70 0x563d15572730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.328+0000 7f6189400640 1 -- 172.21.15.17:0/337537048 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563d15469940 con 0x563d1556a440 2024-09-13T16:07:28.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.329+0000 7f6189400640 1 --2- 172.21.15.17:0/337537048 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d1556a440 0x563d155d0720 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f617c006010 tx=0x7f617c031550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0ef9dc62303a619 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.329+0000 7f616aa00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:07:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.329+0000 7f616aa00640 1 -- 172.21.15.17:0/337537048 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c0cb430 con 0x563d1556a440 2024-09-13T16:07:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.330+0000 7f616aa00640 1 -- 172.21.15.17:0/337537048 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f617c0cafa0 con 0x563d1556a440 2024-09-13T16:07:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.330+0000 7f618e2a1740 1 -- 172.21.15.17:0/337537048 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f617c0c6de0 con 0x563d1556a440 2024-09-13T16:07:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.330+0000 7f616aa00640 1 -- 172.21.15.17:0/337537048 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f617c0cb160 con 0x563d1556a440 2024-09-13T16:07:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.331+0000 7f618e2a1740 10 client.26098 fetch_fsmap learned FSMap version 45 2024-09-13T16:07:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.331+0000 7f618e2a1740 1 -- 172.21.15.17:0/337537048 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x563d154c6170 con 0x563d1556a440 2024-09-13T16:07:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.331+0000 7f616aa00640 1 -- 172.21.15.17:0/337537048 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f617c0c6de0 con 0x563d1556a440 2024-09-13T16:07:28.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.331+0000 7f616aa00640 1 -- 172.21.15.17:0/337537048 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 45) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f617c050020 con 0x563d1556a440 2024-09-13T16:07:28.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.333+0000 7f618e2a1740 10 client.26098 fetch_fsmap finished waiting for FSMap version 45 2024-09-13T16:07:28.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.333+0000 7f618e2a1740 10 client.26098 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:07:28.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.333+0000 7f618e2a1740 20 client.26098 populate_metadata read hostname 'smithi017' 2024-09-13T16:07:28.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.333+0000 7f618e2a1740 1 --2- 172.21.15.17:0/337537048 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x563d155d1fe0 0x563d155d43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:28.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.333+0000 7f618e2a1740 4 client.26098 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:07:28.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.333+0000 7f618e2a1740 1 -- 172.21.15.17:0/337537048 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563d151bb300 con 0x563d155d1fe0 2024-09-13T16:07:28.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.334+0000 7f6188a00640 1 --2- 172.21.15.17:0/337537048 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x563d155d1fe0 0x563d155d43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:28.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.335+0000 7f6188a00640 1 --2- 172.21.15.17:0/337537048 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x563d155d1fe0 0x563d155d43d0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16eee0465dd1410e server_cookie=e9a1530c962528e5 in_seq=0 out_seq=0 2024-09-13T16:07:28.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.335+0000 7f616aa00640 10 client.26098 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:07:28.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.351+0000 7f616aa00640 1 -- 172.21.15.17:0/337537048 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563d151bb300 con 0x563d155d1fe0 2024-09-13T16:07:28.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.351+0000 7f616aa00640 10 client.26098 handle_command_reply: tid=0 2024-09-13T16:07:28.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.351+0000 7f618e2a1740 1 client.26098 shutdown 2024-09-13T16:07:28.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.351+0000 7f618e2a1740 1 -- 172.21.15.17:0/337537048 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d1556a440 msgr2=0x563d155d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:28.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.351+0000 7f618e2a1740 1 --2- 172.21.15.17:0/337537048 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d1556a440 0x563d155d0720 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f617c006010 tx=0x7f617c031550 comp rx=0 tx=0).stop 2024-09-13T16:07:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.351+0000 7f618e2a1740 1 -- 172.21.15.17:0/337537048 shutdown_connections 2024-09-13T16:07:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.352+0000 7f618e2a1740 1 --2- 172.21.15.17:0/337537048 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x563d155d1fe0 0x563d155d43d0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.352+0000 7f618e2a1740 1 --2- 172.21.15.17:0/337537048 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563d1556a440 0x563d155d0720 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.352+0000 7f618e2a1740 1 --2- 172.21.15.17:0/337537048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563d155669e0 0x563d15572c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.352+0000 7f618e2a1740 1 --2- 172.21.15.17:0/337537048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d15564a70 0x563d15572730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.352+0000 7f618e2a1740 1 -- 172.21.15.17:0/337537048 >> 172.21.15.17:0/337537048 conn(0x563d155600e0 msgr2=0x563d15569860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.352+0000 7f616aa00640 0 client.26098 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:07:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.352+0000 7f618e2a1740 1 -- 172.21.15.17:0/337537048 shutdown_connections 2024-09-13T16:07:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.352+0000 7f618e2a1740 1 -- 172.21.15.17:0/337537048 wait complete. 2024-09-13T16:07:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.353+0000 7f618e2a1740 20 client.26098 trim_cache size 0 max 16384 2024-09-13T16:07:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:07:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:07:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:07:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:07:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.353+0000 7f618b400640 1 -- 172.21.15.17:0/274442497 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f616c0a1190 msgr2=0x7f616c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.353+0000 7f618b400640 1 --2- 172.21.15.17:0/274442497 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f616c0a1190 0x7f616c0a3650 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x563d15565de0 tx=0x7f6170005f30 comp rx=0 tx=0).stop 2024-09-13T16:07:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.353+0000 7f618b400640 1 -- 172.21.15.17:0/274442497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6184103a40 msgr2=0x7f618419f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.353+0000 7f618b400640 1 --2- 172.21.15.17:0/274442497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6184103a40 0x7f618419f450 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f617c031a90 tx=0x7f617c031460 comp rx=0 tx=0).stop 2024-09-13T16:07:28.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.354+0000 7f618b400640 1 -- 172.21.15.17:0/274442497 shutdown_connections 2024-09-13T16:07:28.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.354+0000 7f618b400640 1 --2- 172.21.15.17:0/274442497 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f616c0a1190 0x7f616c0a3650 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.354+0000 7f618b400640 1 --2- 172.21.15.17:0/274442497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6184103a40 0x7f618419f450 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.354+0000 7f618b400640 1 --2- 172.21.15.17:0/274442497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6184103080 0x7f61841983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.354+0000 7f618b400640 1 --2- 172.21.15.17:0/274442497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6184101f30 0x7f6184197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:28.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.354+0000 7f618b400640 1 -- 172.21.15.17:0/274442497 >> 172.21.15.17:0/274442497 conn(0x7f61840fd6b0 msgr2=0x7f61841064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:28.358 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:27 smithi189 ceph-mon[34790]: pgmap v676: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.7 MiB/s wr, 673 op/s 2024-09-13T16:07:28.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.355+0000 7f618b400640 1 -- 172.21.15.17:0/274442497 shutdown_connections 2024-09-13T16:07:28.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:28.355+0000 7f618b400640 1 -- 172.21.15.17:0/274442497 wait complete. 2024-09-13T16:07:30.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:29 smithi193 ceph-mon[35248]: pgmap v677: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.8 MiB/s wr, 560 op/s 2024-09-13T16:07:30.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:29 smithi017 ceph-mon[30494]: pgmap v677: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.8 MiB/s wr, 560 op/s 2024-09-13T16:07:30.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 585.0 s, 532.4 tps, lat 185.324 ms stddev 231.717 2024-09-13T16:07:30.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:29 smithi189 ceph-mon[34790]: pgmap v677: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.8 MiB/s wr, 560 op/s 2024-09-13T16:07:32.257 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:31 smithi193 ceph-mon[35248]: pgmap v678: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.9 MiB/s wr, 582 op/s 2024-09-13T16:07:32.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:31 smithi017 ceph-mon[30494]: pgmap v678: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.9 MiB/s wr, 582 op/s 2024-09-13T16:07:32.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:31 smithi189 ceph-mon[34790]: pgmap v678: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.9 MiB/s wr, 582 op/s 2024-09-13T16:07:34.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:33 smithi193 ceph-mon[35248]: pgmap v679: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 511 op/s 2024-09-13T16:07:34.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:33 smithi017 ceph-mon[30494]: pgmap v679: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 511 op/s 2024-09-13T16:07:34.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:33 smithi189 ceph-mon[34790]: pgmap v679: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 511 op/s 2024-09-13T16:07:35.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 590.0 s, 587.8 tps, lat 167.514 ms stddev 205.310 2024-09-13T16:07:36.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:35 smithi193 ceph-mon[35248]: pgmap v680: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.8 MiB/s wr, 543 op/s 2024-09-13T16:07:36.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:35 smithi017 ceph-mon[30494]: pgmap v680: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.8 MiB/s wr, 543 op/s 2024-09-13T16:07:36.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:35 smithi189 ceph-mon[34790]: pgmap v680: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.8 MiB/s wr, 543 op/s 2024-09-13T16:07:38.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:37 smithi193 ceph-mon[35248]: pgmap v681: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.3 MiB/s wr, 699 op/s 2024-09-13T16:07:38.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:37 smithi017 ceph-mon[30494]: pgmap v681: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.3 MiB/s wr, 699 op/s 2024-09-13T16:07:38.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:37 smithi189 ceph-mon[34790]: pgmap v681: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.3 MiB/s wr, 699 op/s 2024-09-13T16:07:40.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:39 smithi193 ceph-mon[35248]: pgmap v682: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.2 MiB/s wr, 652 op/s 2024-09-13T16:07:40.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:39 smithi017 ceph-mon[30494]: pgmap v682: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.2 MiB/s wr, 652 op/s 2024-09-13T16:07:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 595.0 s, 477.8 tps, lat 213.062 ms stddev 257.575 2024-09-13T16:07:40.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:39 smithi189 ceph-mon[34790]: pgmap v682: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.2 MiB/s wr, 652 op/s 2024-09-13T16:07:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.531+0000 7fcf02400640 1 -- 172.21.15.17:0/2814712394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcefc102f60 msgr2=0x7fcefc1033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.531+0000 7fcf02400640 1 --2- 172.21.15.17:0/2814712394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcefc102f60 0x7fcefc1033e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fcee8009900 tx=0x7fcee802a400 comp rx=0 tx=0).stop 2024-09-13T16:07:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.532+0000 7fcf02400640 1 -- 172.21.15.17:0/2814712394 shutdown_connections 2024-09-13T16:07:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.532+0000 7fcf02400640 1 --2- 172.21.15.17:0/2814712394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcefc103920 0x7fcefc10a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.532+0000 7fcf02400640 1 --2- 172.21.15.17:0/2814712394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcefc102f60 0x7fcefc1033e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.532+0000 7fcf02400640 1 --2- 172.21.15.17:0/2814712394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcefc101d70 0x7fcefc102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.532+0000 7fcf02400640 1 -- 172.21.15.17:0/2814712394 >> 172.21.15.17:0/2814712394 conn(0x7fcefc0fd510 msgr2=0x7fcefc0ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.532+0000 7fcf02400640 1 -- 172.21.15.17:0/2814712394 shutdown_connections 2024-09-13T16:07:41.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.532+0000 7fcf02400640 1 -- 172.21.15.17:0/2814712394 wait complete. 2024-09-13T16:07:41.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.533+0000 7fcf02400640 1 Processor -- start 2024-09-13T16:07:41.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.533+0000 7fcf02400640 1 -- start start 2024-09-13T16:07:41.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.534+0000 7fcf02400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcefc101d70 0x7fcefc197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:41.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.534+0000 7fcf02400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcefc102f60 0x7fcefc198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.534+0000 7fcf02400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcefc103920 0x7fcefc19f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.534+0000 7fcf02400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc19f7e0 con 0x7fcefc102f60 2024-09-13T16:07:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.534+0000 7fcf02400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc19f950 con 0x7fcefc103920 2024-09-13T16:07:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.534+0000 7fcf02400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc19fb10 con 0x7fcefc101d70 2024-09-13T16:07:41.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.534+0000 7fcf01000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcefc101d70 0x7fcefc197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:41.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.534+0000 7fcf01000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcefc101d70 0x7fcefc197d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:59774/0 (socket says 172.21.15.17:59774) 2024-09-13T16:07:41.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.534+0000 7fcf01000640 1 -- 172.21.15.17:0/2191815179 learned_addr learned my addr 172.21.15.17:0/2191815179 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:41.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.534+0000 7fcefbe00640 1 --2- 172.21.15.17:0/2191815179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcefc102f60 0x7fcefc198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:41.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.534+0000 7fcf01a00640 1 --2- 172.21.15.17:0/2191815179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcefc103920 0x7fcefc19f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:41.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.534+0000 7fcf01a00640 1 -- 172.21.15.17:0/2191815179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcefc101d70 msgr2=0x7fcefc197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:41.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.534+0000 7fcf01a00640 1 --2- 172.21.15.17:0/2191815179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcefc101d70 0x7fcefc197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.534+0000 7fcf01a00640 1 -- 172.21.15.17:0/2191815179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcefc102f60 msgr2=0x7fcefc198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:41.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.534+0000 7fcf01a00640 1 --2- 172.21.15.17:0/2191815179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcefc102f60 0x7fcefc198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.534+0000 7fcf01a00640 1 -- 172.21.15.17:0/2191815179 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee8009560 con 0x7fcefc103920 2024-09-13T16:07:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.534+0000 7fcefbe00640 1 --2- 172.21.15.17:0/2191815179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcefc102f60 0x7fcefc198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:07:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.535+0000 7fcf01a00640 1 --2- 172.21.15.17:0/2191815179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcefc103920 0x7fcefc19f270 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcef4009fd0 tx=0x7fcef400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.535+0000 7fcef9600640 1 -- 172.21.15.17:0/2191815179 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef400ce20 con 0x7fcefc103920 2024-09-13T16:07:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.535+0000 7fcef9600640 1 -- 172.21.15.17:0/2191815179 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcef4005020 con 0x7fcefc103920 2024-09-13T16:07:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.535+0000 7fcef9600640 1 -- 172.21.15.17:0/2191815179 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4010670 con 0x7fcefc103920 2024-09-13T16:07:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.535+0000 7fcf02400640 1 -- 172.21.15.17:0/2191815179 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcefc19fdf0 con 0x7fcefc103920 2024-09-13T16:07:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.535+0000 7fcf02400640 1 -- 172.21.15.17:0/2191815179 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcefc1a01c0 con 0x7fcefc103920 2024-09-13T16:07:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.540+0000 7fcef9600640 1 -- 172.21.15.17:0/2191815179 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fcef4005450 con 0x7fcefc103920 2024-09-13T16:07:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.543+0000 7fcef9600640 1 --2- 172.21.15.17:0/2191815179 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcee40a1130 0x7fcee40a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.544+0000 7fcef9600640 1 -- 172.21.15.17:0/2191815179 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fcef4014070 con 0x7fcefc103920 2024-09-13T16:07:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.544+0000 7fcf01000640 1 --2- 172.21.15.17:0/2191815179 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcee40a1130 0x7fcee40a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.545+0000 7fcf01000640 1 --2- 172.21.15.17:0/2191815179 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcee40a1130 0x7fcee40a35f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcefc1991d0 tx=0x7fcef000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.546+0000 7fcf06865740 1 Processor -- start 2024-09-13T16:07:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.546+0000 7fcf06865740 1 -- start start 2024-09-13T16:07:41.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.546+0000 7fcf06865740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff041d2490 0x55ff041d2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:41.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.546+0000 7fcf06865740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041d2dd0 0x55ff041d7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:41.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.546+0000 7fcf06865740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d7e60 0x55ff041da320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:41.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.546+0000 7fcf06865740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff040d5bb0 con 0x55ff041d2dd0 2024-09-13T16:07:41.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.546+0000 7fcf06865740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff04133a70 con 0x55ff041d2490 2024-09-13T16:07:41.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.546+0000 7fcf06865740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff04131200 con 0x55ff041d7e60 2024-09-13T16:07:41.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.547+0000 7fcefbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041d2dd0 0x55ff041d7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:41.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.547+0000 7fcefbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041d2dd0 0x55ff041d7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37794/0 (socket says 172.21.15.17:37794) 2024-09-13T16:07:41.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.547+0000 7fcefbe00640 1 -- 172.21.15.17:0/186079910 learned_addr learned my addr 172.21.15.17:0/186079910 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:41.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.547+0000 7fcf01a00640 1 --2- 172.21.15.17:0/186079910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d7e60 0x55ff041da320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:41.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.547+0000 7fcf01000640 1 --2- 172.21.15.17:0/186079910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff041d2490 0x55ff041d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:41.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.547+0000 7fcefbe00640 1 -- 172.21.15.17:0/186079910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d7e60 msgr2=0x55ff041da320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:41.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.547+0000 7fcefbe00640 1 --2- 172.21.15.17:0/186079910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d7e60 0x55ff041da320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.547+0000 7fcefbe00640 1 -- 172.21.15.17:0/186079910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff041d2490 msgr2=0x55ff041d2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:41.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.547+0000 7fcefbe00640 1 --2- 172.21.15.17:0/186079910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff041d2490 0x55ff041d2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.547+0000 7fcefbe00640 1 -- 172.21.15.17:0/186079910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff040ce940 con 0x55ff041d2dd0 2024-09-13T16:07:41.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.547+0000 7fcefbe00640 1 --2- 172.21.15.17:0/186079910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041d2dd0 0x55ff041d7890 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcee8009900 tx=0x7fcee8004520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5052e3cc228895f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:41.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.548+0000 7fceee000640 1 -- 172.21.15.17:0/186079910 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee8003870 con 0x55ff041d2dd0 2024-09-13T16:07:41.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.548+0000 7fceee000640 1 -- 172.21.15.17:0/186079910 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcee8040070 con 0x55ff041d2dd0 2024-09-13T16:07:41.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.548+0000 7fceee000640 1 -- 172.21.15.17:0/186079910 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee8031e30 con 0x55ff041d2dd0 2024-09-13T16:07:41.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.550+0000 7fcf06865740 1 -- 172.21.15.17:0/186079910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041d2dd0 msgr2=0x55ff041d7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:41.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.550+0000 7fcf06865740 1 --2- 172.21.15.17:0/186079910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041d2dd0 0x55ff041d7890 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcee8009900 tx=0x7fcee8004520 comp rx=0 tx=0).stop 2024-09-13T16:07:41.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.551+0000 7fcf06865740 1 -- 172.21.15.17:0/186079910 shutdown_connections 2024-09-13T16:07:41.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.551+0000 7fcf06865740 1 --2- 172.21.15.17:0/186079910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d7e60 0x55ff041da320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.551+0000 7fcf06865740 1 --2- 172.21.15.17:0/186079910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041d2dd0 0x55ff041d7890 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.551+0000 7fcf06865740 1 --2- 172.21.15.17:0/186079910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff041d2490 0x55ff041d2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.551+0000 7fcf06865740 1 -- 172.21.15.17:0/186079910 >> 172.21.15.17:0/186079910 conn(0x55ff041cdb00 msgr2=0x55ff041cdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:41.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.551+0000 7fcf06865740 1 -- 172.21.15.17:0/186079910 shutdown_connections 2024-09-13T16:07:41.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.551+0000 7fcf06865740 1 -- 172.21.15.17:0/186079910 wait complete. 2024-09-13T16:07:41.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.552+0000 7fcf06865740 1 -- start start 2024-09-13T16:07:41.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.552+0000 7fcf06865740 1 Processor -- start 2024-09-13T16:07:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.553+0000 7fcf06865740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d2490 0x55ff041dc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.553+0000 7fcf06865740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041d7e60 0x55ff041dc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.553+0000 7fcf06865740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff041e18b0 0x55ff041e3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.553+0000 7fcf06865740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff0412caf0 con 0x55ff041d7e60 2024-09-13T16:07:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.553+0000 7fcf06865740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff040eaf20 con 0x55ff041e18b0 2024-09-13T16:07:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.553+0000 7fcf06865740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff040eabc0 con 0x55ff041d2490 2024-09-13T16:07:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.553+0000 7fcf06865740 10 client.0 _ll_register_callbacks cb 0x55ff0411ca70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:07:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.553+0000 7fcf01000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d2490 0x55ff041dc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.553+0000 7fcf01000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d2490 0x55ff041dc390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:59794/0 (socket says 172.21.15.17:59794) 2024-09-13T16:07:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.553+0000 7fcf01000640 1 -- 172.21.15.17:0/3803404597 learned_addr learned my addr 172.21.15.17:0/3803404597 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.553+0000 7fcf01a00640 1 --2- 172.21.15.17:0/3803404597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff041e18b0 0x55ff041e3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.553+0000 7fcefbe00640 1 --2- 172.21.15.17:0/3803404597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041d7e60 0x55ff041dc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.554+0000 7fcf01a00640 1 -- 172.21.15.17:0/3803404597 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d2490 msgr2=0x55ff041dc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.554+0000 7fcf01a00640 1 --2- 172.21.15.17:0/3803404597 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d2490 0x55ff041dc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.554+0000 7fcf01a00640 1 -- 172.21.15.17:0/3803404597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041d7e60 msgr2=0x55ff041dc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.554+0000 7fcf01a00640 1 --2- 172.21.15.17:0/3803404597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041d7e60 0x55ff041dc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.554+0000 7fcf01a00640 1 -- 172.21.15.17:0/3803404597 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcefc10aab0 con 0x55ff041e18b0 2024-09-13T16:07:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.554+0000 7fcefbe00640 1 --2- 172.21.15.17:0/3803404597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041d7e60 0x55ff041dc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:07:41.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.554+0000 7fcf01a00640 1 --2- 172.21.15.17:0/3803404597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff041e18b0 0x55ff041e3ca0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcef40ca790 tx=0x7fcef40983b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf908559f406ff6a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:41.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.554+0000 7fcee2a00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:07:41.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.554+0000 7fcee2a00640 1 -- 172.21.15.17:0/3803404597 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef40a22d0 con 0x55ff041e18b0 2024-09-13T16:07:41.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.554+0000 7fcf06865740 1 -- 172.21.15.17:0/3803404597 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ff04156c90 con 0x55ff041e18b0 2024-09-13T16:07:41.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.554+0000 7fcee2a00640 1 -- 172.21.15.17:0/3803404597 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fcef40a2560 con 0x55ff041e18b0 2024-09-13T16:07:41.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.554+0000 7fcee2a00640 1 -- 172.21.15.17:0/3803404597 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcef40b8250 con 0x55ff041e18b0 2024-09-13T16:07:41.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.554+0000 7fcf06865740 10 client.26090 fetch_fsmap learned FSMap version 45 2024-09-13T16:07:41.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.554+0000 7fcf06865740 1 -- 172.21.15.17:0/3803404597 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55ff0412b170 con 0x55ff041e18b0 2024-09-13T16:07:41.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.555+0000 7fcee2a00640 1 -- 172.21.15.17:0/3803404597 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ff04156c90 con 0x55ff041e18b0 2024-09-13T16:07:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.555+0000 7fcee2a00640 1 -- 172.21.15.17:0/3803404597 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 45) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fcef4095e40 con 0x55ff041e18b0 2024-09-13T16:07:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.556+0000 7fcf06865740 10 client.26090 fetch_fsmap finished waiting for FSMap version 45 2024-09-13T16:07:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.556+0000 7fcf06865740 10 client.26090 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:07:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.556+0000 7fcf06865740 20 client.26090 populate_metadata read hostname 'smithi017' 2024-09-13T16:07:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.556+0000 7fcf06865740 1 --2- 172.21.15.17:0/3803404597 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55ff041e8360 0x55ff041ea780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.556+0000 7fcf06865740 4 client.26090 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:07:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.556+0000 7fcf06865740 1 -- 172.21.15.17:0/3803404597 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ff0411f7d0 con 0x55ff041e8360 2024-09-13T16:07:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.556+0000 7fcf01000640 1 --2- 172.21.15.17:0/3803404597 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55ff041e8360 0x55ff041ea780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.556+0000 7fcf01000640 1 --2- 172.21.15.17:0/3803404597 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55ff041e8360 0x55ff041ea780 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbf3eae1e5b6fd6f server_cookie=fff5c0aabea50b1e in_seq=0 out_seq=0 2024-09-13T16:07:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.556+0000 7fcee2a00640 10 client.26090 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:07:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.557+0000 7fcee2a00640 1 -- 172.21.15.17:0/3803404597 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ff0411f7d0 con 0x55ff041e8360 2024-09-13T16:07:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.557+0000 7fcee2a00640 10 client.26090 handle_command_reply: tid=0 2024-09-13T16:07:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.557+0000 7fcf06865740 1 client.26090 shutdown 2024-09-13T16:07:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.557+0000 7fcf06865740 1 -- 172.21.15.17:0/3803404597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff041e18b0 msgr2=0x55ff041e3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.557+0000 7fcf06865740 1 --2- 172.21.15.17:0/3803404597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff041e18b0 0x55ff041e3ca0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcef40ca790 tx=0x7fcef40983b0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.558+0000 7fcf06865740 1 -- 172.21.15.17:0/3803404597 shutdown_connections 2024-09-13T16:07:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.558+0000 7fcf06865740 1 --2- 172.21.15.17:0/3803404597 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55ff041e8360 0x55ff041ea780 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.558+0000 7fcf06865740 1 --2- 172.21.15.17:0/3803404597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff041e18b0 0x55ff041e3ca0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.558+0000 7fcf06865740 1 --2- 172.21.15.17:0/3803404597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041d7e60 0x55ff041dc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.558+0000 7fcf06865740 1 --2- 172.21.15.17:0/3803404597 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d2490 0x55ff041dc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.558+0000 7fcf06865740 1 -- 172.21.15.17:0/3803404597 >> 172.21.15.17:0/3803404597 conn(0x55ff041cdb00 msgr2=0x55ff041cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.558+0000 7fcee2a00640 0 client.26090 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:07:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.558+0000 7fcf06865740 1 -- 172.21.15.17:0/3803404597 shutdown_connections 2024-09-13T16:07:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.558+0000 7fcf06865740 1 -- 172.21.15.17:0/3803404597 wait complete. 2024-09-13T16:07:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.558+0000 7fcf06865740 20 client.26090 trim_cache size 0 max 16384 2024-09-13T16:07:41.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.580+0000 7fcf06865740 1 Processor -- start 2024-09-13T16:07:41.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.580+0000 7fcf06865740 1 -- start start 2024-09-13T16:07:41.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.581+0000 7fcf06865740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d2490 0x55ff041f8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:41.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.581+0000 7fcf06865740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff041d7e60 0x55ff041f8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.581+0000 7fcf06865740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041e18b0 0x55ff041d3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.581+0000 7fcf06865740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff03e93e60 con 0x55ff041e18b0 2024-09-13T16:07:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.581+0000 7fcf06865740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff041dbed0 con 0x55ff041d7e60 2024-09-13T16:07:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.581+0000 7fcf06865740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff041e8160 con 0x55ff041d2490 2024-09-13T16:07:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.581+0000 7fcf01a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041e18b0 0x55ff041d3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.582+0000 7fcf01a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041e18b0 0x55ff041d3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37814/0 (socket says 172.21.15.17:37814) 2024-09-13T16:07:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.582+0000 7fcf01a00640 1 -- 172.21.15.17:0/1331817120 learned_addr learned my addr 172.21.15.17:0/1331817120 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.582+0000 7fcf01000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d2490 0x55ff041f8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.582+0000 7fcefbe00640 1 --2- 172.21.15.17:0/1331817120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff041d7e60 0x55ff041f8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.582+0000 7fcf01000640 1 -- 172.21.15.17:0/1331817120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff041d7e60 msgr2=0x55ff041f8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.582+0000 7fcf01000640 1 --2- 172.21.15.17:0/1331817120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff041d7e60 0x55ff041f8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.582+0000 7fcf01000640 1 -- 172.21.15.17:0/1331817120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041e18b0 msgr2=0x55ff041d3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.582+0000 7fcf01000640 1 --2- 172.21.15.17:0/1331817120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041e18b0 0x55ff041d3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.582+0000 7fcf01000640 1 -- 172.21.15.17:0/1331817120 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff040cd180 con 0x55ff041d2490 2024-09-13T16:07:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.583+0000 7fcf01a00640 1 --2- 172.21.15.17:0/1331817120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041e18b0 0x55ff041d3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:07:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.583+0000 7fcf01000640 1 --2- 172.21.15.17:0/1331817120 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d2490 0x55ff041f8620 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55ff041e8740 tx=0x7fcef0013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df39a58d0664b8de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.583+0000 7fceeea00640 1 -- 172.21.15.17:0/1331817120 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef002e070 con 0x55ff041d2490 2024-09-13T16:07:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.583+0000 7fceeea00640 1 -- 172.21.15.17:0/1331817120 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcef0015070 con 0x55ff041d2490 2024-09-13T16:07:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.583+0000 7fceeea00640 1 -- 172.21.15.17:0/1331817120 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef0024040 con 0x55ff041d2490 2024-09-13T16:07:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.584+0000 7fcf06865740 1 -- 172.21.15.17:0/1331817120 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d2490 msgr2=0x55ff041f8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.584+0000 7fcf06865740 1 --2- 172.21.15.17:0/1331817120 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d2490 0x55ff041f8620 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55ff041e8740 tx=0x7fcef0013000 comp rx=0 tx=0).stop 2024-09-13T16:07:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.584+0000 7fcf06865740 1 -- 172.21.15.17:0/1331817120 shutdown_connections 2024-09-13T16:07:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.584+0000 7fcf06865740 1 --2- 172.21.15.17:0/1331817120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041e18b0 0x55ff041d3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.584+0000 7fcf06865740 1 --2- 172.21.15.17:0/1331817120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff041d7e60 0x55ff041f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.584+0000 7fcf06865740 1 --2- 172.21.15.17:0/1331817120 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d2490 0x55ff041f8620 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.584+0000 7fcf06865740 1 -- 172.21.15.17:0/1331817120 >> 172.21.15.17:0/1331817120 conn(0x55ff041cdb00 msgr2=0x55ff041cdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.584+0000 7fcf06865740 1 -- 172.21.15.17:0/1331817120 shutdown_connections 2024-09-13T16:07:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.584+0000 7fcf06865740 1 -- 172.21.15.17:0/1331817120 wait complete. 2024-09-13T16:07:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.584+0000 7fcf06865740 1 -- start start 2024-09-13T16:07:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.585+0000 7fcf06865740 1 Processor -- start 2024-09-13T16:07:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.585+0000 7fcf06865740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff041d2490 0x55ff04237500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.585+0000 7fcf06865740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d7e60 0x55ff04237a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.585+0000 7fcf06865740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041e18b0 0x55ff0423e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.585+0000 7fcf06865740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff0423e870 con 0x55ff041e18b0 2024-09-13T16:07:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.585+0000 7fcf06865740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff0423e9b0 con 0x55ff041d2490 2024-09-13T16:07:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.585+0000 7fcf06865740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff0423eb40 con 0x55ff041d7e60 2024-09-13T16:07:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.585+0000 7fcf06865740 10 client.0 _ll_register_callbacks cb 0x7fcee8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:07:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.585+0000 7fcf01a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041e18b0 0x55ff0423e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.585+0000 7fcf01000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff041d2490 0x55ff04237500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.585+0000 7fcefbe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d7e60 0x55ff04237a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.586+0000 7fcf01000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff041d2490 0x55ff04237500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:57576/0 (socket says 172.21.15.17:57576) 2024-09-13T16:07:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.586+0000 7fcf01000640 1 -- 172.21.15.17:0/1183801626 learned_addr learned my addr 172.21.15.17:0/1183801626 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.586+0000 7fcf01a00640 1 -- 172.21.15.17:0/1183801626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d7e60 msgr2=0x55ff04237a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.586+0000 7fcf01a00640 1 --2- 172.21.15.17:0/1183801626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d7e60 0x55ff04237a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.586+0000 7fcf01a00640 1 -- 172.21.15.17:0/1183801626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff041d2490 msgr2=0x55ff04237500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.586+0000 7fcf01a00640 1 --2- 172.21.15.17:0/1183801626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff041d2490 0x55ff04237500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.586+0000 7fcf01a00640 1 -- 172.21.15.17:0/1183801626 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff0412b170 con 0x55ff041e18b0 2024-09-13T16:07:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.586+0000 7fcefbe00640 1 --2- 172.21.15.17:0/1183801626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d7e60 0x55ff04237a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:07:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.586+0000 7fcf01a00640 1 --2- 172.21.15.17:0/1183801626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041e18b0 0x55ff0423e330 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcef400c760 tx=0x7fcef4009590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7bcb796ae8ad86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.586+0000 7fcee2a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T16:07:41.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.587+0000 7fcee2a00640 1 -- 172.21.15.17:0/1183801626 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4099c20 con 0x55ff041e18b0 2024-09-13T16:07:41.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.587+0000 7fcee2a00640 1 -- 172.21.15.17:0/1183801626 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fcef40a2560 con 0x55ff041e18b0 2024-09-13T16:07:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.587+0000 7fcf06865740 1 -- 172.21.15.17:0/1183801626 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcee8040070 con 0x55ff041e18b0 2024-09-13T16:07:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.587+0000 7fcee2a00640 1 -- 172.21.15.17:0/1183801626 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcef40b8460 con 0x55ff041e18b0 2024-09-13T16:07:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.587+0000 7fcf06865740 10 client.15807 fetch_fsmap learned FSMap version 45 2024-09-13T16:07:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.587+0000 7fcf06865740 1 -- 172.21.15.17:0/1183801626 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x7fcef0011780 con 0x55ff041e18b0 2024-09-13T16:07:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.587+0000 7fcee2a00640 1 -- 172.21.15.17:0/1183801626 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcee8040070 con 0x55ff041e18b0 2024-09-13T16:07:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.587+0000 7fcee2a00640 1 -- 172.21.15.17:0/1183801626 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 45) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fcef4083380 con 0x55ff041e18b0 2024-09-13T16:07:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.588+0000 7fcf06865740 10 client.15807 fetch_fsmap finished waiting for FSMap version 45 2024-09-13T16:07:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.588+0000 7fcf06865740 10 client.15807 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:07:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.588+0000 7fcf06865740 20 client.15807 populate_metadata read hostname 'smithi017' 2024-09-13T16:07:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.588+0000 7fcf06865740 1 --2- 172.21.15.17:0/1183801626 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55ff042403e0 0x55ff04242800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.588+0000 7fcf06865740 4 client.15807 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:07:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.588+0000 7fcf06865740 1 -- 172.21.15.17:0/1183801626 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ff03e20300 con 0x55ff042403e0 2024-09-13T16:07:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.588+0000 7fcf01000640 1 --2- 172.21.15.17:0/1183801626 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55ff042403e0 0x55ff04242800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.591+0000 7fcee2a00640 10 client.15807 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:07:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.591+0000 7fcf01000640 1 --2- 172.21.15.17:0/1183801626 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55ff042403e0 0x55ff04242800 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a780d533585972bf server_cookie=845a071bd3ab73c0 in_seq=0 out_seq=0 2024-09-13T16:07:41.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.666+0000 7fcee2a00640 1 -- 172.21.15.17:0/1183801626 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ff03e20300 con 0x55ff042403e0 2024-09-13T16:07:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.666+0000 7fcee2a00640 10 client.15807 handle_command_reply: tid=0 2024-09-13T16:07:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.666+0000 7fcf06865740 1 client.15807 shutdown 2024-09-13T16:07:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.667+0000 7fcf06865740 1 -- 172.21.15.17:0/1183801626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041e18b0 msgr2=0x55ff0423e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.667+0000 7fcf06865740 1 --2- 172.21.15.17:0/1183801626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041e18b0 0x55ff0423e330 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcef400c760 tx=0x7fcef4009590 comp rx=0 tx=0).stop 2024-09-13T16:07:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.667+0000 7fcf06865740 1 -- 172.21.15.17:0/1183801626 shutdown_connections 2024-09-13T16:07:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.667+0000 7fcf06865740 1 --2- 172.21.15.17:0/1183801626 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55ff042403e0 0x55ff04242800 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.667+0000 7fcf06865740 1 --2- 172.21.15.17:0/1183801626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff041e18b0 0x55ff0423e330 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.667+0000 7fcf06865740 1 --2- 172.21.15.17:0/1183801626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041d7e60 0x55ff04237a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.667+0000 7fcf06865740 1 --2- 172.21.15.17:0/1183801626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff041d2490 0x55ff04237500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.667+0000 7fcf06865740 1 -- 172.21.15.17:0/1183801626 >> 172.21.15.17:0/1183801626 conn(0x55ff041cdb00 msgr2=0x55ff041d3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.667+0000 7fcee2a00640 0 client.15807 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:07:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.667+0000 7fcf06865740 1 -- 172.21.15.17:0/1183801626 shutdown_connections 2024-09-13T16:07:41.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.669+0000 7fcf06865740 1 -- 172.21.15.17:0/1183801626 wait complete. 2024-09-13T16:07:41.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.670+0000 7fcf06865740 20 client.15807 trim_cache size 0 max 16384 2024-09-13T16:07:41.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:07:41.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:07:41.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:07:41.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:07:41.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.673+0000 7fcf02400640 1 -- 172.21.15.17:0/2191815179 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcee40a1130 msgr2=0x7fcee40a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:41.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.673+0000 7fcf02400640 1 --2- 172.21.15.17:0/2191815179 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcee40a1130 0x7fcee40a35f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcefc1991d0 tx=0x7fcef000b410 comp rx=0 tx=0).stop 2024-09-13T16:07:41.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.673+0000 7fcf02400640 1 -- 172.21.15.17:0/2191815179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcefc103920 msgr2=0x7fcefc19f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:41.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.673+0000 7fcf02400640 1 --2- 172.21.15.17:0/2191815179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcefc103920 0x7fcefc19f270 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcef4009fd0 tx=0x7fcef400ef10 comp rx=0 tx=0).stop 2024-09-13T16:07:41.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.673+0000 7fcf02400640 1 -- 172.21.15.17:0/2191815179 shutdown_connections 2024-09-13T16:07:41.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.673+0000 7fcf02400640 1 --2- 172.21.15.17:0/2191815179 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fcee40a1130 0x7fcee40a35f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.673+0000 7fcf02400640 1 --2- 172.21.15.17:0/2191815179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcefc103920 0x7fcefc19f270 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.673+0000 7fcf02400640 1 --2- 172.21.15.17:0/2191815179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcefc102f60 0x7fcefc198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.673+0000 7fcf02400640 1 --2- 172.21.15.17:0/2191815179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcefc101d70 0x7fcefc197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:41.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.673+0000 7fcf02400640 1 -- 172.21.15.17:0/2191815179 >> 172.21.15.17:0/2191815179 conn(0x7fcefc0fd510 msgr2=0x7fcefc1062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:41.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.674+0000 7fcf02400640 1 -- 172.21.15.17:0/2191815179 shutdown_connections 2024-09-13T16:07:41.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:41.674+0000 7fcf02400640 1 -- 172.21.15.17:0/2191815179 wait complete. 2024-09-13T16:07:42.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:41 smithi193 ceph-mon[35248]: pgmap v683: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.1 MiB/s wr, 706 op/s 2024-09-13T16:07:42.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:41 smithi017 ceph-mon[30494]: pgmap v683: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.1 MiB/s wr, 706 op/s 2024-09-13T16:07:42.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:41 smithi189 ceph-mon[34790]: pgmap v683: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.1 MiB/s wr, 706 op/s 2024-09-13T16:07:44.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:43 smithi193 ceph-mon[35248]: pgmap v684: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.9 MiB/s wr, 678 op/s 2024-09-13T16:07:44.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:43 smithi017 ceph-mon[30494]: pgmap v684: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.9 MiB/s wr, 678 op/s 2024-09-13T16:07:44.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:43 smithi189 ceph-mon[34790]: pgmap v684: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.9 MiB/s wr, 678 op/s 2024-09-13T16:07:45.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 600.0 s, 501.2 tps, lat 199.187 ms stddev 241.297 2024-09-13T16:07:46.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:46 smithi193 ceph-mon[35248]: pgmap v685: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.3 MiB/s wr, 633 op/s 2024-09-13T16:07:46.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:45 smithi017 ceph-mon[30494]: pgmap v685: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.3 MiB/s wr, 633 op/s 2024-09-13T16:07:46.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:46 smithi189 ceph-mon[34790]: pgmap v685: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.3 MiB/s wr, 633 op/s 2024-09-13T16:07:48.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:48 smithi017 ceph-mon[30494]: pgmap v686: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.4 MiB/s wr, 665 op/s 2024-09-13T16:07:48.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:48 smithi189 ceph-mon[34790]: pgmap v686: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.4 MiB/s wr, 665 op/s 2024-09-13T16:07:48.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:48 smithi193 ceph-mon[35248]: pgmap v686: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.4 MiB/s wr, 665 op/s 2024-09-13T16:07:50.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 605.0 s, 525.0 tps, lat 188.312 ms stddev 220.271 2024-09-13T16:07:50.334 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:50 smithi017 ceph-mon[30494]: pgmap v687: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.3 MiB/s wr, 509 op/s 2024-09-13T16:07:50.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:50 smithi189 ceph-mon[34790]: pgmap v687: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.3 MiB/s wr, 509 op/s 2024-09-13T16:07:50.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:50 smithi193 ceph-mon[35248]: pgmap v687: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.3 MiB/s wr, 509 op/s 2024-09-13T16:07:51.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:51 smithi189 ceph-mon[34790]: pgmap v688: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.1 MiB/s wr, 614 op/s 2024-09-13T16:07:51.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:51 smithi193 ceph-mon[35248]: pgmap v688: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.1 MiB/s wr, 614 op/s 2024-09-13T16:07:51.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:51 smithi017 ceph-mon[30494]: pgmap v688: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.1 MiB/s wr, 614 op/s 2024-09-13T16:07:53.856 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:53 smithi189 ceph-mon[34790]: pgmap v689: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.7 MiB/s wr, 516 op/s 2024-09-13T16:07:54.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:53 smithi193 ceph-mon[35248]: pgmap v689: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.7 MiB/s wr, 516 op/s 2024-09-13T16:07:54.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:53 smithi017 ceph-mon[30494]: pgmap v689: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.7 MiB/s wr, 516 op/s 2024-09-13T16:07:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.881+0000 7f5041a00640 1 -- 172.21.15.17:0/2134969414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f503c1007b0 msgr2=0x7f503c102ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.881+0000 7f5041a00640 1 --2- 172.21.15.17:0/2134969414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f503c1007b0 0x7f503c102ba0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f502c009900 tx=0x7f502c02a3f0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.881+0000 7f5041a00640 1 -- 172.21.15.17:0/2134969414 shutdown_connections 2024-09-13T16:07:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.881+0000 7f5041a00640 1 --2- 172.21.15.17:0/2134969414 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f503c105a10 0x7f503c107e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.881+0000 7f5041a00640 1 --2- 172.21.15.17:0/2134969414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f503c1030e0 0x7f503c1054d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.881+0000 7f5041a00640 1 --2- 172.21.15.17:0/2134969414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f503c1007b0 0x7f503c102ba0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.881+0000 7f5041a00640 1 -- 172.21.15.17:0/2134969414 >> 172.21.15.17:0/2134969414 conn(0x7f503c0fa3b0 msgr2=0x7f503c0fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.881+0000 7f5041a00640 1 -- 172.21.15.17:0/2134969414 shutdown_connections 2024-09-13T16:07:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.882+0000 7f5041a00640 1 -- 172.21.15.17:0/2134969414 wait complete. 2024-09-13T16:07:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.883+0000 7f5041a00640 1 Processor -- start 2024-09-13T16:07:54.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.883+0000 7f5041a00640 1 -- start start 2024-09-13T16:07:54.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.884+0000 7f5041a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f503c1007b0 0x7f503c06edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:54.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.884+0000 7f5041a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f503c1030e0 0x7f503c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:54.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.884+0000 7f5041a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f503c105a10 0x7f503c1a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:54.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.884+0000 7f5041a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c072360 con 0x7f503c1007b0 2024-09-13T16:07:54.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.884+0000 7f5041a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c0724d0 con 0x7f503c105a10 2024-09-13T16:07:54.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.884+0000 7f5041a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c1a6480 con 0x7f503c1030e0 2024-09-13T16:07:54.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.885+0000 7f503aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f503c1007b0 0x7f503c06edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:54.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.885+0000 7f503aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f503c1007b0 0x7f503c06edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59986/0 (socket says 172.21.15.17:59986) 2024-09-13T16:07:54.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.885+0000 7f503aa00640 1 -- 172.21.15.17:0/3501155860 learned_addr learned my addr 172.21.15.17:0/3501155860 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:54.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.886+0000 7f503aa00640 1 -- 172.21.15.17:0/3501155860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f503c1030e0 msgr2=0x7f503c06f310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:07:54.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.886+0000 7f503aa00640 1 --2- 172.21.15.17:0/3501155860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f503c1030e0 0x7f503c06f310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.886+0000 7f503aa00640 1 -- 172.21.15.17:0/3501155860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f503c105a10 msgr2=0x7f503c1a5f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T16:07:54.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.886+0000 7f503aa00640 1 --2- 172.21.15.17:0/3501155860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f503c105a10 0x7f503c1a5f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.886+0000 7f503aa00640 1 -- 172.21.15.17:0/3501155860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502c009560 con 0x7f503c1007b0 2024-09-13T16:07:54.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.887+0000 7f503aa00640 1 --2- 172.21.15.17:0/3501155860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f503c1007b0 0x7f503c06edd0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f502c031500 tx=0x7f502c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:54.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.888+0000 7f5033400640 1 -- 172.21.15.17:0/3501155860 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c003e00 con 0x7f503c1007b0 2024-09-13T16:07:54.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.888+0000 7f5041a00640 1 -- 172.21.15.17:0/3501155860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f503c1a66b0 con 0x7f503c1007b0 2024-09-13T16:07:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.890+0000 7f5033400640 1 -- 172.21.15.17:0/3501155860 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f502c031c70 con 0x7f503c1007b0 2024-09-13T16:07:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.890+0000 7f5041a00640 1 -- 172.21.15.17:0/3501155860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503c1a6af0 con 0x7f503c1007b0 2024-09-13T16:07:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.891+0000 7f5033400640 1 -- 172.21.15.17:0/3501155860 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c003e00 con 0x7f503c1007b0 2024-09-13T16:07:54.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.896+0000 7f5044869740 1 Processor -- start 2024-09-13T16:07:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.896+0000 7f5044869740 1 -- start start 2024-09-13T16:07:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.896+0000 7f5044869740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc10503a70 0x55fc10503e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.896+0000 7f5044869740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc105043b0 0x55fc10508f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.896+0000 7f5044869740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc105094a0 0x55fc1050b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.896+0000 7f5044869740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc10411bb0 con 0x55fc105043b0 2024-09-13T16:07:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.896+0000 7f5044869740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc1046fa70 con 0x55fc105094a0 2024-09-13T16:07:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.897+0000 7f5044869740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc1046d200 con 0x55fc10503a70 2024-09-13T16:07:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.897+0000 7f503a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc105094a0 0x55fc1050b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.897+0000 7f503a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc105094a0 0x55fc1050b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:50560/0 (socket says 172.21.15.17:50560) 2024-09-13T16:07:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.897+0000 7f503b400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc10503a70 0x55fc10503e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:54.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.897+0000 7f503a000640 1 -- 172.21.15.17:0/3300552741 learned_addr learned my addr 172.21.15.17:0/3300552741 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:54.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.897+0000 7f5033400640 1 -- 172.21.15.17:0/3501155860 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f502c03bb40 con 0x7f503c1007b0 2024-09-13T16:07:54.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.897+0000 7f503a000640 1 -- 172.21.15.17:0/3300552741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc10503a70 msgr2=0x55fc10503e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:54.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.897+0000 7f503a000640 1 --2- 172.21.15.17:0/3300552741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc10503a70 0x55fc10503e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.897+0000 7f503a000640 1 -- 172.21.15.17:0/3300552741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc105043b0 msgr2=0x55fc10508f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:07:54.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.897+0000 7f503a000640 1 --2- 172.21.15.17:0/3300552741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc105043b0 0x55fc10508f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.897+0000 7f503a000640 1 -- 172.21.15.17:0/3300552741 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc1040a940 con 0x55fc105094a0 2024-09-13T16:07:54.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.898+0000 7f503a000640 1 --2- 172.21.15.17:0/3300552741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc105094a0 0x55fc1050b930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f502800ba20 tx=0x7f502800bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec40df347cfc2726 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:54.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.898+0000 7f5027e00640 1 -- 172.21.15.17:0/3300552741 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502800dc40 con 0x55fc105094a0 2024-09-13T16:07:54.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.898+0000 7f5027e00640 1 -- 172.21.15.17:0/3300552741 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f502800dda0 con 0x55fc105094a0 2024-09-13T16:07:54.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.899+0000 7f5027e00640 1 -- 172.21.15.17:0/3300552741 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5028010460 con 0x55fc105094a0 2024-09-13T16:07:54.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.899+0000 7f5044869740 1 -- 172.21.15.17:0/3300552741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc105094a0 msgr2=0x55fc1050b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:54.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.899+0000 7f5044869740 1 --2- 172.21.15.17:0/3300552741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc105094a0 0x55fc1050b930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f502800ba20 tx=0x7f502800bee0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.900+0000 7f5044869740 1 -- 172.21.15.17:0/3300552741 shutdown_connections 2024-09-13T16:07:54.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.900+0000 7f5044869740 1 --2- 172.21.15.17:0/3300552741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc105094a0 0x55fc1050b930 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.900+0000 7f5044869740 1 --2- 172.21.15.17:0/3300552741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc105043b0 0x55fc10508f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.900+0000 7f5044869740 1 --2- 172.21.15.17:0/3300552741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc10503a70 0x55fc10503e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.900+0000 7f5044869740 1 -- 172.21.15.17:0/3300552741 >> 172.21.15.17:0/3300552741 conn(0x55fc10501060 msgr2=0x55fc10501440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:54.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.900+0000 7f5044869740 1 -- 172.21.15.17:0/3300552741 shutdown_connections 2024-09-13T16:07:54.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.900+0000 7f5044869740 1 -- 172.21.15.17:0/3300552741 wait complete. 2024-09-13T16:07:54.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.901+0000 7f5033400640 1 --2- 172.21.15.17:0/3501155860 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f50200a1090 0x7f50200a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:54.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.902+0000 7f5033400640 1 -- 172.21.15.17:0/3501155860 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f502c0ed410 con 0x7f503c1007b0 2024-09-13T16:07:54.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.902+0000 7f503b400640 1 --2- 172.21.15.17:0/3501155860 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f50200a1090 0x7f50200a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:54.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.902+0000 7f5044869740 1 -- start start 2024-09-13T16:07:54.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.903+0000 7f5044869740 1 Processor -- start 2024-09-13T16:07:54.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.905+0000 7f503b400640 1 --2- 172.21.15.17:0/3501155860 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f50200a1090 0x7f50200a3550 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f503c068910 tx=0x7f5034009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:54.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.905+0000 7f5044869740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc10503a70 0x55fc105209c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:54.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.905+0000 7f5044869740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc105043b0 0x55fc10520f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:54.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.905+0000 7f5044869740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc105094a0 0x55fc10527c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:54.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.905+0000 7f5044869740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc10468af0 con 0x55fc10503a70 2024-09-13T16:07:54.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.905+0000 7f5044869740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc10426f20 con 0x55fc105094a0 2024-09-13T16:07:54.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.905+0000 7f5044869740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc10426bc0 con 0x55fc105043b0 2024-09-13T16:07:54.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.906+0000 7f5044869740 10 client.0 _ll_register_callbacks cb 0x55fc10458a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:07:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.906+0000 7f503a000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc105043b0 0x55fc10520f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.906+0000 7f503a000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc105043b0 0x55fc10520f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:42222/0 (socket says 172.21.15.17:42222) 2024-09-13T16:07:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.906+0000 7f503a000640 1 -- 172.21.15.17:0/2566929939 learned_addr learned my addr 172.21.15.17:0/2566929939 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.906+0000 7f503b400640 1 --2- 172.21.15.17:0/2566929939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc105094a0 0x55fc10527c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.906+0000 7f503a000640 1 -- 172.21.15.17:0/2566929939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc105094a0 msgr2=0x55fc10527c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.906+0000 7f503a000640 1 --2- 172.21.15.17:0/2566929939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc105094a0 0x55fc10527c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.906+0000 7f503a000640 1 -- 172.21.15.17:0/2566929939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc10503a70 msgr2=0x55fc105209c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.906+0000 7f503a000640 1 --2- 172.21.15.17:0/2566929939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc10503a70 0x55fc105209c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.906+0000 7f503a000640 1 -- 172.21.15.17:0/2566929939 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f502800b650 con 0x55fc105043b0 2024-09-13T16:07:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.907+0000 7f503b400640 1 --2- 172.21.15.17:0/2566929939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc105094a0 0x55fc10527c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:07:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.907+0000 7f503a000640 1 --2- 172.21.15.17:0/2566929939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc105043b0 0x55fc10520f00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f502800b9f0 tx=0x7f502800dc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b7ada058f159cfe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.907+0000 7f5024c00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:07:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.908+0000 7f5024c00640 1 -- 172.21.15.17:0/2566929939 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502801f070 con 0x55fc105043b0 2024-09-13T16:07:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.908+0000 7f5044869740 1 -- 172.21.15.17:0/2566929939 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc10492c90 con 0x55fc105043b0 2024-09-13T16:07:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.908+0000 7f5024c00640 1 -- 172.21.15.17:0/2566929939 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f5028004310 con 0x55fc105043b0 2024-09-13T16:07:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.908+0000 7f5024c00640 1 -- 172.21.15.17:0/2566929939 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50280044d0 con 0x55fc105043b0 2024-09-13T16:07:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.908+0000 7f5044869740 10 client.26125 fetch_fsmap learned FSMap version 45 2024-09-13T16:07:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.909+0000 7f5044869740 1 -- 172.21.15.17:0/2566929939 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55fc10467170 con 0x55fc105043b0 2024-09-13T16:07:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.909+0000 7f5024c00640 1 -- 172.21.15.17:0/2566929939 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fc10492c90 con 0x55fc105043b0 2024-09-13T16:07:54.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.909+0000 7f5024c00640 1 -- 172.21.15.17:0/2566929939 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 45) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f5028005010 con 0x55fc105043b0 2024-09-13T16:07:54.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.910+0000 7f5044869740 10 client.26125 fetch_fsmap finished waiting for FSMap version 45 2024-09-13T16:07:54.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.910+0000 7f5044869740 10 client.26125 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:07:54.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.910+0000 7f5044869740 20 client.26125 populate_metadata read hostname 'smithi017' 2024-09-13T16:07:54.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.910+0000 7f5044869740 1 --2- 172.21.15.17:0/2566929939 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55fc1052c310 0x55fc1052e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:54.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.910+0000 7f5044869740 4 client.26125 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:07:54.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.910+0000 7f5044869740 1 -- 172.21.15.17:0/2566929939 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fc1045b7d0 con 0x55fc1052c310 2024-09-13T16:07:54.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.914+0000 7f503aa00640 1 --2- 172.21.15.17:0/2566929939 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55fc1052c310 0x55fc1052e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:54.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.914+0000 7f503aa00640 1 --2- 172.21.15.17:0/2566929939 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55fc1052c310 0x55fc1052e730 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a5cead76b08e7f5 server_cookie=b1337ea912b5dace in_seq=0 out_seq=0 2024-09-13T16:07:54.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.914+0000 7f5024c00640 10 client.26125 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:07:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.916+0000 7f5024c00640 1 -- 172.21.15.17:0/2566929939 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fc1045b7d0 con 0x55fc1052c310 2024-09-13T16:07:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.916+0000 7f5024c00640 10 client.26125 handle_command_reply: tid=0 2024-09-13T16:07:54.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.916+0000 7f5044869740 1 client.26125 shutdown 2024-09-13T16:07:54.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.917+0000 7f5044869740 1 -- 172.21.15.17:0/2566929939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc105043b0 msgr2=0x55fc10520f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:54.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.917+0000 7f5044869740 1 --2- 172.21.15.17:0/2566929939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc105043b0 0x55fc10520f00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f502800b9f0 tx=0x7f502800dc70 comp rx=0 tx=0).stop 2024-09-13T16:07:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.917+0000 7f5044869740 1 -- 172.21.15.17:0/2566929939 shutdown_connections 2024-09-13T16:07:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.917+0000 7f5044869740 1 --2- 172.21.15.17:0/2566929939 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55fc1052c310 0x55fc1052e730 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.917+0000 7f5024c00640 0 client.26125 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:07:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.917+0000 7f5044869740 1 --2- 172.21.15.17:0/2566929939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc105094a0 0x55fc10527c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.917+0000 7f5044869740 1 --2- 172.21.15.17:0/2566929939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc105043b0 0x55fc10520f00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.917+0000 7f5044869740 1 --2- 172.21.15.17:0/2566929939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc10503a70 0x55fc105209c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.917+0000 7f5044869740 1 -- 172.21.15.17:0/2566929939 >> 172.21.15.17:0/2566929939 conn(0x55fc10501060 msgr2=0x55fc10502870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.917+0000 7f5044869740 1 -- 172.21.15.17:0/2566929939 shutdown_connections 2024-09-13T16:07:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.917+0000 7f5044869740 1 -- 172.21.15.17:0/2566929939 wait complete. 2024-09-13T16:07:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.918+0000 7f5044869740 20 client.26125 trim_cache size 0 max 16384 2024-09-13T16:07:54.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.951+0000 7f5044869740 1 Processor -- start 2024-09-13T16:07:54.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.951+0000 7f5044869740 1 -- start start 2024-09-13T16:07:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.952+0000 7f5044869740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc10503a70 0x55fc10503e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.952+0000 7f5044869740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc105043b0 0x55fc10527be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.952+0000 7f5044869740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc105094a0 0x55fc10501440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.952+0000 7f5044869740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc101cfe60 con 0x55fc105043b0 2024-09-13T16:07:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.952+0000 7f5044869740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc1045b7d0 con 0x55fc10503a70 2024-09-13T16:07:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.952+0000 7f5044869740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc10492c90 con 0x55fc105094a0 2024-09-13T16:07:54.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.953+0000 7f503b400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc105094a0 0x55fc10501440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:54.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.953+0000 7f503b400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc105094a0 0x55fc10501440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:42238/0 (socket says 172.21.15.17:42238) 2024-09-13T16:07:54.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.953+0000 7f503b400640 1 -- 172.21.15.17:0/212517881 learned_addr learned my addr 172.21.15.17:0/212517881 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:54.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.953+0000 7f503aa00640 1 --2- 172.21.15.17:0/212517881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc10503a70 0x55fc10503e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:54.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.953+0000 7f503b400640 1 -- 172.21.15.17:0/212517881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc10503a70 msgr2=0x55fc10503e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:54.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.953+0000 7f503b400640 1 --2- 172.21.15.17:0/212517881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc10503a70 0x55fc10503e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.953+0000 7f503b400640 1 -- 172.21.15.17:0/212517881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc105043b0 msgr2=0x55fc10527be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:54.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.953+0000 7f503b400640 1 --2- 172.21.15.17:0/212517881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc105043b0 0x55fc10527be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.953+0000 7f503b400640 1 -- 172.21.15.17:0/212517881 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc10409180 con 0x55fc105094a0 2024-09-13T16:07:54.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.954+0000 7f503b400640 1 --2- 172.21.15.17:0/212517881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc105094a0 0x55fc10501440 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5034009810 tx=0x7f5034014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31602849fa6a3956 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:54.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.954+0000 7f5030c00640 1 -- 172.21.15.17:0/212517881 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503401f9b0 con 0x55fc105094a0 2024-09-13T16:07:54.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.954+0000 7f5030c00640 1 -- 172.21.15.17:0/212517881 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5034003970 con 0x55fc105094a0 2024-09-13T16:07:54.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.954+0000 7f5030c00640 1 -- 172.21.15.17:0/212517881 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034004460 con 0x55fc105094a0 2024-09-13T16:07:54.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.956+0000 7f5044869740 1 -- 172.21.15.17:0/212517881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc105094a0 msgr2=0x55fc10501440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:54.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.956+0000 7f5044869740 1 --2- 172.21.15.17:0/212517881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc105094a0 0x55fc10501440 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5034009810 tx=0x7f5034014000 comp rx=0 tx=0).stop 2024-09-13T16:07:54.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.956+0000 7f5044869740 1 -- 172.21.15.17:0/212517881 shutdown_connections 2024-09-13T16:07:54.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.956+0000 7f5044869740 1 --2- 172.21.15.17:0/212517881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc105094a0 0x55fc10501440 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.956+0000 7f5044869740 1 --2- 172.21.15.17:0/212517881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc105043b0 0x55fc10527be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.956+0000 7f5044869740 1 --2- 172.21.15.17:0/212517881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc10503a70 0x55fc10503e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.956+0000 7f5044869740 1 -- 172.21.15.17:0/212517881 >> 172.21.15.17:0/212517881 conn(0x55fc10501060 msgr2=0x55fc1050ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:54.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.956+0000 7f5044869740 1 -- 172.21.15.17:0/212517881 shutdown_connections 2024-09-13T16:07:54.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.956+0000 7f5044869740 1 -- 172.21.15.17:0/212517881 wait complete. 2024-09-13T16:07:54.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.957+0000 7f5044869740 1 -- start start 2024-09-13T16:07:54.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.957+0000 7f5044869740 1 Processor -- start 2024-09-13T16:07:54.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.958+0000 7f5044869740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc10503a70 0x55fc105274a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:54.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.960+0000 7f5044869740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc105043b0 0x55fc105279e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:54.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.960+0000 7f5044869740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc105094a0 0x55fc10523f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:54.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.960+0000 7f5044869740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc10524580 con 0x55fc10503a70 2024-09-13T16:07:54.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.960+0000 7f5044869740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc105246f0 con 0x55fc105094a0 2024-09-13T16:07:54.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.960+0000 7f5044869740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc105248b0 con 0x55fc105043b0 2024-09-13T16:07:54.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.960+0000 7f5044869740 10 client.0 _ll_register_callbacks cb 0x7f5028005f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:07:54.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.961+0000 7f503a000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc105043b0 0x55fc105279e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:54.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.961+0000 7f503a000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc105043b0 0x55fc105279e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:42240/0 (socket says 172.21.15.17:42240) 2024-09-13T16:07:54.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.961+0000 7f503a000640 1 -- 172.21.15.17:0/787560045 learned_addr learned my addr 172.21.15.17:0/787560045 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:07:54.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.961+0000 7f503b400640 1 --2- 172.21.15.17:0/787560045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc105094a0 0x55fc10523f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:54.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.961+0000 7f503a000640 1 -- 172.21.15.17:0/787560045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc105094a0 msgr2=0x55fc10523f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:54.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.961+0000 7f503a000640 1 --2- 172.21.15.17:0/787560045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc105094a0 0x55fc10523f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.961+0000 7f503a000640 1 -- 172.21.15.17:0/787560045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc10503a70 msgr2=0x55fc105274a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:07:54.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.962+0000 7f503a000640 1 --2- 172.21.15.17:0/787560045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc10503a70 0x55fc105274a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:54.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.962+0000 7f503a000640 1 -- 172.21.15.17:0/787560045 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5034017070 con 0x55fc105043b0 2024-09-13T16:07:54.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.962+0000 7f503a000640 1 --2- 172.21.15.17:0/787560045 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc105043b0 0x55fc105279e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f502800ba20 tx=0x7f5028004540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acdea2bce5a48025 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:07:54.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.962+0000 7f5024c00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:07:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.962+0000 7f5024c00640 1 -- 172.21.15.17:0/787560045 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502801f070 con 0x55fc105043b0 2024-09-13T16:07:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.962+0000 7f5024c00640 1 -- 172.21.15.17:0/787560045 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f5028000e40 con 0x55fc105043b0 2024-09-13T16:07:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.964+0000 7f5044869740 1 -- 172.21.15.17:0/787560045 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f502800dda0 con 0x55fc105043b0 2024-09-13T16:07:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.964+0000 7f5024c00640 1 -- 172.21.15.17:0/787560045 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f502800b870 con 0x55fc105043b0 2024-09-13T16:07:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.964+0000 7f5044869740 10 client.26131 fetch_fsmap learned FSMap version 45 2024-09-13T16:07:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.964+0000 7f5044869740 1 -- 172.21.15.17:0/787560045 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55fc1042e560 con 0x55fc105043b0 2024-09-13T16:07:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.964+0000 7f5024c00640 1 -- 172.21.15.17:0/787560045 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f502800dda0 con 0x55fc105043b0 2024-09-13T16:07:54.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.964+0000 7f5024c00640 1 -- 172.21.15.17:0/787560045 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 45) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f502802b040 con 0x55fc105043b0 2024-09-13T16:07:54.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.965+0000 7f5044869740 10 client.26131 fetch_fsmap finished waiting for FSMap version 45 2024-09-13T16:07:54.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.965+0000 7f5044869740 10 client.26131 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:07:54.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.965+0000 7f5044869740 20 client.26131 populate_metadata read hostname 'smithi017' 2024-09-13T16:07:54.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.965+0000 7f5044869740 1 --2- 172.21.15.17:0/787560045 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55fc105839f0 0x55fc10585e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:07:54.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.966+0000 7f5044869740 4 client.26131 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:07:54.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.966+0000 7f5044869740 1 -- 172.21.15.17:0/787560045 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fc1015c300 con 0x55fc105839f0 2024-09-13T16:07:54.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.966+0000 7f503aa00640 1 --2- 172.21.15.17:0/787560045 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55fc105839f0 0x55fc10585e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:07:54.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.969+0000 7f5024c00640 10 client.26131 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:07:54.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:54.969+0000 7f503aa00640 1 --2- 172.21.15.17:0/787560045 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55fc105839f0 0x55fc10585e10 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b46e499a978e1c6d server_cookie=15282901aa9b0a2 in_seq=0 out_seq=0 2024-09-13T16:07:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.026+0000 7f5024c00640 1 -- 172.21.15.17:0/787560045 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fc1015c300 con 0x55fc105839f0 2024-09-13T16:07:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.026+0000 7f5024c00640 10 client.26131 handle_command_reply: tid=0 2024-09-13T16:07:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.026+0000 7f5044869740 1 client.26131 shutdown 2024-09-13T16:07:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.028+0000 7f5044869740 1 -- 172.21.15.17:0/787560045 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc105043b0 msgr2=0x55fc105279e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.028+0000 7f5044869740 1 --2- 172.21.15.17:0/787560045 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc105043b0 0x55fc105279e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f502800ba20 tx=0x7f5028004540 comp rx=0 tx=0).stop 2024-09-13T16:07:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.028+0000 7f5044869740 1 -- 172.21.15.17:0/787560045 shutdown_connections 2024-09-13T16:07:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.028+0000 7f5044869740 1 --2- 172.21.15.17:0/787560045 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55fc105839f0 0x55fc10585e10 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.028+0000 7f5044869740 1 --2- 172.21.15.17:0/787560045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc105094a0 0x55fc10523f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.028+0000 7f5044869740 1 --2- 172.21.15.17:0/787560045 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fc105043b0 0x55fc105279e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.028+0000 7f5044869740 1 --2- 172.21.15.17:0/787560045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc10503a70 0x55fc105274a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.028+0000 7f5044869740 1 -- 172.21.15.17:0/787560045 >> 172.21.15.17:0/787560045 conn(0x55fc10501060 msgr2=0x55fc10501440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.028+0000 7f5024c00640 0 client.26131 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:07:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.029+0000 7f5044869740 1 -- 172.21.15.17:0/787560045 shutdown_connections 2024-09-13T16:07:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.029+0000 7f5044869740 1 -- 172.21.15.17:0/787560045 wait complete. 2024-09-13T16:07:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.029+0000 7f5044869740 20 client.26131 trim_cache size 0 max 16384 2024-09-13T16:07:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:07:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:07:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:07:55.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:07:55.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.030+0000 7f5041a00640 1 -- 172.21.15.17:0/3501155860 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f50200a1090 msgr2=0x7f50200a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:55.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.030+0000 7f5041a00640 1 --2- 172.21.15.17:0/3501155860 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f50200a1090 0x7f50200a3550 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f503c068910 tx=0x7f5034009500 comp rx=0 tx=0).stop 2024-09-13T16:07:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.031+0000 7f5041a00640 1 -- 172.21.15.17:0/3501155860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f503c1007b0 msgr2=0x7f503c06edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:07:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.031+0000 7f5041a00640 1 --2- 172.21.15.17:0/3501155860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f503c1007b0 0x7f503c06edd0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f502c031500 tx=0x7f502c003c10 comp rx=0 tx=0).stop 2024-09-13T16:07:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.031+0000 7f5041a00640 1 -- 172.21.15.17:0/3501155860 shutdown_connections 2024-09-13T16:07:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.031+0000 7f5041a00640 1 --2- 172.21.15.17:0/3501155860 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f50200a1090 0x7f50200a3550 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.031+0000 7f5041a00640 1 --2- 172.21.15.17:0/3501155860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f503c105a10 0x7f503c1a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.031+0000 7f5041a00640 1 --2- 172.21.15.17:0/3501155860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f503c1030e0 0x7f503c06f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.031+0000 7f5041a00640 1 --2- 172.21.15.17:0/3501155860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f503c1007b0 0x7f503c06edd0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:07:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.031+0000 7f5041a00640 1 -- 172.21.15.17:0/3501155860 >> 172.21.15.17:0/3501155860 conn(0x7f503c0fa3b0 msgr2=0x7f503c101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:07:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.032+0000 7f5041a00640 1 -- 172.21.15.17:0/3501155860 shutdown_connections 2024-09-13T16:07:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:07:55.032+0000 7f5041a00640 1 -- 172.21.15.17:0/3501155860 wait complete. 2024-09-13T16:07:55.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 610.0 s, 545.0 tps, lat 181.454 ms stddev 221.869 2024-09-13T16:07:56.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:55 smithi193 ceph-mon[35248]: pgmap v690: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 7.1 MiB/s wr, 506 op/s 2024-09-13T16:07:56.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:55 smithi017 ceph-mon[30494]: pgmap v690: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 7.1 MiB/s wr, 506 op/s 2024-09-13T16:07:56.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:55 smithi189 ceph-mon[34790]: pgmap v690: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 7.1 MiB/s wr, 506 op/s 2024-09-13T16:07:58.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:57 smithi193 ceph-mon[35248]: pgmap v691: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 586 op/s 2024-09-13T16:07:58.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:57 smithi017 ceph-mon[30494]: pgmap v691: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 586 op/s 2024-09-13T16:07:58.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:57 smithi189 ceph-mon[34790]: pgmap v691: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 586 op/s 2024-09-13T16:08:00.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:07:59 smithi193 ceph-mon[35248]: pgmap v692: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.1 MiB/s wr, 511 op/s 2024-09-13T16:08:00.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:07:59 smithi017 ceph-mon[30494]: pgmap v692: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.1 MiB/s wr, 511 op/s 2024-09-13T16:08:00.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:07:59 smithi189 ceph-mon[34790]: pgmap v692: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.1 MiB/s wr, 511 op/s 2024-09-13T16:08:00.317 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 615.0 s, 544.6 tps, lat 187.696 ms stddev 208.149 2024-09-13T16:08:01.908 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:01 smithi189 ceph-mon[34790]: pgmap v693: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 MiB/s wr, 610 op/s 2024-09-13T16:08:02.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:01 smithi193 ceph-mon[35248]: pgmap v693: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 MiB/s wr, 610 op/s 2024-09-13T16:08:02.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:01 smithi017 ceph-mon[30494]: pgmap v693: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 MiB/s wr, 610 op/s 2024-09-13T16:08:04.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:03 smithi193 ceph-mon[35248]: pgmap v694: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 MiB/s wr, 465 op/s 2024-09-13T16:08:04.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:03 smithi017 ceph-mon[30494]: pgmap v694: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 MiB/s wr, 465 op/s 2024-09-13T16:08:04.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:03 smithi189 ceph-mon[34790]: pgmap v694: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 MiB/s wr, 465 op/s 2024-09-13T16:08:05.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 620.0 s, 638.4 tps, lat 158.282 ms stddev 187.676 2024-09-13T16:08:06.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:05 smithi193 ceph-mon[35248]: pgmap v695: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 MiB/s wr, 499 op/s 2024-09-13T16:08:06.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:05 smithi017 ceph-mon[30494]: pgmap v695: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 MiB/s wr, 499 op/s 2024-09-13T16:08:06.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:05 smithi189 ceph-mon[34790]: pgmap v695: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 MiB/s wr, 499 op/s 2024-09-13T16:08:08.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:07 smithi193 ceph-mon[35248]: pgmap v696: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 MiB/s wr, 558 op/s 2024-09-13T16:08:08.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:07 smithi017 ceph-mon[30494]: pgmap v696: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 MiB/s wr, 558 op/s 2024-09-13T16:08:08.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:07 smithi189 ceph-mon[34790]: pgmap v696: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 MiB/s wr, 558 op/s 2024-09-13T16:08:08.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.214+0000 7f298ee00640 1 -- 172.21.15.17:0/2747225407 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2988105920 msgr2=0x7f2988107db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:08.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.214+0000 7f298ee00640 1 --2- 172.21.15.17:0/2747225407 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2988105920 0x7f2988107db0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2980009be0 tx=0x7f298002a6e0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.214+0000 7f298ee00640 1 -- 172.21.15.17:0/2747225407 shutdown_connections 2024-09-13T16:08:08.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.214+0000 7f298ee00640 1 --2- 172.21.15.17:0/2747225407 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2988105920 0x7f2988107db0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.214+0000 7f298ee00640 1 --2- 172.21.15.17:0/2747225407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2988102f10 0x7f2988105300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.214+0000 7f298ee00640 1 --2- 172.21.15.17:0/2747225407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29881005e0 0x7f29881029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.214+0000 7f298ee00640 1 -- 172.21.15.17:0/2747225407 >> 172.21.15.17:0/2747225407 conn(0x7f29880fa1c0 msgr2=0x7f29880fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:08.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.214+0000 7f298ee00640 1 -- 172.21.15.17:0/2747225407 shutdown_connections 2024-09-13T16:08:08.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.214+0000 7f298ee00640 1 -- 172.21.15.17:0/2747225407 wait complete. 2024-09-13T16:08:08.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.216+0000 7f298ee00640 1 Processor -- start 2024-09-13T16:08:08.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.218+0000 7f298ee00640 1 -- start start 2024-09-13T16:08:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.218+0000 7f298ee00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29881005e0 0x7f2988197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.218+0000 7f298ee00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2988102f10 0x7f2988198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.218+0000 7f298ee00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2988105920 0x7f298819f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.218+0000 7f298ee00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298819f910 con 0x7f2988102f10 2024-09-13T16:08:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.218+0000 7f298ee00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298819fa80 con 0x7f29881005e0 2024-09-13T16:08:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.218+0000 7f298ee00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298819fc40 con 0x7f2988105920 2024-09-13T16:08:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.219+0000 7f298d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2988102f10 0x7f2988198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.219+0000 7f298e400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2988105920 0x7f298819f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.219+0000 7f298e400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2988105920 0x7f298819f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:45150/0 (socket says 172.21.15.17:45150) 2024-09-13T16:08:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.219+0000 7f298e400640 1 -- 172.21.15.17:0/997584457 learned_addr learned my addr 172.21.15.17:0/997584457 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:08:08.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.219+0000 7f298d000640 1 -- 172.21.15.17:0/997584457 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2988105920 msgr2=0x7f298819f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:08.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.219+0000 7f298d000640 1 --2- 172.21.15.17:0/997584457 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2988105920 0x7f298819f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.219+0000 7f298d000640 1 -- 172.21.15.17:0/997584457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29881005e0 msgr2=0x7f2988197e20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T16:08:08.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.220+0000 7f298d000640 1 --2- 172.21.15.17:0/997584457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29881005e0 0x7f2988197e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.220+0000 7f298d000640 1 -- 172.21.15.17:0/997584457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2980009840 con 0x7f2988102f10 2024-09-13T16:08:08.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.220+0000 7f298d000640 1 --2- 172.21.15.17:0/997584457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2988102f10 0x7f2988198360 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f297c00b3c0 tx=0x7f297c00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:08.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.222+0000 7f2986000640 1 -- 172.21.15.17:0/997584457 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c011830 con 0x7f2988102f10 2024-09-13T16:08:08.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.222+0000 7f2986000640 1 -- 172.21.15.17:0/997584457 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f297c011e50 con 0x7f2988102f10 2024-09-13T16:08:08.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.222+0000 7f2986000640 1 -- 172.21.15.17:0/997584457 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c00f2e0 con 0x7f2988102f10 2024-09-13T16:08:08.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.222+0000 7f298ee00640 1 -- 172.21.15.17:0/997584457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2988190fb0 con 0x7f2988102f10 2024-09-13T16:08:08.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.222+0000 7f298ee00640 1 -- 172.21.15.17:0/997584457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29881914c0 con 0x7f2988102f10 2024-09-13T16:08:08.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.228+0000 7f2986000640 1 -- 172.21.15.17:0/997584457 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f297c01b460 con 0x7f2988102f10 2024-09-13T16:08:08.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.231+0000 7f2986000640 1 --2- 172.21.15.17:0/997584457 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f29700a12a0 0x7f29700a3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:08.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.232+0000 7f2993217740 1 Processor -- start 2024-09-13T16:08:08.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.232+0000 7f2993217740 1 -- start start 2024-09-13T16:08:08.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.232+0000 7f2986000640 1 -- 172.21.15.17:0/997584457 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f297c09aa20 con 0x7f2988102f10 2024-09-13T16:08:08.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.233+0000 7f298da00640 1 --2- 172.21.15.17:0/997584457 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f29700a12a0 0x7f29700a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:08.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.234+0000 7f2993217740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39beec80 0x562a39bef080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:08.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.234+0000 7f2993217740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39bef5c0 0x562a39bf4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:08.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.234+0000 7f2993217740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562a39bf4650 0x562a39bf6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:08.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.234+0000 7f2993217740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a39afabb0 con 0x562a39beec80 2024-09-13T16:08:08.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.234+0000 7f2993217740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a39b58a70 con 0x562a39bef5c0 2024-09-13T16:08:08.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.234+0000 7f2993217740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a39b56200 con 0x562a39bf4650 2024-09-13T16:08:08.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.234+0000 7f298d000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39bef5c0 0x562a39bf4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:08.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.234+0000 7f298e400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562a39bf4650 0x562a39bf6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:08.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.234+0000 7f298d000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39bef5c0 0x562a39bf4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:57088/0 (socket says 172.21.15.17:57088) 2024-09-13T16:08:08.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.234+0000 7f298d000640 1 -- 172.21.15.17:0/1593196262 learned_addr learned my addr 172.21.15.17:0/1593196262 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:08:08.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.235+0000 7f298da00640 1 --2- 172.21.15.17:0/1593196262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39beec80 0x562a39bef080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:08.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.235+0000 7f298d000640 1 -- 172.21.15.17:0/1593196262 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562a39bf4650 msgr2=0x562a39bf6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:08.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.235+0000 7f298d000640 1 --2- 172.21.15.17:0/1593196262 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562a39bf4650 0x562a39bf6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.235+0000 7f298d000640 1 -- 172.21.15.17:0/1593196262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39beec80 msgr2=0x562a39bef080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.235+0000 7f298d000640 1 --2- 172.21.15.17:0/1593196262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39beec80 0x562a39bef080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.235+0000 7f298d000640 1 -- 172.21.15.17:0/1593196262 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a39af3940 con 0x562a39bef5c0 2024-09-13T16:08:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.235+0000 7f298da00640 1 --2- 172.21.15.17:0/1593196262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39beec80 0x562a39bef080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:08:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.235+0000 7f298d000640 1 --2- 172.21.15.17:0/1593196262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39bef5c0 0x562a39bf4080 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f297c00bd80 tx=0x7f297c09a220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a08355fc1af980ae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.235+0000 7f2976a00640 1 -- 172.21.15.17:0/1593196262 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c0a27a0 con 0x562a39bef5c0 2024-09-13T16:08:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.236+0000 7f2976a00640 1 -- 172.21.15.17:0/1593196262 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f297c0986c0 con 0x562a39bef5c0 2024-09-13T16:08:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.236+0000 7f2976a00640 1 -- 172.21.15.17:0/1593196262 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c0a2310 con 0x562a39bef5c0 2024-09-13T16:08:08.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.236+0000 7f2993217740 1 -- 172.21.15.17:0/1593196262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39bef5c0 msgr2=0x562a39bf4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:08.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.237+0000 7f2993217740 1 --2- 172.21.15.17:0/1593196262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39bef5c0 0x562a39bf4080 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f297c00bd80 tx=0x7f297c09a220 comp rx=0 tx=0).stop 2024-09-13T16:08:08.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.237+0000 7f2993217740 1 -- 172.21.15.17:0/1593196262 shutdown_connections 2024-09-13T16:08:08.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.237+0000 7f2993217740 1 --2- 172.21.15.17:0/1593196262 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562a39bf4650 0x562a39bf6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.237+0000 7f2993217740 1 --2- 172.21.15.17:0/1593196262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39bef5c0 0x562a39bf4080 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.237+0000 7f2993217740 1 --2- 172.21.15.17:0/1593196262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39beec80 0x562a39bef080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.237+0000 7f2993217740 1 -- 172.21.15.17:0/1593196262 >> 172.21.15.17:0/1593196262 conn(0x562a39bea2f0 msgr2=0x562a39bea6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:08.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.237+0000 7f298da00640 1 --2- 172.21.15.17:0/997584457 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f29700a12a0 0x7f29700a3760 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2978005fd0 tx=0x7f2978009650 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:08.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.237+0000 7f2993217740 1 -- 172.21.15.17:0/1593196262 shutdown_connections 2024-09-13T16:08:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.237+0000 7f2993217740 1 -- 172.21.15.17:0/1593196262 wait complete. 2024-09-13T16:08:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.238+0000 7f2993217740 1 -- start start 2024-09-13T16:08:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.238+0000 7f2993217740 1 Processor -- start 2024-09-13T16:08:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.239+0000 7f2993217740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39beec80 0x562a39c098d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.239+0000 7f2993217740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39bef5c0 0x562a39c09e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.239+0000 7f2993217740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562a39bf4650 0x562a39c10e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.239+0000 7f2993217740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a39b51af0 con 0x562a39beec80 2024-09-13T16:08:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.239+0000 7f2993217740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a39b0ff20 con 0x562a39bef5c0 2024-09-13T16:08:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.239+0000 7f2993217740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a39b0fbc0 con 0x562a39bf4650 2024-09-13T16:08:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.239+0000 7f298d000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39bef5c0 0x562a39c09e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.239+0000 7f298d000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39bef5c0 0x562a39c09e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:57096/0 (socket says 172.21.15.17:57096) 2024-09-13T16:08:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.239+0000 7f298d000640 1 -- 172.21.15.17:0/670829548 learned_addr learned my addr 172.21.15.17:0/670829548 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:08:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.239+0000 7f2993217740 10 client.0 _ll_register_callbacks cb 0x562a39b41a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:08:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.240+0000 7f298da00640 1 --2- 172.21.15.17:0/670829548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39beec80 0x562a39c098d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.240+0000 7f298d000640 1 -- 172.21.15.17:0/670829548 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562a39bf4650 msgr2=0x562a39c10e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.240+0000 7f298d000640 1 --2- 172.21.15.17:0/670829548 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562a39bf4650 0x562a39c10e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.240+0000 7f298d000640 1 -- 172.21.15.17:0/670829548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39beec80 msgr2=0x562a39c098d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.240+0000 7f298d000640 1 --2- 172.21.15.17:0/670829548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39beec80 0x562a39c098d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.240+0000 7f298d000640 1 -- 172.21.15.17:0/670829548 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29881914c0 con 0x562a39bef5c0 2024-09-13T16:08:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.240+0000 7f298da00640 1 --2- 172.21.15.17:0/670829548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39beec80 0x562a39c098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:08:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.240+0000 7f298d000640 1 --2- 172.21.15.17:0/670829548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39bef5c0 0x562a39c09e10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f297c010880 tx=0x7f297c09a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4fc834be8315357 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.240+0000 7f296b400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:08:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.240+0000 7f296b400640 1 -- 172.21.15.17:0/670829548 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c096a30 con 0x562a39bef5c0 2024-09-13T16:08:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.240+0000 7f296b400640 1 -- 172.21.15.17:0/670829548 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f297c096b90 con 0x562a39bef5c0 2024-09-13T16:08:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.240+0000 7f2993217740 1 -- 172.21.15.17:0/670829548 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a39b7bc90 con 0x562a39bef5c0 2024-09-13T16:08:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.241+0000 7f296b400640 1 -- 172.21.15.17:0/670829548 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f297c0a2310 con 0x562a39bef5c0 2024-09-13T16:08:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.241+0000 7f2993217740 10 client.26120 fetch_fsmap learned FSMap version 45 2024-09-13T16:08:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.241+0000 7f2993217740 1 -- 172.21.15.17:0/670829548 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x562a39b50170 con 0x562a39bef5c0 2024-09-13T16:08:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.242+0000 7f296b400640 1 -- 172.21.15.17:0/670829548 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f297c0b6020 con 0x562a39bef5c0 2024-09-13T16:08:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.242+0000 7f296b400640 1 -- 172.21.15.17:0/670829548 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 45) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f297c099280 con 0x562a39bef5c0 2024-09-13T16:08:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.242+0000 7f2993217740 10 client.26120 fetch_fsmap finished waiting for FSMap version 45 2024-09-13T16:08:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.242+0000 7f2993217740 10 client.26120 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:08:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.242+0000 7f2993217740 20 client.26120 populate_metadata read hostname 'smithi017' 2024-09-13T16:08:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.242+0000 7f2993217740 1 --2- 172.21.15.17:0/670829548 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x562a39c151d0 0x562a39c175f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.242+0000 7f2993217740 4 client.26120 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:08:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.242+0000 7f2993217740 1 -- 172.21.15.17:0/670829548 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a39b447d0 con 0x562a39c151d0 2024-09-13T16:08:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.242+0000 7f298da00640 1 --2- 172.21.15.17:0/670829548 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x562a39c151d0 0x562a39c175f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.243+0000 7f298da00640 1 --2- 172.21.15.17:0/670829548 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x562a39c151d0 0x562a39c175f0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3141707ab9ad742 server_cookie=94f50a23f307bebe in_seq=0 out_seq=0 2024-09-13T16:08:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.243+0000 7f296b400640 10 client.26120 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:08:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.244+0000 7f296b400640 1 -- 172.21.15.17:0/670829548 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562a39b447d0 con 0x562a39c151d0 2024-09-13T16:08:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.244+0000 7f296b400640 10 client.26120 handle_command_reply: tid=0 2024-09-13T16:08:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.244+0000 7f2993217740 1 client.26120 shutdown 2024-09-13T16:08:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.245+0000 7f2993217740 1 -- 172.21.15.17:0/670829548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39bef5c0 msgr2=0x562a39c09e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.245+0000 7f2993217740 1 --2- 172.21.15.17:0/670829548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39bef5c0 0x562a39c09e10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f297c010880 tx=0x7f297c09a180 comp rx=0 tx=0).stop 2024-09-13T16:08:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.245+0000 7f2993217740 1 -- 172.21.15.17:0/670829548 shutdown_connections 2024-09-13T16:08:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.245+0000 7f2993217740 1 --2- 172.21.15.17:0/670829548 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x562a39c151d0 0x562a39c175f0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.245+0000 7f2993217740 1 --2- 172.21.15.17:0/670829548 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562a39bf4650 0x562a39c10e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.245+0000 7f2993217740 1 --2- 172.21.15.17:0/670829548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39bef5c0 0x562a39c09e10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.245+0000 7f296b400640 0 client.26120 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:08:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.245+0000 7f2993217740 1 --2- 172.21.15.17:0/670829548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39beec80 0x562a39c098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.245+0000 7f2993217740 1 -- 172.21.15.17:0/670829548 >> 172.21.15.17:0/670829548 conn(0x562a39bea2f0 msgr2=0x562a39bebb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.245+0000 7f2993217740 1 -- 172.21.15.17:0/670829548 shutdown_connections 2024-09-13T16:08:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.245+0000 7f2993217740 1 -- 172.21.15.17:0/670829548 wait complete. 2024-09-13T16:08:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.246+0000 7f2993217740 20 client.26120 trim_cache size 0 max 16384 2024-09-13T16:08:08.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.277+0000 7f2993217740 1 Processor -- start 2024-09-13T16:08:08.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.277+0000 7f2993217740 1 -- start start 2024-09-13T16:08:08.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.278+0000 7f2993217740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39beec80 0x562a39c098b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:08.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.278+0000 7f2993217740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562a39bef5c0 0x562a39c10e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:08.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.278+0000 7f2993217740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39bf4650 0x562a39c09df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:08.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.278+0000 7f2993217740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a398b8e60 con 0x562a39bf4650 2024-09-13T16:08:08.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.278+0000 7f2993217740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a39bf7220 con 0x562a39beec80 2024-09-13T16:08:08.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.278+0000 7f2993217740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a39be4990 con 0x562a39bef5c0 2024-09-13T16:08:08.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.279+0000 7f298da00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39beec80 0x562a39c098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:08.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.279+0000 7f298d000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562a39bef5c0 0x562a39c10e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:08.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.279+0000 7f298e400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39bf4650 0x562a39c09df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:08.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.279+0000 7f298da00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39beec80 0x562a39c098b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:57106/0 (socket says 172.21.15.17:57106) 2024-09-13T16:08:08.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.279+0000 7f298da00640 1 -- 172.21.15.17:0/4292568968 learned_addr learned my addr 172.21.15.17:0/4292568968 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:08:08.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.279+0000 7f298d000640 1 -- 172.21.15.17:0/4292568968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39beec80 msgr2=0x562a39c098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:08.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.279+0000 7f298d000640 1 --2- 172.21.15.17:0/4292568968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39beec80 0x562a39c098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.279+0000 7f298d000640 1 -- 172.21.15.17:0/4292568968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39bf4650 msgr2=0x562a39c09df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:08.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.279+0000 7f298d000640 1 --2- 172.21.15.17:0/4292568968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39bf4650 0x562a39c09df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.279+0000 7f298d000640 1 -- 172.21.15.17:0/4292568968 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a39af2180 con 0x562a39bef5c0 2024-09-13T16:08:08.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.279+0000 7f298da00640 1 --2- 172.21.15.17:0/4292568968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39beec80 0x562a39c098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:08:08.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.282+0000 7f298d000640 1 --2- 172.21.15.17:0/4292568968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562a39bef5c0 0x562a39c10e10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f297c096820 tx=0x7f297c0109e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c10893b9301bdc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:08.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.282+0000 7f2977400640 1 -- 172.21.15.17:0/4292568968 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c00d040 con 0x562a39bef5c0 2024-09-13T16:08:08.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.282+0000 7f2977400640 1 -- 172.21.15.17:0/4292568968 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f297c0b6070 con 0x562a39bef5c0 2024-09-13T16:08:08.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.282+0000 7f2977400640 1 -- 172.21.15.17:0/4292568968 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c099280 con 0x562a39bef5c0 2024-09-13T16:08:08.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.283+0000 7f2993217740 1 -- 172.21.15.17:0/4292568968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562a39bef5c0 msgr2=0x562a39c10e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:08.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.283+0000 7f2993217740 1 --2- 172.21.15.17:0/4292568968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562a39bef5c0 0x562a39c10e10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f297c096820 tx=0x7f297c0109e0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.284+0000 7f2993217740 1 -- 172.21.15.17:0/4292568968 shutdown_connections 2024-09-13T16:08:08.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.284+0000 7f2993217740 1 --2- 172.21.15.17:0/4292568968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39bf4650 0x562a39c09df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.284+0000 7f2993217740 1 --2- 172.21.15.17:0/4292568968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562a39bef5c0 0x562a39c10e10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.284+0000 7f2993217740 1 --2- 172.21.15.17:0/4292568968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39beec80 0x562a39c098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.284+0000 7f2993217740 1 -- 172.21.15.17:0/4292568968 >> 172.21.15.17:0/4292568968 conn(0x562a39bea2f0 msgr2=0x562a39bf3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:08.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.286+0000 7f2993217740 1 -- 172.21.15.17:0/4292568968 shutdown_connections 2024-09-13T16:08:08.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.286+0000 7f2993217740 1 -- 172.21.15.17:0/4292568968 wait complete. 2024-09-13T16:08:08.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.286+0000 7f2993217740 1 -- start start 2024-09-13T16:08:08.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.287+0000 7f2993217740 1 Processor -- start 2024-09-13T16:08:08.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.288+0000 7f2993217740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39beec80 0x562a39c0cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:08.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.288+0000 7f2993217740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39bef5c0 0x562a39c0d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:08.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.288+0000 7f2993217740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562a39bf4650 0x562a39c102a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:08.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.288+0000 7f298da00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39beec80 0x562a39c0cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:08.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.289+0000 7f298da00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39beec80 0x562a39c0cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58700/0 (socket says 172.21.15.17:58700) 2024-09-13T16:08:08.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.289+0000 7f2993217740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a39c107e0 con 0x562a39beec80 2024-09-13T16:08:08.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.289+0000 7f298e400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562a39bf4650 0x562a39c102a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:08.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.289+0000 7f2993217740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a39c10950 con 0x562a39bef5c0 2024-09-13T16:08:08.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.289+0000 7f2993217740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a39c10b10 con 0x562a39bf4650 2024-09-13T16:08:08.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.289+0000 7f298da00640 1 -- 172.21.15.17:0/3813848161 learned_addr learned my addr 172.21.15.17:0/3813848161 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:08:08.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.289+0000 7f298d000640 1 --2- 172.21.15.17:0/3813848161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39bef5c0 0x562a39c0d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:08.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.289+0000 7f2993217740 10 client.0 _ll_register_callbacks cb 0x7f297c096660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:08:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.291+0000 7f298da00640 1 -- 172.21.15.17:0/3813848161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562a39bf4650 msgr2=0x562a39c102a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.291+0000 7f298da00640 1 --2- 172.21.15.17:0/3813848161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562a39bf4650 0x562a39c102a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.291+0000 7f298da00640 1 -- 172.21.15.17:0/3813848161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39bef5c0 msgr2=0x562a39c0d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.291+0000 7f298da00640 1 --2- 172.21.15.17:0/3813848161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39bef5c0 0x562a39c0d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.291+0000 7f298da00640 1 -- 172.21.15.17:0/3813848161 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a39b50170 con 0x562a39beec80 2024-09-13T16:08:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.291+0000 7f298d000640 1 --2- 172.21.15.17:0/3813848161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39bef5c0 0x562a39c0d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.291+0000 7f298e400640 1 --2- 172.21.15.17:0/3813848161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562a39bf4650 0x562a39c102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:08:08.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.292+0000 7f298da00640 1 --2- 172.21.15.17:0/3813848161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39beec80 0x562a39c0cd40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f297800ebb0 tx=0x7f29780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56547e2c30fe9d84 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:08.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.292+0000 7f296b400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T16:08:08.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.295+0000 7f296b400640 1 -- 172.21.15.17:0/3813848161 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2978025040 con 0x562a39beec80 2024-09-13T16:08:08.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.295+0000 7f296b400640 1 -- 172.21.15.17:0/3813848161 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f297802b070 con 0x562a39beec80 2024-09-13T16:08:08.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.295+0000 7f2993217740 1 -- 172.21.15.17:0/3813848161 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f297c0986c0 con 0x562a39beec80 2024-09-13T16:08:08.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.296+0000 7f296b400640 1 -- 172.21.15.17:0/3813848161 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2978005970 con 0x562a39beec80 2024-09-13T16:08:08.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.296+0000 7f2993217740 10 client.15822 fetch_fsmap learned FSMap version 45 2024-09-13T16:08:08.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.296+0000 7f2993217740 1 -- 172.21.15.17:0/3813848161 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x562a39b17560 con 0x562a39beec80 2024-09-13T16:08:08.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.296+0000 7f296b400640 1 -- 172.21.15.17:0/3813848161 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f297c0986c0 con 0x562a39beec80 2024-09-13T16:08:08.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.296+0000 7f296b400640 1 -- 172.21.15.17:0/3813848161 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 45) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f2978030860 con 0x562a39beec80 2024-09-13T16:08:08.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.297+0000 7f2993217740 10 client.15822 fetch_fsmap finished waiting for FSMap version 45 2024-09-13T16:08:08.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.297+0000 7f2993217740 10 client.15822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:08:08.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.297+0000 7f2993217740 20 client.15822 populate_metadata read hostname 'smithi017' 2024-09-13T16:08:08.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.297+0000 7f2993217740 1 --2- 172.21.15.17:0/3813848161 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x562a39c6c8a0 0x562a39c6ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:08.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.297+0000 7f2993217740 4 client.15822 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:08:08.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.297+0000 7f2993217740 1 -- 172.21.15.17:0/3813848161 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562a39845300 con 0x562a39c6c8a0 2024-09-13T16:08:08.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.298+0000 7f298d000640 1 --2- 172.21.15.17:0/3813848161 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x562a39c6c8a0 0x562a39c6ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:08.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.299+0000 7f298d000640 1 --2- 172.21.15.17:0/3813848161 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x562a39c6c8a0 0x562a39c6ecc0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=179b8ee96d1925dd server_cookie=29522c92fe90c92d in_seq=0 out_seq=0 2024-09-13T16:08:08.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.299+0000 7f296b400640 10 client.15822 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:08:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.462+0000 7f296b400640 1 -- 172.21.15.17:0/3813848161 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562a39845300 con 0x562a39c6c8a0 2024-09-13T16:08:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.462+0000 7f296b400640 10 client.15822 handle_command_reply: tid=0 2024-09-13T16:08:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.462+0000 7f2993217740 1 client.15822 shutdown 2024-09-13T16:08:08.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.462+0000 7f2993217740 1 -- 172.21.15.17:0/3813848161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39beec80 msgr2=0x562a39c0cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:08.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.463+0000 7f2993217740 1 --2- 172.21.15.17:0/3813848161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39beec80 0x562a39c0cd40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f297800ebb0 tx=0x7f29780046c0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.463+0000 7f2993217740 1 -- 172.21.15.17:0/3813848161 shutdown_connections 2024-09-13T16:08:08.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.463+0000 7f2993217740 1 --2- 172.21.15.17:0/3813848161 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x562a39c6c8a0 0x562a39c6ecc0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.463+0000 7f2993217740 1 --2- 172.21.15.17:0/3813848161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562a39bf4650 0x562a39c102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.463+0000 7f2993217740 1 --2- 172.21.15.17:0/3813848161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a39bef5c0 0x562a39c0d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.463+0000 7f2993217740 1 --2- 172.21.15.17:0/3813848161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a39beec80 0x562a39c0cd40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.463+0000 7f2993217740 1 -- 172.21.15.17:0/3813848161 >> 172.21.15.17:0/3813848161 conn(0x562a39bea2f0 msgr2=0x562a39bf04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:08.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.463+0000 7f296b400640 0 client.15822 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:08:08.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.463+0000 7f2993217740 1 -- 172.21.15.17:0/3813848161 shutdown_connections 2024-09-13T16:08:08.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.463+0000 7f2993217740 1 -- 172.21.15.17:0/3813848161 wait complete. 2024-09-13T16:08:08.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.464+0000 7f2993217740 20 client.15822 trim_cache size 0 max 16384 2024-09-13T16:08:08.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:08:08.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:08:08.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:08:08.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:08:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.465+0000 7f298ee00640 1 -- 172.21.15.17:0/997584457 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f29700a12a0 msgr2=0x7f29700a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.465+0000 7f298ee00640 1 --2- 172.21.15.17:0/997584457 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f29700a12a0 0x7f29700a3760 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2978005fd0 tx=0x7f2978009650 comp rx=0 tx=0).stop 2024-09-13T16:08:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.465+0000 7f298ee00640 1 -- 172.21.15.17:0/997584457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2988102f10 msgr2=0x7f2988198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.465+0000 7f298ee00640 1 --2- 172.21.15.17:0/997584457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2988102f10 0x7f2988198360 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f297c00b3c0 tx=0x7f297c00b880 comp rx=0 tx=0).stop 2024-09-13T16:08:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.465+0000 7f298ee00640 1 -- 172.21.15.17:0/997584457 shutdown_connections 2024-09-13T16:08:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.465+0000 7f298ee00640 1 --2- 172.21.15.17:0/997584457 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f29700a12a0 0x7f29700a3760 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.465+0000 7f298ee00640 1 --2- 172.21.15.17:0/997584457 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2988105920 0x7f298819f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.465+0000 7f298ee00640 1 --2- 172.21.15.17:0/997584457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2988102f10 0x7f2988198360 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.465+0000 7f298ee00640 1 --2- 172.21.15.17:0/997584457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29881005e0 0x7f2988197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.465+0000 7f298ee00640 1 -- 172.21.15.17:0/997584457 >> 172.21.15.17:0/997584457 conn(0x7f29880fa1c0 msgr2=0x7f29880ffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.465+0000 7f298ee00640 1 -- 172.21.15.17:0/997584457 shutdown_connections 2024-09-13T16:08:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:08.465+0000 7f298ee00640 1 -- 172.21.15.17:0/997584457 wait complete. 2024-09-13T16:08:10.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:09 smithi193 ceph-mon[35248]: pgmap v697: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 7.2 MiB/s wr, 491 op/s 2024-09-13T16:08:10.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:09 smithi017 ceph-mon[30494]: pgmap v697: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 7.2 MiB/s wr, 491 op/s 2024-09-13T16:08:10.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:09 smithi189 ceph-mon[34790]: pgmap v697: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 7.2 MiB/s wr, 491 op/s 2024-09-13T16:08:10.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 625.0 s, 525.8 tps, lat 182.530 ms stddev 311.658 2024-09-13T16:08:12.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:11 smithi193 ceph-mon[35248]: pgmap v698: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.2 MiB/s wr, 504 op/s 2024-09-13T16:08:12.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:11 smithi017 ceph-mon[30494]: pgmap v698: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.2 MiB/s wr, 504 op/s 2024-09-13T16:08:12.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:11 smithi189 ceph-mon[34790]: pgmap v698: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.2 MiB/s wr, 504 op/s 2024-09-13T16:08:14.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:13 smithi193 ceph-mon[35248]: pgmap v699: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 6.7 MiB/s wr, 464 op/s 2024-09-13T16:08:14.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:13 smithi017 ceph-mon[30494]: pgmap v699: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 6.7 MiB/s wr, 464 op/s 2024-09-13T16:08:14.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:13 smithi189 ceph-mon[34790]: pgmap v699: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 6.7 MiB/s wr, 464 op/s 2024-09-13T16:08:15.315 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 630.0 s, 539.2 tps, lat 191.155 ms stddev 222.067 2024-09-13T16:08:16.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:15 smithi193 ceph-mon[35248]: pgmap v700: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7.1 MiB/s wr, 501 op/s 2024-09-13T16:08:16.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:15 smithi017 ceph-mon[30494]: pgmap v700: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7.1 MiB/s wr, 501 op/s 2024-09-13T16:08:16.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:15 smithi189 ceph-mon[34790]: pgmap v700: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7.1 MiB/s wr, 501 op/s 2024-09-13T16:08:18.007 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:17 smithi193 ceph-mon[35248]: pgmap v701: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 8.4 MiB/s wr, 557 op/s 2024-09-13T16:08:18.007 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:17 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:08:18.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:17 smithi017 ceph-mon[30494]: pgmap v701: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 8.4 MiB/s wr, 557 op/s 2024-09-13T16:08:18.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:17 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:08:18.084 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:17 smithi189 ceph-mon[34790]: pgmap v701: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 8.4 MiB/s wr, 557 op/s 2024-09-13T16:08:18.084 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:17 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:08:20.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:19 smithi193 ceph-mon[35248]: pgmap v702: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7.0 MiB/s wr, 486 op/s 2024-09-13T16:08:20.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:19 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:20.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:19 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:20.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:19 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:20.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:19 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:20.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:19 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:20.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:19 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:20.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:19 smithi017 ceph-mon[30494]: pgmap v702: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7.0 MiB/s wr, 486 op/s 2024-09-13T16:08:20.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:19 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:20.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:19 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:20.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:19 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:20.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:19 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:20.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:19 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:20.014 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:19 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:20.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:19 smithi189 ceph-mon[34790]: pgmap v702: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7.0 MiB/s wr, 486 op/s 2024-09-13T16:08:20.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:19 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:20.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:19 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:20.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:19 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:20.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:19 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:20.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:19 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:20.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:19 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:20.317 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 635.0 s, 471.8 tps, lat 211.149 ms stddev 265.804 2024-09-13T16:08:22.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:21 smithi193 ceph-mon[35248]: pgmap v703: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 7.3 MiB/s wr, 508 op/s 2024-09-13T16:08:22.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.002+0000 7f7f06200640 1 -- 172.21.15.17:0/2967816408 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ef8098a20 msgr2=0x7f7ef8098ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:22.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.002+0000 7f7f06200640 1 --2- 172.21.15.17:0/2967816408 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ef8098a20 0x7f7ef8098ea0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009860 tx=0x7f7eec02a340 comp rx=0 tx=0).stop 2024-09-13T16:08:22.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.004+0000 7f7f06200640 1 -- 172.21.15.17:0/2967816408 shutdown_connections 2024-09-13T16:08:22.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.004+0000 7f7f06200640 1 --2- 172.21.15.17:0/2967816408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ef80993e0 0x7f7ef809fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.004+0000 7f7f06200640 1 --2- 172.21.15.17:0/2967816408 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ef8098a20 0x7f7ef8098ea0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.004+0000 7f7f06200640 1 --2- 172.21.15.17:0/2967816408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef8097830 0x7f7ef8097c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.004+0000 7f7f06200640 1 -- 172.21.15.17:0/2967816408 >> 172.21.15.17:0/2967816408 conn(0x7f7ef8092fb0 msgr2=0x7f7ef80953d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.005+0000 7f7f06200640 1 -- 172.21.15.17:0/2967816408 shutdown_connections 2024-09-13T16:08:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.006+0000 7f7f06200640 1 -- 172.21.15.17:0/2967816408 wait complete. 2024-09-13T16:08:22.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.007+0000 7f7f06200640 1 Processor -- start 2024-09-13T16:08:22.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.009+0000 7f7f06200640 1 -- start start 2024-09-13T16:08:22.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:21 smithi017 ceph-mon[30494]: pgmap v703: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 7.3 MiB/s wr, 508 op/s 2024-09-13T16:08:22.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.009+0000 7f7f06200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef8097830 0x7f7ef8131d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.009+0000 7f7f06200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ef8098a20 0x7f7ef81322a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.009+0000 7f7f06200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ef80993e0 0x7f7ef8139310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.009+0000 7f7f06200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef8139850 con 0x7f7ef8097830 2024-09-13T16:08:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.009+0000 7f7f06200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef81399c0 con 0x7f7ef8098a20 2024-09-13T16:08:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.009+0000 7f7f06200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef8139b80 con 0x7f7ef80993e0 2024-09-13T16:08:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.010+0000 7f7f05800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ef80993e0 0x7f7ef8139310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.010+0000 7f7effe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ef8098a20 0x7f7ef81322a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.010+0000 7f7f05800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ef80993e0 0x7f7ef8139310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:42382/0 (socket says 172.21.15.17:42382) 2024-09-13T16:08:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.010+0000 7f7f05800640 1 -- 172.21.15.17:0/670855590 learned_addr learned my addr 172.21.15.17:0/670855590 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:08:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.010+0000 7f7f05800640 1 -- 172.21.15.17:0/670855590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ef8098a20 msgr2=0x7f7ef81322a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.010+0000 7f7f04e00640 1 --2- 172.21.15.17:0/670855590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef8097830 0x7f7ef8131d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.010+0000 7f7f05800640 1 --2- 172.21.15.17:0/670855590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ef8098a20 0x7f7ef81322a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.010+0000 7f7f05800640 1 -- 172.21.15.17:0/670855590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef8097830 msgr2=0x7f7ef8131d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.010+0000 7f7f05800640 1 --2- 172.21.15.17:0/670855590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef8097830 0x7f7ef8131d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.010+0000 7f7f05800640 1 -- 172.21.15.17:0/670855590 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec009490 con 0x7f7ef80993e0 2024-09-13T16:08:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.011+0000 7f7effe00640 1 --2- 172.21.15.17:0/670855590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ef8098a20 0x7f7ef81322a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.011+0000 7f7f04e00640 1 --2- 172.21.15.17:0/670855590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef8097830 0x7f7ef8131d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:08:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.011+0000 7f7f05800640 1 --2- 172.21.15.17:0/670855590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ef80993e0 0x7f7ef8139310 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7f00065d70 tx=0x7f7f00069840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.011+0000 7f7efd600640 1 -- 172.21.15.17:0/670855590 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00069ea0 con 0x7f7ef80993e0 2024-09-13T16:08:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.012+0000 7f7efd600640 1 -- 172.21.15.17:0/670855590 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f0007b040 con 0x7f7ef80993e0 2024-09-13T16:08:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.012+0000 7f7efd600640 1 -- 172.21.15.17:0/670855590 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00069ea0 con 0x7f7ef80993e0 2024-09-13T16:08:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.012+0000 7f7f06200640 1 -- 172.21.15.17:0/670855590 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef8139e60 con 0x7f7ef80993e0 2024-09-13T16:08:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.013+0000 7f7f06200640 1 -- 172.21.15.17:0/670855590 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef813a1d0 con 0x7f7ef80993e0 2024-09-13T16:08:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.019+0000 7f7f0a61d740 1 Processor -- start 2024-09-13T16:08:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.022+0000 7f7efd600640 1 -- 172.21.15.17:0/670855590 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7f0006f070 con 0x7f7ef80993e0 2024-09-13T16:08:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.024+0000 7f7f0a61d740 1 -- start start 2024-09-13T16:08:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.025+0000 7f7f0a61d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502dc80 0x55f00502e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.025+0000 7f7f0a61d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00502e5c0 0x55f005033080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.025+0000 7f7f0a61d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f005033650 0x55f005035b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.025+0000 7f7f0a61d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f004f39bb0 con 0x55f00502dc80 2024-09-13T16:08:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.025+0000 7f7f0a61d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f004f97a70 con 0x55f005033650 2024-09-13T16:08:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.025+0000 7f7f0a61d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f004f95200 con 0x55f00502e5c0 2024-09-13T16:08:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.026+0000 7f7f04e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00502e5c0 0x55f005033080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.026+0000 7f7f04e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00502e5c0 0x55f005033080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:42396/0 (socket says 172.21.15.17:42396) 2024-09-13T16:08:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.026+0000 7f7f04e00640 1 -- 172.21.15.17:0/3400033826 learned_addr learned my addr 172.21.15.17:0/3400033826 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:08:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.026+0000 7f7effe00640 1 --2- 172.21.15.17:0/3400033826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502dc80 0x55f00502e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.027+0000 7f7f04e00640 1 -- 172.21.15.17:0/3400033826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f005033650 msgr2=0x55f005035b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:08:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.027+0000 7f7f04e00640 1 --2- 172.21.15.17:0/3400033826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f005033650 0x55f005035b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.027+0000 7f7f04e00640 1 -- 172.21.15.17:0/3400033826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502dc80 msgr2=0x55f00502e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.027+0000 7f7f04e00640 1 --2- 172.21.15.17:0/3400033826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502dc80 0x55f00502e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.027+0000 7f7f04e00640 1 -- 172.21.15.17:0/3400033826 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f004f32940 con 0x55f00502e5c0 2024-09-13T16:08:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.027+0000 7f7effe00640 1 --2- 172.21.15.17:0/3400033826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502dc80 0x55f00502e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.028+0000 7f7f04e00640 1 --2- 172.21.15.17:0/3400033826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00502e5c0 0x55f005033080 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400a9d0 tx=0x7f7ef400ae90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35cbe9f165a8eeca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.028+0000 7f7ef2000640 1 -- 172.21.15.17:0/3400033826 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef400cc60 con 0x55f00502e5c0 2024-09-13T16:08:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.028+0000 7f7ef2000640 1 -- 172.21.15.17:0/3400033826 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ef400cdc0 con 0x55f00502e5c0 2024-09-13T16:08:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.028+0000 7f7ef2000640 1 -- 172.21.15.17:0/3400033826 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4018690 con 0x55f00502e5c0 2024-09-13T16:08:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.026+0000 7f7efd600640 1 --2- 172.21.15.17:0/670855590 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7ee80a11a0 0x7f7ee80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.029+0000 7f7efd600640 1 -- 172.21.15.17:0/670855590 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f7f0013e9a0 con 0x7f7ef80993e0 2024-09-13T16:08:22.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.031+0000 7f7f05800640 1 --2- 172.21.15.17:0/670855590 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7ee80a11a0 0x7f7ee80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.031+0000 7f7f0a61d740 1 -- 172.21.15.17:0/3400033826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00502e5c0 msgr2=0x55f005033080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.032+0000 7f7f0a61d740 1 --2- 172.21.15.17:0/3400033826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00502e5c0 0x55f005033080 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400a9d0 tx=0x7f7ef400ae90 comp rx=0 tx=0).stop 2024-09-13T16:08:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.033+0000 7f7f0a61d740 1 -- 172.21.15.17:0/3400033826 shutdown_connections 2024-09-13T16:08:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.033+0000 7f7f0a61d740 1 --2- 172.21.15.17:0/3400033826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f005033650 0x55f005035b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.033+0000 7f7f0a61d740 1 --2- 172.21.15.17:0/3400033826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f00502e5c0 0x55f005033080 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.033+0000 7f7f0a61d740 1 --2- 172.21.15.17:0/3400033826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502dc80 0x55f00502e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.033+0000 7f7f0a61d740 1 -- 172.21.15.17:0/3400033826 >> 172.21.15.17:0/3400033826 conn(0x55f0050292f0 msgr2=0x55f0050296f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:22.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.034+0000 7f7f0a61d740 1 -- 172.21.15.17:0/3400033826 shutdown_connections 2024-09-13T16:08:22.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.035+0000 7f7f0a61d740 1 -- 172.21.15.17:0/3400033826 wait complete. 2024-09-13T16:08:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.036+0000 7f7f0a61d740 1 -- start start 2024-09-13T16:08:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.037+0000 7f7f0a61d740 1 Processor -- start 2024-09-13T16:08:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.037+0000 7f7f05800640 1 --2- 172.21.15.17:0/670855590 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7ee80a11a0 0x7f7ee80a3660 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7f0013c150 tx=0x7f7f00065c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.040+0000 7f7f0a61d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f00502dc80 0x55f005037a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.041+0000 7f7f0a61d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502e5c0 0x55f005037f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.041+0000 7f7f0a61d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f005033650 0x55f00503ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.041+0000 7f7f0a61d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f004f90af0 con 0x55f00502e5c0 2024-09-13T16:08:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.041+0000 7f7f0a61d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f004f4ef20 con 0x55f00502dc80 2024-09-13T16:08:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.041+0000 7f7f0a61d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f004f4ebc0 con 0x55f005033650 2024-09-13T16:08:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.041+0000 7f7f0a61d740 10 client.0 _ll_register_callbacks cb 0x55f004f80a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:08:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.041+0000 7f7effe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f00502dc80 0x55f005037a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.041+0000 7f7effe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f00502dc80 0x55f005037a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:50136/0 (socket says 172.21.15.17:50136) 2024-09-13T16:08:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.041+0000 7f7effe00640 1 -- 172.21.15.17:0/1173213820 learned_addr learned my addr 172.21.15.17:0/1173213820 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:08:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.041+0000 7f7effe00640 1 --2- 172.21.15.17:0/1173213820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f005033650 0x55f00503ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.042+0000 7f7f04e00640 1 --2- 172.21.15.17:0/1173213820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502e5c0 0x55f005037f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.043+0000 7f7f04e00640 1 -- 172.21.15.17:0/1173213820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f005033650 msgr2=0x55f00503ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.043+0000 7f7f04e00640 1 --2- 172.21.15.17:0/1173213820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f005033650 0x55f00503ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.043+0000 7f7f04e00640 1 -- 172.21.15.17:0/1173213820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f00502dc80 msgr2=0x55f005037a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.043+0000 7f7f04e00640 1 --2- 172.21.15.17:0/1173213820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f00502dc80 0x55f005037a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.043+0000 7f7f04e00640 1 -- 172.21.15.17:0/1173213820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef400a600 con 0x55f00502e5c0 2024-09-13T16:08:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.043+0000 7f7effe00640 1 --2- 172.21.15.17:0/1173213820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f00502dc80 0x55f005037a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.044+0000 7f7f04e00640 1 --2- 172.21.15.17:0/1173213820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502e5c0 0x55f005037f50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4000c00 tx=0x7f7ef4006cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9fdc31d9e358ca5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.044+0000 7f7ee6a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T16:08:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.045+0000 7f7ee6a00640 1 -- 172.21.15.17:0/1173213820 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4011c90 con 0x55f00502e5c0 2024-09-13T16:08:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.045+0000 7f7ee6a00640 1 -- 172.21.15.17:0/1173213820 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f7ef401a660 con 0x55f00502e5c0 2024-09-13T16:08:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.046+0000 7f7f0a61d740 1 -- 172.21.15.17:0/1173213820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f004fbac90 con 0x55f00502e5c0 2024-09-13T16:08:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.046+0000 7f7ee6a00640 1 -- 172.21.15.17:0/1173213820 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ef401a880 con 0x55f00502e5c0 2024-09-13T16:08:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.046+0000 7f7f0a61d740 10 client.15828 fetch_fsmap learned FSMap version 45 2024-09-13T16:08:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.046+0000 7f7f0a61d740 1 -- 172.21.15.17:0/1173213820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55f004f8f170 con 0x55f00502e5c0 2024-09-13T16:08:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.047+0000 7f7ee6a00640 1 -- 172.21.15.17:0/1173213820 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f004fbac90 con 0x55f00502e5c0 2024-09-13T16:08:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.048+0000 7f7ee6a00640 1 -- 172.21.15.17:0/1173213820 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 45) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f7ef402d7e0 con 0x55f00502e5c0 2024-09-13T16:08:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.048+0000 7f7f0a61d740 10 client.15828 fetch_fsmap finished waiting for FSMap version 45 2024-09-13T16:08:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.048+0000 7f7f0a61d740 10 client.15828 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:08:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.048+0000 7f7f0a61d740 20 client.15828 populate_metadata read hostname 'smithi017' 2024-09-13T16:08:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.048+0000 7f7f0a61d740 1 --2- 172.21.15.17:0/1173213820 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f005043520 0x55f005045940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.048+0000 7f7f0a61d740 4 client.15828 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:08:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.048+0000 7f7f0a61d740 1 -- 172.21.15.17:0/1173213820 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f004f837d0 con 0x55f005043520 2024-09-13T16:08:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.049+0000 7f7effe00640 1 --2- 172.21.15.17:0/1173213820 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f005043520 0x55f005045940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.050+0000 7f7effe00640 1 --2- 172.21.15.17:0/1173213820 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f005043520 0x55f005045940 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d525b7d5ea17392 server_cookie=79a026279bd34491 in_seq=0 out_seq=0 2024-09-13T16:08:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.050+0000 7f7ee6a00640 10 client.15828 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:08:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.051+0000 7f7ee6a00640 1 -- 172.21.15.17:0/1173213820 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f004f837d0 con 0x55f005043520 2024-09-13T16:08:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.051+0000 7f7ee6a00640 10 client.15828 handle_command_reply: tid=0 2024-09-13T16:08:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.051+0000 7f7f0a61d740 1 client.15828 shutdown 2024-09-13T16:08:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.052+0000 7f7f0a61d740 1 -- 172.21.15.17:0/1173213820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502e5c0 msgr2=0x55f005037f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.052+0000 7f7f0a61d740 1 --2- 172.21.15.17:0/1173213820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502e5c0 0x55f005037f50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4000c00 tx=0x7f7ef4006cf0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.052+0000 7f7f0a61d740 1 -- 172.21.15.17:0/1173213820 shutdown_connections 2024-09-13T16:08:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.052+0000 7f7f0a61d740 1 --2- 172.21.15.17:0/1173213820 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f005043520 0x55f005045940 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.052+0000 7f7f0a61d740 1 --2- 172.21.15.17:0/1173213820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f005033650 0x55f00503ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.052+0000 7f7f0a61d740 1 --2- 172.21.15.17:0/1173213820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502e5c0 0x55f005037f50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.052+0000 7f7f0a61d740 1 --2- 172.21.15.17:0/1173213820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f00502dc80 0x55f005037a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.052+0000 7f7ee6a00640 0 client.15828 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:08:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.052+0000 7f7f0a61d740 1 -- 172.21.15.17:0/1173213820 >> 172.21.15.17:0/1173213820 conn(0x55f0050292f0 msgr2=0x55f00502ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.052+0000 7f7f0a61d740 1 -- 172.21.15.17:0/1173213820 shutdown_connections 2024-09-13T16:08:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.052+0000 7f7f0a61d740 1 -- 172.21.15.17:0/1173213820 wait complete. 2024-09-13T16:08:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.053+0000 7f7f0a61d740 20 client.15828 trim_cache size 0 max 16384 2024-09-13T16:08:22.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.076+0000 7f7f0a61d740 1 Processor -- start 2024-09-13T16:08:22.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.076+0000 7f7f0a61d740 1 -- start start 2024-09-13T16:08:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.076+0000 7f7f0a61d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502dc80 0x55f005037a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.076+0000 7f7f0a61d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f00502e5c0 0x55f005037f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.076+0000 7f7f0a61d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f005033650 0x55f00503ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.076+0000 7f7f0a61d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f004cf7e60 con 0x55f00502dc80 2024-09-13T16:08:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.076+0000 7f7f0a61d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f00502b180 con 0x55f00502e5c0 2024-09-13T16:08:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.076+0000 7f7f0a61d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f005023900 con 0x55f005033650 2024-09-13T16:08:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.076+0000 7f7effe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502dc80 0x55f005037a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.077+0000 7f7effe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502dc80 0x55f005037a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37842/0 (socket says 172.21.15.17:37842) 2024-09-13T16:08:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.077+0000 7f7effe00640 1 -- 172.21.15.17:0/328795153 learned_addr learned my addr 172.21.15.17:0/328795153 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:08:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.077+0000 7f7effe00640 1 --2- 172.21.15.17:0/328795153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f005033650 0x55f00503ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.077+0000 7f7f04e00640 1 --2- 172.21.15.17:0/328795153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f00502e5c0 0x55f005037f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.077+0000 7f7effe00640 1 -- 172.21.15.17:0/328795153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f005033650 msgr2=0x55f00503ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.077+0000 7f7effe00640 1 --2- 172.21.15.17:0/328795153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f005033650 0x55f00503ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.077+0000 7f7effe00640 1 -- 172.21.15.17:0/328795153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f00502e5c0 msgr2=0x55f005037f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.077+0000 7f7effe00640 1 --2- 172.21.15.17:0/328795153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f00502e5c0 0x55f005037f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.077+0000 7f7effe00640 1 -- 172.21.15.17:0/328795153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f004f31180 con 0x55f00502dc80 2024-09-13T16:08:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.077+0000 7f7f04e00640 1 --2- 172.21.15.17:0/328795153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f00502e5c0 0x55f005037f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:08:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.078+0000 7f7effe00640 1 --2- 172.21.15.17:0/328795153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502dc80 0x55f005037a10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0304b0 tx=0x7f7eec032810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dafbe09330bdd640 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:22.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.078+0000 7f7ef2a00640 1 -- 172.21.15.17:0/328795153 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec005240 con 0x55f00502dc80 2024-09-13T16:08:22.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.078+0000 7f7ef2a00640 1 -- 172.21.15.17:0/328795153 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7eec04c800 con 0x55f00502dc80 2024-09-13T16:08:22.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.078+0000 7f7ef2a00640 1 -- 172.21.15.17:0/328795153 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec0048b0 con 0x55f00502dc80 2024-09-13T16:08:22.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.079+0000 7f7f0a61d740 1 -- 172.21.15.17:0/328795153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502dc80 msgr2=0x55f005037a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:22.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.079+0000 7f7f0a61d740 1 --2- 172.21.15.17:0/328795153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502dc80 0x55f005037a10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0304b0 tx=0x7f7eec032810 comp rx=0 tx=0).stop 2024-09-13T16:08:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.080+0000 7f7f0a61d740 1 -- 172.21.15.17:0/328795153 shutdown_connections 2024-09-13T16:08:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.080+0000 7f7f0a61d740 1 --2- 172.21.15.17:0/328795153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f005033650 0x55f00503ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.080+0000 7f7f0a61d740 1 --2- 172.21.15.17:0/328795153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f00502e5c0 0x55f005037f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.080+0000 7f7f0a61d740 1 --2- 172.21.15.17:0/328795153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502dc80 0x55f005037a10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.080+0000 7f7f0a61d740 1 -- 172.21.15.17:0/328795153 >> 172.21.15.17:0/328795153 conn(0x55f0050292f0 msgr2=0x55f00504a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.080+0000 7f7f0a61d740 1 -- 172.21.15.17:0/328795153 shutdown_connections 2024-09-13T16:08:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.080+0000 7f7f0a61d740 1 -- 172.21.15.17:0/328795153 wait complete. 2024-09-13T16:08:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.080+0000 7f7f0a61d740 1 -- start start 2024-09-13T16:08:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.080+0000 7f7f0a61d740 1 Processor -- start 2024-09-13T16:08:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.081+0000 7f7f0a61d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502dc80 0x55f00503ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.081+0000 7f7f0a61d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f00502e5c0 0x55f00503bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.081+0000 7f7f0a61d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f005033650 0x55f00503c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.081+0000 7f7f0a61d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f005099a10 con 0x55f00502dc80 2024-09-13T16:08:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.081+0000 7f7f0a61d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f005099b50 con 0x55f00502e5c0 2024-09-13T16:08:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.081+0000 7f7f0a61d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f005099cc0 con 0x55f005033650 2024-09-13T16:08:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.081+0000 7f7f0a61d740 10 client.0 _ll_register_callbacks cb 0x7f7ef400a1d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:08:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.081+0000 7f7f04e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f00502e5c0 0x55f00503bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.081+0000 7f7f04e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f00502e5c0 0x55f00503bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:50148/0 (socket says 172.21.15.17:50148) 2024-09-13T16:08:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.081+0000 7f7f04e00640 1 -- 172.21.15.17:0/16148227 learned_addr learned my addr 172.21.15.17:0/16148227 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:08:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.081+0000 7f7effe00640 1 --2- 172.21.15.17:0/16148227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f005033650 0x55f00503c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.081+0000 7f7effe00640 1 --2- 172.21.15.17:0/16148227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502dc80 0x55f00503ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.081+0000 7f7f04e00640 1 -- 172.21.15.17:0/16148227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f005033650 msgr2=0x55f00503c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.082+0000 7f7f04e00640 1 --2- 172.21.15.17:0/16148227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f005033650 0x55f00503c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.082+0000 7f7f04e00640 1 -- 172.21.15.17:0/16148227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502dc80 msgr2=0x55f00503ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.082+0000 7f7f04e00640 1 --2- 172.21.15.17:0/16148227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502dc80 0x55f00503ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.082+0000 7f7f04e00640 1 -- 172.21.15.17:0/16148227 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f004f8f170 con 0x55f00502e5c0 2024-09-13T16:08:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.082+0000 7f7effe00640 1 --2- 172.21.15.17:0/16148227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502dc80 0x55f00503ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:08:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.082+0000 7f7f04e00640 1 --2- 172.21.15.17:0/16148227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f00502e5c0 0x55f00503bb60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4004810 tx=0x7f7ef4011620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7db2b67ac944261 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.082+0000 7f7ee6a00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:08:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.082+0000 7f7ee6a00640 1 -- 172.21.15.17:0/16148227 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef401aa70 con 0x55f00502e5c0 2024-09-13T16:08:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.082+0000 7f7ee6a00640 1 -- 172.21.15.17:0/16148227 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f7ef4023e60 con 0x55f00502e5c0 2024-09-13T16:08:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.082+0000 7f7f0a61d740 1 -- 172.21.15.17:0/16148227 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7ef400cdc0 con 0x55f00502e5c0 2024-09-13T16:08:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.083+0000 7f7ee6a00640 1 -- 172.21.15.17:0/16148227 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ef402d9a0 con 0x55f00502e5c0 2024-09-13T16:08:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.083+0000 7f7f0a61d740 10 client.26141 fetch_fsmap learned FSMap version 45 2024-09-13T16:08:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.083+0000 7f7f0a61d740 1 -- 172.21.15.17:0/16148227 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x7f7eec047040 con 0x55f00502e5c0 2024-09-13T16:08:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.083+0000 7f7ee6a00640 1 -- 172.21.15.17:0/16148227 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ef400cdc0 con 0x55f00502e5c0 2024-09-13T16:08:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.083+0000 7f7ee6a00640 1 -- 172.21.15.17:0/16148227 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 45) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f7ef4023850 con 0x55f00502e5c0 2024-09-13T16:08:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.083+0000 7f7f0a61d740 10 client.26141 fetch_fsmap finished waiting for FSMap version 45 2024-09-13T16:08:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.083+0000 7f7f0a61d740 10 client.26141 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:08:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.084+0000 7f7f0a61d740 20 client.26141 populate_metadata read hostname 'smithi017' 2024-09-13T16:08:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.084+0000 7f7f0a61d740 1 --2- 172.21.15.17:0/16148227 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f00509b300 0x55f00509d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.084+0000 7f7f0a61d740 4 client.26141 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:08:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.084+0000 7f7f0a61d740 1 -- 172.21.15.17:0/16148227 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f004c84300 con 0x55f00509b300 2024-09-13T16:08:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.084+0000 7f7effe00640 1 --2- 172.21.15.17:0/16148227 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f00509b300 0x55f00509d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.084+0000 7f7effe00640 1 --2- 172.21.15.17:0/16148227 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f00509b300 0x55f00509d720 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bce27b837eaecd73 server_cookie=c6ad0bd47b168535 in_seq=0 out_seq=0 2024-09-13T16:08:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.084+0000 7f7ee6a00640 10 client.26141 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:08:22.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.093+0000 7f7ee6a00640 1 -- 172.21.15.17:0/16148227 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f004c84300 con 0x55f00509b300 2024-09-13T16:08:22.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.093+0000 7f7ee6a00640 10 client.26141 handle_command_reply: tid=0 2024-09-13T16:08:22.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.093+0000 7f7f0a61d740 1 client.26141 shutdown 2024-09-13T16:08:22.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.093+0000 7f7f0a61d740 1 -- 172.21.15.17:0/16148227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f00502e5c0 msgr2=0x55f00503bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:22.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.093+0000 7f7f0a61d740 1 --2- 172.21.15.17:0/16148227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f00502e5c0 0x55f00503bb60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4004810 tx=0x7f7ef4011620 comp rx=0 tx=0).stop 2024-09-13T16:08:22.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.094+0000 7f7f0a61d740 1 -- 172.21.15.17:0/16148227 shutdown_connections 2024-09-13T16:08:22.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.094+0000 7f7f0a61d740 1 --2- 172.21.15.17:0/16148227 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55f00509b300 0x55f00509d720 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.094+0000 7f7f0a61d740 1 --2- 172.21.15.17:0/16148227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f005033650 0x55f00503c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.094+0000 7f7f0a61d740 1 --2- 172.21.15.17:0/16148227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f00502e5c0 0x55f00503bb60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.094+0000 7f7ee6a00640 0 client.26141 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:08:22.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.094+0000 7f7f0a61d740 1 --2- 172.21.15.17:0/16148227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00502dc80 0x55f00503ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.094+0000 7f7f0a61d740 1 -- 172.21.15.17:0/16148227 >> 172.21.15.17:0/16148227 conn(0x55f0050292f0 msgr2=0x55f0050379d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:22.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.094+0000 7f7f0a61d740 1 -- 172.21.15.17:0/16148227 shutdown_connections 2024-09-13T16:08:22.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.094+0000 7f7f0a61d740 1 -- 172.21.15.17:0/16148227 wait complete. 2024-09-13T16:08:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.094+0000 7f7f0a61d740 20 client.26141 trim_cache size 0 max 16384 2024-09-13T16:08:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:08:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:08:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:08:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:08:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.095+0000 7f7f06200640 1 -- 172.21.15.17:0/670855590 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7ee80a11a0 msgr2=0x7f7ee80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.095+0000 7f7f06200640 1 --2- 172.21.15.17:0/670855590 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7ee80a11a0 0x7f7ee80a3660 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7f0013c150 tx=0x7f7f00065c00 comp rx=0 tx=0).stop 2024-09-13T16:08:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.095+0000 7f7f06200640 1 -- 172.21.15.17:0/670855590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ef80993e0 msgr2=0x7f7ef8139310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.095+0000 7f7f06200640 1 --2- 172.21.15.17:0/670855590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ef80993e0 0x7f7ef8139310 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7f00065d70 tx=0x7f7f00069840 comp rx=0 tx=0).stop 2024-09-13T16:08:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.095+0000 7f7f06200640 1 -- 172.21.15.17:0/670855590 shutdown_connections 2024-09-13T16:08:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.095+0000 7f7f06200640 1 --2- 172.21.15.17:0/670855590 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7ee80a11a0 0x7f7ee80a3660 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.096+0000 7f7f06200640 1 --2- 172.21.15.17:0/670855590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ef80993e0 0x7f7ef8139310 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.096+0000 7f7f06200640 1 --2- 172.21.15.17:0/670855590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ef8098a20 0x7f7ef81322a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.096+0000 7f7f06200640 1 --2- 172.21.15.17:0/670855590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef8097830 0x7f7ef8131d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.096+0000 7f7f06200640 1 -- 172.21.15.17:0/670855590 >> 172.21.15.17:0/670855590 conn(0x7f7ef8092fb0 msgr2=0x7f7ef800aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.096+0000 7f7f06200640 1 -- 172.21.15.17:0/670855590 shutdown_connections 2024-09-13T16:08:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:22.096+0000 7f7f06200640 1 -- 172.21.15.17:0/670855590 wait complete. 2024-09-13T16:08:22.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:21 smithi189 ceph-mon[34790]: pgmap v703: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 7.3 MiB/s wr, 508 op/s 2024-09-13T16:08:24.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:23 smithi193 ceph-mon[35248]: pgmap v704: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7.3 MiB/s wr, 535 op/s 2024-09-13T16:08:24.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:23 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:24.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:23 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:24.014 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:23 smithi017 ceph-mon[30494]: pgmap v704: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7.3 MiB/s wr, 535 op/s 2024-09-13T16:08:24.014 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:23 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:24.014 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:23 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:24.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:23 smithi189 ceph-mon[34790]: pgmap v704: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7.3 MiB/s wr, 535 op/s 2024-09-13T16:08:24.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:23 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:24.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:23 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:25.315 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 640.0 s, 440.4 tps, lat 226.464 ms stddev 325.035 2024-09-13T16:08:26.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:25 smithi193 ceph-mon[35248]: pgmap v705: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6.8 MiB/s wr, 482 op/s 2024-09-13T16:08:26.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:25 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:08:26.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:25 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:08:26.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:25 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:26.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:25 smithi017 ceph-mon[30494]: pgmap v705: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6.8 MiB/s wr, 482 op/s 2024-09-13T16:08:26.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:25 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:08:26.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:25 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:08:26.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:25 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:26.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:25 smithi189 ceph-mon[34790]: pgmap v705: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6.8 MiB/s wr, 482 op/s 2024-09-13T16:08:26.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:25 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:08:26.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:25 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:08:26.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:25 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:08:28.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:27 smithi189 ceph-mon[34790]: pgmap v706: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.5 MiB/s wr, 515 op/s 2024-09-13T16:08:28.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:27 smithi193 ceph-mon[35248]: pgmap v706: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.5 MiB/s wr, 515 op/s 2024-09-13T16:08:28.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:27 smithi017 ceph-mon[30494]: pgmap v706: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.5 MiB/s wr, 515 op/s 2024-09-13T16:08:30.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:29 smithi189 ceph-mon[34790]: pgmap v707: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.2 MiB/s wr, 464 op/s 2024-09-13T16:08:30.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:29 smithi193 ceph-mon[35248]: pgmap v707: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.2 MiB/s wr, 464 op/s 2024-09-13T16:08:30.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:29 smithi017 ceph-mon[30494]: pgmap v707: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.2 MiB/s wr, 464 op/s 2024-09-13T16:08:30.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 645.0 s, 499.0 tps, lat 199.065 ms stddev 251.031 2024-09-13T16:08:32.056 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:31 smithi193 ceph-mon[35248]: pgmap v708: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.1 MiB/s wr, 475 op/s 2024-09-13T16:08:32.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:31 smithi189 ceph-mon[34790]: pgmap v708: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.1 MiB/s wr, 475 op/s 2024-09-13T16:08:32.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:31 smithi017 ceph-mon[30494]: pgmap v708: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.1 MiB/s wr, 475 op/s 2024-09-13T16:08:34.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:33 smithi189 ceph-mon[34790]: pgmap v709: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.1 MiB/s wr, 501 op/s 2024-09-13T16:08:34.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:33 smithi193 ceph-mon[35248]: pgmap v709: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.1 MiB/s wr, 501 op/s 2024-09-13T16:08:34.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:33 smithi017 ceph-mon[30494]: pgmap v709: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.1 MiB/s wr, 501 op/s 2024-09-13T16:08:35.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.312+0000 7fa832200640 1 -- 172.21.15.17:0/2276690249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa82c0744f0 msgr2=0x7fa82c072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.312+0000 7fa832200640 1 --2- 172.21.15.17:0/2276690249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa82c0744f0 0x7fa82c072940 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa81c009900 tx=0x7fa81c02a400 comp rx=0 tx=0).stop 2024-09-13T16:08:35.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.313+0000 7fa832200640 1 -- 172.21.15.17:0/2276690249 shutdown_connections 2024-09-13T16:08:35.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.313+0000 7fa832200640 1 --2- 172.21.15.17:0/2276690249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa82c107b90 0x7fa82c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.313+0000 7fa832200640 1 --2- 172.21.15.17:0/2276690249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82c072f10 0x7fa82c073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.313+0000 7fa832200640 1 --2- 172.21.15.17:0/2276690249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa82c0744f0 0x7fa82c072940 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.313+0000 7fa832200640 1 -- 172.21.15.17:0/2276690249 >> 172.21.15.17:0/2276690249 conn(0x7fa82c0fb4a0 msgr2=0x7fa82c0fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:35.315 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 650.0 s, 479.4 tps, lat 207.594 ms stddev 253.507 2024-09-13T16:08:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.313+0000 7fa832200640 1 -- 172.21.15.17:0/2276690249 shutdown_connections 2024-09-13T16:08:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.313+0000 7fa832200640 1 -- 172.21.15.17:0/2276690249 wait complete. 2024-09-13T16:08:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.314+0000 7fa832200640 1 Processor -- start 2024-09-13T16:08:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.314+0000 7fa832200640 1 -- start start 2024-09-13T16:08:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.314+0000 7fa832200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa82c072f10 0x7fa82c103040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.314+0000 7fa832200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82c0744f0 0x7fa82c103580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.314+0000 7fa832200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa82c107b90 0x7fa82c0ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.315+0000 7fa832200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c100340 con 0x7fa82c0744f0 2024-09-13T16:08:35.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.315+0000 7fa832200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c1004b0 con 0x7fa82c107b90 2024-09-13T16:08:35.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.315+0000 7fa832200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c100670 con 0x7fa82c072f10 2024-09-13T16:08:35.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.315+0000 7fa82aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82c0744f0 0x7fa82c103580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.315+0000 7fa82be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa82c107b90 0x7fa82c0ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.315+0000 7fa82aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82c0744f0 0x7fa82c103580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47174/0 (socket says 172.21.15.17:47174) 2024-09-13T16:08:35.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.315+0000 7fa82b400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa82c072f10 0x7fa82c103040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.315+0000 7fa82aa00640 1 -- 172.21.15.17:0/3865160456 learned_addr learned my addr 172.21.15.17:0/3865160456 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:08:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.315+0000 7fa82b400640 1 -- 172.21.15.17:0/3865160456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa82c107b90 msgr2=0x7fa82c0ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.315+0000 7fa82b400640 1 --2- 172.21.15.17:0/3865160456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa82c107b90 0x7fa82c0ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.315+0000 7fa82b400640 1 -- 172.21.15.17:0/3865160456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82c0744f0 msgr2=0x7fa82c103580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.315+0000 7fa82b400640 1 --2- 172.21.15.17:0/3865160456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82c0744f0 0x7fa82c103580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.315+0000 7fa82b400640 1 -- 172.21.15.17:0/3865160456 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c009560 con 0x7fa82c072f10 2024-09-13T16:08:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.316+0000 7fa82b400640 1 --2- 172.21.15.17:0/3865160456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa82c072f10 0x7fa82c103040 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0057c0 tx=0x7fa81c005620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:35.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.317+0000 7fa823e00640 1 -- 172.21.15.17:0/3865160456 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c004c50 con 0x7fa82c072f10 2024-09-13T16:08:35.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.317+0000 7fa823e00640 1 -- 172.21.15.17:0/3865160456 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa81c004db0 con 0x7fa82c072f10 2024-09-13T16:08:35.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.317+0000 7fa823e00640 1 -- 172.21.15.17:0/3865160456 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c031b20 con 0x7fa82c072f10 2024-09-13T16:08:35.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.317+0000 7fa832200640 1 -- 172.21.15.17:0/3865160456 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82c1a43d0 con 0x7fa82c072f10 2024-09-13T16:08:35.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.318+0000 7fa832200640 1 -- 172.21.15.17:0/3865160456 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82c1a4890 con 0x7fa82c072f10 2024-09-13T16:08:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.323+0000 7fa8350c2740 1 Processor -- start 2024-09-13T16:08:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.323+0000 7fa823e00640 1 -- 172.21.15.17:0/3865160456 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa81c031c80 con 0x7fa82c072f10 2024-09-13T16:08:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.324+0000 7fa8350c2740 1 -- start start 2024-09-13T16:08:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.324+0000 7fa8350c2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20daa70 0x5619e20dae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.324+0000 7fa8350c2740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619e20db3b0 0x5619e20dfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.324+0000 7fa8350c2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20e0440 0x5619e20e2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.324+0000 7fa8350c2740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619e1fe6bb0 con 0x5619e20db3b0 2024-09-13T16:08:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.324+0000 7fa8350c2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619e2044a70 con 0x5619e20daa70 2024-09-13T16:08:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.324+0000 7fa8350c2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619e2042200 con 0x5619e20e0440 2024-09-13T16:08:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.324+0000 7fa82be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20daa70 0x5619e20dae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.324+0000 7fa82be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20daa70 0x5619e20dae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:56668/0 (socket says 172.21.15.17:56668) 2024-09-13T16:08:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.324+0000 7fa82be00640 1 -- 172.21.15.17:0/2374553405 learned_addr learned my addr 172.21.15.17:0/2374553405 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:08:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.325+0000 7fa82aa00640 1 --2- 172.21.15.17:0/2374553405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20e0440 0x5619e20e2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.325+0000 7fa82b400640 1 --2- 172.21.15.17:0/2374553405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619e20db3b0 0x5619e20dfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.325+0000 7fa82be00640 1 -- 172.21.15.17:0/2374553405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20e0440 msgr2=0x5619e20e2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.325+0000 7fa82be00640 1 --2- 172.21.15.17:0/2374553405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20e0440 0x5619e20e2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.325+0000 7fa82be00640 1 -- 172.21.15.17:0/2374553405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619e20db3b0 msgr2=0x5619e20dfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.325+0000 7fa82be00640 1 --2- 172.21.15.17:0/2374553405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619e20db3b0 0x5619e20dfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.325+0000 7fa82be00640 1 -- 172.21.15.17:0/2374553405 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619e1fdf940 con 0x5619e20daa70 2024-09-13T16:08:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.325+0000 7fa82be00640 1 --2- 172.21.15.17:0/2374553405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20daa70 0x5619e20dae70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa8240039f0 tx=0x7fa824003eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39f378bc572a1abb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.326+0000 7fa823e00640 1 --2- 172.21.15.17:0/3865160456 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa8100a1260 0x7fa8100a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.326+0000 7fa820c00640 1 -- 172.21.15.17:0/2374553405 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82401a470 con 0x5619e20daa70 2024-09-13T16:08:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.326+0000 7fa820c00640 1 -- 172.21.15.17:0/2374553405 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa824011900 con 0x5619e20daa70 2024-09-13T16:08:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.326+0000 7fa820c00640 1 -- 172.21.15.17:0/2374553405 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa824010920 con 0x5619e20daa70 2024-09-13T16:08:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.326+0000 7fa823e00640 1 -- 172.21.15.17:0/3865160456 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fa81c0eda30 con 0x7fa82c072f10 2024-09-13T16:08:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.326+0000 7fa82b400640 1 --2- 172.21.15.17:0/3865160456 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa8100a1260 0x7fa8100a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.327+0000 7fa8350c2740 1 -- 172.21.15.17:0/2374553405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20daa70 msgr2=0x5619e20dae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.327+0000 7fa8350c2740 1 --2- 172.21.15.17:0/2374553405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20daa70 0x5619e20dae70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa8240039f0 tx=0x7fa824003eb0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.327+0000 7fa82b400640 1 --2- 172.21.15.17:0/3865160456 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa8100a1260 0x7fa8100a3720 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0ba880 tx=0x7fa81c02a400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.327+0000 7fa8350c2740 1 -- 172.21.15.17:0/2374553405 shutdown_connections 2024-09-13T16:08:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.327+0000 7fa8350c2740 1 --2- 172.21.15.17:0/2374553405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20e0440 0x5619e20e2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.327+0000 7fa8350c2740 1 --2- 172.21.15.17:0/2374553405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619e20db3b0 0x5619e20dfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.327+0000 7fa8350c2740 1 --2- 172.21.15.17:0/2374553405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20daa70 0x5619e20dae70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.327+0000 7fa8350c2740 1 -- 172.21.15.17:0/2374553405 >> 172.21.15.17:0/2374553405 conn(0x5619e20d60e0 msgr2=0x5619e20d64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:35.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.327+0000 7fa8350c2740 1 -- 172.21.15.17:0/2374553405 shutdown_connections 2024-09-13T16:08:35.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.327+0000 7fa8350c2740 1 -- 172.21.15.17:0/2374553405 wait complete. 2024-09-13T16:08:35.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.328+0000 7fa8350c2740 1 -- start start 2024-09-13T16:08:35.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.328+0000 7fa8350c2740 1 Processor -- start 2024-09-13T16:08:35.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.330+0000 7fa8350c2740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619e20daa70 0x5619e20e4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.330+0000 7fa8350c2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20db3b0 0x5619e20e4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.330+0000 7fa8350c2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20e0440 0x5619e20ebc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.330+0000 7fa8350c2740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619e203daf0 con 0x5619e20daa70 2024-09-13T16:08:35.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.330+0000 7fa8350c2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619e1ffbf20 con 0x5619e20db3b0 2024-09-13T16:08:35.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.330+0000 7fa8350c2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619e1ffbbc0 con 0x5619e20e0440 2024-09-13T16:08:35.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.330+0000 7fa8350c2740 10 client.0 _ll_register_callbacks cb 0x5619e202da70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:08:35.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.332+0000 7fa82aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20db3b0 0x5619e20e4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.332+0000 7fa82aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20db3b0 0x5619e20e4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:56684/0 (socket says 172.21.15.17:56684) 2024-09-13T16:08:35.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.332+0000 7fa82aa00640 1 -- 172.21.15.17:0/1308881938 learned_addr learned my addr 172.21.15.17:0/1308881938 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:08:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.332+0000 7fa82aa00640 1 -- 172.21.15.17:0/1308881938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20e0440 msgr2=0x5619e20ebc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.332+0000 7fa82aa00640 1 --2- 172.21.15.17:0/1308881938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20e0440 0x5619e20ebc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.332+0000 7fa82aa00640 1 -- 172.21.15.17:0/1308881938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619e20daa70 msgr2=0x5619e20e4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.332+0000 7fa82aa00640 1 --2- 172.21.15.17:0/1308881938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619e20daa70 0x5619e20e4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.332+0000 7fa82aa00640 1 -- 172.21.15.17:0/1308881938 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa824009c90 con 0x5619e20db3b0 2024-09-13T16:08:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.333+0000 7fa82aa00640 1 --2- 172.21.15.17:0/1308881938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20db3b0 0x5619e20e4c40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa818012750 tx=0x7fa818012c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=757c5d06998ef822 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.333+0000 7fa815600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:08:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.333+0000 7fa815600640 1 -- 172.21.15.17:0/1308881938 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa818017070 con 0x5619e20db3b0 2024-09-13T16:08:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.333+0000 7fa815600640 1 -- 172.21.15.17:0/1308881938 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fa818004050 con 0x5619e20db3b0 2024-09-13T16:08:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.334+0000 7fa8350c2740 1 -- 172.21.15.17:0/1308881938 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5619e2067c90 con 0x5619e20db3b0 2024-09-13T16:08:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.334+0000 7fa815600640 1 -- 172.21.15.17:0/1308881938 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa818004210 con 0x5619e20db3b0 2024-09-13T16:08:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.334+0000 7fa8350c2740 10 client.26153 fetch_fsmap learned FSMap version 45 2024-09-13T16:08:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.334+0000 7fa8350c2740 1 -- 172.21.15.17:0/1308881938 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5619e203c170 con 0x5619e20db3b0 2024-09-13T16:08:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.335+0000 7fa815600640 1 -- 172.21.15.17:0/1308881938 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5619e2067c90 con 0x5619e20db3b0 2024-09-13T16:08:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.335+0000 7fa815600640 1 -- 172.21.15.17:0/1308881938 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 45) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fa818003a90 con 0x5619e20db3b0 2024-09-13T16:08:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.335+0000 7fa8350c2740 10 client.26153 fetch_fsmap finished waiting for FSMap version 45 2024-09-13T16:08:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.335+0000 7fa8350c2740 10 client.26153 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:08:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.335+0000 7fa8350c2740 20 client.26153 populate_metadata read hostname 'smithi017' 2024-09-13T16:08:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.335+0000 7fa8350c2740 1 --2- 172.21.15.17:0/1308881938 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5619e20f0480 0x5619e20f28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.335+0000 7fa8350c2740 4 client.26153 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:08:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.335+0000 7fa8350c2740 1 -- 172.21.15.17:0/1308881938 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5619e20307d0 con 0x5619e20f0480 2024-09-13T16:08:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.336+0000 7fa82be00640 1 --2- 172.21.15.17:0/1308881938 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5619e20f0480 0x5619e20f28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.336+0000 7fa82be00640 1 --2- 172.21.15.17:0/1308881938 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5619e20f0480 0x5619e20f28a0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fc0ed8627514113 server_cookie=4b3e8defc2b7e982 in_seq=0 out_seq=0 2024-09-13T16:08:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.336+0000 7fa815600640 10 client.26153 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:08:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.337+0000 7fa815600640 1 -- 172.21.15.17:0/1308881938 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5619e20307d0 con 0x5619e20f0480 2024-09-13T16:08:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.337+0000 7fa815600640 10 client.26153 handle_command_reply: tid=0 2024-09-13T16:08:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.337+0000 7fa8350c2740 1 client.26153 shutdown 2024-09-13T16:08:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.337+0000 7fa8350c2740 1 -- 172.21.15.17:0/1308881938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20db3b0 msgr2=0x5619e20e4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.337+0000 7fa8350c2740 1 --2- 172.21.15.17:0/1308881938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20db3b0 0x5619e20e4c40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa818012750 tx=0x7fa818012c10 comp rx=0 tx=0).stop 2024-09-13T16:08:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.337+0000 7fa8350c2740 1 -- 172.21.15.17:0/1308881938 shutdown_connections 2024-09-13T16:08:35.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.337+0000 7fa8350c2740 1 --2- 172.21.15.17:0/1308881938 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5619e20f0480 0x5619e20f28a0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.337+0000 7fa8350c2740 1 --2- 172.21.15.17:0/1308881938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20e0440 0x5619e20ebc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.337+0000 7fa8350c2740 1 --2- 172.21.15.17:0/1308881938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20db3b0 0x5619e20e4c40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.337+0000 7fa8350c2740 1 --2- 172.21.15.17:0/1308881938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619e20daa70 0x5619e20e4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.337+0000 7fa8350c2740 1 -- 172.21.15.17:0/1308881938 >> 172.21.15.17:0/1308881938 conn(0x5619e20d60e0 msgr2=0x5619e20d78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:35.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.337+0000 7fa815600640 0 client.26153 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:08:35.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.337+0000 7fa8350c2740 1 -- 172.21.15.17:0/1308881938 shutdown_connections 2024-09-13T16:08:35.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.338+0000 7fa8350c2740 1 -- 172.21.15.17:0/1308881938 wait complete. 2024-09-13T16:08:35.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.338+0000 7fa8350c2740 20 client.26153 trim_cache size 0 max 16384 2024-09-13T16:08:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.362+0000 7fa8350c2740 1 Processor -- start 2024-09-13T16:08:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.363+0000 7fa8350c2740 1 -- start start 2024-09-13T16:08:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.363+0000 7fa8350c2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20daa70 0x5619e20dc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.364+0000 7fa8350c2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20e0440 0x5619e20dc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.364+0000 7fa82be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20daa70 0x5619e20dc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.364+0000 7fa8350c2740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619e20ebc40 0x5619e20e46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.364+0000 7fa8350c2740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619e1da4e60 con 0x5619e20ebc40 2024-09-13T16:08:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.364+0000 7fa8350c2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619e20da5f0 con 0x5619e20e0440 2024-09-13T16:08:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.364+0000 7fa8350c2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619e20e5370 con 0x5619e20daa70 2024-09-13T16:08:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.364+0000 7fa82be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20daa70 0x5619e20dc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:41010/0 (socket says 172.21.15.17:41010) 2024-09-13T16:08:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.364+0000 7fa82be00640 1 -- 172.21.15.17:0/1502643481 learned_addr learned my addr 172.21.15.17:0/1502643481 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:08:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.366+0000 7fa82be00640 1 --2- 172.21.15.17:0/1502643481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619e20ebc40 0x5619e20e46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.366+0000 7fa82aa00640 1 --2- 172.21.15.17:0/1502643481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20e0440 0x5619e20dc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.366+0000 7fa82be00640 1 -- 172.21.15.17:0/1502643481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20e0440 msgr2=0x5619e20dc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.366+0000 7fa82be00640 1 --2- 172.21.15.17:0/1502643481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20e0440 0x5619e20dc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.366+0000 7fa82be00640 1 -- 172.21.15.17:0/1502643481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619e20ebc40 msgr2=0x5619e20e46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.366+0000 7fa82be00640 1 --2- 172.21.15.17:0/1502643481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619e20ebc40 0x5619e20e46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.366+0000 7fa82be00640 1 -- 172.21.15.17:0/1502643481 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619e1fde180 con 0x5619e20daa70 2024-09-13T16:08:35.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.368+0000 7fa82be00640 1 --2- 172.21.15.17:0/1502643481 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20daa70 0x5619e20dc310 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa8240039f0 tx=0x7fa824009950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a2192d09bd77b00 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.369+0000 7fa821600640 1 -- 172.21.15.17:0/1502643481 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82402d070 con 0x5619e20daa70 2024-09-13T16:08:35.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.369+0000 7fa821600640 1 -- 172.21.15.17:0/1502643481 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa824011c10 con 0x5619e20daa70 2024-09-13T16:08:35.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.369+0000 7fa821600640 1 -- 172.21.15.17:0/1502643481 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82401e040 con 0x5619e20daa70 2024-09-13T16:08:35.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.371+0000 7fa8350c2740 1 -- 172.21.15.17:0/1502643481 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20daa70 msgr2=0x5619e20dc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.371+0000 7fa8350c2740 1 --2- 172.21.15.17:0/1502643481 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20daa70 0x5619e20dc310 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa8240039f0 tx=0x7fa824009950 comp rx=0 tx=0).stop 2024-09-13T16:08:35.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.371+0000 7fa8350c2740 1 -- 172.21.15.17:0/1502643481 shutdown_connections 2024-09-13T16:08:35.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.371+0000 7fa8350c2740 1 --2- 172.21.15.17:0/1502643481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619e20ebc40 0x5619e20e46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.371+0000 7fa8350c2740 1 --2- 172.21.15.17:0/1502643481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20e0440 0x5619e20dc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.371+0000 7fa8350c2740 1 --2- 172.21.15.17:0/1502643481 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20daa70 0x5619e20dc310 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.371+0000 7fa8350c2740 1 -- 172.21.15.17:0/1502643481 >> 172.21.15.17:0/1502643481 conn(0x5619e20d60e0 msgr2=0x5619e20df8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:35.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.371+0000 7fa8350c2740 1 -- 172.21.15.17:0/1502643481 shutdown_connections 2024-09-13T16:08:35.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.372+0000 7fa8350c2740 1 -- 172.21.15.17:0/1502643481 wait complete. 2024-09-13T16:08:35.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.372+0000 7fa8350c2740 1 -- start start 2024-09-13T16:08:35.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.372+0000 7fa8350c2740 1 Processor -- start 2024-09-13T16:08:35.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.373+0000 7fa8350c2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20daa70 0x5619e20e87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.373+0000 7fa8350c2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20e0440 0x5619e20e8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.373+0000 7fa8350c2740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619e20ebc40 0x5619e20e9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.373+0000 7fa8350c2740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619e20ea1e0 con 0x5619e20ebc40 2024-09-13T16:08:35.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.373+0000 7fa8350c2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619e20ea350 con 0x5619e20e0440 2024-09-13T16:08:35.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.373+0000 7fa8350c2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619e20ea510 con 0x5619e20daa70 2024-09-13T16:08:35.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.373+0000 7fa8350c2740 10 client.0 _ll_register_callbacks cb 0x7fa824009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:08:35.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.374+0000 7fa82be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20daa70 0x5619e20e87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.374+0000 7fa82be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20daa70 0x5619e20e87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:41016/0 (socket says 172.21.15.17:41016) 2024-09-13T16:08:35.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.374+0000 7fa82be00640 1 -- 172.21.15.17:0/105695008 learned_addr learned my addr 172.21.15.17:0/105695008 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:08:35.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.374+0000 7fa82aa00640 1 --2- 172.21.15.17:0/105695008 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20e0440 0x5619e20e8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.375+0000 7fa82be00640 1 -- 172.21.15.17:0/105695008 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20e0440 msgr2=0x5619e20e8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:35.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.375+0000 7fa82be00640 1 --2- 172.21.15.17:0/105695008 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20e0440 0x5619e20e8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.375+0000 7fa82be00640 1 -- 172.21.15.17:0/105695008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619e20ebc40 msgr2=0x5619e20e9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:35.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.375+0000 7fa82be00640 1 --2- 172.21.15.17:0/105695008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619e20ebc40 0x5619e20e9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.375+0000 7fa82be00640 1 -- 172.21.15.17:0/105695008 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5619e1fdf940 con 0x5619e20daa70 2024-09-13T16:08:35.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.377+0000 7fa82be00640 1 --2- 172.21.15.17:0/105695008 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20daa70 0x5619e20e87a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa824005a90 tx=0x7fa8240096a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28e2dbd6e8133e63 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:35.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.377+0000 7fa815600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:08:35.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.382+0000 7fa815600640 1 -- 172.21.15.17:0/105695008 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82401e070 con 0x5619e20daa70 2024-09-13T16:08:35.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.382+0000 7fa815600640 1 -- 172.21.15.17:0/105695008 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fa824011440 con 0x5619e20daa70 2024-09-13T16:08:35.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.382+0000 7fa8350c2740 1 -- 172.21.15.17:0/105695008 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa824011900 con 0x5619e20daa70 2024-09-13T16:08:35.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.385+0000 7fa815600640 1 -- 172.21.15.17:0/105695008 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa82402d040 con 0x5619e20daa70 2024-09-13T16:08:35.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.385+0000 7fa8350c2740 10 client.26179 fetch_fsmap learned FSMap version 45 2024-09-13T16:08:35.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.385+0000 7fa8350c2740 1 -- 172.21.15.17:0/105695008 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5619e2003560 con 0x5619e20daa70 2024-09-13T16:08:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.386+0000 7fa815600640 1 -- 172.21.15.17:0/105695008 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa824011900 con 0x5619e20daa70 2024-09-13T16:08:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.386+0000 7fa815600640 1 -- 172.21.15.17:0/105695008 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 45) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fa824025040 con 0x5619e20daa70 2024-09-13T16:08:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.386+0000 7fa8350c2740 10 client.26179 fetch_fsmap finished waiting for FSMap version 45 2024-09-13T16:08:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.386+0000 7fa8350c2740 10 client.26179 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:08:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.386+0000 7fa8350c2740 20 client.26179 populate_metadata read hostname 'smithi017' 2024-09-13T16:08:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.386+0000 7fa8350c2740 1 --2- 172.21.15.17:0/105695008 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5619e2148980 0x5619e214ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.386+0000 7fa8350c2740 4 client.26179 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:08:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.386+0000 7fa8350c2740 1 -- 172.21.15.17:0/105695008 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5619e1d31300 con 0x5619e2148980 2024-09-13T16:08:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.387+0000 7fa82aa00640 1 --2- 172.21.15.17:0/105695008 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5619e2148980 0x5619e214ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.387+0000 7fa82aa00640 1 --2- 172.21.15.17:0/105695008 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5619e2148980 0x5619e214ada0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df21c4d4c77f59f0 server_cookie=fe1f73538d1e643 in_seq=0 out_seq=0 2024-09-13T16:08:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.387+0000 7fa815600640 10 client.26179 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:08:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.586+0000 7fa815600640 1 -- 172.21.15.17:0/105695008 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5619e1d31300 con 0x5619e2148980 2024-09-13T16:08:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.586+0000 7fa815600640 10 client.26179 handle_command_reply: tid=0 2024-09-13T16:08:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.586+0000 7fa8350c2740 1 client.26179 shutdown 2024-09-13T16:08:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.586+0000 7fa8350c2740 1 -- 172.21.15.17:0/105695008 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20daa70 msgr2=0x5619e20e87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.586+0000 7fa8350c2740 1 --2- 172.21.15.17:0/105695008 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20daa70 0x5619e20e87a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa824005a90 tx=0x7fa8240096a0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.586+0000 7fa8350c2740 1 -- 172.21.15.17:0/105695008 shutdown_connections 2024-09-13T16:08:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.586+0000 7fa8350c2740 1 --2- 172.21.15.17:0/105695008 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5619e2148980 0x5619e214ada0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.586+0000 7fa8350c2740 1 --2- 172.21.15.17:0/105695008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619e20ebc40 0x5619e20e9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.586+0000 7fa8350c2740 1 --2- 172.21.15.17:0/105695008 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5619e20e0440 0x5619e20e8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.586+0000 7fa8350c2740 1 --2- 172.21.15.17:0/105695008 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619e20daa70 0x5619e20e87a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.586+0000 7fa8350c2740 1 -- 172.21.15.17:0/105695008 >> 172.21.15.17:0/105695008 conn(0x5619e20d60e0 msgr2=0x5619e20e46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.586+0000 7fa815600640 0 client.26179 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:08:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.586+0000 7fa8350c2740 1 -- 172.21.15.17:0/105695008 shutdown_connections 2024-09-13T16:08:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.586+0000 7fa8350c2740 1 -- 172.21.15.17:0/105695008 wait complete. 2024-09-13T16:08:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.587+0000 7fa8350c2740 20 client.26179 trim_cache size 0 max 16384 2024-09-13T16:08:35.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:08:35.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:08:35.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:08:35.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:08:35.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.587+0000 7fa832200640 1 -- 172.21.15.17:0/3865160456 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa8100a1260 msgr2=0x7fa8100a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.587+0000 7fa832200640 1 --2- 172.21.15.17:0/3865160456 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa8100a1260 0x7fa8100a3720 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0ba880 tx=0x7fa81c02a400 comp rx=0 tx=0).stop 2024-09-13T16:08:35.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.587+0000 7fa832200640 1 -- 172.21.15.17:0/3865160456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa82c072f10 msgr2=0x7fa82c103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:35.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.587+0000 7fa832200640 1 --2- 172.21.15.17:0/3865160456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa82c072f10 0x7fa82c103040 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0057c0 tx=0x7fa81c005620 comp rx=0 tx=0).stop 2024-09-13T16:08:35.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.588+0000 7fa832200640 1 -- 172.21.15.17:0/3865160456 shutdown_connections 2024-09-13T16:08:35.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.588+0000 7fa832200640 1 --2- 172.21.15.17:0/3865160456 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa8100a1260 0x7fa8100a3720 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.588+0000 7fa832200640 1 --2- 172.21.15.17:0/3865160456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa82c107b90 0x7fa82c0ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.588+0000 7fa832200640 1 --2- 172.21.15.17:0/3865160456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82c0744f0 0x7fa82c103580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.588+0000 7fa832200640 1 --2- 172.21.15.17:0/3865160456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa82c072f10 0x7fa82c103040 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:35.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.588+0000 7fa832200640 1 -- 172.21.15.17:0/3865160456 >> 172.21.15.17:0/3865160456 conn(0x7fa82c0fb4a0 msgr2=0x7fa82c103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:35.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.588+0000 7fa832200640 1 -- 172.21.15.17:0/3865160456 shutdown_connections 2024-09-13T16:08:35.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:35.589+0000 7fa832200640 1 -- 172.21.15.17:0/3865160456 wait complete. 2024-09-13T16:08:36.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:35 smithi189 ceph-mon[34790]: pgmap v710: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.6 MiB/s wr, 454 op/s 2024-09-13T16:08:36.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:35 smithi193 ceph-mon[35248]: pgmap v710: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.6 MiB/s wr, 454 op/s 2024-09-13T16:08:36.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:35 smithi017 ceph-mon[30494]: pgmap v710: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.6 MiB/s wr, 454 op/s 2024-09-13T16:08:38.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:37 smithi189 ceph-mon[34790]: pgmap v711: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.6 MiB/s wr, 526 op/s 2024-09-13T16:08:38.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:37 smithi193 ceph-mon[35248]: pgmap v711: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.6 MiB/s wr, 526 op/s 2024-09-13T16:08:38.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:37 smithi017 ceph-mon[30494]: pgmap v711: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.6 MiB/s wr, 526 op/s 2024-09-13T16:08:40.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:39 smithi189 ceph-mon[34790]: pgmap v712: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.8 MiB/s wr, 502 op/s 2024-09-13T16:08:40.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:39 smithi193 ceph-mon[35248]: pgmap v712: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.8 MiB/s wr, 502 op/s 2024-09-13T16:08:40.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:39 smithi017 ceph-mon[30494]: pgmap v712: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.8 MiB/s wr, 502 op/s 2024-09-13T16:08:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 655.0 s, 569.2 tps, lat 181.341 ms stddev 228.922 2024-09-13T16:08:42.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:41 smithi189 ceph-mon[34790]: pgmap v713: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 549 op/s 2024-09-13T16:08:42.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:41 smithi193 ceph-mon[35248]: pgmap v713: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 549 op/s 2024-09-13T16:08:42.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:41 smithi017 ceph-mon[30494]: pgmap v713: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 549 op/s 2024-09-13T16:08:44.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:43 smithi189 ceph-mon[34790]: pgmap v714: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.6 MiB/s wr, 597 op/s 2024-09-13T16:08:44.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:43 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:08:44.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:43 smithi193 ceph-mon[35248]: pgmap v714: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.6 MiB/s wr, 597 op/s 2024-09-13T16:08:44.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:43 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:08:44.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:43 smithi017 ceph-mon[30494]: pgmap v714: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.6 MiB/s wr, 597 op/s 2024-09-13T16:08:44.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:43 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:08:45.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 660.0 s, 478.8 tps, lat 203.141 ms stddev 211.142 2024-09-13T16:08:46.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:45 smithi189 ceph-mon[34790]: pgmap v715: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 MiB/s wr, 555 op/s 2024-09-13T16:08:46.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:45 smithi193 ceph-mon[35248]: pgmap v715: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 MiB/s wr, 555 op/s 2024-09-13T16:08:46.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:45 smithi017 ceph-mon[30494]: pgmap v715: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 MiB/s wr, 555 op/s 2024-09-13T16:08:48.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:47 smithi193 ceph-mon[35248]: pgmap v716: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 MiB/s wr, 615 op/s 2024-09-13T16:08:48.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:47 smithi017 ceph-mon[30494]: pgmap v716: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 MiB/s wr, 615 op/s 2024-09-13T16:08:48.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:47 smithi189 ceph-mon[34790]: pgmap v716: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 MiB/s wr, 615 op/s 2024-09-13T16:08:48.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.832+0000 7f87a8000640 1 -- 172.21.15.17:0/374247222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87a0107be0 msgr2=0x7f87a010a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.832+0000 7f87a8000640 1 --2- 172.21.15.17:0/374247222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87a0107be0 0x7f87a010a0a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8798009ca0 tx=0x7f879802a950 comp rx=0 tx=0).stop 2024-09-13T16:08:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.833+0000 7f87a8000640 1 -- 172.21.15.17:0/374247222 shutdown_connections 2024-09-13T16:08:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.833+0000 7f87a8000640 1 --2- 172.21.15.17:0/374247222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87a0107be0 0x7f87a010a0a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.833+0000 7f87a8000640 1 --2- 172.21.15.17:0/374247222 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87a0072eb0 0x7f87a0073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.833+0000 7f87a8000640 1 --2- 172.21.15.17:0/374247222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87a0074490 0x7f87a00728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.833+0000 7f87a8000640 1 -- 172.21.15.17:0/374247222 >> 172.21.15.17:0/374247222 conn(0x7f87a00fb4b0 msgr2=0x7f87a00fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.835+0000 7f87a8000640 1 -- 172.21.15.17:0/374247222 shutdown_connections 2024-09-13T16:08:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.835+0000 7f87a8000640 1 -- 172.21.15.17:0/374247222 wait complete. 2024-09-13T16:08:48.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.837+0000 7f87a8000640 1 Processor -- start 2024-09-13T16:08:48.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.837+0000 7f87a8000640 1 -- start start 2024-09-13T16:08:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.838+0000 7f87a8000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87a0072eb0 0x7f87a0193a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.839+0000 7f87a8000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87a0074490 0x7f87a0193fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.839+0000 7f87a8000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87a0107be0 0x7f87a019b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.839+0000 7f87a8000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a019b550 con 0x7f87a0107be0 2024-09-13T16:08:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.839+0000 7f87a8000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a019b6c0 con 0x7f87a0072eb0 2024-09-13T16:08:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.839+0000 7f87a8000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a01ac8d0 con 0x7f87a0074490 2024-09-13T16:08:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.839+0000 7f87a5600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87a0072eb0 0x7f87a0193a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.839+0000 7f87a5600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87a0072eb0 0x7f87a0193a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:58282/0 (socket says 172.21.15.17:58282) 2024-09-13T16:08:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.839+0000 7f87a5600640 1 -- 172.21.15.17:0/3231804083 learned_addr learned my addr 172.21.15.17:0/3231804083 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:08:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.840+0000 7f87a4c00640 1 --2- 172.21.15.17:0/3231804083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87a0074490 0x7f87a0193fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.840+0000 7f87a6000640 1 --2- 172.21.15.17:0/3231804083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87a0107be0 0x7f87a019b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.840+0000 7f87a5600640 1 -- 172.21.15.17:0/3231804083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87a0074490 msgr2=0x7f87a0193fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.840+0000 7f87a5600640 1 --2- 172.21.15.17:0/3231804083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87a0074490 0x7f87a0193fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.840+0000 7f87a5600640 1 -- 172.21.15.17:0/3231804083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87a0107be0 msgr2=0x7f87a019b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.841+0000 7f87a5600640 1 --2- 172.21.15.17:0/3231804083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87a0107be0 0x7f87a019b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.841+0000 7f87a5600640 1 -- 172.21.15.17:0/3231804083 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8798009900 con 0x7f87a0072eb0 2024-09-13T16:08:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.841+0000 7f87a5600640 1 --2- 172.21.15.17:0/3231804083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87a0072eb0 0x7f87a0193a60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f879400c950 tx=0x7f879400ce10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.842+0000 7f879e000640 1 -- 172.21.15.17:0/3231804083 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8794007c70 con 0x7f87a0072eb0 2024-09-13T16:08:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.842+0000 7f87a6000640 1 --2- 172.21.15.17:0/3231804083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87a0107be0 0x7f87a019b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:08:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.842+0000 7f879e000640 1 -- 172.21.15.17:0/3231804083 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8794007dd0 con 0x7f87a0072eb0 2024-09-13T16:08:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.842+0000 7f879e000640 1 -- 172.21.15.17:0/3231804083 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8794018840 con 0x7f87a0072eb0 2024-09-13T16:08:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.842+0000 7f87a8000640 1 -- 172.21.15.17:0/3231804083 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a01acb80 con 0x7f87a0072eb0 2024-09-13T16:08:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.842+0000 7f87a8000640 1 -- 172.21.15.17:0/3231804083 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a01ad040 con 0x7f87a0072eb0 2024-09-13T16:08:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.852+0000 7f87aae32740 1 Processor -- start 2024-09-13T16:08:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.852+0000 7f879e000640 1 -- 172.21.15.17:0/3231804083 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f87940189a0 con 0x7f87a0072eb0 2024-09-13T16:08:48.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.854+0000 7f87aae32740 1 -- start start 2024-09-13T16:08:48.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.854+0000 7f87aae32740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558157964a70 0x558157964e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:48.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.854+0000 7f87aae32740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581579653b0 0x558157969e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:48.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.854+0000 7f87aae32740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55815796a440 0x55815796c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:48.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.854+0000 7f87aae32740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558157870bb0 con 0x558157964a70 2024-09-13T16:08:48.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.854+0000 7f87aae32740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581578cea70 con 0x5581579653b0 2024-09-13T16:08:48.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.854+0000 7f87aae32740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581578cc200 con 0x55815796a440 2024-09-13T16:08:48.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.855+0000 7f87a4c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55815796a440 0x55815796c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.855+0000 7f87a5600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581579653b0 0x558157969e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.855+0000 7f87a4c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55815796a440 0x55815796c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:33186/0 (socket says 172.21.15.17:33186) 2024-09-13T16:08:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.855+0000 7f87a4c00640 1 -- 172.21.15.17:0/3079398020 learned_addr learned my addr 172.21.15.17:0/3079398020 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:08:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.855+0000 7f87a6000640 1 --2- 172.21.15.17:0/3079398020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558157964a70 0x558157964e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.856+0000 7f87a4c00640 1 -- 172.21.15.17:0/3079398020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581579653b0 msgr2=0x558157969e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.856+0000 7f87a4c00640 1 --2- 172.21.15.17:0/3079398020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581579653b0 0x558157969e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.856+0000 7f87a4c00640 1 -- 172.21.15.17:0/3079398020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558157964a70 msgr2=0x558157964e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.856+0000 7f87a4c00640 1 --2- 172.21.15.17:0/3079398020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558157964a70 0x558157964e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.856+0000 7f87a4c00640 1 -- 172.21.15.17:0/3079398020 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558157869940 con 0x55815796a440 2024-09-13T16:08:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.856+0000 7f879e000640 1 --2- 172.21.15.17:0/3231804083 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f87880a1110 0x7f87880a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.856+0000 7f879e000640 1 -- 172.21.15.17:0/3231804083 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f87940cce00 con 0x7f87a0072eb0 2024-09-13T16:08:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.857+0000 7f87a4c00640 1 --2- 172.21.15.17:0/3079398020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55815796a440 0x55815796c900 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f878c009b60 tx=0x7f878c00e6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=151b52f59559f2c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.857+0000 7f87a6000640 1 --2- 172.21.15.17:0/3231804083 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f87880a1110 0x7f87880a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.859+0000 7f8792a00640 1 -- 172.21.15.17:0/3079398020 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c009e50 con 0x55815796a440 2024-09-13T16:08:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.859+0000 7f8792a00640 1 -- 172.21.15.17:0/3079398020 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f878c0054e0 con 0x55815796a440 2024-09-13T16:08:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.859+0000 7f8792a00640 1 -- 172.21.15.17:0/3079398020 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c0116d0 con 0x55815796a440 2024-09-13T16:08:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.862+0000 7f87aae32740 1 -- 172.21.15.17:0/3079398020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55815796a440 msgr2=0x55815796c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.862+0000 7f87aae32740 1 --2- 172.21.15.17:0/3079398020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55815796a440 0x55815796c900 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f878c009b60 tx=0x7f878c00e6c0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.861+0000 7f87a6000640 1 --2- 172.21.15.17:0/3231804083 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f87880a1110 0x7f87880a35d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8798006010 tx=0x7f879802f9b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.862+0000 7f87aae32740 1 -- 172.21.15.17:0/3079398020 shutdown_connections 2024-09-13T16:08:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.862+0000 7f87aae32740 1 --2- 172.21.15.17:0/3079398020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55815796a440 0x55815796c900 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.862+0000 7f87aae32740 1 --2- 172.21.15.17:0/3079398020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581579653b0 0x558157969e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.862+0000 7f87aae32740 1 --2- 172.21.15.17:0/3079398020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558157964a70 0x558157964e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.862+0000 7f87aae32740 1 -- 172.21.15.17:0/3079398020 >> 172.21.15.17:0/3079398020 conn(0x5581579600e0 msgr2=0x5581579604e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.862+0000 7f87aae32740 1 -- 172.21.15.17:0/3079398020 shutdown_connections 2024-09-13T16:08:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.863+0000 7f87aae32740 1 -- 172.21.15.17:0/3079398020 wait complete. 2024-09-13T16:08:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.863+0000 7f87aae32740 1 -- start start 2024-09-13T16:08:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.863+0000 7f87aae32740 1 Processor -- start 2024-09-13T16:08:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.865+0000 7f87aae32740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558157964a70 0x55815796e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.865+0000 7f87aae32740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581579653b0 0x55815796ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.865+0000 7f87a5600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558157964a70 0x55815796e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.865+0000 7f87aae32740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55815796a440 0x558157975c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.866+0000 7f87a6000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55815796a440 0x558157975c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.866+0000 7f87a6000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55815796a440 0x558157975c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:33196/0 (socket says 172.21.15.17:33196) 2024-09-13T16:08:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.866+0000 7f87a6000640 1 -- 172.21.15.17:0/3869832988 learned_addr learned my addr 172.21.15.17:0/3869832988 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:08:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.866+0000 7f87aae32740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581578c7af0 con 0x5581579653b0 2024-09-13T16:08:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.866+0000 7f87aae32740 1 -- 172.21.15.17:0/3869832988 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x558157885f20 con 0x558157964a70 2024-09-13T16:08:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.867+0000 7f87aae32740 1 -- 172.21.15.17:0/3869832988 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x558157885bc0 con 0x55815796a440 2024-09-13T16:08:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.867+0000 7f87aae32740 10 client.0 _ll_register_callbacks cb 0x5581578b7a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:08:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.867+0000 7f87a4c00640 1 --2- 172.21.15.17:0/3869832988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581579653b0 0x55815796ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.868+0000 7f87a6000640 1 -- 172.21.15.17:0/3869832988 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558157964a70 msgr2=0x55815796e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.868+0000 7f87a6000640 1 --2- 172.21.15.17:0/3869832988 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558157964a70 0x55815796e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.868+0000 7f87a6000640 1 -- 172.21.15.17:0/3869832988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581579653b0 msgr2=0x55815796ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.868+0000 7f87a6000640 1 --2- 172.21.15.17:0/3869832988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581579653b0 0x55815796ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.868+0000 7f87a6000640 1 -- 172.21.15.17:0/3869832988 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878c009790 con 0x55815796a440 2024-09-13T16:08:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.868+0000 7f8787400640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:08:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.869+0000 7f87a6000640 1 --2- 172.21.15.17:0/3869832988 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55815796a440 0x558157975c20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8798035000 tx=0x7f879802a950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee95a4a10a83c067 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.870+0000 7f8787400640 1 -- 172.21.15.17:0/3869832988 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8798041070 con 0x55815796a440 2024-09-13T16:08:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.871+0000 7f8787400640 1 -- 172.21.15.17:0/3869832988 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f8798030440 con 0x55815796a440 2024-09-13T16:08:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.872+0000 7f87aae32740 1 -- 172.21.15.17:0/3869832988 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5581578f1c90 con 0x55815796a440 2024-09-13T16:08:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.872+0000 7f8787400640 1 -- 172.21.15.17:0/3869832988 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8798030640 con 0x55815796a440 2024-09-13T16:08:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.878+0000 7f87aae32740 10 client.26188 fetch_fsmap learned FSMap version 46 2024-09-13T16:08:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.878+0000 7f87aae32740 1 -- 172.21.15.17:0/3869832988 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x5581578c6170 con 0x55815796a440 2024-09-13T16:08:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.879+0000 7f8787400640 1 -- 172.21.15.17:0/3869832988 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5581578f1c90 con 0x55815796a440 2024-09-13T16:08:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.879+0000 7f8787400640 1 -- 172.21.15.17:0/3869832988 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 46) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f8798059070 con 0x55815796a440 2024-09-13T16:08:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.879+0000 7f87aae32740 10 client.26188 fetch_fsmap finished waiting for FSMap version 46 2024-09-13T16:08:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.879+0000 7f87aae32740 10 client.26188 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:08:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.879+0000 7f87aae32740 20 client.26188 populate_metadata read hostname 'smithi017' 2024-09-13T16:08:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.879+0000 7f87aae32740 1 --2- 172.21.15.17:0/3869832988 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55815797a2e0 0x55815797c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.879+0000 7f87aae32740 4 client.26188 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:08:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.879+0000 7f87aae32740 1 -- 172.21.15.17:0/3869832988 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5581578ba7d0 con 0x55815797a2e0 2024-09-13T16:08:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.880+0000 7f87a5600640 1 --2- 172.21.15.17:0/3869832988 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55815797a2e0 0x55815797c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:48.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.880+0000 7f8787400640 10 client.26188 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:08:48.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.881+0000 7f87a5600640 1 --2- 172.21.15.17:0/3869832988 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55815797a2e0 0x55815797c700 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8d8c9ed5e02b88b server_cookie=dbe1423cd405ceaa in_seq=0 out_seq=0 2024-09-13T16:08:48.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.882+0000 7f8787400640 1 -- 172.21.15.17:0/3869832988 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5581578ba7d0 con 0x55815797a2e0 2024-09-13T16:08:48.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.882+0000 7f8787400640 10 client.26188 handle_command_reply: tid=0 2024-09-13T16:08:48.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.883+0000 7f87aae32740 1 client.26188 shutdown 2024-09-13T16:08:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.885+0000 7f87aae32740 1 -- 172.21.15.17:0/3869832988 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55815796a440 msgr2=0x558157975c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:48.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.885+0000 7f87aae32740 1 --2- 172.21.15.17:0/3869832988 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55815796a440 0x558157975c20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8798035000 tx=0x7f879802a950 comp rx=0 tx=0).stop 2024-09-13T16:08:48.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.886+0000 7f87aae32740 1 -- 172.21.15.17:0/3869832988 shutdown_connections 2024-09-13T16:08:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.886+0000 7f87aae32740 1 --2- 172.21.15.17:0/3869832988 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55815797a2e0 0x55815797c700 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.886+0000 7f87aae32740 1 --2- 172.21.15.17:0/3869832988 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55815796a440 0x558157975c20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.886+0000 7f87aae32740 1 --2- 172.21.15.17:0/3869832988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581579653b0 0x55815796ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.886+0000 7f87aae32740 1 --2- 172.21.15.17:0/3869832988 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558157964a70 0x55815796e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.886+0000 7f87aae32740 1 -- 172.21.15.17:0/3869832988 >> 172.21.15.17:0/3869832988 conn(0x5581579600e0 msgr2=0x5581579618f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.886+0000 7f8787400640 0 client.26188 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:08:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.886+0000 7f87aae32740 1 -- 172.21.15.17:0/3869832988 shutdown_connections 2024-09-13T16:08:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.886+0000 7f87aae32740 1 -- 172.21.15.17:0/3869832988 wait complete. 2024-09-13T16:08:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.887+0000 7f87aae32740 20 client.26188 trim_cache size 0 max 16384 2024-09-13T16:08:48.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.952+0000 7f87aae32740 1 Processor -- start 2024-09-13T16:08:48.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.953+0000 7f87aae32740 1 -- start start 2024-09-13T16:08:48.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.953+0000 7f87aae32740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558157964a70 0x558157969830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:48.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.953+0000 7f87aae32740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581579653b0 0x558157975be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:48.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.953+0000 7f87aae32740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55815796a440 0x558157969d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:48.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.953+0000 7f87aae32740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55815762ee60 con 0x5581579653b0 2024-09-13T16:08:48.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.953+0000 7f87aae32740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x558157965890 con 0x55815796a440 2024-09-13T16:08:48.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.953+0000 7f87aae32740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581579694b0 con 0x558157964a70 2024-09-13T16:08:48.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.953+0000 7f87a4c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581579653b0 0x558157975be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.953+0000 7f87a4c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581579653b0 0x558157975be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35012/0 (socket says 172.21.15.17:35012) 2024-09-13T16:08:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.953+0000 7f87a4c00640 1 -- 172.21.15.17:0/2539732138 learned_addr learned my addr 172.21.15.17:0/2539732138 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:08:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.953+0000 7f87a5600640 1 --2- 172.21.15.17:0/2539732138 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558157964a70 0x558157969830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.954+0000 7f87a6000640 1 --2- 172.21.15.17:0/2539732138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55815796a440 0x558157969d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.954+0000 7f87a4c00640 1 -- 172.21.15.17:0/2539732138 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558157964a70 msgr2=0x558157969830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.955+0000 7f87a4c00640 1 --2- 172.21.15.17:0/2539732138 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558157964a70 0x558157969830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.955+0000 7f87a4c00640 1 -- 172.21.15.17:0/2539732138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55815796a440 msgr2=0x558157969d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.955+0000 7f87a4c00640 1 --2- 172.21.15.17:0/2539732138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55815796a440 0x558157969d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.955+0000 7f87a4c00640 1 -- 172.21.15.17:0/2539732138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558157868180 con 0x5581579653b0 2024-09-13T16:08:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.955+0000 7f87a5600640 1 --2- 172.21.15.17:0/2539732138 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558157964a70 0x558157969830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:08:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.956+0000 7f87a4c00640 1 --2- 172.21.15.17:0/2539732138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581579653b0 0x558157975be0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f878c017000 tx=0x7f878c00efa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206167b03437ad63 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.957+0000 7f8793400640 1 -- 172.21.15.17:0/2539732138 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c021040 con 0x5581579653b0 2024-09-13T16:08:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.957+0000 7f8793400640 1 -- 172.21.15.17:0/2539732138 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f878c009e50 con 0x5581579653b0 2024-09-13T16:08:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.957+0000 7f8793400640 1 -- 172.21.15.17:0/2539732138 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c0266e0 con 0x5581579653b0 2024-09-13T16:08:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.958+0000 7f87aae32740 1 -- 172.21.15.17:0/2539732138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581579653b0 msgr2=0x558157975be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.958+0000 7f87aae32740 1 --2- 172.21.15.17:0/2539732138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581579653b0 0x558157975be0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f878c017000 tx=0x7f878c00efa0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.959+0000 7f87aae32740 1 -- 172.21.15.17:0/2539732138 shutdown_connections 2024-09-13T16:08:48.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.959+0000 7f87aae32740 1 --2- 172.21.15.17:0/2539732138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55815796a440 0x558157969d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.959+0000 7f87aae32740 1 --2- 172.21.15.17:0/2539732138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581579653b0 0x558157975be0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.959+0000 7f87aae32740 1 --2- 172.21.15.17:0/2539732138 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558157964a70 0x558157969830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.959+0000 7f87aae32740 1 -- 172.21.15.17:0/2539732138 >> 172.21.15.17:0/2539732138 conn(0x5581579600e0 msgr2=0x55815796e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.959+0000 7f87aae32740 1 -- 172.21.15.17:0/2539732138 shutdown_connections 2024-09-13T16:08:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.959+0000 7f87aae32740 1 -- 172.21.15.17:0/2539732138 wait complete. 2024-09-13T16:08:48.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.960+0000 7f87aae32740 1 -- start start 2024-09-13T16:08:48.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.960+0000 7f87aae32740 1 Processor -- start 2024-09-13T16:08:48.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.963+0000 7f87aae32740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558157964a70 0x5581579726b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:48.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.963+0000 7f87aae32740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581579653b0 0x558157972bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:48.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.963+0000 7f87aae32740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55815796a440 0x5581579d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:48.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.963+0000 7f87aae32740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558157975c10 con 0x55815796a440 2024-09-13T16:08:48.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.963+0000 7f87aae32740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x558157975d80 con 0x5581579653b0 2024-09-13T16:08:48.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.963+0000 7f87aae32740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x558157975f40 con 0x558157964a70 2024-09-13T16:08:48.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.963+0000 7f87aae32740 10 client.0 _ll_register_callbacks cb 0x7f878c009320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:08:48.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.963+0000 7f87a5600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558157964a70 0x5581579726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:48.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.963+0000 7f87a5600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558157964a70 0x5581579726b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:37432/0 (socket says 172.21.15.17:37432) 2024-09-13T16:08:48.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.963+0000 7f87a5600640 1 -- 172.21.15.17:0/2337516117 learned_addr learned my addr 172.21.15.17:0/2337516117 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:08:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.964+0000 7f87a4c00640 1 --2- 172.21.15.17:0/2337516117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581579653b0 0x558157972bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.965+0000 7f87a5600640 1 -- 172.21.15.17:0/2337516117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581579653b0 msgr2=0x558157972bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.965+0000 7f87a5600640 1 --2- 172.21.15.17:0/2337516117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581579653b0 0x558157972bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.965+0000 7f87a5600640 1 -- 172.21.15.17:0/2337516117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55815796a440 msgr2=0x5581579d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:08:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.965+0000 7f87a5600640 1 --2- 172.21.15.17:0/2337516117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55815796a440 0x5581579d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.965+0000 7f87a5600640 1 -- 172.21.15.17:0/2337516117 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558157869940 con 0x558157964a70 2024-09-13T16:08:48.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.965+0000 7f87a4c00640 1 --2- 172.21.15.17:0/2337516117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581579653b0 0x558157972bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:08:48.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.966+0000 7f87a5600640 1 --2- 172.21.15.17:0/2337516117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558157964a70 0x5581579726b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f87940ca920 tx=0x7f8794096350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b8573829eb07f49 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:08:48.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.966+0000 7f8787400640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:08:48.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.966+0000 7f8787400640 1 -- 172.21.15.17:0/2337516117 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879409dd30 con 0x558157964a70 2024-09-13T16:08:48.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.966+0000 7f8787400640 1 -- 172.21.15.17:0/2337516117 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f87940a2380 con 0x558157964a70 2024-09-13T16:08:48.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.966+0000 7f87aae32740 1 -- 172.21.15.17:0/2337516117 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f878c0054e0 con 0x558157964a70 2024-09-13T16:08:48.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.970+0000 7f8787400640 1 -- 172.21.15.17:0/2337516117 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f879400fb10 con 0x558157964a70 2024-09-13T16:08:48.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.971+0000 7f87aae32740 10 client.26191 fetch_fsmap learned FSMap version 46 2024-09-13T16:08:48.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.971+0000 7f87aae32740 1 -- 172.21.15.17:0/2337516117 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x55815788d560 con 0x558157964a70 2024-09-13T16:08:48.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.971+0000 7f8787400640 1 -- 172.21.15.17:0/2337516117 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f878c0054e0 con 0x558157964a70 2024-09-13T16:08:48.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.972+0000 7f8787400640 1 -- 172.21.15.17:0/2337516117 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 46) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f8794016020 con 0x558157964a70 2024-09-13T16:08:48.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.973+0000 7f87aae32740 10 client.26191 fetch_fsmap finished waiting for FSMap version 46 2024-09-13T16:08:48.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.973+0000 7f87aae32740 10 client.26191 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:08:48.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.973+0000 7f87aae32740 20 client.26191 populate_metadata read hostname 'smithi017' 2024-09-13T16:08:48.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.973+0000 7f87aae32740 1 --2- 172.21.15.17:0/2337516117 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5581579d24c0 0x5581579d48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:08:48.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.973+0000 7f87aae32740 4 client.26191 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:08:48.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.973+0000 7f87aae32740 1 -- 172.21.15.17:0/2337516117 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5581575bb300 con 0x5581579d24c0 2024-09-13T16:08:48.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.973+0000 7f87a4c00640 1 --2- 172.21.15.17:0/2337516117 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5581579d24c0 0x5581579d48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:08:48.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.974+0000 7f87a4c00640 1 --2- 172.21.15.17:0/2337516117 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5581579d24c0 0x5581579d48e0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c3a55c642c3268d server_cookie=fdc7f8953006322b in_seq=0 out_seq=0 2024-09-13T16:08:48.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:48.974+0000 7f8787400640 10 client.26191 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:08:49.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.084+0000 7f8787400640 1 -- 172.21.15.17:0/2337516117 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5581575bb300 con 0x5581579d24c0 2024-09-13T16:08:49.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.084+0000 7f8787400640 10 client.26191 handle_command_reply: tid=0 2024-09-13T16:08:49.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.084+0000 7f87aae32740 1 client.26191 shutdown 2024-09-13T16:08:49.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.085+0000 7f87aae32740 1 -- 172.21.15.17:0/2337516117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558157964a70 msgr2=0x5581579726b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:49.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.085+0000 7f87aae32740 1 --2- 172.21.15.17:0/2337516117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558157964a70 0x5581579726b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f87940ca920 tx=0x7f8794096350 comp rx=0 tx=0).stop 2024-09-13T16:08:49.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.086+0000 7f87aae32740 1 -- 172.21.15.17:0/2337516117 shutdown_connections 2024-09-13T16:08:49.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.086+0000 7f87aae32740 1 --2- 172.21.15.17:0/2337516117 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5581579d24c0 0x5581579d48e0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:49.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.086+0000 7f87aae32740 1 --2- 172.21.15.17:0/2337516117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55815796a440 0x5581579d07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:49.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.086+0000 7f87aae32740 1 --2- 172.21.15.17:0/2337516117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581579653b0 0x558157972bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:49.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.086+0000 7f87aae32740 1 --2- 172.21.15.17:0/2337516117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558157964a70 0x5581579726b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:49.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.086+0000 7f87aae32740 1 -- 172.21.15.17:0/2337516117 >> 172.21.15.17:0/2337516117 conn(0x5581579600e0 msgr2=0x5581579661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:49.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.086+0000 7f8787400640 0 client.26191 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:08:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.086+0000 7f87aae32740 1 -- 172.21.15.17:0/2337516117 shutdown_connections 2024-09-13T16:08:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.086+0000 7f87aae32740 1 -- 172.21.15.17:0/2337516117 wait complete. 2024-09-13T16:08:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.087+0000 7f87aae32740 20 client.26191 trim_cache size 0 max 16384 2024-09-13T16:08:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:08:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:08:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:08:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:08:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.088+0000 7f87a8000640 1 -- 172.21.15.17:0/3231804083 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f87880a1110 msgr2=0x7f87880a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.088+0000 7f87a8000640 1 --2- 172.21.15.17:0/3231804083 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f87880a1110 0x7f87880a35d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8798006010 tx=0x7f879802f9b0 comp rx=0 tx=0).stop 2024-09-13T16:08:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.088+0000 7f87a8000640 1 -- 172.21.15.17:0/3231804083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87a0072eb0 msgr2=0x7f87a0193a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:08:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.088+0000 7f87a8000640 1 --2- 172.21.15.17:0/3231804083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87a0072eb0 0x7f87a0193a60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f879400c950 tx=0x7f879400ce10 comp rx=0 tx=0).stop 2024-09-13T16:08:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.088+0000 7f87a8000640 1 -- 172.21.15.17:0/3231804083 shutdown_connections 2024-09-13T16:08:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.088+0000 7f87a8000640 1 --2- 172.21.15.17:0/3231804083 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f87880a1110 0x7f87880a35d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.088+0000 7f87a8000640 1 --2- 172.21.15.17:0/3231804083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87a0107be0 0x7f87a019b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.088+0000 7f87a8000640 1 --2- 172.21.15.17:0/3231804083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87a0074490 0x7f87a0193fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.088+0000 7f87a8000640 1 --2- 172.21.15.17:0/3231804083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87a0072eb0 0x7f87a0193a60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:08:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.088+0000 7f87a8000640 1 -- 172.21.15.17:0/3231804083 >> 172.21.15.17:0/3231804083 conn(0x7f87a00fb4b0 msgr2=0x7f87a00ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:08:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.089+0000 7f87a8000640 1 -- 172.21.15.17:0/3231804083 shutdown_connections 2024-09-13T16:08:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:08:49.089+0000 7f87a8000640 1 -- 172.21.15.17:0/3231804083 wait complete. 2024-09-13T16:08:50.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:49 smithi193 ceph-mon[35248]: pgmap v717: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 537 op/s 2024-09-13T16:08:50.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:49 smithi017 ceph-mon[30494]: pgmap v717: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 537 op/s 2024-09-13T16:08:50.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 665.0 s, 576.6 tps, lat 173.259 ms stddev 211.194 2024-09-13T16:08:50.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:49 smithi189 ceph-mon[34790]: pgmap v717: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 537 op/s 2024-09-13T16:08:52.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:51 smithi193 ceph-mon[35248]: pgmap v718: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.1 MiB/s wr, 538 op/s 2024-09-13T16:08:52.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:51 smithi017 ceph-mon[30494]: pgmap v718: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.1 MiB/s wr, 538 op/s 2024-09-13T16:08:52.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:51 smithi189 ceph-mon[34790]: pgmap v718: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.1 MiB/s wr, 538 op/s 2024-09-13T16:08:54.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:53 smithi193 ceph-mon[35248]: pgmap v719: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 636 op/s 2024-09-13T16:08:54.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:53 smithi017 ceph-mon[30494]: pgmap v719: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 636 op/s 2024-09-13T16:08:54.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:53 smithi189 ceph-mon[34790]: pgmap v719: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 636 op/s 2024-09-13T16:08:55.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 670.0 s, 479.6 tps, lat 208.193 ms stddev 300.137 2024-09-13T16:08:56.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:55 smithi193 ceph-mon[35248]: pgmap v720: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.7 MiB/s wr, 683 op/s 2024-09-13T16:08:56.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:55 smithi017 ceph-mon[30494]: pgmap v720: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.7 MiB/s wr, 683 op/s 2024-09-13T16:08:56.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:55 smithi189 ceph-mon[34790]: pgmap v720: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.7 MiB/s wr, 683 op/s 2024-09-13T16:08:58.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:57 smithi193 ceph-mon[35248]: pgmap v721: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 810 op/s 2024-09-13T16:08:58.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:57 smithi017 ceph-mon[30494]: pgmap v721: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 810 op/s 2024-09-13T16:08:58.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:57 smithi189 ceph-mon[34790]: pgmap v721: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 810 op/s 2024-09-13T16:08:59.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:58 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:08:59.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:58 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:08:59.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:58 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:09:00.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:08:59 smithi193 ceph-mon[35248]: pgmap v722: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 796 op/s 2024-09-13T16:09:00.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:08:59 smithi017 ceph-mon[30494]: pgmap v722: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 796 op/s 2024-09-13T16:09:00.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 675.0 s, 541.0 tps, lat 188.281 ms stddev 216.880 2024-09-13T16:09:00.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:08:59 smithi189 ceph-mon[34790]: pgmap v722: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 796 op/s 2024-09-13T16:09:02.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:01 smithi193 ceph-mon[35248]: pgmap v723: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 815 op/s 2024-09-13T16:09:02.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:01 smithi017 ceph-mon[30494]: pgmap v723: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 815 op/s 2024-09-13T16:09:02.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:01 smithi189 ceph-mon[34790]: pgmap v723: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 815 op/s 2024-09-13T16:09:03.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.307+0000 7fc58be00640 1 -- 172.21.15.17:0/157717123 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc58c102f10 msgr2=0x7fc58c105300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:03.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.307+0000 7fc58be00640 1 --2- 172.21.15.17:0/157717123 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc58c102f10 0x7fc58c105300 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc578009900 tx=0x7fc57802a420 comp rx=0 tx=0).stop 2024-09-13T16:09:03.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.307+0000 7fc58be00640 1 -- 172.21.15.17:0/157717123 shutdown_connections 2024-09-13T16:09:03.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.307+0000 7fc58be00640 1 --2- 172.21.15.17:0/157717123 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc58c105920 0x7fc58c107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.307+0000 7fc58be00640 1 --2- 172.21.15.17:0/157717123 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc58c102f10 0x7fc58c105300 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.307+0000 7fc58be00640 1 --2- 172.21.15.17:0/157717123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc58c1005e0 0x7fc58c1029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.307+0000 7fc58be00640 1 -- 172.21.15.17:0/157717123 >> 172.21.15.17:0/157717123 conn(0x7fc58c0fa1c0 msgr2=0x7fc58c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.307+0000 7fc58be00640 1 -- 172.21.15.17:0/157717123 shutdown_connections 2024-09-13T16:09:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.307+0000 7fc58be00640 1 -- 172.21.15.17:0/157717123 wait complete. 2024-09-13T16:09:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.309+0000 7fc58be00640 1 Processor -- start 2024-09-13T16:09:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.309+0000 7fc58be00640 1 -- start start 2024-09-13T16:09:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.311+0000 7fc58be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc58c1005e0 0x7fc58c072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.311+0000 7fc58be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc58c102f10 0x7fc58c06ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.311+0000 7fc58be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc58c105920 0x7fc58c06f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.311+0000 7fc58be00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c1a5f10 con 0x7fc58c105920 2024-09-13T16:09:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.311+0000 7fc58be00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c1a6050 con 0x7fc58c102f10 2024-09-13T16:09:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.311+0000 7fc58be00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c1a6210 con 0x7fc58c1005e0 2024-09-13T16:09:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.312+0000 7fc58a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc58c102f10 0x7fc58c06ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.312+0000 7fc58a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc58c102f10 0x7fc58c06ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:60318/0 (socket says 172.21.15.17:60318) 2024-09-13T16:09:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.312+0000 7fc58a000640 1 -- 172.21.15.17:0/1684665201 learned_addr learned my addr 172.21.15.17:0/1684665201 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.312+0000 7fc58aa00640 1 --2- 172.21.15.17:0/1684665201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc58c1005e0 0x7fc58c072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.312+0000 7fc58a000640 1 -- 172.21.15.17:0/1684665201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc58c1005e0 msgr2=0x7fc58c072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.312+0000 7fc58a000640 1 --2- 172.21.15.17:0/1684665201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc58c1005e0 0x7fc58c072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.312+0000 7fc58a000640 1 -- 172.21.15.17:0/1684665201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc58c105920 msgr2=0x7fc58c06f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:03.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.312+0000 7fc58a000640 1 --2- 172.21.15.17:0/1684665201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc58c105920 0x7fc58c06f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.312+0000 7fc58a000640 1 -- 172.21.15.17:0/1684665201 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc578009560 con 0x7fc58c102f10 2024-09-13T16:09:03.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.313+0000 7fc58a000640 1 --2- 172.21.15.17:0/1684665201 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc58c102f10 0x7fc58c06ebd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc578000c00 tx=0x7fc578003f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:03.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.313+0000 7fc583400640 1 -- 172.21.15.17:0/1684665201 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578032a10 con 0x7fc58c102f10 2024-09-13T16:09:03.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.313+0000 7fc583400640 1 -- 172.21.15.17:0/1684665201 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc578032b70 con 0x7fc58c102f10 2024-09-13T16:09:03.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.313+0000 7fc583400640 1 -- 172.21.15.17:0/1684665201 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57803a620 con 0x7fc58c102f10 2024-09-13T16:09:03.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.313+0000 7fc58be00640 1 -- 172.21.15.17:0/1684665201 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58c0fe3d0 con 0x7fc58c102f10 2024-09-13T16:09:03.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.314+0000 7fc58be00640 1 -- 172.21.15.17:0/1684665201 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58c0fe8b0 con 0x7fc58c102f10 2024-09-13T16:09:03.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.318+0000 7fc583400640 1 -- 172.21.15.17:0/1684665201 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc57803a780 con 0x7fc58c102f10 2024-09-13T16:09:03.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.322+0000 7fc583400640 1 --2- 172.21.15.17:0/1684665201 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc5700a12a0 0x7fc5700a3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.322+0000 7fc583400640 1 -- 172.21.15.17:0/1684665201 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fc5780ee600 con 0x7fc58c102f10 2024-09-13T16:09:03.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.323+0000 7fc58aa00640 1 --2- 172.21.15.17:0/1684665201 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc5700a12a0 0x7fc5700a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:03.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.324+0000 7fc594403740 1 Processor -- start 2024-09-13T16:09:03.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.324+0000 7fc594403740 1 -- start start 2024-09-13T16:09:03.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.324+0000 7fc594403740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557325422c80 0x557325423080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.324+0000 7fc594403740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573254235c0 0x557325428080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.324+0000 7fc594403740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557325428650 0x55732542ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.325+0000 7fc58aa00640 1 --2- 172.21.15.17:0/1684665201 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc5700a12a0 0x7fc5700a3760 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc57c00de30 tx=0x7fc57c00f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:03.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.326+0000 7fc594403740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55732532ebb0 con 0x5573254235c0 2024-09-13T16:09:03.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.326+0000 7fc594403740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55732538ca70 con 0x557325422c80 2024-09-13T16:09:03.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.326+0000 7fc594403740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55732538a200 con 0x557325428650 2024-09-13T16:09:03.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.326+0000 7fc58aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557325422c80 0x557325423080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:03.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.326+0000 7fc58b400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557325428650 0x55732542ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:03.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.326+0000 7fc58b400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557325428650 0x55732542ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:37950/0 (socket says 172.21.15.17:37950) 2024-09-13T16:09:03.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.326+0000 7fc58a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573254235c0 0x557325428080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:03.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.326+0000 7fc58b400640 1 -- 172.21.15.17:0/1924347876 learned_addr learned my addr 172.21.15.17:0/1924347876 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:03.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.327+0000 7fc58b400640 1 -- 172.21.15.17:0/1924347876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557325422c80 msgr2=0x557325423080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:03.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.327+0000 7fc58b400640 1 --2- 172.21.15.17:0/1924347876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557325422c80 0x557325423080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.327+0000 7fc58b400640 1 -- 172.21.15.17:0/1924347876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573254235c0 msgr2=0x557325428080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:03.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.327+0000 7fc58b400640 1 --2- 172.21.15.17:0/1924347876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573254235c0 0x557325428080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.327+0000 7fc58b400640 1 -- 172.21.15.17:0/1924347876 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557325327940 con 0x557325428650 2024-09-13T16:09:03.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.327+0000 7fc58b400640 1 --2- 172.21.15.17:0/1924347876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557325428650 0x55732542ab10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc584009d20 tx=0x7fc58400b420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cfd041a3a3dd315 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:03.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.328+0000 7fc577e00640 1 -- 172.21.15.17:0/1924347876 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58400e070 con 0x557325428650 2024-09-13T16:09:03.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.328+0000 7fc577e00640 1 -- 172.21.15.17:0/1924347876 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc584009850 con 0x557325428650 2024-09-13T16:09:03.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.328+0000 7fc577e00640 1 -- 172.21.15.17:0/1924347876 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc584011700 con 0x557325428650 2024-09-13T16:09:03.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.329+0000 7fc594403740 1 -- 172.21.15.17:0/1924347876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557325428650 msgr2=0x55732542ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:03.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.329+0000 7fc594403740 1 --2- 172.21.15.17:0/1924347876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557325428650 0x55732542ab10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc584009d20 tx=0x7fc58400b420 comp rx=0 tx=0).stop 2024-09-13T16:09:03.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.330+0000 7fc594403740 1 -- 172.21.15.17:0/1924347876 shutdown_connections 2024-09-13T16:09:03.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.330+0000 7fc594403740 1 --2- 172.21.15.17:0/1924347876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557325428650 0x55732542ab10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.330+0000 7fc594403740 1 --2- 172.21.15.17:0/1924347876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573254235c0 0x557325428080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.330+0000 7fc594403740 1 --2- 172.21.15.17:0/1924347876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557325422c80 0x557325423080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.330+0000 7fc594403740 1 -- 172.21.15.17:0/1924347876 >> 172.21.15.17:0/1924347876 conn(0x55732541e2f0 msgr2=0x55732541e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:03.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.330+0000 7fc594403740 1 -- 172.21.15.17:0/1924347876 shutdown_connections 2024-09-13T16:09:03.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.330+0000 7fc594403740 1 -- 172.21.15.17:0/1924347876 wait complete. 2024-09-13T16:09:03.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.331+0000 7fc594403740 1 -- start start 2024-09-13T16:09:03.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.331+0000 7fc594403740 1 Processor -- start 2024-09-13T16:09:03.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.335+0000 7fc594403740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557325422c80 0x5573254350d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.335+0000 7fc594403740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573254235c0 0x557325435610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.335+0000 7fc594403740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557325428650 0x55732543c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.335+0000 7fc594403740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557325385af0 con 0x557325422c80 2024-09-13T16:09:03.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.335+0000 7fc594403740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x557325343f20 con 0x5573254235c0 2024-09-13T16:09:03.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.335+0000 7fc594403740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x557325343bc0 con 0x557325428650 2024-09-13T16:09:03.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.336+0000 7fc58b400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557325428650 0x55732543c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:03.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.336+0000 7fc58b400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557325428650 0x55732543c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:37958/0 (socket says 172.21.15.17:37958) 2024-09-13T16:09:03.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.336+0000 7fc58b400640 1 -- 172.21.15.17:0/2849014844 learned_addr learned my addr 172.21.15.17:0/2849014844 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:03.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.336+0000 7fc58a000640 1 --2- 172.21.15.17:0/2849014844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573254235c0 0x557325435610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:03.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.336+0000 7fc594403740 10 client.0 _ll_register_callbacks cb 0x557325375a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:09:03.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.336+0000 7fc58aa00640 1 --2- 172.21.15.17:0/2849014844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557325422c80 0x5573254350d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:03.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.336+0000 7fc58b400640 1 -- 172.21.15.17:0/2849014844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573254235c0 msgr2=0x557325435610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:03.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.336+0000 7fc58b400640 1 --2- 172.21.15.17:0/2849014844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573254235c0 0x557325435610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.336+0000 7fc58b400640 1 -- 172.21.15.17:0/2849014844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557325422c80 msgr2=0x5573254350d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:03.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.336+0000 7fc58b400640 1 --2- 172.21.15.17:0/2849014844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557325422c80 0x5573254350d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.336+0000 7fc58b400640 1 -- 172.21.15.17:0/2849014844 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5840099d0 con 0x557325428650 2024-09-13T16:09:03.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.336+0000 7fc594403740 1 -- 172.21.15.17:0/2849014844 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5573253787d0 con 0x557325428650 2024-09-13T16:09:03.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.337+0000 7fc574c00640 10 client.26203 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:09:03.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.337+0000 7fc58b400640 1 --2- 172.21.15.17:0/2849014844 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557325428650 0x55732543c650 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc584012b20 tx=0x7fc584011630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54ae8636c9224e5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:03.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.337+0000 7fc574c00640 1 -- 172.21.15.17:0/2849014844 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58400e040 con 0x557325428650 2024-09-13T16:09:03.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.338+0000 7fc574c00640 1 -- 172.21.15.17:0/2849014844 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fc5840128d0 con 0x557325428650 2024-09-13T16:09:03.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.338+0000 7fc574c00640 1 -- 172.21.15.17:0/2849014844 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc584012c30 con 0x557325428650 2024-09-13T16:09:03.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.338+0000 7fc594403740 10 client.26203 fetch_fsmap learned FSMap version 47 2024-09-13T16:09:03.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.338+0000 7fc594403740 1 -- 172.21.15.17:0/2849014844 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=47}) v3 -- 0x557325384170 con 0x557325428650 2024-09-13T16:09:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.341+0000 7fc574c00640 1 -- 172.21.15.17:0/2849014844 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 47) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc584011b60 con 0x557325428650 2024-09-13T16:09:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.341+0000 7fc594403740 10 client.26203 fetch_fsmap finished waiting for FSMap version 47 2024-09-13T16:09:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.342+0000 7fc594403740 10 client.26203 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:09:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.342+0000 7fc594403740 20 client.26203 populate_metadata read hostname 'smithi017' 2024-09-13T16:09:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.342+0000 7fc594403740 1 --2- 172.21.15.17:0/2849014844 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557325440ac0 0x557325442eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.342+0000 7fc594403740 4 client.26203 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:09:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.342+0000 7fc594403740 1 -- 172.21.15.17:0/2849014844 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557325079300 con 0x557325440ac0 2024-09-13T16:09:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.342+0000 7fc58aa00640 1 --2- 172.21.15.17:0/2849014844 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557325440ac0 0x557325442eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:03.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.343+0000 7fc58aa00640 1 --2- 172.21.15.17:0/2849014844 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557325440ac0 0x557325442eb0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=838242ef2be9f886 server_cookie=9019046c74812c37 in_seq=0 out_seq=0 2024-09-13T16:09:03.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.344+0000 7fc574c00640 10 client.26203 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:09:03.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.346+0000 7fc574c00640 1 -- 172.21.15.17:0/2849014844 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557325079300 con 0x557325440ac0 2024-09-13T16:09:03.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.346+0000 7fc574c00640 10 client.26203 handle_command_reply: tid=0 2024-09-13T16:09:03.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.346+0000 7fc594403740 1 client.26203 shutdown 2024-09-13T16:09:03.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.346+0000 7fc594403740 1 -- 172.21.15.17:0/2849014844 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557325428650 msgr2=0x55732543c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:03.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.346+0000 7fc594403740 1 --2- 172.21.15.17:0/2849014844 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557325428650 0x55732543c650 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc584012b20 tx=0x7fc584011630 comp rx=0 tx=0).stop 2024-09-13T16:09:03.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.347+0000 7fc594403740 1 -- 172.21.15.17:0/2849014844 shutdown_connections 2024-09-13T16:09:03.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.347+0000 7fc594403740 1 --2- 172.21.15.17:0/2849014844 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557325440ac0 0x557325442eb0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.347+0000 7fc594403740 1 --2- 172.21.15.17:0/2849014844 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557325428650 0x55732543c650 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.347+0000 7fc594403740 1 --2- 172.21.15.17:0/2849014844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573254235c0 0x557325435610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.347+0000 7fc594403740 1 --2- 172.21.15.17:0/2849014844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557325422c80 0x5573254350d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.347+0000 7fc594403740 1 -- 172.21.15.17:0/2849014844 >> 172.21.15.17:0/2849014844 conn(0x55732541e2f0 msgr2=0x55732541fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:03.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.347+0000 7fc574c00640 0 client.26203 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:09:03.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.348+0000 7fc594403740 1 -- 172.21.15.17:0/2849014844 shutdown_connections 2024-09-13T16:09:03.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.348+0000 7fc594403740 1 -- 172.21.15.17:0/2849014844 wait complete. 2024-09-13T16:09:03.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.348+0000 7fc594403740 20 client.26203 trim_cache size 0 max 16384 2024-09-13T16:09:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.381+0000 7fc594403740 1 Processor -- start 2024-09-13T16:09:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.381+0000 7fc594403740 1 -- start start 2024-09-13T16:09:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.382+0000 7fc594403740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557325422c80 0x5573254350d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.382+0000 7fc594403740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573254235c0 0x55732543c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.382+0000 7fc594403740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557325428650 0x557325435610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.382+0000 7fc594403740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55732541e1b0 con 0x557325422c80 2024-09-13T16:09:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.382+0000 7fc594403740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573250ece60 con 0x557325428650 2024-09-13T16:09:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.382+0000 7fc594403740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55732541dc70 con 0x5573254235c0 2024-09-13T16:09:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.383+0000 7fc58a000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573254235c0 0x55732543c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.383+0000 7fc58a000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573254235c0 0x55732543c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:37968/0 (socket says 172.21.15.17:37968) 2024-09-13T16:09:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.383+0000 7fc58a000640 1 -- 172.21.15.17:0/1776814634 learned_addr learned my addr 172.21.15.17:0/1776814634 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.383+0000 7fc58b400640 1 --2- 172.21.15.17:0/1776814634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557325428650 0x557325435610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.384+0000 7fc58aa00640 1 --2- 172.21.15.17:0/1776814634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557325422c80 0x5573254350d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.384+0000 7fc58a000640 1 -- 172.21.15.17:0/1776814634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557325428650 msgr2=0x557325435610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.384+0000 7fc58a000640 1 --2- 172.21.15.17:0/1776814634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557325428650 0x557325435610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.384+0000 7fc58a000640 1 -- 172.21.15.17:0/1776814634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557325422c80 msgr2=0x5573254350d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.384+0000 7fc58a000640 1 --2- 172.21.15.17:0/1776814634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557325422c80 0x5573254350d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.384+0000 7fc58a000640 1 -- 172.21.15.17:0/1776814634 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557325326180 con 0x5573254235c0 2024-09-13T16:09:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.384+0000 7fc58aa00640 1 --2- 172.21.15.17:0/1776814634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557325422c80 0x5573254350d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:09:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.384+0000 7fc58a000640 1 --2- 172.21.15.17:0/1776814634 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573254235c0 0x55732543c610 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc5780bb400 tx=0x7fc57803bc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6de0e6dfd964528 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.385+0000 7fc580c00640 1 -- 172.21.15.17:0/1776814634 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5780bf530 con 0x5573254235c0 2024-09-13T16:09:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.385+0000 7fc580c00640 1 -- 172.21.15.17:0/1776814634 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc5780c3b80 con 0x5573254235c0 2024-09-13T16:09:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.385+0000 7fc580c00640 1 -- 172.21.15.17:0/1776814634 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5780b7e10 con 0x5573254235c0 2024-09-13T16:09:03.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.387+0000 7fc594403740 1 -- 172.21.15.17:0/1776814634 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573254235c0 msgr2=0x55732543c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:03.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.387+0000 7fc594403740 1 --2- 172.21.15.17:0/1776814634 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573254235c0 0x55732543c610 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc5780bb400 tx=0x7fc57803bc50 comp rx=0 tx=0).stop 2024-09-13T16:09:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.388+0000 7fc594403740 1 -- 172.21.15.17:0/1776814634 shutdown_connections 2024-09-13T16:09:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.388+0000 7fc594403740 1 --2- 172.21.15.17:0/1776814634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557325428650 0x557325435610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.388+0000 7fc594403740 1 --2- 172.21.15.17:0/1776814634 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5573254235c0 0x55732543c610 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.388+0000 7fc594403740 1 --2- 172.21.15.17:0/1776814634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557325422c80 0x5573254350d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.388+0000 7fc594403740 1 -- 172.21.15.17:0/1776814634 >> 172.21.15.17:0/1776814634 conn(0x55732541e2f0 msgr2=0x557325427ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.388+0000 7fc594403740 1 -- 172.21.15.17:0/1776814634 shutdown_connections 2024-09-13T16:09:03.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.389+0000 7fc594403740 1 -- 172.21.15.17:0/1776814634 wait complete. 2024-09-13T16:09:03.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.390+0000 7fc594403740 1 -- start start 2024-09-13T16:09:03.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.390+0000 7fc594403740 1 Processor -- start 2024-09-13T16:09:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.392+0000 7fc594403740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557325422c80 0x55732543c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.392+0000 7fc594403740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573254235c0 0x557325438ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.392+0000 7fc594403740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557325428650 0x557325439400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.393+0000 7fc594403740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557325439990 con 0x557325428650 2024-09-13T16:09:03.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.393+0000 7fc594403740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x557325439b00 con 0x5573254235c0 2024-09-13T16:09:03.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.393+0000 7fc594403740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55732542f8e0 con 0x557325422c80 2024-09-13T16:09:03.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.393+0000 7fc594403740 10 client.0 _ll_register_callbacks cb 0x7fc584009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:09:03.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.393+0000 7fc58aa00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557325422c80 0x55732543c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:03.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.393+0000 7fc58a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573254235c0 0x557325438ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:03.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.394+0000 7fc58b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557325428650 0x557325439400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:03.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.394+0000 7fc58b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557325428650 0x557325439400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33180/0 (socket says 172.21.15.17:33180) 2024-09-13T16:09:03.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.394+0000 7fc58b400640 1 -- 172.21.15.17:0/2057688772 learned_addr learned my addr 172.21.15.17:0/2057688772 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:03.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.395+0000 7fc58aa00640 1 -- 172.21.15.17:0/2057688772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573254235c0 msgr2=0x557325438ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:03.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.395+0000 7fc58aa00640 1 --2- 172.21.15.17:0/2057688772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573254235c0 0x557325438ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.395+0000 7fc58aa00640 1 -- 172.21.15.17:0/2057688772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557325428650 msgr2=0x557325439400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:03.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.395+0000 7fc58aa00640 1 --2- 172.21.15.17:0/2057688772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557325428650 0x557325439400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.396+0000 7fc58aa00640 1 -- 172.21.15.17:0/2057688772 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58c0fe8b0 con 0x557325422c80 2024-09-13T16:09:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.397+0000 7fc58aa00640 1 --2- 172.21.15.17:0/2057688772 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557325422c80 0x55732543c380 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5573254437a0 tx=0x7fc57c0047d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df4157f4f8e94150 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.397+0000 7fc574c00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:09:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.397+0000 7fc574c00640 1 -- 172.21.15.17:0/2057688772 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c019e10 con 0x557325422c80 2024-09-13T16:09:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.398+0000 7fc574c00640 1 -- 172.21.15.17:0/2057688772 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fc57c027040 con 0x557325422c80 2024-09-13T16:09:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.398+0000 7fc594403740 1 -- 172.21.15.17:0/2057688772 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5573253afc90 con 0x557325422c80 2024-09-13T16:09:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.398+0000 7fc574c00640 1 -- 172.21.15.17:0/2057688772 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc57c027240 con 0x557325422c80 2024-09-13T16:09:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.399+0000 7fc594403740 10 client.26209 fetch_fsmap learned FSMap version 47 2024-09-13T16:09:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.399+0000 7fc594403740 1 -- 172.21.15.17:0/2057688772 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55732534b560 con 0x557325422c80 2024-09-13T16:09:03.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.399+0000 7fc574c00640 1 -- 172.21.15.17:0/2057688772 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5573253afc90 con 0x557325422c80 2024-09-13T16:09:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.400+0000 7fc574c00640 1 -- 172.21.15.17:0/2057688772 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 47) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc57c030930 con 0x557325422c80 2024-09-13T16:09:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.400+0000 7fc594403740 10 client.26209 fetch_fsmap finished waiting for FSMap version 47 2024-09-13T16:09:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.400+0000 7fc594403740 10 client.26209 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:09:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.400+0000 7fc594403740 20 client.26209 populate_metadata read hostname 'smithi017' 2024-09-13T16:09:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.400+0000 7fc594403740 1 --2- 172.21.15.17:0/2057688772 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557325431260 0x557325433650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.400+0000 7fc594403740 4 client.26209 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:09:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.400+0000 7fc594403740 1 -- 172.21.15.17:0/2057688772 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55732508a600 con 0x557325431260 2024-09-13T16:09:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.401+0000 7fc58a000640 1 --2- 172.21.15.17:0/2057688772 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557325431260 0x557325433650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.406+0000 7fc574c00640 10 client.26209 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:09:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:03.406+0000 7fc58a000640 1 --2- 172.21.15.17:0/2057688772 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557325431260 0x557325433650 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=648c70beee4c0398 server_cookie=8d218c9a76a81078 in_seq=0 out_seq=0 2024-09-13T16:09:04.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:03 smithi193 ceph-mon[35248]: pgmap v724: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 840 op/s 2024-09-13T16:09:04.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:03 smithi017 ceph-mon[30494]: pgmap v724: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 840 op/s 2024-09-13T16:09:04.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:03 smithi189 ceph-mon[34790]: pgmap v724: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 840 op/s 2024-09-13T16:09:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.523+0000 7fc574c00640 1 -- 172.21.15.17:0/2057688772 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55732508a600 con 0x557325431260 2024-09-13T16:09:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.523+0000 7fc574c00640 10 client.26209 handle_command_reply: tid=0 2024-09-13T16:09:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.523+0000 7fc594403740 1 client.26209 shutdown 2024-09-13T16:09:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.524+0000 7fc594403740 1 -- 172.21.15.17:0/2057688772 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557325422c80 msgr2=0x55732543c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.524+0000 7fc594403740 1 --2- 172.21.15.17:0/2057688772 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557325422c80 0x55732543c380 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5573254437a0 tx=0x7fc57c0047d0 comp rx=0 tx=0).stop 2024-09-13T16:09:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.524+0000 7fc594403740 1 -- 172.21.15.17:0/2057688772 shutdown_connections 2024-09-13T16:09:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.524+0000 7fc594403740 1 --2- 172.21.15.17:0/2057688772 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x557325431260 0x557325433650 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.524+0000 7fc594403740 1 --2- 172.21.15.17:0/2057688772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557325428650 0x557325439400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.524+0000 7fc594403740 1 --2- 172.21.15.17:0/2057688772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573254235c0 0x557325438ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.524+0000 7fc594403740 1 --2- 172.21.15.17:0/2057688772 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557325422c80 0x55732543c380 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.524+0000 7fc594403740 1 -- 172.21.15.17:0/2057688772 >> 172.21.15.17:0/2057688772 conn(0x55732541e2f0 msgr2=0x557325435070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.524+0000 7fc574c00640 0 client.26209 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:09:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.524+0000 7fc594403740 1 -- 172.21.15.17:0/2057688772 shutdown_connections 2024-09-13T16:09:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.524+0000 7fc594403740 1 -- 172.21.15.17:0/2057688772 wait complete. 2024-09-13T16:09:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.525+0000 7fc594403740 20 client.26209 trim_cache size 0 max 16384 2024-09-13T16:09:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:09:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:09:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:09:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:09:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.527+0000 7fc58be00640 1 -- 172.21.15.17:0/1684665201 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc5700a12a0 msgr2=0x7fc5700a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.527+0000 7fc58be00640 1 --2- 172.21.15.17:0/1684665201 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc5700a12a0 0x7fc5700a3760 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc57c00de30 tx=0x7fc57c00f040 comp rx=0 tx=0).stop 2024-09-13T16:09:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.527+0000 7fc58be00640 1 -- 172.21.15.17:0/1684665201 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc58c102f10 msgr2=0x7fc58c06ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.527+0000 7fc58be00640 1 --2- 172.21.15.17:0/1684665201 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc58c102f10 0x7fc58c06ebd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc578000c00 tx=0x7fc578003f60 comp rx=0 tx=0).stop 2024-09-13T16:09:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.527+0000 7fc58be00640 1 -- 172.21.15.17:0/1684665201 shutdown_connections 2024-09-13T16:09:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.527+0000 7fc58be00640 1 --2- 172.21.15.17:0/1684665201 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc5700a12a0 0x7fc5700a3760 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:04.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.527+0000 7fc58be00640 1 --2- 172.21.15.17:0/1684665201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc58c105920 0x7fc58c06f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:04.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.527+0000 7fc58be00640 1 --2- 172.21.15.17:0/1684665201 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc58c102f10 0x7fc58c06ebd0 secure :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc578000c00 tx=0x7fc578003f60 comp rx=0 tx=0).stop 2024-09-13T16:09:04.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.527+0000 7fc58be00640 1 --2- 172.21.15.17:0/1684665201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc58c1005e0 0x7fc58c072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:04.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.527+0000 7fc58be00640 1 -- 172.21.15.17:0/1684665201 >> 172.21.15.17:0/1684665201 conn(0x7fc58c0fa1c0 msgr2=0x7fc58c100f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:04.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.527+0000 7fc58be00640 1 -- 172.21.15.17:0/1684665201 shutdown_connections 2024-09-13T16:09:04.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:04.527+0000 7fc58be00640 1 -- 172.21.15.17:0/1684665201 wait complete. 2024-09-13T16:09:05.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 680.0 s, 290.6 tps, lat 342.146 ms stddev 550.442 2024-09-13T16:09:06.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:05 smithi193 ceph-mon[35248]: pgmap v725: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 13 MiB/s wr, 918 op/s 2024-09-13T16:09:06.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:05 smithi017 ceph-mon[30494]: pgmap v725: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 13 MiB/s wr, 918 op/s 2024-09-13T16:09:06.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:05 smithi189 ceph-mon[34790]: pgmap v725: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 13 MiB/s wr, 918 op/s 2024-09-13T16:09:08.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:07 smithi193 ceph-mon[35248]: pgmap v726: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 14 MiB/s wr, 1.05k op/s 2024-09-13T16:09:08.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:07 smithi017 ceph-mon[30494]: pgmap v726: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 14 MiB/s wr, 1.05k op/s 2024-09-13T16:09:08.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:07 smithi189 ceph-mon[34790]: pgmap v726: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 14 MiB/s wr, 1.05k op/s 2024-09-13T16:09:10.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:09 smithi193 ceph-mon[35248]: pgmap v727: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 15 MiB/s wr, 1.11k op/s 2024-09-13T16:09:10.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:09 smithi017 ceph-mon[30494]: pgmap v727: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 15 MiB/s wr, 1.11k op/s 2024-09-13T16:09:10.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 685.0 s, 498.8 tps, lat 195.720 ms stddev 237.942 2024-09-13T16:09:10.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:09 smithi189 ceph-mon[34790]: pgmap v727: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 15 MiB/s wr, 1.11k op/s 2024-09-13T16:09:12.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:11 smithi193 ceph-mon[35248]: pgmap v728: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 15 MiB/s wr, 1.11k op/s 2024-09-13T16:09:12.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:11 smithi017 ceph-mon[30494]: pgmap v728: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 15 MiB/s wr, 1.11k op/s 2024-09-13T16:09:12.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:11 smithi189 ceph-mon[34790]: pgmap v728: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 15 MiB/s wr, 1.11k op/s 2024-09-13T16:09:14.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:13 smithi193 ceph-mon[35248]: pgmap v729: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 15 MiB/s wr, 1.14k op/s 2024-09-13T16:09:14.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:13 smithi017 ceph-mon[30494]: pgmap v729: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 15 MiB/s wr, 1.14k op/s 2024-09-13T16:09:14.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:13 smithi189 ceph-mon[34790]: pgmap v729: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 15 MiB/s wr, 1.14k op/s 2024-09-13T16:09:15.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 690.0 s, 524.2 tps, lat 189.852 ms stddev 229.553 2024-09-13T16:09:16.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:15 smithi193 ceph-mon[35248]: pgmap v730: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 15 MiB/s wr, 1.12k op/s 2024-09-13T16:09:16.264 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:15 smithi017 ceph-mon[30494]: pgmap v730: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 15 MiB/s wr, 1.12k op/s 2024-09-13T16:09:16.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:15 smithi189 ceph-mon[34790]: pgmap v730: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 15 MiB/s wr, 1.12k op/s 2024-09-13T16:09:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.734+0000 7f273ea00640 1 -- 172.21.15.17:0/2415652559 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2738101700 msgr2=0x7f2738107f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.734+0000 7f273ea00640 1 --2- 172.21.15.17:0/2415652559 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2738101700 0x7f2738107f90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2730009ca0 tx=0x7f273002a8b0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.735+0000 7f273ea00640 1 -- 172.21.15.17:0/2415652559 shutdown_connections 2024-09-13T16:09:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.735+0000 7f273ea00640 1 --2- 172.21.15.17:0/2415652559 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2738101700 0x7f2738107f90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.735+0000 7f273ea00640 1 --2- 172.21.15.17:0/2415652559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2738100d40 0x7f27381011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.735+0000 7f273ea00640 1 --2- 172.21.15.17:0/2415652559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27380ffb50 0x7f27380fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.735+0000 7f273ea00640 1 -- 172.21.15.17:0/2415652559 >> 172.21.15.17:0/2415652559 conn(0x7f27380fb2f0 msgr2=0x7f27380fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.735+0000 7f273ea00640 1 -- 172.21.15.17:0/2415652559 shutdown_connections 2024-09-13T16:09:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.735+0000 7f273ea00640 1 -- 172.21.15.17:0/2415652559 wait complete. 2024-09-13T16:09:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.741+0000 7f273ea00640 1 Processor -- start 2024-09-13T16:09:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.741+0000 7f273ea00640 1 -- start start 2024-09-13T16:09:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.742+0000 7f273ea00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27380ffb50 0x7f273819c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.742+0000 7f273ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2738100d40 0x7f273819c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.742+0000 7f273ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2738101700 0x7f27381a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.742+0000 7f273ea00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27381a3b30 con 0x7f2738100d40 2024-09-13T16:09:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.742+0000 7f273ea00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27381a3ca0 con 0x7f2738101700 2024-09-13T16:09:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.742+0000 7f273ea00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27381a3e60 con 0x7f27380ffb50 2024-09-13T16:09:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.743+0000 7f273e000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2738101700 0x7f27381a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.743+0000 7f273d600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27380ffb50 0x7f273819c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.743+0000 7f273d600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27380ffb50 0x7f273819c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:36290/0 (socket says 172.21.15.17:36290) 2024-09-13T16:09:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.743+0000 7f273d600640 1 -- 172.21.15.17:0/590554065 learned_addr learned my addr 172.21.15.17:0/590554065 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.743+0000 7f273d600640 1 -- 172.21.15.17:0/590554065 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2738101700 msgr2=0x7f27381a35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.743+0000 7f273d600640 1 --2- 172.21.15.17:0/590554065 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2738101700 0x7f27381a35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.743+0000 7f273d600640 1 -- 172.21.15.17:0/590554065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2738100d40 msgr2=0x7f273819c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.743+0000 7f273d600640 1 --2- 172.21.15.17:0/590554065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2738100d40 0x7f273819c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.743+0000 7f273d600640 1 -- 172.21.15.17:0/590554065 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2728009490 con 0x7f27380ffb50 2024-09-13T16:09:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.744+0000 7f273d600640 1 --2- 172.21.15.17:0/590554065 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27380ffb50 0x7f273819c040 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f272800e9c0 tx=0x7f272800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.744+0000 7f2736000640 1 -- 172.21.15.17:0/590554065 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272800cde0 con 0x7f27380ffb50 2024-09-13T16:09:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.745+0000 7f2736000640 1 -- 172.21.15.17:0/590554065 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27280108f0 con 0x7f27380ffb50 2024-09-13T16:09:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.745+0000 7f2736000640 1 -- 172.21.15.17:0/590554065 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27280188c0 con 0x7f27380ffb50 2024-09-13T16:09:17.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.745+0000 7f273ea00640 1 -- 172.21.15.17:0/590554065 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2730009900 con 0x7f27380ffb50 2024-09-13T16:09:17.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.745+0000 7f273ea00640 1 -- 172.21.15.17:0/590554065 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27381a4470 con 0x7f27380ffb50 2024-09-13T16:09:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.751+0000 7f2742e5e740 1 Processor -- start 2024-09-13T16:09:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.751+0000 7f2742e5e740 1 -- start start 2024-09-13T16:09:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.752+0000 7f2742e5e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86dec90 0x5630e86df090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.752+0000 7f2742e5e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630e86df5d0 0x5630e86e4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.752+0000 7f2742e5e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86e4660 0x5630e86e6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.752+0000 7f2742e5e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e85d9bb0 con 0x5630e86df5d0 2024-09-13T16:09:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.752+0000 7f2742e5e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e8637a70 con 0x5630e86e4660 2024-09-13T16:09:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.752+0000 7f2742e5e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e8635200 con 0x5630e86dec90 2024-09-13T16:09:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.753+0000 7f273e000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86dec90 0x5630e86df090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.753+0000 7f273e000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86dec90 0x5630e86df090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:36304/0 (socket says 172.21.15.17:36304) 2024-09-13T16:09:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.753+0000 7f273e000640 1 -- 172.21.15.17:0/3348328202 learned_addr learned my addr 172.21.15.17:0/3348328202 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.755+0000 7f273cc00640 1 --2- 172.21.15.17:0/3348328202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86e4660 0x5630e86e6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.755+0000 7f273cc00640 1 -- 172.21.15.17:0/3348328202 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86dec90 msgr2=0x5630e86df090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.755+0000 7f273cc00640 1 --2- 172.21.15.17:0/3348328202 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86dec90 0x5630e86df090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.755+0000 7f273cc00640 1 -- 172.21.15.17:0/3348328202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630e86df5d0 msgr2=0x5630e86e4090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:09:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.755+0000 7f273cc00640 1 --2- 172.21.15.17:0/3348328202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630e86df5d0 0x5630e86e4090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.755+0000 7f273cc00640 1 -- 172.21.15.17:0/3348328202 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630e85d2940 con 0x5630e86e4660 2024-09-13T16:09:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.756+0000 7f2736000640 1 -- 172.21.15.17:0/590554065 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2728010430 con 0x7f27380ffb50 2024-09-13T16:09:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.758+0000 7f273cc00640 1 --2- 172.21.15.17:0/3348328202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86e4660 0x5630e86e6b20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f272c009b10 tx=0x7f272c00e350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c739b21c1cd52cf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.758+0000 7f2726a00640 1 -- 172.21.15.17:0/3348328202 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c00ed50 con 0x5630e86e4660 2024-09-13T16:09:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.758+0000 7f2726a00640 1 -- 172.21.15.17:0/3348328202 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f272c0044f0 con 0x5630e86e4660 2024-09-13T16:09:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.758+0000 7f2726a00640 1 -- 172.21.15.17:0/3348328202 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c004a00 con 0x5630e86e4660 2024-09-13T16:09:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.758+0000 7f2736000640 1 --2- 172.21.15.17:0/590554065 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f27200a1200 0x7f27200a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.759+0000 7f2736000640 1 -- 172.21.15.17:0/590554065 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f2728014070 con 0x7f27380ffb50 2024-09-13T16:09:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.759+0000 7f2742e5e740 1 -- 172.21.15.17:0/3348328202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86e4660 msgr2=0x5630e86e6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.759+0000 7f2742e5e740 1 --2- 172.21.15.17:0/3348328202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86e4660 0x5630e86e6b20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f272c009b10 tx=0x7f272c00e350 comp rx=0 tx=0).stop 2024-09-13T16:09:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.759+0000 7f2742e5e740 1 -- 172.21.15.17:0/3348328202 shutdown_connections 2024-09-13T16:09:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.759+0000 7f2742e5e740 1 --2- 172.21.15.17:0/3348328202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86e4660 0x5630e86e6b20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.759+0000 7f2742e5e740 1 --2- 172.21.15.17:0/3348328202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630e86df5d0 0x5630e86e4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.759+0000 7f2742e5e740 1 --2- 172.21.15.17:0/3348328202 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86dec90 0x5630e86df090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.759+0000 7f2742e5e740 1 -- 172.21.15.17:0/3348328202 >> 172.21.15.17:0/3348328202 conn(0x5630e86c92f0 msgr2=0x5630e86c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.760+0000 7f2742e5e740 1 -- 172.21.15.17:0/3348328202 shutdown_connections 2024-09-13T16:09:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.760+0000 7f2742e5e740 1 -- 172.21.15.17:0/3348328202 wait complete. 2024-09-13T16:09:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.760+0000 7f273e000640 1 --2- 172.21.15.17:0/590554065 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f27200a1200 0x7f27200a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.760+0000 7f2742e5e740 1 -- start start 2024-09-13T16:09:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.761+0000 7f2742e5e740 1 Processor -- start 2024-09-13T16:09:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.761+0000 7f2742e5e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630e86dec90 0x5630e86cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.761+0000 7f2742e5e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86df5d0 0x5630e86cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.761+0000 7f2742e5e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86e4660 0x5630e86d6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.761+0000 7f2742e5e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e8630af0 con 0x5630e86dec90 2024-09-13T16:09:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.761+0000 7f2742e5e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e85eef20 con 0x5630e86e4660 2024-09-13T16:09:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.761+0000 7f2742e5e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e85eebc0 con 0x5630e86df5d0 2024-09-13T16:09:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.762+0000 7f2742e5e740 10 client.0 _ll_register_callbacks cb 0x5630e8620a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:09:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.762+0000 7f273cc00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86df5d0 0x5630e86cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.762+0000 7f273cc00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86df5d0 0x5630e86cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:36312/0 (socket says 172.21.15.17:36312) 2024-09-13T16:09:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.762+0000 7f273cc00640 1 -- 172.21.15.17:0/3907695328 learned_addr learned my addr 172.21.15.17:0/3907695328 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.764+0000 7f273e000640 1 --2- 172.21.15.17:0/590554065 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f27200a1200 0x7f27200a36c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2730006010 tx=0x7f2730030840 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.765+0000 7f273d600640 1 --2- 172.21.15.17:0/3907695328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630e86dec90 0x5630e86cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.765+0000 7f273e000640 1 --2- 172.21.15.17:0/3907695328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86e4660 0x5630e86d6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.765+0000 7f273cc00640 1 -- 172.21.15.17:0/3907695328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86e4660 msgr2=0x5630e86d6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.765+0000 7f273cc00640 1 --2- 172.21.15.17:0/3907695328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86e4660 0x5630e86d6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.765+0000 7f273cc00640 1 -- 172.21.15.17:0/3907695328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630e86dec90 msgr2=0x5630e86cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.765+0000 7f273cc00640 1 --2- 172.21.15.17:0/3907695328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630e86dec90 0x5630e86cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.765+0000 7f273cc00640 1 -- 172.21.15.17:0/3907695328 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272c0097f0 con 0x5630e86df5d0 2024-09-13T16:09:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.765+0000 7f273cc00640 1 --2- 172.21.15.17:0/3907695328 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86df5d0 0x5630e86cf4e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f272c00a010 tx=0x7f272c00ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb288df1da5fb1b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.766+0000 7f271b400640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:09:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.767+0000 7f271b400640 1 -- 172.21.15.17:0/3907695328 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c01c030 con 0x5630e86df5d0 2024-09-13T16:09:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.767+0000 7f271b400640 1 -- 172.21.15.17:0/3907695328 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f272c014070 con 0x5630e86df5d0 2024-09-13T16:09:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.767+0000 7f2742e5e740 1 -- 172.21.15.17:0/3907695328 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5630e865ac90 con 0x5630e86df5d0 2024-09-13T16:09:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.768+0000 7f271b400640 1 -- 172.21.15.17:0/3907695328 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f272c01f040 con 0x5630e86df5d0 2024-09-13T16:09:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.768+0000 7f2742e5e740 10 client.26221 fetch_fsmap learned FSMap version 47 2024-09-13T16:09:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.768+0000 7f2742e5e740 1 -- 172.21.15.17:0/3907695328 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5630e862f170 con 0x5630e86df5d0 2024-09-13T16:09:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.768+0000 7f271b400640 1 -- 172.21.15.17:0/3907695328 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5630e865ac90 con 0x5630e86df5d0 2024-09-13T16:09:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.768+0000 7f271b400640 1 -- 172.21.15.17:0/3907695328 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 47) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f272c022070 con 0x5630e86df5d0 2024-09-13T16:09:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.768+0000 7f2742e5e740 10 client.26221 fetch_fsmap finished waiting for FSMap version 47 2024-09-13T16:09:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.768+0000 7f2742e5e740 10 client.26221 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:09:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.768+0000 7f2742e5e740 20 client.26221 populate_metadata read hostname 'smithi017' 2024-09-13T16:09:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.768+0000 7f2742e5e740 1 --2- 172.21.15.17:0/3907695328 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5630e86daa50 0x5630e86dce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.768+0000 7f2742e5e740 4 client.26221 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:09:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.768+0000 7f2742e5e740 1 -- 172.21.15.17:0/3907695328 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5630e86237d0 con 0x5630e86daa50 2024-09-13T16:09:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.769+0000 7f273d600640 1 --2- 172.21.15.17:0/3907695328 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5630e86daa50 0x5630e86dce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.770+0000 7f273d600640 1 --2- 172.21.15.17:0/3907695328 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5630e86daa50 0x5630e86dce40 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd8756a82a7a67df server_cookie=d3fcfe16bd2aa196 in_seq=0 out_seq=0 2024-09-13T16:09:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.771+0000 7f271b400640 10 client.26221 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:09:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.771+0000 7f271b400640 1 -- 172.21.15.17:0/3907695328 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5630e86237d0 con 0x5630e86daa50 2024-09-13T16:09:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.771+0000 7f271b400640 10 client.26221 handle_command_reply: tid=0 2024-09-13T16:09:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.771+0000 7f2742e5e740 1 client.26221 shutdown 2024-09-13T16:09:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.772+0000 7f2742e5e740 1 -- 172.21.15.17:0/3907695328 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86df5d0 msgr2=0x5630e86cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.772+0000 7f2742e5e740 1 --2- 172.21.15.17:0/3907695328 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86df5d0 0x5630e86cf4e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f272c00a010 tx=0x7f272c00ee70 comp rx=0 tx=0).stop 2024-09-13T16:09:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.772+0000 7f2742e5e740 1 -- 172.21.15.17:0/3907695328 shutdown_connections 2024-09-13T16:09:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.772+0000 7f2742e5e740 1 --2- 172.21.15.17:0/3907695328 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5630e86daa50 0x5630e86dce40 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.772+0000 7f2742e5e740 1 --2- 172.21.15.17:0/3907695328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86e4660 0x5630e86d6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.772+0000 7f2742e5e740 1 --2- 172.21.15.17:0/3907695328 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86df5d0 0x5630e86cf4e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.772+0000 7f2742e5e740 1 --2- 172.21.15.17:0/3907695328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630e86dec90 0x5630e86cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.772+0000 7f271b400640 0 client.26221 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:09:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.772+0000 7f2742e5e740 1 -- 172.21.15.17:0/3907695328 >> 172.21.15.17:0/3907695328 conn(0x5630e86c92f0 msgr2=0x5630e86cab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:17.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.774+0000 7f2742e5e740 1 -- 172.21.15.17:0/3907695328 shutdown_connections 2024-09-13T16:09:17.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.775+0000 7f2742e5e740 1 -- 172.21.15.17:0/3907695328 wait complete. 2024-09-13T16:09:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.777+0000 7f2742e5e740 20 client.26221 trim_cache size 0 max 16384 2024-09-13T16:09:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.801+0000 7f2742e5e740 1 Processor -- start 2024-09-13T16:09:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.801+0000 7f2742e5e740 1 -- start start 2024-09-13T16:09:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.802+0000 7f2742e5e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86dec90 0x5630e86cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.802+0000 7f2742e5e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86df5d0 0x5630e86cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.802+0000 7f2742e5e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630e86e4660 0x5630e86d64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.802+0000 7f2742e5e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e8397e60 con 0x5630e86e4660 2024-09-13T16:09:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.802+0000 7f2742e5e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e86ceae0 con 0x5630e86df5d0 2024-09-13T16:09:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.802+0000 7f2742e5e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e86e38e0 con 0x5630e86dec90 2024-09-13T16:09:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.803+0000 7f273d600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86dec90 0x5630e86cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.803+0000 7f273d600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86dec90 0x5630e86cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:36320/0 (socket says 172.21.15.17:36320) 2024-09-13T16:09:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.803+0000 7f273d600640 1 -- 172.21.15.17:0/2237264581 learned_addr learned my addr 172.21.15.17:0/2237264581 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.803+0000 7f273e000640 1 --2- 172.21.15.17:0/2237264581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630e86e4660 0x5630e86d64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.803+0000 7f273cc00640 1 --2- 172.21.15.17:0/2237264581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86df5d0 0x5630e86cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.803+0000 7f273d600640 1 -- 172.21.15.17:0/2237264581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86df5d0 msgr2=0x5630e86cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.803+0000 7f273d600640 1 --2- 172.21.15.17:0/2237264581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86df5d0 0x5630e86cf4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.803+0000 7f273d600640 1 -- 172.21.15.17:0/2237264581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630e86e4660 msgr2=0x5630e86d64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.803+0000 7f273d600640 1 --2- 172.21.15.17:0/2237264581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630e86e4660 0x5630e86d64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.803+0000 7f273d600640 1 -- 172.21.15.17:0/2237264581 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630e85d1180 con 0x5630e86dec90 2024-09-13T16:09:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.803+0000 7f273d600640 1 --2- 172.21.15.17:0/2237264581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86dec90 0x5630e86cef80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2728096e80 tx=0x7f272800efb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7299a5be403c225d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.804+0000 7f2727400640 1 -- 172.21.15.17:0/2237264581 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272809ab10 con 0x5630e86dec90 2024-09-13T16:09:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.804+0000 7f2727400640 1 -- 172.21.15.17:0/2237264581 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2728010a60 con 0x5630e86dec90 2024-09-13T16:09:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.804+0000 7f2727400640 1 -- 172.21.15.17:0/2237264581 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27280cabd0 con 0x5630e86dec90 2024-09-13T16:09:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.805+0000 7f2742e5e740 1 -- 172.21.15.17:0/2237264581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86dec90 msgr2=0x5630e86cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.805+0000 7f2742e5e740 1 --2- 172.21.15.17:0/2237264581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86dec90 0x5630e86cef80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2728096e80 tx=0x7f272800efb0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.807+0000 7f2742e5e740 1 -- 172.21.15.17:0/2237264581 shutdown_connections 2024-09-13T16:09:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.807+0000 7f2742e5e740 1 --2- 172.21.15.17:0/2237264581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630e86e4660 0x5630e86d64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.807+0000 7f2742e5e740 1 --2- 172.21.15.17:0/2237264581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86df5d0 0x5630e86cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.807+0000 7f2742e5e740 1 --2- 172.21.15.17:0/2237264581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86dec90 0x5630e86cef80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.807+0000 7f2742e5e740 1 -- 172.21.15.17:0/2237264581 >> 172.21.15.17:0/2237264581 conn(0x5630e86c92f0 msgr2=0x5630e86eb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.807+0000 7f2742e5e740 1 -- 172.21.15.17:0/2237264581 shutdown_connections 2024-09-13T16:09:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.807+0000 7f2742e5e740 1 -- 172.21.15.17:0/2237264581 wait complete. 2024-09-13T16:09:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.808+0000 7f2742e5e740 1 -- start start 2024-09-13T16:09:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.808+0000 7f2742e5e740 1 Processor -- start 2024-09-13T16:09:17.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.809+0000 7f2742e5e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86dec90 0x5630e86d3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:17.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.809+0000 7f2742e5e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630e86df5d0 0x5630e86d41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:17.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.810+0000 7f2742e5e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86e4660 0x5630e86d5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:17.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.810+0000 7f273d600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86dec90 0x5630e86d3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:17.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.810+0000 7f2742e5e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e86d55d0 con 0x5630e86df5d0 2024-09-13T16:09:17.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.810+0000 7f2742e5e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e86d5740 con 0x5630e86dec90 2024-09-13T16:09:17.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.810+0000 7f2742e5e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e86d5900 con 0x5630e86e4660 2024-09-13T16:09:17.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.810+0000 7f2742e5e740 10 client.0 _ll_register_callbacks cb 0x7f272c009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:09:17.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.810+0000 7f273e000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86e4660 0x5630e86d5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:17.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.810+0000 7f273e000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86e4660 0x5630e86d5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:36336/0 (socket says 172.21.15.17:36336) 2024-09-13T16:09:17.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.810+0000 7f273e000640 1 -- 172.21.15.17:0/61008040 learned_addr learned my addr 172.21.15.17:0/61008040 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:17.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.811+0000 7f273cc00640 1 --2- 172.21.15.17:0/61008040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630e86df5d0 0x5630e86d41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:17.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.811+0000 7f273e000640 1 -- 172.21.15.17:0/61008040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86dec90 msgr2=0x5630e86d3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:17.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.810+0000 7f273d600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86dec90 0x5630e86d3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:57530/0 (socket says 172.21.15.17:57530) 2024-09-13T16:09:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.811+0000 7f273e000640 1 --2- 172.21.15.17:0/61008040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86dec90 0x5630e86d3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.811+0000 7f273e000640 1 -- 172.21.15.17:0/61008040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630e86df5d0 msgr2=0x5630e86d41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.811+0000 7f273e000640 1 --2- 172.21.15.17:0/61008040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630e86df5d0 0x5630e86d41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.811+0000 7f273e000640 1 -- 172.21.15.17:0/61008040 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27381a4470 con 0x5630e86e4660 2024-09-13T16:09:17.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.811+0000 7f273cc00640 1 --2- 172.21.15.17:0/61008040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630e86df5d0 0x5630e86d41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:09:17.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.811+0000 7f273d600640 1 --2- 172.21.15.17:0/61008040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86dec90 0x5630e86d3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:09:17.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.812+0000 7f273e000640 1 --2- 172.21.15.17:0/61008040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86e4660 0x5630e86d5090 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2730030b80 tx=0x7f273002a8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f732e6de80f0de4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:17.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.812+0000 7f271b400640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:09:17.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.812+0000 7f271b400640 1 -- 172.21.15.17:0/61008040 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2730063070 con 0x5630e86e4660 2024-09-13T16:09:17.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.812+0000 7f271b400640 1 -- 172.21.15.17:0/61008040 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f2730003c40 con 0x5630e86e4660 2024-09-13T16:09:17.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.812+0000 7f2742e5e740 1 -- 172.21.15.17:0/61008040 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f272c0044f0 con 0x5630e86e4660 2024-09-13T16:09:17.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.815+0000 7f271b400640 1 -- 172.21.15.17:0/61008040 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2730003e00 con 0x5630e86e4660 2024-09-13T16:09:17.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.815+0000 7f2742e5e740 10 client.26227 fetch_fsmap learned FSMap version 47 2024-09-13T16:09:17.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.815+0000 7f2742e5e740 1 -- 172.21.15.17:0/61008040 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5630e85f6560 con 0x5630e86e4660 2024-09-13T16:09:17.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.815+0000 7f271b400640 1 -- 172.21.15.17:0/61008040 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f272c0044f0 con 0x5630e86e4660 2024-09-13T16:09:17.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.816+0000 7f271b400640 1 -- 172.21.15.17:0/61008040 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 47) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f273007e070 con 0x5630e86e4660 2024-09-13T16:09:17.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.816+0000 7f2742e5e740 10 client.26227 fetch_fsmap finished waiting for FSMap version 47 2024-09-13T16:09:17.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.816+0000 7f2742e5e740 10 client.26227 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:09:17.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.816+0000 7f2742e5e740 20 client.26227 populate_metadata read hostname 'smithi017' 2024-09-13T16:09:17.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.816+0000 7f2742e5e740 1 --2- 172.21.15.17:0/61008040 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5630e873b420 0x5630e873d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:17.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.816+0000 7f2742e5e740 4 client.26227 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:09:17.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.816+0000 7f2742e5e740 1 -- 172.21.15.17:0/61008040 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5630e8324300 con 0x5630e873b420 2024-09-13T16:09:17.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.816+0000 7f273d600640 1 --2- 172.21.15.17:0/61008040 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5630e873b420 0x5630e873d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:17.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.818+0000 7f273d600640 1 --2- 172.21.15.17:0/61008040 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5630e873b420 0x5630e873d840 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9329db5175567c8e server_cookie=f260264143625e30 in_seq=0 out_seq=0 2024-09-13T16:09:17.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.818+0000 7f271b400640 10 client.26227 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:09:17.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.843+0000 7f271b400640 1 -- 172.21.15.17:0/61008040 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5630e8324300 con 0x5630e873b420 2024-09-13T16:09:17.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.843+0000 7f271b400640 10 client.26227 handle_command_reply: tid=0 2024-09-13T16:09:17.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.843+0000 7f2742e5e740 1 client.26227 shutdown 2024-09-13T16:09:17.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.844+0000 7f2742e5e740 1 -- 172.21.15.17:0/61008040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86e4660 msgr2=0x5630e86d5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:17.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.844+0000 7f2742e5e740 1 --2- 172.21.15.17:0/61008040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86e4660 0x5630e86d5090 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2730030b80 tx=0x7f273002a8b0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.844+0000 7f2742e5e740 1 -- 172.21.15.17:0/61008040 shutdown_connections 2024-09-13T16:09:17.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.844+0000 7f2742e5e740 1 --2- 172.21.15.17:0/61008040 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5630e873b420 0x5630e873d840 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.844+0000 7f2742e5e740 1 --2- 172.21.15.17:0/61008040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630e86e4660 0x5630e86d5090 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.844+0000 7f2742e5e740 1 --2- 172.21.15.17:0/61008040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630e86df5d0 0x5630e86d41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.844+0000 7f2742e5e740 1 --2- 172.21.15.17:0/61008040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630e86dec90 0x5630e86d3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.844+0000 7f2742e5e740 1 -- 172.21.15.17:0/61008040 >> 172.21.15.17:0/61008040 conn(0x5630e86c92f0 msgr2=0x5630e86cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:17.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.844+0000 7f271b400640 0 client.26227 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:09:17.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.844+0000 7f2742e5e740 1 -- 172.21.15.17:0/61008040 shutdown_connections 2024-09-13T16:09:17.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.844+0000 7f2742e5e740 1 -- 172.21.15.17:0/61008040 wait complete. 2024-09-13T16:09:17.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.847+0000 7f2742e5e740 20 client.26227 trim_cache size 0 max 16384 2024-09-13T16:09:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:09:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:09:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:09:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:09:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.848+0000 7f273ea00640 1 -- 172.21.15.17:0/590554065 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f27200a1200 msgr2=0x7f27200a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.848+0000 7f273ea00640 1 --2- 172.21.15.17:0/590554065 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f27200a1200 0x7f27200a36c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2730006010 tx=0x7f2730030840 comp rx=0 tx=0).stop 2024-09-13T16:09:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.848+0000 7f273ea00640 1 -- 172.21.15.17:0/590554065 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27380ffb50 msgr2=0x7f273819c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.848+0000 7f273ea00640 1 --2- 172.21.15.17:0/590554065 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27380ffb50 0x7f273819c040 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f272800e9c0 tx=0x7f272800ee80 comp rx=0 tx=0).stop 2024-09-13T16:09:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.848+0000 7f273ea00640 1 -- 172.21.15.17:0/590554065 shutdown_connections 2024-09-13T16:09:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.848+0000 7f273ea00640 1 --2- 172.21.15.17:0/590554065 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f27200a1200 0x7f27200a36c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.848+0000 7f273ea00640 1 --2- 172.21.15.17:0/590554065 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2738101700 0x7f27381a35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.848+0000 7f273ea00640 1 --2- 172.21.15.17:0/590554065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2738100d40 0x7f273819c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.848+0000 7f273ea00640 1 --2- 172.21.15.17:0/590554065 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27380ffb50 0x7f273819c040 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.848+0000 7f273ea00640 1 -- 172.21.15.17:0/590554065 >> 172.21.15.17:0/590554065 conn(0x7f27380fb2f0 msgr2=0x7f273810beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.849+0000 7f273ea00640 1 -- 172.21.15.17:0/590554065 shutdown_connections 2024-09-13T16:09:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:17.849+0000 7f273ea00640 1 -- 172.21.15.17:0/590554065 wait complete. 2024-09-13T16:09:18.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:17 smithi193 ceph-mon[35248]: pgmap v731: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 12 MiB/s wr, 912 op/s 2024-09-13T16:09:18.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:17 smithi017 ceph-mon[30494]: pgmap v731: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 12 MiB/s wr, 912 op/s 2024-09-13T16:09:18.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:17 smithi189 ceph-mon[34790]: pgmap v731: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 12 MiB/s wr, 912 op/s 2024-09-13T16:09:20.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 695.0 s, 586.6 tps, lat 177.107 ms stddev 220.181 2024-09-13T16:09:20.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:20 smithi189 ceph-mon[34790]: pgmap v732: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 8.2 MiB/s wr, 675 op/s 2024-09-13T16:09:20.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:20 smithi193 ceph-mon[35248]: pgmap v732: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 8.2 MiB/s wr, 675 op/s 2024-09-13T16:09:20.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:20 smithi017 ceph-mon[30494]: pgmap v732: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 8.2 MiB/s wr, 675 op/s 2024-09-13T16:09:22.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:22 smithi189 ceph-mon[34790]: pgmap v733: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.8 MiB/s wr, 511 op/s 2024-09-13T16:09:22.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:22 smithi193 ceph-mon[35248]: pgmap v733: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.8 MiB/s wr, 511 op/s 2024-09-13T16:09:22.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:22 smithi017 ceph-mon[30494]: pgmap v733: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.8 MiB/s wr, 511 op/s 2024-09-13T16:09:24.314 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:24 smithi017 ceph-mon[30494]: pgmap v734: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.5 MiB/s wr, 514 op/s 2024-09-13T16:09:24.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:24 smithi189 ceph-mon[34790]: pgmap v734: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.5 MiB/s wr, 514 op/s 2024-09-13T16:09:24.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:24 smithi193 ceph-mon[35248]: pgmap v734: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.5 MiB/s wr, 514 op/s 2024-09-13T16:09:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 700.0 s, 762.8 tps, lat 129.902 ms stddev 181.845 2024-09-13T16:09:26.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:26 smithi189 ceph-mon[34790]: pgmap v735: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.2 MiB/s wr, 508 op/s 2024-09-13T16:09:26.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:26 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:09:26.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:26 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:09:26.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:26 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:09:26.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:26 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:09:26.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:26 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:09:26.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:26 smithi193 ceph-mon[35248]: pgmap v735: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.2 MiB/s wr, 508 op/s 2024-09-13T16:09:26.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:26 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:09:26.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:26 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:09:26.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:26 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:09:26.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:26 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:09:26.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:26 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:09:26.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:26 smithi017 ceph-mon[30494]: pgmap v735: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.2 MiB/s wr, 508 op/s 2024-09-13T16:09:26.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:26 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:09:26.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:26 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:09:26.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:26 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:09:26.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:26 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:09:26.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:26 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:09:27.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:27 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:09:27.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:27 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:09:27.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:27 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:09:27.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:27 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:09:27.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:27 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:09:27.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:27 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:09:27.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:27 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:09:27.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:27 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:09:27.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:27 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:09:28.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:28 smithi189 ceph-mon[34790]: pgmap v736: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 6.6 MiB/s wr, 512 op/s 2024-09-13T16:09:28.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:28 smithi193 ceph-mon[35248]: pgmap v736: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 6.6 MiB/s wr, 512 op/s 2024-09-13T16:09:28.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:28 smithi017 ceph-mon[30494]: pgmap v736: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 6.6 MiB/s wr, 512 op/s 2024-09-13T16:09:30.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 705.0 s, 474.8 tps, lat 208.733 ms stddev 252.936 2024-09-13T16:09:30.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:30 smithi189 ceph-mon[34790]: pgmap v737: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6.2 MiB/s wr, 499 op/s 2024-09-13T16:09:30.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:30 smithi193 ceph-mon[35248]: pgmap v737: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6.2 MiB/s wr, 499 op/s 2024-09-13T16:09:30.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:30 smithi017 ceph-mon[30494]: pgmap v737: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6.2 MiB/s wr, 499 op/s 2024-09-13T16:09:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.062+0000 7f7e04e00640 1 -- 172.21.15.17:0/3371126274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e00101d70 msgr2=0x7f7e00102170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.062+0000 7f7e04e00640 1 --2- 172.21.15.17:0/3371126274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e00101d70 0x7f7e00102170 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009900 tx=0x7f7df002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.062+0000 7f7e04e00640 1 -- 172.21.15.17:0/3371126274 shutdown_connections 2024-09-13T16:09:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.062+0000 7f7e04e00640 1 --2- 172.21.15.17:0/3371126274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e00103920 0x7f7e0010a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.062+0000 7f7e04e00640 1 --2- 172.21.15.17:0/3371126274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e00102f60 0x7f7e001033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.062+0000 7f7e04e00640 1 --2- 172.21.15.17:0/3371126274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e00101d70 0x7f7e00102170 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.062+0000 7f7e04e00640 1 -- 172.21.15.17:0/3371126274 >> 172.21.15.17:0/3371126274 conn(0x7f7e000fd4d0 msgr2=0x7f7e000ff910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:31.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.062+0000 7f7e04e00640 1 -- 172.21.15.17:0/3371126274 shutdown_connections 2024-09-13T16:09:31.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.065+0000 7f7e04e00640 1 -- 172.21.15.17:0/3371126274 wait complete. 2024-09-13T16:09:31.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.066+0000 7f7e04e00640 1 Processor -- start 2024-09-13T16:09:31.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.068+0000 7f7e04e00640 1 -- start start 2024-09-13T16:09:31.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.070+0000 7f7e04e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e00101d70 0x7f7e00197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:31.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.070+0000 7f7e04e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e00102f60 0x7f7e00198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:31.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.070+0000 7f7e04e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e00103920 0x7f7e0019f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:31.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.070+0000 7f7e04e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0019f7e0 con 0x7f7e00102f60 2024-09-13T16:09:31.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.070+0000 7f7e04e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0019f950 con 0x7f7e00101d70 2024-09-13T16:09:31.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.070+0000 7f7e04e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0019fb10 con 0x7f7e00103920 2024-09-13T16:09:31.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.071+0000 7f7dff400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e00101d70 0x7f7e00197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:31.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.071+0000 7f7dff400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e00101d70 0x7f7e00197d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:43884/0 (socket says 172.21.15.17:43884) 2024-09-13T16:09:31.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.071+0000 7f7dff400640 1 -- 172.21.15.17:0/3013973070 learned_addr learned my addr 172.21.15.17:0/3013973070 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:31.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.071+0000 7f7dfea00640 1 --2- 172.21.15.17:0/3013973070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e00102f60 0x7f7e00198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:31.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.071+0000 7f7dffe00640 1 --2- 172.21.15.17:0/3013973070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e00103920 0x7f7e0019f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:31.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.071+0000 7f7dff400640 1 -- 172.21.15.17:0/3013973070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e00103920 msgr2=0x7f7e0019f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:31.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.071+0000 7f7dff400640 1 --2- 172.21.15.17:0/3013973070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e00103920 0x7f7e0019f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.071+0000 7f7dff400640 1 -- 172.21.15.17:0/3013973070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e00102f60 msgr2=0x7f7e00198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:31.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.071+0000 7f7dff400640 1 --2- 172.21.15.17:0/3013973070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e00102f60 0x7f7e00198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.071+0000 7f7dff400640 1 -- 172.21.15.17:0/3013973070 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df0009560 con 0x7f7e00101d70 2024-09-13T16:09:31.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.072+0000 7f7dff400640 1 --2- 172.21.15.17:0/3013973070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e00101d70 0x7f7e00197d00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7df0031500 tx=0x7f7df0003d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.073+0000 7f7df7e00640 1 -- 172.21.15.17:0/3013973070 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df00317b0 con 0x7f7e00101d70 2024-09-13T16:09:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.074+0000 7f7df7e00640 1 -- 172.21.15.17:0/3013973070 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7df0031dd0 con 0x7f7e00101d70 2024-09-13T16:09:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.074+0000 7f7df7e00640 1 -- 172.21.15.17:0/3013973070 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df00433c0 con 0x7f7e00101d70 2024-09-13T16:09:31.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.076+0000 7f7e04e00640 1 -- 172.21.15.17:0/3013973070 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0019fd90 con 0x7f7e00101d70 2024-09-13T16:09:31.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.076+0000 7f7e04e00640 1 -- 172.21.15.17:0/3013973070 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e001a01c0 con 0x7f7e00101d70 2024-09-13T16:09:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.080+0000 7f7e09205740 1 Processor -- start 2024-09-13T16:09:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.080+0000 7f7e09205740 1 -- start start 2024-09-13T16:09:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.081+0000 7f7df7e00640 1 -- 172.21.15.17:0/3013973070 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7df0031910 con 0x7f7e00101d70 2024-09-13T16:09:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.082+0000 7f7e09205740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c06cc80 0x56009c06d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.082+0000 7f7e09205740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06d5c0 0x56009c072080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.082+0000 7f7e09205740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56009c072650 0x56009c074b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.082+0000 7f7e09205740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009bf78bb0 con 0x56009c072650 2024-09-13T16:09:31.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.082+0000 7f7e09205740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009bfd6a70 con 0x56009c06d5c0 2024-09-13T16:09:31.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.082+0000 7f7e09205740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009bfd4200 con 0x56009c06cc80 2024-09-13T16:09:31.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.083+0000 7f7df7e00640 1 --2- 172.21.15.17:0/3013973070 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7de40a11b0 0x7f7de40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:31.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.084+0000 7f7dff400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06d5c0 0x56009c072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:31.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.082+0000 7f7dffe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c06cc80 0x56009c06d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:31.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.084+0000 7f7dffe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c06cc80 0x56009c06d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:37692/0 (socket says 172.21.15.17:37692) 2024-09-13T16:09:31.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.084+0000 7f7dffe00640 1 -- 172.21.15.17:0/2845436150 learned_addr learned my addr 172.21.15.17:0/2845436150 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:31.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.084+0000 7f7df7e00640 1 -- 172.21.15.17:0/3013973070 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f7df00edbe0 con 0x7f7e00101d70 2024-09-13T16:09:31.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.084+0000 7f7dfea00640 1 --2- 172.21.15.17:0/2845436150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56009c072650 0x56009c074b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:31.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.084+0000 7f7dffe00640 1 -- 172.21.15.17:0/2845436150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06d5c0 msgr2=0x56009c072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:31.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.084+0000 7f7dffe00640 1 --2- 172.21.15.17:0/2845436150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06d5c0 0x56009c072080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.084+0000 7f7dffe00640 1 -- 172.21.15.17:0/2845436150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56009c072650 msgr2=0x56009c074b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:31.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.084+0000 7f7dffe00640 1 --2- 172.21.15.17:0/2845436150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56009c072650 0x56009c074b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.084+0000 7f7dffe00640 1 -- 172.21.15.17:0/2845436150 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56009bf71940 con 0x56009c06cc80 2024-09-13T16:09:31.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.086+0000 7f7dffe00640 1 --2- 172.21.15.17:0/3013973070 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7de40a11b0 0x7f7de40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:31.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.087+0000 7f7dffe00640 1 --2- 172.21.15.17:0/3013973070 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7de40a11b0 0x7f7de40a3670 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7df8010fd0 tx=0x7f7df8013000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:31.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.089+0000 7f7dffe00640 1 --2- 172.21.15.17:0/2845436150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c06cc80 0x56009c06d080 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7df8007f70 tx=0x7f7df8010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5263a10ecc389672 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:31.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.089+0000 7f7df4c00640 1 -- 172.21.15.17:0/2845436150 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df8012650 con 0x56009c06cc80 2024-09-13T16:09:31.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.090+0000 7f7df4c00640 1 -- 172.21.15.17:0/2845436150 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7df8011cf0 con 0x56009c06cc80 2024-09-13T16:09:31.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.090+0000 7f7df4c00640 1 -- 172.21.15.17:0/2845436150 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df801ad50 con 0x56009c06cc80 2024-09-13T16:09:31.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.091+0000 7f7e09205740 1 -- 172.21.15.17:0/2845436150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c06cc80 msgr2=0x56009c06d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:31.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.091+0000 7f7e09205740 1 --2- 172.21.15.17:0/2845436150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c06cc80 0x56009c06d080 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7df8007f70 tx=0x7f7df8010800 comp rx=0 tx=0).stop 2024-09-13T16:09:31.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.091+0000 7f7e09205740 1 -- 172.21.15.17:0/2845436150 shutdown_connections 2024-09-13T16:09:31.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.091+0000 7f7e09205740 1 --2- 172.21.15.17:0/2845436150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56009c072650 0x56009c074b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.091+0000 7f7e09205740 1 --2- 172.21.15.17:0/2845436150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06d5c0 0x56009c072080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.091+0000 7f7e09205740 1 --2- 172.21.15.17:0/2845436150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c06cc80 0x56009c06d080 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.091+0000 7f7e09205740 1 -- 172.21.15.17:0/2845436150 >> 172.21.15.17:0/2845436150 conn(0x56009c0682f0 msgr2=0x56009c0686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:31.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.092+0000 7f7e09205740 1 -- 172.21.15.17:0/2845436150 shutdown_connections 2024-09-13T16:09:31.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.092+0000 7f7e09205740 1 -- 172.21.15.17:0/2845436150 wait complete. 2024-09-13T16:09:31.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.092+0000 7f7e09205740 1 -- start start 2024-09-13T16:09:31.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.093+0000 7f7e09205740 1 Processor -- start 2024-09-13T16:09:31.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.094+0000 7f7e09205740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c06cc80 0x56009c07f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:31.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.094+0000 7f7e09205740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06d5c0 0x56009c07f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:31.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.094+0000 7f7e09205740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56009c072650 0x56009c0866b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:31.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.094+0000 7f7e09205740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009bfcfaf0 con 0x56009c072650 2024-09-13T16:09:31.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.094+0000 7f7e09205740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009bf8df20 con 0x56009c06d5c0 2024-09-13T16:09:31.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.094+0000 7f7e09205740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009bf8dbc0 con 0x56009c06cc80 2024-09-13T16:09:31.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.094+0000 7f7e09205740 10 client.0 _ll_register_callbacks cb 0x56009bfbfa70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:09:31.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.095+0000 7f7dff400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c06cc80 0x56009c07f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:31.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.095+0000 7f7dfea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06d5c0 0x56009c07f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:31.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.095+0000 7f7dfea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06d5c0 0x56009c07f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:43910/0 (socket says 172.21.15.17:43910) 2024-09-13T16:09:31.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.095+0000 7f7dfea00640 1 -- 172.21.15.17:0/3520432081 learned_addr learned my addr 172.21.15.17:0/3520432081 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:31.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.096+0000 7f7dfea00640 1 -- 172.21.15.17:0/3520432081 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c06cc80 msgr2=0x56009c07f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:31.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.096+0000 7f7dfea00640 1 --2- 172.21.15.17:0/3520432081 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c06cc80 0x56009c07f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.096+0000 7f7dfea00640 1 -- 172.21.15.17:0/3520432081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56009c072650 msgr2=0x56009c0866b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:31.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.096+0000 7f7dfea00640 1 --2- 172.21.15.17:0/3520432081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56009c072650 0x56009c0866b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.096+0000 7f7dfea00640 1 -- 172.21.15.17:0/3520432081 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df8007ba0 con 0x56009c06d5c0 2024-09-13T16:09:31.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.096+0000 7f7dfea00640 1 --2- 172.21.15.17:0/3520432081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06d5c0 0x56009c07f6c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7dec00e2d0 tx=0x7f7dec00e790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54fbfb09824dcb04 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:31.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.096+0000 7f7de9600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:09:31.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.096+0000 7f7de9600640 1 -- 172.21.15.17:0/3520432081 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec013660 con 0x56009c06d5c0 2024-09-13T16:09:31.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.096+0000 7f7de9600640 1 -- 172.21.15.17:0/3520432081 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f7dec0137c0 con 0x56009c06d5c0 2024-09-13T16:09:31.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.097+0000 7f7e09205740 1 -- 172.21.15.17:0/3520432081 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56009bff9c90 con 0x56009c06d5c0 2024-09-13T16:09:31.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.097+0000 7f7de9600640 1 -- 172.21.15.17:0/3520432081 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7dec013980 con 0x56009c06d5c0 2024-09-13T16:09:31.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.097+0000 7f7e09205740 10 client.26207 fetch_fsmap learned FSMap version 47 2024-09-13T16:09:31.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.097+0000 7f7e09205740 1 -- 172.21.15.17:0/3520432081 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x56009bfce170 con 0x56009c06d5c0 2024-09-13T16:09:31.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.097+0000 7f7de9600640 1 -- 172.21.15.17:0/3520432081 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56009bff9c90 con 0x56009c06d5c0 2024-09-13T16:09:31.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.097+0000 7f7de9600640 1 -- 172.21.15.17:0/3520432081 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 47) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7dec011070 con 0x56009c06d5c0 2024-09-13T16:09:31.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.098+0000 7f7e09205740 10 client.26207 fetch_fsmap finished waiting for FSMap version 47 2024-09-13T16:09:31.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.098+0000 7f7e09205740 10 client.26207 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:09:31.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.098+0000 7f7e09205740 20 client.26207 populate_metadata read hostname 'smithi017' 2024-09-13T16:09:31.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.098+0000 7f7e09205740 1 --2- 172.21.15.17:0/3520432081 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56009c08ae70 0x56009c08d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:31.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.098+0000 7f7e09205740 4 client.26207 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:09:31.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.098+0000 7f7e09205740 1 -- 172.21.15.17:0/3520432081 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56009bfc27d0 con 0x56009c08ae70 2024-09-13T16:09:31.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.098+0000 7f7dff400640 1 --2- 172.21.15.17:0/3520432081 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56009c08ae70 0x56009c08d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:31.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.100+0000 7f7dff400640 1 --2- 172.21.15.17:0/3520432081 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56009c08ae70 0x56009c08d290 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c69755a3d894c7f4 server_cookie=11d0fa83169c15b in_seq=0 out_seq=0 2024-09-13T16:09:31.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.100+0000 7f7de9600640 10 client.26207 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:09:31.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.101+0000 7f7de9600640 1 -- 172.21.15.17:0/3520432081 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56009bfc27d0 con 0x56009c08ae70 2024-09-13T16:09:31.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.101+0000 7f7de9600640 10 client.26207 handle_command_reply: tid=0 2024-09-13T16:09:31.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.102+0000 7f7e09205740 1 client.26207 shutdown 2024-09-13T16:09:31.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.103+0000 7f7e09205740 1 -- 172.21.15.17:0/3520432081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06d5c0 msgr2=0x56009c07f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:31.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.103+0000 7f7e09205740 1 --2- 172.21.15.17:0/3520432081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06d5c0 0x56009c07f6c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7dec00e2d0 tx=0x7f7dec00e790 comp rx=0 tx=0).stop 2024-09-13T16:09:31.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.103+0000 7f7e09205740 1 -- 172.21.15.17:0/3520432081 shutdown_connections 2024-09-13T16:09:31.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.103+0000 7f7e09205740 1 --2- 172.21.15.17:0/3520432081 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56009c08ae70 0x56009c08d290 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.103+0000 7f7e09205740 1 --2- 172.21.15.17:0/3520432081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56009c072650 0x56009c0866b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.103+0000 7f7e09205740 1 --2- 172.21.15.17:0/3520432081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06d5c0 0x56009c07f6c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.103+0000 7f7e09205740 1 --2- 172.21.15.17:0/3520432081 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c06cc80 0x56009c07f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.103+0000 7f7e09205740 1 -- 172.21.15.17:0/3520432081 >> 172.21.15.17:0/3520432081 conn(0x56009c0682f0 msgr2=0x56009c069b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:31.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.103+0000 7f7de9600640 0 client.26207 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:09:31.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.103+0000 7f7e09205740 1 -- 172.21.15.17:0/3520432081 shutdown_connections 2024-09-13T16:09:31.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.103+0000 7f7e09205740 1 -- 172.21.15.17:0/3520432081 wait complete. 2024-09-13T16:09:31.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.104+0000 7f7e09205740 20 client.26207 trim_cache size 0 max 16384 2024-09-13T16:09:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.145+0000 7f7e09205740 1 Processor -- start 2024-09-13T16:09:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.145+0000 7f7e09205740 1 -- start start 2024-09-13T16:09:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.146+0000 7f7e09205740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06cc80 0x56009c06e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.146+0000 7f7e09205740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56009c06d5c0 0x56009c06eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.146+0000 7f7e09205740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c072650 0x56009c086670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.146+0000 7f7e09205740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009bd36e60 con 0x56009c06d5c0 2024-09-13T16:09:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.146+0000 7f7e09205740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009c0893e0 con 0x56009c06cc80 2024-09-13T16:09:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.146+0000 7f7e09205740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009c080030 con 0x56009c072650 2024-09-13T16:09:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.146+0000 7f7dff400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06cc80 0x56009c06e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.146+0000 7f7dff400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06cc80 0x56009c06e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:43924/0 (socket says 172.21.15.17:43924) 2024-09-13T16:09:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.146+0000 7f7dff400640 1 -- 172.21.15.17:0/1064414197 learned_addr learned my addr 172.21.15.17:0/1064414197 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.146+0000 7f7dffe00640 1 --2- 172.21.15.17:0/1064414197 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c072650 0x56009c086670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.147+0000 7f7dfea00640 1 --2- 172.21.15.17:0/1064414197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56009c06d5c0 0x56009c06eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.148+0000 7f7dff400640 1 -- 172.21.15.17:0/1064414197 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c072650 msgr2=0x56009c086670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.151+0000 7f7dff400640 1 --2- 172.21.15.17:0/1064414197 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c072650 0x56009c086670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.151+0000 7f7dff400640 1 -- 172.21.15.17:0/1064414197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56009c06d5c0 msgr2=0x56009c06eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.151+0000 7f7dff400640 1 --2- 172.21.15.17:0/1064414197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56009c06d5c0 0x56009c06eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.151+0000 7f7dff400640 1 -- 172.21.15.17:0/1064414197 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56009bf70180 con 0x56009c06cc80 2024-09-13T16:09:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.151+0000 7f7dffe00640 1 --2- 172.21.15.17:0/1064414197 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c072650 0x56009c086670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:09:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.151+0000 7f7dfea00640 1 --2- 172.21.15.17:0/1064414197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56009c06d5c0 0x56009c06eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:09:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.151+0000 7f7dff400640 1 --2- 172.21.15.17:0/1064414197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06cc80 0x56009c06e580 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7df0006010 tx=0x7f7df0040460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddb571766f85e3a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.151+0000 7f7df5600640 1 -- 172.21.15.17:0/1064414197 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df00bac80 con 0x56009c06cc80 2024-09-13T16:09:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.151+0000 7f7df5600640 1 -- 172.21.15.17:0/1064414197 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7df00beab0 con 0x56009c06cc80 2024-09-13T16:09:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.151+0000 7f7df5600640 1 -- 172.21.15.17:0/1064414197 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0041e60 con 0x56009c06cc80 2024-09-13T16:09:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.153+0000 7f7e09205740 1 -- 172.21.15.17:0/1064414197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06cc80 msgr2=0x56009c06e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.153+0000 7f7e09205740 1 --2- 172.21.15.17:0/1064414197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06cc80 0x56009c06e580 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7df0006010 tx=0x7f7df0040460 comp rx=0 tx=0).stop 2024-09-13T16:09:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.154+0000 7f7e09205740 1 -- 172.21.15.17:0/1064414197 shutdown_connections 2024-09-13T16:09:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.154+0000 7f7e09205740 1 --2- 172.21.15.17:0/1064414197 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c072650 0x56009c086670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.154+0000 7f7e09205740 1 --2- 172.21.15.17:0/1064414197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56009c06d5c0 0x56009c06eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.154+0000 7f7e09205740 1 --2- 172.21.15.17:0/1064414197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06cc80 0x56009c06e580 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.154+0000 7f7e09205740 1 -- 172.21.15.17:0/1064414197 >> 172.21.15.17:0/1064414197 conn(0x56009c0682f0 msgr2=0x56009c091bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.154+0000 7f7e09205740 1 -- 172.21.15.17:0/1064414197 shutdown_connections 2024-09-13T16:09:31.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.154+0000 7f7e09205740 1 -- 172.21.15.17:0/1064414197 wait complete. 2024-09-13T16:09:31.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.155+0000 7f7e09205740 1 -- start start 2024-09-13T16:09:31.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.155+0000 7f7e09205740 1 Processor -- start 2024-09-13T16:09:31.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.156+0000 7f7e09205740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06cc80 0x56009c0845f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:31.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.157+0000 7f7e09205740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56009c06d5c0 0x56009c084b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.157+0000 7f7dff400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06cc80 0x56009c0845f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.157+0000 7f7dff400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06cc80 0x56009c0845f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:43930/0 (socket says 172.21.15.17:43930) 2024-09-13T16:09:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.157+0000 7f7e09205740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c072650 0x56009c085b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.157+0000 7f7e09205740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009c086080 con 0x56009c06d5c0 2024-09-13T16:09:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.157+0000 7f7e09205740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009c0861f0 con 0x56009c06cc80 2024-09-13T16:09:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.157+0000 7f7e09205740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009c0863b0 con 0x56009c072650 2024-09-13T16:09:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.157+0000 7f7dff400640 1 -- 172.21.15.17:0/3639293430 learned_addr learned my addr 172.21.15.17:0/3639293430 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.157+0000 7f7e09205740 10 client.0 _ll_register_callbacks cb 0x7f7df80076a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:09:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.157+0000 7f7dffe00640 1 --2- 172.21.15.17:0/3639293430 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c072650 0x56009c085b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.158+0000 7f7dffe00640 1 -- 172.21.15.17:0/3639293430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06cc80 msgr2=0x56009c0845f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.158+0000 7f7dffe00640 1 --2- 172.21.15.17:0/3639293430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06cc80 0x56009c0845f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.158+0000 7f7dffe00640 1 -- 172.21.15.17:0/3639293430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56009c06d5c0 msgr2=0x56009c084b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.158+0000 7f7dfea00640 1 --2- 172.21.15.17:0/3639293430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56009c06d5c0 0x56009c084b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.160+0000 7f7dffe00640 1 --2- 172.21.15.17:0/3639293430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56009c06d5c0 0x56009c084b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.160+0000 7f7dffe00640 1 -- 172.21.15.17:0/3639293430 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e001a01c0 con 0x56009c072650 2024-09-13T16:09:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.160+0000 7f7dff400640 1 --2- 172.21.15.17:0/3639293430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06cc80 0x56009c0845f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:09:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.160+0000 7f7dfea00640 1 --2- 172.21.15.17:0/3639293430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56009c06d5c0 0x56009c084b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:09:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.160+0000 7f7dffe00640 1 --2- 172.21.15.17:0/3639293430 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c072650 0x56009c085b40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7df8012fd0 tx=0x7f7df8011a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=696e83fe877f1775 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.160+0000 7f7de9600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:09:31.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.163+0000 7f7de9600640 1 -- 172.21.15.17:0/3639293430 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df8012650 con 0x56009c072650 2024-09-13T16:09:31.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.163+0000 7f7de9600640 1 -- 172.21.15.17:0/3639293430 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f7df8011e60 con 0x56009c072650 2024-09-13T16:09:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.163+0000 7f7e09205740 1 -- 172.21.15.17:0/3639293430 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7df8011cf0 con 0x56009c072650 2024-09-13T16:09:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.163+0000 7f7de9600640 1 -- 172.21.15.17:0/3639293430 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7df8004980 con 0x56009c072650 2024-09-13T16:09:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.163+0000 7f7e09205740 10 client.26245 fetch_fsmap learned FSMap version 47 2024-09-13T16:09:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.163+0000 7f7e09205740 1 -- 172.21.15.17:0/3639293430 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x56009bf95560 con 0x56009c072650 2024-09-13T16:09:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.164+0000 7f7de9600640 1 -- 172.21.15.17:0/3639293430 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7df8011cf0 con 0x56009c072650 2024-09-13T16:09:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.165+0000 7f7de9600640 1 -- 172.21.15.17:0/3639293430 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 47) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7df8037020 con 0x56009c072650 2024-09-13T16:09:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.165+0000 7f7e09205740 10 client.26245 fetch_fsmap finished waiting for FSMap version 47 2024-09-13T16:09:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.165+0000 7f7e09205740 10 client.26245 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:09:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.165+0000 7f7e09205740 20 client.26245 populate_metadata read hostname 'smithi017' 2024-09-13T16:09:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.165+0000 7f7e09205740 1 --2- 172.21.15.17:0/3639293430 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56009c0e24d0 0x56009c0e48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.165+0000 7f7e09205740 4 client.26245 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:09:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.165+0000 7f7e09205740 1 -- 172.21.15.17:0/3639293430 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56009bcc3300 con 0x56009c0e24d0 2024-09-13T16:09:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.166+0000 7f7dff400640 1 --2- 172.21.15.17:0/3639293430 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56009c0e24d0 0x56009c0e48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.166+0000 7f7dff400640 1 --2- 172.21.15.17:0/3639293430 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56009c0e24d0 0x56009c0e48f0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13d463c36a723701 server_cookie=1a72609f2c81e963 in_seq=0 out_seq=0 2024-09-13T16:09:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.166+0000 7f7de9600640 10 client.26245 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:09:31.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.208+0000 7f7de9600640 1 -- 172.21.15.17:0/3639293430 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56009bcc3300 con 0x56009c0e24d0 2024-09-13T16:09:31.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.208+0000 7f7de9600640 10 client.26245 handle_command_reply: tid=0 2024-09-13T16:09:31.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.208+0000 7f7e09205740 1 client.26245 shutdown 2024-09-13T16:09:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.208+0000 7f7e09205740 1 -- 172.21.15.17:0/3639293430 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c072650 msgr2=0x56009c085b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.208+0000 7f7e09205740 1 --2- 172.21.15.17:0/3639293430 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c072650 0x56009c085b40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7df8012fd0 tx=0x7f7df8011a60 comp rx=0 tx=0).stop 2024-09-13T16:09:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.209+0000 7f7e09205740 1 -- 172.21.15.17:0/3639293430 shutdown_connections 2024-09-13T16:09:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.209+0000 7f7e09205740 1 --2- 172.21.15.17:0/3639293430 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56009c0e24d0 0x56009c0e48f0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.209+0000 7f7e09205740 1 --2- 172.21.15.17:0/3639293430 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56009c072650 0x56009c085b40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.209+0000 7f7e09205740 1 --2- 172.21.15.17:0/3639293430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56009c06d5c0 0x56009c084b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.209+0000 7f7e09205740 1 --2- 172.21.15.17:0/3639293430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56009c06cc80 0x56009c0845f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.209+0000 7f7de9600640 0 client.26245 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:09:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.209+0000 7f7e09205740 1 -- 172.21.15.17:0/3639293430 >> 172.21.15.17:0/3639293430 conn(0x56009c0682f0 msgr2=0x56009c07f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.209+0000 7f7e09205740 1 -- 172.21.15.17:0/3639293430 shutdown_connections 2024-09-13T16:09:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.209+0000 7f7e09205740 1 -- 172.21.15.17:0/3639293430 wait complete. 2024-09-13T16:09:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.211+0000 7f7e09205740 20 client.26245 trim_cache size 0 max 16384 2024-09-13T16:09:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:09:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:09:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:09:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:09:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.212+0000 7f7e04e00640 1 -- 172.21.15.17:0/3013973070 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7de40a11b0 msgr2=0x7f7de40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.212+0000 7f7e04e00640 1 --2- 172.21.15.17:0/3013973070 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7de40a11b0 0x7f7de40a3670 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7df8010fd0 tx=0x7f7df8013000 comp rx=0 tx=0).stop 2024-09-13T16:09:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.212+0000 7f7e04e00640 1 -- 172.21.15.17:0/3013973070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e00101d70 msgr2=0x7f7e00197d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.212+0000 7f7e04e00640 1 --2- 172.21.15.17:0/3013973070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e00101d70 0x7f7e00197d00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7df0031500 tx=0x7f7df0003d50 comp rx=0 tx=0).stop 2024-09-13T16:09:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.212+0000 7f7e04e00640 1 -- 172.21.15.17:0/3013973070 shutdown_connections 2024-09-13T16:09:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.212+0000 7f7e04e00640 1 --2- 172.21.15.17:0/3013973070 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f7de40a11b0 0x7f7de40a3670 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.212+0000 7f7e04e00640 1 --2- 172.21.15.17:0/3013973070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e00103920 0x7f7e0019f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.212+0000 7f7e04e00640 1 --2- 172.21.15.17:0/3013973070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e00102f60 0x7f7e00198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.212+0000 7f7e04e00640 1 --2- 172.21.15.17:0/3013973070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e00101d70 0x7f7e00197d00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.212+0000 7f7e04e00640 1 -- 172.21.15.17:0/3013973070 >> 172.21.15.17:0/3013973070 conn(0x7f7e000fd4d0 msgr2=0x7f7e001062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.212+0000 7f7e04e00640 1 -- 172.21.15.17:0/3013973070 shutdown_connections 2024-09-13T16:09:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:31.213+0000 7f7e04e00640 1 -- 172.21.15.17:0/3013973070 wait complete. 2024-09-13T16:09:32.306 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:32 smithi193 ceph-mon[35248]: pgmap v738: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.3 MiB/s wr, 518 op/s 2024-09-13T16:09:32.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:32 smithi189 ceph-mon[34790]: pgmap v738: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.3 MiB/s wr, 518 op/s 2024-09-13T16:09:32.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:32 smithi017 ceph-mon[30494]: pgmap v738: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.3 MiB/s wr, 518 op/s 2024-09-13T16:09:34.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:34 smithi189 ceph-mon[34790]: pgmap v739: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6.1 MiB/s wr, 532 op/s 2024-09-13T16:09:34.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:34 smithi193 ceph-mon[35248]: pgmap v739: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6.1 MiB/s wr, 532 op/s 2024-09-13T16:09:34.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:34 smithi017 ceph-mon[30494]: pgmap v739: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6.1 MiB/s wr, 532 op/s 2024-09-13T16:09:35.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 710.0 s, 565.8 tps, lat 175.870 ms stddev 241.701 2024-09-13T16:09:36.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:36 smithi189 ceph-mon[34790]: pgmap v740: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6.6 MiB/s wr, 543 op/s 2024-09-13T16:09:36.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:36 smithi193 ceph-mon[35248]: pgmap v740: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6.6 MiB/s wr, 543 op/s 2024-09-13T16:09:36.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:36 smithi017 ceph-mon[30494]: pgmap v740: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6.6 MiB/s wr, 543 op/s 2024-09-13T16:09:37.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:37 smithi193 ceph-mon[35248]: pgmap v741: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.5 MiB/s wr, 568 op/s 2024-09-13T16:09:37.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:37 smithi017 ceph-mon[30494]: pgmap v741: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.5 MiB/s wr, 568 op/s 2024-09-13T16:09:37.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:37 smithi189 ceph-mon[34790]: pgmap v741: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.5 MiB/s wr, 568 op/s 2024-09-13T16:09:40.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:39 smithi193 ceph-mon[35248]: pgmap v742: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.7 MiB/s wr, 551 op/s 2024-09-13T16:09:40.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:39 smithi017 ceph-mon[30494]: pgmap v742: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.7 MiB/s wr, 551 op/s 2024-09-13T16:09:40.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:39 smithi189 ceph-mon[34790]: pgmap v742: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.7 MiB/s wr, 551 op/s 2024-09-13T16:09:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 715.0 s, 647.6 tps, lat 152.177 ms stddev 186.832 2024-09-13T16:09:41.765 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:41 smithi017 ceph-mon[30494]: pgmap v743: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.5 MiB/s wr, 605 op/s 2024-09-13T16:09:42.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:41 smithi193 ceph-mon[35248]: pgmap v743: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.5 MiB/s wr, 605 op/s 2024-09-13T16:09:42.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:41 smithi189 ceph-mon[34790]: pgmap v743: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.5 MiB/s wr, 605 op/s 2024-09-13T16:09:44.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:43 smithi193 ceph-mon[35248]: pgmap v744: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.0 MiB/s wr, 659 op/s 2024-09-13T16:09:44.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:43 smithi017 ceph-mon[30494]: pgmap v744: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.0 MiB/s wr, 659 op/s 2024-09-13T16:09:44.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:43 smithi189 ceph-mon[34790]: pgmap v744: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.0 MiB/s wr, 659 op/s 2024-09-13T16:09:44.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.412+0000 7fddf5e00640 1 -- 172.21.15.17:0/4173640196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddf0071860 msgr2=0x7fddf010b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:44.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.412+0000 7fddf5e00640 1 --2- 172.21.15.17:0/4173640196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddf0071860 0x7fddf010b770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009900 tx=0x7fdde402a400 comp rx=0 tx=0).stop 2024-09-13T16:09:44.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.412+0000 7fddf5e00640 1 -- 172.21.15.17:0/4173640196 shutdown_connections 2024-09-13T16:09:44.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.412+0000 7fddf5e00640 1 --2- 172.21.15.17:0/4173640196 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddf010bdc0 0x7fddf010e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.412+0000 7fddf5e00640 1 --2- 172.21.15.17:0/4173640196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddf0071860 0x7fddf010b770 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.412+0000 7fddf5e00640 1 --2- 172.21.15.17:0/4173640196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0070f40 0x7fddf0071320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.412+0000 7fddf5e00640 1 -- 172.21.15.17:0/4173640196 >> 172.21.15.17:0/4173640196 conn(0x7fddf006cd10 msgr2=0x7fddf006f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:44.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.413+0000 7fddf5e00640 1 -- 172.21.15.17:0/4173640196 shutdown_connections 2024-09-13T16:09:44.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.413+0000 7fddf5e00640 1 -- 172.21.15.17:0/4173640196 wait complete. 2024-09-13T16:09:44.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.414+0000 7fddf5e00640 1 Processor -- start 2024-09-13T16:09:44.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.418+0000 7fddf5e00640 1 -- start start 2024-09-13T16:09:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.418+0000 7fddf5e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddf0070f40 0x7fddf01a48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.418+0000 7fddf5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0071860 0x7fddf01a4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.418+0000 7fddf5e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddf010bdc0 0x7fddf01abe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.418+0000 7fddf5e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf01ac3b0 con 0x7fddf0071860 2024-09-13T16:09:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.418+0000 7fddf5e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf01ac520 con 0x7fddf010bdc0 2024-09-13T16:09:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.418+0000 7fddf5e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf01ac6e0 con 0x7fddf0070f40 2024-09-13T16:09:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.419+0000 7fddf4a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddf0070f40 0x7fddf01a48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.419+0000 7fddf4a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddf0070f40 0x7fddf01a48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:51960/0 (socket says 172.21.15.17:51960) 2024-09-13T16:09:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.419+0000 7fddf4a00640 1 -- 172.21.15.17:0/2007975542 learned_addr learned my addr 172.21.15.17:0/2007975542 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:44.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.419+0000 7fddf4a00640 1 -- 172.21.15.17:0/2007975542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddf010bdc0 msgr2=0x7fddf01abe70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T16:09:44.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.419+0000 7fddf4a00640 1 --2- 172.21.15.17:0/2007975542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddf010bdc0 0x7fddf01abe70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.419+0000 7fddf4a00640 1 -- 172.21.15.17:0/2007975542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0071860 msgr2=0x7fddf01a4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:44.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.419+0000 7fddf4a00640 1 --2- 172.21.15.17:0/2007975542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0071860 0x7fddf01a4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.419+0000 7fddf4a00640 1 -- 172.21.15.17:0/2007975542 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde4009560 con 0x7fddf0070f40 2024-09-13T16:09:44.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.420+0000 7fddf4a00640 1 --2- 172.21.15.17:0/2007975542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddf0070f40 0x7fddf01a48c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00e9f0 tx=0x7fdddc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:44.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.420+0000 7fdded600640 1 -- 172.21.15.17:0/2007975542 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc00cd80 con 0x7fddf0070f40 2024-09-13T16:09:44.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.420+0000 7fdded600640 1 -- 172.21.15.17:0/2007975542 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdddc0108f0 con 0x7fddf0070f40 2024-09-13T16:09:44.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.420+0000 7fddf5e00640 1 -- 172.21.15.17:0/2007975542 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf01ac9c0 con 0x7fddf0070f40 2024-09-13T16:09:44.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.420+0000 7fdded600640 1 -- 172.21.15.17:0/2007975542 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc018840 con 0x7fddf0070f40 2024-09-13T16:09:44.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.420+0000 7fddf5e00640 1 -- 172.21.15.17:0/2007975542 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf01acf20 con 0x7fddf0070f40 2024-09-13T16:09:44.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.425+0000 7fddfa267740 1 Processor -- start 2024-09-13T16:09:44.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.425+0000 7fddfa267740 1 -- start start 2024-09-13T16:09:44.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.426+0000 7fddfa267740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b49426c80 0x556b49427080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:44.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.426+0000 7fdded600640 1 -- 172.21.15.17:0/2007975542 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fdddc010430 con 0x7fddf0070f40 2024-09-13T16:09:44.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.426+0000 7fddfa267740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556b494275c0 0x556b4942c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:44.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.426+0000 7fddfa267740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556b4942c650 0x556b4942eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:44.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.426+0000 7fddfa267740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b49332bb0 con 0x556b494275c0 2024-09-13T16:09:44.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.426+0000 7fddfa267740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b49390a70 con 0x556b4942c650 2024-09-13T16:09:44.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.426+0000 7fddfa267740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b4938e200 con 0x556b49426c80 2024-09-13T16:09:44.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.426+0000 7fddf5400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b49426c80 0x556b49427080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:44.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.426+0000 7fddf5400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b49426c80 0x556b49427080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:51972/0 (socket says 172.21.15.17:51972) 2024-09-13T16:09:44.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.426+0000 7fddf5400640 1 -- 172.21.15.17:0/3942294828 learned_addr learned my addr 172.21.15.17:0/3942294828 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:44.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.427+0000 7fddefe00640 1 --2- 172.21.15.17:0/3942294828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556b4942c650 0x556b4942eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:44.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.427+0000 7fddf5400640 1 -- 172.21.15.17:0/3942294828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556b4942c650 msgr2=0x556b4942eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:44.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.427+0000 7fddf5400640 1 --2- 172.21.15.17:0/3942294828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556b4942c650 0x556b4942eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.427+0000 7fddf5400640 1 -- 172.21.15.17:0/3942294828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556b494275c0 msgr2=0x556b4942c080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:09:44.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.428+0000 7fdded600640 1 --2- 172.21.15.17:0/2007975542 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fddd80a11b0 0x7fddd80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:44.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.428+0000 7fdded600640 1 -- 172.21.15.17:0/2007975542 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fdddc014070 con 0x7fddf0070f40 2024-09-13T16:09:44.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.429+0000 7fddefe00640 1 --2- 172.21.15.17:0/2007975542 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fddd80a11b0 0x7fddd80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:44.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.430+0000 7fddf4a00640 1 --2- 172.21.15.17:0/3942294828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556b494275c0 0x556b4942c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:44.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.431+0000 7fddf5400640 1 --2- 172.21.15.17:0/3942294828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556b494275c0 0x556b4942c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.431+0000 7fddf5400640 1 -- 172.21.15.17:0/3942294828 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b4932b940 con 0x556b49426c80 2024-09-13T16:09:44.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.431+0000 7fddf4a00640 1 --2- 172.21.15.17:0/3942294828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556b494275c0 0x556b4942c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:09:44.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.433+0000 7fddf5400640 1 --2- 172.21.15.17:0/3942294828 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b49426c80 0x556b49427080 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009e30 tx=0x7fdde800e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adcb71c15807a5e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:44.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.433+0000 7fdde2000640 1 -- 172.21.15.17:0/3942294828 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8004d20 con 0x556b49426c80 2024-09-13T16:09:44.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.433+0000 7fdde2000640 1 -- 172.21.15.17:0/3942294828 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdde8004e80 con 0x556b49426c80 2024-09-13T16:09:44.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.433+0000 7fdde2000640 1 -- 172.21.15.17:0/3942294828 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8004d20 con 0x556b49426c80 2024-09-13T16:09:44.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.434+0000 7fddfa267740 1 -- 172.21.15.17:0/3942294828 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b49426c80 msgr2=0x556b49427080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:44.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.434+0000 7fddfa267740 1 --2- 172.21.15.17:0/3942294828 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b49426c80 0x556b49427080 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009e30 tx=0x7fdde800e720 comp rx=0 tx=0).stop 2024-09-13T16:09:44.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.434+0000 7fddefe00640 1 --2- 172.21.15.17:0/2007975542 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fddd80a11b0 0x7fddd80a3670 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdde402a9f0 tx=0x7fdde4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:44.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.436+0000 7fddfa267740 1 -- 172.21.15.17:0/3942294828 shutdown_connections 2024-09-13T16:09:44.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.436+0000 7fddfa267740 1 --2- 172.21.15.17:0/3942294828 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556b4942c650 0x556b4942eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.436+0000 7fddfa267740 1 --2- 172.21.15.17:0/3942294828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556b494275c0 0x556b4942c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.436+0000 7fddfa267740 1 --2- 172.21.15.17:0/3942294828 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b49426c80 0x556b49427080 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.436+0000 7fddfa267740 1 -- 172.21.15.17:0/3942294828 >> 172.21.15.17:0/3942294828 conn(0x556b494222f0 msgr2=0x556b494226f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:44.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.436+0000 7fddfa267740 1 -- 172.21.15.17:0/3942294828 shutdown_connections 2024-09-13T16:09:44.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.436+0000 7fddfa267740 1 -- 172.21.15.17:0/3942294828 wait complete. 2024-09-13T16:09:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.436+0000 7fddfa267740 1 -- start start 2024-09-13T16:09:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.437+0000 7fddfa267740 1 Processor -- start 2024-09-13T16:09:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.437+0000 7fddfa267740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556b49426c80 0x556b49441a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.438+0000 7fddfa267740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556b494275c0 0x556b49441f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.438+0000 7fddfa267740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b4942c650 0x556b49448f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.438+0000 7fddefe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556b494275c0 0x556b49441f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.438+0000 7fddefe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556b494275c0 0x556b49441f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:34946/0 (socket says 172.21.15.17:34946) 2024-09-13T16:09:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.438+0000 7fddefe00640 1 -- 172.21.15.17:0/3551745805 learned_addr learned my addr 172.21.15.17:0/3551745805 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.438+0000 7fddfa267740 1 -- 172.21.15.17:0/3551745805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b49389af0 con 0x556b49426c80 2024-09-13T16:09:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.438+0000 7fddf5400640 1 --2- 172.21.15.17:0/3551745805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b4942c650 0x556b49448f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.438+0000 7fddfa267740 1 -- 172.21.15.17:0/3551745805 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b49347f20 con 0x556b494275c0 2024-09-13T16:09:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.438+0000 7fddfa267740 1 -- 172.21.15.17:0/3551745805 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b49347bc0 con 0x556b4942c650 2024-09-13T16:09:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.439+0000 7fddf5400640 1 -- 172.21.15.17:0/3551745805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556b494275c0 msgr2=0x556b49441f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.439+0000 7fddf5400640 1 --2- 172.21.15.17:0/3551745805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556b494275c0 0x556b49441f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.439+0000 7fddf5400640 1 -- 172.21.15.17:0/3551745805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556b49426c80 msgr2=0x556b49441a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.439+0000 7fddf5400640 1 --2- 172.21.15.17:0/3551745805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556b49426c80 0x556b49441a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.439+0000 7fddf5400640 1 -- 172.21.15.17:0/3551745805 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde8009b10 con 0x556b4942c650 2024-09-13T16:09:44.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.440+0000 7fddfa267740 10 client.0 _ll_register_callbacks cb 0x556b49379a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:09:44.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.440+0000 7fddfa267740 1 -- 172.21.15.17:0/3551745805 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556b4937c7d0 con 0x556b4942c650 2024-09-13T16:09:44.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.441+0000 7fddd6a00640 10 client.26257 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:09:44.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.441+0000 7fddf5400640 1 --2- 172.21.15.17:0/3551745805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b4942c650 0x556b49448f20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdde8000f80 tx=0x7fdde8005390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab81ff6c194ad655 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:44.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.441+0000 7fddd6a00640 1 -- 172.21.15.17:0/3551745805 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8026070 con 0x556b4942c650 2024-09-13T16:09:44.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.441+0000 7fddd6a00640 1 -- 172.21.15.17:0/3551745805 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fdde8014070 con 0x556b4942c650 2024-09-13T16:09:44.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.441+0000 7fddd6a00640 1 -- 172.21.15.17:0/3551745805 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdde8026070 con 0x556b4942c650 2024-09-13T16:09:44.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.443+0000 7fddfa267740 10 client.26257 fetch_fsmap learned FSMap version 47 2024-09-13T16:09:44.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.443+0000 7fddfa267740 1 -- 172.21.15.17:0/3551745805 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=47}) v3 -- 0x556b49388170 con 0x556b4942c650 2024-09-13T16:09:44.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.443+0000 7fddd6a00640 1 -- 172.21.15.17:0/3551745805 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 47) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fdde8029030 con 0x556b4942c650 2024-09-13T16:09:44.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.443+0000 7fddfa267740 10 client.26257 fetch_fsmap finished waiting for FSMap version 47 2024-09-13T16:09:44.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.443+0000 7fddfa267740 10 client.26257 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:09:44.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.443+0000 7fddfa267740 20 client.26257 populate_metadata read hostname 'smithi017' 2024-09-13T16:09:44.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.443+0000 7fddfa267740 1 --2- 172.21.15.17:0/3551745805 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x556b49434310 0x556b49436770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:44.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.443+0000 7fddfa267740 4 client.26257 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:09:44.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.443+0000 7fddfa267740 1 -- 172.21.15.17:0/3551745805 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556b4907d300 con 0x556b49434310 2024-09-13T16:09:44.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.444+0000 7fddf4a00640 1 --2- 172.21.15.17:0/3551745805 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x556b49434310 0x556b49436770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:44.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.444+0000 7fddd6a00640 10 client.26257 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:09:44.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.444+0000 7fddf4a00640 1 --2- 172.21.15.17:0/3551745805 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x556b49434310 0x556b49436770 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8953e18c1eac2ee0 server_cookie=6a3b2351782c9f45 in_seq=0 out_seq=0 2024-09-13T16:09:44.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.445+0000 7fddd6a00640 1 -- 172.21.15.17:0/3551745805 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556b4907d300 con 0x556b49434310 2024-09-13T16:09:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.445+0000 7fddd6a00640 10 client.26257 handle_command_reply: tid=0 2024-09-13T16:09:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.445+0000 7fddfa267740 1 client.26257 shutdown 2024-09-13T16:09:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.446+0000 7fddfa267740 1 -- 172.21.15.17:0/3551745805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b4942c650 msgr2=0x556b49448f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.446+0000 7fddfa267740 1 --2- 172.21.15.17:0/3551745805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b4942c650 0x556b49448f20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdde8000f80 tx=0x7fdde8005390 comp rx=0 tx=0).stop 2024-09-13T16:09:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.446+0000 7fddfa267740 1 -- 172.21.15.17:0/3551745805 shutdown_connections 2024-09-13T16:09:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.446+0000 7fddfa267740 1 --2- 172.21.15.17:0/3551745805 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x556b49434310 0x556b49436770 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.446+0000 7fddfa267740 1 --2- 172.21.15.17:0/3551745805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b4942c650 0x556b49448f20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.446+0000 7fddfa267740 1 --2- 172.21.15.17:0/3551745805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556b494275c0 0x556b49441f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.446+0000 7fddfa267740 1 --2- 172.21.15.17:0/3551745805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556b49426c80 0x556b49441a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.446+0000 7fddfa267740 1 -- 172.21.15.17:0/3551745805 >> 172.21.15.17:0/3551745805 conn(0x556b494222f0 msgr2=0x556b49423b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:44.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.446+0000 7fddd6a00640 0 client.26257 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:09:44.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.446+0000 7fddfa267740 1 -- 172.21.15.17:0/3551745805 shutdown_connections 2024-09-13T16:09:44.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.446+0000 7fddfa267740 1 -- 172.21.15.17:0/3551745805 wait complete. 2024-09-13T16:09:44.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.447+0000 7fddfa267740 20 client.26257 trim_cache size 0 max 16384 2024-09-13T16:09:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.478+0000 7fddfa267740 1 Processor -- start 2024-09-13T16:09:44.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.480+0000 7fddfa267740 1 -- start start 2024-09-13T16:09:44.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.480+0000 7fddfa267740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556b49426c80 0x556b49446ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:44.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.480+0000 7fddfa267740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556b494275c0 0x556b49447410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.480+0000 7fddfa267740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b4942c650 0x556b494285e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.480+0000 7fddfa267740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b490f0e60 con 0x556b494275c0 2024-09-13T16:09:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.480+0000 7fddfa267740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b4942c3f0 con 0x556b49426c80 2024-09-13T16:09:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.480+0000 7fddfa267740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b4943b820 con 0x556b4942c650 2024-09-13T16:09:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.481+0000 7fddefe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556b494275c0 0x556b49447410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.481+0000 7fddf5400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b4942c650 0x556b494285e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.481+0000 7fddf5400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b4942c650 0x556b494285e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:51994/0 (socket says 172.21.15.17:51994) 2024-09-13T16:09:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.481+0000 7fddefe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556b494275c0 0x556b49447410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59328/0 (socket says 172.21.15.17:59328) 2024-09-13T16:09:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.481+0000 7fddf5400640 1 -- 172.21.15.17:0/1698102142 learned_addr learned my addr 172.21.15.17:0/1698102142 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.481+0000 7fddf5400640 1 -- 172.21.15.17:0/1698102142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556b49426c80 msgr2=0x556b49446ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.481+0000 7fddf5400640 1 --2- 172.21.15.17:0/1698102142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556b49426c80 0x556b49446ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.482+0000 7fddf5400640 1 -- 172.21.15.17:0/1698102142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556b494275c0 msgr2=0x556b49447410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.482+0000 7fddf5400640 1 --2- 172.21.15.17:0/1698102142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556b494275c0 0x556b49447410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.482+0000 7fddf5400640 1 -- 172.21.15.17:0/1698102142 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b4932a180 con 0x556b4942c650 2024-09-13T16:09:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.482+0000 7fddf5400640 1 --2- 172.21.15.17:0/1698102142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b4942c650 0x556b494285e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009ae0 tx=0x7fdde8019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13428e9da038276f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.482+0000 7fdde2a00640 1 -- 172.21.15.17:0/1698102142 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8026070 con 0x556b4942c650 2024-09-13T16:09:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.482+0000 7fdde2a00640 1 -- 172.21.15.17:0/1698102142 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556b4937c7d0 con 0x556b4942c650 2024-09-13T16:09:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.483+0000 7fdde2a00640 1 -- 172.21.15.17:0/1698102142 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8010720 con 0x556b4942c650 2024-09-13T16:09:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.483+0000 7fddfa267740 1 -- 172.21.15.17:0/1698102142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b4942c650 msgr2=0x556b494285e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.484+0000 7fddfa267740 1 --2- 172.21.15.17:0/1698102142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b4942c650 0x556b494285e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009ae0 tx=0x7fdde8019000 comp rx=0 tx=0).stop 2024-09-13T16:09:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.484+0000 7fddfa267740 1 -- 172.21.15.17:0/1698102142 shutdown_connections 2024-09-13T16:09:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.484+0000 7fddfa267740 1 --2- 172.21.15.17:0/1698102142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b4942c650 0x556b494285e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.484+0000 7fddfa267740 1 --2- 172.21.15.17:0/1698102142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556b494275c0 0x556b49447410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.484+0000 7fddfa267740 1 --2- 172.21.15.17:0/1698102142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556b49426c80 0x556b49446ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.484+0000 7fddfa267740 1 -- 172.21.15.17:0/1698102142 >> 172.21.15.17:0/1698102142 conn(0x556b494222f0 msgr2=0x556b4943b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.484+0000 7fddfa267740 1 -- 172.21.15.17:0/1698102142 shutdown_connections 2024-09-13T16:09:44.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.484+0000 7fddfa267740 1 -- 172.21.15.17:0/1698102142 wait complete. 2024-09-13T16:09:44.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.485+0000 7fddfa267740 1 -- start start 2024-09-13T16:09:44.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.485+0000 7fddfa267740 1 Processor -- start 2024-09-13T16:09:44.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.485+0000 7fddfa267740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556b49426c80 0x556b49446660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:44.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.485+0000 7fddfa267740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b494275c0 0x556b49446ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:44.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.485+0000 7fddfa267740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556b4942c650 0x556b49491c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:44.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.486+0000 7fddfa267740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b49492190 con 0x556b49426c80 2024-09-13T16:09:44.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.486+0000 7fddfa267740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b49492300 con 0x556b4942c650 2024-09-13T16:09:44.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.486+0000 7fddfa267740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b494924c0 con 0x556b494275c0 2024-09-13T16:09:44.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.486+0000 7fddfa267740 10 client.0 _ll_register_callbacks cb 0x7fdde8009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:09:44.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.486+0000 7fddf5400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556b4942c650 0x556b49491c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:44.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.487+0000 7fddefe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b494275c0 0x556b49446ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:44.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.487+0000 7fddefe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b494275c0 0x556b49446ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:52000/0 (socket says 172.21.15.17:52000) 2024-09-13T16:09:44.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.487+0000 7fddefe00640 1 -- 172.21.15.17:0/1241859238 learned_addr learned my addr 172.21.15.17:0/1241859238 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:44.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.487+0000 7fddf5400640 1 -- 172.21.15.17:0/1241859238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b494275c0 msgr2=0x556b49446ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:44.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.487+0000 7fddf5400640 1 --2- 172.21.15.17:0/1241859238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b494275c0 0x556b49446ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.487+0000 7fddf5400640 1 -- 172.21.15.17:0/1241859238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556b49426c80 msgr2=0x556b49446660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:44.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.487+0000 7fddf5400640 1 --2- 172.21.15.17:0/1241859238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556b49426c80 0x556b49446660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.487+0000 7fddf5400640 1 -- 172.21.15.17:0/1241859238 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556b49388170 con 0x556b4942c650 2024-09-13T16:09:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.492+0000 7fddd6a00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:09:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.492+0000 7fddf5400640 1 --2- 172.21.15.17:0/1241859238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556b4942c650 0x556b49491c50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009340 tx=0x7fdde800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd5d8ea5dd0da18a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:44.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.492+0000 7fddd6a00640 1 -- 172.21.15.17:0/1241859238 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8026070 con 0x556b4942c650 2024-09-13T16:09:44.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.492+0000 7fddfa267740 1 -- 172.21.15.17:0/1241859238 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556b493b3c90 con 0x556b4942c650 2024-09-13T16:09:44.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.493+0000 7fddd6a00640 1 -- 172.21.15.17:0/1241859238 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fdde8014070 con 0x556b4942c650 2024-09-13T16:09:44.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.493+0000 7fddd6a00640 1 -- 172.21.15.17:0/1241859238 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdde8026070 con 0x556b4942c650 2024-09-13T16:09:44.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.493+0000 7fddfa267740 10 client.26225 fetch_fsmap learned FSMap version 47 2024-09-13T16:09:44.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.493+0000 7fddfa267740 1 -- 172.21.15.17:0/1241859238 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x556b4934f560 con 0x556b4942c650 2024-09-13T16:09:44.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.493+0000 7fddd6a00640 1 -- 172.21.15.17:0/1241859238 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdde8027040 con 0x556b4942c650 2024-09-13T16:09:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.494+0000 7fddd6a00640 1 -- 172.21.15.17:0/1241859238 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 47) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fdde8045070 con 0x556b4942c650 2024-09-13T16:09:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.495+0000 7fddfa267740 10 client.26225 fetch_fsmap finished waiting for FSMap version 47 2024-09-13T16:09:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.495+0000 7fddfa267740 10 client.26225 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:09:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.495+0000 7fddfa267740 20 client.26225 populate_metadata read hostname 'smithi017' 2024-09-13T16:09:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.495+0000 7fddfa267740 1 --2- 172.21.15.17:0/1241859238 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x556b49493b80 0x556b49495f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:44.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.495+0000 7fddfa267740 4 client.26225 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:09:44.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.495+0000 7fddfa267740 1 -- 172.21.15.17:0/1241859238 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556b493b3c90 con 0x556b49493b80 2024-09-13T16:09:44.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.495+0000 7fddf4a00640 1 --2- 172.21.15.17:0/1241859238 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x556b49493b80 0x556b49495f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:44.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.496+0000 7fddd6a00640 10 client.26225 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:09:44.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.496+0000 7fddf4a00640 1 --2- 172.21.15.17:0/1241859238 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x556b49493b80 0x556b49495f70 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8ff15288192a228 server_cookie=c3f5aa56db30d9ff in_seq=0 out_seq=0 2024-09-13T16:09:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.643+0000 7fddd6a00640 1 -- 172.21.15.17:0/1241859238 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556b493b3c90 con 0x556b49493b80 2024-09-13T16:09:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.643+0000 7fddd6a00640 10 client.26225 handle_command_reply: tid=0 2024-09-13T16:09:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.643+0000 7fddfa267740 1 client.26225 shutdown 2024-09-13T16:09:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.643+0000 7fddfa267740 1 -- 172.21.15.17:0/1241859238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556b4942c650 msgr2=0x556b49491c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.643+0000 7fddfa267740 1 --2- 172.21.15.17:0/1241859238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556b4942c650 0x556b49491c50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009340 tx=0x7fdde800ef20 comp rx=0 tx=0).stop 2024-09-13T16:09:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.643+0000 7fddfa267740 1 -- 172.21.15.17:0/1241859238 shutdown_connections 2024-09-13T16:09:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.643+0000 7fddfa267740 1 --2- 172.21.15.17:0/1241859238 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x556b49493b80 0x556b49495f70 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.643+0000 7fddfa267740 1 --2- 172.21.15.17:0/1241859238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556b4942c650 0x556b49491c50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.643+0000 7fddfa267740 1 --2- 172.21.15.17:0/1241859238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b494275c0 0x556b49446ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.643+0000 7fddfa267740 1 --2- 172.21.15.17:0/1241859238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556b49426c80 0x556b49446660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.643+0000 7fddfa267740 1 -- 172.21.15.17:0/1241859238 >> 172.21.15.17:0/1241859238 conn(0x556b494222f0 msgr2=0x556b494285e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:44.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.643+0000 7fddd6a00640 0 client.26225 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:09:44.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.644+0000 7fddfa267740 1 -- 172.21.15.17:0/1241859238 shutdown_connections 2024-09-13T16:09:44.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.645+0000 7fddfa267740 1 -- 172.21.15.17:0/1241859238 wait complete. 2024-09-13T16:09:44.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.645+0000 7fddfa267740 20 client.26225 trim_cache size 0 max 16384 2024-09-13T16:09:44.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:09:44.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:09:44.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:09:44.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:09:44.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.646+0000 7fddf5e00640 1 -- 172.21.15.17:0/2007975542 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fddd80a11b0 msgr2=0x7fddd80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:44.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.646+0000 7fddf5e00640 1 --2- 172.21.15.17:0/2007975542 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fddd80a11b0 0x7fddd80a3670 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdde402a9f0 tx=0x7fdde4000bc0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.646+0000 7fddf5e00640 1 -- 172.21.15.17:0/2007975542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddf0070f40 msgr2=0x7fddf01a48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:44.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.646+0000 7fddf5e00640 1 --2- 172.21.15.17:0/2007975542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddf0070f40 0x7fddf01a48c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00e9f0 tx=0x7fdddc00eeb0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.647+0000 7fddf5e00640 1 -- 172.21.15.17:0/2007975542 shutdown_connections 2024-09-13T16:09:44.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.647+0000 7fddf5e00640 1 --2- 172.21.15.17:0/2007975542 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fddd80a11b0 0x7fddd80a3670 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.647+0000 7fddf5e00640 1 --2- 172.21.15.17:0/2007975542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddf010bdc0 0x7fddf01abe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.647+0000 7fddf5e00640 1 --2- 172.21.15.17:0/2007975542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0071860 0x7fddf01a4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.647+0000 7fddf5e00640 1 --2- 172.21.15.17:0/2007975542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddf0070f40 0x7fddf01a48c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:44.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.647+0000 7fddf5e00640 1 -- 172.21.15.17:0/2007975542 >> 172.21.15.17:0/2007975542 conn(0x7fddf006cd10 msgr2=0x7fddf006dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:44.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.647+0000 7fddf5e00640 1 -- 172.21.15.17:0/2007975542 shutdown_connections 2024-09-13T16:09:44.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:44.647+0000 7fddf5e00640 1 -- 172.21.15.17:0/2007975542 wait complete. 2024-09-13T16:09:45.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 720.0 s, 450.6 tps, lat 223.662 ms stddev 273.700 2024-09-13T16:09:46.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:45 smithi193 ceph-mon[35248]: pgmap v745: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 674 op/s 2024-09-13T16:09:46.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:45 smithi017 ceph-mon[30494]: pgmap v745: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 674 op/s 2024-09-13T16:09:46.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:45 smithi189 ceph-mon[34790]: pgmap v745: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 674 op/s 2024-09-13T16:09:48.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:47 smithi193 ceph-mon[35248]: pgmap v746: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.3 MiB/s wr, 654 op/s 2024-09-13T16:09:48.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:47 smithi017 ceph-mon[30494]: pgmap v746: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.3 MiB/s wr, 654 op/s 2024-09-13T16:09:48.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:47 smithi189 ceph-mon[34790]: pgmap v746: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.3 MiB/s wr, 654 op/s 2024-09-13T16:09:50.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:49 smithi193 ceph-mon[35248]: pgmap v747: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.0 MiB/s wr, 600 op/s 2024-09-13T16:09:50.013 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:49 smithi017 ceph-mon[30494]: pgmap v747: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.0 MiB/s wr, 600 op/s 2024-09-13T16:09:50.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:49 smithi189 ceph-mon[34790]: pgmap v747: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.0 MiB/s wr, 600 op/s 2024-09-13T16:09:50.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 725.0 s, 534.0 tps, lat 193.812 ms stddev 255.404 2024-09-13T16:09:52.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:51 smithi193 ceph-mon[35248]: pgmap v748: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.1 MiB/s wr, 622 op/s 2024-09-13T16:09:52.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:51 smithi017 ceph-mon[30494]: pgmap v748: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.1 MiB/s wr, 622 op/s 2024-09-13T16:09:52.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:51 smithi189 ceph-mon[34790]: pgmap v748: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.1 MiB/s wr, 622 op/s 2024-09-13T16:09:54.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:53 smithi193 ceph-mon[35248]: pgmap v749: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.8 MiB/s wr, 615 op/s 2024-09-13T16:09:54.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:53 smithi017 ceph-mon[30494]: pgmap v749: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.8 MiB/s wr, 615 op/s 2024-09-13T16:09:54.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:53 smithi189 ceph-mon[34790]: pgmap v749: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.8 MiB/s wr, 615 op/s 2024-09-13T16:09:55.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 730.0 s, 504.2 tps, lat 191.880 ms stddev 226.752 2024-09-13T16:09:56.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:55 smithi193 ceph-mon[35248]: pgmap v750: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.5 MiB/s wr, 552 op/s 2024-09-13T16:09:56.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:55 smithi017 ceph-mon[30494]: pgmap v750: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.5 MiB/s wr, 552 op/s 2024-09-13T16:09:56.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:55 smithi189 ceph-mon[34790]: pgmap v750: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.5 MiB/s wr, 552 op/s 2024-09-13T16:09:57.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.820+0000 7f84f3e00640 1 -- 172.21.15.17:0/892688541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84f4100640 msgr2=0x7f84f4102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:57.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.820+0000 7f84f3e00640 1 --2- 172.21.15.17:0/892688541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84f4100640 0x7f84f4102a30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009900 tx=0x7f84dc02a3f0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.820+0000 7f84f3e00640 1 -- 172.21.15.17:0/892688541 shutdown_connections 2024-09-13T16:09:57.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.820+0000 7f84f3e00640 1 --2- 172.21.15.17:0/892688541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84f41058f0 0x7f84f4107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.820+0000 7f84f3e00640 1 --2- 172.21.15.17:0/892688541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84f4102f70 0x7f84f4105360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.820+0000 7f84f3e00640 1 --2- 172.21.15.17:0/892688541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84f4100640 0x7f84f4102a30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.820+0000 7f84f3e00640 1 -- 172.21.15.17:0/892688541 >> 172.21.15.17:0/892688541 conn(0x7f84f40fa1c0 msgr2=0x7f84f40fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:57.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.820+0000 7f84f3e00640 1 -- 172.21.15.17:0/892688541 shutdown_connections 2024-09-13T16:09:57.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.820+0000 7f84f3e00640 1 -- 172.21.15.17:0/892688541 wait complete. 2024-09-13T16:09:57.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.821+0000 7f84f3e00640 1 Processor -- start 2024-09-13T16:09:57.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.821+0000 7f84f3e00640 1 -- start start 2024-09-13T16:09:57.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.822+0000 7f84f3e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84f4100640 0x7f84f4195bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:57.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.822+0000 7f84f3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84f4102f70 0x7f84f4196100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:57.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.822+0000 7f84f3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84f41058f0 0x7f84f419d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:57.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.822+0000 7f84f3e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f419d6b0 con 0x7f84f4102f70 2024-09-13T16:09:57.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.822+0000 7f84f3e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f419d820 con 0x7f84f41058f0 2024-09-13T16:09:57.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.822+0000 7f84f3e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f419d9e0 con 0x7f84f4100640 2024-09-13T16:09:57.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.822+0000 7f84ebe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84f4102f70 0x7f84f4196100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:57.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.822+0000 7f84f2a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84f4100640 0x7f84f4195bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:57.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.822+0000 7f84f2a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84f4100640 0x7f84f4195bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:45582/0 (socket says 172.21.15.17:45582) 2024-09-13T16:09:57.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.822+0000 7f84f2a00640 1 -- 172.21.15.17:0/4051257565 learned_addr learned my addr 172.21.15.17:0/4051257565 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:57.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.822+0000 7f84f3400640 1 --2- 172.21.15.17:0/4051257565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84f41058f0 0x7f84f419d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:57.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.823+0000 7f84f3400640 1 -- 172.21.15.17:0/4051257565 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84f4100640 msgr2=0x7f84f4195bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:57.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.823+0000 7f84f3400640 1 --2- 172.21.15.17:0/4051257565 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84f4100640 0x7f84f4195bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.823+0000 7f84f3400640 1 -- 172.21.15.17:0/4051257565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84f4102f70 msgr2=0x7f84f4196100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:57.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.823+0000 7f84f3400640 1 --2- 172.21.15.17:0/4051257565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84f4102f70 0x7f84f4196100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.823+0000 7f84f3400640 1 -- 172.21.15.17:0/4051257565 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e4009490 con 0x7f84f41058f0 2024-09-13T16:09:57.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.823+0000 7f84f2a00640 1 --2- 172.21.15.17:0/4051257565 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84f4100640 0x7f84f4195bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:09:57.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.823+0000 7f84f3400640 1 --2- 172.21.15.17:0/4051257565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84f41058f0 0x7f84f419d170 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f84ec009fd0 tx=0x7f84ec00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:57.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.824+0000 7f84eb400640 1 -- 172.21.15.17:0/4051257565 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec00ce20 con 0x7f84f41058f0 2024-09-13T16:09:57.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.824+0000 7f84f3e00640 1 -- 172.21.15.17:0/4051257565 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84dc009560 con 0x7f84f41058f0 2024-09-13T16:09:57.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.824+0000 7f84eb400640 1 -- 172.21.15.17:0/4051257565 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84ec005020 con 0x7f84f41058f0 2024-09-13T16:09:57.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.824+0000 7f84eb400640 1 -- 172.21.15.17:0/4051257565 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec010670 con 0x7f84f41058f0 2024-09-13T16:09:57.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.824+0000 7f84f3e00640 1 -- 172.21.15.17:0/4051257565 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f40fe810 con 0x7f84f41058f0 2024-09-13T16:09:57.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.827+0000 7f84eb400640 1 -- 172.21.15.17:0/4051257565 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f84ec005450 con 0x7f84f41058f0 2024-09-13T16:09:57.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.827+0000 7f84fc8d5740 1 Processor -- start 2024-09-13T16:09:57.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.827+0000 7f84fc8d5740 1 -- start start 2024-09-13T16:09:57.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.828+0000 7f84fc8d5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719ec80 0x564b7719f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:57.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.828+0000 7f84fc8d5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b7719f5c0 0x564b771a4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:57.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.828+0000 7f84fc8d5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b771a4650 0x564b771a6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:57.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.828+0000 7f84fc8d5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b770aabb0 con 0x564b771a4650 2024-09-13T16:09:57.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.828+0000 7f84fc8d5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b77108a70 con 0x564b7719f5c0 2024-09-13T16:09:57.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.828+0000 7f84fc8d5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b77106200 con 0x564b7719ec80 2024-09-13T16:09:57.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.828+0000 7f84f2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b7719f5c0 0x564b771a4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:57.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.828+0000 7f84ebe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719ec80 0x564b7719f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:57.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.828+0000 7f84f2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b7719f5c0 0x564b771a4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:46340/0 (socket says 172.21.15.17:46340) 2024-09-13T16:09:57.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.828+0000 7f84f2a00640 1 -- 172.21.15.17:0/3183624078 learned_addr learned my addr 172.21.15.17:0/3183624078 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:57.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.828+0000 7f84ebe00640 1 --2- 172.21.15.17:0/3183624078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b771a4650 0x564b771a6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:57.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.829+0000 7f84f2a00640 1 -- 172.21.15.17:0/3183624078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719ec80 msgr2=0x564b7719f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:57.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.829+0000 7f84f2a00640 1 --2- 172.21.15.17:0/3183624078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719ec80 0x564b7719f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.829+0000 7f84f2a00640 1 -- 172.21.15.17:0/3183624078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b771a4650 msgr2=0x564b771a6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:57.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.829+0000 7f84f2a00640 1 --2- 172.21.15.17:0/3183624078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b771a4650 0x564b771a6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.829+0000 7f84f2a00640 1 -- 172.21.15.17:0/3183624078 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b770a3940 con 0x564b7719f5c0 2024-09-13T16:09:57.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.829+0000 7f84eb400640 1 --2- 172.21.15.17:0/4051257565 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f84d40a11b0 0x7f84d40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:57.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.829+0000 7f84eb400640 1 -- 172.21.15.17:0/4051257565 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f84ec014070 con 0x7f84f41058f0 2024-09-13T16:09:57.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.829+0000 7f84f2a00640 1 --2- 172.21.15.17:0/3183624078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b7719f5c0 0x564b771a4080 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f84dc006010 tx=0x7f84dc004470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3d42d210e70bac8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:57.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.829+0000 7f84ebe00640 1 --2- 172.21.15.17:0/4051257565 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f84d40a11b0 0x7f84d40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:57.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.829+0000 7f84e3e00640 1 -- 172.21.15.17:0/3183624078 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc005340 con 0x564b7719f5c0 2024-09-13T16:09:57.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.829+0000 7f84e3e00640 1 -- 172.21.15.17:0/3183624078 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84dc0054a0 con 0x564b7719f5c0 2024-09-13T16:09:57.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.829+0000 7f84e3e00640 1 -- 172.21.15.17:0/3183624078 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc003ba0 con 0x564b7719f5c0 2024-09-13T16:09:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.830+0000 7f84ebe00640 1 --2- 172.21.15.17:0/4051257565 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f84d40a11b0 0x7f84d40a3670 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f84e4009fd0 tx=0x7f84e4013040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.830+0000 7f84fc8d5740 1 -- 172.21.15.17:0/3183624078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b7719f5c0 msgr2=0x564b771a4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.830+0000 7f84fc8d5740 1 --2- 172.21.15.17:0/3183624078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b7719f5c0 0x564b771a4080 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f84dc006010 tx=0x7f84dc004470 comp rx=0 tx=0).stop 2024-09-13T16:09:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.831+0000 7f84fc8d5740 1 -- 172.21.15.17:0/3183624078 shutdown_connections 2024-09-13T16:09:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.831+0000 7f84fc8d5740 1 --2- 172.21.15.17:0/3183624078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b771a4650 0x564b771a6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.831+0000 7f84fc8d5740 1 --2- 172.21.15.17:0/3183624078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b7719f5c0 0x564b771a4080 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.831+0000 7f84fc8d5740 1 --2- 172.21.15.17:0/3183624078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719ec80 0x564b7719f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.831+0000 7f84fc8d5740 1 -- 172.21.15.17:0/3183624078 >> 172.21.15.17:0/3183624078 conn(0x564b7719a2f0 msgr2=0x564b7719a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.831+0000 7f84fc8d5740 1 -- 172.21.15.17:0/3183624078 shutdown_connections 2024-09-13T16:09:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.831+0000 7f84fc8d5740 1 -- 172.21.15.17:0/3183624078 wait complete. 2024-09-13T16:09:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.831+0000 7f84fc8d5740 1 -- start start 2024-09-13T16:09:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.831+0000 7f84fc8d5740 1 Processor -- start 2024-09-13T16:09:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.832+0000 7f84fc8d5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b7719ec80 0x564b771a8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.832+0000 7f84fc8d5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719f5c0 0x564b771a8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.832+0000 7f84fc8d5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b771a4650 0x564b771afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.832+0000 7f84fc8d5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b77101af0 con 0x564b771a4650 2024-09-13T16:09:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.832+0000 7f84fc8d5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b770bff20 con 0x564b7719ec80 2024-09-13T16:09:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.832+0000 7f84fc8d5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b770bfbc0 con 0x564b7719f5c0 2024-09-13T16:09:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.832+0000 7f84fc8d5740 10 client.0 _ll_register_callbacks cb 0x564b770f1a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:09:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.832+0000 7f84f3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b771a4650 0x564b771afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.832+0000 7f84ebe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719f5c0 0x564b771a8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.832+0000 7f84f2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b7719ec80 0x564b771a8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.832+0000 7f84f3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b771a4650 0x564b771afdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51116/0 (socket says 172.21.15.17:51116) 2024-09-13T16:09:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.832+0000 7f84f3400640 1 -- 172.21.15.17:0/295905488 learned_addr learned my addr 172.21.15.17:0/295905488 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:57.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.833+0000 7f84f2a00640 1 -- 172.21.15.17:0/295905488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719f5c0 msgr2=0x564b771a8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:57.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.833+0000 7f84f2a00640 1 --2- 172.21.15.17:0/295905488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719f5c0 0x564b771a8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.833+0000 7f84f2a00640 1 -- 172.21.15.17:0/295905488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b771a4650 msgr2=0x564b771afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:57.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.835+0000 7f84f2a00640 1 --2- 172.21.15.17:0/295905488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b771a4650 0x564b771afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.835+0000 7f84f2a00640 1 -- 172.21.15.17:0/295905488 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f4108990 con 0x564b7719ec80 2024-09-13T16:09:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.835+0000 7f84ebe00640 1 --2- 172.21.15.17:0/295905488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719f5c0 0x564b771a8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:09:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.835+0000 7f84f3400640 1 --2- 172.21.15.17:0/295905488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b771a4650 0x564b771afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:09:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.835+0000 7f84f2a00640 1 --2- 172.21.15.17:0/295905488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b7719ec80 0x564b771a8850 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009a20 tx=0x7f84dc005370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a68087a3e692d963 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.835+0000 7f84e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:09:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.836+0000 7f84e0c00640 1 -- 172.21.15.17:0/295905488 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc052070 con 0x564b7719ec80 2024-09-13T16:09:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.836+0000 7f84e0c00640 1 -- 172.21.15.17:0/295905488 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f84dc003bf0 con 0x564b7719ec80 2024-09-13T16:09:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.836+0000 7f84fc8d5740 1 -- 172.21.15.17:0/295905488 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b7712bc90 con 0x564b7719ec80 2024-09-13T16:09:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.836+0000 7f84e0c00640 1 -- 172.21.15.17:0/295905488 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84dc04a040 con 0x564b7719ec80 2024-09-13T16:09:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.836+0000 7f84fc8d5740 10 client.26237 fetch_fsmap learned FSMap version 47 2024-09-13T16:09:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.836+0000 7f84fc8d5740 1 -- 172.21.15.17:0/295905488 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x564b77100170 con 0x564b7719ec80 2024-09-13T16:09:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.837+0000 7f84e0c00640 1 -- 172.21.15.17:0/295905488 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564b7712bc90 con 0x564b7719ec80 2024-09-13T16:09:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.837+0000 7f84e0c00640 1 -- 172.21.15.17:0/295905488 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 47) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f84dc055030 con 0x564b7719ec80 2024-09-13T16:09:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.837+0000 7f84fc8d5740 10 client.26237 fetch_fsmap finished waiting for FSMap version 47 2024-09-13T16:09:57.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.837+0000 7f84fc8d5740 10 client.26237 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:09:57.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.837+0000 7f84fc8d5740 20 client.26237 populate_metadata read hostname 'smithi017' 2024-09-13T16:09:57.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.837+0000 7f84fc8d5740 1 --2- 172.21.15.17:0/295905488 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564b771b41c0 0x564b771b65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:57.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.837+0000 7f84fc8d5740 4 client.26237 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:09:57.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.837+0000 7f84fc8d5740 1 -- 172.21.15.17:0/295905488 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b770f47d0 con 0x564b771b41c0 2024-09-13T16:09:57.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.838+0000 7f84ebe00640 1 --2- 172.21.15.17:0/295905488 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564b771b41c0 0x564b771b65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:57.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.839+0000 7f84ebe00640 1 --2- 172.21.15.17:0/295905488 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564b771b41c0 0x564b771b65b0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c31c6239eca1e2b server_cookie=952cd3288f0527c4 in_seq=0 out_seq=0 2024-09-13T16:09:57.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.839+0000 7f84e0c00640 10 client.26237 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:09:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.839+0000 7f84e0c00640 1 -- 172.21.15.17:0/295905488 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564b770f47d0 con 0x564b771b41c0 2024-09-13T16:09:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.839+0000 7f84e0c00640 10 client.26237 handle_command_reply: tid=0 2024-09-13T16:09:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.839+0000 7f84fc8d5740 1 client.26237 shutdown 2024-09-13T16:09:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.840+0000 7f84fc8d5740 1 -- 172.21.15.17:0/295905488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b7719ec80 msgr2=0x564b771a8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.840+0000 7f84fc8d5740 1 --2- 172.21.15.17:0/295905488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b7719ec80 0x564b771a8850 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009a20 tx=0x7f84dc005370 comp rx=0 tx=0).stop 2024-09-13T16:09:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.840+0000 7f84fc8d5740 1 -- 172.21.15.17:0/295905488 shutdown_connections 2024-09-13T16:09:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.840+0000 7f84fc8d5740 1 --2- 172.21.15.17:0/295905488 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564b771b41c0 0x564b771b65b0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.840+0000 7f84fc8d5740 1 --2- 172.21.15.17:0/295905488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b771a4650 0x564b771afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.840+0000 7f84fc8d5740 1 --2- 172.21.15.17:0/295905488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719f5c0 0x564b771a8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.840+0000 7f84fc8d5740 1 --2- 172.21.15.17:0/295905488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b7719ec80 0x564b771a8850 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.840+0000 7f84fc8d5740 1 -- 172.21.15.17:0/295905488 >> 172.21.15.17:0/295905488 conn(0x564b7719a2f0 msgr2=0x564b7719bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.840+0000 7f84e0c00640 0 client.26237 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:09:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.840+0000 7f84fc8d5740 1 -- 172.21.15.17:0/295905488 shutdown_connections 2024-09-13T16:09:57.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.840+0000 7f84fc8d5740 1 -- 172.21.15.17:0/295905488 wait complete. 2024-09-13T16:09:57.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.840+0000 7f84fc8d5740 20 client.26237 trim_cache size 0 max 16384 2024-09-13T16:09:57.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.857+0000 7f84fc8d5740 1 Processor -- start 2024-09-13T16:09:57.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.857+0000 7f84fc8d5740 1 -- start start 2024-09-13T16:09:57.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.858+0000 7f84fc8d5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b7719ec80 0x564b771a0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:57.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.858+0000 7f84fc8d5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719f5c0 0x564b771a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:57.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.858+0000 7f84fc8d5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b771a4650 0x564b771afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:57.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.858+0000 7f84fc8d5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b76e68e60 con 0x564b771a4650 2024-09-13T16:09:57.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.858+0000 7f84fc8d5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b771b3fc0 con 0x564b7719ec80 2024-09-13T16:09:57.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.858+0000 7f84fc8d5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b771b0230 con 0x564b7719f5c0 2024-09-13T16:09:57.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.858+0000 7f84f2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b7719ec80 0x564b771a0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:57.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.858+0000 7f84f2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b7719ec80 0x564b771a0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:46372/0 (socket says 172.21.15.17:46372) 2024-09-13T16:09:57.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.858+0000 7f84f2a00640 1 -- 172.21.15.17:0/387097600 learned_addr learned my addr 172.21.15.17:0/387097600 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:57.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.858+0000 7f84f3400640 1 --2- 172.21.15.17:0/387097600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b771a4650 0x564b771afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:57.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.858+0000 7f84ebe00640 1 --2- 172.21.15.17:0/387097600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719f5c0 0x564b771a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:57.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.858+0000 7f84f2a00640 1 -- 172.21.15.17:0/387097600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719f5c0 msgr2=0x564b771a09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:57.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.858+0000 7f84f2a00640 1 --2- 172.21.15.17:0/387097600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719f5c0 0x564b771a09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.858+0000 7f84f2a00640 1 -- 172.21.15.17:0/387097600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b771a4650 msgr2=0x564b771afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:57.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.858+0000 7f84f2a00640 1 --2- 172.21.15.17:0/387097600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b771a4650 0x564b771afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.858+0000 7f84f2a00640 1 -- 172.21.15.17:0/387097600 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b770a2180 con 0x564b7719ec80 2024-09-13T16:09:57.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.859+0000 7f84f2a00640 1 --2- 172.21.15.17:0/387097600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b7719ec80 0x564b771a0480 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0036d0 tx=0x7f84dc005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba541384e24d7fc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:57.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.859+0000 7f84e8c00640 1 -- 172.21.15.17:0/387097600 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc052070 con 0x564b7719ec80 2024-09-13T16:09:57.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.859+0000 7f84e8c00640 1 -- 172.21.15.17:0/387097600 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84dc003770 con 0x564b7719ec80 2024-09-13T16:09:57.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.859+0000 7f84e8c00640 1 -- 172.21.15.17:0/387097600 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc04a030 con 0x564b7719ec80 2024-09-13T16:09:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.860+0000 7f84fc8d5740 1 -- 172.21.15.17:0/387097600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b7719ec80 msgr2=0x564b771a0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.860+0000 7f84fc8d5740 1 --2- 172.21.15.17:0/387097600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b7719ec80 0x564b771a0480 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0036d0 tx=0x7f84dc005fd0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.860+0000 7f84fc8d5740 1 -- 172.21.15.17:0/387097600 shutdown_connections 2024-09-13T16:09:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.860+0000 7f84fc8d5740 1 --2- 172.21.15.17:0/387097600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b771a4650 0x564b771afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.860+0000 7f84fc8d5740 1 --2- 172.21.15.17:0/387097600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719f5c0 0x564b771a09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.860+0000 7f84fc8d5740 1 --2- 172.21.15.17:0/387097600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b7719ec80 0x564b771a0480 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.860+0000 7f84fc8d5740 1 -- 172.21.15.17:0/387097600 >> 172.21.15.17:0/387097600 conn(0x564b7719a2f0 msgr2=0x564b771baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.860+0000 7f84fc8d5740 1 -- 172.21.15.17:0/387097600 shutdown_connections 2024-09-13T16:09:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.860+0000 7f84fc8d5740 1 -- 172.21.15.17:0/387097600 wait complete. 2024-09-13T16:09:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.861+0000 7f84fc8d5740 1 -- start start 2024-09-13T16:09:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.861+0000 7f84fc8d5740 1 Processor -- start 2024-09-13T16:09:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.861+0000 7f84fc8d5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719ec80 0x564b771ab530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.861+0000 7f84fc8d5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b7719f5c0 0x564b771aba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.861+0000 7f84fc8d5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b771a4650 0x564b771aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.861+0000 7f84fc8d5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b771aef80 con 0x564b7719f5c0 2024-09-13T16:09:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.861+0000 7f84fc8d5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b771af0f0 con 0x564b771a4650 2024-09-13T16:09:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.861+0000 7f84fc8d5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b771af2b0 con 0x564b7719ec80 2024-09-13T16:09:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.861+0000 7f84fc8d5740 10 client.0 _ll_register_callbacks cb 0x7f84e4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:09:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.861+0000 7f84f2a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719ec80 0x564b771ab530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.861+0000 7f84ebe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b7719f5c0 0x564b771aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.861+0000 7f84f2a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719ec80 0x564b771ab530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:45614/0 (socket says 172.21.15.17:45614) 2024-09-13T16:09:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.861+0000 7f84f2a00640 1 -- 172.21.15.17:0/1922741856 learned_addr learned my addr 172.21.15.17:0/1922741856 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:09:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.861+0000 7f84f3400640 1 --2- 172.21.15.17:0/1922741856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b771a4650 0x564b771aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.862+0000 7f84f2a00640 1 -- 172.21.15.17:0/1922741856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b771a4650 msgr2=0x564b771aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.862+0000 7f84f2a00640 1 --2- 172.21.15.17:0/1922741856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b771a4650 0x564b771aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.862+0000 7f84f2a00640 1 -- 172.21.15.17:0/1922741856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b7719f5c0 msgr2=0x564b771aba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:09:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.862+0000 7f84f2a00640 1 --2- 172.21.15.17:0/1922741856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b7719f5c0 0x564b771aba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.862+0000 7f84f2a00640 1 -- 172.21.15.17:0/1922741856 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b77100170 con 0x564b7719ec80 2024-09-13T16:09:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.862+0000 7f84f2a00640 1 --2- 172.21.15.17:0/1922741856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719ec80 0x564b771ab530 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f84dc02a9e0 tx=0x7f84dc02a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c84f05a056c4964 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:09:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.862+0000 7f84e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:09:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.862+0000 7f84e0c00640 1 -- 172.21.15.17:0/1922741856 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc052070 con 0x564b7719ec80 2024-09-13T16:09:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.862+0000 7f84fc8d5740 1 -- 172.21.15.17:0/1922741856 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f84dc0054a0 con 0x564b7719ec80 2024-09-13T16:09:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.862+0000 7f84e0c00640 1 -- 172.21.15.17:0/1922741856 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f84dc000e40 con 0x564b7719ec80 2024-09-13T16:09:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.863+0000 7f84e0c00640 1 -- 172.21.15.17:0/1922741856 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84dc0048c0 con 0x564b7719ec80 2024-09-13T16:09:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.863+0000 7f84fc8d5740 10 client.26281 fetch_fsmap learned FSMap version 47 2024-09-13T16:09:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.863+0000 7f84fc8d5740 1 -- 172.21.15.17:0/1922741856 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x564b770c7560 con 0x564b7719ec80 2024-09-13T16:09:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.863+0000 7f84e0c00640 1 -- 172.21.15.17:0/1922741856 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84dc0054a0 con 0x564b7719ec80 2024-09-13T16:09:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.863+0000 7f84e0c00640 1 -- 172.21.15.17:0/1922741856 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 47) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f84dc05d040 con 0x564b7719ec80 2024-09-13T16:09:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.863+0000 7f84fc8d5740 10 client.26281 fetch_fsmap finished waiting for FSMap version 47 2024-09-13T16:09:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.863+0000 7f84fc8d5740 10 client.26281 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:09:57.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.863+0000 7f84fc8d5740 20 client.26281 populate_metadata read hostname 'smithi017' 2024-09-13T16:09:57.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.863+0000 7f84fc8d5740 1 --2- 172.21.15.17:0/1922741856 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564b7720ac90 0x564b7720d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:09:57.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.863+0000 7f84fc8d5740 4 client.26281 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:09:57.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.863+0000 7f84fc8d5740 1 -- 172.21.15.17:0/1922741856 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564b76df5300 con 0x564b7720ac90 2024-09-13T16:09:57.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.863+0000 7f84ebe00640 1 --2- 172.21.15.17:0/1922741856 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564b7720ac90 0x564b7720d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:09:57.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.864+0000 7f84ebe00640 1 --2- 172.21.15.17:0/1922741856 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564b7720ac90 0x564b7720d080 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb00ce1d97b80dbf server_cookie=f60c3e2d635f102c in_seq=0 out_seq=0 2024-09-13T16:09:57.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.864+0000 7f84e0c00640 10 client.26281 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:09:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.870+0000 7f84e0c00640 1 -- 172.21.15.17:0/1922741856 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564b76df5300 con 0x564b7720ac90 2024-09-13T16:09:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.870+0000 7f84e0c00640 10 client.26281 handle_command_reply: tid=0 2024-09-13T16:09:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.871+0000 7f84fc8d5740 1 client.26281 shutdown 2024-09-13T16:09:57.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.871+0000 7f84fc8d5740 1 -- 172.21.15.17:0/1922741856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719ec80 msgr2=0x564b771ab530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:57.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.871+0000 7f84fc8d5740 1 --2- 172.21.15.17:0/1922741856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719ec80 0x564b771ab530 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f84dc02a9e0 tx=0x7f84dc02a3f0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.871+0000 7f84fc8d5740 1 -- 172.21.15.17:0/1922741856 shutdown_connections 2024-09-13T16:09:57.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.871+0000 7f84fc8d5740 1 --2- 172.21.15.17:0/1922741856 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564b7720ac90 0x564b7720d080 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.871+0000 7f84fc8d5740 1 --2- 172.21.15.17:0/1922741856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b771a4650 0x564b771aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.871+0000 7f84fc8d5740 1 --2- 172.21.15.17:0/1922741856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b7719f5c0 0x564b771aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.871+0000 7f84fc8d5740 1 --2- 172.21.15.17:0/1922741856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b7719ec80 0x564b771ab530 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.871+0000 7f84fc8d5740 1 -- 172.21.15.17:0/1922741856 >> 172.21.15.17:0/1922741856 conn(0x564b7719a2f0 msgr2=0x564b771a0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:57.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.871+0000 7f84e0c00640 0 client.26281 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:09:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.872+0000 7f84fc8d5740 1 -- 172.21.15.17:0/1922741856 shutdown_connections 2024-09-13T16:09:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.872+0000 7f84fc8d5740 1 -- 172.21.15.17:0/1922741856 wait complete. 2024-09-13T16:09:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.872+0000 7f84fc8d5740 20 client.26281 trim_cache size 0 max 16384 2024-09-13T16:09:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:09:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:09:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:09:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:09:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.873+0000 7f84f3e00640 1 -- 172.21.15.17:0/4051257565 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f84d40a11b0 msgr2=0x7f84d40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.873+0000 7f84f3e00640 1 --2- 172.21.15.17:0/4051257565 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f84d40a11b0 0x7f84d40a3670 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f84e4009fd0 tx=0x7f84e4013040 comp rx=0 tx=0).stop 2024-09-13T16:09:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.873+0000 7f84f3e00640 1 -- 172.21.15.17:0/4051257565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84f41058f0 msgr2=0x7f84f419d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:09:57.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.873+0000 7f84f3e00640 1 --2- 172.21.15.17:0/4051257565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84f41058f0 0x7f84f419d170 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f84ec009fd0 tx=0x7f84ec00ef10 comp rx=0 tx=0).stop 2024-09-13T16:09:57.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.873+0000 7f84f3e00640 1 -- 172.21.15.17:0/4051257565 shutdown_connections 2024-09-13T16:09:57.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.873+0000 7f84f3e00640 1 --2- 172.21.15.17:0/4051257565 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f84d40a11b0 0x7f84d40a3670 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.873+0000 7f84f3e00640 1 --2- 172.21.15.17:0/4051257565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84f41058f0 0x7f84f419d170 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.873+0000 7f84f3e00640 1 --2- 172.21.15.17:0/4051257565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84f4102f70 0x7f84f4196100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.873+0000 7f84f3e00640 1 --2- 172.21.15.17:0/4051257565 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84f4100640 0x7f84f4195bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:09:57.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.873+0000 7f84f3e00640 1 -- 172.21.15.17:0/4051257565 >> 172.21.15.17:0/4051257565 conn(0x7f84f40fa1c0 msgr2=0x7f84f4100fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:09:57.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.873+0000 7f84f3e00640 1 -- 172.21.15.17:0/4051257565 shutdown_connections 2024-09-13T16:09:57.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:09:57.874+0000 7f84f3e00640 1 -- 172.21.15.17:0/4051257565 wait complete. 2024-09-13T16:09:58.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:57 smithi193 ceph-mon[35248]: pgmap v751: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.2 MiB/s wr, 521 op/s 2024-09-13T16:09:58.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:57 smithi017 ceph-mon[30494]: pgmap v751: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.2 MiB/s wr, 521 op/s 2024-09-13T16:09:58.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:57 smithi189 ceph-mon[34790]: pgmap v751: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.2 MiB/s wr, 521 op/s 2024-09-13T16:10:00.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:09:59 smithi193 ceph-mon[35248]: pgmap v752: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.5 MiB/s wr, 490 op/s 2024-09-13T16:10:00.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:09:59 smithi017 ceph-mon[30494]: pgmap v752: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.5 MiB/s wr, 490 op/s 2024-09-13T16:10:00.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:09:59 smithi189 ceph-mon[34790]: pgmap v752: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.5 MiB/s wr, 490 op/s 2024-09-13T16:10:00.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 735.0 s, 517.2 tps, lat 194.353 ms stddev 241.610 2024-09-13T16:10:01.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:00 smithi193 ceph-mon[35248]: overall HEALTH_OK 2024-09-13T16:10:01.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:00 smithi017 ceph-mon[30494]: overall HEALTH_OK 2024-09-13T16:10:01.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:00 smithi189 ceph-mon[34790]: overall HEALTH_OK 2024-09-13T16:10:02.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:01 smithi193 ceph-mon[35248]: pgmap v753: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.2 MiB/s wr, 516 op/s 2024-09-13T16:10:02.006 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:01 smithi189 ceph-mon[34790]: pgmap v753: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.2 MiB/s wr, 516 op/s 2024-09-13T16:10:02.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:01 smithi017 ceph-mon[30494]: pgmap v753: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.2 MiB/s wr, 516 op/s 2024-09-13T16:10:04.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:03 smithi189 ceph-mon[34790]: pgmap v754: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.8 MiB/s wr, 536 op/s 2024-09-13T16:10:04.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:03 smithi193 ceph-mon[35248]: pgmap v754: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.8 MiB/s wr, 536 op/s 2024-09-13T16:10:04.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:03 smithi017 ceph-mon[30494]: pgmap v754: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.8 MiB/s wr, 536 op/s 2024-09-13T16:10:05.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:04 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:10:05.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:04 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:10:05.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:04 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:10:05.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 740.0 s, 499.8 tps, lat 202.186 ms stddev 232.020 2024-09-13T16:10:06.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:05 smithi189 ceph-mon[34790]: pgmap v755: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.0 MiB/s wr, 473 op/s 2024-09-13T16:10:06.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:05 smithi193 ceph-mon[35248]: pgmap v755: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.0 MiB/s wr, 473 op/s 2024-09-13T16:10:06.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:05 smithi017 ceph-mon[30494]: pgmap v755: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.0 MiB/s wr, 473 op/s 2024-09-13T16:10:08.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:07 smithi189 ceph-mon[34790]: pgmap v756: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.1 MiB/s wr, 500 op/s 2024-09-13T16:10:08.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:07 smithi193 ceph-mon[35248]: pgmap v756: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.1 MiB/s wr, 500 op/s 2024-09-13T16:10:08.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:07 smithi017 ceph-mon[30494]: pgmap v756: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.1 MiB/s wr, 500 op/s 2024-09-13T16:10:10.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:09 smithi189 ceph-mon[34790]: pgmap v757: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.0 MiB/s wr, 466 op/s 2024-09-13T16:10:10.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:09 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:10:10.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:09 smithi193 ceph-mon[35248]: pgmap v757: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.0 MiB/s wr, 466 op/s 2024-09-13T16:10:10.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:09 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:10:10.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:09 smithi017 ceph-mon[30494]: pgmap v757: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.0 MiB/s wr, 466 op/s 2024-09-13T16:10:10.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:09 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:10:10.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 745.0 s, 523.2 tps, lat 193.139 ms stddev 229.838 2024-09-13T16:10:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.504+0000 7f17f5a00640 1 -- 172.21.15.17:0/286444397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17f0072f10 msgr2=0x7f17f0073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.504+0000 7f17f5a00640 1 --2- 172.21.15.17:0/286444397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17f0072f10 0x7f17f0073370 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f17dc009860 tx=0x7f17dc02a380 comp rx=0 tx=0).stop 2024-09-13T16:10:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.505+0000 7f17f5a00640 1 -- 172.21.15.17:0/286444397 shutdown_connections 2024-09-13T16:10:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.505+0000 7f17f5a00640 1 --2- 172.21.15.17:0/286444397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17f010c120 0x7f17f010e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.505+0000 7f17f5a00640 1 --2- 172.21.15.17:0/286444397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17f0072f10 0x7f17f0073370 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.505+0000 7f17f5a00640 1 --2- 172.21.15.17:0/286444397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17f00744f0 0x7f17f0072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.505+0000 7f17f5a00640 1 -- 172.21.15.17:0/286444397 >> 172.21.15.17:0/286444397 conn(0x7f17f00fb2f0 msgr2=0x7f17f00fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.505+0000 7f17f5a00640 1 -- 172.21.15.17:0/286444397 shutdown_connections 2024-09-13T16:10:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.505+0000 7f17f5a00640 1 -- 172.21.15.17:0/286444397 wait complete. 2024-09-13T16:10:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.506+0000 7f17f5a00640 1 Processor -- start 2024-09-13T16:10:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.507+0000 7f17f5a00640 1 -- start start 2024-09-13T16:10:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.508+0000 7f17f5a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17f00744f0 0x7f17f019c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.508+0000 7f17f5a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17f010c120 0x7f17f019c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.509+0000 7f17f5a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17f01a19a0 0x7f17f01a3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.509+0000 7f17efe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17f00744f0 0x7f17f019c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.509+0000 7f17efe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17f00744f0 0x7f17f019c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46208/0 (socket says 172.21.15.17:46208) 2024-09-13T16:10:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.509+0000 7f17f5000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17f01a19a0 0x7f17f01a3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.509+0000 7f17f5000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17f01a19a0 0x7f17f01a3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:39696/0 (socket says 172.21.15.17:39696) 2024-09-13T16:10:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.509+0000 7f17f5a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f01a42d0 con 0x7f17f00744f0 2024-09-13T16:10:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.509+0000 7f17f5a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f01a4440 con 0x7f17f01a19a0 2024-09-13T16:10:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.509+0000 7f17f5a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f01a4600 con 0x7f17f010c120 2024-09-13T16:10:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.509+0000 7f17ef400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17f010c120 0x7f17f019c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.509+0000 7f17efe00640 1 -- 172.21.15.17:0/660721662 learned_addr learned my addr 172.21.15.17:0/660721662 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:10:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.511+0000 7f17f5000640 1 -- 172.21.15.17:0/660721662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17f010c120 msgr2=0x7f17f019c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.511+0000 7f17f5000640 1 --2- 172.21.15.17:0/660721662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17f010c120 0x7f17f019c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.511+0000 7f17f5000640 1 -- 172.21.15.17:0/660721662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17f00744f0 msgr2=0x7f17f019c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.511+0000 7f17f5000640 1 --2- 172.21.15.17:0/660721662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17f00744f0 0x7f17f019c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.511+0000 7f17f5000640 1 -- 172.21.15.17:0/660721662 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17dc009490 con 0x7f17f01a19a0 2024-09-13T16:10:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.511+0000 7f17ef400640 1 --2- 172.21.15.17:0/660721662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17f010c120 0x7f17f019c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.512+0000 7f17f5000640 1 --2- 172.21.15.17:0/660721662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17f01a19a0 0x7f17f01a3d90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f17e800ef00 tx=0x7f17e800c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.513+0000 7f17ecc00640 1 -- 172.21.15.17:0/660721662 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e8004b20 con 0x7f17f01a19a0 2024-09-13T16:10:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.513+0000 7f17ecc00640 1 -- 172.21.15.17:0/660721662 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17e8003e30 con 0x7f17f01a19a0 2024-09-13T16:10:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.513+0000 7f17ecc00640 1 -- 172.21.15.17:0/660721662 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e800b570 con 0x7f17f01a19a0 2024-09-13T16:10:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.513+0000 7f17f5a00640 1 -- 172.21.15.17:0/660721662 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f01a48e0 con 0x7f17f01a19a0 2024-09-13T16:10:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.513+0000 7f17f5a00640 1 -- 172.21.15.17:0/660721662 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f01a4d70 con 0x7f17f01a19a0 2024-09-13T16:10:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.520+0000 7f17f9ea3740 1 Processor -- start 2024-09-13T16:10:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.520+0000 7f17ecc00640 1 -- 172.21.15.17:0/660721662 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f17e800a040 con 0x7f17f01a19a0 2024-09-13T16:10:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.520+0000 7f17f9ea3740 1 -- start start 2024-09-13T16:10:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.521+0000 7f17f9ea3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35ac80 0x564cdb35b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.521+0000 7f17f9ea3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564cdb35b5c0 0x564cdb360080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.521+0000 7f17f9ea3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb360650 0x564cdb362b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.521+0000 7f17f9ea3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb266bb0 con 0x564cdb35b5c0 2024-09-13T16:10:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.521+0000 7f17f9ea3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb2c4a70 con 0x564cdb360650 2024-09-13T16:10:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.521+0000 7f17f9ea3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb2c2200 con 0x564cdb35ac80 2024-09-13T16:10:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.522+0000 7f17ef400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb360650 0x564cdb362b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.522+0000 7f17efe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564cdb35b5c0 0x564cdb360080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.522+0000 7f17ecc00640 1 --2- 172.21.15.17:0/660721662 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f17d40a12a0 0x7f17d40a3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.522+0000 7f17ef400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb360650 0x564cdb362b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:39700/0 (socket says 172.21.15.17:39700) 2024-09-13T16:10:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.522+0000 7f17ef400640 1 -- 172.21.15.17:0/2443370773 learned_addr learned my addr 172.21.15.17:0/2443370773 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:10:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.522+0000 7f17ef400640 1 --2- 172.21.15.17:0/2443370773 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35ac80 0x564cdb35b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.522+0000 7f17ecc00640 1 -- 172.21.15.17:0/660721662 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f17e80cc9e0 con 0x7f17f01a19a0 2024-09-13T16:10:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.524+0000 7f17ef400640 1 -- 172.21.15.17:0/2443370773 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35ac80 msgr2=0x564cdb35b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.524+0000 7f17ef400640 1 --2- 172.21.15.17:0/2443370773 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35ac80 0x564cdb35b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.524+0000 7f17ef400640 1 -- 172.21.15.17:0/2443370773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564cdb35b5c0 msgr2=0x564cdb360080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.524+0000 7f17ef400640 1 --2- 172.21.15.17:0/2443370773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564cdb35b5c0 0x564cdb360080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.524+0000 7f17ef400640 1 -- 172.21.15.17:0/2443370773 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cdb25f940 con 0x564cdb360650 2024-09-13T16:10:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.524+0000 7f17efe00640 1 --2- 172.21.15.17:0/2443370773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564cdb35b5c0 0x564cdb360080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.524+0000 7f17f5000640 1 --2- 172.21.15.17:0/660721662 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f17d40a12a0 0x7f17d40a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.525+0000 7f17ef400640 1 --2- 172.21.15.17:0/2443370773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb360650 0x564cdb362b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f17dc02a970 tx=0x7f17dc02c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3ed49666f2a7779 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.526+0000 7f17e5600640 1 -- 172.21.15.17:0/2443370773 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc032440 con 0x564cdb360650 2024-09-13T16:10:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.526+0000 7f17e5600640 1 -- 172.21.15.17:0/2443370773 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17dc004030 con 0x564cdb360650 2024-09-13T16:10:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.526+0000 7f17e5600640 1 -- 172.21.15.17:0/2443370773 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc032440 con 0x564cdb360650 2024-09-13T16:10:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.527+0000 7f17f9ea3740 1 -- 172.21.15.17:0/2443370773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb360650 msgr2=0x564cdb362b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.527+0000 7f17f9ea3740 1 --2- 172.21.15.17:0/2443370773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb360650 0x564cdb362b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f17dc02a970 tx=0x7f17dc02c040 comp rx=0 tx=0).stop 2024-09-13T16:10:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.527+0000 7f17f5000640 1 --2- 172.21.15.17:0/660721662 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f17d40a12a0 0x7f17d40a3760 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f17e8005fd0 tx=0x7f17e800cf70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.527+0000 7f17f9ea3740 1 -- 172.21.15.17:0/2443370773 shutdown_connections 2024-09-13T16:10:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.527+0000 7f17f9ea3740 1 --2- 172.21.15.17:0/2443370773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb360650 0x564cdb362b10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.527+0000 7f17f9ea3740 1 --2- 172.21.15.17:0/2443370773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564cdb35b5c0 0x564cdb360080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.527+0000 7f17f9ea3740 1 --2- 172.21.15.17:0/2443370773 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35ac80 0x564cdb35b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.527+0000 7f17f9ea3740 1 -- 172.21.15.17:0/2443370773 >> 172.21.15.17:0/2443370773 conn(0x564cdb3562f0 msgr2=0x564cdb3566f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.528+0000 7f17f9ea3740 1 -- 172.21.15.17:0/2443370773 shutdown_connections 2024-09-13T16:10:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.528+0000 7f17f9ea3740 1 -- 172.21.15.17:0/2443370773 wait complete. 2024-09-13T16:10:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.529+0000 7f17f9ea3740 1 -- start start 2024-09-13T16:10:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.529+0000 7f17f9ea3740 1 Processor -- start 2024-09-13T16:10:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.530+0000 7f17f9ea3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35ac80 0x564cdb375920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.530+0000 7f17f9ea3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564cdb35b5c0 0x564cdb375e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.530+0000 7f17f9ea3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb360650 0x564cdb37cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.530+0000 7f17f9ea3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb2bdaf0 con 0x564cdb35b5c0 2024-09-13T16:10:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.530+0000 7f17f9ea3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb27bf20 con 0x564cdb360650 2024-09-13T16:10:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.530+0000 7f17f9ea3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb27bbc0 con 0x564cdb35ac80 2024-09-13T16:10:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.531+0000 7f17f9ea3740 10 client.0 _ll_register_callbacks cb 0x564cdb2ada70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:10:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.531+0000 7f17ef400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35ac80 0x564cdb375920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.531+0000 7f17ef400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35ac80 0x564cdb375920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:58744/0 (socket says 172.21.15.17:58744) 2024-09-13T16:10:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.531+0000 7f17ef400640 1 -- 172.21.15.17:0/2094818271 learned_addr learned my addr 172.21.15.17:0/2094818271 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:10:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.531+0000 7f17ef400640 1 --2- 172.21.15.17:0/2094818271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb360650 0x564cdb37cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.532+0000 7f17ef400640 1 -- 172.21.15.17:0/2094818271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb360650 msgr2=0x564cdb37cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.532+0000 7f17ef400640 1 --2- 172.21.15.17:0/2094818271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb360650 0x564cdb37cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.532+0000 7f17ef400640 1 -- 172.21.15.17:0/2094818271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564cdb35b5c0 msgr2=0x564cdb375e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:10:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.532+0000 7f17efe00640 1 --2- 172.21.15.17:0/2094818271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564cdb35b5c0 0x564cdb375e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.532+0000 7f17ef400640 1 --2- 172.21.15.17:0/2094818271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564cdb35b5c0 0x564cdb375e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.532+0000 7f17ef400640 1 -- 172.21.15.17:0/2094818271 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f010ee60 con 0x564cdb35ac80 2024-09-13T16:10:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.533+0000 7f17ef400640 1 --2- 172.21.15.17:0/2094818271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35ac80 0x564cdb375920 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0304f0 tx=0x7f17dc030340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3db9d9dff23af48 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.533+0000 7f17da000640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:10:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.533+0000 7f17da000640 1 -- 172.21.15.17:0/2094818271 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc032850 con 0x564cdb35ac80 2024-09-13T16:10:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.533+0000 7f17da000640 1 -- 172.21.15.17:0/2094818271 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f17dc0035f0 con 0x564cdb35ac80 2024-09-13T16:10:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.533+0000 7f17f9ea3740 1 -- 172.21.15.17:0/2094818271 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564cdb2e7c90 con 0x564cdb35ac80 2024-09-13T16:10:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.534+0000 7f17da000640 1 -- 172.21.15.17:0/2094818271 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17dc032850 con 0x564cdb35ac80 2024-09-13T16:10:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.534+0000 7f17f9ea3740 10 client.26293 fetch_fsmap learned FSMap version 49 2024-09-13T16:10:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.534+0000 7f17f9ea3740 1 -- 172.21.15.17:0/2094818271 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x564cdb2bc170 con 0x564cdb35ac80 2024-09-13T16:10:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.534+0000 7f17da000640 1 -- 172.21.15.17:0/2094818271 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564cdb2e7c90 con 0x564cdb35ac80 2024-09-13T16:10:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.535+0000 7f17da000640 1 -- 172.21.15.17:0/2094818271 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 49) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f17dc0406a0 con 0x564cdb35ac80 2024-09-13T16:10:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.535+0000 7f17f9ea3740 10 client.26293 fetch_fsmap finished waiting for FSMap version 49 2024-09-13T16:10:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.535+0000 7f17f9ea3740 10 client.26293 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:10:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.535+0000 7f17f9ea3740 20 client.26293 populate_metadata read hostname 'smithi017' 2024-09-13T16:10:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.535+0000 7f17f9ea3740 1 --2- 172.21.15.17:0/2094818271 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564cdb3920d0 0x564cdb3944c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.535+0000 7f17f9ea3740 4 client.26293 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:10:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.535+0000 7f17f9ea3740 1 -- 172.21.15.17:0/2094818271 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564cdb2b07d0 con 0x564cdb3920d0 2024-09-13T16:10:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.536+0000 7f17efe00640 1 --2- 172.21.15.17:0/2094818271 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564cdb3920d0 0x564cdb3944c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.538+0000 7f17efe00640 1 --2- 172.21.15.17:0/2094818271 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564cdb3920d0 0x564cdb3944c0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=338c44dcadc97569 server_cookie=e9871d5a25174bb1 in_seq=0 out_seq=0 2024-09-13T16:10:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.538+0000 7f17da000640 10 client.26293 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:10:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.539+0000 7f17da000640 1 -- 172.21.15.17:0/2094818271 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564cdb2b07d0 con 0x564cdb3920d0 2024-09-13T16:10:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.539+0000 7f17da000640 10 client.26293 handle_command_reply: tid=0 2024-09-13T16:10:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.539+0000 7f17f9ea3740 1 client.26293 shutdown 2024-09-13T16:10:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.540+0000 7f17f9ea3740 1 -- 172.21.15.17:0/2094818271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35ac80 msgr2=0x564cdb375920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.540+0000 7f17f9ea3740 1 --2- 172.21.15.17:0/2094818271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35ac80 0x564cdb375920 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0304f0 tx=0x7f17dc030340 comp rx=0 tx=0).stop 2024-09-13T16:10:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.540+0000 7f17f9ea3740 1 -- 172.21.15.17:0/2094818271 shutdown_connections 2024-09-13T16:10:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.540+0000 7f17f9ea3740 1 --2- 172.21.15.17:0/2094818271 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564cdb3920d0 0x564cdb3944c0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.540+0000 7f17f9ea3740 1 --2- 172.21.15.17:0/2094818271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb360650 0x564cdb37cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.540+0000 7f17f9ea3740 1 --2- 172.21.15.17:0/2094818271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564cdb35b5c0 0x564cdb375e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.540+0000 7f17f9ea3740 1 --2- 172.21.15.17:0/2094818271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35ac80 0x564cdb375920 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.540+0000 7f17f9ea3740 1 -- 172.21.15.17:0/2094818271 >> 172.21.15.17:0/2094818271 conn(0x564cdb3562f0 msgr2=0x564cdb357b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.540+0000 7f17da000640 0 client.26293 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:10:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.540+0000 7f17f9ea3740 1 -- 172.21.15.17:0/2094818271 shutdown_connections 2024-09-13T16:10:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.540+0000 7f17f9ea3740 1 -- 172.21.15.17:0/2094818271 wait complete. 2024-09-13T16:10:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.540+0000 7f17f9ea3740 20 client.26293 trim_cache size 0 max 16384 2024-09-13T16:10:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.562+0000 7f17f9ea3740 1 Processor -- start 2024-09-13T16:10:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.562+0000 7f17f9ea3740 1 -- start start 2024-09-13T16:10:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.563+0000 7f17f9ea3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35ac80 0x564cdb3756d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.563+0000 7f17f9ea3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb35b5c0 0x564cdb37cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.563+0000 7f17f9ea3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564cdb360650 0x564cdb375c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.563+0000 7f17f9ea3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb024e60 con 0x564cdb360650 2024-09-13T16:10:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.563+0000 7f17f9ea3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb376680 con 0x564cdb35b5c0 2024-09-13T16:10:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.563+0000 7f17f9ea3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb376af0 con 0x564cdb35ac80 2024-09-13T16:10:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.563+0000 7f17ef400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35ac80 0x564cdb3756d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.563+0000 7f17ef400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35ac80 0x564cdb3756d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:58750/0 (socket says 172.21.15.17:58750) 2024-09-13T16:10:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.563+0000 7f17ef400640 1 -- 172.21.15.17:0/568906217 learned_addr learned my addr 172.21.15.17:0/568906217 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:10:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.563+0000 7f17efe00640 1 --2- 172.21.15.17:0/568906217 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb35b5c0 0x564cdb37cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.563+0000 7f17ef400640 1 --2- 172.21.15.17:0/568906217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564cdb360650 0x564cdb375c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.563+0000 7f17ef400640 1 -- 172.21.15.17:0/568906217 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb35b5c0 msgr2=0x564cdb37cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.563+0000 7f17ef400640 1 --2- 172.21.15.17:0/568906217 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb35b5c0 0x564cdb37cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.564+0000 7f17ef400640 1 -- 172.21.15.17:0/568906217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564cdb360650 msgr2=0x564cdb375c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.564+0000 7f17ef400640 1 --2- 172.21.15.17:0/568906217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564cdb360650 0x564cdb375c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.564+0000 7f17ef400640 1 -- 172.21.15.17:0/568906217 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cdb25e180 con 0x564cdb35ac80 2024-09-13T16:10:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.564+0000 7f17ef400640 1 --2- 172.21.15.17:0/568906217 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35ac80 0x564cdb3756d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f17dc040fb0 tx=0x7f17dc033f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cd7eada3399cd07 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.564+0000 7f17e6000640 1 -- 172.21.15.17:0/568906217 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc032850 con 0x564cdb35ac80 2024-09-13T16:10:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.564+0000 7f17e6000640 1 -- 172.21.15.17:0/568906217 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17dc0041a0 con 0x564cdb35ac80 2024-09-13T16:10:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.564+0000 7f17e6000640 1 -- 172.21.15.17:0/568906217 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc058cd0 con 0x564cdb35ac80 2024-09-13T16:10:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.565+0000 7f17f9ea3740 1 -- 172.21.15.17:0/568906217 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35ac80 msgr2=0x564cdb3756d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.565+0000 7f17f9ea3740 1 --2- 172.21.15.17:0/568906217 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35ac80 0x564cdb3756d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f17dc040fb0 tx=0x7f17dc033f90 comp rx=0 tx=0).stop 2024-09-13T16:10:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.565+0000 7f17f9ea3740 1 -- 172.21.15.17:0/568906217 shutdown_connections 2024-09-13T16:10:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.565+0000 7f17f9ea3740 1 --2- 172.21.15.17:0/568906217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564cdb360650 0x564cdb375c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.565+0000 7f17f9ea3740 1 --2- 172.21.15.17:0/568906217 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb35b5c0 0x564cdb37cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.565+0000 7f17f9ea3740 1 --2- 172.21.15.17:0/568906217 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35ac80 0x564cdb3756d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.565+0000 7f17f9ea3740 1 -- 172.21.15.17:0/568906217 >> 172.21.15.17:0/568906217 conn(0x564cdb3562f0 msgr2=0x564cdb35c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.565+0000 7f17f9ea3740 1 -- 172.21.15.17:0/568906217 shutdown_connections 2024-09-13T16:10:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.565+0000 7f17f9ea3740 1 -- 172.21.15.17:0/568906217 wait complete. 2024-09-13T16:10:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.565+0000 7f17f9ea3740 1 -- start start 2024-09-13T16:10:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.566+0000 7f17f9ea3740 1 Processor -- start 2024-09-13T16:10:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.566+0000 7f17f9ea3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb35ac80 0x564cdb379b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.566+0000 7f17f9ea3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35b5c0 0x564cdb37a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.566+0000 7f17f9ea3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564cdb360650 0x564cdb3e8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.566+0000 7f17f9ea3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb37a680 con 0x564cdb360650 2024-09-13T16:10:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.566+0000 7f17f9ea3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb37a7f0 con 0x564cdb35ac80 2024-09-13T16:10:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.566+0000 7f17f9ea3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb3e8b20 con 0x564cdb35b5c0 2024-09-13T16:10:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.566+0000 7f17f9ea3740 10 client.0 _ll_register_callbacks cb 0x7f17e8009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:10:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.566+0000 7f17ef400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb35ac80 0x564cdb379b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.567+0000 7f17ef400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb35ac80 0x564cdb379b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:39738/0 (socket says 172.21.15.17:39738) 2024-09-13T16:10:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.567+0000 7f17ef400640 1 -- 172.21.15.17:0/1801715739 learned_addr learned my addr 172.21.15.17:0/1801715739 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:10:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.567+0000 7f17efe00640 1 --2- 172.21.15.17:0/1801715739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35b5c0 0x564cdb37a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.567+0000 7f17ef400640 1 --2- 172.21.15.17:0/1801715739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564cdb360650 0x564cdb3e8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.567+0000 7f17efe00640 1 -- 172.21.15.17:0/1801715739 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb35ac80 msgr2=0x564cdb379b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.567+0000 7f17efe00640 1 --2- 172.21.15.17:0/1801715739 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb35ac80 0x564cdb379b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.567+0000 7f17efe00640 1 -- 172.21.15.17:0/1801715739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564cdb360650 msgr2=0x564cdb3e8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.567+0000 7f17efe00640 1 --2- 172.21.15.17:0/1801715739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564cdb360650 0x564cdb3e8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.567+0000 7f17efe00640 1 -- 172.21.15.17:0/1801715739 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564cdb2bc170 con 0x564cdb35b5c0 2024-09-13T16:10:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.567+0000 7f17efe00640 1 --2- 172.21.15.17:0/1801715739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35b5c0 0x564cdb37a0c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x564cdb394d40 tx=0x7f17e001ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6d8a211b591de8b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.567+0000 7f17da000640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:10:11.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.568+0000 7f17da000640 1 -- 172.21.15.17:0/1801715739 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e001c780 con 0x564cdb35b5c0 2024-09-13T16:10:11.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.568+0000 7f17da000640 1 -- 172.21.15.17:0/1801715739 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f17e0025480 con 0x564cdb35b5c0 2024-09-13T16:10:11.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.568+0000 7f17f9ea3740 1 -- 172.21.15.17:0/1801715739 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f17dc004030 con 0x564cdb35b5c0 2024-09-13T16:10:11.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.569+0000 7f17da000640 1 -- 172.21.15.17:0/1801715739 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17e001c8e0 con 0x564cdb35b5c0 2024-09-13T16:10:11.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.569+0000 7f17f9ea3740 10 client.26299 fetch_fsmap learned FSMap version 49 2024-09-13T16:10:11.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.569+0000 7f17f9ea3740 1 -- 172.21.15.17:0/1801715739 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x564cdb283560 con 0x564cdb35b5c0 2024-09-13T16:10:11.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.569+0000 7f17da000640 1 -- 172.21.15.17:0/1801715739 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17dc004030 con 0x564cdb35b5c0 2024-09-13T16:10:11.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.569+0000 7f17da000640 1 -- 172.21.15.17:0/1801715739 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 49) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f17e0016700 con 0x564cdb35b5c0 2024-09-13T16:10:11.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.569+0000 7f17f9ea3740 10 client.26299 fetch_fsmap finished waiting for FSMap version 49 2024-09-13T16:10:11.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.569+0000 7f17f9ea3740 10 client.26299 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:10:11.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.569+0000 7f17f9ea3740 20 client.26299 populate_metadata read hostname 'smithi017' 2024-09-13T16:10:11.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.570+0000 7f17f9ea3740 1 --2- 172.21.15.17:0/1801715739 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564cdb3ea630 0x564cdb3eca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:11.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.570+0000 7f17f9ea3740 4 client.26299 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:10:11.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.570+0000 7f17f9ea3740 1 -- 172.21.15.17:0/1801715739 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564cdafb1300 con 0x564cdb3ea630 2024-09-13T16:10:11.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.570+0000 7f17ef400640 1 --2- 172.21.15.17:0/1801715739 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564cdb3ea630 0x564cdb3eca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:11.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.570+0000 7f17ef400640 1 --2- 172.21.15.17:0/1801715739 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564cdb3ea630 0x564cdb3eca50 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de337c6a138feab3 server_cookie=7afd007e8464a677 in_seq=0 out_seq=0 2024-09-13T16:10:11.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.570+0000 7f17da000640 10 client.26299 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:10:11.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.578+0000 7f17da000640 1 -- 172.21.15.17:0/1801715739 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564cdafb1300 con 0x564cdb3ea630 2024-09-13T16:10:11.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.578+0000 7f17da000640 10 client.26299 handle_command_reply: tid=0 2024-09-13T16:10:11.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.579+0000 7f17f9ea3740 1 client.26299 shutdown 2024-09-13T16:10:11.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.579+0000 7f17f9ea3740 1 -- 172.21.15.17:0/1801715739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35b5c0 msgr2=0x564cdb37a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:11.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.579+0000 7f17f9ea3740 1 --2- 172.21.15.17:0/1801715739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35b5c0 0x564cdb37a0c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x564cdb394d40 tx=0x7f17e001ced0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.580+0000 7f17f9ea3740 1 -- 172.21.15.17:0/1801715739 shutdown_connections 2024-09-13T16:10:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.580+0000 7f17f9ea3740 1 --2- 172.21.15.17:0/1801715739 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564cdb3ea630 0x564cdb3eca50 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.580+0000 7f17f9ea3740 1 --2- 172.21.15.17:0/1801715739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564cdb360650 0x564cdb3e8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.580+0000 7f17f9ea3740 1 --2- 172.21.15.17:0/1801715739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564cdb35b5c0 0x564cdb37a0c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.580+0000 7f17f9ea3740 1 --2- 172.21.15.17:0/1801715739 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564cdb35ac80 0x564cdb379b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.580+0000 7f17f9ea3740 1 -- 172.21.15.17:0/1801715739 >> 172.21.15.17:0/1801715739 conn(0x564cdb3562f0 msgr2=0x564cdb3756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.580+0000 7f17da000640 0 client.26299 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:10:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.580+0000 7f17f9ea3740 1 -- 172.21.15.17:0/1801715739 shutdown_connections 2024-09-13T16:10:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.580+0000 7f17f9ea3740 1 -- 172.21.15.17:0/1801715739 wait complete. 2024-09-13T16:10:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.581+0000 7f17f9ea3740 20 client.26299 trim_cache size 0 max 16384 2024-09-13T16:10:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:10:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:10:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:10:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:10:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.582+0000 7f17f5a00640 1 -- 172.21.15.17:0/660721662 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f17d40a12a0 msgr2=0x7f17d40a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.582+0000 7f17f5a00640 1 --2- 172.21.15.17:0/660721662 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f17d40a12a0 0x7f17d40a3760 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f17e8005fd0 tx=0x7f17e800cf70 comp rx=0 tx=0).stop 2024-09-13T16:10:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.582+0000 7f17f5a00640 1 -- 172.21.15.17:0/660721662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17f01a19a0 msgr2=0x7f17f01a3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.582+0000 7f17f5a00640 1 --2- 172.21.15.17:0/660721662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17f01a19a0 0x7f17f01a3d90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f17e800ef00 tx=0x7f17e800c740 comp rx=0 tx=0).stop 2024-09-13T16:10:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.582+0000 7f17f5a00640 1 -- 172.21.15.17:0/660721662 shutdown_connections 2024-09-13T16:10:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.582+0000 7f17f5a00640 1 --2- 172.21.15.17:0/660721662 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f17d40a12a0 0x7f17d40a3760 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.582+0000 7f17f5a00640 1 --2- 172.21.15.17:0/660721662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17f01a19a0 0x7f17f01a3d90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.582+0000 7f17f5a00640 1 --2- 172.21.15.17:0/660721662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17f010c120 0x7f17f019c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.582+0000 7f17f5a00640 1 --2- 172.21.15.17:0/660721662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17f00744f0 0x7f17f019c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.582+0000 7f17f5a00640 1 -- 172.21.15.17:0/660721662 >> 172.21.15.17:0/660721662 conn(0x7f17f00fb2f0 msgr2=0x7f17f00fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.583+0000 7f17f5a00640 1 -- 172.21.15.17:0/660721662 shutdown_connections 2024-09-13T16:10:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:11.583+0000 7f17f5a00640 1 -- 172.21.15.17:0/660721662 wait complete. 2024-09-13T16:10:12.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:11 smithi189 ceph-mon[34790]: pgmap v758: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.9 MiB/s wr, 496 op/s 2024-09-13T16:10:12.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:11 smithi193 ceph-mon[35248]: pgmap v758: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.9 MiB/s wr, 496 op/s 2024-09-13T16:10:12.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:11 smithi017 ceph-mon[30494]: pgmap v758: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.9 MiB/s wr, 496 op/s 2024-09-13T16:10:14.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:13 smithi189 ceph-mon[34790]: pgmap v759: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.2 MiB/s wr, 513 op/s 2024-09-13T16:10:14.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:13 smithi193 ceph-mon[35248]: pgmap v759: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.2 MiB/s wr, 513 op/s 2024-09-13T16:10:14.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:13 smithi017 ceph-mon[30494]: pgmap v759: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.2 MiB/s wr, 513 op/s 2024-09-13T16:10:15.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 750.0 s, 494.6 tps, lat 202.701 ms stddev 241.925 2024-09-13T16:10:16.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:15 smithi189 ceph-mon[34790]: pgmap v760: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.0 MiB/s wr, 475 op/s 2024-09-13T16:10:16.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:15 smithi193 ceph-mon[35248]: pgmap v760: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.0 MiB/s wr, 475 op/s 2024-09-13T16:10:16.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:15 smithi017 ceph-mon[30494]: pgmap v760: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.0 MiB/s wr, 475 op/s 2024-09-13T16:10:18.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:17 smithi189 ceph-mon[34790]: pgmap v761: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.2 MiB/s wr, 510 op/s 2024-09-13T16:10:18.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:17 smithi193 ceph-mon[35248]: pgmap v761: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.2 MiB/s wr, 510 op/s 2024-09-13T16:10:18.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:17 smithi017 ceph-mon[30494]: pgmap v761: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.2 MiB/s wr, 510 op/s 2024-09-13T16:10:20.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:19 smithi189 ceph-mon[34790]: pgmap v762: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.6 MiB/s wr, 461 op/s 2024-09-13T16:10:20.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:19 smithi193 ceph-mon[35248]: pgmap v762: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.6 MiB/s wr, 461 op/s 2024-09-13T16:10:20.264 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:19 smithi017 ceph-mon[30494]: pgmap v762: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.6 MiB/s wr, 461 op/s 2024-09-13T16:10:20.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 755.0 s, 493.0 tps, lat 197.792 ms stddev 216.906 2024-09-13T16:10:22.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:21 smithi189 ceph-mon[34790]: pgmap v763: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.8 MiB/s wr, 500 op/s 2024-09-13T16:10:22.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:21 smithi193 ceph-mon[35248]: pgmap v763: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.8 MiB/s wr, 500 op/s 2024-09-13T16:10:22.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:21 smithi017 ceph-mon[30494]: pgmap v763: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.8 MiB/s wr, 500 op/s 2024-09-13T16:10:24.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:23 smithi193 ceph-mon[35248]: pgmap v764: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.1 MiB/s wr, 512 op/s 2024-09-13T16:10:24.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:23 smithi017 ceph-mon[30494]: pgmap v764: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.1 MiB/s wr, 512 op/s 2024-09-13T16:10:24.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:23 smithi189 ceph-mon[34790]: pgmap v764: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.1 MiB/s wr, 512 op/s 2024-09-13T16:10:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.821+0000 7f1b0ee00640 1 -- 172.21.15.17:0/3350478101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b081079c0 msgr2=0x7f1b08107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.821+0000 7f1b0ee00640 1 --2- 172.21.15.17:0/3350478101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b081079c0 0x7f1b08107da0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009ca0 tx=0x7f1b0002a8c0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.822+0000 7f1b0ee00640 1 -- 172.21.15.17:0/3350478101 shutdown_connections 2024-09-13T16:10:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.822+0000 7f1b0ee00640 1 --2- 172.21.15.17:0/3350478101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b08071690 0x7f1b08110800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.822+0000 7f1b0ee00640 1 --2- 172.21.15.17:0/3350478101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b08070cd0 0x7f1b08071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.822+0000 7f1b0ee00640 1 --2- 172.21.15.17:0/3350478101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b081079c0 0x7f1b08107da0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.822+0000 7f1b0ee00640 1 -- 172.21.15.17:0/3350478101 >> 172.21.15.17:0/3350478101 conn(0x7f1b0806cd10 msgr2=0x7f1b0806f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.822+0000 7f1b0ee00640 1 -- 172.21.15.17:0/3350478101 shutdown_connections 2024-09-13T16:10:24.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.822+0000 7f1b0ee00640 1 -- 172.21.15.17:0/3350478101 wait complete. 2024-09-13T16:10:24.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.824+0000 7f1b0ee00640 1 Processor -- start 2024-09-13T16:10:24.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.826+0000 7f1b0ee00640 1 -- start start 2024-09-13T16:10:24.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.827+0000 7f1b0ee00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b08070cd0 0x7f1b0819e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:24.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.827+0000 7f1b0ee00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b08071690 0x7f1b0819e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:24.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.827+0000 7f1b0ee00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b081079c0 0x7f1b081a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:24.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.827+0000 7f1b0e400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b081079c0 0x7f1b081a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:24.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.828+0000 7f1b0e400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b081079c0 0x7f1b081a57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:44468/0 (socket says 172.21.15.17:44468) 2024-09-13T16:10:24.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.828+0000 7f1b0e400640 1 -- 172.21.15.17:0/4227676974 learned_addr learned my addr 172.21.15.17:0/4227676974 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:10:24.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.828+0000 7f1b0ee00640 1 -- 172.21.15.17:0/4227676974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b081a5d00 con 0x7f1b08071690 2024-09-13T16:10:24.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.828+0000 7f1b0ee00640 1 -- 172.21.15.17:0/4227676974 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b081a5e70 con 0x7f1b081079c0 2024-09-13T16:10:24.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.828+0000 7f1b0ee00640 1 -- 172.21.15.17:0/4227676974 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b081085c0 con 0x7f1b08070cd0 2024-09-13T16:10:24.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.828+0000 7f1b0da00640 1 --2- 172.21.15.17:0/4227676974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b08070cd0 0x7f1b0819e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:24.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.828+0000 7f1b0e400640 1 -- 172.21.15.17:0/4227676974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b08070cd0 msgr2=0x7f1b0819e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:24.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.828+0000 7f1b0e400640 1 --2- 172.21.15.17:0/4227676974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b08070cd0 0x7f1b0819e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.828+0000 7f1b0e400640 1 -- 172.21.15.17:0/4227676974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b08071690 msgr2=0x7f1b0819e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:24.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.828+0000 7f1b0e400640 1 --2- 172.21.15.17:0/4227676974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b08071690 0x7f1b0819e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.828+0000 7f1b0e400640 1 -- 172.21.15.17:0/4227676974 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b00009900 con 0x7f1b081079c0 2024-09-13T16:10:24.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.829+0000 7f1b0e400640 1 --2- 172.21.15.17:0/4227676974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b081079c0 0x7f1b081a57c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1af400e970 tx=0x7f1af400ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:24.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.829+0000 7f1b06000640 1 -- 172.21.15.17:0/4227676974 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af4009720 con 0x7f1b081079c0 2024-09-13T16:10:24.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.829+0000 7f1b06000640 1 -- 172.21.15.17:0/4227676974 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1af40054e0 con 0x7f1b081079c0 2024-09-13T16:10:24.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.829+0000 7f1b06000640 1 -- 172.21.15.17:0/4227676974 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af4010430 con 0x7f1b081079c0 2024-09-13T16:10:24.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.829+0000 7f1b0ee00640 1 -- 172.21.15.17:0/4227676974 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b081088a0 con 0x7f1b081079c0 2024-09-13T16:10:24.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.830+0000 7f1b0ee00640 1 -- 172.21.15.17:0/4227676974 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b08108d60 con 0x7f1b081079c0 2024-09-13T16:10:24.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.835+0000 7f1b13274740 1 Processor -- start 2024-09-13T16:10:24.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.836+0000 7f1b06000640 1 -- 172.21.15.17:0/4227676974 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1af400ccc0 con 0x7f1b081079c0 2024-09-13T16:10:24.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.836+0000 7f1b13274740 1 -- start start 2024-09-13T16:10:24.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.836+0000 7f1b13274740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff21c80 0x55a4eff22080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:24.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.836+0000 7f1b13274740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff225c0 0x55a4eff27080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:24.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.836+0000 7f1b13274740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4eff27650 0x55a4eff29b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:24.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.836+0000 7f1b13274740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4efe2dbb0 con 0x55a4eff27650 2024-09-13T16:10:24.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.836+0000 7f1b13274740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4efe8ba70 con 0x55a4eff225c0 2024-09-13T16:10:24.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.836+0000 7f1b13274740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4efe89200 con 0x55a4eff21c80 2024-09-13T16:10:24.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.837+0000 7f1b0da00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff225c0 0x55a4eff27080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:24.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.837+0000 7f1b0da00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff225c0 0x55a4eff27080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:44482/0 (socket says 172.21.15.17:44482) 2024-09-13T16:10:24.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.837+0000 7f1b0da00640 1 -- 172.21.15.17:0/3791449555 learned_addr learned my addr 172.21.15.17:0/3791449555 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:10:24.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.837+0000 7f1b0d000640 1 --2- 172.21.15.17:0/3791449555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4eff27650 0x55a4eff29b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:24.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.837+0000 7f1b0da00640 1 -- 172.21.15.17:0/3791449555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff21c80 msgr2=0x55a4eff22080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:10:24.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.837+0000 7f1b0da00640 1 --2- 172.21.15.17:0/3791449555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff21c80 0x55a4eff22080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.837+0000 7f1b0da00640 1 -- 172.21.15.17:0/3791449555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4eff27650 msgr2=0x55a4eff29b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:24.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.837+0000 7f1b0da00640 1 --2- 172.21.15.17:0/3791449555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4eff27650 0x55a4eff29b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.837+0000 7f1b0da00640 1 -- 172.21.15.17:0/3791449555 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4efe26940 con 0x55a4eff225c0 2024-09-13T16:10:24.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.837+0000 7f1b0da00640 1 --2- 172.21.15.17:0/3791449555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff225c0 0x55a4eff27080 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1b00000f80 tx=0x7f1b000093f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbced1175ecae940 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:24.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.837+0000 7f1b06000640 1 --2- 172.21.15.17:0/4227676974 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1af00a12a0 0x7f1af00a3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:24.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.838+0000 7f1afaa00640 1 -- 172.21.15.17:0/3791449555 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00031450 con 0x55a4eff225c0 2024-09-13T16:10:24.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.838+0000 7f1b06000640 1 -- 172.21.15.17:0/4227676974 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f1af4014070 con 0x7f1b081079c0 2024-09-13T16:10:24.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.838+0000 7f1afaa00640 1 -- 172.21.15.17:0/3791449555 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b00040070 con 0x55a4eff225c0 2024-09-13T16:10:24.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.838+0000 7f1afaa00640 1 -- 172.21.15.17:0/3791449555 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b000309a0 con 0x55a4eff225c0 2024-09-13T16:10:24.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.838+0000 7f1b0d000640 1 --2- 172.21.15.17:0/4227676974 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1af00a12a0 0x7f1af00a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:24.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.839+0000 7f1b13274740 1 -- 172.21.15.17:0/3791449555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff225c0 msgr2=0x55a4eff27080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:24.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.839+0000 7f1b13274740 1 --2- 172.21.15.17:0/3791449555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff225c0 0x55a4eff27080 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1b00000f80 tx=0x7f1b000093f0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.839+0000 7f1b0d000640 1 --2- 172.21.15.17:0/4227676974 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1af00a12a0 0x7f1af00a3760 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1b0819f720 tx=0x7f1afc005d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:24.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.839+0000 7f1b13274740 1 -- 172.21.15.17:0/3791449555 shutdown_connections 2024-09-13T16:10:24.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.839+0000 7f1b13274740 1 --2- 172.21.15.17:0/3791449555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4eff27650 0x55a4eff29b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.839+0000 7f1b13274740 1 --2- 172.21.15.17:0/3791449555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff225c0 0x55a4eff27080 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.839+0000 7f1b13274740 1 --2- 172.21.15.17:0/3791449555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff21c80 0x55a4eff22080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.839+0000 7f1b13274740 1 -- 172.21.15.17:0/3791449555 >> 172.21.15.17:0/3791449555 conn(0x55a4eff1d2f0 msgr2=0x55a4eff1d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:24.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.839+0000 7f1b13274740 1 -- 172.21.15.17:0/3791449555 shutdown_connections 2024-09-13T16:10:24.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.840+0000 7f1b13274740 1 -- 172.21.15.17:0/3791449555 wait complete. 2024-09-13T16:10:24.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.840+0000 7f1b13274740 1 -- start start 2024-09-13T16:10:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.841+0000 7f1b13274740 1 Processor -- start 2024-09-13T16:10:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.842+0000 7f1b13274740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4eff21c80 0x55a4eff2b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.842+0000 7f1b13274740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff225c0 0x55a4eff2be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.842+0000 7f1b13274740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff27650 0x55a4eff3b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:24.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.843+0000 7f1b0d000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff225c0 0x55a4eff2be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:24.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.843+0000 7f1b0d000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff225c0 0x55a4eff2be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:58582/0 (socket says 172.21.15.17:58582) 2024-09-13T16:10:24.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.843+0000 7f1b0d000640 1 -- 172.21.15.17:0/2224658049 learned_addr learned my addr 172.21.15.17:0/2224658049 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:10:24.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.843+0000 7f1b0e400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff27650 0x55a4eff3b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:24.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.843+0000 7f1b13274740 1 -- 172.21.15.17:0/2224658049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4efe84af0 con 0x55a4eff21c80 2024-09-13T16:10:24.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.843+0000 7f1b13274740 1 -- 172.21.15.17:0/2224658049 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4efe42f20 con 0x55a4eff27650 2024-09-13T16:10:24.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.843+0000 7f1b13274740 1 -- 172.21.15.17:0/2224658049 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4efe42bc0 con 0x55a4eff225c0 2024-09-13T16:10:24.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.843+0000 7f1b0da00640 1 --2- 172.21.15.17:0/2224658049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4eff21c80 0x55a4eff2b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:24.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.844+0000 7f1b13274740 10 client.0 _ll_register_callbacks cb 0x55a4efe74a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:10:24.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.844+0000 7f1b0e400640 1 -- 172.21.15.17:0/2224658049 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff225c0 msgr2=0x55a4eff2be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:24.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.844+0000 7f1b0e400640 1 --2- 172.21.15.17:0/2224658049 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff225c0 0x55a4eff2be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.844+0000 7f1b0e400640 1 -- 172.21.15.17:0/2224658049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4eff21c80 msgr2=0x55a4eff2b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:24.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.844+0000 7f1b0e400640 1 --2- 172.21.15.17:0/2224658049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4eff21c80 0x55a4eff2b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.844+0000 7f1b0e400640 1 -- 172.21.15.17:0/2224658049 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b08111090 con 0x55a4eff27650 2024-09-13T16:10:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.844+0000 7f1b13274740 1 -- 172.21.15.17:0/2224658049 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a4efeaec90 con 0x55a4eff27650 2024-09-13T16:10:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.844+0000 7f1b0da00640 1 --2- 172.21.15.17:0/2224658049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4eff21c80 0x55a4eff2b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:10:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.845+0000 7f1b0e400640 1 --2- 172.21.15.17:0/2224658049 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff27650 0x55a4eff3b650 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1af40ca7d0 tx=0x7f1af409a820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51f29c94d642dcba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.845+0000 7f1aef400640 10 client.26273 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:10:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.845+0000 7f1aef400640 1 -- 172.21.15.17:0/2224658049 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af40b1030 con 0x55a4eff27650 2024-09-13T16:10:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.845+0000 7f1aef400640 1 -- 172.21.15.17:0/2224658049 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f1af40b2070 con 0x55a4eff27650 2024-09-13T16:10:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.845+0000 7f1aef400640 1 -- 172.21.15.17:0/2224658049 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1af409c030 con 0x55a4eff27650 2024-09-13T16:10:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.845+0000 7f1b13274740 10 client.26273 fetch_fsmap learned FSMap version 49 2024-09-13T16:10:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.845+0000 7f1b13274740 1 -- 172.21.15.17:0/2224658049 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({fsmap=49}) v3 -- 0x55a4efe83170 con 0x55a4eff27650 2024-09-13T16:10:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.846+0000 7f1aef400640 1 -- 172.21.15.17:0/2224658049 <== mon.2 v2:172.21.15.189:3300/0 4 ==== fsmap(e 49) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f1af401f060 con 0x55a4eff27650 2024-09-13T16:10:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.846+0000 7f1b13274740 10 client.26273 fetch_fsmap finished waiting for FSMap version 49 2024-09-13T16:10:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.846+0000 7f1b13274740 10 client.26273 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:10:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.846+0000 7f1b13274740 20 client.26273 populate_metadata read hostname 'smithi017' 2024-09-13T16:10:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.846+0000 7f1b13274740 1 --2- 172.21.15.17:0/2224658049 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55a4eff3fc20 0x55a4eff42010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.846+0000 7f1b13274740 4 client.26273 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:10:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.846+0000 7f1b13274740 1 -- 172.21.15.17:0/2224658049 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a4efe777d0 con 0x55a4eff3fc20 2024-09-13T16:10:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.847+0000 7f1b0da00640 1 --2- 172.21.15.17:0/2224658049 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55a4eff3fc20 0x55a4eff42010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.847+0000 7f1aef400640 10 client.26273 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:10:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.847+0000 7f1b0da00640 1 --2- 172.21.15.17:0/2224658049 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55a4eff3fc20 0x55a4eff42010 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3963fc3840f89000 server_cookie=95f15580d6861fa3 in_seq=0 out_seq=0 2024-09-13T16:10:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.848+0000 7f1aef400640 1 -- 172.21.15.17:0/2224658049 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a4efe777d0 con 0x55a4eff3fc20 2024-09-13T16:10:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.848+0000 7f1aef400640 10 client.26273 handle_command_reply: tid=0 2024-09-13T16:10:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.848+0000 7f1b13274740 1 client.26273 shutdown 2024-09-13T16:10:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.848+0000 7f1b13274740 1 -- 172.21.15.17:0/2224658049 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff27650 msgr2=0x55a4eff3b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.848+0000 7f1b13274740 1 --2- 172.21.15.17:0/2224658049 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff27650 0x55a4eff3b650 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1af40ca7d0 tx=0x7f1af409a820 comp rx=0 tx=0).stop 2024-09-13T16:10:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.848+0000 7f1b13274740 1 -- 172.21.15.17:0/2224658049 shutdown_connections 2024-09-13T16:10:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.848+0000 7f1b13274740 1 --2- 172.21.15.17:0/2224658049 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55a4eff3fc20 0x55a4eff42010 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.848+0000 7f1b13274740 1 --2- 172.21.15.17:0/2224658049 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff27650 0x55a4eff3b650 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.848+0000 7f1b13274740 1 --2- 172.21.15.17:0/2224658049 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff225c0 0x55a4eff2be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.848+0000 7f1b13274740 1 --2- 172.21.15.17:0/2224658049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4eff21c80 0x55a4eff2b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.848+0000 7f1b13274740 1 -- 172.21.15.17:0/2224658049 >> 172.21.15.17:0/2224658049 conn(0x55a4eff1d2f0 msgr2=0x55a4eff1eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.848+0000 7f1aef400640 0 client.26273 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:10:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.849+0000 7f1b13274740 1 -- 172.21.15.17:0/2224658049 shutdown_connections 2024-09-13T16:10:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.849+0000 7f1b13274740 1 -- 172.21.15.17:0/2224658049 wait complete. 2024-09-13T16:10:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.849+0000 7f1b13274740 20 client.26273 trim_cache size 0 max 16384 2024-09-13T16:10:24.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.875+0000 7f1b13274740 1 Processor -- start 2024-09-13T16:10:24.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.875+0000 7f1b13274740 1 -- start start 2024-09-13T16:10:24.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.875+0000 7f1b13274740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff21c80 0x55a4eff4fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:24.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.875+0000 7f1b13274740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff225c0 0x55a4eff50430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:24.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.875+0000 7f1b13274740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4eff27650 0x55a4eff23520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.875+0000 7f1b13274740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4efbebe60 con 0x55a4eff27650 2024-09-13T16:10:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.875+0000 7f1b13274740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4efe77800 con 0x55a4eff21c80 2024-09-13T16:10:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.875+0000 7f1b13274740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4eff2a220 con 0x55a4eff225c0 2024-09-13T16:10:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.876+0000 7f1b0d000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff225c0 0x55a4eff50430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.876+0000 7f1b0d000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff225c0 0x55a4eff50430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:58598/0 (socket says 172.21.15.17:58598) 2024-09-13T16:10:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.876+0000 7f1b0d000640 1 -- 172.21.15.17:0/2957532460 learned_addr learned my addr 172.21.15.17:0/2957532460 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:10:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.876+0000 7f1b0e400640 1 --2- 172.21.15.17:0/2957532460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4eff27650 0x55a4eff23520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.876+0000 7f1b0da00640 1 --2- 172.21.15.17:0/2957532460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff21c80 0x55a4eff4fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.876+0000 7f1b0da00640 1 -- 172.21.15.17:0/2957532460 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff225c0 msgr2=0x55a4eff50430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.876+0000 7f1b0da00640 1 --2- 172.21.15.17:0/2957532460 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff225c0 0x55a4eff50430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.876+0000 7f1b0da00640 1 -- 172.21.15.17:0/2957532460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4eff27650 msgr2=0x55a4eff23520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.876+0000 7f1b0da00640 1 --2- 172.21.15.17:0/2957532460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4eff27650 0x55a4eff23520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.876+0000 7f1b0da00640 1 -- 172.21.15.17:0/2957532460 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4efe25180 con 0x55a4eff21c80 2024-09-13T16:10:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.876+0000 7f1b0e400640 1 --2- 172.21.15.17:0/2957532460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4eff27650 0x55a4eff23520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:10:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.877+0000 7f1b0da00640 1 --2- 172.21.15.17:0/2957532460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff21c80 0x55a4eff4fef0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55a4eff2ad80 tx=0x7f1b0002a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3acff5deeaeeef16 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.877+0000 7f1b0d000640 1 --2- 172.21.15.17:0/2957532460 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff225c0 0x55a4eff50430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:10:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.877+0000 7f1afb400640 1 -- 172.21.15.17:0/2957532460 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00031450 con 0x55a4eff21c80 2024-09-13T16:10:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.877+0000 7f1afb400640 1 -- 172.21.15.17:0/2957532460 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b000305c0 con 0x55a4eff21c80 2024-09-13T16:10:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.877+0000 7f1afb400640 1 -- 172.21.15.17:0/2957532460 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00050280 con 0x55a4eff21c80 2024-09-13T16:10:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.879+0000 7f1b13274740 1 -- 172.21.15.17:0/2957532460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff21c80 msgr2=0x55a4eff4fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.879+0000 7f1b13274740 1 --2- 172.21.15.17:0/2957532460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff21c80 0x55a4eff4fef0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55a4eff2ad80 tx=0x7f1b0002a8c0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.879+0000 7f1b13274740 1 -- 172.21.15.17:0/2957532460 shutdown_connections 2024-09-13T16:10:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.879+0000 7f1b13274740 1 --2- 172.21.15.17:0/2957532460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4eff27650 0x55a4eff23520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.879+0000 7f1b13274740 1 --2- 172.21.15.17:0/2957532460 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff225c0 0x55a4eff50430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.879+0000 7f1b13274740 1 --2- 172.21.15.17:0/2957532460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff21c80 0x55a4eff4fef0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.879+0000 7f1b13274740 1 -- 172.21.15.17:0/2957532460 >> 172.21.15.17:0/2957532460 conn(0x55a4eff1d2f0 msgr2=0x55a4eff26b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.879+0000 7f1b13274740 1 -- 172.21.15.17:0/2957532460 shutdown_connections 2024-09-13T16:10:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.879+0000 7f1b13274740 1 -- 172.21.15.17:0/2957532460 wait complete. 2024-09-13T16:10:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.880+0000 7f1b13274740 1 -- start start 2024-09-13T16:10:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.880+0000 7f1b13274740 1 Processor -- start 2024-09-13T16:10:24.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.881+0000 7f1b13274740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff21c80 0x55a4eff4ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:24.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.881+0000 7f1b13274740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff225c0 0x55a4eff4e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.881+0000 7f1b13274740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4eff27650 0x55a4eff4ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.881+0000 7f1b13274740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4eff507c0 con 0x55a4eff27650 2024-09-13T16:10:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.881+0000 7f1b13274740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4eff4f190 con 0x55a4eff225c0 2024-09-13T16:10:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.881+0000 7f1b13274740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4eff4f350 con 0x55a4eff21c80 2024-09-13T16:10:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.881+0000 7f1b13274740 10 client.0 _ll_register_callbacks cb 0x7f1af4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:10:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.881+0000 7f1b0da00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff21c80 0x55a4eff4ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.881+0000 7f1b0d000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff225c0 0x55a4eff4e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.881+0000 7f1b0da00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff21c80 0x55a4eff4ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:58608/0 (socket says 172.21.15.17:58608) 2024-09-13T16:10:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.881+0000 7f1b0da00640 1 -- 172.21.15.17:0/3928517638 learned_addr learned my addr 172.21.15.17:0/3928517638 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:10:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.882+0000 7f1b0e400640 1 --2- 172.21.15.17:0/3928517638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4eff27650 0x55a4eff4ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.882+0000 7f1b0da00640 1 -- 172.21.15.17:0/3928517638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff225c0 msgr2=0x55a4eff4e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.882+0000 7f1b0da00640 1 --2- 172.21.15.17:0/3928517638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff225c0 0x55a4eff4e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.882+0000 7f1b0da00640 1 -- 172.21.15.17:0/3928517638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4eff27650 msgr2=0x55a4eff4ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.882+0000 7f1b0da00640 1 --2- 172.21.15.17:0/3928517638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4eff27650 0x55a4eff4ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.882+0000 7f1b0da00640 1 -- 172.21.15.17:0/3928517638 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b00049040 con 0x55a4eff21c80 2024-09-13T16:10:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.882+0000 7f1b0d000640 1 --2- 172.21.15.17:0/3928517638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff225c0 0x55a4eff4e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.882+0000 7f1b0da00640 1 --2- 172.21.15.17:0/3928517638 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff21c80 0x55a4eff4ffa0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1b0002c010 tx=0x7f1b00031710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=347ca17af2ab64f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.882+0000 7f1aef400640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:10:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.883+0000 7f1aef400640 1 -- 172.21.15.17:0/3928517638 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00031800 con 0x55a4eff21c80 2024-09-13T16:10:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.883+0000 7f1aef400640 1 -- 172.21.15.17:0/3928517638 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f1b00030730 con 0x55a4eff21c80 2024-09-13T16:10:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.883+0000 7f1b13274740 1 -- 172.21.15.17:0/3928517638 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1b00040070 con 0x55a4eff21c80 2024-09-13T16:10:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.883+0000 7f1aef400640 1 -- 172.21.15.17:0/3928517638 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b000308f0 con 0x55a4eff21c80 2024-09-13T16:10:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.883+0000 7f1b13274740 10 client.26311 fetch_fsmap learned FSMap version 49 2024-09-13T16:10:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.883+0000 7f1b13274740 1 -- 172.21.15.17:0/3928517638 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55a4efe4a560 con 0x55a4eff21c80 2024-09-13T16:10:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.883+0000 7f1aef400640 1 -- 172.21.15.17:0/3928517638 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b00040070 con 0x55a4eff21c80 2024-09-13T16:10:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.883+0000 7f1aef400640 1 -- 172.21.15.17:0/3928517638 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 49) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f1b0004c040 con 0x55a4eff21c80 2024-09-13T16:10:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.884+0000 7f1b13274740 10 client.26311 fetch_fsmap finished waiting for FSMap version 49 2024-09-13T16:10:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.884+0000 7f1b13274740 10 client.26311 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:10:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.884+0000 7f1b13274740 20 client.26311 populate_metadata read hostname 'smithi017' 2024-09-13T16:10:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.884+0000 7f1b13274740 1 --2- 172.21.15.17:0/3928517638 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55a4eff97d50 0x55a4eff9a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.884+0000 7f1b13274740 4 client.26311 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:10:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.884+0000 7f1b13274740 1 -- 172.21.15.17:0/3928517638 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a4efb78300 con 0x55a4eff97d50 2024-09-13T16:10:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.884+0000 7f1b0d000640 1 --2- 172.21.15.17:0/3928517638 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55a4eff97d50 0x55a4eff9a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.884+0000 7f1b0d000640 1 --2- 172.21.15.17:0/3928517638 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55a4eff97d50 0x55a4eff9a140 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4536eef39e28fa7b server_cookie=c20a2cf14bf3a830 in_seq=0 out_seq=0 2024-09-13T16:10:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.884+0000 7f1aef400640 10 client.26311 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:10:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.893+0000 7f1aef400640 1 -- 172.21.15.17:0/3928517638 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a4efb78300 con 0x55a4eff97d50 2024-09-13T16:10:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.893+0000 7f1aef400640 10 client.26311 handle_command_reply: tid=0 2024-09-13T16:10:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.893+0000 7f1b13274740 1 client.26311 shutdown 2024-09-13T16:10:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.894+0000 7f1b13274740 1 -- 172.21.15.17:0/3928517638 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff21c80 msgr2=0x55a4eff4ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.894+0000 7f1b13274740 1 --2- 172.21.15.17:0/3928517638 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff21c80 0x55a4eff4ffa0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1b0002c010 tx=0x7f1b00031710 comp rx=0 tx=0).stop 2024-09-13T16:10:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.894+0000 7f1b13274740 1 -- 172.21.15.17:0/3928517638 shutdown_connections 2024-09-13T16:10:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.894+0000 7f1b13274740 1 --2- 172.21.15.17:0/3928517638 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55a4eff97d50 0x55a4eff9a140 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.894+0000 7f1b13274740 1 --2- 172.21.15.17:0/3928517638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4eff27650 0x55a4eff4ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.894+0000 7f1b13274740 1 --2- 172.21.15.17:0/3928517638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a4eff225c0 0x55a4eff4e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.894+0000 7f1b13274740 1 --2- 172.21.15.17:0/3928517638 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a4eff21c80 0x55a4eff4ffa0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.894+0000 7f1aef400640 0 client.26311 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:10:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.894+0000 7f1b13274740 1 -- 172.21.15.17:0/3928517638 >> 172.21.15.17:0/3928517638 conn(0x55a4eff1d2f0 msgr2=0x55a4eff266f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.894+0000 7f1b13274740 1 -- 172.21.15.17:0/3928517638 shutdown_connections 2024-09-13T16:10:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.894+0000 7f1b13274740 1 -- 172.21.15.17:0/3928517638 wait complete. 2024-09-13T16:10:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.894+0000 7f1b13274740 20 client.26311 trim_cache size 0 max 16384 2024-09-13T16:10:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:10:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:10:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:10:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:10:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.895+0000 7f1b0ee00640 1 -- 172.21.15.17:0/4227676974 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1af00a12a0 msgr2=0x7f1af00a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.895+0000 7f1b0ee00640 1 --2- 172.21.15.17:0/4227676974 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1af00a12a0 0x7f1af00a3760 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1b0819f720 tx=0x7f1afc005d00 comp rx=0 tx=0).stop 2024-09-13T16:10:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.895+0000 7f1b0ee00640 1 -- 172.21.15.17:0/4227676974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b081079c0 msgr2=0x7f1b081a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.895+0000 7f1b0ee00640 1 --2- 172.21.15.17:0/4227676974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b081079c0 0x7f1b081a57c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1af400e970 tx=0x7f1af400ed70 comp rx=0 tx=0).stop 2024-09-13T16:10:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.895+0000 7f1b0ee00640 1 -- 172.21.15.17:0/4227676974 shutdown_connections 2024-09-13T16:10:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.895+0000 7f1b0ee00640 1 --2- 172.21.15.17:0/4227676974 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1af00a12a0 0x7f1af00a3760 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.895+0000 7f1b0ee00640 1 --2- 172.21.15.17:0/4227676974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b081079c0 0x7f1b081a57c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.895+0000 7f1b0ee00640 1 --2- 172.21.15.17:0/4227676974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b08071690 0x7f1b0819e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.895+0000 7f1b0ee00640 1 --2- 172.21.15.17:0/4227676974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b08070cd0 0x7f1b0819e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.895+0000 7f1b0ee00640 1 -- 172.21.15.17:0/4227676974 >> 172.21.15.17:0/4227676974 conn(0x7f1b0806cd10 msgr2=0x7f1b0810c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.895+0000 7f1b0ee00640 1 -- 172.21.15.17:0/4227676974 shutdown_connections 2024-09-13T16:10:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:24.895+0000 7f1b0ee00640 1 -- 172.21.15.17:0/4227676974 wait complete. 2024-09-13T16:10:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 760.0 s, 485.8 tps, lat 209.020 ms stddev 247.127 2024-09-13T16:10:26.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:25 smithi193 ceph-mon[35248]: pgmap v765: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.0 MiB/s wr, 472 op/s 2024-09-13T16:10:26.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:25 smithi017 ceph-mon[30494]: pgmap v765: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.0 MiB/s wr, 472 op/s 2024-09-13T16:10:26.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:25 smithi189 ceph-mon[34790]: pgmap v765: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.0 MiB/s wr, 472 op/s 2024-09-13T16:10:27.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:26 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:10:27.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:26 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:10:27.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:26 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:10:28.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:27 smithi193 ceph-mon[35248]: pgmap v766: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.6 MiB/s wr, 484 op/s 2024-09-13T16:10:28.264 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:27 smithi017 ceph-mon[30494]: pgmap v766: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.6 MiB/s wr, 484 op/s 2024-09-13T16:10:28.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:27 smithi189 ceph-mon[34790]: pgmap v766: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.6 MiB/s wr, 484 op/s 2024-09-13T16:10:29.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:28 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:10:29.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:28 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:10:29.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:28 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:10:29.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:28 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:10:29.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:28 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:10:29.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:28 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:10:29.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:28 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:10:29.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:28 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:10:29.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:28 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:10:30.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:29 smithi193 ceph-mon[35248]: pgmap v767: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 446 op/s 2024-09-13T16:10:30.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:29 smithi017 ceph-mon[30494]: pgmap v767: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 446 op/s 2024-09-13T16:10:30.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 765.0 s, 395.4 tps, lat 242.661 ms stddev 274.020 2024-09-13T16:10:30.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:29 smithi189 ceph-mon[34790]: pgmap v767: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 446 op/s 2024-09-13T16:10:32.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:31 smithi193 ceph-mon[35248]: pgmap v768: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.8 MiB/s wr, 488 op/s 2024-09-13T16:10:32.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:31 smithi017 ceph-mon[30494]: pgmap v768: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.8 MiB/s wr, 488 op/s 2024-09-13T16:10:32.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:31 smithi189 ceph-mon[34790]: pgmap v768: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.8 MiB/s wr, 488 op/s 2024-09-13T16:10:34.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:33 smithi193 ceph-mon[35248]: pgmap v769: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 470 op/s 2024-09-13T16:10:34.264 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:33 smithi017 ceph-mon[30494]: pgmap v769: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 470 op/s 2024-09-13T16:10:34.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:33 smithi189 ceph-mon[34790]: pgmap v769: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 470 op/s 2024-09-13T16:10:35.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 770.0 s, 580.2 tps, lat 180.697 ms stddev 218.381 2024-09-13T16:10:36.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:35 smithi193 ceph-mon[35248]: pgmap v770: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.3 MiB/s wr, 444 op/s 2024-09-13T16:10:36.264 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:35 smithi017 ceph-mon[30494]: pgmap v770: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.3 MiB/s wr, 444 op/s 2024-09-13T16:10:36.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:35 smithi189 ceph-mon[34790]: pgmap v770: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.3 MiB/s wr, 444 op/s 2024-09-13T16:10:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.083+0000 7f443de00640 1 -- 172.21.15.17:0/803698560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f44381005e0 msgr2=0x7f44381029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.083+0000 7f443de00640 1 --2- 172.21.15.17:0/803698560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f44381005e0 0x7f44381029d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f442c009900 tx=0x7f442c02a410 comp rx=0 tx=0).stop 2024-09-13T16:10:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.084+0000 7f443de00640 1 -- 172.21.15.17:0/803698560 shutdown_connections 2024-09-13T16:10:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.084+0000 7f443de00640 1 --2- 172.21.15.17:0/803698560 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4438105920 0x7f4438107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.084+0000 7f443de00640 1 --2- 172.21.15.17:0/803698560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4438102f10 0x7f4438105300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.084+0000 7f443de00640 1 --2- 172.21.15.17:0/803698560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f44381005e0 0x7f44381029d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.084+0000 7f443de00640 1 -- 172.21.15.17:0/803698560 >> 172.21.15.17:0/803698560 conn(0x7f44380fa1c0 msgr2=0x7f44380fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.085+0000 7f443de00640 1 -- 172.21.15.17:0/803698560 shutdown_connections 2024-09-13T16:10:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.085+0000 7f443de00640 1 -- 172.21.15.17:0/803698560 wait complete. 2024-09-13T16:10:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.086+0000 7f443de00640 1 Processor -- start 2024-09-13T16:10:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.087+0000 7f443de00640 1 -- start start 2024-09-13T16:10:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.087+0000 7f443de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44381005e0 0x7f4438195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.087+0000 7f443de00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4438102f10 0x7f4438196190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.087+0000 7f443de00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4438105920 0x7f443819d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.087+0000 7f443de00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443819d730 con 0x7f44381005e0 2024-09-13T16:10:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.087+0000 7f443de00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443819d8a0 con 0x7f4438105920 2024-09-13T16:10:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.087+0000 7f443de00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443819da60 con 0x7f4438102f10 2024-09-13T16:10:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.087+0000 7f4437e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4438102f10 0x7f4438196190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.087+0000 7f4437e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4438102f10 0x7f4438196190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:39548/0 (socket says 172.21.15.17:39548) 2024-09-13T16:10:38.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.087+0000 7f4437e00640 1 -- 172.21.15.17:0/139212135 learned_addr learned my addr 172.21.15.17:0/139212135 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:10:38.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.087+0000 7f443d400640 1 --2- 172.21.15.17:0/139212135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4438105920 0x7f443819d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:38.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.088+0000 7f4437e00640 1 -- 172.21.15.17:0/139212135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4438105920 msgr2=0x7f443819d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:38.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.088+0000 7f4437e00640 1 --2- 172.21.15.17:0/139212135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4438105920 0x7f443819d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.088+0000 7f4437e00640 1 -- 172.21.15.17:0/139212135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44381005e0 msgr2=0x7f4438195c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:38.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.088+0000 7f4437e00640 1 --2- 172.21.15.17:0/139212135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44381005e0 0x7f4438195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.088+0000 7f4437e00640 1 -- 172.21.15.17:0/139212135 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4430009840 con 0x7f4438102f10 2024-09-13T16:10:38.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.088+0000 7f4437e00640 1 --2- 172.21.15.17:0/139212135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4438102f10 0x7f4438196190 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f442400d770 tx=0x7f442400dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:38.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.089+0000 7f4435600640 1 -- 172.21.15.17:0/139212135 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4424009c30 con 0x7f4438102f10 2024-09-13T16:10:38.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.089+0000 7f4435600640 1 -- 172.21.15.17:0/139212135 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f442400de80 con 0x7f4438102f10 2024-09-13T16:10:38.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.089+0000 7f4435600640 1 -- 172.21.15.17:0/139212135 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442400f620 con 0x7f4438102f10 2024-09-13T16:10:38.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.089+0000 7f443de00640 1 -- 172.21.15.17:0/139212135 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f442c009560 con 0x7f4438102f10 2024-09-13T16:10:38.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.089+0000 7f443de00640 1 -- 172.21.15.17:0/139212135 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44380fe760 con 0x7f4438102f10 2024-09-13T16:10:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.100+0000 7f444226b740 1 Processor -- start 2024-09-13T16:10:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.100+0000 7f444226b740 1 -- start start 2024-09-13T16:10:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.100+0000 7f444226b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cbaa2c80 0x5633cbaa3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.101+0000 7f443d400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cbaa2c80 0x5633cbaa3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.101+0000 7f443d400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cbaa2c80 0x5633cbaa3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:40180/0 (socket says 172.21.15.17:40180) 2024-09-13T16:10:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.101+0000 7f444226b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa35c0 0x5633cbaa8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.101+0000 7f443d400640 1 -- 172.21.15.17:0/108816253 learned_addr learned my addr 172.21.15.17:0/108816253 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:10:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.101+0000 7f444226b740 1 --2- 172.21.15.17:0/108816253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633cbaa8650 0x5633cbaaab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.101+0000 7f444226b740 1 -- 172.21.15.17:0/108816253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633cb9aebb0 con 0x5633cbaa8650 2024-09-13T16:10:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.101+0000 7f444226b740 1 -- 172.21.15.17:0/108816253 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633cba0ca70 con 0x5633cbaa2c80 2024-09-13T16:10:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.101+0000 7f444226b740 1 -- 172.21.15.17:0/108816253 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633cba0a200 con 0x5633cbaa35c0 2024-09-13T16:10:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.101+0000 7f443d400640 1 -- 172.21.15.17:0/108816253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa35c0 msgr2=0x5633cbaa8080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:10:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.101+0000 7f443d400640 1 --2- 172.21.15.17:0/108816253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa35c0 0x5633cbaa8080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.101+0000 7f443d400640 1 -- 172.21.15.17:0/108816253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633cbaa8650 msgr2=0x5633cbaaab10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:10:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.101+0000 7f443d400640 1 --2- 172.21.15.17:0/108816253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633cbaa8650 0x5633cbaaab10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.101+0000 7f443d400640 1 -- 172.21.15.17:0/108816253 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633cb9a7940 con 0x5633cbaa2c80 2024-09-13T16:10:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.102+0000 7f4435600640 1 -- 172.21.15.17:0/139212135 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4424005060 con 0x7f4438102f10 2024-09-13T16:10:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.103+0000 7f443d400640 1 --2- 172.21.15.17:0/108816253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cbaa2c80 0x5633cbaa3080 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4430009d10 tx=0x7f443000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=776e58f37d6c13a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:38.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.104+0000 7f4435600640 1 --2- 172.21.15.17:0/139212135 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f44200a1130 0x7f44200a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:38.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.105+0000 7f4435600640 1 -- 172.21.15.17:0/139212135 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f44240cc780 con 0x7f4438102f10 2024-09-13T16:10:38.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.105+0000 7f442a000640 1 -- 172.21.15.17:0/108816253 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443001b070 con 0x5633cbaa2c80 2024-09-13T16:10:38.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.105+0000 7f442a000640 1 -- 172.21.15.17:0/108816253 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f443000ccd0 con 0x5633cbaa2c80 2024-09-13T16:10:38.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.105+0000 7f442a000640 1 -- 172.21.15.17:0/108816253 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4430016a10 con 0x5633cbaa2c80 2024-09-13T16:10:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.107+0000 7f444226b740 1 -- 172.21.15.17:0/108816253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cbaa2c80 msgr2=0x5633cbaa3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.107+0000 7f444226b740 1 --2- 172.21.15.17:0/108816253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cbaa2c80 0x5633cbaa3080 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4430009d10 tx=0x7f443000c6a0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.107+0000 7f443ca00640 1 --2- 172.21.15.17:0/139212135 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f44200a1130 0x7f44200a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:38.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.109+0000 7f443ca00640 1 --2- 172.21.15.17:0/139212135 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f44200a1130 0x7f44200a35f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f442c0056f0 tx=0x7f442c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.111+0000 7f444226b740 1 -- 172.21.15.17:0/108816253 shutdown_connections 2024-09-13T16:10:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.111+0000 7f444226b740 1 --2- 172.21.15.17:0/108816253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633cbaa8650 0x5633cbaaab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.111+0000 7f444226b740 1 --2- 172.21.15.17:0/108816253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa35c0 0x5633cbaa8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.111+0000 7f444226b740 1 --2- 172.21.15.17:0/108816253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cbaa2c80 0x5633cbaa3080 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.111+0000 7f444226b740 1 -- 172.21.15.17:0/108816253 >> 172.21.15.17:0/108816253 conn(0x5633cba9e2f0 msgr2=0x5633cba9e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.115+0000 7f444226b740 1 -- 172.21.15.17:0/108816253 shutdown_connections 2024-09-13T16:10:38.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.115+0000 7f444226b740 1 -- 172.21.15.17:0/108816253 wait complete. 2024-09-13T16:10:38.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.115+0000 7f444226b740 1 -- start start 2024-09-13T16:10:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.116+0000 7f444226b740 1 Processor -- start 2024-09-13T16:10:38.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.117+0000 7f444226b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa2c80 0x5633cbaac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:38.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.118+0000 7f444226b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cbaa35c0 0x5633cbaacee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:38.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.118+0000 7f443ca00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa2c80 0x5633cbaac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:38.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.118+0000 7f443ca00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa2c80 0x5633cbaac9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:39558/0 (socket says 172.21.15.17:39558) 2024-09-13T16:10:38.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.118+0000 7f443ca00640 1 -- 172.21.15.17:0/2509723976 learned_addr learned my addr 172.21.15.17:0/2509723976 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:10:38.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.118+0000 7f444226b740 1 --2- 172.21.15.17:0/2509723976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633cbaa8650 0x5633cbab3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:38.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.119+0000 7f4437e00640 1 --2- 172.21.15.17:0/2509723976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cbaa35c0 0x5633cbaacee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:38.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.119+0000 7f444226b740 1 -- 172.21.15.17:0/2509723976 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633cba05af0 con 0x5633cbaa8650 2024-09-13T16:10:38.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.119+0000 7f444226b740 1 -- 172.21.15.17:0/2509723976 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633cb9c3f20 con 0x5633cbaa35c0 2024-09-13T16:10:38.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.119+0000 7f444226b740 1 -- 172.21.15.17:0/2509723976 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633cb9c3bc0 con 0x5633cbaa2c80 2024-09-13T16:10:38.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.119+0000 7f443ca00640 1 -- 172.21.15.17:0/2509723976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cbaa35c0 msgr2=0x5633cbaacee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:38.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.119+0000 7f443ca00640 1 --2- 172.21.15.17:0/2509723976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cbaa35c0 0x5633cbaacee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.119+0000 7f443ca00640 1 -- 172.21.15.17:0/2509723976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633cbaa8650 msgr2=0x5633cbab3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:38.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.119+0000 7f443ca00640 1 --2- 172.21.15.17:0/2509723976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633cbaa8650 0x5633cbab3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.119+0000 7f444226b740 10 client.0 _ll_register_callbacks cb 0x5633cb9f5a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:10:38.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.120+0000 7f443ca00640 1 -- 172.21.15.17:0/2509723976 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4430016e10 con 0x5633cbaa2c80 2024-09-13T16:10:38.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.120+0000 7f444226b740 1 -- 172.21.15.17:0/2509723976 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5633cba2fc90 con 0x5633cbaa2c80 2024-09-13T16:10:38.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.120+0000 7f441ea00640 10 client.26320 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:10:38.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.120+0000 7f443ca00640 1 --2- 172.21.15.17:0/2509723976 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa2c80 0x5633cbaac9a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f442c009900 tx=0x7f442c009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94cf0d12778ca308 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:38.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.121+0000 7f441ea00640 1 -- 172.21.15.17:0/2509723976 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c043040 con 0x5633cbaa2c80 2024-09-13T16:10:38.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.121+0000 7f441ea00640 1 -- 172.21.15.17:0/2509723976 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f442c032710 con 0x5633cbaa2c80 2024-09-13T16:10:38.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.122+0000 7f441ea00640 1 -- 172.21.15.17:0/2509723976 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f442c032910 con 0x5633cbaa2c80 2024-09-13T16:10:38.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.122+0000 7f444226b740 10 client.26320 fetch_fsmap learned FSMap version 49 2024-09-13T16:10:38.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.122+0000 7f444226b740 1 -- 172.21.15.17:0/2509723976 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=49}) v3 -- 0x5633cba04170 con 0x5633cbaa2c80 2024-09-13T16:10:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.122+0000 7f441ea00640 1 -- 172.21.15.17:0/2509723976 <== mon.1 v2:172.21.15.193:3300/0 4 ==== fsmap(e 49) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f442c032a70 con 0x5633cbaa2c80 2024-09-13T16:10:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.123+0000 7f444226b740 10 client.26320 fetch_fsmap finished waiting for FSMap version 49 2024-09-13T16:10:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.123+0000 7f444226b740 10 client.26320 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:10:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.123+0000 7f444226b740 20 client.26320 populate_metadata read hostname 'smithi017' 2024-09-13T16:10:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.123+0000 7f444226b740 1 --2- 172.21.15.17:0/2509723976 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5633cbab84f0 0x5633cbaba930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.123+0000 7f444226b740 4 client.26320 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:10:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.123+0000 7f444226b740 1 -- 172.21.15.17:0/2509723976 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5633cb9f87d0 con 0x5633cbab84f0 2024-09-13T16:10:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.126+0000 7f4437e00640 1 --2- 172.21.15.17:0/2509723976 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5633cbab84f0 0x5633cbaba930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.127+0000 7f4437e00640 1 --2- 172.21.15.17:0/2509723976 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5633cbab84f0 0x5633cbaba930 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60cf4b3f8f6eea67 server_cookie=74d76d2403217d8 in_seq=0 out_seq=0 2024-09-13T16:10:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.127+0000 7f441ea00640 10 client.26320 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:10:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.128+0000 7f441ea00640 1 -- 172.21.15.17:0/2509723976 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5633cb9f87d0 con 0x5633cbab84f0 2024-09-13T16:10:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.128+0000 7f441ea00640 10 client.26320 handle_command_reply: tid=0 2024-09-13T16:10:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.128+0000 7f444226b740 1 client.26320 shutdown 2024-09-13T16:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.130+0000 7f444226b740 1 -- 172.21.15.17:0/2509723976 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa2c80 msgr2=0x5633cbaac9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.130+0000 7f444226b740 1 --2- 172.21.15.17:0/2509723976 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa2c80 0x5633cbaac9a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f442c009900 tx=0x7f442c009260 comp rx=0 tx=0).stop 2024-09-13T16:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.130+0000 7f444226b740 1 -- 172.21.15.17:0/2509723976 shutdown_connections 2024-09-13T16:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.130+0000 7f444226b740 1 --2- 172.21.15.17:0/2509723976 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5633cbab84f0 0x5633cbaba930 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.130+0000 7f444226b740 1 --2- 172.21.15.17:0/2509723976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633cbaa8650 0x5633cbab3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.130+0000 7f444226b740 1 --2- 172.21.15.17:0/2509723976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cbaa35c0 0x5633cbaacee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.130+0000 7f441ea00640 0 client.26320 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.130+0000 7f444226b740 1 --2- 172.21.15.17:0/2509723976 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa2c80 0x5633cbaac9a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.130+0000 7f444226b740 1 -- 172.21.15.17:0/2509723976 >> 172.21.15.17:0/2509723976 conn(0x5633cba9e2f0 msgr2=0x5633cba9fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.130+0000 7f444226b740 1 -- 172.21.15.17:0/2509723976 shutdown_connections 2024-09-13T16:10:38.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.130+0000 7f444226b740 1 -- 172.21.15.17:0/2509723976 wait complete. 2024-09-13T16:10:38.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.131+0000 7f444226b740 20 client.26320 trim_cache size 0 max 16384 2024-09-13T16:10:38.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.165+0000 7f444226b740 1 Processor -- start 2024-09-13T16:10:38.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.165+0000 7f444226b740 1 -- start start 2024-09-13T16:10:38.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.165+0000 7f444226b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa2c80 0x5633cbaaa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:38.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.166+0000 7f444226b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cbaa35c0 0x5633cbab3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:38.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.166+0000 7f444226b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633cbaa8650 0x5633cbaa4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:38.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.166+0000 7f444226b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633cb76ce60 con 0x5633cbaa8650 2024-09-13T16:10:38.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.166+0000 7f444226b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633cbaac4e0 con 0x5633cbaa35c0 2024-09-13T16:10:38.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.166+0000 7f444226b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633cbab8090 con 0x5633cbaa2c80 2024-09-13T16:10:38.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.166+0000 7f443ca00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa2c80 0x5633cbaaa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:38.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.166+0000 7f4437e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cbaa35c0 0x5633cbab3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:38.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.167+0000 7f4437e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cbaa35c0 0x5633cbab3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:40184/0 (socket says 172.21.15.17:40184) 2024-09-13T16:10:38.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.167+0000 7f443ca00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa2c80 0x5633cbaaa9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:39562/0 (socket says 172.21.15.17:39562) 2024-09-13T16:10:38.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.167+0000 7f443ca00640 1 -- 172.21.15.17:0/633659747 learned_addr learned my addr 172.21.15.17:0/633659747 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:10:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.167+0000 7f443ca00640 1 -- 172.21.15.17:0/633659747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cbaa35c0 msgr2=0x5633cbab3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.167+0000 7f443ca00640 1 --2- 172.21.15.17:0/633659747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cbaa35c0 0x5633cbab3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.167+0000 7f443ca00640 1 -- 172.21.15.17:0/633659747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633cbaa8650 msgr2=0x5633cbaa4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.167+0000 7f443ca00640 1 --2- 172.21.15.17:0/633659747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633cbaa8650 0x5633cbaa4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.167+0000 7f443ca00640 1 -- 172.21.15.17:0/633659747 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633cb9a6180 con 0x5633cbaa2c80 2024-09-13T16:10:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.168+0000 7f443ca00640 1 --2- 172.21.15.17:0/633659747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa2c80 0x5633cbaaa9f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f442c009800 tx=0x7f442c048000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5aa740b1caae9e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.168+0000 7f442aa00640 1 -- 172.21.15.17:0/633659747 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c032710 con 0x5633cbaa2c80 2024-09-13T16:10:38.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.169+0000 7f442aa00640 1 -- 172.21.15.17:0/633659747 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5633cba2fc90 con 0x5633cbaa2c80 2024-09-13T16:10:38.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.169+0000 7f442aa00640 1 -- 172.21.15.17:0/633659747 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c03cce0 con 0x5633cbaa2c80 2024-09-13T16:10:38.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.171+0000 7f444226b740 1 -- 172.21.15.17:0/633659747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa2c80 msgr2=0x5633cbaaa9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:38.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.171+0000 7f444226b740 1 --2- 172.21.15.17:0/633659747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa2c80 0x5633cbaaa9f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f442c009800 tx=0x7f442c048000 comp rx=0 tx=0).stop 2024-09-13T16:10:38.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.171+0000 7f444226b740 1 -- 172.21.15.17:0/633659747 shutdown_connections 2024-09-13T16:10:38.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.171+0000 7f444226b740 1 --2- 172.21.15.17:0/633659747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633cbaa8650 0x5633cbaa4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.171+0000 7f444226b740 1 --2- 172.21.15.17:0/633659747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cbaa35c0 0x5633cbab3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.171+0000 7f444226b740 1 --2- 172.21.15.17:0/633659747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa2c80 0x5633cbaaa9f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.171+0000 7f444226b740 1 -- 172.21.15.17:0/633659747 >> 172.21.15.17:0/633659747 conn(0x5633cba9e2f0 msgr2=0x5633cbabf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:38.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.171+0000 7f444226b740 1 -- 172.21.15.17:0/633659747 shutdown_connections 2024-09-13T16:10:38.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.171+0000 7f444226b740 1 -- 172.21.15.17:0/633659747 wait complete. 2024-09-13T16:10:38.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.172+0000 7f444226b740 1 -- start start 2024-09-13T16:10:38.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.172+0000 7f444226b740 1 Processor -- start 2024-09-13T16:10:38.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.175+0000 7f444226b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa2c80 0x5633cbab37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:38.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.175+0000 7f444226b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cbaa35c0 0x5633cbab3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:38.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.175+0000 7f444226b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633cbaa8650 0x5633cbab0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:38.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.175+0000 7f444226b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633cbab0800 con 0x5633cbaa8650 2024-09-13T16:10:38.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.175+0000 7f444226b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633cbab0970 con 0x5633cbaa35c0 2024-09-13T16:10:38.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.175+0000 7f444226b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633cbab0b30 con 0x5633cbaa2c80 2024-09-13T16:10:38.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.175+0000 7f444226b740 10 client.0 _ll_register_callbacks cb 0x7f4430016c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:10:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.176+0000 7f443ca00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa2c80 0x5633cbab37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:38.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.176+0000 7f443ca00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa2c80 0x5633cbab37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:39576/0 (socket says 172.21.15.17:39576) 2024-09-13T16:10:38.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.176+0000 7f443ca00640 1 -- 172.21.15.17:0/2205771241 learned_addr learned my addr 172.21.15.17:0/2205771241 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:10:38.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.177+0000 7f443d400640 1 --2- 172.21.15.17:0/2205771241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633cbaa8650 0x5633cbab0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:38.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.177+0000 7f443ca00640 1 -- 172.21.15.17:0/2205771241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cbaa35c0 msgr2=0x5633cbab3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:38.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.177+0000 7f443ca00640 1 --2- 172.21.15.17:0/2205771241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cbaa35c0 0x5633cbab3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.177+0000 7f443ca00640 1 -- 172.21.15.17:0/2205771241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633cbaa8650 msgr2=0x5633cbab0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:38.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.177+0000 7f443ca00640 1 --2- 172.21.15.17:0/2205771241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633cbaa8650 0x5633cbab0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.177+0000 7f443ca00640 1 -- 172.21.15.17:0/2205771241 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5633cba04170 con 0x5633cbaa2c80 2024-09-13T16:10:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.178+0000 7f443ca00640 1 --2- 172.21.15.17:0/2205771241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa2c80 0x5633cbab37a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f442c006010 tx=0x7f442c03dca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16dfb7bc17b0a975 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.178+0000 7f441ea00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:10:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.179+0000 7f441ea00640 1 -- 172.21.15.17:0/2205771241 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c032920 con 0x5633cbaa2c80 2024-09-13T16:10:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.179+0000 7f441ea00640 1 -- 172.21.15.17:0/2205771241 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f442c032a80 con 0x5633cbaa2c80 2024-09-13T16:10:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.179+0000 7f444226b740 1 -- 172.21.15.17:0/2205771241 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f443000ccd0 con 0x5633cbaa2c80 2024-09-13T16:10:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.179+0000 7f441ea00640 1 -- 172.21.15.17:0/2205771241 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f442c05d480 con 0x5633cbaa2c80 2024-09-13T16:10:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.180+0000 7f444226b740 10 client.26326 fetch_fsmap learned FSMap version 49 2024-09-13T16:10:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.180+0000 7f444226b740 1 -- 172.21.15.17:0/2205771241 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x5633cb9cb560 con 0x5633cbaa2c80 2024-09-13T16:10:38.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.181+0000 7f441ea00640 1 -- 172.21.15.17:0/2205771241 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f443000ccd0 con 0x5633cbaa2c80 2024-09-13T16:10:38.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.181+0000 7f441ea00640 1 -- 172.21.15.17:0/2205771241 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 49) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f442c049590 con 0x5633cbaa2c80 2024-09-13T16:10:38.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.181+0000 7f444226b740 10 client.26326 fetch_fsmap finished waiting for FSMap version 49 2024-09-13T16:10:38.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.181+0000 7f444226b740 10 client.26326 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:10:38.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.181+0000 7f444226b740 20 client.26326 populate_metadata read hostname 'smithi017' 2024-09-13T16:10:38.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.181+0000 7f444226b740 1 --2- 172.21.15.17:0/2205771241 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5633cbb0fb40 0x5633cbb11f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:38.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.182+0000 7f444226b740 4 client.26326 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:10:38.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.182+0000 7f444226b740 1 -- 172.21.15.17:0/2205771241 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5633cb6f9300 con 0x5633cbb0fb40 2024-09-13T16:10:38.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.182+0000 7f4437e00640 1 --2- 172.21.15.17:0/2205771241 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5633cbb0fb40 0x5633cbb11f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:38.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.185+0000 7f441ea00640 10 client.26326 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:10:38.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.185+0000 7f4437e00640 1 --2- 172.21.15.17:0/2205771241 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5633cbb0fb40 0x5633cbb11f30 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a4b6faa33f2e369 server_cookie=e27d3a218cf5aca4 in_seq=0 out_seq=0 2024-09-13T16:10:38.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:37 smithi193 ceph-mon[35248]: pgmap v771: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.2 MiB/s wr, 467 op/s 2024-09-13T16:10:38.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:37 smithi017 ceph-mon[30494]: pgmap v771: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.2 MiB/s wr, 467 op/s 2024-09-13T16:10:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.316+0000 7f441ea00640 1 -- 172.21.15.17:0/2205771241 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5633cb6f9300 con 0x5633cbb0fb40 2024-09-13T16:10:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.316+0000 7f441ea00640 10 client.26326 handle_command_reply: tid=0 2024-09-13T16:10:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.316+0000 7f444226b740 1 client.26326 shutdown 2024-09-13T16:10:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.316+0000 7f444226b740 1 -- 172.21.15.17:0/2205771241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa2c80 msgr2=0x5633cbab37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.316+0000 7f444226b740 1 --2- 172.21.15.17:0/2205771241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa2c80 0x5633cbab37a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f442c006010 tx=0x7f442c03dca0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.317+0000 7f444226b740 1 -- 172.21.15.17:0/2205771241 shutdown_connections 2024-09-13T16:10:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.317+0000 7f444226b740 1 --2- 172.21.15.17:0/2205771241 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5633cbb0fb40 0x5633cbb11f30 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.317+0000 7f444226b740 1 --2- 172.21.15.17:0/2205771241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633cbaa8650 0x5633cbab0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.317+0000 7f444226b740 1 --2- 172.21.15.17:0/2205771241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5633cbaa35c0 0x5633cbab3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.317+0000 7f444226b740 1 --2- 172.21.15.17:0/2205771241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633cbaa2c80 0x5633cbab37a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.317+0000 7f444226b740 1 -- 172.21.15.17:0/2205771241 >> 172.21.15.17:0/2205771241 conn(0x5633cba9e2f0 msgr2=0x5633cbaa4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.317+0000 7f441ea00640 0 client.26326 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:10:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.317+0000 7f444226b740 1 -- 172.21.15.17:0/2205771241 shutdown_connections 2024-09-13T16:10:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.317+0000 7f444226b740 1 -- 172.21.15.17:0/2205771241 wait complete. 2024-09-13T16:10:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.317+0000 7f444226b740 20 client.26326 trim_cache size 0 max 16384 2024-09-13T16:10:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:10:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:10:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:10:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:10:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.318+0000 7f443de00640 1 -- 172.21.15.17:0/139212135 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f44200a1130 msgr2=0x7f44200a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.318+0000 7f443de00640 1 --2- 172.21.15.17:0/139212135 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f44200a1130 0x7f44200a35f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f442c0056f0 tx=0x7f442c000bc0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.318+0000 7f443de00640 1 -- 172.21.15.17:0/139212135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4438102f10 msgr2=0x7f4438196190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.318+0000 7f443de00640 1 --2- 172.21.15.17:0/139212135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4438102f10 0x7f4438196190 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f442400d770 tx=0x7f442400dc30 comp rx=0 tx=0).stop 2024-09-13T16:10:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.319+0000 7f443de00640 1 -- 172.21.15.17:0/139212135 shutdown_connections 2024-09-13T16:10:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.319+0000 7f443de00640 1 --2- 172.21.15.17:0/139212135 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f44200a1130 0x7f44200a35f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.319+0000 7f443de00640 1 --2- 172.21.15.17:0/139212135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4438105920 0x7f443819d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.319+0000 7f443de00640 1 --2- 172.21.15.17:0/139212135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4438102f10 0x7f4438196190 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.319+0000 7f443de00640 1 --2- 172.21.15.17:0/139212135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44381005e0 0x7f4438195c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.319+0000 7f443de00640 1 -- 172.21.15.17:0/139212135 >> 172.21.15.17:0/139212135 conn(0x7f44380fa1c0 msgr2=0x7f4438100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.319+0000 7f443de00640 1 -- 172.21.15.17:0/139212135 shutdown_connections 2024-09-13T16:10:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:38.319+0000 7f443de00640 1 -- 172.21.15.17:0/139212135 wait complete. 2024-09-13T16:10:38.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:37 smithi189 ceph-mon[34790]: pgmap v771: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.2 MiB/s wr, 467 op/s 2024-09-13T16:10:40.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:39 smithi193 ceph-mon[35248]: pgmap v772: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.3 MiB/s wr, 444 op/s 2024-09-13T16:10:40.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:39 smithi017 ceph-mon[30494]: pgmap v772: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.3 MiB/s wr, 444 op/s 2024-09-13T16:10:40.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 775.0 s, 501.6 tps, lat 198.917 ms stddev 200.895 2024-09-13T16:10:40.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:39 smithi189 ceph-mon[34790]: pgmap v772: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.3 MiB/s wr, 444 op/s 2024-09-13T16:10:42.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:42 smithi193 ceph-mon[35248]: pgmap v773: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.0 MiB/s wr, 502 op/s 2024-09-13T16:10:42.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:42 smithi017 ceph-mon[30494]: pgmap v773: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.0 MiB/s wr, 502 op/s 2024-09-13T16:10:42.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:42 smithi189 ceph-mon[34790]: pgmap v773: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.0 MiB/s wr, 502 op/s 2024-09-13T16:10:44.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:44 smithi189 ceph-mon[34790]: pgmap v774: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 4.7 MiB/s wr, 492 op/s 2024-09-13T16:10:44.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:44 smithi193 ceph-mon[35248]: pgmap v774: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 4.7 MiB/s wr, 492 op/s 2024-09-13T16:10:44.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:44 smithi017 ceph-mon[30494]: pgmap v774: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 4.7 MiB/s wr, 492 op/s 2024-09-13T16:10:45.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 780.0 s, 431.2 tps, lat 228.327 ms stddev 271.447 2024-09-13T16:10:46.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:46 smithi189 ceph-mon[34790]: pgmap v775: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 4.7 MiB/s wr, 504 op/s 2024-09-13T16:10:46.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:46 smithi193 ceph-mon[35248]: pgmap v775: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 4.7 MiB/s wr, 504 op/s 2024-09-13T16:10:46.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:46 smithi017 ceph-mon[30494]: pgmap v775: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 4.7 MiB/s wr, 504 op/s 2024-09-13T16:10:48.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:48 smithi189 ceph-mon[34790]: pgmap v776: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 5.3 MiB/s wr, 511 op/s 2024-09-13T16:10:48.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:48 smithi193 ceph-mon[35248]: pgmap v776: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 5.3 MiB/s wr, 511 op/s 2024-09-13T16:10:48.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:48 smithi017 ceph-mon[30494]: pgmap v776: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 5.3 MiB/s wr, 511 op/s 2024-09-13T16:10:50.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 785.0 s, 466.6 tps, lat 208.708 ms stddev 288.133 2024-09-13T16:10:50.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:50 smithi189 ceph-mon[34790]: pgmap v777: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 5.2 MiB/s wr, 482 op/s 2024-09-13T16:10:50.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:50 smithi193 ceph-mon[35248]: pgmap v777: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 5.2 MiB/s wr, 482 op/s 2024-09-13T16:10:50.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:50 smithi017 ceph-mon[30494]: pgmap v777: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 5.2 MiB/s wr, 482 op/s 2024-09-13T16:10:51.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.564+0000 7f16f2000640 1 -- 172.21.15.17:0/566718642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16ec06ba50 msgr2=0x7f16ec06be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:51.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.564+0000 7f16f2000640 1 --2- 172.21.15.17:0/566718642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16ec06ba50 0x7f16ec06be50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009be0 tx=0x7f16e402a6f0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.566+0000 7f16f2000640 1 -- 172.21.15.17:0/566718642 shutdown_connections 2024-09-13T16:10:51.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.566+0000 7f16f2000640 1 --2- 172.21.15.17:0/566718642 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16ec06d630 0x7f16ec06ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.566+0000 7f16f2000640 1 --2- 172.21.15.17:0/566718642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16ec06cc90 0x7f16ec06d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.566+0000 7f16f2000640 1 --2- 172.21.15.17:0/566718642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16ec06ba50 0x7f16ec06be50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.566+0000 7f16f2000640 1 -- 172.21.15.17:0/566718642 >> 172.21.15.17:0/566718642 conn(0x7f16ec06a240 msgr2=0x7f16ec06a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.566+0000 7f16f2000640 1 -- 172.21.15.17:0/566718642 shutdown_connections 2024-09-13T16:10:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.566+0000 7f16f2000640 1 -- 172.21.15.17:0/566718642 wait complete. 2024-09-13T16:10:51.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.568+0000 7f16f2000640 1 Processor -- start 2024-09-13T16:10:51.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.570+0000 7f16f2000640 1 -- start start 2024-09-13T16:10:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.570+0000 7f16f2000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16ec06ba50 0x7f16ec1a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.570+0000 7f16f2000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16ec06cc90 0x7f16ec1a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.570+0000 7f16f2000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16ec06d630 0x7f16ec1ac140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.570+0000 7f16f2000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec1ac680 con 0x7f16ec06cc90 2024-09-13T16:10:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.570+0000 7f16f2000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec1ac7f0 con 0x7f16ec06ba50 2024-09-13T16:10:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.570+0000 7f16f2000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec1ac9b0 con 0x7f16ec06d630 2024-09-13T16:10:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.571+0000 7f16eaa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16ec06cc90 0x7f16ec1a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.571+0000 7f16eb400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16ec06ba50 0x7f16ec1a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.571+0000 7f16eb400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16ec06ba50 0x7f16ec1a4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:47554/0 (socket says 172.21.15.17:47554) 2024-09-13T16:10:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.571+0000 7f16eb400640 1 -- 172.21.15.17:0/2849144656 learned_addr learned my addr 172.21.15.17:0/2849144656 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:10:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.571+0000 7f16eaa00640 1 -- 172.21.15.17:0/2849144656 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16ec06d630 msgr2=0x7f16ec1ac140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.571+0000 7f16eaa00640 1 --2- 172.21.15.17:0/2849144656 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16ec06d630 0x7f16ec1ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.571+0000 7f16eaa00640 1 -- 172.21.15.17:0/2849144656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16ec06ba50 msgr2=0x7f16ec1a4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.571+0000 7f16eaa00640 1 --2- 172.21.15.17:0/2849144656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16ec06ba50 0x7f16ec1a4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.571+0000 7f16eaa00640 1 -- 172.21.15.17:0/2849144656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc009560 con 0x7f16ec06cc90 2024-09-13T16:10:51.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.572+0000 7f16eaa00640 1 --2- 172.21.15.17:0/2849144656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16ec06cc90 0x7f16ec1a50d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f16d400b3f0 tx=0x7f16d400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:51.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.573+0000 7f16e3e00640 1 -- 172.21.15.17:0/2849144656 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d4011830 con 0x7f16ec06cc90 2024-09-13T16:10:51.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.573+0000 7f16e3e00640 1 -- 172.21.15.17:0/2849144656 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16d4011e50 con 0x7f16ec06cc90 2024-09-13T16:10:51.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.573+0000 7f16e3e00640 1 -- 172.21.15.17:0/2849144656 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d400f2e0 con 0x7f16ec06cc90 2024-09-13T16:10:51.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.573+0000 7f16f2000640 1 -- 172.21.15.17:0/2849144656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e4009840 con 0x7f16ec06cc90 2024-09-13T16:10:51.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.573+0000 7f16f2000640 1 -- 172.21.15.17:0/2849144656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ec1ad040 con 0x7f16ec06cc90 2024-09-13T16:10:51.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.578+0000 7f16f4ddd740 1 Processor -- start 2024-09-13T16:10:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.578+0000 7f16f4ddd740 1 -- start start 2024-09-13T16:10:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.578+0000 7f16f4ddd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf389a70 0x5560cf389e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.580+0000 7f16f4ddd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf38a3b0 0x5560cf38ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.580+0000 7f16f4ddd740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5560cf38f440 0x5560cf391900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.580+0000 7f16ebe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf389a70 0x5560cf389e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.580+0000 7f16ebe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf389a70 0x5560cf389e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:46198/0 (socket says 172.21.15.17:46198) 2024-09-13T16:10:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.580+0000 7f16ebe00640 1 -- 172.21.15.17:0/1086003315 learned_addr learned my addr 172.21.15.17:0/1086003315 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:10:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.580+0000 7f16f4ddd740 1 -- 172.21.15.17:0/1086003315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560cf295bb0 con 0x5560cf38f440 2024-09-13T16:10:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.580+0000 7f16f4ddd740 1 -- 172.21.15.17:0/1086003315 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560cf2f3a70 con 0x5560cf38a3b0 2024-09-13T16:10:51.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.580+0000 7f16f4ddd740 1 -- 172.21.15.17:0/1086003315 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560cf2f1200 con 0x5560cf389a70 2024-09-13T16:10:51.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.580+0000 7f16eb400640 1 --2- 172.21.15.17:0/1086003315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf38a3b0 0x5560cf38ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:51.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.581+0000 7f16eb400640 1 -- 172.21.15.17:0/1086003315 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf389a70 msgr2=0x5560cf389e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:51.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.581+0000 7f16eb400640 1 --2- 172.21.15.17:0/1086003315 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf389a70 0x5560cf389e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.581+0000 7f16eb400640 1 -- 172.21.15.17:0/1086003315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5560cf38f440 msgr2=0x5560cf391900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:10:51.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.581+0000 7f16eb400640 1 --2- 172.21.15.17:0/1086003315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5560cf38f440 0x5560cf391900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.581+0000 7f16eb400640 1 -- 172.21.15.17:0/1086003315 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560cf28e940 con 0x5560cf38a3b0 2024-09-13T16:10:51.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.581+0000 7f16ebe00640 1 --2- 172.21.15.17:0/1086003315 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf389a70 0x5560cf389e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:51.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.582+0000 7f16eb400640 1 --2- 172.21.15.17:0/1086003315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf38a3b0 0x5560cf38ee70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f16e4000f80 tx=0x7f16e40303a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a62e11289c1b66db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:51.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.582+0000 7f16e0c00640 1 -- 172.21.15.17:0/1086003315 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e4030b80 con 0x5560cf38a3b0 2024-09-13T16:10:51.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.583+0000 7f16e0c00640 1 -- 172.21.15.17:0/1086003315 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16e4030ce0 con 0x5560cf38a3b0 2024-09-13T16:10:51.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.583+0000 7f16e0c00640 1 -- 172.21.15.17:0/1086003315 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e4004890 con 0x5560cf38a3b0 2024-09-13T16:10:51.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.585+0000 7f16f4ddd740 1 -- 172.21.15.17:0/1086003315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf38a3b0 msgr2=0x5560cf38ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:51.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.585+0000 7f16f4ddd740 1 --2- 172.21.15.17:0/1086003315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf38a3b0 0x5560cf38ee70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f16e4000f80 tx=0x7f16e40303a0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.585+0000 7f16f4ddd740 1 -- 172.21.15.17:0/1086003315 shutdown_connections 2024-09-13T16:10:51.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.586+0000 7f16f4ddd740 1 --2- 172.21.15.17:0/1086003315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5560cf38f440 0x5560cf391900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.586+0000 7f16f4ddd740 1 --2- 172.21.15.17:0/1086003315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf38a3b0 0x5560cf38ee70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.586+0000 7f16f4ddd740 1 --2- 172.21.15.17:0/1086003315 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf389a70 0x5560cf389e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.586+0000 7f16f4ddd740 1 -- 172.21.15.17:0/1086003315 >> 172.21.15.17:0/1086003315 conn(0x5560cf3850e0 msgr2=0x5560cf3854e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:51.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.589+0000 7f16e3e00640 1 -- 172.21.15.17:0/2849144656 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f16d40105a0 con 0x7f16ec06cc90 2024-09-13T16:10:51.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.589+0000 7f16f4ddd740 1 -- 172.21.15.17:0/1086003315 shutdown_connections 2024-09-13T16:10:51.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.589+0000 7f16f4ddd740 1 -- 172.21.15.17:0/1086003315 wait complete. 2024-09-13T16:10:51.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.590+0000 7f16f4ddd740 1 -- start start 2024-09-13T16:10:51.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.592+0000 7f16f4ddd740 1 Processor -- start 2024-09-13T16:10:51.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.592+0000 7f16f4ddd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf389a70 0x5560cf3938f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:51.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.592+0000 7f16f4ddd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf38a3b0 0x5560cf393e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:51.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.592+0000 7f16f4ddd740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5560cf398dc0 0x5560cf39b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:51.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.592+0000 7f16f4ddd740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560cf2ecaf0 con 0x5560cf398dc0 2024-09-13T16:10:51.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.592+0000 7f16f4ddd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560cf2aaf20 con 0x5560cf389a70 2024-09-13T16:10:51.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.592+0000 7f16f4ddd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560cf2aabc0 con 0x5560cf38a3b0 2024-09-13T16:10:51.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.593+0000 7f16f4ddd740 10 client.0 _ll_register_callbacks cb 0x5560cf2dca70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:10:51.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.593+0000 7f16e3e00640 1 --2- 172.21.15.17:0/2849144656 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f16d00a1020 0x7f16d00a34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:51.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.593+0000 7f16eb400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf38a3b0 0x5560cf393e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:51.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.593+0000 7f16eb400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf38a3b0 0x5560cf393e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:46210/0 (socket says 172.21.15.17:46210) 2024-09-13T16:10:51.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.593+0000 7f16eb400640 1 -- 172.21.15.17:0/2532733499 learned_addr learned my addr 172.21.15.17:0/2532733499 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:10:51.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.593+0000 7f16e3e00640 1 -- 172.21.15.17:0/2849144656 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f16d40cc700 con 0x7f16ec06cc90 2024-09-13T16:10:51.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.593+0000 7f16eaa00640 1 --2- 172.21.15.17:0/2532733499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5560cf398dc0 0x5560cf39b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:51.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.593+0000 7f16ebe00640 1 --2- 172.21.15.17:0/2532733499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf389a70 0x5560cf3938f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:51.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.593+0000 7f16eb400640 1 -- 172.21.15.17:0/2532733499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf389a70 msgr2=0x5560cf3938f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:51.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.594+0000 7f16eb400640 1 --2- 172.21.15.17:0/2532733499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf389a70 0x5560cf3938f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.594+0000 7f16eb400640 1 -- 172.21.15.17:0/2532733499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5560cf398dc0 msgr2=0x5560cf39b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:51.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.594+0000 7f16eb400640 1 --2- 172.21.15.17:0/2532733499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5560cf398dc0 0x5560cf39b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.594+0000 7f16eb400640 1 -- 172.21.15.17:0/2532733499 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ec06e900 con 0x5560cf38a3b0 2024-09-13T16:10:51.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.594+0000 7f16eaa00640 1 --2- 172.21.15.17:0/2532733499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5560cf398dc0 0x5560cf39b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:10:51.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.594+0000 7f16eb400640 1 --2- 172.21.15.17:0/2532733499 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf38a3b0 0x5560cf393e30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009560 tx=0x7f16e40048b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=380b49b779fcf254 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:51.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.594+0000 7f16d9600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:10:51.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.595+0000 7f16ebe00640 1 --2- 172.21.15.17:0/2532733499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf389a70 0x5560cf3938f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:10:51.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.595+0000 7f16ebe00640 1 --2- 172.21.15.17:0/2849144656 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f16d00a1020 0x7f16d00a34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:51.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.595+0000 7f16d9600640 1 -- 172.21.15.17:0/2532733499 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e404b070 con 0x5560cf38a3b0 2024-09-13T16:10:51.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.595+0000 7f16d9600640 1 -- 172.21.15.17:0/2532733499 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f16e4003c40 con 0x5560cf38a3b0 2024-09-13T16:10:51.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.596+0000 7f16f4ddd740 1 -- 172.21.15.17:0/2532733499 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5560cf2df7d0 con 0x5560cf38a3b0 2024-09-13T16:10:51.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.598+0000 7f16ebe00640 1 --2- 172.21.15.17:0/2849144656 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f16d00a1020 0x7f16d00a34e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f16dc005fd0 tx=0x7f16dc0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:51.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.599+0000 7f16d9600640 1 -- 172.21.15.17:0/2532733499 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16e4003e00 con 0x5560cf38a3b0 2024-09-13T16:10:51.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.599+0000 7f16f4ddd740 10 client.26335 fetch_fsmap learned FSMap version 49 2024-09-13T16:10:51.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.599+0000 7f16f4ddd740 1 -- 172.21.15.17:0/2532733499 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x5560cf2eb170 con 0x5560cf38a3b0 2024-09-13T16:10:51.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.599+0000 7f16d9600640 1 -- 172.21.15.17:0/2532733499 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5560cf2df7d0 con 0x5560cf38a3b0 2024-09-13T16:10:51.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.599+0000 7f16d9600640 1 -- 172.21.15.17:0/2532733499 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 49) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f16e4044030 con 0x5560cf38a3b0 2024-09-13T16:10:51.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.599+0000 7f16f4ddd740 10 client.26335 fetch_fsmap finished waiting for FSMap version 49 2024-09-13T16:10:51.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.600+0000 7f16f4ddd740 10 client.26335 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:10:51.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.600+0000 7f16f4ddd740 20 client.26335 populate_metadata read hostname 'smithi017' 2024-09-13T16:10:51.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.600+0000 7f16f4ddd740 1 --2- 172.21.15.17:0/2532733499 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5560cf39f4e0 0x5560cf3a1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:51.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.600+0000 7f16f4ddd740 4 client.26335 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:10:51.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.600+0000 7f16f4ddd740 1 -- 172.21.15.17:0/2532733499 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5560cefe0300 con 0x5560cf39f4e0 2024-09-13T16:10:51.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.602+0000 7f16eaa00640 1 --2- 172.21.15.17:0/2532733499 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5560cf39f4e0 0x5560cf3a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:51.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.603+0000 7f16eaa00640 1 --2- 172.21.15.17:0/2532733499 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5560cf39f4e0 0x5560cf3a1900 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=250ae061c5f769fa server_cookie=3c3c6b8d5481407d in_seq=0 out_seq=0 2024-09-13T16:10:51.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.603+0000 7f16d9600640 10 client.26335 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:10:51.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.603+0000 7f16d9600640 1 -- 172.21.15.17:0/2532733499 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5560cefe0300 con 0x5560cf39f4e0 2024-09-13T16:10:51.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.603+0000 7f16d9600640 10 client.26335 handle_command_reply: tid=0 2024-09-13T16:10:51.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.603+0000 7f16f4ddd740 1 client.26335 shutdown 2024-09-13T16:10:51.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.604+0000 7f16f4ddd740 1 -- 172.21.15.17:0/2532733499 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf38a3b0 msgr2=0x5560cf393e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:51.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.604+0000 7f16f4ddd740 1 --2- 172.21.15.17:0/2532733499 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf38a3b0 0x5560cf393e30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009560 tx=0x7f16e40048b0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.604+0000 7f16f4ddd740 1 -- 172.21.15.17:0/2532733499 shutdown_connections 2024-09-13T16:10:51.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.604+0000 7f16f4ddd740 1 --2- 172.21.15.17:0/2532733499 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5560cf39f4e0 0x5560cf3a1900 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.604+0000 7f16f4ddd740 1 --2- 172.21.15.17:0/2532733499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5560cf398dc0 0x5560cf39b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.604+0000 7f16f4ddd740 1 --2- 172.21.15.17:0/2532733499 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf38a3b0 0x5560cf393e30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.604+0000 7f16f4ddd740 1 --2- 172.21.15.17:0/2532733499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf389a70 0x5560cf3938f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.604+0000 7f16f4ddd740 1 -- 172.21.15.17:0/2532733499 >> 172.21.15.17:0/2532733499 conn(0x5560cf3850e0 msgr2=0x5560cf3868f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:51.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.604+0000 7f16d9600640 0 client.26335 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:10:51.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.604+0000 7f16f4ddd740 1 -- 172.21.15.17:0/2532733499 shutdown_connections 2024-09-13T16:10:51.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.604+0000 7f16f4ddd740 1 -- 172.21.15.17:0/2532733499 wait complete. 2024-09-13T16:10:51.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.605+0000 7f16f4ddd740 20 client.26335 trim_cache size 0 max 16384 2024-09-13T16:10:51.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.636+0000 7f16f4ddd740 1 Processor -- start 2024-09-13T16:10:51.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.636+0000 7f16f4ddd740 1 -- start start 2024-09-13T16:10:51.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.636+0000 7f16f4ddd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf389a70 0x5560cf3854c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:51.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.637+0000 7f16f4ddd740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5560cf38a3b0 0x5560cf385a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.637+0000 7f16f4ddd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf398dc0 0x5560cf3af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.637+0000 7f16eaa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5560cf38a3b0 0x5560cf385a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.637+0000 7f16eb400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf389a70 0x5560cf3854c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.637+0000 7f16eb400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf389a70 0x5560cf3854c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:47578/0 (socket says 172.21.15.17:47578) 2024-09-13T16:10:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.637+0000 7f16ebe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf398dc0 0x5560cf3af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.637+0000 7f16ebe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf398dc0 0x5560cf3af7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:46226/0 (socket says 172.21.15.17:46226) 2024-09-13T16:10:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.637+0000 7f16eb400640 1 -- 172.21.15.17:0/26665162 learned_addr learned my addr 172.21.15.17:0/26665162 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:10:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.638+0000 7f16f4ddd740 1 -- 172.21.15.17:0/26665162 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560cf053e60 con 0x5560cf38a3b0 2024-09-13T16:10:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.638+0000 7f16f4ddd740 1 -- 172.21.15.17:0/26665162 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560cf380c90 con 0x5560cf389a70 2024-09-13T16:10:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.638+0000 7f16f4ddd740 1 -- 172.21.15.17:0/26665162 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560cf39c330 con 0x5560cf398dc0 2024-09-13T16:10:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.638+0000 7f16ebe00640 1 -- 172.21.15.17:0/26665162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf389a70 msgr2=0x5560cf3854c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.638+0000 7f16ebe00640 1 --2- 172.21.15.17:0/26665162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf389a70 0x5560cf3854c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.638+0000 7f16ebe00640 1 -- 172.21.15.17:0/26665162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5560cf38a3b0 msgr2=0x5560cf385a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.638+0000 7f16ebe00640 1 --2- 172.21.15.17:0/26665162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5560cf38a3b0 0x5560cf385a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.638+0000 7f16ebe00640 1 -- 172.21.15.17:0/26665162 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560cf28d180 con 0x5560cf398dc0 2024-09-13T16:10:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.638+0000 7f16eb400640 1 --2- 172.21.15.17:0/26665162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf389a70 0x5560cf3854c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:10:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.640+0000 7f16ebe00640 1 --2- 172.21.15.17:0/26665162 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf398dc0 0x5560cf3af7a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f16dc010f50 tx=0x7f16dc015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4b1128f37b2470d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.640+0000 7f16e1600640 1 -- 172.21.15.17:0/26665162 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc021070 con 0x5560cf398dc0 2024-09-13T16:10:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.640+0000 7f16e1600640 1 -- 172.21.15.17:0/26665162 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16dc004030 con 0x5560cf398dc0 2024-09-13T16:10:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.640+0000 7f16e1600640 1 -- 172.21.15.17:0/26665162 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc015070 con 0x5560cf398dc0 2024-09-13T16:10:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.641+0000 7f16f4ddd740 1 -- 172.21.15.17:0/26665162 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf398dc0 msgr2=0x5560cf3af7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.641+0000 7f16f4ddd740 1 --2- 172.21.15.17:0/26665162 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf398dc0 0x5560cf3af7a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f16dc010f50 tx=0x7f16dc015000 comp rx=0 tx=0).stop 2024-09-13T16:10:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.642+0000 7f16f4ddd740 1 -- 172.21.15.17:0/26665162 shutdown_connections 2024-09-13T16:10:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.642+0000 7f16f4ddd740 1 --2- 172.21.15.17:0/26665162 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf398dc0 0x5560cf3af7a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.642+0000 7f16f4ddd740 1 --2- 172.21.15.17:0/26665162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5560cf38a3b0 0x5560cf385a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.642+0000 7f16f4ddd740 1 --2- 172.21.15.17:0/26665162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf389a70 0x5560cf3854c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.642+0000 7f16f4ddd740 1 -- 172.21.15.17:0/26665162 >> 172.21.15.17:0/26665162 conn(0x5560cf3850e0 msgr2=0x5560cf3a6260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.642+0000 7f16f4ddd740 1 -- 172.21.15.17:0/26665162 shutdown_connections 2024-09-13T16:10:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.642+0000 7f16f4ddd740 1 -- 172.21.15.17:0/26665162 wait complete. 2024-09-13T16:10:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.643+0000 7f16f4ddd740 1 -- start start 2024-09-13T16:10:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.643+0000 7f16f4ddd740 1 Processor -- start 2024-09-13T16:10:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.644+0000 7f16f4ddd740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5560cf389a70 0x5560cf3aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.644+0000 7f16f4ddd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf38a3b0 0x5560cf3af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.644+0000 7f16f4ddd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf398dc0 0x5560cf3f4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.644+0000 7f16f4ddd740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560cf3f4c60 con 0x5560cf389a70 2024-09-13T16:10:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.644+0000 7f16f4ddd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560cf3f4da0 con 0x5560cf38a3b0 2024-09-13T16:10:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.644+0000 7f16f4ddd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560cf3f4f30 con 0x5560cf398dc0 2024-09-13T16:10:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.644+0000 7f16eb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5560cf389a70 0x5560cf3aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.644+0000 7f16f4ddd740 10 client.0 _ll_register_callbacks cb 0x7f16dc005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:10:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.644+0000 7f16eaa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf38a3b0 0x5560cf3af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.644+0000 7f16eb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5560cf389a70 0x5560cf3aefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56266/0 (socket says 172.21.15.17:56266) 2024-09-13T16:10:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.644+0000 7f16eb400640 1 -- 172.21.15.17:0/1349378829 learned_addr learned my addr 172.21.15.17:0/1349378829 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:10:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.645+0000 7f16ebe00640 1 --2- 172.21.15.17:0/1349378829 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf398dc0 0x5560cf3f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.645+0000 7f16eaa00640 1 -- 172.21.15.17:0/1349378829 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf398dc0 msgr2=0x5560cf3f4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.645+0000 7f16eaa00640 1 --2- 172.21.15.17:0/1349378829 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf398dc0 0x5560cf3f4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.645+0000 7f16eaa00640 1 -- 172.21.15.17:0/1349378829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5560cf389a70 msgr2=0x5560cf3aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:10:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.645+0000 7f16eaa00640 1 --2- 172.21.15.17:0/1349378829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5560cf389a70 0x5560cf3aefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.645+0000 7f16eaa00640 1 -- 172.21.15.17:0/1349378829 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560cf2eb170 con 0x5560cf38a3b0 2024-09-13T16:10:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.646+0000 7f16eaa00640 1 --2- 172.21.15.17:0/1349378829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf38a3b0 0x5560cf3af510 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x5560cf38f820 tx=0x7f16d40b9040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1eb3fe5c7b313d62 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:10:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.646+0000 7f16d9600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:10:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.646+0000 7f16d9600640 1 -- 172.21.15.17:0/1349378829 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d4097940 con 0x5560cf38a3b0 2024-09-13T16:10:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.647+0000 7f16d9600640 1 -- 172.21.15.17:0/1349378829 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f16d4097ba0 con 0x5560cf38a3b0 2024-09-13T16:10:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.647+0000 7f16f4ddd740 1 -- 172.21.15.17:0/1349378829 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5560cf316c90 con 0x5560cf38a3b0 2024-09-13T16:10:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.647+0000 7f16d9600640 1 -- 172.21.15.17:0/1349378829 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16d40cc450 con 0x5560cf38a3b0 2024-09-13T16:10:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.647+0000 7f16f4ddd740 10 client.26309 fetch_fsmap learned FSMap version 49 2024-09-13T16:10:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.648+0000 7f16f4ddd740 1 -- 172.21.15.17:0/1349378829 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x5560cf2b2560 con 0x5560cf38a3b0 2024-09-13T16:10:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.648+0000 7f16d9600640 1 -- 172.21.15.17:0/1349378829 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5560cf316c90 con 0x5560cf38a3b0 2024-09-13T16:10:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.648+0000 7f16d9600640 1 -- 172.21.15.17:0/1349378829 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 49) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f16d40b90b0 con 0x5560cf38a3b0 2024-09-13T16:10:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.649+0000 7f16f4ddd740 10 client.26309 fetch_fsmap finished waiting for FSMap version 49 2024-09-13T16:10:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.649+0000 7f16f4ddd740 10 client.26309 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:10:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.649+0000 7f16f4ddd740 20 client.26309 populate_metadata read hostname 'smithi017' 2024-09-13T16:10:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.649+0000 7f16f4ddd740 1 --2- 172.21.15.17:0/1349378829 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5560cf3f6960 0x5560cf3f8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:10:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.649+0000 7f16f4ddd740 4 client.26309 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:10:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.649+0000 7f16f4ddd740 1 -- 172.21.15.17:0/1349378829 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5560ceff1600 con 0x5560cf3f6960 2024-09-13T16:10:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.649+0000 7f16eb400640 1 --2- 172.21.15.17:0/1349378829 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5560cf3f6960 0x5560cf3f8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:10:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.650+0000 7f16eb400640 1 --2- 172.21.15.17:0/1349378829 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5560cf3f6960 0x5560cf3f8d80 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58b0ba6e927dd103 server_cookie=d7ef7a76f6e7b962 in_seq=0 out_seq=0 2024-09-13T16:10:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.650+0000 7f16d9600640 10 client.26309 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:10:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.671+0000 7f16d9600640 1 -- 172.21.15.17:0/1349378829 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5560ceff1600 con 0x5560cf3f6960 2024-09-13T16:10:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.671+0000 7f16d9600640 10 client.26309 handle_command_reply: tid=0 2024-09-13T16:10:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.671+0000 7f16f4ddd740 1 client.26309 shutdown 2024-09-13T16:10:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.672+0000 7f16f4ddd740 1 -- 172.21.15.17:0/1349378829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf38a3b0 msgr2=0x5560cf3af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.672+0000 7f16f4ddd740 1 --2- 172.21.15.17:0/1349378829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf38a3b0 0x5560cf3af510 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x5560cf38f820 tx=0x7f16d40b9040 comp rx=0 tx=0).stop 2024-09-13T16:10:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.672+0000 7f16f4ddd740 1 -- 172.21.15.17:0/1349378829 shutdown_connections 2024-09-13T16:10:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.672+0000 7f16f4ddd740 1 --2- 172.21.15.17:0/1349378829 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5560cf3f6960 0x5560cf3f8d80 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.672+0000 7f16f4ddd740 1 --2- 172.21.15.17:0/1349378829 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560cf398dc0 0x5560cf3f4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.672+0000 7f16f4ddd740 1 --2- 172.21.15.17:0/1349378829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560cf38a3b0 0x5560cf3af510 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.672+0000 7f16d9600640 0 client.26309 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:10:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.672+0000 7f16f4ddd740 1 --2- 172.21.15.17:0/1349378829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5560cf389a70 0x5560cf3aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.673+0000 7f16f4ddd740 1 -- 172.21.15.17:0/1349378829 >> 172.21.15.17:0/1349378829 conn(0x5560cf3850e0 msgr2=0x5560cf3854c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.673+0000 7f16f4ddd740 1 -- 172.21.15.17:0/1349378829 shutdown_connections 2024-09-13T16:10:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.674+0000 7f16f4ddd740 1 -- 172.21.15.17:0/1349378829 wait complete. 2024-09-13T16:10:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.674+0000 7f16f4ddd740 20 client.26309 trim_cache size 0 max 16384 2024-09-13T16:10:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:10:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:10:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:10:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:10:51.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.675+0000 7f16f2000640 1 -- 172.21.15.17:0/2849144656 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f16d00a1020 msgr2=0x7f16d00a34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:51.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.675+0000 7f16f2000640 1 --2- 172.21.15.17:0/2849144656 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f16d00a1020 0x7f16d00a34e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f16dc005fd0 tx=0x7f16dc0046c0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.675+0000 7f16f2000640 1 -- 172.21.15.17:0/2849144656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16ec06cc90 msgr2=0x7f16ec1a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:10:51.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.675+0000 7f16f2000640 1 --2- 172.21.15.17:0/2849144656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16ec06cc90 0x7f16ec1a50d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f16d400b3f0 tx=0x7f16d400b8b0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.675+0000 7f16f2000640 1 -- 172.21.15.17:0/2849144656 shutdown_connections 2024-09-13T16:10:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.675+0000 7f16f2000640 1 --2- 172.21.15.17:0/2849144656 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f16d00a1020 0x7f16d00a34e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.675+0000 7f16f2000640 1 --2- 172.21.15.17:0/2849144656 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16ec06d630 0x7f16ec1ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.675+0000 7f16f2000640 1 --2- 172.21.15.17:0/2849144656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16ec06cc90 0x7f16ec1a50d0 secure :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f16d400b3f0 tx=0x7f16d400b8b0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.675+0000 7f16f2000640 1 --2- 172.21.15.17:0/2849144656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f16ec06ba50 0x7f16ec1a4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:10:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.675+0000 7f16f2000640 1 -- 172.21.15.17:0/2849144656 >> 172.21.15.17:0/2849144656 conn(0x7f16ec06a240 msgr2=0x7f16ec1095c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:10:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.676+0000 7f16f2000640 1 -- 172.21.15.17:0/2849144656 shutdown_connections 2024-09-13T16:10:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:10:51.676+0000 7f16f2000640 1 -- 172.21.15.17:0/2849144656 wait complete. 2024-09-13T16:10:52.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:52 smithi189 ceph-mon[34790]: pgmap v778: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 5.4 MiB/s wr, 518 op/s 2024-09-13T16:10:52.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:52 smithi193 ceph-mon[35248]: pgmap v778: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 5.4 MiB/s wr, 518 op/s 2024-09-13T16:10:52.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:52 smithi017 ceph-mon[30494]: pgmap v778: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 5.4 MiB/s wr, 518 op/s 2024-09-13T16:10:54.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:54 smithi189 ceph-mon[34790]: pgmap v779: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 4.9 MiB/s wr, 484 op/s 2024-09-13T16:10:54.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:54 smithi193 ceph-mon[35248]: pgmap v779: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 4.9 MiB/s wr, 484 op/s 2024-09-13T16:10:54.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:54 smithi017 ceph-mon[30494]: pgmap v779: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 4.9 MiB/s wr, 484 op/s 2024-09-13T16:10:55.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 790.0 s, 515.0 tps, lat 201.288 ms stddev 237.242 2024-09-13T16:10:56.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:56 smithi189 ceph-mon[34790]: pgmap v780: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 5.4 MiB/s wr, 502 op/s 2024-09-13T16:10:56.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:56 smithi193 ceph-mon[35248]: pgmap v780: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 5.4 MiB/s wr, 502 op/s 2024-09-13T16:10:56.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:56 smithi017 ceph-mon[30494]: pgmap v780: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 5.4 MiB/s wr, 502 op/s 2024-09-13T16:10:58.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:10:58 smithi189 ceph-mon[34790]: pgmap v781: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 5.1 MiB/s wr, 482 op/s 2024-09-13T16:10:58.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:10:58 smithi193 ceph-mon[35248]: pgmap v781: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 5.1 MiB/s wr, 482 op/s 2024-09-13T16:10:58.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:10:58 smithi017 ceph-mon[30494]: pgmap v781: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 5.1 MiB/s wr, 482 op/s 2024-09-13T16:11:00.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 795.0 s, 463.4 tps, lat 215.686 ms stddev 236.709 2024-09-13T16:11:00.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:00 smithi189 ceph-mon[34790]: pgmap v782: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.4 MiB/s wr, 458 op/s 2024-09-13T16:11:00.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:00 smithi193 ceph-mon[35248]: pgmap v782: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.4 MiB/s wr, 458 op/s 2024-09-13T16:11:00.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:00 smithi017 ceph-mon[30494]: pgmap v782: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.4 MiB/s wr, 458 op/s 2024-09-13T16:11:02.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:02 smithi189 ceph-mon[34790]: pgmap v783: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.5 MiB/s wr, 486 op/s 2024-09-13T16:11:02.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:02 smithi193 ceph-mon[35248]: pgmap v783: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.5 MiB/s wr, 486 op/s 2024-09-13T16:11:02.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:02 smithi017 ceph-mon[30494]: pgmap v783: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.5 MiB/s wr, 486 op/s 2024-09-13T16:11:04.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:04 smithi189 ceph-mon[34790]: pgmap v784: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 455 op/s 2024-09-13T16:11:04.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:04 smithi193 ceph-mon[35248]: pgmap v784: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 455 op/s 2024-09-13T16:11:04.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:04 smithi017 ceph-mon[30494]: pgmap v784: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 455 op/s 2024-09-13T16:11:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.963+0000 7f0006200640 1 -- 172.21.15.17:0/630274921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f000010c2b0 msgr2=0x7f0000112b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.963+0000 7f0006200640 1 --2- 172.21.15.17:0/630274921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f000010c2b0 0x7f0000112b40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7efff8009ca0 tx=0x7efff802a8c0 comp rx=0 tx=0).stop 2024-09-13T16:11:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.965+0000 7f0006200640 1 -- 172.21.15.17:0/630274921 shutdown_connections 2024-09-13T16:11:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.965+0000 7f0006200640 1 --2- 172.21.15.17:0/630274921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f000010c2b0 0x7f0000112b40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.965+0000 7f0006200640 1 --2- 172.21.15.17:0/630274921 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f000010b8f0 0x7f000010bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.965+0000 7f0006200640 1 --2- 172.21.15.17:0/630274921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f000010a8c0 0x7f000010acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.965+0000 7f0006200640 1 -- 172.21.15.17:0/630274921 >> 172.21.15.17:0/630274921 conn(0x7f000006a240 msgr2=0x7f000006a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.965+0000 7f0006200640 1 -- 172.21.15.17:0/630274921 shutdown_connections 2024-09-13T16:11:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.965+0000 7f0006200640 1 -- 172.21.15.17:0/630274921 wait complete. 2024-09-13T16:11:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.966+0000 7f0006200640 1 Processor -- start 2024-09-13T16:11:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.966+0000 7f0006200640 1 -- start start 2024-09-13T16:11:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.967+0000 7f0006200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f000010a8c0 0x7f00001a0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.967+0000 7f0006200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f000010b8f0 0x7f00001a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.967+0000 7f0006200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f000010c2b0 0x7f00001a7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.967+0000 7f0006200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00001a81c0 con 0x7f000010a8c0 2024-09-13T16:11:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.967+0000 7f0006200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00001a8330 con 0x7f000010b8f0 2024-09-13T16:11:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.967+0000 7f0006200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00001a84f0 con 0x7f000010c2b0 2024-09-13T16:11:04.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.967+0000 7effffe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f000010c2b0 0x7f00001a7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:04.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.967+0000 7effff400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f000010a8c0 0x7f00001a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:04.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.968+0000 7effffe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f000010c2b0 0x7f00001a7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:48816/0 (socket says 172.21.15.17:48816) 2024-09-13T16:11:04.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.968+0000 7effffe00640 1 -- 172.21.15.17:0/424344686 learned_addr learned my addr 172.21.15.17:0/424344686 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:04.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.968+0000 7efffea00640 1 --2- 172.21.15.17:0/424344686 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f000010b8f0 0x7f00001a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:04.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.968+0000 7effffe00640 1 -- 172.21.15.17:0/424344686 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f000010b8f0 msgr2=0x7f00001a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:04.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.968+0000 7effffe00640 1 --2- 172.21.15.17:0/424344686 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f000010b8f0 0x7f00001a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:04.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.968+0000 7effffe00640 1 -- 172.21.15.17:0/424344686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f000010a8c0 msgr2=0x7f00001a0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:04.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.968+0000 7effffe00640 1 --2- 172.21.15.17:0/424344686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f000010a8c0 0x7f00001a0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:04.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.968+0000 7effffe00640 1 -- 172.21.15.17:0/424344686 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff8009900 con 0x7f000010c2b0 2024-09-13T16:11:04.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.969+0000 7effffe00640 1 --2- 172.21.15.17:0/424344686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f000010c2b0 0x7f00001a7c80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efff80098d0 tx=0x7efff8032f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:04.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.969+0000 7efff7e00640 1 -- 172.21.15.17:0/424344686 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff8003b70 con 0x7f000010c2b0 2024-09-13T16:11:04.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.969+0000 7efff7e00640 1 -- 172.21.15.17:0/424344686 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efff8040070 con 0x7f000010c2b0 2024-09-13T16:11:04.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.969+0000 7efff7e00640 1 -- 172.21.15.17:0/424344686 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff8004510 con 0x7f000010c2b0 2024-09-13T16:11:04.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.969+0000 7f0006200640 1 -- 172.21.15.17:0/424344686 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00001a8770 con 0x7f000010c2b0 2024-09-13T16:11:04.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.969+0000 7f0006200640 1 -- 172.21.15.17:0/424344686 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00001a8c30 con 0x7f000010c2b0 2024-09-13T16:11:04.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.977+0000 7f0008fd1740 1 Processor -- start 2024-09-13T16:11:04.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.977+0000 7efff7e00640 1 -- 172.21.15.17:0/424344686 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7efff8042030 con 0x7f000010c2b0 2024-09-13T16:11:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.979+0000 7f0008fd1740 1 -- start start 2024-09-13T16:11:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.979+0000 7f0008fd1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffc6a70 0x55c56ffc6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.979+0000 7f0008fd1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c56ffc73b0 0x55c56ffcbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:04.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.979+0000 7f0008fd1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c56ffcc440 0x55c56ffce900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:04.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.980+0000 7f0008fd1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c56fed2bb0 con 0x55c56ffc73b0 2024-09-13T16:11:04.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.980+0000 7f0008fd1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c56ff30a70 con 0x55c56ffc6a70 2024-09-13T16:11:04.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.980+0000 7f0008fd1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c56ff2e200 con 0x55c56ffcc440 2024-09-13T16:11:04.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.980+0000 7efffea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffc6a70 0x55c56ffc6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:04.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.980+0000 7efffea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffc6a70 0x55c56ffc6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:50674/0 (socket says 172.21.15.17:50674) 2024-09-13T16:11:04.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.980+0000 7efffea00640 1 -- 172.21.15.17:0/276808501 learned_addr learned my addr 172.21.15.17:0/276808501 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:04.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.980+0000 7efff7e00640 1 --2- 172.21.15.17:0/424344686 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7effe40a11e0 0x7effe40a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:04.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.980+0000 7efffea00640 1 --2- 172.21.15.17:0/276808501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c56ffcc440 0x55c56ffce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:04.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.980+0000 7effff400640 1 --2- 172.21.15.17:0/276808501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c56ffc73b0 0x55c56ffcbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:04.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.980+0000 7efffea00640 1 -- 172.21.15.17:0/276808501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c56ffcc440 msgr2=0x55c56ffce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:04.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.980+0000 7efffea00640 1 --2- 172.21.15.17:0/276808501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c56ffcc440 0x55c56ffce900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:04.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.981+0000 7efffea00640 1 -- 172.21.15.17:0/276808501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c56ffc73b0 msgr2=0x55c56ffcbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:04.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.981+0000 7efffea00640 1 --2- 172.21.15.17:0/276808501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c56ffc73b0 0x55c56ffcbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:04.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.981+0000 7efffea00640 1 -- 172.21.15.17:0/276808501 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c56fecb940 con 0x55c56ffc6a70 2024-09-13T16:11:04.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.981+0000 7effffe00640 1 --2- 172.21.15.17:0/424344686 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7effe40a11e0 0x7effe40a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:04.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.981+0000 7efffea00640 1 --2- 172.21.15.17:0/276808501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffc6a70 0x55c56ffc6e70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7effec011810 tx=0x7effec0097d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dd40f89a3428954 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:04.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.983+0000 7efff4c00640 1 -- 172.21.15.17:0/276808501 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec004030 con 0x55c56ffc6a70 2024-09-13T16:11:04.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.983+0000 7efff4c00640 1 -- 172.21.15.17:0/276808501 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7effec00f7c0 con 0x55c56ffc6a70 2024-09-13T16:11:04.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.983+0000 7efff4c00640 1 -- 172.21.15.17:0/276808501 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec003850 con 0x55c56ffc6a70 2024-09-13T16:11:04.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.983+0000 7efff7e00640 1 -- 172.21.15.17:0/424344686 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7efff80ee090 con 0x7f000010c2b0 2024-09-13T16:11:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.984+0000 7f0008fd1740 1 -- 172.21.15.17:0/276808501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffc6a70 msgr2=0x55c56ffc6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.984+0000 7f0008fd1740 1 --2- 172.21.15.17:0/276808501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffc6a70 0x55c56ffc6e70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7effec011810 tx=0x7effec0097d0 comp rx=0 tx=0).stop 2024-09-13T16:11:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.984+0000 7f0008fd1740 1 -- 172.21.15.17:0/276808501 shutdown_connections 2024-09-13T16:11:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.984+0000 7f0008fd1740 1 --2- 172.21.15.17:0/276808501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c56ffcc440 0x55c56ffce900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.984+0000 7f0008fd1740 1 --2- 172.21.15.17:0/276808501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c56ffc73b0 0x55c56ffcbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.984+0000 7f0008fd1740 1 --2- 172.21.15.17:0/276808501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffc6a70 0x55c56ffc6e70 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.984+0000 7f0008fd1740 1 -- 172.21.15.17:0/276808501 >> 172.21.15.17:0/276808501 conn(0x55c56ffc20e0 msgr2=0x55c56ffc24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:04.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.984+0000 7f0008fd1740 1 -- 172.21.15.17:0/276808501 shutdown_connections 2024-09-13T16:11:04.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.984+0000 7f0008fd1740 1 -- 172.21.15.17:0/276808501 wait complete. 2024-09-13T16:11:04.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.984+0000 7effffe00640 1 --2- 172.21.15.17:0/424344686 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7effe40a11e0 0x7effe40a36a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efff80b7db0 tx=0x7efff808d590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:04.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.985+0000 7f0008fd1740 1 -- start start 2024-09-13T16:11:04.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.985+0000 7f0008fd1740 1 Processor -- start 2024-09-13T16:11:04.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.986+0000 7f0008fd1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c56ffc73b0 0x55c56ffd0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:04.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.986+0000 7f0008fd1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c56ffcc440 0x55c56ffd0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:04.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.986+0000 7f0008fd1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffd5f20 0x55c56ffd8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:04.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.986+0000 7f0008fd1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c56ff29af0 con 0x55c56ffc73b0 2024-09-13T16:11:04.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.986+0000 7f0008fd1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c56fee7f20 con 0x55c56ffd5f20 2024-09-13T16:11:04.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.986+0000 7f0008fd1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c56fee7bc0 con 0x55c56ffcc440 2024-09-13T16:11:04.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.986+0000 7f0008fd1740 10 client.0 _ll_register_callbacks cb 0x55c56ff19a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:11:04.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.986+0000 7effff400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c56ffcc440 0x55c56ffd0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:04.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.986+0000 7effff400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c56ffcc440 0x55c56ffd0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:48830/0 (socket says 172.21.15.17:48830) 2024-09-13T16:11:04.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.986+0000 7effff400640 1 -- 172.21.15.17:0/2304719263 learned_addr learned my addr 172.21.15.17:0/2304719263 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:04.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.987+0000 7efffea00640 1 --2- 172.21.15.17:0/2304719263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffd5f20 0x55c56ffd8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:04.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.987+0000 7effff400640 1 -- 172.21.15.17:0/2304719263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffd5f20 msgr2=0x55c56ffd8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:04.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.988+0000 7effff400640 1 --2- 172.21.15.17:0/2304719263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffd5f20 0x55c56ffd8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:04.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.988+0000 7effff400640 1 -- 172.21.15.17:0/2304719263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c56ffc73b0 msgr2=0x55c56ffd0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:04.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.988+0000 7effff400640 1 --2- 172.21.15.17:0/2304719263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c56ffc73b0 0x55c56ffd0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:04.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.988+0000 7effff400640 1 -- 172.21.15.17:0/2304719263 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effec019040 con 0x55c56ffcc440 2024-09-13T16:11:04.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.989+0000 7effe9600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:11:04.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.989+0000 7effff400640 1 --2- 172.21.15.17:0/2304719263 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c56ffcc440 0x55c56ffd0f40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efff000dd30 tx=0x7efff000f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e915c67d84e15a00 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:04.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.992+0000 7effe9600640 1 -- 172.21.15.17:0/2304719263 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff0005220 con 0x55c56ffcc440 2024-09-13T16:11:04.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.992+0000 7effe9600640 1 -- 172.21.15.17:0/2304719263 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7efff0015070 con 0x55c56ffcc440 2024-09-13T16:11:04.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.992+0000 7f0008fd1740 1 -- 172.21.15.17:0/2304719263 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c56ff53c90 con 0x55c56ffcc440 2024-09-13T16:11:04.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.993+0000 7effe9600640 1 -- 172.21.15.17:0/2304719263 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7efff0005220 con 0x55c56ffcc440 2024-09-13T16:11:04.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.993+0000 7f0008fd1740 10 client.26350 fetch_fsmap learned FSMap version 49 2024-09-13T16:11:04.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.993+0000 7f0008fd1740 1 -- 172.21.15.17:0/2304719263 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55c56ff28170 con 0x55c56ffcc440 2024-09-13T16:11:04.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.994+0000 7effe9600640 1 -- 172.21.15.17:0/2304719263 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efff0005590 con 0x55c56ffcc440 2024-09-13T16:11:04.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.994+0000 7effe9600640 1 -- 172.21.15.17:0/2304719263 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 49) v1 ==== 7478+0+0 (secure 0 0 0) 0x7efff0023820 con 0x55c56ffcc440 2024-09-13T16:11:04.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.994+0000 7f0008fd1740 10 client.26350 fetch_fsmap finished waiting for FSMap version 49 2024-09-13T16:11:04.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.994+0000 7f0008fd1740 10 client.26350 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:11:04.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.994+0000 7f0008fd1740 20 client.26350 populate_metadata read hostname 'smithi017' 2024-09-13T16:11:04.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.994+0000 7f0008fd1740 1 --2- 172.21.15.17:0/2304719263 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c56ffdca80 0x55c56ffdeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:04.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.994+0000 7f0008fd1740 4 client.26350 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:11:04.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.994+0000 7f0008fd1740 1 -- 172.21.15.17:0/2304719263 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c56ff53c90 con 0x55c56ffdca80 2024-09-13T16:11:04.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.995+0000 7efffea00640 1 --2- 172.21.15.17:0/2304719263 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c56ffdca80 0x55c56ffdeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:04.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.997+0000 7efffea00640 1 --2- 172.21.15.17:0/2304719263 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c56ffdca80 0x55c56ffdeec0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=689c46e83576ea9c server_cookie=22179af26f1d4638 in_seq=0 out_seq=0 2024-09-13T16:11:04.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.997+0000 7effe9600640 10 client.26350 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:11:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.998+0000 7effe9600640 1 -- 172.21.15.17:0/2304719263 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c56ff53c90 con 0x55c56ffdca80 2024-09-13T16:11:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.998+0000 7effe9600640 10 client.26350 handle_command_reply: tid=0 2024-09-13T16:11:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.998+0000 7f0008fd1740 1 client.26350 shutdown 2024-09-13T16:11:05.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.999+0000 7f0008fd1740 1 -- 172.21.15.17:0/2304719263 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c56ffcc440 msgr2=0x55c56ffd0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:05.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.999+0000 7f0008fd1740 1 --2- 172.21.15.17:0/2304719263 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c56ffcc440 0x55c56ffd0f40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efff000dd30 tx=0x7efff000f730 comp rx=0 tx=0).stop 2024-09-13T16:11:05.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.999+0000 7f0008fd1740 1 -- 172.21.15.17:0/2304719263 shutdown_connections 2024-09-13T16:11:05.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.999+0000 7f0008fd1740 1 --2- 172.21.15.17:0/2304719263 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c56ffdca80 0x55c56ffdeec0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:05.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.999+0000 7f0008fd1740 1 --2- 172.21.15.17:0/2304719263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffd5f20 0x55c56ffd8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:05.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.999+0000 7f0008fd1740 1 --2- 172.21.15.17:0/2304719263 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c56ffcc440 0x55c56ffd0f40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:05.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.999+0000 7f0008fd1740 1 --2- 172.21.15.17:0/2304719263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c56ffc73b0 0x55c56ffd0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:05.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:04.999+0000 7f0008fd1740 1 -- 172.21.15.17:0/2304719263 >> 172.21.15.17:0/2304719263 conn(0x55c56ffc20e0 msgr2=0x55c56ffc38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:05.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.000+0000 7effe9600640 0 client.26350 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:11:05.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.000+0000 7f0008fd1740 1 -- 172.21.15.17:0/2304719263 shutdown_connections 2024-09-13T16:11:05.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.000+0000 7f0008fd1740 1 -- 172.21.15.17:0/2304719263 wait complete. 2024-09-13T16:11:05.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.000+0000 7f0008fd1740 20 client.26350 trim_cache size 0 max 16384 2024-09-13T16:11:05.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.044+0000 7f0008fd1740 1 Processor -- start 2024-09-13T16:11:05.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.045+0000 7f0008fd1740 1 -- start start 2024-09-13T16:11:05.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.046+0000 7f0008fd1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffc73b0 0x55c56ffe3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:05.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.046+0000 7f0008fd1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c56ffcc440 0x55c56ffecda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:05.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.046+0000 7f0008fd1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c56ffd5f20 0x55c56ffed2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:05.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.046+0000 7f0008fd1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c56fc90e60 con 0x55c56ffcc440 2024-09-13T16:11:05.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.046+0000 7f0008fd1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c56ffd1ae0 con 0x55c56ffc73b0 2024-09-13T16:11:05.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.046+0000 7f0008fd1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c56ffc7890 con 0x55c56ffd5f20 2024-09-13T16:11:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.046+0000 7efffea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffc73b0 0x55c56ffe3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.046+0000 7efffea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffc73b0 0x55c56ffe3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:50698/0 (socket says 172.21.15.17:50698) 2024-09-13T16:11:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.046+0000 7efffea00640 1 -- 172.21.15.17:0/2792543391 learned_addr learned my addr 172.21.15.17:0/2792543391 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.046+0000 7efffea00640 1 --2- 172.21.15.17:0/2792543391 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c56ffd5f20 0x55c56ffed2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.047+0000 7effff400640 1 --2- 172.21.15.17:0/2792543391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c56ffcc440 0x55c56ffecda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.047+0000 7efffea00640 1 -- 172.21.15.17:0/2792543391 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c56ffd5f20 msgr2=0x55c56ffed2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.047+0000 7efffea00640 1 --2- 172.21.15.17:0/2792543391 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c56ffd5f20 0x55c56ffed2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:05.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.047+0000 7efffea00640 1 -- 172.21.15.17:0/2792543391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c56ffcc440 msgr2=0x55c56ffecda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:05.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.048+0000 7efffea00640 1 --2- 172.21.15.17:0/2792543391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c56ffcc440 0x55c56ffecda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:05.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.048+0000 7efffea00640 1 -- 172.21.15.17:0/2792543391 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c56feca180 con 0x55c56ffc73b0 2024-09-13T16:11:05.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.048+0000 7effff400640 1 --2- 172.21.15.17:0/2792543391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c56ffcc440 0x55c56ffecda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:11:05.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.048+0000 7efffea00640 1 --2- 172.21.15.17:0/2792543391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffc73b0 0x55c56ffe3860 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7effec001eb0 tx=0x7effec00f9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3092dbd330f1391d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:05.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.048+0000 7efff5600640 1 -- 172.21.15.17:0/2792543391 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec026040 con 0x55c56ffc73b0 2024-09-13T16:11:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.049+0000 7efff5600640 1 -- 172.21.15.17:0/2792543391 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7effec031020 con 0x55c56ffc73b0 2024-09-13T16:11:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.050+0000 7efff5600640 1 -- 172.21.15.17:0/2792543391 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec005640 con 0x55c56ffc73b0 2024-09-13T16:11:05.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.051+0000 7f0008fd1740 1 -- 172.21.15.17:0/2792543391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffc73b0 msgr2=0x55c56ffe3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:05.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.051+0000 7f0008fd1740 1 --2- 172.21.15.17:0/2792543391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffc73b0 0x55c56ffe3860 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7effec001eb0 tx=0x7effec00f9f0 comp rx=0 tx=0).stop 2024-09-13T16:11:05.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.052+0000 7f0008fd1740 1 -- 172.21.15.17:0/2792543391 shutdown_connections 2024-09-13T16:11:05.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.052+0000 7f0008fd1740 1 --2- 172.21.15.17:0/2792543391 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c56ffd5f20 0x55c56ffed2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:05.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.052+0000 7f0008fd1740 1 --2- 172.21.15.17:0/2792543391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c56ffcc440 0x55c56ffecda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:05.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.052+0000 7f0008fd1740 1 --2- 172.21.15.17:0/2792543391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffc73b0 0x55c56ffe3860 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:05.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.052+0000 7f0008fd1740 1 -- 172.21.15.17:0/2792543391 >> 172.21.15.17:0/2792543391 conn(0x55c56ffc20e0 msgr2=0x55c56ffbd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:05.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.052+0000 7f0008fd1740 1 -- 172.21.15.17:0/2792543391 shutdown_connections 2024-09-13T16:11:05.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.052+0000 7f0008fd1740 1 -- 172.21.15.17:0/2792543391 wait complete. 2024-09-13T16:11:05.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.053+0000 7f0008fd1740 1 -- start start 2024-09-13T16:11:05.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.053+0000 7f0008fd1740 1 Processor -- start 2024-09-13T16:11:05.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.054+0000 7f0008fd1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffc73b0 0x55c56ffec500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:05.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.054+0000 7f0008fd1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c56ffcc440 0x55c56ffeca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:05.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.054+0000 7f0008fd1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c56ffd5f20 0x55c570031b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:05.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.054+0000 7f0008fd1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5700320d0 con 0x55c56ffcc440 2024-09-13T16:11:05.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.054+0000 7f0008fd1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c570032240 con 0x55c56ffc73b0 2024-09-13T16:11:05.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.054+0000 7f0008fd1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c570043410 con 0x55c56ffd5f20 2024-09-13T16:11:05.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.054+0000 7f0008fd1740 10 client.0 _ll_register_callbacks cb 0x7effec009ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:11:05.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.054+0000 7efffea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffc73b0 0x55c56ffec500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:05.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.054+0000 7efffea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffc73b0 0x55c56ffec500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:50712/0 (socket says 172.21.15.17:50712) 2024-09-13T16:11:05.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.054+0000 7efffea00640 1 -- 172.21.15.17:0/3078095017 learned_addr learned my addr 172.21.15.17:0/3078095017 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:05.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.054+0000 7efffea00640 1 --2- 172.21.15.17:0/3078095017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c56ffd5f20 0x55c570031b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:05.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.055+0000 7efffea00640 1 -- 172.21.15.17:0/3078095017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c56ffd5f20 msgr2=0x55c570031b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:05.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.055+0000 7efffea00640 1 --2- 172.21.15.17:0/3078095017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c56ffd5f20 0x55c570031b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:05.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.055+0000 7efffea00640 1 -- 172.21.15.17:0/3078095017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c56ffcc440 msgr2=0x55c56ffeca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:05.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.055+0000 7efffea00640 1 --2- 172.21.15.17:0/3078095017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c56ffcc440 0x55c56ffeca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:05.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.055+0000 7efffea00640 1 -- 172.21.15.17:0/3078095017 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c56fecb940 con 0x55c56ffc73b0 2024-09-13T16:11:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.055+0000 7efffea00640 1 --2- 172.21.15.17:0/3078095017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffc73b0 0x55c56ffec500 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7effec00f790 tx=0x7effec023040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=700668e8298ac637 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.055+0000 7effe9600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:11:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.057+0000 7effe9600640 1 -- 172.21.15.17:0/3078095017 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec026070 con 0x55c56ffc73b0 2024-09-13T16:11:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.057+0000 7effe9600640 1 -- 172.21.15.17:0/3078095017 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7effec032070 con 0x55c56ffc73b0 2024-09-13T16:11:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.058+0000 7f0008fd1740 1 -- 172.21.15.17:0/3078095017 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7effec00f7c0 con 0x55c56ffc73b0 2024-09-13T16:11:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.058+0000 7effe9600640 1 -- 172.21.15.17:0/3078095017 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7effec0050d0 con 0x55c56ffc73b0 2024-09-13T16:11:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.058+0000 7f0008fd1740 10 client.26327 fetch_fsmap learned FSMap version 49 2024-09-13T16:11:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.058+0000 7f0008fd1740 1 -- 172.21.15.17:0/3078095017 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55c56feef560 con 0x55c56ffc73b0 2024-09-13T16:11:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.059+0000 7effe9600640 1 -- 172.21.15.17:0/3078095017 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7effec00f7c0 con 0x55c56ffc73b0 2024-09-13T16:11:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.060+0000 7effe9600640 1 -- 172.21.15.17:0/3078095017 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 49) v1 ==== 7478+0+0 (secure 0 0 0) 0x7effec003ad0 con 0x55c56ffc73b0 2024-09-13T16:11:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.060+0000 7f0008fd1740 10 client.26327 fetch_fsmap finished waiting for FSMap version 49 2024-09-13T16:11:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.060+0000 7f0008fd1740 10 client.26327 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:11:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.060+0000 7f0008fd1740 20 client.26327 populate_metadata read hostname 'smithi017' 2024-09-13T16:11:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.060+0000 7f0008fd1740 1 --2- 172.21.15.17:0/3078095017 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c570044ab0 0x55c570046ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.060+0000 7f0008fd1740 4 client.26327 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:11:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.060+0000 7f0008fd1740 1 -- 172.21.15.17:0/3078095017 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c56ff1c7d0 con 0x55c570044ab0 2024-09-13T16:11:05.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.061+0000 7effff400640 1 --2- 172.21.15.17:0/3078095017 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c570044ab0 0x55c570046ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:05.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.062+0000 7effff400640 1 --2- 172.21.15.17:0/3078095017 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c570044ab0 0x55c570046ed0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac9915cbba6a2d8e server_cookie=ff953bf2bed4858b in_seq=0 out_seq=0 2024-09-13T16:11:05.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.062+0000 7effe9600640 10 client.26327 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:11:05.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.109+0000 7effe9600640 1 -- 172.21.15.17:0/3078095017 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c56ff1c7d0 con 0x55c570044ab0 2024-09-13T16:11:05.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.109+0000 7effe9600640 10 client.26327 handle_command_reply: tid=0 2024-09-13T16:11:05.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.109+0000 7f0008fd1740 1 client.26327 shutdown 2024-09-13T16:11:05.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.110+0000 7f0008fd1740 1 -- 172.21.15.17:0/3078095017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffc73b0 msgr2=0x55c56ffec500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:05.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.110+0000 7f0008fd1740 1 --2- 172.21.15.17:0/3078095017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffc73b0 0x55c56ffec500 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7effec00f790 tx=0x7effec023040 comp rx=0 tx=0).stop 2024-09-13T16:11:05.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.110+0000 7f0008fd1740 1 -- 172.21.15.17:0/3078095017 shutdown_connections 2024-09-13T16:11:05.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.110+0000 7f0008fd1740 1 --2- 172.21.15.17:0/3078095017 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55c570044ab0 0x55c570046ed0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:05.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.110+0000 7f0008fd1740 1 --2- 172.21.15.17:0/3078095017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c56ffd5f20 0x55c570031b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:05.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.110+0000 7f0008fd1740 1 --2- 172.21.15.17:0/3078095017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c56ffcc440 0x55c56ffeca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:05.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.110+0000 7f0008fd1740 1 --2- 172.21.15.17:0/3078095017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c56ffc73b0 0x55c56ffec500 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:05.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.110+0000 7f0008fd1740 1 -- 172.21.15.17:0/3078095017 >> 172.21.15.17:0/3078095017 conn(0x55c56ffc20e0 msgr2=0x55c56ffe3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:05.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.110+0000 7effe9600640 0 client.26327 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:11:05.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.111+0000 7f0008fd1740 1 -- 172.21.15.17:0/3078095017 shutdown_connections 2024-09-13T16:11:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.112+0000 7f0008fd1740 1 -- 172.21.15.17:0/3078095017 wait complete. 2024-09-13T16:11:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.113+0000 7f0008fd1740 20 client.26327 trim_cache size 0 max 16384 2024-09-13T16:11:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:11:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:11:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:11:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:11:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.113+0000 7f0006200640 1 -- 172.21.15.17:0/424344686 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7effe40a11e0 msgr2=0x7effe40a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.113+0000 7f0006200640 1 --2- 172.21.15.17:0/424344686 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7effe40a11e0 0x7effe40a36a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efff80b7db0 tx=0x7efff808d590 comp rx=0 tx=0).stop 2024-09-13T16:11:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.113+0000 7f0006200640 1 -- 172.21.15.17:0/424344686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f000010c2b0 msgr2=0x7f00001a7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.113+0000 7f0006200640 1 --2- 172.21.15.17:0/424344686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f000010c2b0 0x7f00001a7c80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efff80098d0 tx=0x7efff8032f20 comp rx=0 tx=0).stop 2024-09-13T16:11:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.114+0000 7f0006200640 1 -- 172.21.15.17:0/424344686 shutdown_connections 2024-09-13T16:11:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.114+0000 7f0006200640 1 --2- 172.21.15.17:0/424344686 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7effe40a11e0 0x7effe40a36a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.114+0000 7f0006200640 1 --2- 172.21.15.17:0/424344686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f000010c2b0 0x7f00001a7c80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.114+0000 7f0006200640 1 --2- 172.21.15.17:0/424344686 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f000010b8f0 0x7f00001a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.114+0000 7f0006200640 1 --2- 172.21.15.17:0/424344686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f000010a8c0 0x7f00001a0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.114+0000 7f0006200640 1 -- 172.21.15.17:0/424344686 >> 172.21.15.17:0/424344686 conn(0x7f000006a240 msgr2=0x7f000010edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.114+0000 7f0006200640 1 -- 172.21.15.17:0/424344686 shutdown_connections 2024-09-13T16:11:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:05.114+0000 7f0006200640 1 -- 172.21.15.17:0/424344686 wait complete. 2024-09-13T16:11:05.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 800.0 s, 494.4 tps, lat 202.956 ms stddev 213.927 2024-09-13T16:11:06.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:06 smithi189 ceph-mon[34790]: pgmap v785: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.6 MiB/s wr, 481 op/s 2024-09-13T16:11:06.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:06 smithi193 ceph-mon[35248]: pgmap v785: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.6 MiB/s wr, 481 op/s 2024-09-13T16:11:06.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:06 smithi017 ceph-mon[30494]: pgmap v785: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.6 MiB/s wr, 481 op/s 2024-09-13T16:11:07.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:07 smithi193 ceph-mon[35248]: pgmap v786: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.1 MiB/s wr, 458 op/s 2024-09-13T16:11:07.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:07 smithi017 ceph-mon[30494]: pgmap v786: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.1 MiB/s wr, 458 op/s 2024-09-13T16:11:07.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:07 smithi189 ceph-mon[34790]: pgmap v786: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.1 MiB/s wr, 458 op/s 2024-09-13T16:11:10.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:09 smithi193 ceph-mon[35248]: pgmap v787: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 451 op/s 2024-09-13T16:11:10.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:09 smithi017 ceph-mon[30494]: pgmap v787: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 451 op/s 2024-09-13T16:11:10.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:09 smithi189 ceph-mon[34790]: pgmap v787: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 451 op/s 2024-09-13T16:11:10.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 805.0 s, 651.1 tps, lat 152.237 ms stddev 184.445 2024-09-13T16:11:12.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:11 smithi193 ceph-mon[35248]: pgmap v788: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.8 MiB/s wr, 506 op/s 2024-09-13T16:11:12.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:11 smithi017 ceph-mon[30494]: pgmap v788: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.8 MiB/s wr, 506 op/s 2024-09-13T16:11:12.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:11 smithi189 ceph-mon[34790]: pgmap v788: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.8 MiB/s wr, 506 op/s 2024-09-13T16:11:14.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:13 smithi193 ceph-mon[35248]: pgmap v789: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 504 op/s 2024-09-13T16:11:14.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:13 smithi017 ceph-mon[30494]: pgmap v789: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 504 op/s 2024-09-13T16:11:14.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:13 smithi189 ceph-mon[34790]: pgmap v789: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 504 op/s 2024-09-13T16:11:15.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 810.0 s, 579.1 tps, lat 169.391 ms stddev 193.552 2024-09-13T16:11:16.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:15 smithi193 ceph-mon[35248]: pgmap v790: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.1 MiB/s wr, 514 op/s 2024-09-13T16:11:16.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:15 smithi017 ceph-mon[30494]: pgmap v790: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.1 MiB/s wr, 514 op/s 2024-09-13T16:11:16.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:15 smithi189 ceph-mon[34790]: pgmap v790: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.1 MiB/s wr, 514 op/s 2024-09-13T16:11:18.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:17 smithi193 ceph-mon[35248]: pgmap v791: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.6 MiB/s wr, 508 op/s 2024-09-13T16:11:18.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:17 smithi017 ceph-mon[30494]: pgmap v791: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.6 MiB/s wr, 508 op/s 2024-09-13T16:11:18.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:17 smithi189 ceph-mon[34790]: pgmap v791: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.6 MiB/s wr, 508 op/s 2024-09-13T16:11:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.416+0000 7fa467a00640 1 -- 172.21.15.17:0/2478729195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa460100f00 msgr2=0x7fa460101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.416+0000 7fa467a00640 1 --2- 172.21.15.17:0/2478729195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa460100f00 0x7fa460101380 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa44c009900 tx=0x7fa44c02a3f0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.418+0000 7fa467a00640 1 -- 172.21.15.17:0/2478729195 shutdown_connections 2024-09-13T16:11:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.418+0000 7fa467a00640 1 --2- 172.21.15.17:0/2478729195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4601018c0 0x7fa460108150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.418+0000 7fa467a00640 1 --2- 172.21.15.17:0/2478729195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa460100f00 0x7fa460101380 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.418+0000 7fa467a00640 1 --2- 172.21.15.17:0/2478729195 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4600ffd10 0x7fa460100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.418+0000 7fa467a00640 1 -- 172.21.15.17:0/2478729195 >> 172.21.15.17:0/2478729195 conn(0x7fa4600fb4b0 msgr2=0x7fa4600fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.418+0000 7fa467a00640 1 -- 172.21.15.17:0/2478729195 shutdown_connections 2024-09-13T16:11:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.419+0000 7fa467a00640 1 -- 172.21.15.17:0/2478729195 wait complete. 2024-09-13T16:11:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.421+0000 7fa467a00640 1 Processor -- start 2024-09-13T16:11:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.421+0000 7fa467a00640 1 -- start start 2024-09-13T16:11:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.421+0000 7fa467a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4600ffd10 0x7fa46019c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.421+0000 7fa467a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa460100f00 0x7fa46019ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.422+0000 7fa467a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4601018c0 0x7fa4601a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.422+0000 7fa467a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4601a3fe0 con 0x7fa4601018c0 2024-09-13T16:11:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.422+0000 7fa467a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46010e5a0 con 0x7fa4600ffd10 2024-09-13T16:11:18.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.422+0000 7fa467a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46010e760 con 0x7fa460100f00 2024-09-13T16:11:18.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.422+0000 7fa465000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4600ffd10 0x7fa46019c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:18.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.422+0000 7fa45fe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa460100f00 0x7fa46019ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:18.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.422+0000 7fa45fe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa460100f00 0x7fa46019ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:49868/0 (socket says 172.21.15.17:49868) 2024-09-13T16:11:18.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.422+0000 7fa45fe00640 1 -- 172.21.15.17:0/1964385733 learned_addr learned my addr 172.21.15.17:0/1964385733 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:18.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.422+0000 7fa465000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4600ffd10 0x7fa46019c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:55846/0 (socket says 172.21.15.17:55846) 2024-09-13T16:11:18.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.422+0000 7fa465a00640 1 --2- 172.21.15.17:0/1964385733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4601018c0 0x7fa4601a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:18.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.423+0000 7fa45fe00640 1 -- 172.21.15.17:0/1964385733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4600ffd10 msgr2=0x7fa46019c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.423+0000 7fa45fe00640 1 --2- 172.21.15.17:0/1964385733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4600ffd10 0x7fa46019c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.423+0000 7fa45fe00640 1 -- 172.21.15.17:0/1964385733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4601018c0 msgr2=0x7fa4601a3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.423+0000 7fa45fe00640 1 --2- 172.21.15.17:0/1964385733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4601018c0 0x7fa4601a3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.423+0000 7fa45fe00640 1 -- 172.21.15.17:0/1964385733 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44c009560 con 0x7fa460100f00 2024-09-13T16:11:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.423+0000 7fa465000640 1 --2- 172.21.15.17:0/1964385733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4600ffd10 0x7fa46019c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:11:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.423+0000 7fa45fe00640 1 --2- 172.21.15.17:0/1964385733 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa460100f00 0x7fa46019ca30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa44c031500 tx=0x7fa44c003d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.424+0000 7fa45d600640 1 -- 172.21.15.17:0/1964385733 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c0317b0 con 0x7fa460100f00 2024-09-13T16:11:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.424+0000 7fa45d600640 1 -- 172.21.15.17:0/1964385733 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa44c031dd0 con 0x7fa460100f00 2024-09-13T16:11:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.424+0000 7fa45d600640 1 -- 172.21.15.17:0/1964385733 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c03a3c0 con 0x7fa460100f00 2024-09-13T16:11:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.424+0000 7fa467a00640 1 -- 172.21.15.17:0/1964385733 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa46010e9e0 con 0x7fa460100f00 2024-09-13T16:11:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.425+0000 7fa467a00640 1 -- 172.21.15.17:0/1964385733 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46010eec0 con 0x7fa460100f00 2024-09-13T16:11:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.430+0000 7fa46a8bb740 1 Processor -- start 2024-09-13T16:11:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.430+0000 7fa46a8bb740 1 -- start start 2024-09-13T16:11:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.430+0000 7fa46a8bb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f20dfca70 0x555f20dfce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.430+0000 7fa46a8bb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfd3b0 0x555f20e01e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.430+0000 7fa46a8bb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20e02440 0x555f20e04900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.430+0000 7fa46a8bb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f20d08bb0 con 0x555f20dfd3b0 2024-09-13T16:11:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.430+0000 7fa46a8bb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f20d66a70 con 0x555f20dfca70 2024-09-13T16:11:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.430+0000 7fa46a8bb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f20d64200 con 0x555f20e02440 2024-09-13T16:11:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.432+0000 7fa45d600640 1 -- 172.21.15.17:0/1964385733 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa44c03b6d0 con 0x7fa460100f00 2024-09-13T16:11:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.433+0000 7fa465000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfd3b0 0x555f20e01e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.433+0000 7fa465000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfd3b0 0x555f20e01e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56448/0 (socket says 172.21.15.17:56448) 2024-09-13T16:11:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.433+0000 7fa465000640 1 -- 172.21.15.17:0/2725353896 learned_addr learned my addr 172.21.15.17:0/2725353896 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.433+0000 7fa465000640 1 -- 172.21.15.17:0/2725353896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20e02440 msgr2=0x555f20e04900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:11:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.433+0000 7fa465000640 1 --2- 172.21.15.17:0/2725353896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20e02440 0x555f20e04900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.433+0000 7fa465000640 1 -- 172.21.15.17:0/2725353896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f20dfca70 msgr2=0x555f20dfce70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:11:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.435+0000 7fa465a00640 1 --2- 172.21.15.17:0/2725353896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f20dfca70 0x555f20dfce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.435+0000 7fa45d600640 1 --2- 172.21.15.17:0/1964385733 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa4440a1110 0x7fa4440a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.436+0000 7fa465000640 1 --2- 172.21.15.17:0/2725353896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f20dfca70 0x555f20dfce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.436+0000 7fa465000640 1 -- 172.21.15.17:0/2725353896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f20d01940 con 0x555f20dfd3b0 2024-09-13T16:11:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.436+0000 7fa465a00640 1 --2- 172.21.15.17:0/2725353896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f20dfca70 0x555f20dfce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:11:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.436+0000 7fa45fe00640 1 --2- 172.21.15.17:0/1964385733 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa4440a1110 0x7fa4440a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.437+0000 7fa465000640 1 --2- 172.21.15.17:0/2725353896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfd3b0 0x555f20e01e70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa45800a890 tx=0x7fa4580096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3e479df2a73f61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.437+0000 7fa45d600640 1 -- 172.21.15.17:0/1964385733 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fa44c0ed670 con 0x7fa460100f00 2024-09-13T16:11:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.437+0000 7fa456000640 1 -- 172.21.15.17:0/2725353896 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa458010040 con 0x555f20dfd3b0 2024-09-13T16:11:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.438+0000 7fa456000640 1 -- 172.21.15.17:0/2725353896 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa458014400 con 0x555f20dfd3b0 2024-09-13T16:11:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.438+0000 7fa456000640 1 -- 172.21.15.17:0/2725353896 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4580135c0 con 0x555f20dfd3b0 2024-09-13T16:11:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.439+0000 7fa46a8bb740 1 -- 172.21.15.17:0/2725353896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfd3b0 msgr2=0x555f20e01e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.439+0000 7fa46a8bb740 1 --2- 172.21.15.17:0/2725353896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfd3b0 0x555f20e01e70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa45800a890 tx=0x7fa4580096d0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.439+0000 7fa45fe00640 1 --2- 172.21.15.17:0/1964385733 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa4440a1110 0x7fa4440a35d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa44c03bfd0 tx=0x7fa44c03ba70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.440+0000 7fa46a8bb740 1 -- 172.21.15.17:0/2725353896 shutdown_connections 2024-09-13T16:11:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.440+0000 7fa46a8bb740 1 --2- 172.21.15.17:0/2725353896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20e02440 0x555f20e04900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.440+0000 7fa46a8bb740 1 --2- 172.21.15.17:0/2725353896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfd3b0 0x555f20e01e70 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.440+0000 7fa46a8bb740 1 --2- 172.21.15.17:0/2725353896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f20dfca70 0x555f20dfce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.440+0000 7fa46a8bb740 1 -- 172.21.15.17:0/2725353896 >> 172.21.15.17:0/2725353896 conn(0x555f20df80e0 msgr2=0x555f20df84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.441+0000 7fa46a8bb740 1 -- 172.21.15.17:0/2725353896 shutdown_connections 2024-09-13T16:11:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.441+0000 7fa46a8bb740 1 -- 172.21.15.17:0/2725353896 wait complete. 2024-09-13T16:11:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.442+0000 7fa46a8bb740 1 -- start start 2024-09-13T16:11:18.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.442+0000 7fa46a8bb740 1 Processor -- start 2024-09-13T16:11:18.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.443+0000 7fa46a8bb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfca70 0x555f20e06700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:18.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.443+0000 7fa46a8bb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20dfd3b0 0x555f20e06c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:18.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.443+0000 7fa46a8bb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f20e02440 0x555f20e0dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:18.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.444+0000 7fa46a8bb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f20d5faf0 con 0x555f20dfca70 2024-09-13T16:11:18.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.444+0000 7fa46a8bb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f20d1df20 con 0x555f20e02440 2024-09-13T16:11:18.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.444+0000 7fa46a8bb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f20d1dbc0 con 0x555f20dfd3b0 2024-09-13T16:11:18.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.444+0000 7fa46a8bb740 10 client.0 _ll_register_callbacks cb 0x555f20d4fa70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:11:18.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.444+0000 7fa465000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20dfd3b0 0x555f20e06c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:18.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.444+0000 7fa465000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20dfd3b0 0x555f20e06c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:49894/0 (socket says 172.21.15.17:49894) 2024-09-13T16:11:18.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.444+0000 7fa465000640 1 -- 172.21.15.17:0/796524306 learned_addr learned my addr 172.21.15.17:0/796524306 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:18.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.444+0000 7fa465a00640 1 --2- 172.21.15.17:0/796524306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f20e02440 0x555f20e0dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.444+0000 7fa465a00640 1 --2- 172.21.15.17:0/796524306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfca70 0x555f20e06700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.444+0000 7fa465000640 1 -- 172.21.15.17:0/796524306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f20e02440 msgr2=0x555f20e0dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.444+0000 7fa465000640 1 --2- 172.21.15.17:0/796524306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f20e02440 0x555f20e0dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.444+0000 7fa465000640 1 -- 172.21.15.17:0/796524306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfca70 msgr2=0x555f20e06700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:18.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.445+0000 7fa465000640 1 --2- 172.21.15.17:0/796524306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfca70 0x555f20e06700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.445+0000 7fa465000640 1 -- 172.21.15.17:0/796524306 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa45800a4c0 con 0x555f20dfd3b0 2024-09-13T16:11:18.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.445+0000 7fa465a00640 1 --2- 172.21.15.17:0/796524306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfca70 0x555f20e06700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:11:18.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.445+0000 7fa465000640 1 --2- 172.21.15.17:0/796524306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20dfd3b0 0x555f20e06c40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa458004a80 tx=0x7fa45800eae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d4766213fe76c57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:18.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.445+0000 7fa44aa00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:11:18.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.446+0000 7fa44aa00640 1 -- 172.21.15.17:0/796524306 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa458010040 con 0x555f20dfd3b0 2024-09-13T16:11:18.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.446+0000 7fa46a8bb740 1 -- 172.21.15.17:0/796524306 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f20d89c90 con 0x555f20dfd3b0 2024-09-13T16:11:18.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.447+0000 7fa44aa00640 1 -- 172.21.15.17:0/796524306 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fa458023070 con 0x555f20dfd3b0 2024-09-13T16:11:18.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.448+0000 7fa44aa00640 1 -- 172.21.15.17:0/796524306 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4580093b0 con 0x555f20dfd3b0 2024-09-13T16:11:18.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.448+0000 7fa46a8bb740 10 client.26362 fetch_fsmap learned FSMap version 49 2024-09-13T16:11:18.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.448+0000 7fa46a8bb740 1 -- 172.21.15.17:0/796524306 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x555f20d5e170 con 0x555f20dfd3b0 2024-09-13T16:11:18.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.449+0000 7fa44aa00640 1 -- 172.21.15.17:0/796524306 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555f20d89c90 con 0x555f20dfd3b0 2024-09-13T16:11:18.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.450+0000 7fa44aa00640 1 -- 172.21.15.17:0/796524306 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 49) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fa458008030 con 0x555f20dfd3b0 2024-09-13T16:11:18.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.450+0000 7fa46a8bb740 10 client.26362 fetch_fsmap finished waiting for FSMap version 49 2024-09-13T16:11:18.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.450+0000 7fa46a8bb740 10 client.26362 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:11:18.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.450+0000 7fa46a8bb740 20 client.26362 populate_metadata read hostname 'smithi017' 2024-09-13T16:11:18.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.450+0000 7fa46a8bb740 1 --2- 172.21.15.17:0/796524306 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555f20e12200 0x555f20e14620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:18.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.450+0000 7fa46a8bb740 4 client.26362 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:11:18.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.450+0000 7fa46a8bb740 1 -- 172.21.15.17:0/796524306 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f20d527d0 con 0x555f20e12200 2024-09-13T16:11:18.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.452+0000 7fa465a00640 1 --2- 172.21.15.17:0/796524306 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555f20e12200 0x555f20e14620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:18.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.453+0000 7fa44aa00640 10 client.26362 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:11:18.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.453+0000 7fa465a00640 1 --2- 172.21.15.17:0/796524306 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555f20e12200 0x555f20e14620 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ccaacd829092fae server_cookie=7c6225162d5b03d6 in_seq=0 out_seq=0 2024-09-13T16:11:18.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.456+0000 7fa44aa00640 1 -- 172.21.15.17:0/796524306 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555f20d527d0 con 0x555f20e12200 2024-09-13T16:11:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.456+0000 7fa44aa00640 10 client.26362 handle_command_reply: tid=0 2024-09-13T16:11:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.456+0000 7fa46a8bb740 1 client.26362 shutdown 2024-09-13T16:11:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.457+0000 7fa46a8bb740 1 -- 172.21.15.17:0/796524306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20dfd3b0 msgr2=0x555f20e06c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.457+0000 7fa46a8bb740 1 --2- 172.21.15.17:0/796524306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20dfd3b0 0x555f20e06c40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa458004a80 tx=0x7fa45800eae0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.457+0000 7fa46a8bb740 1 -- 172.21.15.17:0/796524306 shutdown_connections 2024-09-13T16:11:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.457+0000 7fa46a8bb740 1 --2- 172.21.15.17:0/796524306 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555f20e12200 0x555f20e14620 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.457+0000 7fa46a8bb740 1 --2- 172.21.15.17:0/796524306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f20e02440 0x555f20e0dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.457+0000 7fa46a8bb740 1 --2- 172.21.15.17:0/796524306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20dfd3b0 0x555f20e06c40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.457+0000 7fa44aa00640 0 client.26362 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:11:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.457+0000 7fa46a8bb740 1 --2- 172.21.15.17:0/796524306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfca70 0x555f20e06700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.457+0000 7fa46a8bb740 1 -- 172.21.15.17:0/796524306 >> 172.21.15.17:0/796524306 conn(0x555f20df80e0 msgr2=0x555f20df98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.459+0000 7fa46a8bb740 1 -- 172.21.15.17:0/796524306 shutdown_connections 2024-09-13T16:11:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.459+0000 7fa46a8bb740 1 -- 172.21.15.17:0/796524306 wait complete. 2024-09-13T16:11:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.460+0000 7fa46a8bb740 20 client.26362 trim_cache size 0 max 16384 2024-09-13T16:11:18.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.500+0000 7fa46a8bb740 1 Processor -- start 2024-09-13T16:11:18.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.500+0000 7fa46a8bb740 1 -- start start 2024-09-13T16:11:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.500+0000 7fa46a8bb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20dfca70 0x555f20df7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.500+0000 7fa46a8bb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfd3b0 0x555f20e0dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.500+0000 7fa46a8bb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f20e02440 0x555f20dfe2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.500+0000 7fa46a8bb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f20ac6e60 con 0x555f20dfd3b0 2024-09-13T16:11:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.500+0000 7fa46a8bb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f20e06240 con 0x555f20e02440 2024-09-13T16:11:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.500+0000 7fa46a8bb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f20dfc5f0 con 0x555f20dfca70 2024-09-13T16:11:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.501+0000 7fa465a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20dfca70 0x555f20df7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.501+0000 7fa465a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20dfca70 0x555f20df7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:49902/0 (socket says 172.21.15.17:49902) 2024-09-13T16:11:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.501+0000 7fa465a00640 1 -- 172.21.15.17:0/2395947339 learned_addr learned my addr 172.21.15.17:0/2395947339 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.501+0000 7fa465a00640 1 --2- 172.21.15.17:0/2395947339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f20e02440 0x555f20dfe2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.501+0000 7fa465000640 1 --2- 172.21.15.17:0/2395947339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfd3b0 0x555f20e0dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.501+0000 7fa465a00640 1 -- 172.21.15.17:0/2395947339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f20e02440 msgr2=0x555f20dfe2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.501+0000 7fa465a00640 1 --2- 172.21.15.17:0/2395947339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f20e02440 0x555f20dfe2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.501+0000 7fa465a00640 1 -- 172.21.15.17:0/2395947339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfd3b0 msgr2=0x555f20e0dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.501+0000 7fa465a00640 1 --2- 172.21.15.17:0/2395947339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfd3b0 0x555f20e0dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.501+0000 7fa465a00640 1 -- 172.21.15.17:0/2395947339 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f20d00180 con 0x555f20dfca70 2024-09-13T16:11:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.502+0000 7fa465a00640 1 --2- 172.21.15.17:0/2395947339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20dfca70 0x555f20df7a20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa450009450 tx=0x7fa4500047d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3caf737b5309856 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.502+0000 7fa456a00640 1 -- 172.21.15.17:0/2395947339 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4500374b0 con 0x555f20dfca70 2024-09-13T16:11:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.502+0000 7fa456a00640 1 -- 172.21.15.17:0/2395947339 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa45003f030 con 0x555f20dfca70 2024-09-13T16:11:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.502+0000 7fa456a00640 1 -- 172.21.15.17:0/2395947339 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4500374b0 con 0x555f20dfca70 2024-09-13T16:11:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.503+0000 7fa46a8bb740 1 -- 172.21.15.17:0/2395947339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20dfca70 msgr2=0x555f20df7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.503+0000 7fa46a8bb740 1 --2- 172.21.15.17:0/2395947339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20dfca70 0x555f20df7a20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa450009450 tx=0x7fa4500047d0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.504+0000 7fa46a8bb740 1 -- 172.21.15.17:0/2395947339 shutdown_connections 2024-09-13T16:11:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.504+0000 7fa46a8bb740 1 --2- 172.21.15.17:0/2395947339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f20e02440 0x555f20dfe2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.504+0000 7fa46a8bb740 1 --2- 172.21.15.17:0/2395947339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfd3b0 0x555f20e0dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.504+0000 7fa46a8bb740 1 --2- 172.21.15.17:0/2395947339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20dfca70 0x555f20df7a20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.504+0000 7fa46a8bb740 1 -- 172.21.15.17:0/2395947339 >> 172.21.15.17:0/2395947339 conn(0x555f20df80e0 msgr2=0x555f20e066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.504+0000 7fa46a8bb740 1 -- 172.21.15.17:0/2395947339 shutdown_connections 2024-09-13T16:11:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.504+0000 7fa46a8bb740 1 -- 172.21.15.17:0/2395947339 wait complete. 2024-09-13T16:11:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.504+0000 7fa46a8bb740 1 -- start start 2024-09-13T16:11:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.505+0000 7fa46a8bb740 1 Processor -- start 2024-09-13T16:11:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.506+0000 7fa46a8bb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20dfca70 0x555f20e0d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:18.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.506+0000 7fa46a8bb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfd3b0 0x555f20e0db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:18.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.506+0000 7fa465a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20dfca70 0x555f20e0d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:18.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.506+0000 7fa465a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20dfca70 0x555f20e0d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:49904/0 (socket says 172.21.15.17:49904) 2024-09-13T16:11:18.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.506+0000 7fa46a8bb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f20e02440 0x555f20e0a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:18.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.507+0000 7fa46a8bb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f20e0a6a0 con 0x555f20dfd3b0 2024-09-13T16:11:18.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.507+0000 7fa46a8bb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f20e0a810 con 0x555f20e02440 2024-09-13T16:11:18.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.507+0000 7fa46a8bb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f20e0a9d0 con 0x555f20dfca70 2024-09-13T16:11:18.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.507+0000 7fa46a8bb740 10 client.0 _ll_register_callbacks cb 0x7fa458009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:11:18.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.507+0000 7fa465a00640 1 -- 172.21.15.17:0/3679386099 learned_addr learned my addr 172.21.15.17:0/3679386099 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:18.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.507+0000 7fa465000640 1 --2- 172.21.15.17:0/3679386099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfd3b0 0x555f20e0db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:18.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.508+0000 7fa465a00640 1 -- 172.21.15.17:0/3679386099 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f20e02440 msgr2=0x555f20e0a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:18.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.508+0000 7fa465a00640 1 --2- 172.21.15.17:0/3679386099 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f20e02440 0x555f20e0a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.508+0000 7fa465a00640 1 -- 172.21.15.17:0/3679386099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfd3b0 msgr2=0x555f20e0db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:18.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.508+0000 7fa465a00640 1 --2- 172.21.15.17:0/3679386099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfd3b0 0x555f20e0db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.508+0000 7fa465a00640 1 -- 172.21.15.17:0/3679386099 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa450041040 con 0x555f20dfca70 2024-09-13T16:11:18.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.509+0000 7fa465000640 1 --2- 172.21.15.17:0/3679386099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfd3b0 0x555f20e0db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:11:18.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.509+0000 7fa465a00640 1 --2- 172.21.15.17:0/3679386099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20dfca70 0x555f20e0d5f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa450009290 tx=0x7fa450036830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3669b29950f2e7fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:18.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.509+0000 7fa44aa00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:11:18.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.510+0000 7fa44aa00640 1 -- 172.21.15.17:0/3679386099 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450036d20 con 0x555f20dfca70 2024-09-13T16:11:18.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.510+0000 7fa44aa00640 1 -- 172.21.15.17:0/3679386099 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fa450036e80 con 0x555f20dfca70 2024-09-13T16:11:18.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.510+0000 7fa46a8bb740 1 -- 172.21.15.17:0/3679386099 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa458014400 con 0x555f20dfca70 2024-09-13T16:11:18.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.510+0000 7fa44aa00640 1 -- 172.21.15.17:0/3679386099 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4500374b0 con 0x555f20dfca70 2024-09-13T16:11:18.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.510+0000 7fa46a8bb740 10 client.26368 fetch_fsmap learned FSMap version 49 2024-09-13T16:11:18.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.510+0000 7fa46a8bb740 1 -- 172.21.15.17:0/3679386099 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x555f20d25560 con 0x555f20dfca70 2024-09-13T16:11:18.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.511+0000 7fa44aa00640 1 -- 172.21.15.17:0/3679386099 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa458014400 con 0x555f20dfca70 2024-09-13T16:11:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.511+0000 7fa44aa00640 1 -- 172.21.15.17:0/3679386099 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 49) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fa450051720 con 0x555f20dfca70 2024-09-13T16:11:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.511+0000 7fa46a8bb740 10 client.26368 fetch_fsmap finished waiting for FSMap version 49 2024-09-13T16:11:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.511+0000 7fa46a8bb740 10 client.26368 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:11:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.511+0000 7fa46a8bb740 20 client.26368 populate_metadata read hostname 'smithi017' 2024-09-13T16:11:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.511+0000 7fa46a8bb740 1 --2- 172.21.15.17:0/3679386099 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555f20e69b40 0x555f20e6bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.511+0000 7fa46a8bb740 4 client.26368 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:11:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.512+0000 7fa46a8bb740 1 -- 172.21.15.17:0/3679386099 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555f20a53300 con 0x555f20e69b40 2024-09-13T16:11:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.512+0000 7fa465000640 1 --2- 172.21.15.17:0/3679386099 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555f20e69b40 0x555f20e6bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:18.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.512+0000 7fa465000640 1 --2- 172.21.15.17:0/3679386099 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555f20e69b40 0x555f20e6bf60 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb1bbca5e790dad0 server_cookie=9269294822882889 in_seq=0 out_seq=0 2024-09-13T16:11:18.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.512+0000 7fa44aa00640 10 client.26368 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:11:18.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.532+0000 7fa44aa00640 1 -- 172.21.15.17:0/3679386099 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555f20a53300 con 0x555f20e69b40 2024-09-13T16:11:18.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.532+0000 7fa44aa00640 10 client.26368 handle_command_reply: tid=0 2024-09-13T16:11:18.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.532+0000 7fa46a8bb740 1 client.26368 shutdown 2024-09-13T16:11:18.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.533+0000 7fa46a8bb740 1 -- 172.21.15.17:0/3679386099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20dfca70 msgr2=0x555f20e0d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:18.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.533+0000 7fa46a8bb740 1 --2- 172.21.15.17:0/3679386099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20dfca70 0x555f20e0d5f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa450009290 tx=0x7fa450036830 comp rx=0 tx=0).stop 2024-09-13T16:11:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.533+0000 7fa46a8bb740 1 -- 172.21.15.17:0/3679386099 shutdown_connections 2024-09-13T16:11:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.533+0000 7fa46a8bb740 1 --2- 172.21.15.17:0/3679386099 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555f20e69b40 0x555f20e6bf60 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.533+0000 7fa46a8bb740 1 --2- 172.21.15.17:0/3679386099 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f20e02440 0x555f20e0a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.533+0000 7fa46a8bb740 1 --2- 172.21.15.17:0/3679386099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f20dfd3b0 0x555f20e0db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.533+0000 7fa46a8bb740 1 --2- 172.21.15.17:0/3679386099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f20dfca70 0x555f20e0d5f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.533+0000 7fa44aa00640 0 client.26368 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:11:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.533+0000 7fa46a8bb740 1 -- 172.21.15.17:0/3679386099 >> 172.21.15.17:0/3679386099 conn(0x555f20df80e0 msgr2=0x555f20e066a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.534+0000 7fa46a8bb740 1 -- 172.21.15.17:0/3679386099 shutdown_connections 2024-09-13T16:11:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.534+0000 7fa46a8bb740 1 -- 172.21.15.17:0/3679386099 wait complete. 2024-09-13T16:11:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:11:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:11:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:11:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:11:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.535+0000 7fa46a8bb740 20 client.26368 trim_cache size 0 max 16384 2024-09-13T16:11:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.536+0000 7fa467a00640 1 -- 172.21.15.17:0/1964385733 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa4440a1110 msgr2=0x7fa4440a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.536+0000 7fa467a00640 1 --2- 172.21.15.17:0/1964385733 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa4440a1110 0x7fa4440a35d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa44c03bfd0 tx=0x7fa44c03ba70 comp rx=0 tx=0).stop 2024-09-13T16:11:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.536+0000 7fa467a00640 1 -- 172.21.15.17:0/1964385733 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa460100f00 msgr2=0x7fa46019ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.536+0000 7fa467a00640 1 --2- 172.21.15.17:0/1964385733 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa460100f00 0x7fa46019ca30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa44c031500 tx=0x7fa44c003d50 comp rx=0 tx=0).stop 2024-09-13T16:11:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.536+0000 7fa467a00640 1 -- 172.21.15.17:0/1964385733 shutdown_connections 2024-09-13T16:11:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.536+0000 7fa467a00640 1 --2- 172.21.15.17:0/1964385733 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa4440a1110 0x7fa4440a35d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.536+0000 7fa467a00640 1 --2- 172.21.15.17:0/1964385733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4601018c0 0x7fa4601a3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.536+0000 7fa467a00640 1 --2- 172.21.15.17:0/1964385733 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa460100f00 0x7fa46019ca30 secure :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa44c031500 tx=0x7fa44c003d50 comp rx=0 tx=0).stop 2024-09-13T16:11:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.536+0000 7fa467a00640 1 --2- 172.21.15.17:0/1964385733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4600ffd10 0x7fa46019c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.536+0000 7fa467a00640 1 -- 172.21.15.17:0/1964385733 >> 172.21.15.17:0/1964385733 conn(0x7fa4600fb4b0 msgr2=0x7fa46010c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.537+0000 7fa467a00640 1 -- 172.21.15.17:0/1964385733 shutdown_connections 2024-09-13T16:11:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:18.537+0000 7fa467a00640 1 -- 172.21.15.17:0/1964385733 wait complete. 2024-09-13T16:11:20.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:19 smithi193 ceph-mon[35248]: pgmap v792: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.9 MiB/s wr, 513 op/s 2024-09-13T16:11:20.014 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:19 smithi017 ceph-mon[30494]: pgmap v792: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.9 MiB/s wr, 513 op/s 2024-09-13T16:11:20.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:19 smithi189 ceph-mon[34790]: pgmap v792: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.9 MiB/s wr, 513 op/s 2024-09-13T16:11:20.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 815.0 s, 512.2 tps, lat 197.891 ms stddev 245.865 2024-09-13T16:11:22.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:21 smithi193 ceph-mon[35248]: pgmap v793: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.2 MiB/s wr, 550 op/s 2024-09-13T16:11:22.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:21 smithi017 ceph-mon[30494]: pgmap v793: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.2 MiB/s wr, 550 op/s 2024-09-13T16:11:22.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:21 smithi189 ceph-mon[34790]: pgmap v793: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.2 MiB/s wr, 550 op/s 2024-09-13T16:11:24.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:23 smithi193 ceph-mon[35248]: pgmap v794: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.9 MiB/s wr, 526 op/s 2024-09-13T16:11:24.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:23 smithi017 ceph-mon[30494]: pgmap v794: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.9 MiB/s wr, 526 op/s 2024-09-13T16:11:24.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:23 smithi189 ceph-mon[34790]: pgmap v794: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.9 MiB/s wr, 526 op/s 2024-09-13T16:11:25.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 820.0 s, 485.9 tps, lat 207.933 ms stddev 242.239 2024-09-13T16:11:26.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:25 smithi193 ceph-mon[35248]: pgmap v795: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.7 MiB/s wr, 519 op/s 2024-09-13T16:11:26.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:25 smithi017 ceph-mon[30494]: pgmap v795: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.7 MiB/s wr, 519 op/s 2024-09-13T16:11:26.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:25 smithi189 ceph-mon[34790]: pgmap v795: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.7 MiB/s wr, 519 op/s 2024-09-13T16:11:28.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:27 smithi193 ceph-mon[35248]: pgmap v796: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.8 MiB/s wr, 546 op/s 2024-09-13T16:11:28.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:27 smithi017 ceph-mon[30494]: pgmap v796: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.8 MiB/s wr, 546 op/s 2024-09-13T16:11:28.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:27 smithi189 ceph-mon[34790]: pgmap v796: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.8 MiB/s wr, 546 op/s 2024-09-13T16:11:29.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:28 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:11:29.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:28 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:11:29.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:28 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:11:30.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:29 smithi189 ceph-mon[34790]: pgmap v797: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.0 MiB/s wr, 543 op/s 2024-09-13T16:11:30.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:29 smithi193 ceph-mon[35248]: pgmap v797: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.0 MiB/s wr, 543 op/s 2024-09-13T16:11:30.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:29 smithi017 ceph-mon[30494]: pgmap v797: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.0 MiB/s wr, 543 op/s 2024-09-13T16:11:30.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 825.0 s, 484.5 tps, lat 198.977 ms stddev 268.902 2024-09-13T16:11:31.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.737+0000 7fbfb0a00640 1 -- 172.21.15.17:0/2296845812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbfac103080 msgr2=0x7fbfac103500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:31.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.737+0000 7fbfb0a00640 1 --2- 172.21.15.17:0/2296845812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbfac103080 0x7fbfac103500 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbf98009900 tx=0x7fbf9802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.737+0000 7fbfb0a00640 1 -- 172.21.15.17:0/2296845812 shutdown_connections 2024-09-13T16:11:31.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.737+0000 7fbfb0a00640 1 --2- 172.21.15.17:0/2296845812 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfac103a40 0x7fbfac10a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.737+0000 7fbfb0a00640 1 --2- 172.21.15.17:0/2296845812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbfac103080 0x7fbfac103500 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.737+0000 7fbfb0a00640 1 --2- 172.21.15.17:0/2296845812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfac101f30 0x7fbfac102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.737+0000 7fbfb0a00640 1 -- 172.21.15.17:0/2296845812 >> 172.21.15.17:0/2296845812 conn(0x7fbfac0fd6b0 msgr2=0x7fbfac0ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:31.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.737+0000 7fbfb0a00640 1 -- 172.21.15.17:0/2296845812 shutdown_connections 2024-09-13T16:11:31.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.737+0000 7fbfb0a00640 1 -- 172.21.15.17:0/2296845812 wait complete. 2024-09-13T16:11:31.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.738+0000 7fbfb0a00640 1 Processor -- start 2024-09-13T16:11:31.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.739+0000 7fbfb0a00640 1 -- start start 2024-09-13T16:11:31.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.739+0000 7fbfb0a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfac101f30 0x7fbfac197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:31.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.739+0000 7fbfb0a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbfac103080 0x7fbfac198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:31.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.739+0000 7fbfb0a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfac103a40 0x7fbfac19f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:31.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.739+0000 7fbfb0a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac19fab0 con 0x7fbfac101f30 2024-09-13T16:11:31.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.739+0000 7fbfb0a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac069f00 con 0x7fbfac103a40 2024-09-13T16:11:31.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.739+0000 7fbfb0a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac06a0c0 con 0x7fbfac103080 2024-09-13T16:11:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.740+0000 7fbfaa800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfac103a40 0x7fbfac19f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.740+0000 7fbfaa800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfac103a40 0x7fbfac19f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:58160/0 (socket says 172.21.15.17:58160) 2024-09-13T16:11:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.740+0000 7fbfaa800640 1 -- 172.21.15.17:0/2786063834 learned_addr learned my addr 172.21.15.17:0/2786063834 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.740+0000 7fbfa9400640 1 --2- 172.21.15.17:0/2786063834 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbfac103080 0x7fbfac198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.740+0000 7fbfa9e00640 1 --2- 172.21.15.17:0/2786063834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfac101f30 0x7fbfac197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.740+0000 7fbfaa800640 1 -- 172.21.15.17:0/2786063834 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbfac103080 msgr2=0x7fbfac198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.740+0000 7fbfaa800640 1 --2- 172.21.15.17:0/2786063834 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbfac103080 0x7fbfac198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.740+0000 7fbfaa800640 1 -- 172.21.15.17:0/2786063834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfac101f30 msgr2=0x7fbfac197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.740+0000 7fbfaa800640 1 --2- 172.21.15.17:0/2786063834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfac101f30 0x7fbfac197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.740+0000 7fbfaa800640 1 -- 172.21.15.17:0/2786063834 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf98009560 con 0x7fbfac103a40 2024-09-13T16:11:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.740+0000 7fbfa9e00640 1 --2- 172.21.15.17:0/2786063834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfac101f30 0x7fbfac197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:11:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.741+0000 7fbfaa800640 1 --2- 172.21.15.17:0/2786063834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfac103a40 0x7fbfac19f570 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400eb10 tx=0x7fbfa400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.741+0000 7fbfa2a00640 1 -- 172.21.15.17:0/2786063834 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4004b20 con 0x7fbfac103a40 2024-09-13T16:11:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.741+0000 7fbfa2a00640 1 -- 172.21.15.17:0/2786063834 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbfa4004c80 con 0x7fbfac103a40 2024-09-13T16:11:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.741+0000 7fbfa2a00640 1 -- 172.21.15.17:0/2786063834 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4010690 con 0x7fbfac103a40 2024-09-13T16:11:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.741+0000 7fbfb0a00640 1 -- 172.21.15.17:0/2786063834 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfac06a3a0 con 0x7fbfac103a40 2024-09-13T16:11:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.741+0000 7fbfb0a00640 1 -- 172.21.15.17:0/2786063834 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfac06a850 con 0x7fbfac103a40 2024-09-13T16:11:31.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.744+0000 7fbfb3873740 1 Processor -- start 2024-09-13T16:11:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.747+0000 7fbfa2a00640 1 -- 172.21.15.17:0/2786063834 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fbfa4004fd0 con 0x7fbfac103a40 2024-09-13T16:11:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.747+0000 7fbfb3873740 1 -- start start 2024-09-13T16:11:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.748+0000 7fbfb3873740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e42a70 0x555f27e42e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.748+0000 7fbfb3873740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e433b0 0x555f27e47e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.748+0000 7fbfb3873740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e48440 0x555f27e4a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.748+0000 7fbfb3873740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f27d4ebb0 con 0x555f27e42a70 2024-09-13T16:11:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.748+0000 7fbfb3873740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f27daca70 con 0x555f27e433b0 2024-09-13T16:11:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.748+0000 7fbfb3873740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f27daa200 con 0x555f27e48440 2024-09-13T16:11:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.748+0000 7fbfa9e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e433b0 0x555f27e47e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.748+0000 7fbfa9e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e433b0 0x555f27e47e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:58162/0 (socket says 172.21.15.17:58162) 2024-09-13T16:11:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.748+0000 7fbfa9e00640 1 -- 172.21.15.17:0/1982419600 learned_addr learned my addr 172.21.15.17:0/1982419600 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.748+0000 7fbfa9400640 1 --2- 172.21.15.17:0/1982419600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e42a70 0x555f27e42e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.748+0000 7fbfa9400640 1 --2- 172.21.15.17:0/1982419600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e48440 0x555f27e4a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.749+0000 7fbfa2a00640 1 --2- 172.21.15.17:0/2786063834 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbf900a1110 0x7fbf900a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.749+0000 7fbfa9e00640 1 -- 172.21.15.17:0/1982419600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e48440 msgr2=0x555f27e4a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.749+0000 7fbfa9e00640 1 --2- 172.21.15.17:0/1982419600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e48440 0x555f27e4a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.749+0000 7fbfa9e00640 1 -- 172.21.15.17:0/1982419600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e42a70 msgr2=0x555f27e42e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.749+0000 7fbfa9e00640 1 --2- 172.21.15.17:0/1982419600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e42a70 0x555f27e42e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.749+0000 7fbfa9e00640 1 -- 172.21.15.17:0/1982419600 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f27d47940 con 0x555f27e433b0 2024-09-13T16:11:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.749+0000 7fbfa2a00640 1 -- 172.21.15.17:0/2786063834 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fbfa4014070 con 0x7fbfac103a40 2024-09-13T16:11:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.750+0000 7fbfa9e00640 1 --2- 172.21.15.17:0/1982419600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e433b0 0x555f27e47e70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00aa10 tx=0x7fbf9c00aed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83d7828164160f11 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.750+0000 7fbfaa800640 1 --2- 172.21.15.17:0/2786063834 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbf900a1110 0x7fbf900a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.751+0000 7fbf97400640 1 -- 172.21.15.17:0/1982419600 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c00cc60 con 0x555f27e433b0 2024-09-13T16:11:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.751+0000 7fbf97400640 1 -- 172.21.15.17:0/1982419600 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf9c00cdc0 con 0x555f27e433b0 2024-09-13T16:11:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.752+0000 7fbf97400640 1 -- 172.21.15.17:0/1982419600 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c0187c0 con 0x555f27e433b0 2024-09-13T16:11:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.752+0000 7fbfb3873740 1 -- 172.21.15.17:0/1982419600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e433b0 msgr2=0x555f27e47e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.752+0000 7fbfb3873740 1 --2- 172.21.15.17:0/1982419600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e433b0 0x555f27e47e70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00aa10 tx=0x7fbf9c00aed0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.752+0000 7fbfaa800640 1 --2- 172.21.15.17:0/2786063834 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbf900a1110 0x7fbf900a35d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40a1c10 tx=0x7fbfa400efd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.753+0000 7fbfb3873740 1 -- 172.21.15.17:0/1982419600 shutdown_connections 2024-09-13T16:11:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.753+0000 7fbfb3873740 1 --2- 172.21.15.17:0/1982419600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e48440 0x555f27e4a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.753+0000 7fbfb3873740 1 --2- 172.21.15.17:0/1982419600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e433b0 0x555f27e47e70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.753+0000 7fbfb3873740 1 --2- 172.21.15.17:0/1982419600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e42a70 0x555f27e42e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.753+0000 7fbfb3873740 1 -- 172.21.15.17:0/1982419600 >> 172.21.15.17:0/1982419600 conn(0x555f27e3e0e0 msgr2=0x555f27e3e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.754+0000 7fbfb3873740 1 -- 172.21.15.17:0/1982419600 shutdown_connections 2024-09-13T16:11:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.754+0000 7fbfb3873740 1 -- 172.21.15.17:0/1982419600 wait complete. 2024-09-13T16:11:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.755+0000 7fbfb3873740 1 -- start start 2024-09-13T16:11:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.755+0000 7fbfb3873740 1 Processor -- start 2024-09-13T16:11:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.756+0000 7fbfb3873740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e42a70 0x555f27e54ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.756+0000 7fbfb3873740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e433b0 0x555f27e55420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.756+0000 7fbfb3873740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e48440 0x555f27e5c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:31.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.756+0000 7fbfb3873740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f27da5af0 con 0x555f27e42a70 2024-09-13T16:11:31.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.756+0000 7fbfb3873740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f27d63f20 con 0x555f27e433b0 2024-09-13T16:11:31.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.756+0000 7fbfb3873740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f27d63bc0 con 0x555f27e48440 2024-09-13T16:11:31.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.756+0000 7fbfb3873740 10 client.0 _ll_register_callbacks cb 0x555f27d95a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:11:31.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.756+0000 7fbfa9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e42a70 0x555f27e54ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:31.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.756+0000 7fbfa9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e42a70 0x555f27e54ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45642/0 (socket says 172.21.15.17:45642) 2024-09-13T16:11:31.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.756+0000 7fbfa9400640 1 -- 172.21.15.17:0/2206959648 learned_addr learned my addr 172.21.15.17:0/2206959648 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:31.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.756+0000 7fbfa9e00640 1 --2- 172.21.15.17:0/2206959648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e433b0 0x555f27e55420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:31.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.757+0000 7fbfa9400640 1 --2- 172.21.15.17:0/2206959648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e48440 0x555f27e5c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:31.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.757+0000 7fbfa9400640 1 -- 172.21.15.17:0/2206959648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e48440 msgr2=0x555f27e5c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:31.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.757+0000 7fbfa9400640 1 --2- 172.21.15.17:0/2206959648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e48440 0x555f27e5c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.757+0000 7fbfa9400640 1 -- 172.21.15.17:0/2206959648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e433b0 msgr2=0x555f27e55420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:31.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.757+0000 7fbfa9400640 1 --2- 172.21.15.17:0/2206959648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e433b0 0x555f27e55420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.757+0000 7fbfa9400640 1 -- 172.21.15.17:0/2206959648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf9c00a640 con 0x555f27e42a70 2024-09-13T16:11:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.757+0000 7fbfa9400640 1 --2- 172.21.15.17:0/2206959648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e42a70 0x555f27e54ee0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbf98005ec0 tx=0x7fbf98040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f328b6119ef3611d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.757+0000 7fbf8be00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T16:11:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.758+0000 7fbf8be00640 1 -- 172.21.15.17:0/2206959648 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98005000 con 0x555f27e42a70 2024-09-13T16:11:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.758+0000 7fbf8be00640 1 -- 172.21.15.17:0/2206959648 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fbf98005160 con 0x555f27e42a70 2024-09-13T16:11:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.758+0000 7fbfb3873740 1 -- 172.21.15.17:0/2206959648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f27dcfc90 con 0x555f27e42a70 2024-09-13T16:11:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.758+0000 7fbf8be00640 1 -- 172.21.15.17:0/2206959648 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf98005320 con 0x555f27e42a70 2024-09-13T16:11:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.758+0000 7fbfb3873740 10 client.15945 fetch_fsmap learned FSMap version 49 2024-09-13T16:11:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.758+0000 7fbfb3873740 1 -- 172.21.15.17:0/2206959648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x555f27da4170 con 0x555f27e42a70 2024-09-13T16:11:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.758+0000 7fbf8be00640 1 -- 172.21.15.17:0/2206959648 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555f27dcfc90 con 0x555f27e42a70 2024-09-13T16:11:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.759+0000 7fbf8be00640 1 -- 172.21.15.17:0/2206959648 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 49) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fbf98003710 con 0x555f27e42a70 2024-09-13T16:11:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.759+0000 7fbfb3873740 10 client.15945 fetch_fsmap finished waiting for FSMap version 49 2024-09-13T16:11:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.759+0000 7fbfb3873740 10 client.15945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:11:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.759+0000 7fbfb3873740 20 client.15945 populate_metadata read hostname 'smithi017' 2024-09-13T16:11:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.759+0000 7fbfb3873740 1 --2- 172.21.15.17:0/2206959648 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555f27e60aa0 0x555f27e62ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.759+0000 7fbfb3873740 4 client.15945 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:11:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.759+0000 7fbfb3873740 1 -- 172.21.15.17:0/2206959648 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f27d987d0 con 0x555f27e60aa0 2024-09-13T16:11:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.759+0000 7fbfa9e00640 1 --2- 172.21.15.17:0/2206959648 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555f27e60aa0 0x555f27e62ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:31.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.760+0000 7fbf8be00640 10 client.15945 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:11:31.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.760+0000 7fbfa9e00640 1 --2- 172.21.15.17:0/2206959648 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555f27e60aa0 0x555f27e62ec0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75799fbc31e762bc server_cookie=9602cefeccc18a5 in_seq=0 out_seq=0 2024-09-13T16:11:31.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.761+0000 7fbf8be00640 1 -- 172.21.15.17:0/2206959648 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555f27d987d0 con 0x555f27e60aa0 2024-09-13T16:11:31.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.761+0000 7fbf8be00640 10 client.15945 handle_command_reply: tid=0 2024-09-13T16:11:31.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.761+0000 7fbfb3873740 1 client.15945 shutdown 2024-09-13T16:11:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.761+0000 7fbfb3873740 1 -- 172.21.15.17:0/2206959648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e42a70 msgr2=0x555f27e54ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.761+0000 7fbfb3873740 1 --2- 172.21.15.17:0/2206959648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e42a70 0x555f27e54ee0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbf98005ec0 tx=0x7fbf98040040 comp rx=0 tx=0).stop 2024-09-13T16:11:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.761+0000 7fbfb3873740 1 -- 172.21.15.17:0/2206959648 shutdown_connections 2024-09-13T16:11:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.761+0000 7fbfb3873740 1 --2- 172.21.15.17:0/2206959648 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555f27e60aa0 0x555f27e62ec0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.761+0000 7fbfb3873740 1 --2- 172.21.15.17:0/2206959648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e48440 0x555f27e5c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.761+0000 7fbfb3873740 1 --2- 172.21.15.17:0/2206959648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e433b0 0x555f27e55420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.761+0000 7fbfb3873740 1 --2- 172.21.15.17:0/2206959648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e42a70 0x555f27e54ee0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.761+0000 7fbfb3873740 1 -- 172.21.15.17:0/2206959648 >> 172.21.15.17:0/2206959648 conn(0x555f27e3e0e0 msgr2=0x555f27e3f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.761+0000 7fbf8be00640 0 client.15945 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:11:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.761+0000 7fbfb3873740 1 -- 172.21.15.17:0/2206959648 shutdown_connections 2024-09-13T16:11:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.762+0000 7fbfb3873740 1 -- 172.21.15.17:0/2206959648 wait complete. 2024-09-13T16:11:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.762+0000 7fbfb3873740 20 client.15945 trim_cache size 0 max 16384 2024-09-13T16:11:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.780+0000 7fbfb3873740 1 Processor -- start 2024-09-13T16:11:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.780+0000 7fbfb3873740 1 -- start start 2024-09-13T16:11:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.780+0000 7fbfb3873740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e42a70 0x555f27e44270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.780+0000 7fbfb3873740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e433b0 0x555f27e447b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.780+0000 7fbfb3873740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e48440 0x555f27e5c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.780+0000 7fbfb3873740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f27b0ce60 con 0x555f27e48440 2024-09-13T16:11:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.780+0000 7fbfb3873740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f27d98800 con 0x555f27e42a70 2024-09-13T16:11:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.780+0000 7fbfb3873740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f27e54a20 con 0x555f27e433b0 2024-09-13T16:11:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.780+0000 7fbfa9e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e433b0 0x555f27e447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.780+0000 7fbfa9400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e42a70 0x555f27e44270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.780+0000 7fbfa9e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e433b0 0x555f27e447b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:47922/0 (socket says 172.21.15.17:47922) 2024-09-13T16:11:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.780+0000 7fbfa9e00640 1 -- 172.21.15.17:0/831648429 learned_addr learned my addr 172.21.15.17:0/831648429 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.780+0000 7fbfa9400640 1 --2- 172.21.15.17:0/831648429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e48440 0x555f27e5c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.781+0000 7fbfa9e00640 1 -- 172.21.15.17:0/831648429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e42a70 msgr2=0x555f27e44270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.781+0000 7fbfa9e00640 1 --2- 172.21.15.17:0/831648429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e42a70 0x555f27e44270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.781+0000 7fbfa9e00640 1 -- 172.21.15.17:0/831648429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e48440 msgr2=0x555f27e5c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.781+0000 7fbfa9e00640 1 --2- 172.21.15.17:0/831648429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e48440 0x555f27e5c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.781+0000 7fbfa9e00640 1 -- 172.21.15.17:0/831648429 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f27d46180 con 0x555f27e433b0 2024-09-13T16:11:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.781+0000 7fbfa9400640 1 --2- 172.21.15.17:0/831648429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e48440 0x555f27e5c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:11:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.781+0000 7fbfa9e00640 1 --2- 172.21.15.17:0/831648429 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e433b0 0x555f27e447b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c004810 tx=0x7fbf9c00aed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d54058a191f7ae6a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.781+0000 7fbf97e00640 1 -- 172.21.15.17:0/831648429 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c020040 con 0x555f27e433b0 2024-09-13T16:11:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.781+0000 7fbf97e00640 1 -- 172.21.15.17:0/831648429 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf9c0288f0 con 0x555f27e433b0 2024-09-13T16:11:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.782+0000 7fbf97e00640 1 -- 172.21.15.17:0/831648429 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c01ae60 con 0x555f27e433b0 2024-09-13T16:11:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.782+0000 7fbfb3873740 1 -- 172.21.15.17:0/831648429 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e433b0 msgr2=0x555f27e447b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.782+0000 7fbfb3873740 1 --2- 172.21.15.17:0/831648429 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e433b0 0x555f27e447b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c004810 tx=0x7fbf9c00aed0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.782+0000 7fbfb3873740 1 -- 172.21.15.17:0/831648429 shutdown_connections 2024-09-13T16:11:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.782+0000 7fbfb3873740 1 --2- 172.21.15.17:0/831648429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e48440 0x555f27e5c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.782+0000 7fbfb3873740 1 --2- 172.21.15.17:0/831648429 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e433b0 0x555f27e447b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.782+0000 7fbfb3873740 1 --2- 172.21.15.17:0/831648429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e42a70 0x555f27e44270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.782+0000 7fbfb3873740 1 -- 172.21.15.17:0/831648429 >> 172.21.15.17:0/831648429 conn(0x555f27e3e0e0 msgr2=0x555f27e67820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.783+0000 7fbfb3873740 1 -- 172.21.15.17:0/831648429 shutdown_connections 2024-09-13T16:11:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.783+0000 7fbfb3873740 1 -- 172.21.15.17:0/831648429 wait complete. 2024-09-13T16:11:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.783+0000 7fbfb3873740 1 -- start start 2024-09-13T16:11:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.783+0000 7fbfb3873740 1 Processor -- start 2024-09-13T16:11:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.784+0000 7fbfb3873740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e42a70 0x555f27e582f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.784+0000 7fbfb3873740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e433b0 0x555f27e58830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.784+0000 7fbfb3873740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e48440 0x555f27e5b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.784+0000 7fbfb3873740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f27e5bd90 con 0x555f27e42a70 2024-09-13T16:11:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.784+0000 7fbfb3873740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f27e5bf00 con 0x555f27e48440 2024-09-13T16:11:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.784+0000 7fbfb3873740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f27e5c0c0 con 0x555f27e433b0 2024-09-13T16:11:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.784+0000 7fbfb3873740 10 client.0 _ll_register_callbacks cb 0x7fbf9c00a1f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:11:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.785+0000 7fbfa9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e42a70 0x555f27e582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.785+0000 7fbfa9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e42a70 0x555f27e582f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45654/0 (socket says 172.21.15.17:45654) 2024-09-13T16:11:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.785+0000 7fbfa9400640 1 -- 172.21.15.17:0/745370789 learned_addr learned my addr 172.21.15.17:0/745370789 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.785+0000 7fbfa9e00640 1 --2- 172.21.15.17:0/745370789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e433b0 0x555f27e58830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.786+0000 7fbfa9e00640 1 -- 172.21.15.17:0/745370789 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e48440 msgr2=0x555f27e5b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.786+0000 7fbfa9400640 1 --2- 172.21.15.17:0/745370789 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e48440 0x555f27e5b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.787+0000 7fbfa9e00640 1 --2- 172.21.15.17:0/745370789 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e48440 0x555f27e5b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.787+0000 7fbfa9e00640 1 -- 172.21.15.17:0/745370789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e42a70 msgr2=0x555f27e582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.787+0000 7fbfa9e00640 1 --2- 172.21.15.17:0/745370789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e42a70 0x555f27e582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.787+0000 7fbfa9e00640 1 -- 172.21.15.17:0/745370789 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f27d47940 con 0x555f27e433b0 2024-09-13T16:11:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.788+0000 7fbfa9e00640 1 --2- 172.21.15.17:0/745370789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e433b0 0x555f27e58830 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c000c00 tx=0x7fbf9c01ac60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25ab2106f55ecaf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.788+0000 7fbf8be00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:11:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.788+0000 7fbfa9400640 1 --2- 172.21.15.17:0/745370789 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e48440 0x555f27e5b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:11:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.789+0000 7fbf8be00640 1 -- 172.21.15.17:0/745370789 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c020040 con 0x555f27e433b0 2024-09-13T16:11:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.789+0000 7fbf8be00640 1 -- 172.21.15.17:0/745370789 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fbf9c028640 con 0x555f27e433b0 2024-09-13T16:11:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.797+0000 7fbfb3873740 1 -- 172.21.15.17:0/745370789 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbf9c00cdc0 con 0x555f27e433b0 2024-09-13T16:11:31.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.798+0000 7fbf8be00640 1 -- 172.21.15.17:0/745370789 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf9c01a450 con 0x555f27e433b0 2024-09-13T16:11:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.801+0000 7fbfb3873740 10 client.26386 fetch_fsmap learned FSMap version 49 2024-09-13T16:11:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.801+0000 7fbfb3873740 1 -- 172.21.15.17:0/745370789 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x555f27d6b560 con 0x555f27e433b0 2024-09-13T16:11:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.801+0000 7fbf8be00640 1 -- 172.21.15.17:0/745370789 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf9c00cdc0 con 0x555f27e433b0 2024-09-13T16:11:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.801+0000 7fbf8be00640 1 -- 172.21.15.17:0/745370789 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 49) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fbf9c006400 con 0x555f27e433b0 2024-09-13T16:11:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.802+0000 7fbfb3873740 10 client.26386 fetch_fsmap finished waiting for FSMap version 49 2024-09-13T16:11:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.802+0000 7fbfb3873740 10 client.26386 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:11:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.802+0000 7fbfb3873740 20 client.26386 populate_metadata read hostname 'smithi017' 2024-09-13T16:11:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.802+0000 7fbfb3873740 1 --2- 172.21.15.17:0/745370789 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555f27eb7c60 0x555f27eba050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.802+0000 7fbfb3873740 4 client.26386 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:11:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.802+0000 7fbfb3873740 1 -- 172.21.15.17:0/745370789 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555f27a99300 con 0x555f27eb7c60 2024-09-13T16:11:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.803+0000 7fbfa9400640 1 --2- 172.21.15.17:0/745370789 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555f27eb7c60 0x555f27eba050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.809+0000 7fbf8be00640 10 client.26386 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:11:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.809+0000 7fbfa9400640 1 --2- 172.21.15.17:0/745370789 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555f27eb7c60 0x555f27eba050 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4183468b1d44b66 server_cookie=43fdf9c09e38ff7c in_seq=0 out_seq=0 2024-09-13T16:11:31.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.965+0000 7fbf8be00640 1 -- 172.21.15.17:0/745370789 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555f27a99300 con 0x555f27eb7c60 2024-09-13T16:11:31.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.965+0000 7fbf8be00640 10 client.26386 handle_command_reply: tid=0 2024-09-13T16:11:31.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.965+0000 7fbfb3873740 1 client.26386 shutdown 2024-09-13T16:11:31.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.966+0000 7fbfb3873740 1 -- 172.21.15.17:0/745370789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e433b0 msgr2=0x555f27e58830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:31.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.966+0000 7fbfb3873740 1 --2- 172.21.15.17:0/745370789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e433b0 0x555f27e58830 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c000c00 tx=0x7fbf9c01ac60 comp rx=0 tx=0).stop 2024-09-13T16:11:31.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.966+0000 7fbfb3873740 1 -- 172.21.15.17:0/745370789 shutdown_connections 2024-09-13T16:11:31.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.966+0000 7fbfb3873740 1 --2- 172.21.15.17:0/745370789 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x555f27eb7c60 0x555f27eba050 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.966+0000 7fbfb3873740 1 --2- 172.21.15.17:0/745370789 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555f27e48440 0x555f27e5b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.966+0000 7fbfb3873740 1 --2- 172.21.15.17:0/745370789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555f27e433b0 0x555f27e58830 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.966+0000 7fbfb3873740 1 --2- 172.21.15.17:0/745370789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f27e42a70 0x555f27e582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.966+0000 7fbfb3873740 1 -- 172.21.15.17:0/745370789 >> 172.21.15.17:0/745370789 conn(0x555f27e3e0e0 msgr2=0x555f27e67820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:31.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.967+0000 7fbf8be00640 0 client.26386 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:11:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.967+0000 7fbfb3873740 1 -- 172.21.15.17:0/745370789 shutdown_connections 2024-09-13T16:11:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.968+0000 7fbfb3873740 1 -- 172.21.15.17:0/745370789 wait complete. 2024-09-13T16:11:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.969+0000 7fbfb3873740 20 client.26386 trim_cache size 0 max 16384 2024-09-13T16:11:31.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:11:31.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:11:31.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:11:31.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:11:31.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.970+0000 7fbfb0a00640 1 -- 172.21.15.17:0/2786063834 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbf900a1110 msgr2=0x7fbf900a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:31.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.970+0000 7fbfb0a00640 1 --2- 172.21.15.17:0/2786063834 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbf900a1110 0x7fbf900a35d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40a1c10 tx=0x7fbfa400efd0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.970+0000 7fbfb0a00640 1 -- 172.21.15.17:0/2786063834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfac103a40 msgr2=0x7fbfac19f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:31.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.970+0000 7fbfb0a00640 1 --2- 172.21.15.17:0/2786063834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfac103a40 0x7fbfac19f570 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400eb10 tx=0x7fbfa400c2d0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.970+0000 7fbfb0a00640 1 -- 172.21.15.17:0/2786063834 shutdown_connections 2024-09-13T16:11:31.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.970+0000 7fbfb0a00640 1 --2- 172.21.15.17:0/2786063834 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fbf900a1110 0x7fbf900a35d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.970+0000 7fbfb0a00640 1 --2- 172.21.15.17:0/2786063834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfac103a40 0x7fbfac19f570 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.970+0000 7fbfb0a00640 1 --2- 172.21.15.17:0/2786063834 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbfac103080 0x7fbfac198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.970+0000 7fbfb0a00640 1 --2- 172.21.15.17:0/2786063834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfac101f30 0x7fbfac197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:31.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.970+0000 7fbfb0a00640 1 -- 172.21.15.17:0/2786063834 >> 172.21.15.17:0/2786063834 conn(0x7fbfac0fd6b0 msgr2=0x7fbfac106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:31.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.971+0000 7fbfb0a00640 1 -- 172.21.15.17:0/2786063834 shutdown_connections 2024-09-13T16:11:31.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:31.971+0000 7fbfb0a00640 1 -- 172.21.15.17:0/2786063834 wait complete. 2024-09-13T16:11:32.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:31 smithi189 ceph-mon[34790]: pgmap v798: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.0 MiB/s wr, 563 op/s 2024-09-13T16:11:32.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:31 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:11:32.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:31 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:11:32.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:31 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:11:32.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:31 smithi193 ceph-mon[35248]: pgmap v798: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.0 MiB/s wr, 563 op/s 2024-09-13T16:11:32.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:31 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:11:32.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:31 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:11:32.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:31 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:11:32.269 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:31 smithi017 ceph-mon[30494]: pgmap v798: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.0 MiB/s wr, 563 op/s 2024-09-13T16:11:32.269 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:31 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:11:32.269 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:31 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:11:32.269 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:31 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:11:34.056 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:33 smithi193 ceph-mon[35248]: pgmap v799: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.9 MiB/s wr, 535 op/s 2024-09-13T16:11:34.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:33 smithi189 ceph-mon[34790]: pgmap v799: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.9 MiB/s wr, 535 op/s 2024-09-13T16:11:34.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:33 smithi017 ceph-mon[30494]: pgmap v799: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.9 MiB/s wr, 535 op/s 2024-09-13T16:11:35.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 830.0 s, 478.4 tps, lat 212.882 ms stddev 246.335 2024-09-13T16:11:36.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:35 smithi189 ceph-mon[34790]: pgmap v800: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.3 MiB/s wr, 502 op/s 2024-09-13T16:11:36.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:35 smithi193 ceph-mon[35248]: pgmap v800: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.3 MiB/s wr, 502 op/s 2024-09-13T16:11:36.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:35 smithi017 ceph-mon[30494]: pgmap v800: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.3 MiB/s wr, 502 op/s 2024-09-13T16:11:38.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:37 smithi189 ceph-mon[34790]: pgmap v801: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.7 MiB/s wr, 521 op/s 2024-09-13T16:11:38.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:37 smithi193 ceph-mon[35248]: pgmap v801: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.7 MiB/s wr, 521 op/s 2024-09-13T16:11:38.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:37 smithi017 ceph-mon[30494]: pgmap v801: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.7 MiB/s wr, 521 op/s 2024-09-13T16:11:40.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:39 smithi189 ceph-mon[34790]: pgmap v802: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.3 MiB/s wr, 477 op/s 2024-09-13T16:11:40.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:39 smithi193 ceph-mon[35248]: pgmap v802: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.3 MiB/s wr, 477 op/s 2024-09-13T16:11:40.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:39 smithi017 ceph-mon[30494]: pgmap v802: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.3 MiB/s wr, 477 op/s 2024-09-13T16:11:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 835.0 s, 455.6 tps, lat 220.922 ms stddev 265.083 2024-09-13T16:11:42.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:41 smithi189 ceph-mon[34790]: pgmap v803: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.4 MiB/s wr, 493 op/s 2024-09-13T16:11:42.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:41 smithi193 ceph-mon[35248]: pgmap v803: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.4 MiB/s wr, 493 op/s 2024-09-13T16:11:42.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:41 smithi017 ceph-mon[30494]: pgmap v803: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.4 MiB/s wr, 493 op/s 2024-09-13T16:11:44.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:43 smithi189 ceph-mon[34790]: pgmap v804: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.1 MiB/s wr, 464 op/s 2024-09-13T16:11:44.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:43 smithi193 ceph-mon[35248]: pgmap v804: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.1 MiB/s wr, 464 op/s 2024-09-13T16:11:44.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:43 smithi017 ceph-mon[30494]: pgmap v804: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.1 MiB/s wr, 464 op/s 2024-09-13T16:11:45.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.178+0000 7f0d51a00640 1 -- 172.21.15.17:0/621026574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d440960c0 msgr2=0x7f0d440984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:45.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.178+0000 7f0d51a00640 1 --2- 172.21.15.17:0/621026574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d440960c0 0x7f0d440984b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009910 tx=0x7f0d4002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.180+0000 7f0d51a00640 1 -- 172.21.15.17:0/621026574 shutdown_connections 2024-09-13T16:11:45.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.180+0000 7f0d51a00640 1 --2- 172.21.15.17:0/621026574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d4409b320 0x7f0d4409d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.180+0000 7f0d51a00640 1 --2- 172.21.15.17:0/621026574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d440989f0 0x7f0d4409ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.180+0000 7f0d51a00640 1 --2- 172.21.15.17:0/621026574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d440960c0 0x7f0d440984b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.180+0000 7f0d51a00640 1 -- 172.21.15.17:0/621026574 >> 172.21.15.17:0/621026574 conn(0x7f0d4408fc80 msgr2=0x7f0d440920e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:45.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.180+0000 7f0d51a00640 1 -- 172.21.15.17:0/621026574 shutdown_connections 2024-09-13T16:11:45.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.180+0000 7f0d51a00640 1 -- 172.21.15.17:0/621026574 wait complete. 2024-09-13T16:11:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.182+0000 7f0d51a00640 1 Processor -- start 2024-09-13T16:11:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.182+0000 7f0d51a00640 1 -- start start 2024-09-13T16:11:45.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.182+0000 7f0d51a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d440960c0 0x7f0d44129260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:45.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.182+0000 7f0d51a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d440989f0 0x7f0d441297a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:45.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.182+0000 7f0d51a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d4409b320 0x7f0d44139420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:45.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.182+0000 7f0d51a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4412a0a0 con 0x7f0d440960c0 2024-09-13T16:11:45.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.182+0000 7f0d51a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d44139960 con 0x7f0d4409b320 2024-09-13T16:11:45.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.182+0000 7f0d51a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d44139ad0 con 0x7f0d440989f0 2024-09-13T16:11:45.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.183+0000 7f0d51000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d4409b320 0x7f0d44139420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:45.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.183+0000 7f0d51000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d4409b320 0x7f0d44139420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:54856/0 (socket says 172.21.15.17:54856) 2024-09-13T16:11:45.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.183+0000 7f0d51000640 1 -- 172.21.15.17:0/1569344022 learned_addr learned my addr 172.21.15.17:0/1569344022 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:45.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.183+0000 7f0d4be00640 1 --2- 172.21.15.17:0/1569344022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d440960c0 0x7f0d44129260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:45.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.183+0000 7f0d51000640 1 -- 172.21.15.17:0/1569344022 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d440989f0 msgr2=0x7f0d441297a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T16:11:45.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.183+0000 7f0d51000640 1 --2- 172.21.15.17:0/1569344022 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d440989f0 0x7f0d441297a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.183+0000 7f0d51000640 1 -- 172.21.15.17:0/1569344022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d440960c0 msgr2=0x7f0d44129260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:45.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.183+0000 7f0d51000640 1 --2- 172.21.15.17:0/1569344022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d440960c0 0x7f0d44129260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.183+0000 7f0d51000640 1 -- 172.21.15.17:0/1569344022 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d38009490 con 0x7f0d4409b320 2024-09-13T16:11:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.183+0000 7f0d4be00640 1 --2- 172.21.15.17:0/1569344022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d440960c0 0x7f0d44129260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:11:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.184+0000 7f0d51000640 1 --2- 172.21.15.17:0/1569344022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d4409b320 0x7f0d44139420 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c066130 tx=0x7f0d4c069a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.184+0000 7f0d48c00640 1 -- 172.21.15.17:0/1569344022 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c07a670 con 0x7f0d4409b320 2024-09-13T16:11:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.184+0000 7f0d51a00640 1 -- 172.21.15.17:0/1569344022 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d40009500 con 0x7f0d4409b320 2024-09-13T16:11:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.184+0000 7f0d48c00640 1 -- 172.21.15.17:0/1569344022 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d4c07b040 con 0x7f0d4409b320 2024-09-13T16:11:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.184+0000 7f0d48c00640 1 -- 172.21.15.17:0/1569344022 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c080a10 con 0x7f0d4409b320 2024-09-13T16:11:45.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.185+0000 7f0d51a00640 1 -- 172.21.15.17:0/1569344022 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d44139ff0 con 0x7f0d4409b320 2024-09-13T16:11:45.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.192+0000 7f0d55e1f740 1 Processor -- start 2024-09-13T16:11:45.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.192+0000 7f0d48c00640 1 -- 172.21.15.17:0/1569344022 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0d4c07a7d0 con 0x7f0d4409b320 2024-09-13T16:11:45.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.194+0000 7f0d48c00640 1 --2- 172.21.15.17:0/1569344022 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0d340a1110 0x7f0d340a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:45.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.195+0000 7f0d55e1f740 1 -- start start 2024-09-13T16:11:45.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.195+0000 7f0d4b400640 1 --2- 172.21.15.17:0/1569344022 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0d340a1110 0x7f0d340a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:45.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.195+0000 7f0d55e1f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c844c80 0x56106c845080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:45.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.195+0000 7f0d55e1f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c8455c0 0x56106c84a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:45.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.195+0000 7f0d55e1f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c84a650 0x56106c84cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:45.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.195+0000 7f0d48c00640 1 -- 172.21.15.17:0/1569344022 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f0d4c104340 con 0x7f0d4409b320 2024-09-13T16:11:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.196+0000 7f0d55e1f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56106c750bb0 con 0x56106c8455c0 2024-09-13T16:11:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.196+0000 7f0d55e1f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x56106c7aea70 con 0x56106c844c80 2024-09-13T16:11:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.196+0000 7f0d55e1f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x56106c7ac200 con 0x56106c84a650 2024-09-13T16:11:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.196+0000 7f0d4be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c844c80 0x56106c845080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.196+0000 7f0d4be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c844c80 0x56106c845080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:54864/0 (socket says 172.21.15.17:54864) 2024-09-13T16:11:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.196+0000 7f0d4be00640 1 -- 172.21.15.17:0/3967210723 learned_addr learned my addr 172.21.15.17:0/3967210723 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.196+0000 7f0d51000640 1 --2- 172.21.15.17:0/3967210723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c84a650 0x56106c84cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.197+0000 7f0d4be00640 1 -- 172.21.15.17:0/3967210723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c84a650 msgr2=0x56106c84cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.197+0000 7f0d4be00640 1 --2- 172.21.15.17:0/3967210723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c84a650 0x56106c84cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.197+0000 7f0d4be00640 1 -- 172.21.15.17:0/3967210723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c8455c0 msgr2=0x56106c84a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.197+0000 7f0d4be00640 1 --2- 172.21.15.17:0/3967210723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c8455c0 0x56106c84a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.197+0000 7f0d4be00640 1 -- 172.21.15.17:0/3967210723 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56106c749940 con 0x56106c844c80 2024-09-13T16:11:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.197+0000 7f0d4be00640 1 --2- 172.21.15.17:0/3967210723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c844c80 0x56106c845080 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0d40000c00 tx=0x7f0d40030420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4fb8ee38ad9027 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:45.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.198+0000 7f0d4b400640 1 --2- 172.21.15.17:0/1569344022 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0d340a1110 0x7f0d340a35d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0d4412a560 tx=0x7f0d38005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:45.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.200+0000 7f0d3d600640 1 -- 172.21.15.17:0/3967210723 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40004250 con 0x56106c844c80 2024-09-13T16:11:45.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.201+0000 7f0d3d600640 1 -- 172.21.15.17:0/3967210723 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d40030d80 con 0x56106c844c80 2024-09-13T16:11:45.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.201+0000 7f0d3d600640 1 -- 172.21.15.17:0/3967210723 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d400046c0 con 0x56106c844c80 2024-09-13T16:11:45.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.202+0000 7f0d55e1f740 1 -- 172.21.15.17:0/3967210723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c844c80 msgr2=0x56106c845080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:45.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.202+0000 7f0d55e1f740 1 --2- 172.21.15.17:0/3967210723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c844c80 0x56106c845080 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0d40000c00 tx=0x7f0d40030420 comp rx=0 tx=0).stop 2024-09-13T16:11:45.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.202+0000 7f0d55e1f740 1 -- 172.21.15.17:0/3967210723 shutdown_connections 2024-09-13T16:11:45.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.202+0000 7f0d55e1f740 1 --2- 172.21.15.17:0/3967210723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c84a650 0x56106c84cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.202+0000 7f0d55e1f740 1 --2- 172.21.15.17:0/3967210723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c8455c0 0x56106c84a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.202+0000 7f0d55e1f740 1 --2- 172.21.15.17:0/3967210723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c844c80 0x56106c845080 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.202+0000 7f0d55e1f740 1 -- 172.21.15.17:0/3967210723 >> 172.21.15.17:0/3967210723 conn(0x56106c8402f0 msgr2=0x56106c8406f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:45.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.203+0000 7f0d55e1f740 1 -- 172.21.15.17:0/3967210723 shutdown_connections 2024-09-13T16:11:45.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.203+0000 7f0d55e1f740 1 -- 172.21.15.17:0/3967210723 wait complete. 2024-09-13T16:11:45.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.204+0000 7f0d55e1f740 1 -- start start 2024-09-13T16:11:45.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.206+0000 7f0d55e1f740 1 Processor -- start 2024-09-13T16:11:45.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.208+0000 7f0d55e1f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c844c80 0x56106c84e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:45.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.208+0000 7f0d55e1f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c8455c0 0x56106c84ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:45.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.208+0000 7f0d55e1f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c84a650 0x56106c855e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:45.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.208+0000 7f0d55e1f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56106c7a7af0 con 0x56106c84a650 2024-09-13T16:11:45.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.208+0000 7f0d55e1f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x56106c765f20 con 0x56106c8455c0 2024-09-13T16:11:45.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.208+0000 7f0d55e1f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x56106c765bc0 con 0x56106c844c80 2024-09-13T16:11:45.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.208+0000 7f0d55e1f740 10 client.0 _ll_register_callbacks cb 0x56106c797a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:11:45.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.209+0000 7f0d4b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c8455c0 0x56106c84ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:45.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.209+0000 7f0d4b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c8455c0 0x56106c84ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:54878/0 (socket says 172.21.15.17:54878) 2024-09-13T16:11:45.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.209+0000 7f0d4b400640 1 -- 172.21.15.17:0/2697985009 learned_addr learned my addr 172.21.15.17:0/2697985009 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:45.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.209+0000 7f0d51000640 1 --2- 172.21.15.17:0/2697985009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c84a650 0x56106c855e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:45.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.210+0000 7f0d4be00640 1 --2- 172.21.15.17:0/2697985009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c844c80 0x56106c84e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.210+0000 7f0d51000640 1 -- 172.21.15.17:0/2697985009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c844c80 msgr2=0x56106c84e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.210+0000 7f0d51000640 1 --2- 172.21.15.17:0/2697985009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c844c80 0x56106c84e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.210+0000 7f0d51000640 1 -- 172.21.15.17:0/2697985009 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c8455c0 msgr2=0x56106c84ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.210+0000 7f0d51000640 1 --2- 172.21.15.17:0/2697985009 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c8455c0 0x56106c84ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.210+0000 7f0d51000640 1 -- 172.21.15.17:0/2697985009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4409e370 con 0x56106c84a650 2024-09-13T16:11:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.210+0000 7f0d4b400640 1 --2- 172.21.15.17:0/2697985009 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c8455c0 0x56106c84ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:11:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.212+0000 7f0d51000640 1 --2- 172.21.15.17:0/2697985009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c84a650 0x56106c855e60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0fe7b0 tx=0x7f0d4c10bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac6ab1026fab7a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.212+0000 7f0d32000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-13T16:11:45.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.214+0000 7f0d32000640 1 -- 172.21.15.17:0/2697985009 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0fffc0 con 0x56106c84a650 2024-09-13T16:11:45.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.214+0000 7f0d32000640 1 -- 172.21.15.17:0/2697985009 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f0d4c10c0c0 con 0x56106c84a650 2024-09-13T16:11:45.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.215+0000 7f0d55e1f740 1 -- 172.21.15.17:0/2697985009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56106c7d1c90 con 0x56106c84a650 2024-09-13T16:11:45.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.215+0000 7f0d32000640 1 -- 172.21.15.17:0/2697985009 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d4c103a10 con 0x56106c84a650 2024-09-13T16:11:45.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.216+0000 7f0d55e1f740 10 client.15957 fetch_fsmap learned FSMap version 49 2024-09-13T16:11:45.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.216+0000 7f0d55e1f740 1 -- 172.21.15.17:0/2697985009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x56106c7a6170 con 0x56106c84a650 2024-09-13T16:11:45.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.217+0000 7f0d32000640 1 -- 172.21.15.17:0/2697985009 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d4c11b070 con 0x56106c84a650 2024-09-13T16:11:45.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.217+0000 7f0d32000640 1 -- 172.21.15.17:0/2697985009 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 49) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f0d4c11c230 con 0x56106c84a650 2024-09-13T16:11:45.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.217+0000 7f0d55e1f740 10 client.15957 fetch_fsmap finished waiting for FSMap version 49 2024-09-13T16:11:45.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.217+0000 7f0d55e1f740 10 client.15957 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:11:45.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.217+0000 7f0d55e1f740 20 client.15957 populate_metadata read hostname 'smithi017' 2024-09-13T16:11:45.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.217+0000 7f0d55e1f740 1 --2- 172.21.15.17:0/2697985009 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56106c85a570 0x56106c85c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:45.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.217+0000 7f0d55e1f740 4 client.15957 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:11:45.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.217+0000 7f0d55e1f740 1 -- 172.21.15.17:0/2697985009 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56106c79a7d0 con 0x56106c85a570 2024-09-13T16:11:45.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.218+0000 7f0d4be00640 1 --2- 172.21.15.17:0/2697985009 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56106c85a570 0x56106c85c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:45.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.219+0000 7f0d4be00640 1 --2- 172.21.15.17:0/2697985009 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56106c85a570 0x56106c85c990 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=555755335bd95986 server_cookie=3380f01ade23f0ef in_seq=0 out_seq=0 2024-09-13T16:11:45.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.219+0000 7f0d32000640 10 client.15957 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:11:45.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.219+0000 7f0d32000640 1 -- 172.21.15.17:0/2697985009 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56106c79a7d0 con 0x56106c85a570 2024-09-13T16:11:45.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.219+0000 7f0d32000640 10 client.15957 handle_command_reply: tid=0 2024-09-13T16:11:45.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.220+0000 7f0d55e1f740 1 client.15957 shutdown 2024-09-13T16:11:45.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.220+0000 7f0d55e1f740 1 -- 172.21.15.17:0/2697985009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c84a650 msgr2=0x56106c855e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:45.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.220+0000 7f0d55e1f740 1 --2- 172.21.15.17:0/2697985009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c84a650 0x56106c855e60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0fe7b0 tx=0x7f0d4c10bbc0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.220+0000 7f0d55e1f740 1 -- 172.21.15.17:0/2697985009 shutdown_connections 2024-09-13T16:11:45.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.220+0000 7f0d55e1f740 1 --2- 172.21.15.17:0/2697985009 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56106c85a570 0x56106c85c990 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.220+0000 7f0d55e1f740 1 --2- 172.21.15.17:0/2697985009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c84a650 0x56106c855e60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.220+0000 7f0d55e1f740 1 --2- 172.21.15.17:0/2697985009 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c8455c0 0x56106c84ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.220+0000 7f0d55e1f740 1 --2- 172.21.15.17:0/2697985009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c844c80 0x56106c84e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.220+0000 7f0d55e1f740 1 -- 172.21.15.17:0/2697985009 >> 172.21.15.17:0/2697985009 conn(0x56106c8402f0 msgr2=0x56106c841b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:45.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.220+0000 7f0d32000640 0 client.15957 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:11:45.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.221+0000 7f0d55e1f740 1 -- 172.21.15.17:0/2697985009 shutdown_connections 2024-09-13T16:11:45.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.221+0000 7f0d55e1f740 1 -- 172.21.15.17:0/2697985009 wait complete. 2024-09-13T16:11:45.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.221+0000 7f0d55e1f740 20 client.15957 trim_cache size 0 max 16384 2024-09-13T16:11:45.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.246+0000 7f0d55e1f740 1 Processor -- start 2024-09-13T16:11:45.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.246+0000 7f0d55e1f740 1 -- start start 2024-09-13T16:11:45.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.247+0000 7f0d55e1f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c844c80 0x56106c846480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:45.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.247+0000 7f0d55e1f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c8455c0 0x56106c855e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:45.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.247+0000 7f0d55e1f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c84a650 0x56106c8469c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:45.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.247+0000 7f0d55e1f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56106c50ee60 con 0x56106c844c80 2024-09-13T16:11:45.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.247+0000 7f0d55e1f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x56106c85a090 con 0x56106c8455c0 2024-09-13T16:11:45.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.247+0000 7f0d55e1f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x56106c84d220 con 0x56106c84a650 2024-09-13T16:11:45.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.247+0000 7f0d4be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c844c80 0x56106c846480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:45.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.248+0000 7f0d4b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c8455c0 0x56106c855e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:45.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.248+0000 7f0d4be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c844c80 0x56106c846480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39748/0 (socket says 172.21.15.17:39748) 2024-09-13T16:11:45.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.248+0000 7f0d4be00640 1 -- 172.21.15.17:0/443997968 learned_addr learned my addr 172.21.15.17:0/443997968 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:45.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.248+0000 7f0d51000640 1 --2- 172.21.15.17:0/443997968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c84a650 0x56106c8469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.248+0000 7f0d51000640 1 -- 172.21.15.17:0/443997968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c8455c0 msgr2=0x56106c855e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.248+0000 7f0d51000640 1 --2- 172.21.15.17:0/443997968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c8455c0 0x56106c855e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.248+0000 7f0d51000640 1 -- 172.21.15.17:0/443997968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c844c80 msgr2=0x56106c846480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.248+0000 7f0d51000640 1 --2- 172.21.15.17:0/443997968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c844c80 0x56106c846480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.248+0000 7f0d51000640 1 -- 172.21.15.17:0/443997968 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56106c748180 con 0x56106c84a650 2024-09-13T16:11:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.248+0000 7f0d4be00640 1 --2- 172.21.15.17:0/443997968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c844c80 0x56106c846480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:11:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.249+0000 7f0d51000640 1 --2- 172.21.15.17:0/443997968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c84a650 0x56106c8469c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0ff4a0 tx=0x7f0d4c1021f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e60dbbc287108bd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.249+0000 7f0d3e000640 1 -- 172.21.15.17:0/443997968 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c103a10 con 0x56106c84a650 2024-09-13T16:11:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.249+0000 7f0d3e000640 1 -- 172.21.15.17:0/443997968 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d4c11b070 con 0x56106c84a650 2024-09-13T16:11:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.249+0000 7f0d3e000640 1 -- 172.21.15.17:0/443997968 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c080dd0 con 0x56106c84a650 2024-09-13T16:11:45.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.249+0000 7f0d55e1f740 1 -- 172.21.15.17:0/443997968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c84a650 msgr2=0x56106c8469c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:45.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.249+0000 7f0d55e1f740 1 --2- 172.21.15.17:0/443997968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c84a650 0x56106c8469c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0ff4a0 tx=0x7f0d4c1021f0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.250+0000 7f0d55e1f740 1 -- 172.21.15.17:0/443997968 shutdown_connections 2024-09-13T16:11:45.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.250+0000 7f0d55e1f740 1 --2- 172.21.15.17:0/443997968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c84a650 0x56106c8469c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.250+0000 7f0d55e1f740 1 --2- 172.21.15.17:0/443997968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c8455c0 0x56106c855e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.250+0000 7f0d55e1f740 1 --2- 172.21.15.17:0/443997968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c844c80 0x56106c846480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.250+0000 7f0d55e1f740 1 -- 172.21.15.17:0/443997968 >> 172.21.15.17:0/443997968 conn(0x56106c8402f0 msgr2=0x56106c849aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:45.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.250+0000 7f0d55e1f740 1 -- 172.21.15.17:0/443997968 shutdown_connections 2024-09-13T16:11:45.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.250+0000 7f0d55e1f740 1 -- 172.21.15.17:0/443997968 wait complete. 2024-09-13T16:11:45.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.250+0000 7f0d55e1f740 1 -- start start 2024-09-13T16:11:45.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.250+0000 7f0d55e1f740 1 Processor -- start 2024-09-13T16:11:45.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.251+0000 7f0d55e1f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c844c80 0x56106c8559d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.251+0000 7f0d55e1f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c8455c0 0x56106c853fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.251+0000 7f0d55e1f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c84a650 0x56106c854520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.251+0000 7f0d55e1f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56106c8561f0 con 0x56106c8455c0 2024-09-13T16:11:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.251+0000 7f0d55e1f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x56106c854a60 con 0x56106c84a650 2024-09-13T16:11:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.251+0000 7f0d55e1f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x56106c854c20 con 0x56106c844c80 2024-09-13T16:11:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.251+0000 7f0d55e1f740 10 client.0 _ll_register_callbacks cb 0x7f0d38005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:11:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.251+0000 7f0d4be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c844c80 0x56106c8559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.251+0000 7f0d4be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c844c80 0x56106c8559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:47572/0 (socket says 172.21.15.17:47572) 2024-09-13T16:11:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.251+0000 7f0d4be00640 1 -- 172.21.15.17:0/493223321 learned_addr learned my addr 172.21.15.17:0/493223321 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.251+0000 7f0d4b400640 1 --2- 172.21.15.17:0/493223321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c8455c0 0x56106c853fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.251+0000 7f0d51000640 1 --2- 172.21.15.17:0/493223321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c84a650 0x56106c854520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:45.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.251+0000 7f0d4be00640 1 -- 172.21.15.17:0/493223321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c84a650 msgr2=0x56106c854520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:45.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.251+0000 7f0d4be00640 1 --2- 172.21.15.17:0/493223321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c84a650 0x56106c854520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.251+0000 7f0d4be00640 1 -- 172.21.15.17:0/493223321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c8455c0 msgr2=0x56106c853fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:45.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.251+0000 7f0d4be00640 1 --2- 172.21.15.17:0/493223321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c8455c0 0x56106c853fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.251+0000 7f0d4be00640 1 -- 172.21.15.17:0/493223321 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56106c749940 con 0x56106c844c80 2024-09-13T16:11:45.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.251+0000 7f0d4b400640 1 --2- 172.21.15.17:0/493223321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c8455c0 0x56106c853fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:11:45.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.252+0000 7f0d4be00640 1 --2- 172.21.15.17:0/493223321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c844c80 0x56106c8559d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0d40000c00 tx=0x7f0d40030610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7745db1eb953f68d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:45.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.252+0000 7f0d32000640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:11:45.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.252+0000 7f0d32000640 1 -- 172.21.15.17:0/493223321 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4004c070 con 0x56106c844c80 2024-09-13T16:11:45.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.252+0000 7f0d55e1f740 1 -- 172.21.15.17:0/493223321 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d40030d80 con 0x56106c844c80 2024-09-13T16:11:45.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.252+0000 7f0d32000640 1 -- 172.21.15.17:0/493223321 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f0d40053420 con 0x56106c844c80 2024-09-13T16:11:45.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.252+0000 7f0d32000640 1 -- 172.21.15.17:0/493223321 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d400535e0 con 0x56106c844c80 2024-09-13T16:11:45.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.252+0000 7f0d55e1f740 10 client.26401 fetch_fsmap learned FSMap version 49 2024-09-13T16:11:45.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.252+0000 7f0d55e1f740 1 -- 172.21.15.17:0/493223321 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x56106c7a6170 con 0x56106c844c80 2024-09-13T16:11:45.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.252+0000 7f0d32000640 1 -- 172.21.15.17:0/493223321 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d40030d80 con 0x56106c844c80 2024-09-13T16:11:45.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.253+0000 7f0d32000640 1 -- 172.21.15.17:0/493223321 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 49) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f0d40038030 con 0x56106c844c80 2024-09-13T16:11:45.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.253+0000 7f0d55e1f740 10 client.26401 fetch_fsmap finished waiting for FSMap version 49 2024-09-13T16:11:45.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.253+0000 7f0d55e1f740 10 client.26401 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:11:45.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.253+0000 7f0d55e1f740 20 client.26401 populate_metadata read hostname 'smithi017' 2024-09-13T16:11:45.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.253+0000 7f0d55e1f740 1 --2- 172.21.15.17:0/493223321 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56106c8b1d30 0x56106c8b4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:45.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.253+0000 7f0d55e1f740 4 client.26401 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:11:45.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.253+0000 7f0d55e1f740 1 -- 172.21.15.17:0/493223321 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56106c49b300 con 0x56106c8b1d30 2024-09-13T16:11:45.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.253+0000 7f0d4b400640 1 --2- 172.21.15.17:0/493223321 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56106c8b1d30 0x56106c8b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.254+0000 7f0d4b400640 1 --2- 172.21.15.17:0/493223321 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56106c8b1d30 0x56106c8b4150 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fa9eda1dbb95b6e server_cookie=d48cf3ae91742674 in_seq=0 out_seq=0 2024-09-13T16:11:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.254+0000 7f0d32000640 10 client.26401 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:11:45.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.273+0000 7f0d32000640 1 -- 172.21.15.17:0/493223321 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56106c49b300 con 0x56106c8b1d30 2024-09-13T16:11:45.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.273+0000 7f0d32000640 10 client.26401 handle_command_reply: tid=0 2024-09-13T16:11:45.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.273+0000 7f0d55e1f740 1 client.26401 shutdown 2024-09-13T16:11:45.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.274+0000 7f0d55e1f740 1 -- 172.21.15.17:0/493223321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c844c80 msgr2=0x56106c8559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:45.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.274+0000 7f0d55e1f740 1 --2- 172.21.15.17:0/493223321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c844c80 0x56106c8559d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0d40000c00 tx=0x7f0d40030610 comp rx=0 tx=0).stop 2024-09-13T16:11:45.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.274+0000 7f0d55e1f740 1 -- 172.21.15.17:0/493223321 shutdown_connections 2024-09-13T16:11:45.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.274+0000 7f0d55e1f740 1 --2- 172.21.15.17:0/493223321 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56106c8b1d30 0x56106c8b4150 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.274+0000 7f0d55e1f740 1 --2- 172.21.15.17:0/493223321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56106c84a650 0x56106c854520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.274+0000 7f0d55e1f740 1 --2- 172.21.15.17:0/493223321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56106c8455c0 0x56106c853fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.274+0000 7f0d55e1f740 1 --2- 172.21.15.17:0/493223321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56106c844c80 0x56106c8559d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.274+0000 7f0d55e1f740 1 -- 172.21.15.17:0/493223321 >> 172.21.15.17:0/493223321 conn(0x56106c8402f0 msgr2=0x56106c84e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:45.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.274+0000 7f0d32000640 0 client.26401 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:11:45.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.275+0000 7f0d55e1f740 1 -- 172.21.15.17:0/493223321 shutdown_connections 2024-09-13T16:11:45.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.275+0000 7f0d55e1f740 1 -- 172.21.15.17:0/493223321 wait complete. 2024-09-13T16:11:45.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.276+0000 7f0d55e1f740 20 client.26401 trim_cache size 0 max 16384 2024-09-13T16:11:45.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:11:45.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:11:45.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:11:45.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:11:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.277+0000 7f0d51a00640 1 -- 172.21.15.17:0/1569344022 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0d340a1110 msgr2=0x7f0d340a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.277+0000 7f0d51a00640 1 --2- 172.21.15.17:0/1569344022 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0d340a1110 0x7f0d340a35d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0d4412a560 tx=0x7f0d38005f90 comp rx=0 tx=0).stop 2024-09-13T16:11:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.277+0000 7f0d51a00640 1 -- 172.21.15.17:0/1569344022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d4409b320 msgr2=0x7f0d44139420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.277+0000 7f0d51a00640 1 --2- 172.21.15.17:0/1569344022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d4409b320 0x7f0d44139420 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c066130 tx=0x7f0d4c069a70 comp rx=0 tx=0).stop 2024-09-13T16:11:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.277+0000 7f0d51a00640 1 -- 172.21.15.17:0/1569344022 shutdown_connections 2024-09-13T16:11:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.277+0000 7f0d51a00640 1 --2- 172.21.15.17:0/1569344022 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0d340a1110 0x7f0d340a35d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.277+0000 7f0d51a00640 1 --2- 172.21.15.17:0/1569344022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d4409b320 0x7f0d44139420 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.277+0000 7f0d51a00640 1 --2- 172.21.15.17:0/1569344022 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d440989f0 0x7f0d441297a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.277+0000 7f0d51a00640 1 --2- 172.21.15.17:0/1569344022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d440960c0 0x7f0d44129260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.277+0000 7f0d51a00640 1 -- 172.21.15.17:0/1569344022 >> 172.21.15.17:0/1569344022 conn(0x7f0d4408fc80 msgr2=0x7f0d44094890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.277+0000 7f0d51a00640 1 -- 172.21.15.17:0/1569344022 shutdown_connections 2024-09-13T16:11:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:45.277+0000 7f0d51a00640 1 -- 172.21.15.17:0/1569344022 wait complete. 2024-09-13T16:11:45.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 840.0 s, 473.4 tps, lat 210.306 ms stddev 229.685 2024-09-13T16:11:46.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:45 smithi193 ceph-mon[35248]: pgmap v805: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.1 MiB/s wr, 456 op/s 2024-09-13T16:11:46.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:45 smithi017 ceph-mon[30494]: pgmap v805: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.1 MiB/s wr, 456 op/s 2024-09-13T16:11:46.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:45 smithi189 ceph-mon[34790]: pgmap v805: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.1 MiB/s wr, 456 op/s 2024-09-13T16:11:48.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:47 smithi193 ceph-mon[35248]: pgmap v806: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 4.7 MiB/s wr, 501 op/s 2024-09-13T16:11:48.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:47 smithi017 ceph-mon[30494]: pgmap v806: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 4.7 MiB/s wr, 501 op/s 2024-09-13T16:11:48.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:47 smithi189 ceph-mon[34790]: pgmap v806: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 4.7 MiB/s wr, 501 op/s 2024-09-13T16:11:50.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:49 smithi193 ceph-mon[35248]: pgmap v807: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 4.0 MiB/s wr, 440 op/s 2024-09-13T16:11:50.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:49 smithi017 ceph-mon[30494]: pgmap v807: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 4.0 MiB/s wr, 440 op/s 2024-09-13T16:11:50.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 845.0 s, 473.2 tps, lat 211.303 ms stddev 226.496 2024-09-13T16:11:50.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:49 smithi189 ceph-mon[34790]: pgmap v807: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 4.0 MiB/s wr, 440 op/s 2024-09-13T16:11:52.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:51 smithi193 ceph-mon[35248]: pgmap v808: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 4.5 MiB/s wr, 495 op/s 2024-09-13T16:11:52.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:51 smithi017 ceph-mon[30494]: pgmap v808: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 4.5 MiB/s wr, 495 op/s 2024-09-13T16:11:52.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:51 smithi189 ceph-mon[34790]: pgmap v808: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 4.5 MiB/s wr, 495 op/s 2024-09-13T16:11:54.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:53 smithi193 ceph-mon[35248]: pgmap v809: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 4.0 MiB/s wr, 455 op/s 2024-09-13T16:11:54.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:53 smithi017 ceph-mon[30494]: pgmap v809: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 4.0 MiB/s wr, 455 op/s 2024-09-13T16:11:54.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:53 smithi189 ceph-mon[34790]: pgmap v809: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 4.0 MiB/s wr, 455 op/s 2024-09-13T16:11:55.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 850.0 s, 487.2 tps, lat 202.830 ms stddev 220.480 2024-09-13T16:11:56.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:55 smithi193 ceph-mon[35248]: pgmap v810: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 4.3 MiB/s wr, 458 op/s 2024-09-13T16:11:56.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:55 smithi017 ceph-mon[30494]: pgmap v810: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 4.3 MiB/s wr, 458 op/s 2024-09-13T16:11:56.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:55 smithi189 ceph-mon[34790]: pgmap v810: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 4.3 MiB/s wr, 458 op/s 2024-09-13T16:11:58.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:57 smithi193 ceph-mon[35248]: pgmap v811: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 4.5 MiB/s wr, 492 op/s 2024-09-13T16:11:58.265 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:57 smithi017 ceph-mon[30494]: pgmap v811: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 4.5 MiB/s wr, 492 op/s 2024-09-13T16:11:58.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:57 smithi189 ceph-mon[34790]: pgmap v811: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 4.5 MiB/s wr, 492 op/s 2024-09-13T16:11:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.485+0000 7fee64a00640 1 -- 172.21.15.17:0/2295836703 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee60100d40 msgr2=0x7fee601011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.485+0000 7fee64a00640 1 --2- 172.21.15.17:0/2295836703 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee60100d40 0x7fee601011c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009900 tx=0x7fee4c02a440 comp rx=0 tx=0).stop 2024-09-13T16:11:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.485+0000 7fee64a00640 1 -- 172.21.15.17:0/2295836703 shutdown_connections 2024-09-13T16:11:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.485+0000 7fee64a00640 1 --2- 172.21.15.17:0/2295836703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee60101700 0x7fee60107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.485+0000 7fee64a00640 1 --2- 172.21.15.17:0/2295836703 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee60100d40 0x7fee601011c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.485+0000 7fee64a00640 1 --2- 172.21.15.17:0/2295836703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee600ffb50 0x7fee600fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.486+0000 7fee64a00640 1 -- 172.21.15.17:0/2295836703 >> 172.21.15.17:0/2295836703 conn(0x7fee600fb2f0 msgr2=0x7fee600fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.486+0000 7fee64a00640 1 -- 172.21.15.17:0/2295836703 shutdown_connections 2024-09-13T16:11:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.486+0000 7fee64a00640 1 -- 172.21.15.17:0/2295836703 wait complete. 2024-09-13T16:11:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.488+0000 7fee64a00640 1 Processor -- start 2024-09-13T16:11:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.488+0000 7fee64a00640 1 -- start start 2024-09-13T16:11:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.489+0000 7fee64a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee600ffb50 0x7fee60193990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.489+0000 7fee64a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee60100d40 0x7fee60193ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.489+0000 7fee64a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee60101700 0x7fee6019aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.490+0000 7fee64a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6019b430 con 0x7fee600ffb50 2024-09-13T16:11:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.490+0000 7fee64a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6019b5a0 con 0x7fee60101700 2024-09-13T16:11:58.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.490+0000 7fee64a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee601ac770 con 0x7fee60100d40 2024-09-13T16:11:58.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.490+0000 7fee5f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee60101700 0x7fee6019aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:58.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.490+0000 7fee5f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee60101700 0x7fee6019aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:49108/0 (socket says 172.21.15.17:49108) 2024-09-13T16:11:58.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.490+0000 7fee5f200640 1 -- 172.21.15.17:0/2981266847 learned_addr learned my addr 172.21.15.17:0/2981266847 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:58.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.490+0000 7fee5de00640 1 --2- 172.21.15.17:0/2981266847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee60100d40 0x7fee60193ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:58.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.491+0000 7fee5e800640 1 --2- 172.21.15.17:0/2981266847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee600ffb50 0x7fee60193990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:58.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.491+0000 7fee5de00640 1 -- 172.21.15.17:0/2981266847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee60101700 msgr2=0x7fee6019aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:58.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.491+0000 7fee5de00640 1 --2- 172.21.15.17:0/2981266847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee60101700 0x7fee6019aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.491+0000 7fee5de00640 1 -- 172.21.15.17:0/2981266847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee600ffb50 msgr2=0x7fee60193990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:58.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.491+0000 7fee5de00640 1 --2- 172.21.15.17:0/2981266847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee600ffb50 0x7fee60193990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.491+0000 7fee5de00640 1 -- 172.21.15.17:0/2981266847 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c009560 con 0x7fee60100d40 2024-09-13T16:11:58.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.492+0000 7fee5de00640 1 --2- 172.21.15.17:0/2981266847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee60100d40 0x7fee60193ed0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009850 tx=0x7fee4c003cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:58.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.492+0000 7fee57400640 1 -- 172.21.15.17:0/2981266847 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c031910 con 0x7fee60100d40 2024-09-13T16:11:58.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.492+0000 7fee57400640 1 -- 172.21.15.17:0/2981266847 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee4c03c470 con 0x7fee60100d40 2024-09-13T16:11:58.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.492+0000 7fee57400640 1 -- 172.21.15.17:0/2981266847 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c03b630 con 0x7fee60100d40 2024-09-13T16:11:58.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.492+0000 7fee64a00640 1 -- 172.21.15.17:0/2981266847 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee601ac9f0 con 0x7fee60100d40 2024-09-13T16:11:58.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.492+0000 7fee64a00640 1 -- 172.21.15.17:0/2981266847 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee601acea0 con 0x7fee60100d40 2024-09-13T16:11:58.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.497+0000 7fee57400640 1 -- 172.21.15.17:0/2981266847 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fee4c031a70 con 0x7fee60100d40 2024-09-13T16:11:58.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.500+0000 7fee57400640 1 --2- 172.21.15.17:0/2981266847 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fee440a1370 0x7fee440a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:58.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.500+0000 7fee57400640 1 -- 172.21.15.17:0/2981266847 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fee4c0edb70 con 0x7fee60100d40 2024-09-13T16:11:58.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.501+0000 7fee5e800640 1 --2- 172.21.15.17:0/2981266847 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fee440a1370 0x7fee440a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:58.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.501+0000 7fee6824d740 1 Processor -- start 2024-09-13T16:11:58.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.502+0000 7fee6824d740 1 -- start start 2024-09-13T16:11:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.502+0000 7fee6824d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632112f4c80 0x5632112f5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.502+0000 7fee6824d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112f55c0 0x5632112fa080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.502+0000 7fee6824d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112fa650 0x5632112fcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.502+0000 7fee6824d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563211200bb0 con 0x5632112f4c80 2024-09-13T16:11:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.502+0000 7fee6824d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x56321125ea70 con 0x5632112fa650 2024-09-13T16:11:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.502+0000 7fee6824d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x56321125c200 con 0x5632112f55c0 2024-09-13T16:11:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.503+0000 7fee5f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112fa650 0x5632112fcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.503+0000 7fee5f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112fa650 0x5632112fcb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:49118/0 (socket says 172.21.15.17:49118) 2024-09-13T16:11:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.503+0000 7fee5f200640 1 -- 172.21.15.17:0/3829170321 learned_addr learned my addr 172.21.15.17:0/3829170321 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.503+0000 7fee5de00640 1 --2- 172.21.15.17:0/3829170321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112f55c0 0x5632112fa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:58.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.503+0000 7fee5e800640 1 --2- 172.21.15.17:0/2981266847 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fee440a1370 0x7fee440a3830 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fee60100ba0 tx=0x7fee50008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:58.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.503+0000 7fee5f200640 1 -- 172.21.15.17:0/3829170321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112f55c0 msgr2=0x5632112fa080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:58.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.504+0000 7fee5f200640 1 --2- 172.21.15.17:0/3829170321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112f55c0 0x5632112fa080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.504+0000 7fee5f200640 1 -- 172.21.15.17:0/3829170321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632112f4c80 msgr2=0x5632112f5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:58.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.504+0000 7fee5f200640 1 --2- 172.21.15.17:0/3829170321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632112f4c80 0x5632112f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.504+0000 7fee5f200640 1 -- 172.21.15.17:0/3829170321 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632111f9940 con 0x5632112fa650 2024-09-13T16:11:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.504+0000 7fee5de00640 1 --2- 172.21.15.17:0/3829170321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112f55c0 0x5632112fa080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:11:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.504+0000 7fee5f200640 1 --2- 172.21.15.17:0/3829170321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112fa650 0x5632112fcb10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fee58011460 tx=0x7fee58011860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b3a520436d66d92 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.504+0000 7fee4be00640 1 -- 172.21.15.17:0/3829170321 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58012710 con 0x5632112fa650 2024-09-13T16:11:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.504+0000 7fee4be00640 1 -- 172.21.15.17:0/3829170321 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee58012d30 con 0x5632112fa650 2024-09-13T16:11:58.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.505+0000 7fee4be00640 1 -- 172.21.15.17:0/3829170321 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5801adb0 con 0x5632112fa650 2024-09-13T16:11:58.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.506+0000 7fee6824d740 1 -- 172.21.15.17:0/3829170321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112fa650 msgr2=0x5632112fcb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:58.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.506+0000 7fee6824d740 1 --2- 172.21.15.17:0/3829170321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112fa650 0x5632112fcb10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fee58011460 tx=0x7fee58011860 comp rx=0 tx=0).stop 2024-09-13T16:11:58.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.506+0000 7fee6824d740 1 -- 172.21.15.17:0/3829170321 shutdown_connections 2024-09-13T16:11:58.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.506+0000 7fee6824d740 1 --2- 172.21.15.17:0/3829170321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112fa650 0x5632112fcb10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.506+0000 7fee6824d740 1 --2- 172.21.15.17:0/3829170321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112f55c0 0x5632112fa080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.506+0000 7fee6824d740 1 --2- 172.21.15.17:0/3829170321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632112f4c80 0x5632112f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.506+0000 7fee6824d740 1 -- 172.21.15.17:0/3829170321 >> 172.21.15.17:0/3829170321 conn(0x5632112f02f0 msgr2=0x5632112f06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:58.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.506+0000 7fee6824d740 1 -- 172.21.15.17:0/3829170321 shutdown_connections 2024-09-13T16:11:58.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.506+0000 7fee6824d740 1 -- 172.21.15.17:0/3829170321 wait complete. 2024-09-13T16:11:58.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.507+0000 7fee6824d740 1 -- start start 2024-09-13T16:11:58.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.507+0000 7fee6824d740 1 Processor -- start 2024-09-13T16:11:58.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.508+0000 7fee6824d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112f4c80 0x5632112fe8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:58.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.508+0000 7fee6824d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632112f55c0 0x5632112fedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:58.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.508+0000 7fee6824d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112fa650 0x563211305e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:58.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.508+0000 7fee6824d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563211257af0 con 0x5632112f55c0 2024-09-13T16:11:58.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.508+0000 7fee6824d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x563211215f20 con 0x5632112f4c80 2024-09-13T16:11:58.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.508+0000 7fee6824d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x563211215bc0 con 0x5632112fa650 2024-09-13T16:11:58.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.508+0000 7fee6824d740 10 client.0 _ll_register_callbacks cb 0x563211247a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:11:58.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.508+0000 7fee5e800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112f4c80 0x5632112fe8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:58.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.508+0000 7fee5e800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112f4c80 0x5632112fe8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:49120/0 (socket says 172.21.15.17:49120) 2024-09-13T16:11:58.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.508+0000 7fee5e800640 1 -- 172.21.15.17:0/1373100224 learned_addr learned my addr 172.21.15.17:0/1373100224 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:58.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.509+0000 7fee5f200640 1 --2- 172.21.15.17:0/1373100224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112fa650 0x563211305e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:58.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.509+0000 7fee5de00640 1 --2- 172.21.15.17:0/1373100224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632112f55c0 0x5632112fedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:58.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.509+0000 7fee5e800640 1 -- 172.21.15.17:0/1373100224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112fa650 msgr2=0x563211305e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:58.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.509+0000 7fee5e800640 1 --2- 172.21.15.17:0/1373100224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112fa650 0x563211305e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.509+0000 7fee5e800640 1 -- 172.21.15.17:0/1373100224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632112f55c0 msgr2=0x5632112fedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:58.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.509+0000 7fee5e800640 1 --2- 172.21.15.17:0/1373100224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632112f55c0 0x5632112fedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.509+0000 7fee5e800640 1 -- 172.21.15.17:0/1373100224 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee58009c90 con 0x5632112f4c80 2024-09-13T16:11:58.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.509+0000 7fee5de00640 1 --2- 172.21.15.17:0/1373100224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632112f55c0 0x5632112fedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:11:58.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.509+0000 7fee5f200640 1 --2- 172.21.15.17:0/1373100224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112fa650 0x563211305e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:11:58.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.509+0000 7fee5e800640 1 --2- 172.21.15.17:0/1373100224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112f4c80 0x5632112fe8b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fee5000ce10 tx=0x7fee500137d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f621c40e6d221b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:58.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.509+0000 7fee48c00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:11:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.510+0000 7fee48c00640 1 -- 172.21.15.17:0/1373100224 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5001d5f0 con 0x5632112f4c80 2024-09-13T16:11:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.510+0000 7fee48c00640 1 -- 172.21.15.17:0/1373100224 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fee5001d750 con 0x5632112f4c80 2024-09-13T16:11:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.510+0000 7fee6824d740 1 -- 172.21.15.17:0/1373100224 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563211281c90 con 0x5632112f4c80 2024-09-13T16:11:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.511+0000 7fee48c00640 1 -- 172.21.15.17:0/1373100224 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee5001d910 con 0x5632112f4c80 2024-09-13T16:11:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.511+0000 7fee6824d740 10 client.26381 fetch_fsmap learned FSMap version 49 2024-09-13T16:11:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.511+0000 7fee6824d740 1 -- 172.21.15.17:0/1373100224 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x563211256170 con 0x5632112f4c80 2024-09-13T16:11:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.511+0000 7fee48c00640 1 -- 172.21.15.17:0/1373100224 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563211281c90 con 0x5632112f4c80 2024-09-13T16:11:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.511+0000 7fee48c00640 1 -- 172.21.15.17:0/1373100224 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 49) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fee5001c070 con 0x5632112f4c80 2024-09-13T16:11:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.511+0000 7fee6824d740 10 client.26381 fetch_fsmap finished waiting for FSMap version 49 2024-09-13T16:11:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.511+0000 7fee6824d740 10 client.26381 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:11:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.511+0000 7fee6824d740 20 client.26381 populate_metadata read hostname 'smithi017' 2024-09-13T16:11:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.511+0000 7fee6824d740 1 --2- 172.21.15.17:0/1373100224 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56321130a5d0 0x56321130c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.511+0000 7fee6824d740 4 client.26381 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:11:58.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.511+0000 7fee6824d740 1 -- 172.21.15.17:0/1373100224 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56321124a7d0 con 0x56321130a5d0 2024-09-13T16:11:58.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.512+0000 7fee5de00640 1 --2- 172.21.15.17:0/1373100224 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56321130a5d0 0x56321130c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:58.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.512+0000 7fee5de00640 1 --2- 172.21.15.17:0/1373100224 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56321130a5d0 0x56321130c9f0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49a0357543aba4f0 server_cookie=45226477155b3ce9 in_seq=0 out_seq=0 2024-09-13T16:11:58.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.513+0000 7fee48c00640 10 client.26381 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:11:58.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.513+0000 7fee48c00640 1 -- 172.21.15.17:0/1373100224 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56321124a7d0 con 0x56321130a5d0 2024-09-13T16:11:58.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.513+0000 7fee48c00640 10 client.26381 handle_command_reply: tid=0 2024-09-13T16:11:58.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.513+0000 7fee6824d740 1 client.26381 shutdown 2024-09-13T16:11:58.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.514+0000 7fee6824d740 1 -- 172.21.15.17:0/1373100224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112f4c80 msgr2=0x5632112fe8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:58.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.514+0000 7fee6824d740 1 --2- 172.21.15.17:0/1373100224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112f4c80 0x5632112fe8b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fee5000ce10 tx=0x7fee500137d0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.514+0000 7fee6824d740 1 -- 172.21.15.17:0/1373100224 shutdown_connections 2024-09-13T16:11:58.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.514+0000 7fee6824d740 1 --2- 172.21.15.17:0/1373100224 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x56321130a5d0 0x56321130c9f0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.514+0000 7fee6824d740 1 --2- 172.21.15.17:0/1373100224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112fa650 0x563211305e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.514+0000 7fee6824d740 1 --2- 172.21.15.17:0/1373100224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632112f55c0 0x5632112fedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.514+0000 7fee6824d740 1 --2- 172.21.15.17:0/1373100224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112f4c80 0x5632112fe8b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.514+0000 7fee6824d740 1 -- 172.21.15.17:0/1373100224 >> 172.21.15.17:0/1373100224 conn(0x5632112f02f0 msgr2=0x5632112f1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.514+0000 7fee48c00640 0 client.26381 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:11:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.514+0000 7fee6824d740 1 -- 172.21.15.17:0/1373100224 shutdown_connections 2024-09-13T16:11:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.514+0000 7fee6824d740 1 -- 172.21.15.17:0/1373100224 wait complete. 2024-09-13T16:11:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.517+0000 7fee6824d740 20 client.26381 trim_cache size 0 max 16384 2024-09-13T16:11:58.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.561+0000 7fee6824d740 1 Processor -- start 2024-09-13T16:11:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.561+0000 7fee6824d740 1 -- start start 2024-09-13T16:11:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.561+0000 7fee6824d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112f02f0 0x5632112fe660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.561+0000 7fee6824d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632112f4c80 0x563211305d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.561+0000 7fee6824d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112f55c0 0x5632112feba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.561+0000 7fee6824d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563210fbee60 con 0x5632112f4c80 2024-09-13T16:11:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.561+0000 7fee6824d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x563211306fb0 con 0x5632112f02f0 2024-09-13T16:11:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.561+0000 7fee6824d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632112f5aa0 con 0x5632112f55c0 2024-09-13T16:11:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.562+0000 7fee5f200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112f55c0 0x5632112feba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.562+0000 7fee5f200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112f55c0 0x5632112feba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:57568/0 (socket says 172.21.15.17:57568) 2024-09-13T16:11:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.562+0000 7fee5f200640 1 -- 172.21.15.17:0/2874885983 learned_addr learned my addr 172.21.15.17:0/2874885983 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.562+0000 7fee5de00640 1 --2- 172.21.15.17:0/2874885983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632112f4c80 0x563211305d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.562+0000 7fee5f200640 1 -- 172.21.15.17:0/2874885983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112f02f0 msgr2=0x5632112fe660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:11:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.563+0000 7fee5f200640 1 --2- 172.21.15.17:0/2874885983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112f02f0 0x5632112fe660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.563+0000 7fee5f200640 1 -- 172.21.15.17:0/2874885983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632112f4c80 msgr2=0x563211305d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.563+0000 7fee5f200640 1 --2- 172.21.15.17:0/2874885983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632112f4c80 0x563211305d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.563+0000 7fee5f200640 1 -- 172.21.15.17:0/2874885983 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632111f8180 con 0x5632112f55c0 2024-09-13T16:11:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.563+0000 7fee5f200640 1 --2- 172.21.15.17:0/2874885983 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112f55c0 0x5632112feba0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fee58012010 tx=0x7fee58005c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b489d7e6b979c7b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.563+0000 7fee54c00640 1 -- 172.21.15.17:0/2874885983 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58004d00 con 0x5632112f55c0 2024-09-13T16:11:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.564+0000 7fee54c00640 1 -- 172.21.15.17:0/2874885983 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee58004e60 con 0x5632112f55c0 2024-09-13T16:11:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.564+0000 7fee54c00640 1 -- 172.21.15.17:0/2874885983 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58004d00 con 0x5632112f55c0 2024-09-13T16:11:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.565+0000 7fee6824d740 1 -- 172.21.15.17:0/2874885983 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112f55c0 msgr2=0x5632112feba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.565+0000 7fee6824d740 1 --2- 172.21.15.17:0/2874885983 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112f55c0 0x5632112feba0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fee58012010 tx=0x7fee58005c80 comp rx=0 tx=0).stop 2024-09-13T16:11:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.565+0000 7fee6824d740 1 -- 172.21.15.17:0/2874885983 shutdown_connections 2024-09-13T16:11:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.565+0000 7fee6824d740 1 --2- 172.21.15.17:0/2874885983 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112f55c0 0x5632112feba0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.565+0000 7fee6824d740 1 --2- 172.21.15.17:0/2874885983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632112f4c80 0x563211305d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.565+0000 7fee6824d740 1 --2- 172.21.15.17:0/2874885983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112f02f0 0x5632112fe660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.565+0000 7fee6824d740 1 -- 172.21.15.17:0/2874885983 >> 172.21.15.17:0/2874885983 conn(0x5632112fcc70 msgr2=0x5632112f6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.565+0000 7fee6824d740 1 -- 172.21.15.17:0/2874885983 shutdown_connections 2024-09-13T16:11:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.565+0000 7fee6824d740 1 -- 172.21.15.17:0/2874885983 wait complete. 2024-09-13T16:11:58.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.566+0000 7fee6824d740 1 -- start start 2024-09-13T16:11:58.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.566+0000 7fee6824d740 1 Processor -- start 2024-09-13T16:11:58.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.567+0000 7fee6824d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632112f02f0 0x563211302810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:58.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.568+0000 7fee6824d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112f4c80 0x563211302d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:58.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.568+0000 7fee6824d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112f55c0 0x563211360b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:58.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.568+0000 7fee5f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112f55c0 0x563211360b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:58.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.568+0000 7fee5f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112f55c0 0x563211360b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:49130/0 (socket says 172.21.15.17:49130) 2024-09-13T16:11:58.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.568+0000 7fee5f200640 1 -- 172.21.15.17:0/4182201166 learned_addr learned my addr 172.21.15.17:0/4182201166 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:11:58.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.568+0000 7fee5de00640 1 --2- 172.21.15.17:0/4182201166 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112f4c80 0x563211302d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:58.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.569+0000 7fee6824d740 1 -- 172.21.15.17:0/4182201166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563211305d70 con 0x5632112f02f0 2024-09-13T16:11:58.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.569+0000 7fee6824d740 1 -- 172.21.15.17:0/4182201166 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x563211305ee0 con 0x5632112f55c0 2024-09-13T16:11:58.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.569+0000 7fee6824d740 1 -- 172.21.15.17:0/4182201166 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632113060a0 con 0x5632112f4c80 2024-09-13T16:11:58.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.569+0000 7fee6824d740 10 client.0 _ll_register_callbacks cb 0x7fee58009ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:11:58.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.570+0000 7fee5f200640 1 -- 172.21.15.17:0/4182201166 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112f4c80 msgr2=0x563211302d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:58.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.570+0000 7fee5f200640 1 --2- 172.21.15.17:0/4182201166 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112f4c80 0x563211302d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.570+0000 7fee5f200640 1 -- 172.21.15.17:0/4182201166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632112f02f0 msgr2=0x563211302810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:11:58.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.570+0000 7fee5f200640 1 --2- 172.21.15.17:0/4182201166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632112f02f0 0x563211302810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.570+0000 7fee5f200640 1 -- 172.21.15.17:0/4182201166 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5632111f9940 con 0x5632112f55c0 2024-09-13T16:11:58.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.571+0000 7fee48c00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:11:58.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.571+0000 7fee5f200640 1 --2- 172.21.15.17:0/4182201166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112f55c0 0x563211360b00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fee58009830 tx=0x7fee580056e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae6719782bd884c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:11:58.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.571+0000 7fee48c00640 1 -- 172.21.15.17:0/4182201166 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58033070 con 0x5632112f55c0 2024-09-13T16:11:58.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.572+0000 7fee48c00640 1 -- 172.21.15.17:0/4182201166 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fee580051c0 con 0x5632112f55c0 2024-09-13T16:11:58.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.572+0000 7fee6824d740 1 -- 172.21.15.17:0/4182201166 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fee58012d30 con 0x5632112f55c0 2024-09-13T16:11:58.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.572+0000 7fee48c00640 1 -- 172.21.15.17:0/4182201166 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee58012510 con 0x5632112f55c0 2024-09-13T16:11:58.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.572+0000 7fee6824d740 10 client.26384 fetch_fsmap learned FSMap version 49 2024-09-13T16:11:58.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.572+0000 7fee6824d740 1 -- 172.21.15.17:0/4182201166 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x56321121d560 con 0x5632112f55c0 2024-09-13T16:11:58.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.573+0000 7fee48c00640 1 -- 172.21.15.17:0/4182201166 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee58012d30 con 0x5632112f55c0 2024-09-13T16:11:58.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.573+0000 7fee48c00640 1 -- 172.21.15.17:0/4182201166 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 49) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fee58022050 con 0x5632112f55c0 2024-09-13T16:11:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.573+0000 7fee6824d740 10 client.26384 fetch_fsmap finished waiting for FSMap version 49 2024-09-13T16:11:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.573+0000 7fee6824d740 10 client.26384 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:11:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.573+0000 7fee6824d740 20 client.26384 populate_metadata read hostname 'smithi017' 2024-09-13T16:11:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.573+0000 7fee6824d740 1 --2- 172.21.15.17:0/4182201166 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5632112fa650 0x5632113642d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:11:58.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.573+0000 7fee6824d740 4 client.26384 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:11:58.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.573+0000 7fee6824d740 1 -- 172.21.15.17:0/4182201166 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563210f4b300 con 0x5632112fa650 2024-09-13T16:11:58.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.574+0000 7fee5e800640 1 --2- 172.21.15.17:0/4182201166 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5632112fa650 0x5632113642d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:11:58.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.574+0000 7fee5e800640 1 --2- 172.21.15.17:0/4182201166 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5632112fa650 0x5632113642d0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac21df5f171aec37 server_cookie=3547a4190faef42d in_seq=0 out_seq=0 2024-09-13T16:11:58.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.575+0000 7fee48c00640 10 client.26384 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:11:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.592+0000 7fee48c00640 1 -- 172.21.15.17:0/4182201166 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563210f4b300 con 0x5632112fa650 2024-09-13T16:11:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.592+0000 7fee48c00640 10 client.26384 handle_command_reply: tid=0 2024-09-13T16:11:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.592+0000 7fee6824d740 1 client.26384 shutdown 2024-09-13T16:11:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.593+0000 7fee6824d740 1 -- 172.21.15.17:0/4182201166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112f55c0 msgr2=0x563211360b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.593+0000 7fee6824d740 1 --2- 172.21.15.17:0/4182201166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112f55c0 0x563211360b00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fee58009830 tx=0x7fee580056e0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.593+0000 7fee6824d740 1 -- 172.21.15.17:0/4182201166 shutdown_connections 2024-09-13T16:11:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.593+0000 7fee6824d740 1 --2- 172.21.15.17:0/4182201166 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x5632112fa650 0x5632113642d0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.593+0000 7fee6824d740 1 --2- 172.21.15.17:0/4182201166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5632112f55c0 0x563211360b00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.593+0000 7fee6824d740 1 --2- 172.21.15.17:0/4182201166 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5632112f4c80 0x563211302d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.593+0000 7fee6824d740 1 --2- 172.21.15.17:0/4182201166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632112f02f0 0x563211302810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.593+0000 7fee6824d740 1 -- 172.21.15.17:0/4182201166 >> 172.21.15.17:0/4182201166 conn(0x5632112fcc70 msgr2=0x5632112fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.593+0000 7fee48c00640 0 client.26384 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:11:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.593+0000 7fee6824d740 1 -- 172.21.15.17:0/4182201166 shutdown_connections 2024-09-13T16:11:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.593+0000 7fee6824d740 1 -- 172.21.15.17:0/4182201166 wait complete. 2024-09-13T16:11:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.594+0000 7fee6824d740 20 client.26384 trim_cache size 0 max 16384 2024-09-13T16:11:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:11:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:11:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:11:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:11:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.595+0000 7fee64a00640 1 -- 172.21.15.17:0/2981266847 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fee440a1370 msgr2=0x7fee440a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.595+0000 7fee64a00640 1 --2- 172.21.15.17:0/2981266847 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fee440a1370 0x7fee440a3830 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fee60100ba0 tx=0x7fee50008040 comp rx=0 tx=0).stop 2024-09-13T16:11:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.595+0000 7fee64a00640 1 -- 172.21.15.17:0/2981266847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee60100d40 msgr2=0x7fee60193ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:11:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.595+0000 7fee64a00640 1 --2- 172.21.15.17:0/2981266847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee60100d40 0x7fee60193ed0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009850 tx=0x7fee4c003cd0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.595+0000 7fee64a00640 1 -- 172.21.15.17:0/2981266847 shutdown_connections 2024-09-13T16:11:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.595+0000 7fee64a00640 1 --2- 172.21.15.17:0/2981266847 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fee440a1370 0x7fee440a3830 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.595+0000 7fee64a00640 1 --2- 172.21.15.17:0/2981266847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee60101700 0x7fee6019aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.595+0000 7fee64a00640 1 --2- 172.21.15.17:0/2981266847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee60100d40 0x7fee60193ed0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.595+0000 7fee64a00640 1 --2- 172.21.15.17:0/2981266847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee600ffb50 0x7fee60193990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:11:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.596+0000 7fee64a00640 1 -- 172.21.15.17:0/2981266847 >> 172.21.15.17:0/2981266847 conn(0x7fee600fb2f0 msgr2=0x7fee600fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:11:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.596+0000 7fee64a00640 1 -- 172.21.15.17:0/2981266847 shutdown_connections 2024-09-13T16:11:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:11:58.596+0000 7fee64a00640 1 -- 172.21.15.17:0/2981266847 wait complete. 2024-09-13T16:12:00.256 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:59 smithi193 ceph-mon[35248]: pgmap v812: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 423 op/s 2024-09-13T16:12:00.256 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:11:59 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:12:00.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:59 smithi017 ceph-mon[30494]: pgmap v812: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 423 op/s 2024-09-13T16:12:00.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:11:59 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:12:00.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 855.0 s, 536.6 tps, lat 190.205 ms stddev 208.431 2024-09-13T16:12:00.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:59 smithi189 ceph-mon[34790]: pgmap v812: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 423 op/s 2024-09-13T16:12:00.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:11:59 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:12:02.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:01 smithi193 ceph-mon[35248]: pgmap v813: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 526 op/s 2024-09-13T16:12:02.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:01 smithi017 ceph-mon[30494]: pgmap v813: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 526 op/s 2024-09-13T16:12:02.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:01 smithi189 ceph-mon[34790]: pgmap v813: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 526 op/s 2024-09-13T16:12:04.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:03 smithi193 ceph-mon[35248]: pgmap v814: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.3 MiB/s wr, 488 op/s 2024-09-13T16:12:04.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:03 smithi017 ceph-mon[30494]: pgmap v814: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.3 MiB/s wr, 488 op/s 2024-09-13T16:12:04.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:03 smithi189 ceph-mon[34790]: pgmap v814: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.3 MiB/s wr, 488 op/s 2024-09-13T16:12:05.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 860.0 s, 559.6 tps, lat 182.160 ms stddev 294.128 2024-09-13T16:12:06.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:05 smithi193 ceph-mon[35248]: pgmap v815: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.2 MiB/s wr, 479 op/s 2024-09-13T16:12:06.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:05 smithi017 ceph-mon[30494]: pgmap v815: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.2 MiB/s wr, 479 op/s 2024-09-13T16:12:06.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:05 smithi189 ceph-mon[34790]: pgmap v815: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.2 MiB/s wr, 479 op/s 2024-09-13T16:12:08.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:07 smithi193 ceph-mon[35248]: pgmap v816: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.7 MiB/s wr, 527 op/s 2024-09-13T16:12:08.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:07 smithi017 ceph-mon[30494]: pgmap v816: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.7 MiB/s wr, 527 op/s 2024-09-13T16:12:08.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:07 smithi189 ceph-mon[34790]: pgmap v816: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.7 MiB/s wr, 527 op/s 2024-09-13T16:12:10.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:09 smithi193 ceph-mon[35248]: pgmap v817: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 474 op/s 2024-09-13T16:12:10.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:09 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:12:10.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:09 smithi017 ceph-mon[30494]: pgmap v817: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 474 op/s 2024-09-13T16:12:10.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:09 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:12:10.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 865.0 s, 511.0 tps, lat 188.557 ms stddev 192.034 2024-09-13T16:12:10.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:09 smithi189 ceph-mon[34790]: pgmap v817: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 474 op/s 2024-09-13T16:12:10.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:09 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:12:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.789+0000 7fb9ed200640 1 -- 172.21.15.17:0/1635969416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9e8101f20 msgr2=0x7fb9e8102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.789+0000 7fb9ed200640 1 --2- 172.21.15.17:0/1635969416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9e8101f20 0x7fb9e8102320 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009900 tx=0x7fb9d802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.789+0000 7fb9ed200640 1 -- 172.21.15.17:0/1635969416 shutdown_connections 2024-09-13T16:12:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.789+0000 7fb9ed200640 1 --2- 172.21.15.17:0/1635969416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e8103a30 0x7fb9e810a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.789+0000 7fb9ed200640 1 --2- 172.21.15.17:0/1635969416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9e8103070 0x7fb9e81034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.789+0000 7fb9ed200640 1 --2- 172.21.15.17:0/1635969416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9e8101f20 0x7fb9e8102320 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.789+0000 7fb9ed200640 1 -- 172.21.15.17:0/1635969416 >> 172.21.15.17:0/1635969416 conn(0x7fb9e80fd680 msgr2=0x7fb9e80ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.789+0000 7fb9ed200640 1 -- 172.21.15.17:0/1635969416 shutdown_connections 2024-09-13T16:12:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.789+0000 7fb9ed200640 1 -- 172.21.15.17:0/1635969416 wait complete. 2024-09-13T16:12:11.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.790+0000 7fb9ed200640 1 Processor -- start 2024-09-13T16:12:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.790+0000 7fb9ed200640 1 -- start start 2024-09-13T16:12:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.791+0000 7fb9ed200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9e8101f20 0x7fb9e819c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.791+0000 7fb9ed200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e8103070 0x7fb9e819c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.791+0000 7fb9ed200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9e8103a30 0x7fb9e81a38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.791+0000 7fb9ed200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e81a3e10 con 0x7fb9e8103070 2024-09-13T16:12:11.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.791+0000 7fb9ed200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e8069f00 con 0x7fb9e8101f20 2024-09-13T16:12:11.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.791+0000 7fb9ed200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e806a0c0 con 0x7fb9e8103a30 2024-09-13T16:12:11.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.791+0000 7fb9e6800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9e8103a30 0x7fb9e81a38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:11.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.792+0000 7fb9e5e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9e8101f20 0x7fb9e819c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:11.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.792+0000 7fb9dfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e8103070 0x7fb9e819c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:11.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.792+0000 7fb9e5e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9e8101f20 0x7fb9e819c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:32810/0 (socket says 172.21.15.17:32810) 2024-09-13T16:12:11.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.792+0000 7fb9e5e00640 1 -- 172.21.15.17:0/3030280645 learned_addr learned my addr 172.21.15.17:0/3030280645 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:11.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.792+0000 7fb9e5e00640 1 -- 172.21.15.17:0/3030280645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9e8103a30 msgr2=0x7fb9e81a38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:11.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.792+0000 7fb9e5e00640 1 --2- 172.21.15.17:0/3030280645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9e8103a30 0x7fb9e81a38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.792+0000 7fb9e5e00640 1 -- 172.21.15.17:0/3030280645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e8103070 msgr2=0x7fb9e819c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.792+0000 7fb9e5e00640 1 --2- 172.21.15.17:0/3030280645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e8103070 0x7fb9e819c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.792+0000 7fb9e5e00640 1 -- 172.21.15.17:0/3030280645 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d8009560 con 0x7fb9e8101f20 2024-09-13T16:12:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.793+0000 7fb9e5e00640 1 --2- 172.21.15.17:0/3030280645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9e8101f20 0x7fb9e819c320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8031500 tx=0x7fb9d80055a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.794+0000 7fb9dea00640 1 -- 172.21.15.17:0/3030280645 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8004b50 con 0x7fb9e8101f20 2024-09-13T16:12:11.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.794+0000 7fb9dea00640 1 -- 172.21.15.17:0/3030280645 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9d8004cb0 con 0x7fb9e8101f20 2024-09-13T16:12:11.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.794+0000 7fb9dea00640 1 -- 172.21.15.17:0/3030280645 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8031a60 con 0x7fb9e8101f20 2024-09-13T16:12:11.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.794+0000 7fb9ed200640 1 -- 172.21.15.17:0/3030280645 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e806a340 con 0x7fb9e8101f20 2024-09-13T16:12:11.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.795+0000 7fb9ed200640 1 -- 172.21.15.17:0/3030280645 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e806a740 con 0x7fb9e8101f20 2024-09-13T16:12:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.799+0000 7fb9dea00640 1 -- 172.21.15.17:0/3030280645 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb9d8031bc0 con 0x7fb9e8101f20 2024-09-13T16:12:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.799+0000 7fb9f00c3740 1 Processor -- start 2024-09-13T16:12:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.799+0000 7fb9f00c3740 1 -- start start 2024-09-13T16:12:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.800+0000 7fb9f00c3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c99a70 0x561d31c99e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.800+0000 7fb9f00c3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c9a3b0 0x561d31c9ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.800+0000 7fb9f00c3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d31c9f440 0x561d31ca1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.800+0000 7fb9f00c3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d31ba5bb0 con 0x561d31c9f440 2024-09-13T16:12:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.800+0000 7fb9f00c3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d31c03a70 con 0x561d31c99a70 2024-09-13T16:12:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.800+0000 7fb9f00c3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d31c01200 con 0x561d31c9a3b0 2024-09-13T16:12:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.800+0000 7fb9e6800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c99a70 0x561d31c99e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.800+0000 7fb9e6800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c99a70 0x561d31c99e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:32826/0 (socket says 172.21.15.17:32826) 2024-09-13T16:12:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.800+0000 7fb9e6800640 1 -- 172.21.15.17:0/1054856043 learned_addr learned my addr 172.21.15.17:0/1054856043 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.800+0000 7fb9dfe00640 1 --2- 172.21.15.17:0/1054856043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d31c9f440 0x561d31ca1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.800+0000 7fb9e5e00640 1 --2- 172.21.15.17:0/1054856043 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c9a3b0 0x561d31c9ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.800+0000 7fb9e6800640 1 -- 172.21.15.17:0/1054856043 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c9a3b0 msgr2=0x561d31c9ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.800+0000 7fb9e6800640 1 --2- 172.21.15.17:0/1054856043 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c9a3b0 0x561d31c9ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.800+0000 7fb9e6800640 1 -- 172.21.15.17:0/1054856043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d31c9f440 msgr2=0x561d31ca1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.800+0000 7fb9e6800640 1 --2- 172.21.15.17:0/1054856043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d31c9f440 0x561d31ca1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.800+0000 7fb9e6800640 1 -- 172.21.15.17:0/1054856043 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d31b9e940 con 0x561d31c99a70 2024-09-13T16:12:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.801+0000 7fb9dea00640 1 --2- 172.21.15.17:0/3030280645 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb9cc0a1260 0x7fb9cc0a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.801+0000 7fb9e6800640 1 --2- 172.21.15.17:0/1054856043 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c99a70 0x561d31c99e70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009fd0 tx=0x7fb9e00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=328e01114798fab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:11.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.801+0000 7fb9d7400640 1 -- 172.21.15.17:0/1054856043 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0004d20 con 0x561d31c99a70 2024-09-13T16:12:11.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.801+0000 7fb9e5e00640 1 --2- 172.21.15.17:0/3030280645 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb9cc0a1260 0x7fb9cc0a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:11.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.801+0000 7fb9d7400640 1 -- 172.21.15.17:0/1054856043 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9e0004e80 con 0x561d31c99a70 2024-09-13T16:12:11.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.801+0000 7fb9d7400640 1 -- 172.21.15.17:0/1054856043 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0005020 con 0x561d31c99a70 2024-09-13T16:12:11.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.801+0000 7fb9dea00640 1 -- 172.21.15.17:0/3030280645 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fb9d80eda60 con 0x7fb9e8101f20 2024-09-13T16:12:11.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.802+0000 7fb9f00c3740 1 -- 172.21.15.17:0/1054856043 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c99a70 msgr2=0x561d31c99e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:11.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.802+0000 7fb9f00c3740 1 --2- 172.21.15.17:0/1054856043 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c99a70 0x561d31c99e70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009fd0 tx=0x7fb9e00118d0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.802+0000 7fb9e5e00640 1 --2- 172.21.15.17:0/3030280645 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb9cc0a1260 0x7fb9cc0a3720 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009a20 tx=0x7fb9d80f3530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:11.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.802+0000 7fb9f00c3740 1 -- 172.21.15.17:0/1054856043 shutdown_connections 2024-09-13T16:12:11.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.802+0000 7fb9f00c3740 1 --2- 172.21.15.17:0/1054856043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d31c9f440 0x561d31ca1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.802+0000 7fb9f00c3740 1 --2- 172.21.15.17:0/1054856043 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c9a3b0 0x561d31c9ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.802+0000 7fb9f00c3740 1 --2- 172.21.15.17:0/1054856043 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c99a70 0x561d31c99e70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.802+0000 7fb9f00c3740 1 -- 172.21.15.17:0/1054856043 >> 172.21.15.17:0/1054856043 conn(0x561d31c950e0 msgr2=0x561d31c954e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:11.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.802+0000 7fb9f00c3740 1 -- 172.21.15.17:0/1054856043 shutdown_connections 2024-09-13T16:12:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.803+0000 7fb9f00c3740 1 -- 172.21.15.17:0/1054856043 wait complete. 2024-09-13T16:12:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.803+0000 7fb9f00c3740 1 -- start start 2024-09-13T16:12:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.805+0000 7fb9f00c3740 1 Processor -- start 2024-09-13T16:12:11.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.808+0000 7fb9f00c3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c99a70 0x561d31ca3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:11.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.808+0000 7fb9f00c3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c9a3b0 0x561d31ca3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:11.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.808+0000 7fb9f00c3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d31c9f440 0x561d31caacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:11.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.808+0000 7fb9f00c3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d31bfcaf0 con 0x561d31c9f440 2024-09-13T16:12:11.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.808+0000 7fb9f00c3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d31bbaf20 con 0x561d31c9a3b0 2024-09-13T16:12:11.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.808+0000 7fb9f00c3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d31bbabc0 con 0x561d31c99a70 2024-09-13T16:12:11.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.808+0000 7fb9f00c3740 10 client.0 _ll_register_callbacks cb 0x561d31beca70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:12:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.810+0000 7fb9e6800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c99a70 0x561d31ca3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.810+0000 7fb9e6800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c99a70 0x561d31ca3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:40620/0 (socket says 172.21.15.17:40620) 2024-09-13T16:12:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.810+0000 7fb9e6800640 1 -- 172.21.15.17:0/3140407544 learned_addr learned my addr 172.21.15.17:0/3140407544 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.813+0000 7fb9dfe00640 1 --2- 172.21.15.17:0/3140407544 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c9a3b0 0x561d31ca3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.816+0000 7fb9e6800640 1 -- 172.21.15.17:0/3140407544 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c9a3b0 msgr2=0x561d31ca3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.816+0000 7fb9e6800640 1 --2- 172.21.15.17:0/3140407544 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c9a3b0 0x561d31ca3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.816+0000 7fb9e6800640 1 -- 172.21.15.17:0/3140407544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d31c9f440 msgr2=0x561d31caacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.816+0000 7fb9e6800640 1 --2- 172.21.15.17:0/3140407544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d31c9f440 0x561d31caacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.816+0000 7fb9e6800640 1 -- 172.21.15.17:0/3140407544 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e0009c80 con 0x561d31c99a70 2024-09-13T16:12:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.816+0000 7fb9dfe00640 1 --2- 172.21.15.17:0/3140407544 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c9a3b0 0x561d31ca3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:12:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.816+0000 7fb9e6800640 1 --2- 172.21.15.17:0/3140407544 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c99a70 0x561d31ca3740 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00049a0 tx=0x7fb9e0004050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c35b5cbab8df9649 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.817+0000 7fb9cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:12:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.817+0000 7fb9cbe00640 1 -- 172.21.15.17:0/3140407544 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0003c30 con 0x561d31c99a70 2024-09-13T16:12:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.817+0000 7fb9f00c3740 1 -- 172.21.15.17:0/3140407544 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d31bef7d0 con 0x561d31c99a70 2024-09-13T16:12:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.817+0000 7fb9cbe00640 1 -- 172.21.15.17:0/3140407544 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fb9e0003d90 con 0x561d31c99a70 2024-09-13T16:12:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.818+0000 7fb9cbe00640 1 -- 172.21.15.17:0/3140407544 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9e002f730 con 0x561d31c99a70 2024-09-13T16:12:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.818+0000 7fb9f00c3740 10 client.26431 fetch_fsmap learned FSMap version 51 2024-09-13T16:12:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.818+0000 7fb9f00c3740 1 -- 172.21.15.17:0/3140407544 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x561d31bfb170 con 0x561d31c99a70 2024-09-13T16:12:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.819+0000 7fb9cbe00640 1 -- 172.21.15.17:0/3140407544 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561d31bef7d0 con 0x561d31c99a70 2024-09-13T16:12:11.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.819+0000 7fb9cbe00640 1 -- 172.21.15.17:0/3140407544 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 51) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb9e000fa30 con 0x561d31c99a70 2024-09-13T16:12:11.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.821+0000 7fb9f00c3740 10 client.26431 fetch_fsmap finished waiting for FSMap version 51 2024-09-13T16:12:11.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.821+0000 7fb9f00c3740 10 client.26431 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:12:11.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.822+0000 7fb9f00c3740 20 client.26431 populate_metadata read hostname 'smithi017' 2024-09-13T16:12:11.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.822+0000 7fb9f00c3740 1 --2- 172.21.15.17:0/3140407544 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x561d31caf320 0x561d31cb1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.822+0000 7fb9f00c3740 4 client.26431 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:12:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.822+0000 7fb9f00c3740 1 -- 172.21.15.17:0/3140407544 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d318f0300 con 0x561d31caf320 2024-09-13T16:12:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.822+0000 7fb9dfe00640 1 --2- 172.21.15.17:0/3140407544 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x561d31caf320 0x561d31cb1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.823+0000 7fb9dfe00640 1 --2- 172.21.15.17:0/3140407544 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x561d31caf320 0x561d31cb1740 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9204854705843cd8 server_cookie=b20cac2bf3c70c8b in_seq=0 out_seq=0 2024-09-13T16:12:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.823+0000 7fb9cbe00640 10 client.26431 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:12:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.826+0000 7fb9cbe00640 1 -- 172.21.15.17:0/3140407544 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561d318f0300 con 0x561d31caf320 2024-09-13T16:12:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.826+0000 7fb9cbe00640 10 client.26431 handle_command_reply: tid=0 2024-09-13T16:12:11.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.826+0000 7fb9f00c3740 1 client.26431 shutdown 2024-09-13T16:12:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.827+0000 7fb9f00c3740 1 -- 172.21.15.17:0/3140407544 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c99a70 msgr2=0x561d31ca3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.827+0000 7fb9f00c3740 1 --2- 172.21.15.17:0/3140407544 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c99a70 0x561d31ca3740 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00049a0 tx=0x7fb9e0004050 comp rx=0 tx=0).stop 2024-09-13T16:12:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.827+0000 7fb9f00c3740 1 -- 172.21.15.17:0/3140407544 shutdown_connections 2024-09-13T16:12:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.827+0000 7fb9f00c3740 1 --2- 172.21.15.17:0/3140407544 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x561d31caf320 0x561d31cb1740 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.827+0000 7fb9f00c3740 1 --2- 172.21.15.17:0/3140407544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d31c9f440 0x561d31caacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.827+0000 7fb9f00c3740 1 --2- 172.21.15.17:0/3140407544 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c9a3b0 0x561d31ca3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.827+0000 7fb9cbe00640 0 client.26431 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:12:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.827+0000 7fb9f00c3740 1 --2- 172.21.15.17:0/3140407544 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c99a70 0x561d31ca3740 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.828+0000 7fb9f00c3740 1 -- 172.21.15.17:0/3140407544 >> 172.21.15.17:0/3140407544 conn(0x561d31c950e0 msgr2=0x561d31c968f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.828+0000 7fb9f00c3740 1 -- 172.21.15.17:0/3140407544 shutdown_connections 2024-09-13T16:12:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.828+0000 7fb9f00c3740 1 -- 172.21.15.17:0/3140407544 wait complete. 2024-09-13T16:12:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.829+0000 7fb9f00c3740 20 client.26431 trim_cache size 0 max 16384 2024-09-13T16:12:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.855+0000 7fb9f00c3740 1 Processor -- start 2024-09-13T16:12:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.855+0000 7fb9f00c3740 1 -- start start 2024-09-13T16:12:11.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.856+0000 7fb9f00c3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d31c99a70 0x561d31c9b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.856+0000 7fb9f00c3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c9a3b0 0x561d31c9b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.856+0000 7fb9f00c3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c9f440 0x561d31caac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.856+0000 7fb9f00c3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d31963e60 con 0x561d31c99a70 2024-09-13T16:12:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.856+0000 7fb9f00c3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d31ca3280 con 0x561d31c9f440 2024-09-13T16:12:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.856+0000 7fb9f00c3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d31c90c60 con 0x561d31c9a3b0 2024-09-13T16:12:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.857+0000 7fb9e6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d31c99a70 0x561d31c9b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.857+0000 7fb9dfe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c9a3b0 0x561d31c9b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.857+0000 7fb9dfe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c9a3b0 0x561d31c9b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:40632/0 (socket says 172.21.15.17:40632) 2024-09-13T16:12:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.857+0000 7fb9dfe00640 1 -- 172.21.15.17:0/1661622250 learned_addr learned my addr 172.21.15.17:0/1661622250 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.858+0000 7fb9e6800640 1 -- 172.21.15.17:0/1661622250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c9a3b0 msgr2=0x561d31c9b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.858+0000 7fb9e6800640 1 --2- 172.21.15.17:0/1661622250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c9a3b0 0x561d31c9b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.858+0000 7fb9e6800640 1 -- 172.21.15.17:0/1661622250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c9f440 msgr2=0x561d31caac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.858+0000 7fb9e6800640 1 --2- 172.21.15.17:0/1661622250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c9f440 0x561d31caac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.858+0000 7fb9e6800640 1 -- 172.21.15.17:0/1661622250 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d31b9d180 con 0x561d31c99a70 2024-09-13T16:12:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.861+0000 7fb9e6800640 1 --2- 172.21.15.17:0/1661622250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d31c99a70 0x561d31c9b370 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0005020 tx=0x7fb9e0004850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd53483a5821ef4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.861+0000 7fb9d7e00640 1 -- 172.21.15.17:0/1661622250 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e00040c0 con 0x561d31c99a70 2024-09-13T16:12:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.861+0000 7fb9d7e00640 1 -- 172.21.15.17:0/1661622250 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9e0011dd0 con 0x561d31c99a70 2024-09-13T16:12:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.861+0000 7fb9d7e00640 1 -- 172.21.15.17:0/1661622250 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0003ea0 con 0x561d31c99a70 2024-09-13T16:12:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.862+0000 7fb9f00c3740 1 -- 172.21.15.17:0/1661622250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d31c99a70 msgr2=0x561d31c9b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.863+0000 7fb9f00c3740 1 --2- 172.21.15.17:0/1661622250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d31c99a70 0x561d31c9b370 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0005020 tx=0x7fb9e0004850 comp rx=0 tx=0).stop 2024-09-13T16:12:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.863+0000 7fb9f00c3740 1 -- 172.21.15.17:0/1661622250 shutdown_connections 2024-09-13T16:12:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.863+0000 7fb9f00c3740 1 --2- 172.21.15.17:0/1661622250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c9f440 0x561d31caac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.863+0000 7fb9f00c3740 1 --2- 172.21.15.17:0/1661622250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c9a3b0 0x561d31c9b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.863+0000 7fb9f00c3740 1 --2- 172.21.15.17:0/1661622250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d31c99a70 0x561d31c9b370 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.863+0000 7fb9f00c3740 1 -- 172.21.15.17:0/1661622250 >> 172.21.15.17:0/1661622250 conn(0x561d31c950e0 msgr2=0x561d31c9e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.863+0000 7fb9f00c3740 1 -- 172.21.15.17:0/1661622250 shutdown_connections 2024-09-13T16:12:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.863+0000 7fb9f00c3740 1 -- 172.21.15.17:0/1661622250 wait complete. 2024-09-13T16:12:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.864+0000 7fb9f00c3740 1 -- start start 2024-09-13T16:12:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.864+0000 7fb9f00c3740 1 Processor -- start 2024-09-13T16:12:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.866+0000 7fb9f00c3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c99a70 0x561d31ca8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.867+0000 7fb9f00c3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d31c9a3b0 0x561d31ca8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.867+0000 7fb9f00c3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c9f440 0x561d31ca9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.867+0000 7fb9f00c3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d31caa3a0 con 0x561d31c9a3b0 2024-09-13T16:12:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.867+0000 7fb9f00c3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d31caa510 con 0x561d31c99a70 2024-09-13T16:12:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.867+0000 7fb9f00c3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d31caa6d0 con 0x561d31c9f440 2024-09-13T16:12:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.867+0000 7fb9f00c3740 10 client.0 _ll_register_callbacks cb 0x7fb9e0009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:12:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.867+0000 7fb9e6800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c99a70 0x561d31ca8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.867+0000 7fb9e6800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c99a70 0x561d31ca8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:32848/0 (socket says 172.21.15.17:32848) 2024-09-13T16:12:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.867+0000 7fb9e6800640 1 -- 172.21.15.17:0/619439082 learned_addr learned my addr 172.21.15.17:0/619439082 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.868+0000 7fb9e6800640 1 --2- 172.21.15.17:0/619439082 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c9f440 0x561d31ca9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:11.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.869+0000 7fb9e6800640 1 -- 172.21.15.17:0/619439082 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c9f440 msgr2=0x561d31ca9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:11.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.869+0000 7fb9e6800640 1 --2- 172.21.15.17:0/619439082 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c9f440 0x561d31ca9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.869+0000 7fb9e6800640 1 -- 172.21.15.17:0/619439082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d31c9a3b0 msgr2=0x561d31ca8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:11.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.869+0000 7fb9e6800640 1 --2- 172.21.15.17:0/619439082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d31c9a3b0 0x561d31ca8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:11.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.869+0000 7fb9e6800640 1 -- 172.21.15.17:0/619439082 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561d31bfb170 con 0x561d31c99a70 2024-09-13T16:12:11.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.869+0000 7fb9e6800640 1 --2- 172.21.15.17:0/619439082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c99a70 0x561d31ca8910 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb9e000fdc0 tx=0x7fb9e0030040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b051102472d4ab8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:11.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.869+0000 7fb9cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:12:11.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.870+0000 7fb9cbe00640 1 -- 172.21.15.17:0/619439082 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0003c20 con 0x561d31c99a70 2024-09-13T16:12:11.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.870+0000 7fb9f00c3740 1 -- 172.21.15.17:0/619439082 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d31c26c90 con 0x561d31c99a70 2024-09-13T16:12:11.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.870+0000 7fb9cbe00640 1 -- 172.21.15.17:0/619439082 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fb9e0003d80 con 0x561d31c99a70 2024-09-13T16:12:11.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.870+0000 7fb9cbe00640 1 -- 172.21.15.17:0/619439082 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9e0003f40 con 0x561d31c99a70 2024-09-13T16:12:11.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.870+0000 7fb9f00c3740 10 client.26399 fetch_fsmap learned FSMap version 51 2024-09-13T16:12:11.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.870+0000 7fb9f00c3740 1 -- 172.21.15.17:0/619439082 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x561d31bc2560 con 0x561d31c99a70 2024-09-13T16:12:11.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.871+0000 7fb9cbe00640 1 -- 172.21.15.17:0/619439082 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9e004a080 con 0x561d31c99a70 2024-09-13T16:12:11.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.871+0000 7fb9cbe00640 1 -- 172.21.15.17:0/619439082 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 51) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb9e000f850 con 0x561d31c99a70 2024-09-13T16:12:11.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.872+0000 7fb9f00c3740 10 client.26399 fetch_fsmap finished waiting for FSMap version 51 2024-09-13T16:12:11.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.872+0000 7fb9f00c3740 10 client.26399 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:12:11.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.872+0000 7fb9f00c3740 20 client.26399 populate_metadata read hostname 'smithi017' 2024-09-13T16:12:11.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.872+0000 7fb9f00c3740 1 --2- 172.21.15.17:0/619439082 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x561d31caf320 0x561d31d08400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:11.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.872+0000 7fb9f00c3740 4 client.26399 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:12:11.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.872+0000 7fb9f00c3740 1 -- 172.21.15.17:0/619439082 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561d31901600 con 0x561d31caf320 2024-09-13T16:12:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.874+0000 7fb9dfe00640 1 --2- 172.21.15.17:0/619439082 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x561d31caf320 0x561d31d08400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:11.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.878+0000 7fb9cbe00640 10 client.26399 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:12:11.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.878+0000 7fb9dfe00640 1 --2- 172.21.15.17:0/619439082 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x561d31caf320 0x561d31d08400 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ef0af733b5c4a48 server_cookie=d473461c66357f4 in_seq=0 out_seq=0 2024-09-13T16:12:12.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.998+0000 7fb9cbe00640 1 -- 172.21.15.17:0/619439082 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561d31901600 con 0x561d31caf320 2024-09-13T16:12:12.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.998+0000 7fb9cbe00640 10 client.26399 handle_command_reply: tid=0 2024-09-13T16:12:12.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.998+0000 7fb9f00c3740 1 client.26399 shutdown 2024-09-13T16:12:12.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.999+0000 7fb9f00c3740 1 -- 172.21.15.17:0/619439082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c99a70 msgr2=0x561d31ca8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:12.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.999+0000 7fb9f00c3740 1 --2- 172.21.15.17:0/619439082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c99a70 0x561d31ca8910 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb9e000fdc0 tx=0x7fb9e0030040 comp rx=0 tx=0).stop 2024-09-13T16:12:12.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.999+0000 7fb9f00c3740 1 -- 172.21.15.17:0/619439082 shutdown_connections 2024-09-13T16:12:12.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.999+0000 7fb9f00c3740 1 --2- 172.21.15.17:0/619439082 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x561d31caf320 0x561d31d08400 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.999+0000 7fb9f00c3740 1 --2- 172.21.15.17:0/619439082 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561d31c9f440 0x561d31ca9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.999+0000 7fb9f00c3740 1 --2- 172.21.15.17:0/619439082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d31c9a3b0 0x561d31ca8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.999+0000 7fb9cbe00640 0 client.26399 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:12:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.999+0000 7fb9f00c3740 1 --2- 172.21.15.17:0/619439082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d31c99a70 0x561d31ca8910 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:11.999+0000 7fb9f00c3740 1 -- 172.21.15.17:0/619439082 >> 172.21.15.17:0/619439082 conn(0x561d31c950e0 msgr2=0x561d31ca34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:12.000+0000 7fb9f00c3740 1 -- 172.21.15.17:0/619439082 shutdown_connections 2024-09-13T16:12:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:12.000+0000 7fb9f00c3740 1 -- 172.21.15.17:0/619439082 wait complete. 2024-09-13T16:12:12.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:12.000+0000 7fb9f00c3740 20 client.26399 trim_cache size 0 max 16384 2024-09-13T16:12:12.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:12:12.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:12:12.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:12:12.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:12:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:12.001+0000 7fb9ed200640 1 -- 172.21.15.17:0/3030280645 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb9cc0a1260 msgr2=0x7fb9cc0a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:12.001+0000 7fb9ed200640 1 --2- 172.21.15.17:0/3030280645 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb9cc0a1260 0x7fb9cc0a3720 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009a20 tx=0x7fb9d80f3530 comp rx=0 tx=0).stop 2024-09-13T16:12:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:12.001+0000 7fb9ed200640 1 -- 172.21.15.17:0/3030280645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9e8101f20 msgr2=0x7fb9e819c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:12.001+0000 7fb9ed200640 1 --2- 172.21.15.17:0/3030280645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9e8101f20 0x7fb9e819c320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8031500 tx=0x7fb9d80055a0 comp rx=0 tx=0).stop 2024-09-13T16:12:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:12.001+0000 7fb9ed200640 1 -- 172.21.15.17:0/3030280645 shutdown_connections 2024-09-13T16:12:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:12.001+0000 7fb9ed200640 1 --2- 172.21.15.17:0/3030280645 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fb9cc0a1260 0x7fb9cc0a3720 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:12.001+0000 7fb9ed200640 1 --2- 172.21.15.17:0/3030280645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9e8103a30 0x7fb9e81a38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:12.001+0000 7fb9ed200640 1 --2- 172.21.15.17:0/3030280645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e8103070 0x7fb9e819c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:12.001+0000 7fb9ed200640 1 --2- 172.21.15.17:0/3030280645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9e8101f20 0x7fb9e819c320 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:12.001+0000 7fb9ed200640 1 -- 172.21.15.17:0/3030280645 >> 172.21.15.17:0/3030280645 conn(0x7fb9e80fd680 msgr2=0x7fb9e8076900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:12.002+0000 7fb9ed200640 1 -- 172.21.15.17:0/3030280645 shutdown_connections 2024-09-13T16:12:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:12.002+0000 7fb9ed200640 1 -- 172.21.15.17:0/3030280645 wait complete. 2024-09-13T16:12:12.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:12 smithi017 ceph-mon[30494]: pgmap v818: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.0 MiB/s wr, 558 op/s 2024-09-13T16:12:12.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:12 smithi189 ceph-mon[34790]: pgmap v818: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.0 MiB/s wr, 558 op/s 2024-09-13T16:12:12.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:12 smithi193 ceph-mon[35248]: pgmap v818: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.0 MiB/s wr, 558 op/s 2024-09-13T16:12:14.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:14 smithi017 ceph-mon[30494]: pgmap v819: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.5 MiB/s wr, 503 op/s 2024-09-13T16:12:14.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:14 smithi189 ceph-mon[34790]: pgmap v819: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.5 MiB/s wr, 503 op/s 2024-09-13T16:12:14.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:14 smithi193 ceph-mon[35248]: pgmap v819: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.5 MiB/s wr, 503 op/s 2024-09-13T16:12:15.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 870.0 s, 538.2 tps, lat 192.699 ms stddev 207.389 2024-09-13T16:12:16.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:16 smithi189 ceph-mon[34790]: pgmap v820: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.3 MiB/s wr, 483 op/s 2024-09-13T16:12:16.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:16 smithi193 ceph-mon[35248]: pgmap v820: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.3 MiB/s wr, 483 op/s 2024-09-13T16:12:16.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:16 smithi017 ceph-mon[30494]: pgmap v820: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.3 MiB/s wr, 483 op/s 2024-09-13T16:12:18.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:18 smithi189 ceph-mon[34790]: pgmap v821: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 541 op/s 2024-09-13T16:12:18.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:18 smithi193 ceph-mon[35248]: pgmap v821: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 541 op/s 2024-09-13T16:12:18.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:18 smithi017 ceph-mon[30494]: pgmap v821: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 541 op/s 2024-09-13T16:12:20.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 875.0 s, 467.0 tps, lat 213.233 ms stddev 234.187 2024-09-13T16:12:20.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:20 smithi189 ceph-mon[34790]: pgmap v822: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.0 MiB/s wr, 459 op/s 2024-09-13T16:12:20.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:20 smithi193 ceph-mon[35248]: pgmap v822: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.0 MiB/s wr, 459 op/s 2024-09-13T16:12:20.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:20 smithi017 ceph-mon[30494]: pgmap v822: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.0 MiB/s wr, 459 op/s 2024-09-13T16:12:22.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:22 smithi189 ceph-mon[34790]: pgmap v823: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.5 MiB/s wr, 522 op/s 2024-09-13T16:12:22.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:22 smithi193 ceph-mon[35248]: pgmap v823: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.5 MiB/s wr, 522 op/s 2024-09-13T16:12:22.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:22 smithi017 ceph-mon[30494]: pgmap v823: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.5 MiB/s wr, 522 op/s 2024-09-13T16:12:24.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:24 smithi189 ceph-mon[34790]: pgmap v824: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.5 MiB/s wr, 503 op/s 2024-09-13T16:12:24.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:24 smithi193 ceph-mon[35248]: pgmap v824: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.5 MiB/s wr, 503 op/s 2024-09-13T16:12:24.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:24 smithi017 ceph-mon[30494]: pgmap v824: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.5 MiB/s wr, 503 op/s 2024-09-13T16:12:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.210+0000 7f1dff600640 1 -- 172.21.15.17:0/2509964474 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1df8100f40 msgr2=0x7f1df81013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.210+0000 7f1dff600640 1 --2- 172.21.15.17:0/2509964474 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1df8100f40 0x7f1df81013c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1de8009860 tx=0x7f1de802a360 comp rx=0 tx=0).stop 2024-09-13T16:12:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.211+0000 7f1dff600640 1 -- 172.21.15.17:0/2509964474 shutdown_connections 2024-09-13T16:12:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.211+0000 7f1dff600640 1 --2- 172.21.15.17:0/2509964474 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1df8101900 0x7f1df8108190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.211+0000 7f1dff600640 1 --2- 172.21.15.17:0/2509964474 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1df8100f40 0x7f1df81013c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.211+0000 7f1dff600640 1 --2- 172.21.15.17:0/2509964474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1df80ffd50 0x7f1df8100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.211+0000 7f1dff600640 1 -- 172.21.15.17:0/2509964474 >> 172.21.15.17:0/2509964474 conn(0x7f1df80fb4b0 msgr2=0x7f1df80fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.213+0000 7f1dff600640 1 -- 172.21.15.17:0/2509964474 shutdown_connections 2024-09-13T16:12:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.213+0000 7f1dff600640 1 -- 172.21.15.17:0/2509964474 wait complete. 2024-09-13T16:12:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.215+0000 7f1dff600640 1 Processor -- start 2024-09-13T16:12:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.215+0000 7f1dff600640 1 -- start start 2024-09-13T16:12:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.215+0000 7f1dff600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1df80ffd50 0x7f1df819c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.215+0000 7f1dff600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1df8100f40 0x7f1df819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.216+0000 7f1dff600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1df8101900 0x7f1df806bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.216+0000 7f1dff600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df806c420 con 0x7f1df80ffd50 2024-09-13T16:12:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.216+0000 7f1dff600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df806c590 con 0x7f1df8100f40 2024-09-13T16:12:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.216+0000 7f1dff600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df806c750 con 0x7f1df8101900 2024-09-13T16:12:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.216+0000 7f1dfd600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1df8101900 0x7f1df806bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.216+0000 7f1dfd600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1df8101900 0x7f1df806bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:59538/0 (socket says 172.21.15.17:59538) 2024-09-13T16:12:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.216+0000 7f1dfd600640 1 -- 172.21.15.17:0/1590807075 learned_addr learned my addr 172.21.15.17:0/1590807075 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.216+0000 7f1dfcc00640 1 --2- 172.21.15.17:0/1590807075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1df80ffd50 0x7f1df819c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.217+0000 7f1dfd600640 1 -- 172.21.15.17:0/1590807075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1df8100f40 msgr2=0x7f1df819cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.217+0000 7f1dfd600640 1 --2- 172.21.15.17:0/1590807075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1df8100f40 0x7f1df819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.217+0000 7f1dfd600640 1 -- 172.21.15.17:0/1590807075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1df80ffd50 msgr2=0x7f1df819c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.217+0000 7f1dfd600640 1 --2- 172.21.15.17:0/1590807075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1df80ffd50 0x7f1df819c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.217+0000 7f1dfd600640 1 -- 172.21.15.17:0/1590807075 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de8009490 con 0x7f1df8101900 2024-09-13T16:12:25.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.218+0000 7f1dfd600640 1 --2- 172.21.15.17:0/1590807075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1df8101900 0x7f1df806bee0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1de400d750 tx=0x7f1de400dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:25.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.218+0000 7f1df5600640 1 -- 172.21.15.17:0/1590807075 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de4009bd0 con 0x7f1df8101900 2024-09-13T16:12:25.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.218+0000 7f1df5600640 1 -- 172.21.15.17:0/1590807075 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1de400de60 con 0x7f1df8101900 2024-09-13T16:12:25.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.218+0000 7f1df5600640 1 -- 172.21.15.17:0/1590807075 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de4009bd0 con 0x7f1df8101900 2024-09-13T16:12:25.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.219+0000 7f1dff600640 1 -- 172.21.15.17:0/1590807075 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df806ca30 con 0x7f1df8101900 2024-09-13T16:12:25.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.219+0000 7f1dff600640 1 -- 172.21.15.17:0/1590807075 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df806cef0 con 0x7f1df8101900 2024-09-13T16:12:25.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.228+0000 7f1e02484740 1 Processor -- start 2024-09-13T16:12:25.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.229+0000 7f1df5600640 1 -- 172.21.15.17:0/1590807075 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1de4010460 con 0x7f1df8101900 2024-09-13T16:12:25.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.230+0000 7f1e02484740 1 -- start start 2024-09-13T16:12:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.230+0000 7f1e02484740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb43e3fa70 0x55eb43e3fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.230+0000 7f1e02484740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e403b0 0x55eb43e44e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.230+0000 7f1e02484740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb43e45440 0x55eb43e47900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.230+0000 7f1e02484740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb43d4bbb0 con 0x55eb43e45440 2024-09-13T16:12:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.230+0000 7f1e02484740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb43da9a70 con 0x55eb43e403b0 2024-09-13T16:12:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.230+0000 7f1e02484740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb43da7200 con 0x55eb43e3fa70 2024-09-13T16:12:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.231+0000 7f1df5600640 1 --2- 172.21.15.17:0/1590807075 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1ddc0a1170 0x7f1ddc0a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.231+0000 7f1dfcc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e403b0 0x55eb43e44e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.231+0000 7f1dfcc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e403b0 0x55eb43e44e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:44734/0 (socket says 172.21.15.17:44734) 2024-09-13T16:12:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.231+0000 7f1dfcc00640 1 -- 172.21.15.17:0/2586736238 learned_addr learned my addr 172.21.15.17:0/2586736238 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.231+0000 7f1df5600640 1 -- 172.21.15.17:0/1590807075 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f1de40cc190 con 0x7f1df8101900 2024-09-13T16:12:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.232+0000 7f1dfcc00640 1 -- 172.21.15.17:0/2586736238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb43e3fa70 msgr2=0x55eb43e3fe70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:12:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.232+0000 7f1dfcc00640 1 --2- 172.21.15.17:0/2586736238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb43e3fa70 0x55eb43e3fe70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.232+0000 7f1dfcc00640 1 -- 172.21.15.17:0/2586736238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb43e45440 msgr2=0x55eb43e47900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:12:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.232+0000 7f1dfcc00640 1 --2- 172.21.15.17:0/2586736238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb43e45440 0x55eb43e47900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.232+0000 7f1dfcc00640 1 -- 172.21.15.17:0/2586736238 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb43d44940 con 0x55eb43e403b0 2024-09-13T16:12:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.232+0000 7f1dfd600640 1 --2- 172.21.15.17:0/1590807075 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1ddc0a1170 0x7f1ddc0a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.233+0000 7f1dfcc00640 1 --2- 172.21.15.17:0/2586736238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e403b0 0x55eb43e44e70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1df000af10 tx=0x7f1df000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=446548e719969487 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:25.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.233+0000 7f1dee000640 1 -- 172.21.15.17:0/2586736238 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df0010840 con 0x55eb43e403b0 2024-09-13T16:12:25.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.233+0000 7f1dee000640 1 -- 172.21.15.17:0/2586736238 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1df0010e60 con 0x55eb43e403b0 2024-09-13T16:12:25.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.233+0000 7f1dee000640 1 -- 172.21.15.17:0/2586736238 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df0010840 con 0x55eb43e403b0 2024-09-13T16:12:25.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.234+0000 7f1e02484740 1 -- 172.21.15.17:0/2586736238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e403b0 msgr2=0x55eb43e44e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:25.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.234+0000 7f1e02484740 1 --2- 172.21.15.17:0/2586736238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e403b0 0x55eb43e44e70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1df000af10 tx=0x7f1df000f790 comp rx=0 tx=0).stop 2024-09-13T16:12:25.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.234+0000 7f1dfd600640 1 --2- 172.21.15.17:0/1590807075 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1ddc0a1170 0x7f1ddc0a3630 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1de4095790 tx=0x7f1de4004830 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:25.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.234+0000 7f1e02484740 1 -- 172.21.15.17:0/2586736238 shutdown_connections 2024-09-13T16:12:25.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.234+0000 7f1e02484740 1 --2- 172.21.15.17:0/2586736238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb43e45440 0x55eb43e47900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.234+0000 7f1e02484740 1 --2- 172.21.15.17:0/2586736238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e403b0 0x55eb43e44e70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.234+0000 7f1e02484740 1 --2- 172.21.15.17:0/2586736238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb43e3fa70 0x55eb43e3fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.234+0000 7f1e02484740 1 -- 172.21.15.17:0/2586736238 >> 172.21.15.17:0/2586736238 conn(0x55eb43e3b0e0 msgr2=0x55eb43e3b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:25.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.235+0000 7f1e02484740 1 -- 172.21.15.17:0/2586736238 shutdown_connections 2024-09-13T16:12:25.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.236+0000 7f1e02484740 1 -- 172.21.15.17:0/2586736238 wait complete. 2024-09-13T16:12:25.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.236+0000 7f1e02484740 1 -- start start 2024-09-13T16:12:25.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.237+0000 7f1e02484740 1 Processor -- start 2024-09-13T16:12:25.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.237+0000 7f1e02484740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e3fa70 0x55eb43e496d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:25.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.237+0000 7f1e02484740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb43e403b0 0x55eb43e49c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:25.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.237+0000 7f1e02484740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb43e45440 0x55eb43e50c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:25.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.237+0000 7f1e02484740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb43da2af0 con 0x55eb43e45440 2024-09-13T16:12:25.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.237+0000 7f1e02484740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb43d60f20 con 0x55eb43e3fa70 2024-09-13T16:12:25.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.237+0000 7f1e02484740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb43d60bc0 con 0x55eb43e403b0 2024-09-13T16:12:25.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.237+0000 7f1e02484740 10 client.0 _ll_register_callbacks cb 0x55eb43d92a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:12:25.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.238+0000 7f1df7e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e3fa70 0x55eb43e496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:25.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.238+0000 7f1df7e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e3fa70 0x55eb43e496d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:44746/0 (socket says 172.21.15.17:44746) 2024-09-13T16:12:25.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.238+0000 7f1df7e00640 1 -- 172.21.15.17:0/4276724283 learned_addr learned my addr 172.21.15.17:0/4276724283 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:25.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.240+0000 7f1df7e00640 1 --2- 172.21.15.17:0/4276724283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb43e45440 0x55eb43e50c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:25.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.240+0000 7f1dfcc00640 1 --2- 172.21.15.17:0/4276724283 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb43e403b0 0x55eb43e49c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:25.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.240+0000 7f1df7e00640 1 -- 172.21.15.17:0/4276724283 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb43e403b0 msgr2=0x55eb43e49c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:25.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.240+0000 7f1df7e00640 1 --2- 172.21.15.17:0/4276724283 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb43e403b0 0x55eb43e49c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.240+0000 7f1df7e00640 1 -- 172.21.15.17:0/4276724283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb43e45440 msgr2=0x55eb43e50c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:25.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.240+0000 7f1df7e00640 1 --2- 172.21.15.17:0/4276724283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb43e45440 0x55eb43e50c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.240+0000 7f1df7e00640 1 -- 172.21.15.17:0/4276724283 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df000ab40 con 0x55eb43e3fa70 2024-09-13T16:12:25.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.241+0000 7f1dfcc00640 1 --2- 172.21.15.17:0/4276724283 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb43e403b0 0x55eb43e49c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:12:25.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.241+0000 7f1df7e00640 1 --2- 172.21.15.17:0/4276724283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e3fa70 0x55eb43e496d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1de80057c0 tx=0x7f1de8005a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffbf776ee77a2b8e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:25.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.241+0000 7f1de2a00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:12:25.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.241+0000 7f1de2a00640 1 -- 172.21.15.17:0/4276724283 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de8032e80 con 0x55eb43e3fa70 2024-09-13T16:12:25.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.241+0000 7f1de2a00640 1 -- 172.21.15.17:0/4276724283 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f1de8030950 con 0x55eb43e3fa70 2024-09-13T16:12:25.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.242+0000 7f1e02484740 1 -- 172.21.15.17:0/4276724283 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eb43dccc90 con 0x55eb43e3fa70 2024-09-13T16:12:25.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.242+0000 7f1de2a00640 1 -- 172.21.15.17:0/4276724283 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1de8030b10 con 0x55eb43e3fa70 2024-09-13T16:12:25.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.242+0000 7f1e02484740 10 client.26408 fetch_fsmap learned FSMap version 51 2024-09-13T16:12:25.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.242+0000 7f1e02484740 1 -- 172.21.15.17:0/4276724283 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55eb43da1170 con 0x55eb43e3fa70 2024-09-13T16:12:25.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.243+0000 7f1de2a00640 1 -- 172.21.15.17:0/4276724283 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55eb43dccc90 con 0x55eb43e3fa70 2024-09-13T16:12:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.243+0000 7f1de2a00640 1 -- 172.21.15.17:0/4276724283 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 51) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1de803dc10 con 0x55eb43e3fa70 2024-09-13T16:12:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.243+0000 7f1e02484740 10 client.26408 fetch_fsmap finished waiting for FSMap version 51 2024-09-13T16:12:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.243+0000 7f1e02484740 10 client.26408 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:12:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.243+0000 7f1e02484740 20 client.26408 populate_metadata read hostname 'smithi017' 2024-09-13T16:12:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.243+0000 7f1e02484740 1 --2- 172.21.15.17:0/4276724283 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55eb43e55300 0x55eb43e57720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.243+0000 7f1e02484740 4 client.26408 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:12:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.243+0000 7f1e02484740 1 -- 172.21.15.17:0/4276724283 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eb43d957d0 con 0x55eb43e55300 2024-09-13T16:12:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.244+0000 7f1dfcc00640 1 --2- 172.21.15.17:0/4276724283 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55eb43e55300 0x55eb43e57720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.244+0000 7f1dfcc00640 1 --2- 172.21.15.17:0/4276724283 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55eb43e55300 0x55eb43e57720 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9147554f7f7349b server_cookie=54a3b413bc79a733 in_seq=0 out_seq=0 2024-09-13T16:12:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.245+0000 7f1de2a00640 10 client.26408 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:12:25.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.245+0000 7f1de2a00640 1 -- 172.21.15.17:0/4276724283 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55eb43d957d0 con 0x55eb43e55300 2024-09-13T16:12:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.245+0000 7f1de2a00640 10 client.26408 handle_command_reply: tid=0 2024-09-13T16:12:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.245+0000 7f1e02484740 1 client.26408 shutdown 2024-09-13T16:12:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.245+0000 7f1e02484740 1 -- 172.21.15.17:0/4276724283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e3fa70 msgr2=0x55eb43e496d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.245+0000 7f1e02484740 1 --2- 172.21.15.17:0/4276724283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e3fa70 0x55eb43e496d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1de80057c0 tx=0x7f1de8005a90 comp rx=0 tx=0).stop 2024-09-13T16:12:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.246+0000 7f1e02484740 1 -- 172.21.15.17:0/4276724283 shutdown_connections 2024-09-13T16:12:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.246+0000 7f1e02484740 1 --2- 172.21.15.17:0/4276724283 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55eb43e55300 0x55eb43e57720 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.246+0000 7f1de2a00640 0 client.26408 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:12:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.246+0000 7f1e02484740 1 --2- 172.21.15.17:0/4276724283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb43e45440 0x55eb43e50c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.246+0000 7f1e02484740 1 --2- 172.21.15.17:0/4276724283 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb43e403b0 0x55eb43e49c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.246+0000 7f1e02484740 1 --2- 172.21.15.17:0/4276724283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e3fa70 0x55eb43e496d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.246+0000 7f1e02484740 1 -- 172.21.15.17:0/4276724283 >> 172.21.15.17:0/4276724283 conn(0x55eb43e3b0e0 msgr2=0x55eb43e3c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.246+0000 7f1e02484740 1 -- 172.21.15.17:0/4276724283 shutdown_connections 2024-09-13T16:12:25.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.246+0000 7f1e02484740 1 -- 172.21.15.17:0/4276724283 wait complete. 2024-09-13T16:12:25.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.246+0000 7f1e02484740 20 client.26408 trim_cache size 0 max 16384 2024-09-13T16:12:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.271+0000 7f1e02484740 1 Processor -- start 2024-09-13T16:12:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.271+0000 7f1e02484740 1 -- start start 2024-09-13T16:12:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.272+0000 7f1e02484740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb43e3fa70 0x55eb43e44870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.272+0000 7f1e02484740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb43e403b0 0x55eb43e44db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.272+0000 7f1e02484740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e45440 0x55eb43e50be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.272+0000 7f1e02484740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb43b09e60 con 0x55eb43e403b0 2024-09-13T16:12:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.272+0000 7f1e02484740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb43d957d0 con 0x55eb43e45440 2024-09-13T16:12:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.272+0000 7f1e02484740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb43e48690 con 0x55eb43e3fa70 2024-09-13T16:12:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.272+0000 7f1df7e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb43e3fa70 0x55eb43e44870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.272+0000 7f1df7e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb43e3fa70 0x55eb43e44870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:59554/0 (socket says 172.21.15.17:59554) 2024-09-13T16:12:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.272+0000 7f1df7e00640 1 -- 172.21.15.17:0/3711439305 learned_addr learned my addr 172.21.15.17:0/3711439305 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.272+0000 7f1df7e00640 1 --2- 172.21.15.17:0/3711439305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e45440 0x55eb43e50be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.272+0000 7f1dfcc00640 1 --2- 172.21.15.17:0/3711439305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb43e403b0 0x55eb43e44db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.273+0000 7f1dfcc00640 1 -- 172.21.15.17:0/3711439305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb43e3fa70 msgr2=0x55eb43e44870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.273+0000 7f1dfcc00640 1 --2- 172.21.15.17:0/3711439305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb43e3fa70 0x55eb43e44870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.273+0000 7f1dfcc00640 1 -- 172.21.15.17:0/3711439305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e45440 msgr2=0x55eb43e50be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.273+0000 7f1dfcc00640 1 --2- 172.21.15.17:0/3711439305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e45440 0x55eb43e50be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.273+0000 7f1dfcc00640 1 -- 172.21.15.17:0/3711439305 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb43d43180 con 0x55eb43e403b0 2024-09-13T16:12:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.273+0000 7f1df7e00640 1 --2- 172.21.15.17:0/3711439305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e45440 0x55eb43e50be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:12:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.273+0000 7f1dfcc00640 1 --2- 172.21.15.17:0/3711439305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb43e403b0 0x55eb43e44db0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1df0018aa0 tx=0x7f1df00183f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6885da7e358155e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.273+0000 7f1deea00640 1 -- 172.21.15.17:0/3711439305 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df0028070 con 0x55eb43e403b0 2024-09-13T16:12:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.274+0000 7f1deea00640 1 -- 172.21.15.17:0/3711439305 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1df002c070 con 0x55eb43e403b0 2024-09-13T16:12:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.274+0000 7f1deea00640 1 -- 172.21.15.17:0/3711439305 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df0003cf0 con 0x55eb43e403b0 2024-09-13T16:12:25.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.274+0000 7f1e02484740 1 -- 172.21.15.17:0/3711439305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb43e403b0 msgr2=0x55eb43e44db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:25.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.274+0000 7f1e02484740 1 --2- 172.21.15.17:0/3711439305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb43e403b0 0x55eb43e44db0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1df0018aa0 tx=0x7f1df00183f0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.274+0000 7f1e02484740 1 -- 172.21.15.17:0/3711439305 shutdown_connections 2024-09-13T16:12:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.274+0000 7f1e02484740 1 --2- 172.21.15.17:0/3711439305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e45440 0x55eb43e50be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.274+0000 7f1e02484740 1 --2- 172.21.15.17:0/3711439305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb43e403b0 0x55eb43e44db0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.274+0000 7f1e02484740 1 --2- 172.21.15.17:0/3711439305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb43e3fa70 0x55eb43e44870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.274+0000 7f1e02484740 1 -- 172.21.15.17:0/3711439305 >> 172.21.15.17:0/3711439305 conn(0x55eb43e3b0e0 msgr2=0x55eb43e41270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.274+0000 7f1e02484740 1 -- 172.21.15.17:0/3711439305 shutdown_connections 2024-09-13T16:12:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.275+0000 7f1e02484740 1 -- 172.21.15.17:0/3711439305 wait complete. 2024-09-13T16:12:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.275+0000 7f1e02484740 1 -- start start 2024-09-13T16:12:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.275+0000 7f1e02484740 1 Processor -- start 2024-09-13T16:12:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.276+0000 7f1e02484740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e3fa70 0x55eb43e4eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.276+0000 7f1e02484740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb43e403b0 0x55eb43e4f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.276+0000 7f1e02484740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb43e45440 0x55eb43e50040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.276+0000 7f1e02484740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb43e50580 con 0x55eb43e45440 2024-09-13T16:12:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.276+0000 7f1e02484740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb43e506f0 con 0x55eb43e3fa70 2024-09-13T16:12:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.276+0000 7f1e02484740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb43e508b0 con 0x55eb43e403b0 2024-09-13T16:12:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.276+0000 7f1e02484740 10 client.0 _ll_register_callbacks cb 0x7f1df000a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:12:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.276+0000 7f1df7e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e3fa70 0x55eb43e4eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.276+0000 7f1df7e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e3fa70 0x55eb43e4eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:44762/0 (socket says 172.21.15.17:44762) 2024-09-13T16:12:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.276+0000 7f1df7e00640 1 -- 172.21.15.17:0/1133346017 learned_addr learned my addr 172.21.15.17:0/1133346017 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.277+0000 7f1dfcc00640 1 --2- 172.21.15.17:0/1133346017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb43e403b0 0x55eb43e4f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.277+0000 7f1df7e00640 1 -- 172.21.15.17:0/1133346017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb43e403b0 msgr2=0x55eb43e4f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.277+0000 7f1df7e00640 1 --2- 172.21.15.17:0/1133346017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb43e403b0 0x55eb43e4f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.277+0000 7f1df7e00640 1 -- 172.21.15.17:0/1133346017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb43e45440 msgr2=0x55eb43e50040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.277+0000 7f1df7e00640 1 --2- 172.21.15.17:0/1133346017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb43e45440 0x55eb43e50040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.277+0000 7f1df7e00640 1 -- 172.21.15.17:0/1133346017 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb43da1170 con 0x55eb43e3fa70 2024-09-13T16:12:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.277+0000 7f1df7e00640 1 --2- 172.21.15.17:0/1133346017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e3fa70 0x55eb43e4eb40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1de80057c0 tx=0x7f1de8005c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12359af631cb0170 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.277+0000 7f1de2a00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:12:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.278+0000 7f1de2a00640 1 -- 172.21.15.17:0/1133346017 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de8004230 con 0x55eb43e3fa70 2024-09-13T16:12:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.278+0000 7f1de2a00640 1 -- 172.21.15.17:0/1133346017 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f1de8000e40 con 0x55eb43e3fa70 2024-09-13T16:12:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.278+0000 7f1e02484740 1 -- 172.21.15.17:0/1133346017 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1df0010e60 con 0x55eb43e3fa70 2024-09-13T16:12:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.278+0000 7f1de2a00640 1 -- 172.21.15.17:0/1133346017 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1de8004390 con 0x55eb43e3fa70 2024-09-13T16:12:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.278+0000 7f1e02484740 10 client.26414 fetch_fsmap learned FSMap version 51 2024-09-13T16:12:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.278+0000 7f1e02484740 1 -- 172.21.15.17:0/1133346017 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55eb43d44940 con 0x55eb43e3fa70 2024-09-13T16:12:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.278+0000 7f1de2a00640 1 -- 172.21.15.17:0/1133346017 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1df0010e60 con 0x55eb43e3fa70 2024-09-13T16:12:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.279+0000 7f1de2a00640 1 -- 172.21.15.17:0/1133346017 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 51) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1de8030b30 con 0x55eb43e3fa70 2024-09-13T16:12:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.279+0000 7f1e02484740 10 client.26414 fetch_fsmap finished waiting for FSMap version 51 2024-09-13T16:12:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.279+0000 7f1e02484740 10 client.26414 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:12:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.279+0000 7f1e02484740 20 client.26414 populate_metadata read hostname 'smithi017' 2024-09-13T16:12:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.279+0000 7f1e02484740 1 --2- 172.21.15.17:0/1133346017 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55eb43e55300 0x55eb43eae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.279+0000 7f1e02484740 4 client.26414 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:12:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.279+0000 7f1e02484740 1 -- 172.21.15.17:0/1133346017 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55eb43a96300 con 0x55eb43e55300 2024-09-13T16:12:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.279+0000 7f1dfcc00640 1 --2- 172.21.15.17:0/1133346017 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55eb43e55300 0x55eb43eae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.280+0000 7f1de2a00640 10 client.26414 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:12:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.280+0000 7f1dfcc00640 1 --2- 172.21.15.17:0/1133346017 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55eb43e55300 0x55eb43eae3e0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc90f381ae85bec9 server_cookie=3e2b04d97beb7670 in_seq=0 out_seq=0 2024-09-13T16:12:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.287+0000 7f1de2a00640 1 -- 172.21.15.17:0/1133346017 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55eb43a96300 con 0x55eb43e55300 2024-09-13T16:12:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.287+0000 7f1de2a00640 10 client.26414 handle_command_reply: tid=0 2024-09-13T16:12:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.287+0000 7f1e02484740 1 client.26414 shutdown 2024-09-13T16:12:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.288+0000 7f1e02484740 1 -- 172.21.15.17:0/1133346017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e3fa70 msgr2=0x55eb43e4eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.288+0000 7f1e02484740 1 --2- 172.21.15.17:0/1133346017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e3fa70 0x55eb43e4eb40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1de80057c0 tx=0x7f1de8005c90 comp rx=0 tx=0).stop 2024-09-13T16:12:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.288+0000 7f1e02484740 1 -- 172.21.15.17:0/1133346017 shutdown_connections 2024-09-13T16:12:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.288+0000 7f1e02484740 1 --2- 172.21.15.17:0/1133346017 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55eb43e55300 0x55eb43eae3e0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.288+0000 7f1e02484740 1 --2- 172.21.15.17:0/1133346017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb43e45440 0x55eb43e50040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.288+0000 7f1e02484740 1 --2- 172.21.15.17:0/1133346017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb43e403b0 0x55eb43e4f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.288+0000 7f1e02484740 1 --2- 172.21.15.17:0/1133346017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb43e3fa70 0x55eb43e4eb40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.288+0000 7f1e02484740 1 -- 172.21.15.17:0/1133346017 >> 172.21.15.17:0/1133346017 conn(0x55eb43e3b0e0 msgr2=0x55eb43e446e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.288+0000 7f1de2a00640 0 client.26414 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:12:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.288+0000 7f1e02484740 1 -- 172.21.15.17:0/1133346017 shutdown_connections 2024-09-13T16:12:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.288+0000 7f1e02484740 1 -- 172.21.15.17:0/1133346017 wait complete. 2024-09-13T16:12:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.288+0000 7f1e02484740 20 client.26414 trim_cache size 0 max 16384 2024-09-13T16:12:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:12:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:12:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:12:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:12:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.289+0000 7f1dff600640 1 -- 172.21.15.17:0/1590807075 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1ddc0a1170 msgr2=0x7f1ddc0a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.289+0000 7f1dff600640 1 --2- 172.21.15.17:0/1590807075 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1ddc0a1170 0x7f1ddc0a3630 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1de4095790 tx=0x7f1de4004830 comp rx=0 tx=0).stop 2024-09-13T16:12:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.289+0000 7f1dff600640 1 -- 172.21.15.17:0/1590807075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1df8101900 msgr2=0x7f1df806bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.289+0000 7f1dff600640 1 --2- 172.21.15.17:0/1590807075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1df8101900 0x7f1df806bee0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1de400d750 tx=0x7f1de400dc10 comp rx=0 tx=0).stop 2024-09-13T16:12:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.289+0000 7f1dff600640 1 -- 172.21.15.17:0/1590807075 shutdown_connections 2024-09-13T16:12:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.289+0000 7f1dff600640 1 --2- 172.21.15.17:0/1590807075 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f1ddc0a1170 0x7f1ddc0a3630 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.289+0000 7f1dff600640 1 --2- 172.21.15.17:0/1590807075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1df8101900 0x7f1df806bee0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.289+0000 7f1dff600640 1 --2- 172.21.15.17:0/1590807075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1df8100f40 0x7f1df819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.289+0000 7f1dff600640 1 --2- 172.21.15.17:0/1590807075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1df80ffd50 0x7f1df819c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.289+0000 7f1dff600640 1 -- 172.21.15.17:0/1590807075 >> 172.21.15.17:0/1590807075 conn(0x7f1df80fb4b0 msgr2=0x7f1df80fc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.289+0000 7f1dff600640 1 -- 172.21.15.17:0/1590807075 shutdown_connections 2024-09-13T16:12:25.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:25.289+0000 7f1dff600640 1 -- 172.21.15.17:0/1590807075 wait complete. 2024-09-13T16:12:25.314 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 880.0 s, 480.9 tps, lat 205.330 ms stddev 242.759 2024-09-13T16:12:26.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:26 smithi189 ceph-mon[34790]: pgmap v825: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.1 MiB/s wr, 476 op/s 2024-09-13T16:12:26.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:26 smithi193 ceph-mon[35248]: pgmap v825: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.1 MiB/s wr, 476 op/s 2024-09-13T16:12:26.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:26 smithi017 ceph-mon[30494]: pgmap v825: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.1 MiB/s wr, 476 op/s 2024-09-13T16:12:28.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:28 smithi189 ceph-mon[34790]: pgmap v826: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 4.7 MiB/s wr, 519 op/s 2024-09-13T16:12:28.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:28 smithi193 ceph-mon[35248]: pgmap v826: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 4.7 MiB/s wr, 519 op/s 2024-09-13T16:12:28.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:28 smithi017 ceph-mon[30494]: pgmap v826: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 4.7 MiB/s wr, 519 op/s 2024-09-13T16:12:30.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 885.0 s, 554.3 tps, lat 180.014 ms stddev 211.756 2024-09-13T16:12:30.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:30 smithi189 ceph-mon[34790]: pgmap v827: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.2 MiB/s wr, 457 op/s 2024-09-13T16:12:30.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:30 smithi193 ceph-mon[35248]: pgmap v827: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.2 MiB/s wr, 457 op/s 2024-09-13T16:12:30.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:30 smithi017 ceph-mon[30494]: pgmap v827: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.2 MiB/s wr, 457 op/s 2024-09-13T16:12:32.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:32 smithi189 ceph-mon[34790]: pgmap v828: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.6 MiB/s wr, 517 op/s 2024-09-13T16:12:32.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:32 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:12:32.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:32 smithi193 ceph-mon[35248]: pgmap v828: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.6 MiB/s wr, 517 op/s 2024-09-13T16:12:32.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:32 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:12:32.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:32 smithi017 ceph-mon[30494]: pgmap v828: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.6 MiB/s wr, 517 op/s 2024-09-13T16:12:32.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:32 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:12:33.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:33 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:12:33.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:33 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:12:33.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:33 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:12:33.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:33 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:12:33.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:33 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:12:33.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:33 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:12:33.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:33 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:12:33.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:33 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:12:33.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:33 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:12:34.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:34 smithi189 ceph-mon[34790]: pgmap v829: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.8 MiB/s wr, 523 op/s 2024-09-13T16:12:34.405 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:34 smithi193 ceph-mon[35248]: pgmap v829: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.8 MiB/s wr, 523 op/s 2024-09-13T16:12:34.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:34 smithi017 ceph-mon[30494]: pgmap v829: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.8 MiB/s wr, 523 op/s 2024-09-13T16:12:35.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 890.0 s, 708.8 tps, lat 138.728 ms stddev 171.757 2024-09-13T16:12:36.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:36 smithi189 ceph-mon[34790]: pgmap v830: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.3 MiB/s wr, 478 op/s 2024-09-13T16:12:36.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:36 smithi193 ceph-mon[35248]: pgmap v830: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.3 MiB/s wr, 478 op/s 2024-09-13T16:12:36.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:36 smithi017 ceph-mon[30494]: pgmap v830: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.3 MiB/s wr, 478 op/s 2024-09-13T16:12:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.498+0000 7fd16e800640 1 -- 172.21.15.17:0/464480406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd168070cd0 msgr2=0x7fd168071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.498+0000 7fd16e800640 1 --2- 172.21.15.17:0/464480406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd168070cd0 0x7fd168071150 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009860 tx=0x7fd15c02a380 comp rx=0 tx=0).stop 2024-09-13T16:12:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.498+0000 7fd16e800640 1 -- 172.21.15.17:0/464480406 shutdown_connections 2024-09-13T16:12:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.498+0000 7fd16e800640 1 --2- 172.21.15.17:0/464480406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd168071690 0x7fd168110800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.498+0000 7fd16e800640 1 --2- 172.21.15.17:0/464480406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd168070cd0 0x7fd168071150 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.498+0000 7fd16e800640 1 --2- 172.21.15.17:0/464480406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1681079c0 0x7fd168107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.498+0000 7fd16e800640 1 -- 172.21.15.17:0/464480406 >> 172.21.15.17:0/464480406 conn(0x7fd16806cd10 msgr2=0x7fd16806f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.499+0000 7fd16e800640 1 -- 172.21.15.17:0/464480406 shutdown_connections 2024-09-13T16:12:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.499+0000 7fd16e800640 1 -- 172.21.15.17:0/464480406 wait complete. 2024-09-13T16:12:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.501+0000 7fd16e800640 1 Processor -- start 2024-09-13T16:12:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.501+0000 7fd16e800640 1 -- start start 2024-09-13T16:12:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.501+0000 7fd16e800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd168070cd0 0x7fd16810a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.501+0000 7fd16e800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd168071690 0x7fd168108780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.501+0000 7fd16e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1681079c0 0x7fd168108cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.501+0000 7fd16e800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1681a2190 con 0x7fd1681079c0 2024-09-13T16:12:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.501+0000 7fd16e800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd168109200 con 0x7fd168070cd0 2024-09-13T16:12:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.501+0000 7fd16e800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1681093c0 con 0x7fd168071690 2024-09-13T16:12:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.502+0000 7fd16de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1681079c0 0x7fd168108cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.502+0000 7fd16de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1681079c0 0x7fd168108cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54438/0 (socket says 172.21.15.17:54438) 2024-09-13T16:12:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.502+0000 7fd16de00640 1 -- 172.21.15.17:0/1159854478 learned_addr learned my addr 172.21.15.17:0/1159854478 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:38.505 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:38 smithi193 ceph-mon[35248]: pgmap v831: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.4 MiB/s wr, 540 op/s 2024-09-13T16:12:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.503+0000 7fd16de00640 1 -- 172.21.15.17:0/1159854478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd168071690 msgr2=0x7fd168108780 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T16:12:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.503+0000 7fd16de00640 1 --2- 172.21.15.17:0/1159854478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd168071690 0x7fd168108780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.503+0000 7fd16de00640 1 -- 172.21.15.17:0/1159854478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd168070cd0 msgr2=0x7fd16810a140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T16:12:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.503+0000 7fd16de00640 1 --2- 172.21.15.17:0/1159854478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd168070cd0 0x7fd16810a140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.503+0000 7fd16de00640 1 -- 172.21.15.17:0/1159854478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c009490 con 0x7fd1681079c0 2024-09-13T16:12:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.503+0000 7fd16de00640 1 --2- 172.21.15.17:0/1159854478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1681079c0 0x7fd168108cc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd160009fd0 tx=0x7fd16000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.505+0000 7fd166000640 1 -- 172.21.15.17:0/1159854478 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd160009b50 con 0x7fd1681079c0 2024-09-13T16:12:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.505+0000 7fd166000640 1 -- 172.21.15.17:0/1159854478 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd160003970 con 0x7fd1681079c0 2024-09-13T16:12:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.505+0000 7fd16e800640 1 -- 172.21.15.17:0/1159854478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1681acb80 con 0x7fd1681079c0 2024-09-13T16:12:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.505+0000 7fd166000640 1 -- 172.21.15.17:0/1159854478 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd160004750 con 0x7fd1681079c0 2024-09-13T16:12:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.505+0000 7fd16e800640 1 -- 172.21.15.17:0/1159854478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1681acfc0 con 0x7fd1681079c0 2024-09-13T16:12:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.509+0000 7fd172c84740 1 Processor -- start 2024-09-13T16:12:38.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:38 smithi017 ceph-mon[30494]: pgmap v831: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.4 MiB/s wr, 540 op/s 2024-09-13T16:12:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.516+0000 7fd166000640 1 -- 172.21.15.17:0/1159854478 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd16000a040 con 0x7fd1681079c0 2024-09-13T16:12:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.516+0000 7fd172c84740 1 -- start start 2024-09-13T16:12:38.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.517+0000 7fd172c84740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55927ed90c20 0x55927ed91020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:38.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.517+0000 7fd172c84740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed91560 0x55927ed96020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:38.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.517+0000 7fd172c84740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed965f0 0x55927ed98ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:38.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.517+0000 7fd172c84740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927ec9cbb0 con 0x55927ed90c20 2024-09-13T16:12:38.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.517+0000 7fd172c84740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927ecfaa70 con 0x55927ed91560 2024-09-13T16:12:38.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.517+0000 7fd172c84740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927ecf8200 con 0x55927ed965f0 2024-09-13T16:12:38.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.518+0000 7fd166000640 1 --2- 172.21.15.17:0/1159854478 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd1500a11b0 0x7fd1500a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.520+0000 7fd16d400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed91560 0x55927ed96020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.520+0000 7fd16d400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed91560 0x55927ed96020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:51978/0 (socket says 172.21.15.17:51978) 2024-09-13T16:12:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.520+0000 7fd16d400640 1 -- 172.21.15.17:0/277160257 learned_addr learned my addr 172.21.15.17:0/277160257 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.520+0000 7fd16ca00640 1 --2- 172.21.15.17:0/277160257 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed965f0 0x55927ed98ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.520+0000 7fd16d400640 1 -- 172.21.15.17:0/277160257 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed965f0 msgr2=0x55927ed98ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.520+0000 7fd16d400640 1 --2- 172.21.15.17:0/277160257 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed965f0 0x55927ed98ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.521+0000 7fd16d400640 1 -- 172.21.15.17:0/277160257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55927ed90c20 msgr2=0x55927ed91020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.521+0000 7fd16de00640 1 --2- 172.21.15.17:0/1159854478 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd1500a11b0 0x7fd1500a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.521+0000 7fd16d400640 1 --2- 172.21.15.17:0/277160257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55927ed90c20 0x55927ed91020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.521+0000 7fd16d400640 1 -- 172.21.15.17:0/277160257 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55927ec95940 con 0x55927ed91560 2024-09-13T16:12:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.521+0000 7fd16d400640 1 --2- 172.21.15.17:0/277160257 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed91560 0x55927ed96020 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd154009780 tx=0x7fd154009c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67efc9f7bfabbae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.522+0000 7fd15aa00640 1 -- 172.21.15.17:0/277160257 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15400bad0 con 0x55927ed91560 2024-09-13T16:12:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.522+0000 7fd16de00640 1 --2- 172.21.15.17:0/1159854478 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd1500a11b0 0x7fd1500a3670 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd1600961a0 tx=0x7fd1600048b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.522+0000 7fd166000640 1 -- 172.21.15.17:0/1159854478 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fd160099730 con 0x7fd1681079c0 2024-09-13T16:12:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.522+0000 7fd15aa00640 1 -- 172.21.15.17:0/277160257 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd154009e90 con 0x55927ed91560 2024-09-13T16:12:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.522+0000 7fd15aa00640 1 -- 172.21.15.17:0/277160257 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd154011ea0 con 0x55927ed91560 2024-09-13T16:12:38.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.525+0000 7fd172c84740 1 -- 172.21.15.17:0/277160257 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed91560 msgr2=0x55927ed96020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:38.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.525+0000 7fd172c84740 1 --2- 172.21.15.17:0/277160257 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed91560 0x55927ed96020 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd154009780 tx=0x7fd154009c40 comp rx=0 tx=0).stop 2024-09-13T16:12:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.528+0000 7fd172c84740 1 -- 172.21.15.17:0/277160257 shutdown_connections 2024-09-13T16:12:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.528+0000 7fd172c84740 1 --2- 172.21.15.17:0/277160257 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed965f0 0x55927ed98ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.528+0000 7fd172c84740 1 --2- 172.21.15.17:0/277160257 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed91560 0x55927ed96020 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.528+0000 7fd172c84740 1 --2- 172.21.15.17:0/277160257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55927ed90c20 0x55927ed91020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.528+0000 7fd172c84740 1 -- 172.21.15.17:0/277160257 >> 172.21.15.17:0/277160257 conn(0x55927ed8c290 msgr2=0x55927ed8c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:38.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.529+0000 7fd172c84740 1 -- 172.21.15.17:0/277160257 shutdown_connections 2024-09-13T16:12:38.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.529+0000 7fd172c84740 1 -- 172.21.15.17:0/277160257 wait complete. 2024-09-13T16:12:38.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.530+0000 7fd172c84740 1 -- start start 2024-09-13T16:12:38.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.530+0000 7fd172c84740 1 Processor -- start 2024-09-13T16:12:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.532+0000 7fd172c84740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed90c20 0x55927ed9a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:38.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.532+0000 7fd172c84740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55927ed91560 0x55927ed9ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:38.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.532+0000 7fd172c84740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed965f0 0x55927eda1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:38.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.532+0000 7fd172c84740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927ecf3af0 con 0x55927ed91560 2024-09-13T16:12:38.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.532+0000 7fd172c84740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927ecb1f20 con 0x55927ed90c20 2024-09-13T16:12:38.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.532+0000 7fd172c84740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927ecb1bc0 con 0x55927ed965f0 2024-09-13T16:12:38.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.532+0000 7fd172c84740 10 client.0 _ll_register_callbacks cb 0x55927ece3a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:12:38.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.532+0000 7fd16ca00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed90c20 0x55927ed9a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:38.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.532+0000 7fd16ca00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed90c20 0x55927ed9a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:51984/0 (socket says 172.21.15.17:51984) 2024-09-13T16:12:38.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.532+0000 7fd16ca00640 1 -- 172.21.15.17:0/3247245687 learned_addr learned my addr 172.21.15.17:0/3247245687 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:38.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.533+0000 7fd16ca00640 1 --2- 172.21.15.17:0/3247245687 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed965f0 0x55927eda1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:38.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.534+0000 7fd16d400640 1 --2- 172.21.15.17:0/3247245687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55927ed91560 0x55927ed9ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:38.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.534+0000 7fd16ca00640 1 -- 172.21.15.17:0/3247245687 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed965f0 msgr2=0x55927eda1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:38.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.534+0000 7fd16ca00640 1 --2- 172.21.15.17:0/3247245687 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed965f0 0x55927eda1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.534+0000 7fd16ca00640 1 -- 172.21.15.17:0/3247245687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55927ed91560 msgr2=0x55927ed9ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.535+0000 7fd16ca00640 1 --2- 172.21.15.17:0/3247245687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55927ed91560 0x55927ed9ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.535+0000 7fd16ca00640 1 -- 172.21.15.17:0/3247245687 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1540093e0 con 0x55927ed90c20 2024-09-13T16:12:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.535+0000 7fd16d400640 1 --2- 172.21.15.17:0/3247245687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55927ed91560 0x55927ed9ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:12:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.536+0000 7fd16ca00640 1 --2- 172.21.15.17:0/3247245687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed90c20 0x55927ed9a850 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd15c005e00 tx=0x7fd15c009760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31d67737a70092f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.536+0000 7fd14f400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-13T16:12:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.536+0000 7fd14f400640 1 -- 172.21.15.17:0/3247245687 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c032850 con 0x55927ed90c20 2024-09-13T16:12:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.537+0000 7fd14f400640 1 -- 172.21.15.17:0/3247245687 <== mon.2 v2:172.21.15.189:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fd15c004050 con 0x55927ed90c20 2024-09-13T16:12:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.537+0000 7fd172c84740 1 -- 172.21.15.17:0/3247245687 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55927ed1dc90 con 0x55927ed90c20 2024-09-13T16:12:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.539+0000 7fd14f400640 1 -- 172.21.15.17:0/3247245687 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd15c004210 con 0x55927ed90c20 2024-09-13T16:12:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.539+0000 7fd172c84740 10 client.26423 fetch_fsmap learned FSMap version 51 2024-09-13T16:12:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.539+0000 7fd172c84740 1 -- 172.21.15.17:0/3247245687 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55927ecf2170 con 0x55927ed90c20 2024-09-13T16:12:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.539+0000 7fd14f400640 1 -- 172.21.15.17:0/3247245687 <== mon.2 v2:172.21.15.189:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55927ed1dc90 con 0x55927ed90c20 2024-09-13T16:12:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.540+0000 7fd14f400640 1 -- 172.21.15.17:0/3247245687 <== mon.2 v2:172.21.15.189:3300/0 5 ==== fsmap(e 51) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd15c0046c0 con 0x55927ed90c20 2024-09-13T16:12:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.540+0000 7fd172c84740 10 client.26423 fetch_fsmap finished waiting for FSMap version 51 2024-09-13T16:12:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.540+0000 7fd172c84740 10 client.26423 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:12:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.540+0000 7fd172c84740 20 client.26423 populate_metadata read hostname 'smithi017' 2024-09-13T16:12:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.540+0000 7fd172c84740 1 --2- 172.21.15.17:0/3247245687 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55927eda6490 0x55927eda88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.540+0000 7fd172c84740 4 client.26423 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:12:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.540+0000 7fd172c84740 1 -- 172.21.15.17:0/3247245687 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55927ece67d0 con 0x55927eda6490 2024-09-13T16:12:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.541+0000 7fd16d400640 1 --2- 172.21.15.17:0/3247245687 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55927eda6490 0x55927eda88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.542+0000 7fd16d400640 1 --2- 172.21.15.17:0/3247245687 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55927eda6490 0x55927eda88b0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e635298c3fa464bd server_cookie=30e4e44d42fe5c5b in_seq=0 out_seq=0 2024-09-13T16:12:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.544+0000 7fd14f400640 10 client.26423 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:12:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.544+0000 7fd14f400640 1 -- 172.21.15.17:0/3247245687 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55927ece67d0 con 0x55927eda6490 2024-09-13T16:12:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.544+0000 7fd14f400640 10 client.26423 handle_command_reply: tid=0 2024-09-13T16:12:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.544+0000 7fd172c84740 1 client.26423 shutdown 2024-09-13T16:12:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.545+0000 7fd172c84740 1 -- 172.21.15.17:0/3247245687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed90c20 msgr2=0x55927ed9a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.545+0000 7fd172c84740 1 --2- 172.21.15.17:0/3247245687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed90c20 0x55927ed9a850 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd15c005e00 tx=0x7fd15c009760 comp rx=0 tx=0).stop 2024-09-13T16:12:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.545+0000 7fd172c84740 1 -- 172.21.15.17:0/3247245687 shutdown_connections 2024-09-13T16:12:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.545+0000 7fd172c84740 1 --2- 172.21.15.17:0/3247245687 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55927eda6490 0x55927eda88b0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.545+0000 7fd172c84740 1 --2- 172.21.15.17:0/3247245687 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed965f0 0x55927eda1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.545+0000 7fd172c84740 1 --2- 172.21.15.17:0/3247245687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55927ed91560 0x55927ed9ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.545+0000 7fd172c84740 1 --2- 172.21.15.17:0/3247245687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed90c20 0x55927ed9a850 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.545+0000 7fd172c84740 1 -- 172.21.15.17:0/3247245687 >> 172.21.15.17:0/3247245687 conn(0x55927ed8c290 msgr2=0x55927ed8b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.546+0000 7fd14f400640 0 client.26423 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:12:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.548+0000 7fd172c84740 1 -- 172.21.15.17:0/3247245687 shutdown_connections 2024-09-13T16:12:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.548+0000 7fd172c84740 1 -- 172.21.15.17:0/3247245687 wait complete. 2024-09-13T16:12:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.550+0000 7fd172c84740 20 client.26423 trim_cache size 0 max 16384 2024-09-13T16:12:38.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.579+0000 7fd172c84740 1 Processor -- start 2024-09-13T16:12:38.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.579+0000 7fd172c84740 1 -- start start 2024-09-13T16:12:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.583+0000 7fd172c84740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed90c20 0x55927ed92420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.583+0000 7fd172c84740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed91560 0x55927eda1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.583+0000 7fd172c84740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55927ed965f0 0x55927ed92960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.583+0000 7fd172c84740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927ea5ae60 con 0x55927ed965f0 2024-09-13T16:12:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.583+0000 7fd172c84740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927ed91fc0 con 0x55927ed90c20 2024-09-13T16:12:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.583+0000 7fd172c84740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927ed880e0 con 0x55927ed91560 2024-09-13T16:12:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.584+0000 7fd16ca00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed90c20 0x55927ed92420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.584+0000 7fd16ca00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed90c20 0x55927ed92420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:51992/0 (socket says 172.21.15.17:51992) 2024-09-13T16:12:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.584+0000 7fd16ca00640 1 -- 172.21.15.17:0/2706706596 learned_addr learned my addr 172.21.15.17:0/2706706596 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.584+0000 7fd16d400640 1 --2- 172.21.15.17:0/2706706596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed91560 0x55927eda1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.585+0000 7fd16d400640 1 -- 172.21.15.17:0/2706706596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed90c20 msgr2=0x55927ed92420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.585+0000 7fd16d400640 1 --2- 172.21.15.17:0/2706706596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed90c20 0x55927ed92420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.585+0000 7fd16d400640 1 -- 172.21.15.17:0/2706706596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55927ed965f0 msgr2=0x55927ed92960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.585+0000 7fd16d400640 1 --2- 172.21.15.17:0/2706706596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55927ed965f0 0x55927ed92960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.585+0000 7fd16d400640 1 -- 172.21.15.17:0/2706706596 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55927ec94180 con 0x55927ed91560 2024-09-13T16:12:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.585+0000 7fd16d400640 1 --2- 172.21.15.17:0/2706706596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed91560 0x55927eda1d90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55927ed9bd30 tx=0x7fd154009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=271c0c16a84bef2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.585+0000 7fd15b400640 1 -- 172.21.15.17:0/2706706596 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd154011c30 con 0x55927ed91560 2024-09-13T16:12:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.586+0000 7fd15b400640 1 -- 172.21.15.17:0/2706706596 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd154026070 con 0x55927ed91560 2024-09-13T16:12:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.586+0000 7fd15b400640 1 -- 172.21.15.17:0/2706706596 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd154011800 con 0x55927ed91560 2024-09-13T16:12:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.587+0000 7fd172c84740 1 -- 172.21.15.17:0/2706706596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed91560 msgr2=0x55927eda1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.587+0000 7fd172c84740 1 --2- 172.21.15.17:0/2706706596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed91560 0x55927eda1d90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55927ed9bd30 tx=0x7fd154009190 comp rx=0 tx=0).stop 2024-09-13T16:12:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.587+0000 7fd172c84740 1 -- 172.21.15.17:0/2706706596 shutdown_connections 2024-09-13T16:12:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.587+0000 7fd172c84740 1 --2- 172.21.15.17:0/2706706596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55927ed965f0 0x55927ed92960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.587+0000 7fd172c84740 1 --2- 172.21.15.17:0/2706706596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed91560 0x55927eda1d90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.587+0000 7fd172c84740 1 --2- 172.21.15.17:0/2706706596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed90c20 0x55927ed92420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.587+0000 7fd172c84740 1 -- 172.21.15.17:0/2706706596 >> 172.21.15.17:0/2706706596 conn(0x55927ed8c290 msgr2=0x55927ed95a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.588+0000 7fd172c84740 1 -- 172.21.15.17:0/2706706596 shutdown_connections 2024-09-13T16:12:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.588+0000 7fd172c84740 1 -- 172.21.15.17:0/2706706596 wait complete. 2024-09-13T16:12:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.588+0000 7fd172c84740 1 -- start start 2024-09-13T16:12:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.589+0000 7fd172c84740 1 Processor -- start 2024-09-13T16:12:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.589+0000 7fd172c84740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed90c20 0x55927ed9ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.589+0000 7fd172c84740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed91560 0x55927ed9e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.589+0000 7fd172c84740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55927ed965f0 0x55927eda1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.589+0000 7fd172c84740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927eda1870 con 0x55927ed965f0 2024-09-13T16:12:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.589+0000 7fd172c84740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927eda19e0 con 0x55927ed90c20 2024-09-13T16:12:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.589+0000 7fd172c84740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x55927eda1ba0 con 0x55927ed91560 2024-09-13T16:12:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.589+0000 7fd172c84740 10 client.0 _ll_register_callbacks cb 0x7fd154009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:12:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.590+0000 7fd16d400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed91560 0x55927ed9e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.590+0000 7fd16d400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed91560 0x55927ed9e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:53222/0 (socket says 172.21.15.17:53222) 2024-09-13T16:12:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.590+0000 7fd16d400640 1 -- 172.21.15.17:0/52333544 learned_addr learned my addr 172.21.15.17:0/52333544 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.590+0000 7fd16d400640 1 -- 172.21.15.17:0/52333544 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed90c20 msgr2=0x55927ed9ddd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T16:12:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.590+0000 7fd16d400640 1 --2- 172.21.15.17:0/52333544 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed90c20 0x55927ed9ddd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.590+0000 7fd16d400640 1 -- 172.21.15.17:0/52333544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55927ed965f0 msgr2=0x55927eda1330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T16:12:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.591+0000 7fd16d400640 1 --2- 172.21.15.17:0/52333544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55927ed965f0 0x55927eda1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.591+0000 7fd16d400640 1 -- 172.21.15.17:0/52333544 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55927ec95940 con 0x55927ed91560 2024-09-13T16:12:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.592+0000 7fd16d400640 1 --2- 172.21.15.17:0/52333544 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed91560 0x55927ed9e310 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd154009780 tx=0x7fd154011420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b61561d393404999 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.592+0000 7fd14f400640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:12:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.593+0000 7fd14f400640 1 -- 172.21.15.17:0/52333544 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd154011dc0 con 0x55927ed91560 2024-09-13T16:12:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.593+0000 7fd14f400640 1 -- 172.21.15.17:0/52333544 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fd15401f070 con 0x55927ed91560 2024-09-13T16:12:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.594+0000 7fd172c84740 1 -- 172.21.15.17:0/52333544 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd154009e90 con 0x55927ed91560 2024-09-13T16:12:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.594+0000 7fd14f400640 1 -- 172.21.15.17:0/52333544 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1540115c0 con 0x55927ed91560 2024-09-13T16:12:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.594+0000 7fd172c84740 10 client.26464 fetch_fsmap learned FSMap version 51 2024-09-13T16:12:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.595+0000 7fd172c84740 1 -- 172.21.15.17:0/52333544 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55927ecb9560 con 0x55927ed91560 2024-09-13T16:12:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.595+0000 7fd14f400640 1 -- 172.21.15.17:0/52333544 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd154009e90 con 0x55927ed91560 2024-09-13T16:12:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.596+0000 7fd14f400640 1 -- 172.21.15.17:0/52333544 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 51) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd154021070 con 0x55927ed91560 2024-09-13T16:12:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.596+0000 7fd172c84740 10 client.26464 fetch_fsmap finished waiting for FSMap version 51 2024-09-13T16:12:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.596+0000 7fd172c84740 10 client.26464 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:12:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.596+0000 7fd172c84740 20 client.26464 populate_metadata read hostname 'smithi017' 2024-09-13T16:12:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.596+0000 7fd172c84740 1 --2- 172.21.15.17:0/52333544 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55927ee0e910 0x55927ee10d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.596+0000 7fd172c84740 4 client.26464 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:12:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.596+0000 7fd172c84740 1 -- 172.21.15.17:0/52333544 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55927e9e7300 con 0x55927ee0e910 2024-09-13T16:12:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.596+0000 7fd16ca00640 1 --2- 172.21.15.17:0/52333544 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55927ee0e910 0x55927ee10d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.597+0000 7fd16ca00640 1 --2- 172.21.15.17:0/52333544 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55927ee0e910 0x55927ee10d30 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff5b0c36e79584f7 server_cookie=c47999040476a12e in_seq=0 out_seq=0 2024-09-13T16:12:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.597+0000 7fd14f400640 10 client.26464 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:12:38.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:38 smithi189 ceph-mon[34790]: pgmap v831: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.4 MiB/s wr, 540 op/s 2024-09-13T16:12:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.697+0000 7fd14f400640 1 -- 172.21.15.17:0/52333544 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55927e9e7300 con 0x55927ee0e910 2024-09-13T16:12:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.697+0000 7fd14f400640 10 client.26464 handle_command_reply: tid=0 2024-09-13T16:12:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.697+0000 7fd172c84740 1 client.26464 shutdown 2024-09-13T16:12:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.698+0000 7fd172c84740 1 -- 172.21.15.17:0/52333544 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed91560 msgr2=0x55927ed9e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.698+0000 7fd172c84740 1 --2- 172.21.15.17:0/52333544 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed91560 0x55927ed9e310 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd154009780 tx=0x7fd154011420 comp rx=0 tx=0).stop 2024-09-13T16:12:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.698+0000 7fd172c84740 1 -- 172.21.15.17:0/52333544 shutdown_connections 2024-09-13T16:12:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.698+0000 7fd172c84740 1 --2- 172.21.15.17:0/52333544 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x55927ee0e910 0x55927ee10d30 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.698+0000 7fd172c84740 1 --2- 172.21.15.17:0/52333544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55927ed965f0 0x55927eda1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.698+0000 7fd172c84740 1 --2- 172.21.15.17:0/52333544 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55927ed91560 0x55927ed9e310 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.698+0000 7fd172c84740 1 --2- 172.21.15.17:0/52333544 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55927ed90c20 0x55927ed9ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.698+0000 7fd172c84740 1 -- 172.21.15.17:0/52333544 >> 172.21.15.17:0/52333544 conn(0x55927ed8c290 msgr2=0x55927ed95620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.698+0000 7fd14f400640 0 client.26464 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:12:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.698+0000 7fd172c84740 1 -- 172.21.15.17:0/52333544 shutdown_connections 2024-09-13T16:12:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.699+0000 7fd172c84740 1 -- 172.21.15.17:0/52333544 wait complete. 2024-09-13T16:12:38.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.699+0000 7fd172c84740 20 client.26464 trim_cache size 0 max 16384 2024-09-13T16:12:38.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:12:38.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:12:38.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:12:38.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:12:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.700+0000 7fd16e800640 1 -- 172.21.15.17:0/1159854478 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd1500a11b0 msgr2=0x7fd1500a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.700+0000 7fd16e800640 1 --2- 172.21.15.17:0/1159854478 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd1500a11b0 0x7fd1500a3670 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd1600961a0 tx=0x7fd1600048b0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.700+0000 7fd16e800640 1 -- 172.21.15.17:0/1159854478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1681079c0 msgr2=0x7fd168108cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.700+0000 7fd16e800640 1 --2- 172.21.15.17:0/1159854478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1681079c0 0x7fd168108cc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd160009fd0 tx=0x7fd16000c800 comp rx=0 tx=0).stop 2024-09-13T16:12:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.700+0000 7fd16e800640 1 -- 172.21.15.17:0/1159854478 shutdown_connections 2024-09-13T16:12:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.700+0000 7fd16e800640 1 --2- 172.21.15.17:0/1159854478 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fd1500a11b0 0x7fd1500a3670 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.700+0000 7fd16e800640 1 --2- 172.21.15.17:0/1159854478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1681079c0 0x7fd168108cc0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.700+0000 7fd16e800640 1 --2- 172.21.15.17:0/1159854478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd168071690 0x7fd168108780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.700+0000 7fd16e800640 1 --2- 172.21.15.17:0/1159854478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd168070cd0 0x7fd16810a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.700+0000 7fd16e800640 1 -- 172.21.15.17:0/1159854478 >> 172.21.15.17:0/1159854478 conn(0x7fd16806cd10 msgr2=0x7fd16810ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.701+0000 7fd16e800640 1 -- 172.21.15.17:0/1159854478 shutdown_connections 2024-09-13T16:12:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:38.701+0000 7fd16e800640 1 -- 172.21.15.17:0/1159854478 wait complete. 2024-09-13T16:12:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 895.0 s, 454.4 tps, lat 219.227 ms stddev 236.213 2024-09-13T16:12:40.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:40 smithi193 ceph-mon[35248]: pgmap v832: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.7 MiB/s wr, 482 op/s 2024-09-13T16:12:40.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:40 smithi017 ceph-mon[30494]: pgmap v832: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.7 MiB/s wr, 482 op/s 2024-09-13T16:12:40.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:40 smithi189 ceph-mon[34790]: pgmap v832: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.7 MiB/s wr, 482 op/s 2024-09-13T16:12:42.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:42 smithi193 ceph-mon[35248]: pgmap v833: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 558 op/s 2024-09-13T16:12:42.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:42 smithi017 ceph-mon[30494]: pgmap v833: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 558 op/s 2024-09-13T16:12:42.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:42 smithi189 ceph-mon[34790]: pgmap v833: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 558 op/s 2024-09-13T16:12:44.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:44 smithi193 ceph-mon[35248]: pgmap v834: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.7 MiB/s wr, 557 op/s 2024-09-13T16:12:44.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:44 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:12:44.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:44 smithi017 ceph-mon[30494]: pgmap v834: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.7 MiB/s wr, 557 op/s 2024-09-13T16:12:44.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:44 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:12:44.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:44 smithi189 ceph-mon[34790]: pgmap v834: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.7 MiB/s wr, 557 op/s 2024-09-13T16:12:44.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:44 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:12:45.313 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 900.0 s, 488.4 tps, lat 207.443 ms stddev 245.897 2024-09-13T16:12:45.504 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:45 smithi193 ceph-mon[35248]: pgmap v835: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.7 MiB/s wr, 536 op/s 2024-09-13T16:12:45.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:45 smithi017 ceph-mon[30494]: pgmap v835: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.7 MiB/s wr, 536 op/s 2024-09-13T16:12:45.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:45 smithi189 ceph-mon[34790]: pgmap v835: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.7 MiB/s wr, 536 op/s 2024-09-13T16:12:45.850 INFO:teuthology.orchestra.run.smithi017.stdout:transaction type: 2024-09-13T16:12:45.851 INFO:teuthology.orchestra.run.smithi017.stdout:scaling factor: 32 2024-09-13T16:12:45.851 INFO:teuthology.orchestra.run.smithi017.stdout:query mode: simple 2024-09-13T16:12:45.851 INFO:teuthology.orchestra.run.smithi017.stdout:number of clients: 100 2024-09-13T16:12:45.851 INFO:teuthology.orchestra.run.smithi017.stdout:number of threads: 4 2024-09-13T16:12:45.851 INFO:teuthology.orchestra.run.smithi017.stdout:duration: 900 s 2024-09-13T16:12:45.851 INFO:teuthology.orchestra.run.smithi017.stdout:number of transactions actually processed: 818195 2024-09-13T16:12:45.851 INFO:teuthology.orchestra.run.smithi017.stdout:latency average = 110.002 ms 2024-09-13T16:12:45.851 INFO:teuthology.orchestra.run.smithi017.stdout:latency stddev = 168.122 ms 2024-09-13T16:12:45.851 INFO:teuthology.orchestra.run.smithi017.stdout:tps = 908.563656 (including connections establishing) 2024-09-13T16:12:45.851 INFO:teuthology.orchestra.run.smithi017.stdout:tps = 908.569897 (excluding connections establishing) 2024-09-13T16:12:45.877 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-09-13T16:12:48.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:47 smithi193 ceph-mon[35248]: pgmap v836: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.1 MiB/s wr, 618 op/s 2024-09-13T16:12:48.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:47 smithi017 ceph-mon[30494]: pgmap v836: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.1 MiB/s wr, 618 op/s 2024-09-13T16:12:48.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:47 smithi189 ceph-mon[34790]: pgmap v836: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.1 MiB/s wr, 618 op/s 2024-09-13T16:12:49.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:48 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:12:49.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:48 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:12:49.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:48 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:12:50.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:49 smithi189 ceph-mon[34790]: pgmap v837: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.5 MiB/s wr, 568 op/s 2024-09-13T16:12:50.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:49 smithi193 ceph-mon[35248]: pgmap v837: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.5 MiB/s wr, 568 op/s 2024-09-13T16:12:50.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:49 smithi017 ceph-mon[30494]: pgmap v837: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.5 MiB/s wr, 568 op/s 2024-09-13T16:12:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.870+0000 7fe94e600640 1 -- 172.21.15.17:0/1873930923 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe948100f40 msgr2=0x7fe9481013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.870+0000 7fe94e600640 1 --2- 172.21.15.17:0/1873930923 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe948100f40 0x7fe9481013c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe934009900 tx=0x7fe93402a400 comp rx=0 tx=0).stop 2024-09-13T16:12:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.870+0000 7fe94e600640 1 -- 172.21.15.17:0/1873930923 shutdown_connections 2024-09-13T16:12:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.871+0000 7fe94e600640 1 --2- 172.21.15.17:0/1873930923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe948101900 0x7fe948108190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.871+0000 7fe94e600640 1 --2- 172.21.15.17:0/1873930923 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe948100f40 0x7fe9481013c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.871+0000 7fe94e600640 1 --2- 172.21.15.17:0/1873930923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9480ffd50 0x7fe948100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.871+0000 7fe94e600640 1 -- 172.21.15.17:0/1873930923 >> 172.21.15.17:0/1873930923 conn(0x7fe9480fb4b0 msgr2=0x7fe9480fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.871+0000 7fe94e600640 1 -- 172.21.15.17:0/1873930923 shutdown_connections 2024-09-13T16:12:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.871+0000 7fe94e600640 1 -- 172.21.15.17:0/1873930923 wait complete. 2024-09-13T16:12:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.872+0000 7fe94e600640 1 Processor -- start 2024-09-13T16:12:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.872+0000 7fe94e600640 1 -- start start 2024-09-13T16:12:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.873+0000 7fe94e600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9480ffd50 0x7fe948195cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.873+0000 7fe94e600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe948100f40 0x7fe948196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.873+0000 7fe94e600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe948101900 0x7fe94819d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.873+0000 7fe94e600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94819d7d0 con 0x7fe948101900 2024-09-13T16:12:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.873+0000 7fe94e600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94819d940 con 0x7fe948100f40 2024-09-13T16:12:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.873+0000 7fe94e600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94819db00 con 0x7fe9480ffd50 2024-09-13T16:12:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.873+0000 7fe947400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9480ffd50 0x7fe948195cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.873+0000 7fe946a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe948100f40 0x7fe948196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.873+0000 7fe947400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9480ffd50 0x7fe948195cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:48630/0 (socket says 172.21.15.17:48630) 2024-09-13T16:12:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.873+0000 7fe947400640 1 -- 172.21.15.17:0/3292076239 learned_addr learned my addr 172.21.15.17:0/3292076239 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.873+0000 7fe947e00640 1 --2- 172.21.15.17:0/3292076239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe948101900 0x7fe94819d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.873+0000 7fe947400640 1 -- 172.21.15.17:0/3292076239 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe948100f40 msgr2=0x7fe948196230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.873+0000 7fe947400640 1 --2- 172.21.15.17:0/3292076239 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe948100f40 0x7fe948196230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.873+0000 7fe947400640 1 -- 172.21.15.17:0/3292076239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe948101900 msgr2=0x7fe94819d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.873+0000 7fe947400640 1 --2- 172.21.15.17:0/3292076239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe948101900 0x7fe94819d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.873+0000 7fe947400640 1 -- 172.21.15.17:0/3292076239 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe934009560 con 0x7fe9480ffd50 2024-09-13T16:12:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.873+0000 7fe946a00640 1 --2- 172.21.15.17:0/3292076239 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe948100f40 0x7fe948196230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:12:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.874+0000 7fe947400640 1 --2- 172.21.15.17:0/3292076239 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9480ffd50 0x7fe948195cf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe93800e9c0 tx=0x7fe93800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.874+0000 7fe93fe00640 1 -- 172.21.15.17:0/3292076239 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe938009700 con 0x7fe9480ffd50 2024-09-13T16:12:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.874+0000 7fe93fe00640 1 -- 172.21.15.17:0/3292076239 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe9380044e0 con 0x7fe9480ffd50 2024-09-13T16:12:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.874+0000 7fe94e600640 1 -- 172.21.15.17:0/3292076239 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe94819dde0 con 0x7fe9480ffd50 2024-09-13T16:12:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.874+0000 7fe93fe00640 1 -- 172.21.15.17:0/3292076239 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe938010430 con 0x7fe9480ffd50 2024-09-13T16:12:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.874+0000 7fe94e600640 1 -- 172.21.15.17:0/3292076239 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94819e210 con 0x7fe9480ffd50 2024-09-13T16:12:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.878+0000 7fe93fe00640 1 -- 172.21.15.17:0/3292076239 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe938003f60 con 0x7fe9480ffd50 2024-09-13T16:12:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.879+0000 7fe951413740 1 Processor -- start 2024-09-13T16:12:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.879+0000 7fe951413740 1 -- start start 2024-09-13T16:12:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.879+0000 7fe93fe00640 1 --2- 172.21.15.17:0/3292076239 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe92c0a1110 0x7fe92c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.879+0000 7fe93fe00640 1 -- 172.21.15.17:0/3292076239 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fe938014070 con 0x7fe9480ffd50 2024-09-13T16:12:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.880+0000 7fe951413740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b83951a70 0x564b83951e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.880+0000 7fe951413740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b839523b0 0x564b83961780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.880+0000 7fe951413740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b83961cc0 0x564b839640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.880+0000 7fe951413740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b8385fbb0 con 0x564b83961cc0 2024-09-13T16:12:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.880+0000 7fe951413740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b838bda70 con 0x564b839523b0 2024-09-13T16:12:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.880+0000 7fe951413740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b838bb200 con 0x564b83951a70 2024-09-13T16:12:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.880+0000 7fe947e00640 1 --2- 172.21.15.17:0/3292076239 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe92c0a1110 0x7fe92c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.880+0000 7fe947400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b83951a70 0x564b83951e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.880+0000 7fe946a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b839523b0 0x564b83961780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.880+0000 7fe947400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b83951a70 0x564b83951e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:48646/0 (socket says 172.21.15.17:48646) 2024-09-13T16:12:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.880+0000 7fe947400640 1 -- 172.21.15.17:0/2535046802 learned_addr learned my addr 172.21.15.17:0/2535046802 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.880+0000 7fe947400640 1 -- 172.21.15.17:0/2535046802 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b839523b0 msgr2=0x564b83961780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.880+0000 7fe947e00640 1 --2- 172.21.15.17:0/2535046802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b83961cc0 0x564b839640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.880+0000 7fe947400640 1 --2- 172.21.15.17:0/2535046802 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b839523b0 0x564b83961780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.880+0000 7fe947400640 1 -- 172.21.15.17:0/2535046802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b83961cc0 msgr2=0x564b839640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:51.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.880+0000 7fe947400640 1 --2- 172.21.15.17:0/2535046802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b83961cc0 0x564b839640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.880+0000 7fe947400640 1 -- 172.21.15.17:0/2535046802 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b83858940 con 0x564b83951a70 2024-09-13T16:12:51.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.881+0000 7fe946a00640 1 --2- 172.21.15.17:0/2535046802 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b839523b0 0x564b83961780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:12:51.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.881+0000 7fe947e00640 1 --2- 172.21.15.17:0/2535046802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b83961cc0 0x564b839640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T16:12:51.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.881+0000 7fe947400640 1 --2- 172.21.15.17:0/2535046802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b83951a70 0x564b83951e70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe9380965c0 tx=0x7fe938099b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e8d987a69f8068 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:51.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.881+0000 7fe93cc00640 1 -- 172.21.15.17:0/2535046802 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93809a150 con 0x564b83951a70 2024-09-13T16:12:51.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.881+0000 7fe93cc00640 1 -- 172.21.15.17:0/2535046802 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe93809df80 con 0x564b83951a70 2024-09-13T16:12:51.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.881+0000 7fe93cc00640 1 -- 172.21.15.17:0/2535046802 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9380a2140 con 0x564b83951a70 2024-09-13T16:12:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.882+0000 7fe951413740 1 -- 172.21.15.17:0/2535046802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b83951a70 msgr2=0x564b83951e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.882+0000 7fe947e00640 1 --2- 172.21.15.17:0/3292076239 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe92c0a1110 0x7fe92c0a35d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe940005fd0 tx=0x7fe940009b00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.882+0000 7fe951413740 1 --2- 172.21.15.17:0/2535046802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b83951a70 0x564b83951e70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe9380965c0 tx=0x7fe938099b70 comp rx=0 tx=0).stop 2024-09-13T16:12:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.883+0000 7fe951413740 1 -- 172.21.15.17:0/2535046802 shutdown_connections 2024-09-13T16:12:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.883+0000 7fe951413740 1 --2- 172.21.15.17:0/2535046802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b83961cc0 0x564b839640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.883+0000 7fe951413740 1 --2- 172.21.15.17:0/2535046802 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b839523b0 0x564b83961780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.883+0000 7fe951413740 1 --2- 172.21.15.17:0/2535046802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b83951a70 0x564b83951e70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.883+0000 7fe951413740 1 -- 172.21.15.17:0/2535046802 >> 172.21.15.17:0/2535046802 conn(0x564b8394f060 msgr2=0x564b8394f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.883+0000 7fe951413740 1 -- 172.21.15.17:0/2535046802 shutdown_connections 2024-09-13T16:12:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.883+0000 7fe951413740 1 -- 172.21.15.17:0/2535046802 wait complete. 2024-09-13T16:12:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.883+0000 7fe951413740 1 -- start start 2024-09-13T16:12:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.884+0000 7fe951413740 1 Processor -- start 2024-09-13T16:12:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.884+0000 7fe951413740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b83951a70 0x564b83965e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.884+0000 7fe951413740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b839523b0 0x564b839663b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.884+0000 7fe951413740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b83961cc0 0x564b8396d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.884+0000 7fe951413740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b838b6af0 con 0x564b839523b0 2024-09-13T16:12:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.884+0000 7fe951413740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b83874f20 con 0x564b83961cc0 2024-09-13T16:12:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.884+0000 7fe951413740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b83874bc0 con 0x564b83951a70 2024-09-13T16:12:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.884+0000 7fe951413740 10 client.0 _ll_register_callbacks cb 0x564b838a6a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:12:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.884+0000 7fe947400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b83951a70 0x564b83965e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.884+0000 7fe947400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b83951a70 0x564b83965e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:48662/0 (socket says 172.21.15.17:48662) 2024-09-13T16:12:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.884+0000 7fe947400640 1 -- 172.21.15.17:0/725597449 learned_addr learned my addr 172.21.15.17:0/725597449 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.884+0000 7fe947e00640 1 --2- 172.21.15.17:0/725597449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b83961cc0 0x564b8396d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.885+0000 7fe946a00640 1 --2- 172.21.15.17:0/725597449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b839523b0 0x564b839663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.885+0000 7fe947400640 1 -- 172.21.15.17:0/725597449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b83961cc0 msgr2=0x564b8396d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.885+0000 7fe947400640 1 --2- 172.21.15.17:0/725597449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b83961cc0 0x564b8396d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.885+0000 7fe947400640 1 -- 172.21.15.17:0/725597449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b839523b0 msgr2=0x564b839663b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.885+0000 7fe947400640 1 --2- 172.21.15.17:0/725597449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b839523b0 0x564b839663b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.885+0000 7fe947400640 1 -- 172.21.15.17:0/725597449 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94819e210 con 0x564b83951a70 2024-09-13T16:12:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.885+0000 7fe946a00640 1 --2- 172.21.15.17:0/725597449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b839523b0 0x564b839663b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:12:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.885+0000 7fe947400640 1 --2- 172.21.15.17:0/725597449 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b83951a70 0x564b83965e70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe9380a20a0 tx=0x7fe938099be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6066c30273b41e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.885+0000 7fe931600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:12:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.885+0000 7fe931600640 1 -- 172.21.15.17:0/725597449 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9380a2340 con 0x564b83951a70 2024-09-13T16:12:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.885+0000 7fe931600640 1 -- 172.21.15.17:0/725597449 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fe9380a25d0 con 0x564b83951a70 2024-09-13T16:12:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.885+0000 7fe951413740 1 -- 172.21.15.17:0/725597449 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b838e0c90 con 0x564b83951a70 2024-09-13T16:12:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.886+0000 7fe931600640 1 -- 172.21.15.17:0/725597449 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe93809a150 con 0x564b83951a70 2024-09-13T16:12:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.886+0000 7fe951413740 10 client.26476 fetch_fsmap learned FSMap version 53 2024-09-13T16:12:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.886+0000 7fe951413740 1 -- 172.21.15.17:0/725597449 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x564b838b5170 con 0x564b83951a70 2024-09-13T16:12:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.886+0000 7fe931600640 1 -- 172.21.15.17:0/725597449 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe9380a6020 con 0x564b83951a70 2024-09-13T16:12:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.886+0000 7fe931600640 1 -- 172.21.15.17:0/725597449 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 53) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fe93801f060 con 0x564b83951a70 2024-09-13T16:12:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.886+0000 7fe951413740 10 client.26476 fetch_fsmap finished waiting for FSMap version 53 2024-09-13T16:12:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.886+0000 7fe951413740 10 client.26476 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:12:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.886+0000 7fe951413740 20 client.26476 populate_metadata read hostname 'smithi017' 2024-09-13T16:12:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.886+0000 7fe951413740 1 --2- 172.21.15.17:0/725597449 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564b83971880 0x564b83973ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.886+0000 7fe951413740 4 client.26476 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T16:12:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.886+0000 7fe951413740 1 -- 172.21.15.17:0/725597449 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b838a97d0 con 0x564b83971880 2024-09-13T16:12:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.887+0000 7fe946a00640 1 --2- 172.21.15.17:0/725597449 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564b83971880 0x564b83973ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.887+0000 7fe946a00640 1 --2- 172.21.15.17:0/725597449 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564b83971880 0x564b83973ca0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=360bfa9440b1272a server_cookie=97c8e68d2e0f74a4 in_seq=0 out_seq=0 2024-09-13T16:12:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.887+0000 7fe931600640 10 client.26476 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:12:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.888+0000 7fe931600640 1 -- 172.21.15.17:0/725597449 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564b838a97d0 con 0x564b83971880 2024-09-13T16:12:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.888+0000 7fe931600640 10 client.26476 handle_command_reply: tid=0 2024-09-13T16:12:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.888+0000 7fe951413740 1 client.26476 shutdown 2024-09-13T16:12:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.888+0000 7fe951413740 1 -- 172.21.15.17:0/725597449 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b83951a70 msgr2=0x564b83965e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.888+0000 7fe951413740 1 --2- 172.21.15.17:0/725597449 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b83951a70 0x564b83965e70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe9380a20a0 tx=0x7fe938099be0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.889+0000 7fe951413740 1 -- 172.21.15.17:0/725597449 shutdown_connections 2024-09-13T16:12:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.889+0000 7fe951413740 1 --2- 172.21.15.17:0/725597449 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564b83971880 0x564b83973ca0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.889+0000 7fe951413740 1 --2- 172.21.15.17:0/725597449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b83961cc0 0x564b8396d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.889+0000 7fe951413740 1 --2- 172.21.15.17:0/725597449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b839523b0 0x564b839663b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.889+0000 7fe951413740 1 --2- 172.21.15.17:0/725597449 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b83951a70 0x564b83965e70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.889+0000 7fe931600640 0 client.26476 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:12:51.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.889+0000 7fe951413740 1 -- 172.21.15.17:0/725597449 >> 172.21.15.17:0/725597449 conn(0x564b8394f060 msgr2=0x564b83950870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:51.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.889+0000 7fe951413740 1 -- 172.21.15.17:0/725597449 shutdown_connections 2024-09-13T16:12:51.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.889+0000 7fe951413740 1 -- 172.21.15.17:0/725597449 wait complete. 2024-09-13T16:12:51.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.889+0000 7fe951413740 20 client.26476 trim_cache size 0 max 16384 2024-09-13T16:12:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.908+0000 7fe951413740 1 Processor -- start 2024-09-13T16:12:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.908+0000 7fe951413740 1 -- start start 2024-09-13T16:12:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.909+0000 7fe951413740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b83951a70 0x564b8394ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.909+0000 7fe951413740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b839523b0 0x564b8396d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.909+0000 7fe951413740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b83961cc0 0x564b8395dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.909+0000 7fe951413740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b8361de60 con 0x564b839523b0 2024-09-13T16:12:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.909+0000 7fe951413740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b838a97d0 con 0x564b83961cc0 2024-09-13T16:12:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.909+0000 7fe951413740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b83967060 con 0x564b83951a70 2024-09-13T16:12:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.909+0000 7fe947400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b83951a70 0x564b8394ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.909+0000 7fe947e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b83961cc0 0x564b8395dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.909+0000 7fe947400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b83951a70 0x564b8394ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:48672/0 (socket says 172.21.15.17:48672) 2024-09-13T16:12:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.909+0000 7fe947400640 1 -- 172.21.15.17:0/886202086 learned_addr learned my addr 172.21.15.17:0/886202086 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.909+0000 7fe946a00640 1 --2- 172.21.15.17:0/886202086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b839523b0 0x564b8396d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.910+0000 7fe947400640 1 -- 172.21.15.17:0/886202086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b83961cc0 msgr2=0x564b8395dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.910+0000 7fe947400640 1 --2- 172.21.15.17:0/886202086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b83961cc0 0x564b8395dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.910+0000 7fe947400640 1 -- 172.21.15.17:0/886202086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b839523b0 msgr2=0x564b8396d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.910+0000 7fe947400640 1 --2- 172.21.15.17:0/886202086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b839523b0 0x564b8396d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.910+0000 7fe947400640 1 -- 172.21.15.17:0/886202086 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b83857180 con 0x564b83951a70 2024-09-13T16:12:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.910+0000 7fe947e00640 1 --2- 172.21.15.17:0/886202086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b83961cc0 0x564b8395dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:12:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.910+0000 7fe946a00640 1 --2- 172.21.15.17:0/886202086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b839523b0 0x564b8396d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:12:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.910+0000 7fe947400640 1 --2- 172.21.15.17:0/886202086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b83951a70 0x564b8394ea20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe9380965c0 tx=0x7fe938003980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31448930d0047100 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.910+0000 7fe93d600640 1 -- 172.21.15.17:0/886202086 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93809f2a0 con 0x564b83951a70 2024-09-13T16:12:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.910+0000 7fe93d600640 1 -- 172.21.15.17:0/886202086 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe9380a6030 con 0x564b83951a70 2024-09-13T16:12:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.910+0000 7fe93d600640 1 -- 172.21.15.17:0/886202086 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9380a23a0 con 0x564b83951a70 2024-09-13T16:12:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.911+0000 7fe951413740 1 -- 172.21.15.17:0/886202086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b83951a70 msgr2=0x564b8394ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:51.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.911+0000 7fe951413740 1 --2- 172.21.15.17:0/886202086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b83951a70 0x564b8394ea20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe9380965c0 tx=0x7fe938003980 comp rx=0 tx=0).stop 2024-09-13T16:12:51.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.911+0000 7fe951413740 1 -- 172.21.15.17:0/886202086 shutdown_connections 2024-09-13T16:12:51.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.911+0000 7fe951413740 1 --2- 172.21.15.17:0/886202086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b83961cc0 0x564b8395dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.911+0000 7fe951413740 1 --2- 172.21.15.17:0/886202086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b839523b0 0x564b8396d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.911+0000 7fe951413740 1 --2- 172.21.15.17:0/886202086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b83951a70 0x564b8394ea20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.911+0000 7fe951413740 1 -- 172.21.15.17:0/886202086 >> 172.21.15.17:0/886202086 conn(0x564b8394f060 msgr2=0x564b8394f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:51.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.911+0000 7fe951413740 1 -- 172.21.15.17:0/886202086 shutdown_connections 2024-09-13T16:12:51.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.911+0000 7fe951413740 1 -- 172.21.15.17:0/886202086 wait complete. 2024-09-13T16:12:51.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.912+0000 7fe951413740 1 -- start start 2024-09-13T16:12:51.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.912+0000 7fe951413740 1 Processor -- start 2024-09-13T16:12:51.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.912+0000 7fe951413740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b83951a70 0x564b8396cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:51.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.912+0000 7fe951413740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b839523b0 0x564b83969a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:51.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.912+0000 7fe951413740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b83961cc0 0x564b83969fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:51.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.912+0000 7fe951413740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b8396a6d0 con 0x564b83961cc0 2024-09-13T16:12:51.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.912+0000 7fe951413740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b8396d650 con 0x564b83951a70 2024-09-13T16:12:51.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.912+0000 7fe951413740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b8396d810 con 0x564b839523b0 2024-09-13T16:12:51.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.912+0000 7fe951413740 10 client.0 _ll_register_callbacks cb 0x7fe938095ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T16:12:51.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.913+0000 7fe946a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b839523b0 0x564b83969a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:51.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.913+0000 7fe947400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b83951a70 0x564b8396cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:51.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.913+0000 7fe946a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b839523b0 0x564b83969a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:48680/0 (socket says 172.21.15.17:48680) 2024-09-13T16:12:51.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.913+0000 7fe946a00640 1 -- 172.21.15.17:0/2551873327 learned_addr learned my addr 172.21.15.17:0/2551873327 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:51.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.913+0000 7fe947e00640 1 --2- 172.21.15.17:0/2551873327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b83961cc0 0x564b83969fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:51.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.913+0000 7fe946a00640 1 -- 172.21.15.17:0/2551873327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b83951a70 msgr2=0x564b8396cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:51.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.913+0000 7fe946a00640 1 --2- 172.21.15.17:0/2551873327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b83951a70 0x564b8396cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.913+0000 7fe946a00640 1 -- 172.21.15.17:0/2551873327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b83961cc0 msgr2=0x564b83969fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T16:12:51.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.913+0000 7fe946a00640 1 --2- 172.21.15.17:0/2551873327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b83961cc0 0x564b83969fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.913+0000 7fe946a00640 1 -- 172.21.15.17:0/2551873327 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9400121a0 con 0x564b839523b0 2024-09-13T16:12:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.913+0000 7fe947e00640 1 --2- 172.21.15.17:0/2551873327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b83961cc0 0x564b83969fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:12:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.913+0000 7fe947400640 1 --2- 172.21.15.17:0/2551873327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b83951a70 0x564b8396cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:12:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.913+0000 7fe946a00640 1 --2- 172.21.15.17:0/2551873327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b839523b0 0x564b83969a90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe93402a920 tx=0x7fe93402ab90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3215978c06cb2924 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.913+0000 7fe931600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-09-13T16:12:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.914+0000 7fe931600640 1 -- 172.21.15.17:0/2551873327 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934042070 con 0x564b839523b0 2024-09-13T16:12:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.914+0000 7fe951413740 1 -- 172.21.15.17:0/2551873327 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe93809df80 con 0x564b839523b0 2024-09-13T16:12:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.914+0000 7fe931600640 1 -- 172.21.15.17:0/2551873327 <== mon.1 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fe9340464a0 con 0x564b839523b0 2024-09-13T16:12:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.914+0000 7fe931600640 1 -- 172.21.15.17:0/2551873327 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe934046a90 con 0x564b839523b0 2024-09-13T16:12:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.914+0000 7fe951413740 10 client.26482 fetch_fsmap learned FSMap version 53 2024-09-13T16:12:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.914+0000 7fe951413740 1 -- 172.21.15.17:0/2551873327 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x564b838b5170 con 0x564b839523b0 2024-09-13T16:12:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.914+0000 7fe931600640 1 -- 172.21.15.17:0/2551873327 <== mon.1 v2:172.21.15.193:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe93809df80 con 0x564b839523b0 2024-09-13T16:12:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.915+0000 7fe931600640 1 -- 172.21.15.17:0/2551873327 <== mon.1 v2:172.21.15.193:3300/0 5 ==== fsmap(e 53) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fe934003710 con 0x564b839523b0 2024-09-13T16:12:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.915+0000 7fe951413740 10 client.26482 fetch_fsmap finished waiting for FSMap version 53 2024-09-13T16:12:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.915+0000 7fe951413740 10 client.26482 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-13T16:12:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.915+0000 7fe951413740 20 client.26482 populate_metadata read hostname 'smithi017' 2024-09-13T16:12:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.915+0000 7fe951413740 1 --2- 172.21.15.17:0/2551873327 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564b839c96c0 0x564b839cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.915+0000 7fe951413740 4 client.26482 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T16:12:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.915+0000 7fe951413740 1 -- 172.21.15.17:0/2551873327 --> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564b835aa300 con 0x564b839c96c0 2024-09-13T16:12:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.915+0000 7fe947400640 1 --2- 172.21.15.17:0/2551873327 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564b839c96c0 0x564b839cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.916+0000 7fe931600640 10 client.26482 ms_handle_connect on v2:172.21.15.189:6838/2624723395 2024-09-13T16:12:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.916+0000 7fe947400640 1 --2- 172.21.15.17:0/2551873327 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564b839c96c0 0x564b839cbae0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3d6e508f3549543 server_cookie=88c5807499d5171 in_seq=0 out_seq=0 2024-09-13T16:12:51.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.930+0000 7fe931600640 1 -- 172.21.15.17:0/2551873327 <== mds.0 v2:172.21.15.189:6838/2624723395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564b835aa300 con 0x564b839c96c0 2024-09-13T16:12:51.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.930+0000 7fe931600640 10 client.26482 handle_command_reply: tid=0 2024-09-13T16:12:51.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.930+0000 7fe951413740 1 client.26482 shutdown 2024-09-13T16:12:51.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.930+0000 7fe951413740 1 -- 172.21.15.17:0/2551873327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b839523b0 msgr2=0x564b83969a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:51.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.930+0000 7fe951413740 1 --2- 172.21.15.17:0/2551873327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b839523b0 0x564b83969a90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe93402a920 tx=0x7fe93402ab90 comp rx=0 tx=0).stop 2024-09-13T16:12:51.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.931+0000 7fe951413740 1 -- 172.21.15.17:0/2551873327 shutdown_connections 2024-09-13T16:12:51.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.931+0000 7fe951413740 1 --2- 172.21.15.17:0/2551873327 >> [v2:172.21.15.189:6838/2624723395,v1:172.21.15.189:6839/2624723395] conn(0x564b839c96c0 0x564b839cbae0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.931+0000 7fe951413740 1 --2- 172.21.15.17:0/2551873327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564b83961cc0 0x564b83969fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.931+0000 7fe931600640 0 client.26482 ms_handle_reset on v2:172.21.15.189:6838/2624723395 2024-09-13T16:12:51.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.931+0000 7fe951413740 1 --2- 172.21.15.17:0/2551873327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564b839523b0 0x564b83969a90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.931+0000 7fe951413740 1 --2- 172.21.15.17:0/2551873327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564b83951a70 0x564b8396cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.931+0000 7fe951413740 1 -- 172.21.15.17:0/2551873327 >> 172.21.15.17:0/2551873327 conn(0x564b8394f060 msgr2=0x564b83965c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:51.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.931+0000 7fe951413740 1 -- 172.21.15.17:0/2551873327 shutdown_connections 2024-09-13T16:12:51.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.931+0000 7fe951413740 1 -- 172.21.15.17:0/2551873327 wait complete. 2024-09-13T16:12:51.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-13T16:12:51.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-13T16:12:51.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-13T16:12:51.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-13T16:12:51.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.932+0000 7fe951413740 20 client.26482 trim_cache size 0 max 16384 2024-09-13T16:12:51.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.932+0000 7fe94e600640 1 -- 172.21.15.17:0/3292076239 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe92c0a1110 msgr2=0x7fe92c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:51.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.932+0000 7fe94e600640 1 --2- 172.21.15.17:0/3292076239 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe92c0a1110 0x7fe92c0a35d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe940005fd0 tx=0x7fe940009b00 comp rx=0 tx=0).stop 2024-09-13T16:12:51.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.932+0000 7fe94e600640 1 -- 172.21.15.17:0/3292076239 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9480ffd50 msgr2=0x7fe948195cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:51.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.932+0000 7fe94e600640 1 --2- 172.21.15.17:0/3292076239 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9480ffd50 0x7fe948195cf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe93800e9c0 tx=0x7fe93800ee80 comp rx=0 tx=0).stop 2024-09-13T16:12:51.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.932+0000 7fe94e600640 1 -- 172.21.15.17:0/3292076239 shutdown_connections 2024-09-13T16:12:51.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.932+0000 7fe94e600640 1 --2- 172.21.15.17:0/3292076239 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe92c0a1110 0x7fe92c0a35d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.932+0000 7fe94e600640 1 --2- 172.21.15.17:0/3292076239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe948101900 0x7fe94819d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.932+0000 7fe94e600640 1 --2- 172.21.15.17:0/3292076239 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe948100f40 0x7fe948196230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.932+0000 7fe94e600640 1 --2- 172.21.15.17:0/3292076239 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9480ffd50 0x7fe948195cf0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:51.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.932+0000 7fe94e600640 1 -- 172.21.15.17:0/3292076239 >> 172.21.15.17:0/3292076239 conn(0x7fe9480fb4b0 msgr2=0x7fe9481043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:51.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.933+0000 7fe94e600640 1 -- 172.21.15.17:0/3292076239 shutdown_connections 2024-09-13T16:12:51.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-13T16:12:51.933+0000 7fe94e600640 1 -- 172.21.15.17:0/3292076239 wait complete. 2024-09-13T16:12:52.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:51 smithi189 ceph-mon[34790]: pgmap v838: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.9 MiB/s wr, 710 op/s 2024-09-13T16:12:52.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:51 smithi193 ceph-mon[35248]: pgmap v838: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.9 MiB/s wr, 710 op/s 2024-09-13T16:12:52.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:51 smithi017 ceph-mon[30494]: pgmap v838: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.9 MiB/s wr, 710 op/s 2024-09-13T16:12:54.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:53 smithi189 ceph-mon[34790]: pgmap v839: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.3 MiB/s wr, 729 op/s 2024-09-13T16:12:54.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:53 smithi193 ceph-mon[35248]: pgmap v839: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.3 MiB/s wr, 729 op/s 2024-09-13T16:12:54.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:53 smithi017 ceph-mon[30494]: pgmap v839: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.3 MiB/s wr, 729 op/s 2024-09-13T16:12:56.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:55 smithi189 ceph-mon[34790]: pgmap v840: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.2 MiB/s wr, 662 op/s 2024-09-13T16:12:56.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:55 smithi193 ceph-mon[35248]: pgmap v840: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.2 MiB/s wr, 662 op/s 2024-09-13T16:12:56.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:55 smithi017 ceph-mon[30494]: pgmap v840: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.2 MiB/s wr, 662 op/s 2024-09-13T16:12:58.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:57 smithi017 ceph-mon[30494]: pgmap v841: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.8 MiB/s wr, 775 op/s 2024-09-13T16:12:58.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:57 smithi189 ceph-mon[34790]: pgmap v841: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.8 MiB/s wr, 775 op/s 2024-09-13T16:12:58.179 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-13T16:12:58.256 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:57 smithi193 ceph-mon[35248]: pgmap v841: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.8 MiB/s wr, 775 op/s 2024-09-13T16:12:58.317 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/: 2024-09-13T16:12:58.317 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T16:12:58.317 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 . 2024-09-13T16:12:58.317 INFO:teuthology.orchestra.run.smithi017.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 .. 2024-09-13T16:12:58.317 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 13 16:12 data 2024-09-13T16:12:58.317 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.317 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data: 2024-09-13T16:12:58.318 INFO:teuthology.orchestra.run.smithi017.stdout:total 36 2024-09-13T16:12:58.318 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 13 16:12 . 2024-09-13T16:12:58.318 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 .. 2024-09-13T16:12:58.318 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 13 15:57 base 2024-09-13T16:12:58.318 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Sep 13 15:57 current_logfiles 2024-09-13T16:12:58.318 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 13 15:57 global 2024-09-13T16:12:58.318 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 log 2024-09-13T16:12:58.318 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 pg_commit_ts 2024-09-13T16:12:58.318 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 pg_dynshmem 2024-09-13T16:12:58.318 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 13 15:57 pg_hba.conf 2024-09-13T16:12:58.318 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 13 15:57 pg_ident.conf 2024-09-13T16:12:58.318 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 16:12 pg_logical 2024-09-13T16:12:58.318 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 13 15:57 pg_multixact 2024-09-13T16:12:58.318 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 pg_notify 2024-09-13T16:12:58.319 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 pg_replslot 2024-09-13T16:12:58.319 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 pg_serial 2024-09-13T16:12:58.319 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 pg_snapshots 2024-09-13T16:12:58.319 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 16:12 pg_stat 2024-09-13T16:12:58.319 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 16:12 pg_stat_tmp 2024-09-13T16:12:58.319 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 16:12 pg_subtrans 2024-09-13T16:12:58.319 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 pg_tblspc 2024-09-13T16:12:58.319 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 pg_twophase 2024-09-13T16:12:58.319 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 15:57 PG_VERSION 2024-09-13T16:12:58.319 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 13 16:12 pg_wal 2024-09-13T16:12:58.319 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 pg_xact 2024-09-13T16:12:58.319 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 13 15:57 postgresql.auto.conf 2024-09-13T16:12:58.319 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 13 15:57 postgresql.conf 2024-09-13T16:12:58.319 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Sep 13 15:57 postmaster.opts 2024-09-13T16:12:58.320 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.320 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base: 2024-09-13T16:12:58.320 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T16:12:58.320 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 13 15:57 . 2024-09-13T16:12:58.320 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 13 16:12 .. 2024-09-13T16:12:58.320 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 13 15:57 1 2024-09-13T16:12:58.320 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 13 15:57 13493 2024-09-13T16:12:58.320 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Sep 13 16:04 13494 2024-09-13T16:12:58.320 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 pgsql_tmp 2024-09-13T16:12:58.320 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.320 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-13T16:12:58.320 INFO:teuthology.orchestra.run.smithi017.stdout:total 7777 2024-09-13T16:12:58.320 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 13 15:57 . 2024-09-13T16:12:58.321 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 13 15:57 .. 2024-09-13T16:12:58.321 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 112 2024-09-13T16:12:58.321 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 113 2024-09-13T16:12:58.321 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 13 15:57 1247 2024-09-13T16:12:58.321 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1247_fsm 2024-09-13T16:12:58.321 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1247_vm 2024-09-13T16:12:58.321 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 13 15:57 1249 2024-09-13T16:12:58.321 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1249_fsm 2024-09-13T16:12:58.321 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1249_vm 2024-09-13T16:12:58.321 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 13 15:57 1255 2024-09-13T16:12:58.321 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1255_fsm 2024-09-13T16:12:58.322 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1255_vm 2024-09-13T16:12:58.322 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 13 15:57 1259 2024-09-13T16:12:58.322 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1259_fsm 2024-09-13T16:12:58.322 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1259_vm 2024-09-13T16:12:58.322 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 13 15:57 13344 2024-09-13T16:12:58.322 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13344_fsm 2024-09-13T16:12:58.322 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13344_vm 2024-09-13T16:12:58.322 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13346 2024-09-13T16:12:58.322 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13348 2024-09-13T16:12:58.322 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13349 2024-09-13T16:12:58.323 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13349_fsm 2024-09-13T16:12:58.323 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13349_vm 2024-09-13T16:12:58.323 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13351 2024-09-13T16:12:58.323 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13353 2024-09-13T16:12:58.323 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13354 2024-09-13T16:12:58.323 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13354_fsm 2024-09-13T16:12:58.323 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13354_vm 2024-09-13T16:12:58.323 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13356 2024-09-13T16:12:58.323 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13358 2024-09-13T16:12:58.323 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13359 2024-09-13T16:12:58.323 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13359_fsm 2024-09-13T16:12:58.323 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13359_vm 2024-09-13T16:12:58.324 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13361 2024-09-13T16:12:58.324 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13363 2024-09-13T16:12:58.324 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 1417 2024-09-13T16:12:58.324 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 1418 2024-09-13T16:12:58.324 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 174 2024-09-13T16:12:58.324 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 175 2024-09-13T16:12:58.324 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2187 2024-09-13T16:12:58.324 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2224 2024-09-13T16:12:58.324 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2328 2024-09-13T16:12:58.324 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2336 2024-09-13T16:12:58.324 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2337 2024-09-13T16:12:58.324 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2579 2024-09-13T16:12:58.324 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2600 2024-09-13T16:12:58.324 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2600_fsm 2024-09-13T16:12:58.325 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2600_vm 2024-09-13T16:12:58.325 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2601 2024-09-13T16:12:58.325 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2601_fsm 2024-09-13T16:12:58.325 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2601_vm 2024-09-13T16:12:58.325 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 13 15:57 2602 2024-09-13T16:12:58.325 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2602_fsm 2024-09-13T16:12:58.325 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2602_vm 2024-09-13T16:12:58.325 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2603 2024-09-13T16:12:58.325 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2603_fsm 2024-09-13T16:12:58.325 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2603_vm 2024-09-13T16:12:58.325 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2604 2024-09-13T16:12:58.325 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2605 2024-09-13T16:12:58.325 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2605_fsm 2024-09-13T16:12:58.325 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2605_vm 2024-09-13T16:12:58.326 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2606 2024-09-13T16:12:58.326 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2606_fsm 2024-09-13T16:12:58.326 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2606_vm 2024-09-13T16:12:58.326 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2607 2024-09-13T16:12:58.326 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2607_fsm 2024-09-13T16:12:58.326 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2607_vm 2024-09-13T16:12:58.326 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 13 15:57 2608 2024-09-13T16:12:58.326 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2608_fsm 2024-09-13T16:12:58.326 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2608_vm 2024-09-13T16:12:58.326 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 13 15:57 2609 2024-09-13T16:12:58.326 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2609_fsm 2024-09-13T16:12:58.326 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2609_vm 2024-09-13T16:12:58.326 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2610 2024-09-13T16:12:58.327 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2610_fsm 2024-09-13T16:12:58.327 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2610_vm 2024-09-13T16:12:58.327 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2611 2024-09-13T16:12:58.327 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2612 2024-09-13T16:12:58.327 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2612_fsm 2024-09-13T16:12:58.327 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2612_vm 2024-09-13T16:12:58.327 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2613 2024-09-13T16:12:58.327 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2615 2024-09-13T16:12:58.327 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2615_fsm 2024-09-13T16:12:58.327 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2615_vm 2024-09-13T16:12:58.328 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2616 2024-09-13T16:12:58.328 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2616_fsm 2024-09-13T16:12:58.328 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2616_vm 2024-09-13T16:12:58.328 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 13 15:57 2617 2024-09-13T16:12:58.328 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2617_fsm 2024-09-13T16:12:58.328 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2617_vm 2024-09-13T16:12:58.328 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 13 15:57 2618 2024-09-13T16:12:58.328 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2618_fsm 2024-09-13T16:12:58.328 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2618_vm 2024-09-13T16:12:58.328 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 13 15:57 2619 2024-09-13T16:12:58.328 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2619_fsm 2024-09-13T16:12:58.328 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2619_vm 2024-09-13T16:12:58.328 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2620 2024-09-13T16:12:58.328 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2650 2024-09-13T16:12:58.329 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2651 2024-09-13T16:12:58.329 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2652 2024-09-13T16:12:58.329 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2653 2024-09-13T16:12:58.329 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2654 2024-09-13T16:12:58.329 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2655 2024-09-13T16:12:58.329 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2656 2024-09-13T16:12:58.329 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2657 2024-09-13T16:12:58.329 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 13 15:57 2658 2024-09-13T16:12:58.329 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 13 15:57 2659 2024-09-13T16:12:58.329 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2660 2024-09-13T16:12:58.329 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2661 2024-09-13T16:12:58.329 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2662 2024-09-13T16:12:58.329 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 13 15:57 2663 2024-09-13T16:12:58.329 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2664 2024-09-13T16:12:58.330 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2665 2024-09-13T16:12:58.330 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2666 2024-09-13T16:12:58.330 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2667 2024-09-13T16:12:58.330 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2668 2024-09-13T16:12:58.330 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2669 2024-09-13T16:12:58.330 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2670 2024-09-13T16:12:58.330 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 13 15:57 2673 2024-09-13T16:12:58.330 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 13 15:57 2674 2024-09-13T16:12:58.330 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 13 15:57 2675 2024-09-13T16:12:58.330 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2678 2024-09-13T16:12:58.330 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2679 2024-09-13T16:12:58.330 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2680 2024-09-13T16:12:58.330 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2681 2024-09-13T16:12:58.330 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2682 2024-09-13T16:12:58.330 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2683 2024-09-13T16:12:58.331 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2684 2024-09-13T16:12:58.331 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2685 2024-09-13T16:12:58.331 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2686 2024-09-13T16:12:58.331 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2687 2024-09-13T16:12:58.331 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2688 2024-09-13T16:12:58.331 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 13 15:57 2689 2024-09-13T16:12:58.331 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 13 15:57 2690 2024-09-13T16:12:58.331 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 13 15:57 2691 2024-09-13T16:12:58.331 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2692 2024-09-13T16:12:58.331 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2693 2024-09-13T16:12:58.332 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2696 2024-09-13T16:12:58.332 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2699 2024-09-13T16:12:58.332 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2701 2024-09-13T16:12:58.332 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2702 2024-09-13T16:12:58.332 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2703 2024-09-13T16:12:58.332 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2704 2024-09-13T16:12:58.332 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2753 2024-09-13T16:12:58.333 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2753_fsm 2024-09-13T16:12:58.333 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2753_vm 2024-09-13T16:12:58.333 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2754 2024-09-13T16:12:58.333 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2755 2024-09-13T16:12:58.333 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2756 2024-09-13T16:12:58.333 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2757 2024-09-13T16:12:58.333 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2830 2024-09-13T16:12:58.333 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2831 2024-09-13T16:12:58.333 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2832 2024-09-13T16:12:58.333 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2833 2024-09-13T16:12:58.333 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2834 2024-09-13T16:12:58.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2835 2024-09-13T16:12:58.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2836 2024-09-13T16:12:58.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2837 2024-09-13T16:12:58.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 13 15:57 2838 2024-09-13T16:12:58.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2838_fsm 2024-09-13T16:12:58.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2838_vm 2024-09-13T16:12:58.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2839 2024-09-13T16:12:58.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2840 2024-09-13T16:12:58.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2840_fsm 2024-09-13T16:12:58.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2840_vm 2024-09-13T16:12:58.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2841 2024-09-13T16:12:58.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2995 2024-09-13T16:12:58.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2996 2024-09-13T16:12:58.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3079 2024-09-13T16:12:58.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3079_fsm 2024-09-13T16:12:58.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3079_vm 2024-09-13T16:12:58.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3080 2024-09-13T16:12:58.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3081 2024-09-13T16:12:58.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 3085 2024-09-13T16:12:58.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3118 2024-09-13T16:12:58.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3119 2024-09-13T16:12:58.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 13 15:57 3164 2024-09-13T16:12:58.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3256 2024-09-13T16:12:58.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3257 2024-09-13T16:12:58.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3258 2024-09-13T16:12:58.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3350 2024-09-13T16:12:58.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3351 2024-09-13T16:12:58.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3379 2024-09-13T16:12:58.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3380 2024-09-13T16:12:58.336 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3381 2024-09-13T16:12:58.336 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3394 2024-09-13T16:12:58.336 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3394_fsm 2024-09-13T16:12:58.336 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3394_vm 2024-09-13T16:12:58.336 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3395 2024-09-13T16:12:58.336 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3429 2024-09-13T16:12:58.336 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3430 2024-09-13T16:12:58.336 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3431 2024-09-13T16:12:58.336 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3433 2024-09-13T16:12:58.336 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3439 2024-09-13T16:12:58.336 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3440 2024-09-13T16:12:58.336 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 3455 2024-09-13T16:12:58.336 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 13 15:57 3456 2024-09-13T16:12:58.336 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3456_fsm 2024-09-13T16:12:58.337 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3456_vm 2024-09-13T16:12:58.337 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3466 2024-09-13T16:12:58.337 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3467 2024-09-13T16:12:58.337 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3468 2024-09-13T16:12:58.337 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3501 2024-09-13T16:12:58.337 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3502 2024-09-13T16:12:58.337 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3503 2024-09-13T16:12:58.337 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3534 2024-09-13T16:12:58.337 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3541 2024-09-13T16:12:58.337 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3541_fsm 2024-09-13T16:12:58.337 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3541_vm 2024-09-13T16:12:58.337 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3542 2024-09-13T16:12:58.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3574 2024-09-13T16:12:58.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3575 2024-09-13T16:12:58.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3576 2024-09-13T16:12:58.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3596 2024-09-13T16:12:58.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3597 2024-09-13T16:12:58.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3598 2024-09-13T16:12:58.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3599 2024-09-13T16:12:58.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3600 2024-09-13T16:12:58.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3600_fsm 2024-09-13T16:12:58.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3600_vm 2024-09-13T16:12:58.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3601 2024-09-13T16:12:58.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3601_fsm 2024-09-13T16:12:58.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3601_vm 2024-09-13T16:12:58.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3602 2024-09-13T16:12:58.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3602_fsm 2024-09-13T16:12:58.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3602_vm 2024-09-13T16:12:58.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3603 2024-09-13T16:12:58.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3603_fsm 2024-09-13T16:12:58.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3603_vm 2024-09-13T16:12:58.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3604 2024-09-13T16:12:58.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3605 2024-09-13T16:12:58.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3606 2024-09-13T16:12:58.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3607 2024-09-13T16:12:58.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3608 2024-09-13T16:12:58.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 3609 2024-09-13T16:12:58.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3712 2024-09-13T16:12:58.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3764 2024-09-13T16:12:58.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3764_fsm 2024-09-13T16:12:58.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3764_vm 2024-09-13T16:12:58.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3766 2024-09-13T16:12:58.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3767 2024-09-13T16:12:58.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3997 2024-09-13T16:12:58.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4143 2024-09-13T16:12:58.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4144 2024-09-13T16:12:58.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4145 2024-09-13T16:12:58.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4146 2024-09-13T16:12:58.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4147 2024-09-13T16:12:58.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4148 2024-09-13T16:12:58.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4149 2024-09-13T16:12:58.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4150 2024-09-13T16:12:58.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4151 2024-09-13T16:12:58.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4152 2024-09-13T16:12:58.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4153 2024-09-13T16:12:58.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4154 2024-09-13T16:12:58.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4155 2024-09-13T16:12:58.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4156 2024-09-13T16:12:58.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4157 2024-09-13T16:12:58.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4158 2024-09-13T16:12:58.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4159 2024-09-13T16:12:58.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4160 2024-09-13T16:12:58.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4161 2024-09-13T16:12:58.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4162 2024-09-13T16:12:58.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4163 2024-09-13T16:12:58.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4164 2024-09-13T16:12:58.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4165 2024-09-13T16:12:58.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4166 2024-09-13T16:12:58.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4167 2024-09-13T16:12:58.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4168 2024-09-13T16:12:58.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4169 2024-09-13T16:12:58.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4170 2024-09-13T16:12:58.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4171 2024-09-13T16:12:58.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4172 2024-09-13T16:12:58.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4173 2024-09-13T16:12:58.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4174 2024-09-13T16:12:58.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 5002 2024-09-13T16:12:58.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 548 2024-09-13T16:12:58.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 549 2024-09-13T16:12:58.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 6102 2024-09-13T16:12:58.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 6104 2024-09-13T16:12:58.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 6106 2024-09-13T16:12:58.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6110 2024-09-13T16:12:58.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6111 2024-09-13T16:12:58.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6112 2024-09-13T16:12:58.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6113 2024-09-13T16:12:58.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6117 2024-09-13T16:12:58.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 826 2024-09-13T16:12:58.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 827 2024-09-13T16:12:58.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 828 2024-09-13T16:12:58.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 13 15:57 pg_filenode.map 2024-09-13T16:12:58.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 15:57 PG_VERSION 2024-09-13T16:12:58.353 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.353 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-13T16:12:58.353 INFO:teuthology.orchestra.run.smithi017.stdout:total 7777 2024-09-13T16:12:58.353 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 13 15:57 . 2024-09-13T16:12:58.353 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 13 15:57 .. 2024-09-13T16:12:58.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 112 2024-09-13T16:12:58.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 113 2024-09-13T16:12:58.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 13 15:57 1247 2024-09-13T16:12:58.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1247_fsm 2024-09-13T16:12:58.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1247_vm 2024-09-13T16:12:58.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 13 15:57 1249 2024-09-13T16:12:58.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1249_fsm 2024-09-13T16:12:58.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1249_vm 2024-09-13T16:12:58.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 13 15:57 1255 2024-09-13T16:12:58.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1255_fsm 2024-09-13T16:12:58.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1255_vm 2024-09-13T16:12:58.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 13 15:57 1259 2024-09-13T16:12:58.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1259_fsm 2024-09-13T16:12:58.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1259_vm 2024-09-13T16:12:58.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 13 15:57 13344 2024-09-13T16:12:58.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13344_fsm 2024-09-13T16:12:58.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13344_vm 2024-09-13T16:12:58.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13346 2024-09-13T16:12:58.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13348 2024-09-13T16:12:58.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13349 2024-09-13T16:12:58.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13349_fsm 2024-09-13T16:12:58.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13349_vm 2024-09-13T16:12:58.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13351 2024-09-13T16:12:58.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13353 2024-09-13T16:12:58.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13354 2024-09-13T16:12:58.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13354_fsm 2024-09-13T16:12:58.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13354_vm 2024-09-13T16:12:58.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13356 2024-09-13T16:12:58.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13358 2024-09-13T16:12:58.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13359 2024-09-13T16:12:58.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13359_fsm 2024-09-13T16:12:58.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13359_vm 2024-09-13T16:12:58.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13361 2024-09-13T16:12:58.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13363 2024-09-13T16:12:58.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 1417 2024-09-13T16:12:58.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 1418 2024-09-13T16:12:58.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 174 2024-09-13T16:12:58.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 175 2024-09-13T16:12:58.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2187 2024-09-13T16:12:58.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2224 2024-09-13T16:12:58.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2328 2024-09-13T16:12:58.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2336 2024-09-13T16:12:58.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2337 2024-09-13T16:12:58.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2579 2024-09-13T16:12:58.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2600 2024-09-13T16:12:58.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2600_fsm 2024-09-13T16:12:58.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2600_vm 2024-09-13T16:12:58.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2601 2024-09-13T16:12:58.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2601_fsm 2024-09-13T16:12:58.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2601_vm 2024-09-13T16:12:58.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 13 15:57 2602 2024-09-13T16:12:58.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2602_fsm 2024-09-13T16:12:58.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2602_vm 2024-09-13T16:12:58.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2603 2024-09-13T16:12:58.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2603_fsm 2024-09-13T16:12:58.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2603_vm 2024-09-13T16:12:58.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2604 2024-09-13T16:12:58.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2605 2024-09-13T16:12:58.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2605_fsm 2024-09-13T16:12:58.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2605_vm 2024-09-13T16:12:58.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2606 2024-09-13T16:12:58.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2606_fsm 2024-09-13T16:12:58.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2606_vm 2024-09-13T16:12:58.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2607 2024-09-13T16:12:58.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2607_fsm 2024-09-13T16:12:58.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2607_vm 2024-09-13T16:12:58.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 13 15:57 2608 2024-09-13T16:12:58.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2608_fsm 2024-09-13T16:12:58.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2608_vm 2024-09-13T16:12:58.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 13 15:57 2609 2024-09-13T16:12:58.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2609_fsm 2024-09-13T16:12:58.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2609_vm 2024-09-13T16:12:58.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2610 2024-09-13T16:12:58.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2610_fsm 2024-09-13T16:12:58.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2610_vm 2024-09-13T16:12:58.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2611 2024-09-13T16:12:58.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2612 2024-09-13T16:12:58.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2612_fsm 2024-09-13T16:12:58.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2612_vm 2024-09-13T16:12:58.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2613 2024-09-13T16:12:58.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2615 2024-09-13T16:12:58.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2615_fsm 2024-09-13T16:12:58.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2615_vm 2024-09-13T16:12:58.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2616 2024-09-13T16:12:58.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2616_fsm 2024-09-13T16:12:58.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2616_vm 2024-09-13T16:12:58.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 13 15:57 2617 2024-09-13T16:12:58.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2617_fsm 2024-09-13T16:12:58.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2617_vm 2024-09-13T16:12:58.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 13 15:57 2618 2024-09-13T16:12:58.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2618_fsm 2024-09-13T16:12:58.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2618_vm 2024-09-13T16:12:58.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 13 15:57 2619 2024-09-13T16:12:58.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2619_fsm 2024-09-13T16:12:58.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2619_vm 2024-09-13T16:12:58.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2620 2024-09-13T16:12:58.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2650 2024-09-13T16:12:58.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2651 2024-09-13T16:12:58.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2652 2024-09-13T16:12:58.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2653 2024-09-13T16:12:58.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2654 2024-09-13T16:12:58.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2655 2024-09-13T16:12:58.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2656 2024-09-13T16:12:58.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2657 2024-09-13T16:12:58.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 13 15:57 2658 2024-09-13T16:12:58.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 13 15:57 2659 2024-09-13T16:12:58.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2660 2024-09-13T16:12:58.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2661 2024-09-13T16:12:58.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2662 2024-09-13T16:12:58.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 13 15:57 2663 2024-09-13T16:12:58.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2664 2024-09-13T16:12:58.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2665 2024-09-13T16:12:58.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2666 2024-09-13T16:12:58.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2667 2024-09-13T16:12:58.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2668 2024-09-13T16:12:58.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2669 2024-09-13T16:12:58.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2670 2024-09-13T16:12:58.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 13 15:57 2673 2024-09-13T16:12:58.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 13 15:57 2674 2024-09-13T16:12:58.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 13 15:57 2675 2024-09-13T16:12:58.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2678 2024-09-13T16:12:58.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2679 2024-09-13T16:12:58.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2680 2024-09-13T16:12:58.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2681 2024-09-13T16:12:58.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2682 2024-09-13T16:12:58.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2683 2024-09-13T16:12:58.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2684 2024-09-13T16:12:58.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2685 2024-09-13T16:12:58.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2686 2024-09-13T16:12:58.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2687 2024-09-13T16:12:58.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2688 2024-09-13T16:12:58.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 13 15:57 2689 2024-09-13T16:12:58.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 13 15:57 2690 2024-09-13T16:12:58.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 13 15:57 2691 2024-09-13T16:12:58.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2692 2024-09-13T16:12:58.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2693 2024-09-13T16:12:58.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2696 2024-09-13T16:12:58.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2699 2024-09-13T16:12:58.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2701 2024-09-13T16:12:58.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2702 2024-09-13T16:12:58.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2703 2024-09-13T16:12:58.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2704 2024-09-13T16:12:58.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2753 2024-09-13T16:12:58.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2753_fsm 2024-09-13T16:12:58.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2753_vm 2024-09-13T16:12:58.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2754 2024-09-13T16:12:58.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2755 2024-09-13T16:12:58.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2756 2024-09-13T16:12:58.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2757 2024-09-13T16:12:58.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2830 2024-09-13T16:12:58.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2831 2024-09-13T16:12:58.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2832 2024-09-13T16:12:58.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2833 2024-09-13T16:12:58.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2834 2024-09-13T16:12:58.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2835 2024-09-13T16:12:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2836 2024-09-13T16:12:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2837 2024-09-13T16:12:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 13 15:57 2838 2024-09-13T16:12:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2838_fsm 2024-09-13T16:12:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2838_vm 2024-09-13T16:12:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2839 2024-09-13T16:12:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2840 2024-09-13T16:12:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2840_fsm 2024-09-13T16:12:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2840_vm 2024-09-13T16:12:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2841 2024-09-13T16:12:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2995 2024-09-13T16:12:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2996 2024-09-13T16:12:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3079 2024-09-13T16:12:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3079_fsm 2024-09-13T16:12:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3079_vm 2024-09-13T16:12:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3080 2024-09-13T16:12:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3081 2024-09-13T16:12:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 3085 2024-09-13T16:12:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3118 2024-09-13T16:12:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3119 2024-09-13T16:12:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 13 15:57 3164 2024-09-13T16:12:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3256 2024-09-13T16:12:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3257 2024-09-13T16:12:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3258 2024-09-13T16:12:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3350 2024-09-13T16:12:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3351 2024-09-13T16:12:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3379 2024-09-13T16:12:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3380 2024-09-13T16:12:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3381 2024-09-13T16:12:58.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3394 2024-09-13T16:12:58.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3394_fsm 2024-09-13T16:12:58.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3394_vm 2024-09-13T16:12:58.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3395 2024-09-13T16:12:58.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3429 2024-09-13T16:12:58.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3430 2024-09-13T16:12:58.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3431 2024-09-13T16:12:58.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3433 2024-09-13T16:12:58.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3439 2024-09-13T16:12:58.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3440 2024-09-13T16:12:58.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 3455 2024-09-13T16:12:58.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 13 15:57 3456 2024-09-13T16:12:58.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3456_fsm 2024-09-13T16:12:58.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3456_vm 2024-09-13T16:12:58.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3466 2024-09-13T16:12:58.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3467 2024-09-13T16:12:58.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3468 2024-09-13T16:12:58.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3501 2024-09-13T16:12:58.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3502 2024-09-13T16:12:58.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3503 2024-09-13T16:12:58.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3534 2024-09-13T16:12:58.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3541 2024-09-13T16:12:58.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3541_fsm 2024-09-13T16:12:58.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3541_vm 2024-09-13T16:12:58.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3542 2024-09-13T16:12:58.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3574 2024-09-13T16:12:58.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3575 2024-09-13T16:12:58.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3576 2024-09-13T16:12:58.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3596 2024-09-13T16:12:58.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3597 2024-09-13T16:12:58.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3598 2024-09-13T16:12:58.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3599 2024-09-13T16:12:58.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3600 2024-09-13T16:12:58.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3600_fsm 2024-09-13T16:12:58.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3600_vm 2024-09-13T16:12:58.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3601 2024-09-13T16:12:58.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3601_fsm 2024-09-13T16:12:58.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3601_vm 2024-09-13T16:12:58.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3602 2024-09-13T16:12:58.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3602_fsm 2024-09-13T16:12:58.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3602_vm 2024-09-13T16:12:58.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3603 2024-09-13T16:12:58.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3603_fsm 2024-09-13T16:12:58.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3603_vm 2024-09-13T16:12:58.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3604 2024-09-13T16:12:58.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3605 2024-09-13T16:12:58.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3606 2024-09-13T16:12:58.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3607 2024-09-13T16:12:58.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3608 2024-09-13T16:12:58.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 3609 2024-09-13T16:12:58.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3712 2024-09-13T16:12:58.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3764 2024-09-13T16:12:58.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3764_fsm 2024-09-13T16:12:58.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3764_vm 2024-09-13T16:12:58.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3766 2024-09-13T16:12:58.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3767 2024-09-13T16:12:58.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3997 2024-09-13T16:12:58.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4143 2024-09-13T16:12:58.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4144 2024-09-13T16:12:58.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4145 2024-09-13T16:12:58.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4146 2024-09-13T16:12:58.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4147 2024-09-13T16:12:58.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4148 2024-09-13T16:12:58.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4149 2024-09-13T16:12:58.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4150 2024-09-13T16:12:58.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4151 2024-09-13T16:12:58.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4152 2024-09-13T16:12:58.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4153 2024-09-13T16:12:58.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4154 2024-09-13T16:12:58.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4155 2024-09-13T16:12:58.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4156 2024-09-13T16:12:58.373 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4157 2024-09-13T16:12:58.373 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4158 2024-09-13T16:12:58.373 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4159 2024-09-13T16:12:58.373 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4160 2024-09-13T16:12:58.373 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4161 2024-09-13T16:12:58.373 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4162 2024-09-13T16:12:58.373 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4163 2024-09-13T16:12:58.373 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4164 2024-09-13T16:12:58.373 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4165 2024-09-13T16:12:58.373 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4166 2024-09-13T16:12:58.373 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4167 2024-09-13T16:12:58.373 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4168 2024-09-13T16:12:58.374 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4169 2024-09-13T16:12:58.374 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4170 2024-09-13T16:12:58.374 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4171 2024-09-13T16:12:58.374 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4172 2024-09-13T16:12:58.383 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4173 2024-09-13T16:12:58.383 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4174 2024-09-13T16:12:58.383 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 5002 2024-09-13T16:12:58.383 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 548 2024-09-13T16:12:58.383 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 549 2024-09-13T16:12:58.383 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 6102 2024-09-13T16:12:58.384 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 6104 2024-09-13T16:12:58.384 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 6106 2024-09-13T16:12:58.384 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6110 2024-09-13T16:12:58.384 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6111 2024-09-13T16:12:58.384 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6112 2024-09-13T16:12:58.384 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6113 2024-09-13T16:12:58.385 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6117 2024-09-13T16:12:58.385 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 826 2024-09-13T16:12:58.385 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 827 2024-09-13T16:12:58.385 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 828 2024-09-13T16:12:58.385 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 13 15:57 pg_filenode.map 2024-09-13T16:12:58.385 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 15:57 PG_VERSION 2024-09-13T16:12:58.385 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.385 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-13T16:12:58.385 INFO:teuthology.orchestra.run.smithi017.stdout:total 552238 2024-09-13T16:12:58.385 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Sep 13 16:04 . 2024-09-13T16:12:58.385 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 13 15:57 .. 2024-09-13T16:12:58.385 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 112 2024-09-13T16:12:58.385 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 113 2024-09-13T16:12:58.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 13 15:57 1247 2024-09-13T16:12:58.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1247_fsm 2024-09-13T16:12:58.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1247_vm 2024-09-13T16:12:58.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 13 15:57 1249 2024-09-13T16:12:58.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1249_fsm 2024-09-13T16:12:58.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1249_vm 2024-09-13T16:12:58.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 13 15:57 1255 2024-09-13T16:12:58.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1255_fsm 2024-09-13T16:12:58.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1255_vm 2024-09-13T16:12:58.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 13 16:12 1259 2024-09-13T16:12:58.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1259_fsm 2024-09-13T16:12:58.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1259_vm 2024-09-13T16:12:58.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 13 15:57 13344 2024-09-13T16:12:58.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13344_fsm 2024-09-13T16:12:58.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13344_vm 2024-09-13T16:12:58.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13346 2024-09-13T16:12:58.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13348 2024-09-13T16:12:58.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13349 2024-09-13T16:12:58.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13349_fsm 2024-09-13T16:12:58.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13349_vm 2024-09-13T16:12:58.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13351 2024-09-13T16:12:58.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13353 2024-09-13T16:12:58.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13354 2024-09-13T16:12:58.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13354_fsm 2024-09-13T16:12:58.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13354_vm 2024-09-13T16:12:58.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13356 2024-09-13T16:12:58.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13358 2024-09-13T16:12:58.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13359 2024-09-13T16:12:58.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 13359_fsm 2024-09-13T16:12:58.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13359_vm 2024-09-13T16:12:58.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 13361 2024-09-13T16:12:58.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 13363 2024-09-13T16:12:58.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 1417 2024-09-13T16:12:58.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 1418 2024-09-13T16:12:58.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 440303616 Sep 13 16:12 16396 2024-09-13T16:12:58.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 13 16:12 16396_fsm 2024-09-13T16:12:58.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 16:05 16396_vm 2024-09-13T16:12:58.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 655360 Sep 13 16:12 16397 2024-09-13T16:12:58.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 16:12 16397_fsm 2024-09-13T16:12:58.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 16:12 16397_vm 2024-09-13T16:12:58.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1032192 Sep 13 16:12 16399 2024-09-13T16:12:58.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 16:12 16399_fsm 2024-09-13T16:12:58.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 16:12 16399_vm 2024-09-13T16:12:58.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 16:12 16400 2024-09-13T16:12:58.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 13 16:12 16402 2024-09-13T16:12:58.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 Sep 13 16:12 16404 2024-09-13T16:12:58.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 43122688 Sep 13 16:12 16406 2024-09-13T16:12:58.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 16:12 16406_fsm 2024-09-13T16:12:58.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 16:11 16406_vm 2024-09-13T16:12:58.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 174 2024-09-13T16:12:58.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 175 2024-09-13T16:12:58.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2187 2024-09-13T16:12:58.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2224 2024-09-13T16:12:58.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2328 2024-09-13T16:12:58.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2336 2024-09-13T16:12:58.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2337 2024-09-13T16:12:58.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2579 2024-09-13T16:12:58.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2600 2024-09-13T16:12:58.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2600_fsm 2024-09-13T16:12:58.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2600_vm 2024-09-13T16:12:58.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2601 2024-09-13T16:12:58.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2601_fsm 2024-09-13T16:12:58.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2601_vm 2024-09-13T16:12:58.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 13 15:57 2602 2024-09-13T16:12:58.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2602_fsm 2024-09-13T16:12:58.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2602_vm 2024-09-13T16:12:58.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2603 2024-09-13T16:12:58.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2603_fsm 2024-09-13T16:12:58.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2603_vm 2024-09-13T16:12:58.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2604 2024-09-13T16:12:58.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2605 2024-09-13T16:12:58.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2605_fsm 2024-09-13T16:12:58.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2605_vm 2024-09-13T16:12:58.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2606 2024-09-13T16:12:58.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2606_fsm 2024-09-13T16:12:58.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2606_vm 2024-09-13T16:12:58.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2607 2024-09-13T16:12:58.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2607_fsm 2024-09-13T16:12:58.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2607_vm 2024-09-13T16:12:58.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 13 15:57 2608 2024-09-13T16:12:58.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2608_fsm 2024-09-13T16:12:58.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2608_vm 2024-09-13T16:12:58.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 13 15:57 2609 2024-09-13T16:12:58.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2609_fsm 2024-09-13T16:12:58.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2609_vm 2024-09-13T16:12:58.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2610 2024-09-13T16:12:58.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2610_fsm 2024-09-13T16:12:58.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2610_vm 2024-09-13T16:12:58.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2611 2024-09-13T16:12:58.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2612 2024-09-13T16:12:58.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2612_fsm 2024-09-13T16:12:58.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2612_vm 2024-09-13T16:12:58.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2613 2024-09-13T16:12:58.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2615 2024-09-13T16:12:58.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2615_fsm 2024-09-13T16:12:58.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2615_vm 2024-09-13T16:12:58.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2616 2024-09-13T16:12:58.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2616_fsm 2024-09-13T16:12:58.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2616_vm 2024-09-13T16:12:58.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 13 15:57 2617 2024-09-13T16:12:58.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2617_fsm 2024-09-13T16:12:58.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2617_vm 2024-09-13T16:12:58.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 13 15:57 2618 2024-09-13T16:12:58.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2618_fsm 2024-09-13T16:12:58.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2618_vm 2024-09-13T16:12:58.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 172032 Sep 13 16:12 2619 2024-09-13T16:12:58.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 16:00 2619_fsm 2024-09-13T16:12:58.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2619_vm 2024-09-13T16:12:58.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2620 2024-09-13T16:12:58.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2650 2024-09-13T16:12:58.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2651 2024-09-13T16:12:58.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2652 2024-09-13T16:12:58.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2653 2024-09-13T16:12:58.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2654 2024-09-13T16:12:58.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2655 2024-09-13T16:12:58.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2656 2024-09-13T16:12:58.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2657 2024-09-13T16:12:58.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 13 15:57 2658 2024-09-13T16:12:58.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 13 15:57 2659 2024-09-13T16:12:58.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2660 2024-09-13T16:12:58.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2661 2024-09-13T16:12:58.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2662 2024-09-13T16:12:58.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 13 15:57 2663 2024-09-13T16:12:58.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2664 2024-09-13T16:12:58.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2665 2024-09-13T16:12:58.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2666 2024-09-13T16:12:58.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2667 2024-09-13T16:12:58.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2668 2024-09-13T16:12:58.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2669 2024-09-13T16:12:58.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2670 2024-09-13T16:12:58.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 13 15:57 2673 2024-09-13T16:12:58.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 13 15:57 2674 2024-09-13T16:12:58.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 13 15:57 2675 2024-09-13T16:12:58.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2678 2024-09-13T16:12:58.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2679 2024-09-13T16:12:58.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2680 2024-09-13T16:12:58.396 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2681 2024-09-13T16:12:58.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2682 2024-09-13T16:12:58.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2683 2024-09-13T16:12:58.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2684 2024-09-13T16:12:58.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2685 2024-09-13T16:12:58.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2686 2024-09-13T16:12:58.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2687 2024-09-13T16:12:58.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2688 2024-09-13T16:12:58.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 13 15:57 2689 2024-09-13T16:12:58.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 13 15:57 2690 2024-09-13T16:12:58.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 13 15:57 2691 2024-09-13T16:12:58.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2692 2024-09-13T16:12:58.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2693 2024-09-13T16:12:58.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 16:01 2696 2024-09-13T16:12:58.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2699 2024-09-13T16:12:58.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2701 2024-09-13T16:12:58.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2702 2024-09-13T16:12:58.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2703 2024-09-13T16:12:58.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 2704 2024-09-13T16:12:58.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2753 2024-09-13T16:12:58.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2753_fsm 2024-09-13T16:12:58.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2753_vm 2024-09-13T16:12:58.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2754 2024-09-13T16:12:58.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2755 2024-09-13T16:12:58.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2756 2024-09-13T16:12:58.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 2757 2024-09-13T16:12:58.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2830 2024-09-13T16:12:58.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2831 2024-09-13T16:12:58.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2832 2024-09-13T16:12:58.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2833 2024-09-13T16:12:58.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2834 2024-09-13T16:12:58.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2835 2024-09-13T16:12:58.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2836 2024-09-13T16:12:58.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2837 2024-09-13T16:12:58.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 13 15:57 2838 2024-09-13T16:12:58.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2838_fsm 2024-09-13T16:12:58.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2838_vm 2024-09-13T16:12:58.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2839 2024-09-13T16:12:58.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2840 2024-09-13T16:12:58.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2840_fsm 2024-09-13T16:12:58.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2840_vm 2024-09-13T16:12:58.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2841 2024-09-13T16:12:58.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2995 2024-09-13T16:12:58.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2996 2024-09-13T16:12:58.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3079 2024-09-13T16:12:58.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3079_fsm 2024-09-13T16:12:58.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3079_vm 2024-09-13T16:12:58.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3080 2024-09-13T16:12:58.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3081 2024-09-13T16:12:58.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 3085 2024-09-13T16:12:58.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3118 2024-09-13T16:12:58.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3119 2024-09-13T16:12:58.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 13 15:57 3164 2024-09-13T16:12:58.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3256 2024-09-13T16:12:58.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3257 2024-09-13T16:12:58.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3258 2024-09-13T16:12:58.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3350 2024-09-13T16:12:58.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3351 2024-09-13T16:12:58.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3379 2024-09-13T16:12:58.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3380 2024-09-13T16:12:58.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3381 2024-09-13T16:12:58.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3394 2024-09-13T16:12:58.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3394_fsm 2024-09-13T16:12:58.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3394_vm 2024-09-13T16:12:58.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3395 2024-09-13T16:12:58.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3429 2024-09-13T16:12:58.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3430 2024-09-13T16:12:58.402 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3431 2024-09-13T16:12:58.402 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3433 2024-09-13T16:12:58.402 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3439 2024-09-13T16:12:58.402 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3440 2024-09-13T16:12:58.402 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 13 15:57 3455 2024-09-13T16:12:58.402 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 13 15:57 3456 2024-09-13T16:12:58.402 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3456_fsm 2024-09-13T16:12:58.402 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3456_vm 2024-09-13T16:12:58.402 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3466 2024-09-13T16:12:58.403 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3467 2024-09-13T16:12:58.403 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3468 2024-09-13T16:12:58.403 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3501 2024-09-13T16:12:58.403 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3502 2024-09-13T16:12:58.403 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3503 2024-09-13T16:12:58.403 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3534 2024-09-13T16:12:58.403 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3541 2024-09-13T16:12:58.403 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3541_fsm 2024-09-13T16:12:58.403 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3541_vm 2024-09-13T16:12:58.403 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3542 2024-09-13T16:12:58.403 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3574 2024-09-13T16:12:58.403 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3575 2024-09-13T16:12:58.403 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3576 2024-09-13T16:12:58.403 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3596 2024-09-13T16:12:58.404 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3597 2024-09-13T16:12:58.404 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3598 2024-09-13T16:12:58.404 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3599 2024-09-13T16:12:58.404 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3600 2024-09-13T16:12:58.404 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3600_fsm 2024-09-13T16:12:58.404 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3600_vm 2024-09-13T16:12:58.404 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3601 2024-09-13T16:12:58.404 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3601_fsm 2024-09-13T16:12:58.404 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3601_vm 2024-09-13T16:12:58.404 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3602 2024-09-13T16:12:58.404 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3602_fsm 2024-09-13T16:12:58.404 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3602_vm 2024-09-13T16:12:58.404 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3603 2024-09-13T16:12:58.405 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3603_fsm 2024-09-13T16:12:58.405 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3603_vm 2024-09-13T16:12:58.405 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3604 2024-09-13T16:12:58.405 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3605 2024-09-13T16:12:58.405 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3606 2024-09-13T16:12:58.405 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3607 2024-09-13T16:12:58.405 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3608 2024-09-13T16:12:58.405 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 13 15:57 3609 2024-09-13T16:12:58.405 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3712 2024-09-13T16:12:58.405 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3764 2024-09-13T16:12:58.405 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 3764_fsm 2024-09-13T16:12:58.405 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3764_vm 2024-09-13T16:12:58.405 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3766 2024-09-13T16:12:58.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 3767 2024-09-13T16:12:58.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3997 2024-09-13T16:12:58.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4143 2024-09-13T16:12:58.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4144 2024-09-13T16:12:58.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4145 2024-09-13T16:12:58.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4146 2024-09-13T16:12:58.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4147 2024-09-13T16:12:58.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4148 2024-09-13T16:12:58.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4149 2024-09-13T16:12:58.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4150 2024-09-13T16:12:58.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4151 2024-09-13T16:12:58.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4152 2024-09-13T16:12:58.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4153 2024-09-13T16:12:58.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4154 2024-09-13T16:12:58.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4155 2024-09-13T16:12:58.407 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4156 2024-09-13T16:12:58.407 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4157 2024-09-13T16:12:58.407 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4158 2024-09-13T16:12:58.407 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4159 2024-09-13T16:12:58.408 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4160 2024-09-13T16:12:58.408 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4161 2024-09-13T16:12:58.408 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4162 2024-09-13T16:12:58.408 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4163 2024-09-13T16:12:58.408 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4164 2024-09-13T16:12:58.408 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4165 2024-09-13T16:12:58.408 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4166 2024-09-13T16:12:58.408 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4167 2024-09-13T16:12:58.408 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4168 2024-09-13T16:12:58.408 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4169 2024-09-13T16:12:58.409 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4170 2024-09-13T16:12:58.409 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4171 2024-09-13T16:12:58.409 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4172 2024-09-13T16:12:58.409 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4173 2024-09-13T16:12:58.409 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4174 2024-09-13T16:12:58.409 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 5002 2024-09-13T16:12:58.409 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 548 2024-09-13T16:12:58.409 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 549 2024-09-13T16:12:58.409 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 6102 2024-09-13T16:12:58.409 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 6104 2024-09-13T16:12:58.409 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 6106 2024-09-13T16:12:58.409 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6110 2024-09-13T16:12:58.409 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6111 2024-09-13T16:12:58.410 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6112 2024-09-13T16:12:58.410 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6113 2024-09-13T16:12:58.410 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6117 2024-09-13T16:12:58.410 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 826 2024-09-13T16:12:58.410 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 827 2024-09-13T16:12:58.410 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 828 2024-09-13T16:12:58.410 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 13 15:57 pg_filenode.map 2024-09-13T16:12:58.410 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 151596 Sep 13 15:57 pg_internal.init 2024-09-13T16:12:58.410 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 15:57 PG_VERSION 2024-09-13T16:12:58.410 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.410 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-09-13T16:12:58.410 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T16:12:58.410 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T16:12:58.410 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 13 15:57 .. 2024-09-13T16:12:58.411 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.411 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/global: 2024-09-13T16:12:58.411 INFO:teuthology.orchestra.run.smithi017.stdout:total 560 2024-09-13T16:12:58.411 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 13 15:57 . 2024-09-13T16:12:58.411 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 13 16:12 .. 2024-09-13T16:12:58.411 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1213 2024-09-13T16:12:58.411 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1213_fsm 2024-09-13T16:12:58.411 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1213_vm 2024-09-13T16:12:58.411 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1214 2024-09-13T16:12:58.411 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1214_fsm 2024-09-13T16:12:58.411 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1214_vm 2024-09-13T16:12:58.411 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 1232 2024-09-13T16:12:58.411 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 1233 2024-09-13T16:12:58.411 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1260 2024-09-13T16:12:58.412 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1260_fsm 2024-09-13T16:12:58.412 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1260_vm 2024-09-13T16:12:58.412 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1261 2024-09-13T16:12:58.412 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1261_fsm 2024-09-13T16:12:58.412 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1261_vm 2024-09-13T16:12:58.412 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1262 2024-09-13T16:12:58.412 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 1262_fsm 2024-09-13T16:12:58.412 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 1262_vm 2024-09-13T16:12:58.412 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2396 2024-09-13T16:12:58.412 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 13 15:57 2396_fsm 2024-09-13T16:12:58.412 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2396_vm 2024-09-13T16:12:58.412 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2397 2024-09-13T16:12:58.412 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2671 2024-09-13T16:12:58.412 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2672 2024-09-13T16:12:58.413 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2676 2024-09-13T16:12:58.413 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2677 2024-09-13T16:12:58.413 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2694 2024-09-13T16:12:58.413 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2695 2024-09-13T16:12:58.413 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2697 2024-09-13T16:12:58.413 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 13 15:57 2698 2024-09-13T16:12:58.413 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2846 2024-09-13T16:12:58.413 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2847 2024-09-13T16:12:58.413 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2964 2024-09-13T16:12:58.413 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2965 2024-09-13T16:12:58.413 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 2966 2024-09-13T16:12:58.413 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 2967 2024-09-13T16:12:58.413 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 3592 2024-09-13T16:12:58.414 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 3593 2024-09-13T16:12:58.414 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4060 2024-09-13T16:12:58.414 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4061 2024-09-13T16:12:58.414 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4175 2024-09-13T16:12:58.414 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4176 2024-09-13T16:12:58.414 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4177 2024-09-13T16:12:58.414 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4178 2024-09-13T16:12:58.414 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4181 2024-09-13T16:12:58.414 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4182 2024-09-13T16:12:58.414 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4183 2024-09-13T16:12:58.414 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4184 2024-09-13T16:12:58.414 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 4185 2024-09-13T16:12:58.414 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 4186 2024-09-13T16:12:58.414 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 6000 2024-09-13T16:12:58.415 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6001 2024-09-13T16:12:58.415 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6002 2024-09-13T16:12:58.415 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 6100 2024-09-13T16:12:58.415 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6114 2024-09-13T16:12:58.415 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 6115 2024-09-13T16:12:58.415 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 16:12 pg_control 2024-09-13T16:12:58.415 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 13 15:57 pg_filenode.map 2024-09-13T16:12:58.415 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 23144 Sep 13 15:57 pg_internal.init 2024-09-13T16:12:58.415 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.415 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/log: 2024-09-13T16:12:58.415 INFO:teuthology.orchestra.run.smithi017.stdout:total 2 2024-09-13T16:12:58.415 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 . 2024-09-13T16:12:58.415 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 13 16:12 .. 2024-09-13T16:12:58.415 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1118 Sep 13 16:12 postgresql-Fri.log 2024-09-13T16:12:58.416 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.416 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-13T16:12:58.416 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T16:12:58.416 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T16:12:58.416 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 13 16:12 .. 2024-09-13T16:12:58.416 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.416 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-13T16:12:58.416 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T16:12:58.416 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T16:12:58.417 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 13 16:12 .. 2024-09-13T16:12:58.417 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.417 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-13T16:12:58.417 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2024-09-13T16:12:58.417 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 16:12 . 2024-09-13T16:12:58.417 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 13 16:12 .. 2024-09-13T16:12:58.417 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 mappings 2024-09-13T16:12:58.417 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 13 16:12 replorigin_checkpoint 2024-09-13T16:12:58.417 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 snapshots 2024-09-13T16:12:58.417 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.417 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-13T16:12:58.417 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T16:12:58.417 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T16:12:58.417 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 16:12 .. 2024-09-13T16:12:58.418 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.418 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-13T16:12:58.418 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T16:12:58.418 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T16:12:58.418 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 16:12 .. 2024-09-13T16:12:58.418 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.418 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-13T16:12:58.418 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T16:12:58.418 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 13 15:57 . 2024-09-13T16:12:58.418 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 13 16:12 .. 2024-09-13T16:12:58.418 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 members 2024-09-13T16:12:58.418 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 offsets 2024-09-13T16:12:58.418 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.418 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-13T16:12:58.418 INFO:teuthology.orchestra.run.smithi017.stdout:total 8 2024-09-13T16:12:58.419 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 . 2024-09-13T16:12:58.419 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 13 15:57 .. 2024-09-13T16:12:58.419 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 15:57 0000 2024-09-13T16:12:58.419 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.419 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-13T16:12:58.419 INFO:teuthology.orchestra.run.smithi017.stdout:total 8 2024-09-13T16:12:58.419 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 . 2024-09-13T16:12:58.419 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 13 15:57 .. 2024-09-13T16:12:58.419 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 13 16:02 0000 2024-09-13T16:12:58.419 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.419 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-13T16:12:58.419 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T16:12:58.419 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T16:12:58.420 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 13 16:12 .. 2024-09-13T16:12:58.420 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.420 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-13T16:12:58.420 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T16:12:58.420 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T16:12:58.420 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 13 16:12 .. 2024-09-13T16:12:58.420 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.420 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-13T16:12:58.420 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T16:12:58.420 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T16:12:58.420 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 13 16:12 .. 2024-09-13T16:12:58.420 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.421 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-13T16:12:58.421 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T16:12:58.421 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T16:12:58.421 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 13 16:12 .. 2024-09-13T16:12:58.421 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.421 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-13T16:12:58.421 INFO:teuthology.orchestra.run.smithi017.stdout:total 15 2024-09-13T16:12:58.421 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 13 16:12 . 2024-09-13T16:12:58.421 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 13 16:12 .. 2024-09-13T16:12:58.421 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1952 Sep 13 16:12 db_0.stat 2024-09-13T16:12:58.421 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 10979 Sep 13 16:12 db_13494.stat 2024-09-13T16:12:58.421 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1151 Sep 13 16:12 global.stat 2024-09-13T16:12:58.421 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.422 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-13T16:12:58.422 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T16:12:58.422 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 16:12 . 2024-09-13T16:12:58.422 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 13 16:12 .. 2024-09-13T16:12:58.422 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.422 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-13T16:12:58.422 INFO:teuthology.orchestra.run.smithi017.stdout:total 128 2024-09-13T16:12:58.422 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 16:12 . 2024-09-13T16:12:58.422 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 13 16:12 .. 2024-09-13T16:12:58.422 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 13 16:12 000C 2024-09-13T16:12:58.422 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.422 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-13T16:12:58.422 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T16:12:58.422 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T16:12:58.422 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 13 16:12 .. 2024-09-13T16:12:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.423 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-13T16:12:58.423 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T16:12:58.423 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T16:12:58.423 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 13 16:12 .. 2024-09-13T16:12:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.423 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-13T16:12:58.423 INFO:teuthology.orchestra.run.smithi017.stdout:total 933888 2024-09-13T16:12:58.423 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 13 16:12 . 2024-09-13T16:12:58.423 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 13 16:12 .. 2024-09-13T16:12:58.423 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:12 000000010000000000000067 2024-09-13T16:12:58.423 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:02 000000010000000000000068 2024-09-13T16:12:58.423 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:05 000000010000000000000069 2024-09-13T16:12:58.423 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:03 00000001000000000000006A 2024-09-13T16:12:58.424 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:04 00000001000000000000006B 2024-09-13T16:12:58.424 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:03 00000001000000000000006C 2024-09-13T16:12:58.424 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:03 00000001000000000000006D 2024-09-13T16:12:58.424 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:05 00000001000000000000006E 2024-09-13T16:12:58.424 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:06 00000001000000000000006F 2024-09-13T16:12:58.424 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:03 000000010000000000000070 2024-09-13T16:12:58.424 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:03 000000010000000000000071 2024-09-13T16:12:58.424 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:05 000000010000000000000072 2024-09-13T16:12:58.424 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:04 000000010000000000000073 2024-09-13T16:12:58.424 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:04 000000010000000000000074 2024-09-13T16:12:58.424 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:02 000000010000000000000075 2024-09-13T16:12:58.424 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:02 000000010000000000000076 2024-09-13T16:12:58.424 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:03 000000010000000000000077 2024-09-13T16:12:58.424 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:03 000000010000000000000078 2024-09-13T16:12:58.425 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:06 000000010000000000000079 2024-09-13T16:12:58.425 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:02 00000001000000000000007A 2024-09-13T16:12:58.425 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:03 00000001000000000000007B 2024-09-13T16:12:58.425 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:03 00000001000000000000007C 2024-09-13T16:12:58.425 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:02 00000001000000000000007D 2024-09-13T16:12:58.425 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:04 00000001000000000000007E 2024-09-13T16:12:58.425 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:07 00000001000000000000007F 2024-09-13T16:12:58.425 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:03 000000010000000000000080 2024-09-13T16:12:58.425 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:03 000000010000000000000081 2024-09-13T16:12:58.425 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:02 000000010000000000000082 2024-09-13T16:12:58.425 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:07 000000010000000000000083 2024-09-13T16:12:58.426 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:08 000000010000000000000084 2024-09-13T16:12:58.426 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:08 000000010000000000000085 2024-09-13T16:12:58.426 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:09 000000010000000000000086 2024-09-13T16:12:58.426 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:09 000000010000000000000087 2024-09-13T16:12:58.426 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:11 000000010000000000000088 2024-09-13T16:12:58.426 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:07 000000010000000000000089 2024-09-13T16:12:58.426 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:08 00000001000000000000008A 2024-09-13T16:12:58.426 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:11 00000001000000000000008B 2024-09-13T16:12:58.426 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:10 00000001000000000000008C 2024-09-13T16:12:58.426 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:08 00000001000000000000008D 2024-09-13T16:12:58.426 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:10 00000001000000000000008E 2024-09-13T16:12:58.427 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:08 00000001000000000000008F 2024-09-13T16:12:58.427 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:09 000000010000000000000090 2024-09-13T16:12:58.427 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:07 000000010000000000000091 2024-09-13T16:12:58.427 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:09 000000010000000000000092 2024-09-13T16:12:58.427 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:08 000000010000000000000093 2024-09-13T16:12:58.427 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:09 000000010000000000000094 2024-09-13T16:12:58.427 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:12 000000010000000000000095 2024-09-13T16:12:58.427 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:09 000000010000000000000096 2024-09-13T16:12:58.428 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:08 000000010000000000000097 2024-09-13T16:12:58.428 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:07 000000010000000000000098 2024-09-13T16:12:58.428 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:08 000000010000000000000099 2024-09-13T16:12:58.428 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:08 00000001000000000000009A 2024-09-13T16:12:58.428 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:11 00000001000000000000009B 2024-09-13T16:12:58.428 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:08 00000001000000000000009C 2024-09-13T16:12:58.428 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:07 00000001000000000000009D 2024-09-13T16:12:58.428 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:07 00000001000000000000009E 2024-09-13T16:12:58.428 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 13 16:10 00000001000000000000009F 2024-09-13T16:12:58.428 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 archive_status 2024-09-13T16:12:58.428 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.429 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-13T16:12:58.429 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2024-09-13T16:12:58.429 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 13 15:57 . 2024-09-13T16:12:58.429 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 13 16:12 .. 2024-09-13T16:12:58.429 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.429 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-13T16:12:58.429 INFO:teuthology.orchestra.run.smithi017.stdout:total 200 2024-09-13T16:12:58.429 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 13 15:57 . 2024-09-13T16:12:58.429 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 13 16:12 .. 2024-09-13T16:12:58.429 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 204800 Sep 13 16:12 0000 2024-09-13T16:12:58.431 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-13T16:12:58.443 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi017.front.sepia.ceph.com 2024-09-13T16:12:58.455 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-13T16:12:58.466 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:12:58.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.660+0000 7f0f9fe00640 1 -- 172.21.15.17:0/436350563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fa0102fb0 msgr2=0x7f0fa0103430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:58.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.660+0000 7f0f9fe00640 1 --2- 172.21.15.17:0/436350563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fa0102fb0 0x7f0fa0103430 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c009900 tx=0x7f0f8c02a3f0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.660+0000 7f0f9fe00640 1 -- 172.21.15.17:0/436350563 shutdown_connections 2024-09-13T16:12:58.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.660+0000 7f0f9fe00640 1 --2- 172.21.15.17:0/436350563 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fa0103970 0x7f0fa010a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.660+0000 7f0f9fe00640 1 --2- 172.21.15.17:0/436350563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fa0102fb0 0x7f0fa0103430 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.660+0000 7f0f9fe00640 1 --2- 172.21.15.17:0/436350563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fa0101dc0 0x7f0fa01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.660+0000 7f0f9fe00640 1 -- 172.21.15.17:0/436350563 >> 172.21.15.17:0/436350563 conn(0x7f0fa00fd540 msgr2=0x7f0fa00ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:58.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.660+0000 7f0f9fe00640 1 -- 172.21.15.17:0/436350563 shutdown_connections 2024-09-13T16:12:58.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.660+0000 7f0f9fe00640 1 -- 172.21.15.17:0/436350563 wait complete. 2024-09-13T16:12:58.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.661+0000 7f0f9fe00640 1 Processor -- start 2024-09-13T16:12:58.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.661+0000 7f0f9fe00640 1 -- start start 2024-09-13T16:12:58.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.661+0000 7f0f9fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fa0101dc0 0x7f0fa0197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:58.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.661+0000 7f0f9fe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fa0102fb0 0x7f0fa01983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:58.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.661+0000 7f0f9fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fa0103970 0x7f0fa019f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:58.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.661+0000 7f0f9fe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa019f960 con 0x7f0fa0101dc0 2024-09-13T16:12:58.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.661+0000 7f0f9fe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa019fad0 con 0x7f0fa0103970 2024-09-13T16:12:58.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.661+0000 7f0f9fe00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa019fc90 con 0x7f0fa0102fb0 2024-09-13T16:12:58.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.662+0000 7f0f9e000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fa0102fb0 0x7f0fa01983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:58.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.662+0000 7f0f9ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fa0101dc0 0x7f0fa0197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:58.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.662+0000 7f0f9e000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fa0102fb0 0x7f0fa01983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:48696/0 (socket says 172.21.15.17:48696) 2024-09-13T16:12:58.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.662+0000 7f0f9e000640 1 -- 172.21.15.17:0/1146785012 learned_addr learned my addr 172.21.15.17:0/1146785012 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:58.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.662+0000 7f0f9f400640 1 --2- 172.21.15.17:0/1146785012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fa0103970 0x7f0fa019f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:58.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.662+0000 7f0f9ea00640 1 -- 172.21.15.17:0/1146785012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fa0102fb0 msgr2=0x7f0fa01983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:58.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.662+0000 7f0f9ea00640 1 --2- 172.21.15.17:0/1146785012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fa0102fb0 0x7f0fa01983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.662+0000 7f0f9ea00640 1 -- 172.21.15.17:0/1146785012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fa0103970 msgr2=0x7f0fa019f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:58.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.662+0000 7f0f9ea00640 1 --2- 172.21.15.17:0/1146785012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fa0103970 0x7f0fa019f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.662+0000 7f0f9ea00640 1 -- 172.21.15.17:0/1146785012 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8c009560 con 0x7f0fa0101dc0 2024-09-13T16:12:58.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.662+0000 7f0f9e000640 1 --2- 172.21.15.17:0/1146785012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fa0102fb0 0x7f0fa01983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:12:58.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.662+0000 7f0f9ea00640 1 --2- 172.21.15.17:0/1146785012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fa0101dc0 0x7f0fa0197e70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0102e10 tx=0x7f0f9000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:58.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.663+0000 7f0f97400640 1 -- 172.21.15.17:0/1146785012 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f90009c30 con 0x7f0fa0101dc0 2024-09-13T16:12:58.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.663+0000 7f0f97400640 1 -- 172.21.15.17:0/1146785012 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f90009d90 con 0x7f0fa0101dc0 2024-09-13T16:12:58.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.663+0000 7f0f97400640 1 -- 172.21.15.17:0/1146785012 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9000f620 con 0x7f0fa0101dc0 2024-09-13T16:12:58.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.663+0000 7f0f9fe00640 1 -- 172.21.15.17:0/1146785012 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa019ff70 con 0x7f0fa0101dc0 2024-09-13T16:12:58.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.663+0000 7f0f9fe00640 1 -- 172.21.15.17:0/1146785012 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa01a0340 con 0x7f0fa0101dc0 2024-09-13T16:12:58.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.664+0000 7f0f9fe00640 1 -- 172.21.15.17:0/1146785012 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa01092a0 con 0x7f0fa0101dc0 2024-09-13T16:12:58.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.666+0000 7f0f97400640 1 -- 172.21.15.17:0/1146785012 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0f90010460 con 0x7f0fa0101dc0 2024-09-13T16:12:58.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.668+0000 7f0f97400640 1 --2- 172.21.15.17:0/1146785012 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0f840a1110 0x7f0f840a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:58.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.668+0000 7f0f97400640 1 -- 172.21.15.17:0/1146785012 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f0f900cc8f0 con 0x7f0fa0101dc0 2024-09-13T16:12:58.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.668+0000 7f0f9e000640 1 --2- 172.21.15.17:0/1146785012 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0f840a1110 0x7f0f840a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:58.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.669+0000 7f0f9e000640 1 --2- 172.21.15.17:0/1146785012 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0f840a1110 0x7f0f840a35d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0199380 tx=0x7f0f8c005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:58.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.672+0000 7f0f97400640 1 -- 172.21.15.17:0/1146785012 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0f90095d80 con 0x7f0fa0101dc0 2024-09-13T16:12:58.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.854+0000 7f0f9fe00640 1 -- 172.21.15.17:0/1146785012 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fa010d730 con 0x7f0fa0101dc0 2024-09-13T16:12:58.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.856+0000 7f0f97400640 1 -- 172.21.15.17:0/1146785012 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24575 (secure 0 0 0) 0x7f0f900993a0 con 0x7f0fa0101dc0 2024-09-13T16:12:58.858 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:12:58.859 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":94,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","created":"2024-09-13T15:46:50.475750+0000","modified":"2024-09-13T15:56:44.228817+0000","last_up_change":"2024-09-13T15:53:59.138985+0000","last_in_change":"2024-09-13T15:53:39.220264+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:50:10.657011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:54:51.436469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:54:52.427930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:54:55.478058+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5d39d6af-15e6-463b-b9ff-a9a5dd94e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6803","nonce":158651212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6805","nonce":158651212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6809","nonce":158651212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6807","nonce":158651212}]},"public_addr":"172.21.15.17:6803/158651212","cluster_addr":"172.21.15.17:6805/158651212","heartbeat_back_addr":"172.21.15.17:6809/158651212","heartbeat_front_addr":"172.21.15.17:6807/158651212","state":["exists","up"]},{"osd":1,"uuid":"0da621c7-645b-44ae-ba7c-a573861c3aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6801","nonce":964319421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6803","nonce":964319421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6807","nonce":964319421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6805","nonce":964319421}]},"public_addr":"172.21.15.189:6801/964319421","cluster_addr":"172.21.15.189:6803/964319421","heartbeat_back_addr":"172.21.15.189:6807/964319421","heartbeat_front_addr":"172.21.15.189:6805/964319421","state":["exists","up"]},{"osd":2,"uuid":"fa95af60-1486-4a29-8c79-8a73a4146552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6801","nonce":138468002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6803","nonce":138468002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6807","nonce":138468002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6805","nonce":138468002}]},"public_addr":"172.21.15.193:6801/138468002","cluster_addr":"172.21.15.193:6803/138468002","heartbeat_back_addr":"172.21.15.193:6807/138468002","heartbeat_front_addr":"172.21.15.193:6805/138468002","state":["exists","up"]},{"osd":3,"uuid":"90428e5f-dfd4-4cda-b240-fdb9079bcb7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6811","nonce":919913803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6813","nonce":919913803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6817","nonce":919913803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6815","nonce":919913803}]},"public_addr":"172.21.15.17:6811/919913803","cluster_addr":"172.21.15.17:6813/919913803","heartbeat_back_addr":"172.21.15.17:6817/919913803","heartbeat_front_addr":"172.21.15.17:6815/919913803","state":["exists","up"]},{"osd":4,"uuid":"e1c537b6-98d2-4b66-b15a-65fe70b0ce25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6809","nonce":2310375565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6811","nonce":2310375565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6815","nonce":2310375565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6813","nonce":2310375565}]},"public_addr":"172.21.15.189:6809/2310375565","cluster_addr":"172.21.15.189:6811/2310375565","heartbeat_back_addr":"172.21.15.189:6815/2310375565","heartbeat_front_addr":"172.21.15.189:6813/2310375565","state":["exists","up"]},{"osd":5,"uuid":"48522fd7-d781-4447-873f-174dabd1e33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6809","nonce":1330877824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6811","nonce":1330877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6815","nonce":1330877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6813","nonce":1330877824}]},"public_addr":"172.21.15.193:6809/1330877824","cluster_addr":"172.21.15.193:6811/1330877824","heartbeat_back_addr":"172.21.15.193:6815/1330877824","heartbeat_front_addr":"172.21.15.193:6813/1330877824","state":["exists","up"]},{"osd":6,"uuid":"47bea191-fb53-40a7-8563-8ebf17dd5bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6819","nonce":3930545382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6821","nonce":3930545382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6825","nonce":3930545382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6823","nonce":3930545382}]},"public_addr":"172.21.15.17:6819/3930545382","cluster_addr":"172.21.15.17:6821/3930545382","heartbeat_back_addr":"172.21.15.17:6825/3930545382","heartbeat_front_addr":"172.21.15.17:6823/3930545382","state":["exists","up"]},{"osd":7,"uuid":"a98f36f9-0a19-4c9a-8ed1-615c4a6e7658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6817","nonce":3691677495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6819","nonce":3691677495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6823","nonce":3691677495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6821","nonce":3691677495}]},"public_addr":"172.21.15.189:6817/3691677495","cluster_addr":"172.21.15.189:6819/3691677495","heartbeat_back_addr":"172.21.15.189:6823/3691677495","heartbeat_front_addr":"172.21.15.189:6821/3691677495","state":["exists","up"]},{"osd":8,"uuid":"7a372d9f-c40f-4ead-87da-2f3a570c1373","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6817","nonce":4112907498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6819","nonce":4112907498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6823","nonce":4112907498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6821","nonce":4112907498}]},"public_addr":"172.21.15.193:6817/4112907498","cluster_addr":"172.21.15.193:6819/4112907498","heartbeat_back_addr":"172.21.15.193:6823/4112907498","heartbeat_front_addr":"172.21.15.193:6821/4112907498","state":["exists","up"]},{"osd":9,"uuid":"ac3d983c-c5e7-456b-8271-7c4e6169de61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6827","nonce":663424274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6829","nonce":663424274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6833","nonce":663424274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6831","nonce":663424274}]},"public_addr":"172.21.15.17:6827/663424274","cluster_addr":"172.21.15.17:6829/663424274","heartbeat_back_addr":"172.21.15.17:6833/663424274","heartbeat_front_addr":"172.21.15.17:6831/663424274","state":["exists","up"]},{"osd":10,"uuid":"08dcae02-6c79-4a06-ae88-6eb6e6941cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6825","nonce":3153990375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6827","nonce":3153990375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6831","nonce":3153990375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6829","nonce":3153990375}]},"public_addr":"172.21.15.189:6825/3153990375","cluster_addr":"172.21.15.189:6827/3153990375","heartbeat_back_addr":"172.21.15.189:6831/3153990375","heartbeat_front_addr":"172.21.15.189:6829/3153990375","state":["exists","up"]},{"osd":11,"uuid":"a4ebcf41-d805-4d44-b112-13ae84d51868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6825","nonce":4088053907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6827","nonce":4088053907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6831","nonce":4088053907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6829","nonce":4088053907}]},"public_addr":"172.21.15.193:6825/4088053907","cluster_addr":"172.21.15.193:6827/4088053907","heartbeat_back_addr":"172.21.15.193:6831/4088053907","heartbeat_front_addr":"172.21.15.193:6829/4088053907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:22.172370+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:44.802224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:06.641435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:34.536515+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:58.789324+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:22.189862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:50.382257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:14.678047+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:38.581105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:07.258150+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:32.261383+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:56.739338+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8},{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/1550067038":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/3360683829":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/634066188":"2024-09-14T15:47:42.048005+0000","172.21.15.17:6801/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1945536687":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/2214214377":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1224386591":"2024-09-14T15:47:14.996424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:12:58.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.858+0000 7f0f9fe00640 1 -- 172.21.15.17:0/1146785012 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0f840a1110 msgr2=0x7f0f840a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:58.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.858+0000 7f0f9fe00640 1 --2- 172.21.15.17:0/1146785012 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0f840a1110 0x7f0f840a35d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0199380 tx=0x7f0f8c005780 comp rx=0 tx=0).stop 2024-09-13T16:12:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.858+0000 7f0f9fe00640 1 -- 172.21.15.17:0/1146785012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fa0101dc0 msgr2=0x7f0fa0197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.858+0000 7f0f9fe00640 1 --2- 172.21.15.17:0/1146785012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fa0101dc0 0x7f0fa0197e70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0102e10 tx=0x7f0f9000dde0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.859+0000 7f0f9fe00640 1 -- 172.21.15.17:0/1146785012 shutdown_connections 2024-09-13T16:12:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.859+0000 7f0f9fe00640 1 --2- 172.21.15.17:0/1146785012 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0f840a1110 0x7f0f840a35d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.859+0000 7f0f9fe00640 1 --2- 172.21.15.17:0/1146785012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fa0103970 0x7f0fa019f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.859+0000 7f0f9fe00640 1 --2- 172.21.15.17:0/1146785012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fa0102fb0 0x7f0fa01983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.859+0000 7f0f9fe00640 1 --2- 172.21.15.17:0/1146785012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fa0101dc0 0x7f0fa0197e70 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.859+0000 7f0f9fe00640 1 -- 172.21.15.17:0/1146785012 >> 172.21.15.17:0/1146785012 conn(0x7f0fa00fd540 msgr2=0x7f0fa0106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.859+0000 7f0f9fe00640 1 -- 172.21.15.17:0/1146785012 shutdown_connections 2024-09-13T16:12:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:58.859+0000 7f0f9fe00640 1 -- 172.21.15.17:0/1146785012 wait complete. 2024-09-13T16:12:58.877 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:50:10.657011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:54:51.436469+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:54:52.427930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:54:55.478058+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T16:12:58.878 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:12:59.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.036+0000 7f6ddea00640 1 -- 172.21.15.17:0/2165331808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6dd80760b0 msgr2=0x7f6dd8076510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:59.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.036+0000 7f6ddea00640 1 --2- 172.21.15.17:0/2165331808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6dd80760b0 0x7f6dd8076510 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009900 tx=0x7f6dc002a400 comp rx=0 tx=0).stop 2024-09-13T16:12:59.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.036+0000 7f6ddea00640 1 -- 172.21.15.17:0/2165331808 shutdown_connections 2024-09-13T16:12:59.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.036+0000 7f6ddea00640 1 --2- 172.21.15.17:0/2165331808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6dd8076a50 0x7f6dd80772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.036+0000 7f6ddea00640 1 --2- 172.21.15.17:0/2165331808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6dd80760b0 0x7f6dd8076510 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.036+0000 7f6ddea00640 1 --2- 172.21.15.17:0/2165331808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6dd8074e70 0x7f6dd8075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.036+0000 7f6ddea00640 1 -- 172.21.15.17:0/2165331808 >> 172.21.15.17:0/2165331808 conn(0x7f6dd80fd6f0 msgr2=0x7f6dd80ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:59.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.036+0000 7f6ddea00640 1 -- 172.21.15.17:0/2165331808 shutdown_connections 2024-09-13T16:12:59.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.036+0000 7f6ddea00640 1 -- 172.21.15.17:0/2165331808 wait complete. 2024-09-13T16:12:59.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.037+0000 7f6ddea00640 1 Processor -- start 2024-09-13T16:12:59.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.037+0000 7f6ddea00640 1 -- start start 2024-09-13T16:12:59.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.037+0000 7f6ddea00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6dd8074e70 0x7f6dd819c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:59.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.037+0000 7f6ddea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6dd80760b0 0x7f6dd819c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:59.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.037+0000 7f6ddea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6dd8076a50 0x7f6dd81a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:59.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.037+0000 7f6ddea00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd81a3ed0 con 0x7f6dd80760b0 2024-09-13T16:12:59.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.037+0000 7f6ddea00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd81a4040 con 0x7f6dd8076a50 2024-09-13T16:12:59.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.037+0000 7f6ddea00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd81a4200 con 0x7f6dd8074e70 2024-09-13T16:12:59.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.037+0000 7f6dcf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6dd80760b0 0x7f6dd819c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:59.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.038+0000 7f6dcf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6dd80760b0 0x7f6dd819c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42760/0 (socket says 172.21.15.17:42760) 2024-09-13T16:12:59.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.038+0000 7f6dd7e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6dd8074e70 0x7f6dd819c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:59.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.038+0000 7f6dcf400640 1 -- 172.21.15.17:0/330189724 learned_addr learned my addr 172.21.15.17:0/330189724 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:59.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.038+0000 7f6ddca00640 1 --2- 172.21.15.17:0/330189724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6dd8076a50 0x7f6dd81a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:59.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.038+0000 7f6dd7e00640 1 -- 172.21.15.17:0/330189724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6dd8076a50 msgr2=0x7f6dd81a3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:59.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.038+0000 7f6dd7e00640 1 --2- 172.21.15.17:0/330189724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6dd8076a50 0x7f6dd81a3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.038+0000 7f6dd7e00640 1 -- 172.21.15.17:0/330189724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6dd80760b0 msgr2=0x7f6dd819c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:59.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.038+0000 7f6dd7e00640 1 --2- 172.21.15.17:0/330189724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6dd80760b0 0x7f6dd819c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.038+0000 7f6dd7e00640 1 -- 172.21.15.17:0/330189724 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc0009560 con 0x7f6dd8074e70 2024-09-13T16:12:59.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.038+0000 7f6dd7e00640 1 --2- 172.21.15.17:0/330189724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6dd8074e70 0x7f6dd819c3e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800e9f0 tx=0x7f6dc800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:59.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.039+0000 7f6dd5600640 1 -- 172.21.15.17:0/330189724 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc800ccc0 con 0x7f6dd8074e70 2024-09-13T16:12:59.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.039+0000 7f6dd5600640 1 -- 172.21.15.17:0/330189724 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6dc800ce20 con 0x7f6dd8074e70 2024-09-13T16:12:59.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.039+0000 7f6dd5600640 1 -- 172.21.15.17:0/330189724 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80187e0 con 0x7f6dd8074e70 2024-09-13T16:12:59.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.039+0000 7f6ddea00640 1 -- 172.21.15.17:0/330189724 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd81a44e0 con 0x7f6dd8074e70 2024-09-13T16:12:59.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.039+0000 7f6ddea00640 1 -- 172.21.15.17:0/330189724 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd81a49a0 con 0x7f6dd8074e70 2024-09-13T16:12:59.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.040+0000 7f6ddea00640 1 -- 172.21.15.17:0/330189724 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd810eb00 con 0x7f6dd8074e70 2024-09-13T16:12:59.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.041+0000 7f6dd5600640 1 -- 172.21.15.17:0/330189724 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6dc8010430 con 0x7f6dd8074e70 2024-09-13T16:12:59.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.043+0000 7f6dd5600640 1 --2- 172.21.15.17:0/330189724 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6dbc0a1110 0x7f6dbc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:59.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.043+0000 7f6dd5600640 1 -- 172.21.15.17:0/330189724 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f6dc8014070 con 0x7f6dd8074e70 2024-09-13T16:12:59.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.043+0000 7f6dcf400640 1 --2- 172.21.15.17:0/330189724 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6dbc0a1110 0x7f6dbc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:59.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.044+0000 7f6dcf400640 1 --2- 172.21.15.17:0/330189724 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6dbc0a1110 0x7f6dbc0a35d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6dd819d8f0 tx=0x7f6dc0005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:59.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.047+0000 7f6dd5600640 1 -- 172.21.15.17:0/330189724 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6dc8052e20 con 0x7f6dd8074e70 2024-09-13T16:12:59.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.229+0000 7f6ddea00640 1 -- 172.21.15.17:0/330189724 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6dd802c480 con 0x7f6dd8074e70 2024-09-13T16:12:59.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.230+0000 7f6dd5600640 1 -- 172.21.15.17:0/330189724 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6dc8099dd0 con 0x7f6dd8074e70 2024-09-13T16:12:59.232 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-13T16:12:59.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.232+0000 7f6ddea00640 1 -- 172.21.15.17:0/330189724 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6dbc0a1110 msgr2=0x7f6dbc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:59.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.232+0000 7f6ddea00640 1 --2- 172.21.15.17:0/330189724 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6dbc0a1110 0x7f6dbc0a35d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6dd819d8f0 tx=0x7f6dc0005780 comp rx=0 tx=0).stop 2024-09-13T16:12:59.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.232+0000 7f6ddea00640 1 -- 172.21.15.17:0/330189724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6dd8074e70 msgr2=0x7f6dd819c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:59.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.232+0000 7f6ddea00640 1 --2- 172.21.15.17:0/330189724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6dd8074e70 0x7f6dd819c3e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800e9f0 tx=0x7f6dc800eeb0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.232+0000 7f6ddea00640 1 -- 172.21.15.17:0/330189724 shutdown_connections 2024-09-13T16:12:59.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.232+0000 7f6ddea00640 1 --2- 172.21.15.17:0/330189724 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6dbc0a1110 0x7f6dbc0a35d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.232+0000 7f6ddea00640 1 --2- 172.21.15.17:0/330189724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6dd8076a50 0x7f6dd81a3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.232+0000 7f6ddea00640 1 --2- 172.21.15.17:0/330189724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6dd80760b0 0x7f6dd819c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.232+0000 7f6ddea00640 1 --2- 172.21.15.17:0/330189724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6dd8074e70 0x7f6dd819c3e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.232+0000 7f6ddea00640 1 -- 172.21.15.17:0/330189724 >> 172.21.15.17:0/330189724 conn(0x7f6dd80fd6f0 msgr2=0x7f6dd80fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:59.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.232+0000 7f6ddea00640 1 -- 172.21.15.17:0/330189724 shutdown_connections 2024-09-13T16:12:59.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.233+0000 7f6ddea00640 1 -- 172.21.15.17:0/330189724 wait complete. 2024-09-13T16:12:59.250 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:12:59.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.409+0000 7f0aaf400640 1 -- 172.21.15.17:0/1597832730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0aa8103b30 msgr2=0x7f0aa810a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:59.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.409+0000 7f0aaf400640 1 --2- 172.21.15.17:0/1597832730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0aa8103b30 0x7f0aa810a3c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009ca0 tx=0x7f0aa002a8c0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.409+0000 7f0aaf400640 1 -- 172.21.15.17:0/1597832730 shutdown_connections 2024-09-13T16:12:59.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.409+0000 7f0aaf400640 1 --2- 172.21.15.17:0/1597832730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0aa8103b30 0x7f0aa810a3c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.409+0000 7f0aaf400640 1 --2- 172.21.15.17:0/1597832730 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0aa8103170 0x7f0aa81035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.409+0000 7f0aaf400640 1 --2- 172.21.15.17:0/1597832730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0aa8101f80 0x7f0aa8102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.409+0000 7f0aaf400640 1 -- 172.21.15.17:0/1597832730 >> 172.21.15.17:0/1597832730 conn(0x7f0aa80fd700 msgr2=0x7f0aa80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:59.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.409+0000 7f0aaf400640 1 -- 172.21.15.17:0/1597832730 shutdown_connections 2024-09-13T16:12:59.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.409+0000 7f0aaf400640 1 -- 172.21.15.17:0/1597832730 wait complete. 2024-09-13T16:12:59.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.410+0000 7f0aaf400640 1 Processor -- start 2024-09-13T16:12:59.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.410+0000 7f0aaf400640 1 -- start start 2024-09-13T16:12:59.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.410+0000 7f0aaf400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0aa8101f80 0x7f0aa8197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:59.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.410+0000 7f0aaf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0aa8103170 0x7f0aa81984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:59.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.410+0000 7f0aaf400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0aa8103b30 0x7f0aa819f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:59.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.410+0000 7f0aaf400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa819fa20 con 0x7f0aa8103170 2024-09-13T16:12:59.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.410+0000 7f0aaf400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa819fb90 con 0x7f0aa8103b30 2024-09-13T16:12:59.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.410+0000 7f0aaf400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa819fd50 con 0x7f0aa8101f80 2024-09-13T16:12:59.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.411+0000 7f0aa7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0aa8103170 0x7f0aa81984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:59.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.411+0000 7f0aa7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0aa8103170 0x7f0aa81984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42772/0 (socket says 172.21.15.17:42772) 2024-09-13T16:12:59.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.411+0000 7f0aa7e00640 1 -- 172.21.15.17:0/2603267851 learned_addr learned my addr 172.21.15.17:0/2603267851 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.411+0000 7f0aa7e00640 1 -- 172.21.15.17:0/2603267851 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0aa8101f80 msgr2=0x7f0aa8197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.411+0000 7f0aa7e00640 1 --2- 172.21.15.17:0/2603267851 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0aa8101f80 0x7f0aa8197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.411+0000 7f0aa7e00640 1 -- 172.21.15.17:0/2603267851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0aa8103b30 msgr2=0x7f0aa819f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.411+0000 7f0aa7e00640 1 --2- 172.21.15.17:0/2603267851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0aa8103b30 0x7f0aa819f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.411+0000 7f0aa7e00640 1 -- 172.21.15.17:0/2603267851 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa0009900 con 0x7f0aa8103170 2024-09-13T16:12:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.411+0000 7f0aa7e00640 1 --2- 172.21.15.17:0/2603267851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0aa8103170 0x7f0aa81984c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400e9f0 tx=0x7f0a9400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.411+0000 7f0aa5600640 1 -- 172.21.15.17:0/2603267851 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a94009700 con 0x7f0aa8103170 2024-09-13T16:12:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.412+0000 7f0aaf400640 1 -- 172.21.15.17:0/2603267851 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa819ffd0 con 0x7f0aa8103170 2024-09-13T16:12:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.412+0000 7f0aa5600640 1 -- 172.21.15.17:0/2603267851 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a9400cd80 con 0x7f0aa8103170 2024-09-13T16:12:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.412+0000 7f0aa5600640 1 -- 172.21.15.17:0/2603267851 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a94018860 con 0x7f0aa8103170 2024-09-13T16:12:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.412+0000 7f0aaf400640 1 -- 172.21.15.17:0/2603267851 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa81a0500 con 0x7f0aa8103170 2024-09-13T16:12:59.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.413+0000 7f0aaf400640 1 -- 172.21.15.17:0/2603267851 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa81093c0 con 0x7f0aa8103170 2024-09-13T16:12:59.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.414+0000 7f0aa5600640 1 -- 172.21.15.17:0/2603267851 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0a940189c0 con 0x7f0aa8103170 2024-09-13T16:12:59.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.416+0000 7f0aa5600640 1 --2- 172.21.15.17:0/2603267851 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0a900a1110 0x7f0a900a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:59.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.417+0000 7f0aa5600640 1 -- 172.21.15.17:0/2603267851 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f0a94014070 con 0x7f0aa8103170 2024-09-13T16:12:59.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.417+0000 7f0aaca00640 1 --2- 172.21.15.17:0/2603267851 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0a900a1110 0x7f0a900a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:59.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.418+0000 7f0aaca00640 1 --2- 172.21.15.17:0/2603267851 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0a900a1110 0x7f0a900a35d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8102fd0 tx=0x7f0a9c009630 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:59.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.421+0000 7f0aa5600640 1 -- 172.21.15.17:0/2603267851 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0a94052e20 con 0x7f0aa8103170 2024-09-13T16:12:59.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.604+0000 7f0aaf400640 1 -- 172.21.15.17:0/2603267851 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0aa802c410 con 0x7f0aa8103170 2024-09-13T16:12:59.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.604+0000 7f0aa5600640 1 -- 172.21.15.17:0/2603267851 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0a940964a0 con 0x7f0aa8103170 2024-09-13T16:12:59.606 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-13T16:12:59.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.607+0000 7f0aaf400640 1 -- 172.21.15.17:0/2603267851 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0a900a1110 msgr2=0x7f0a900a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:59.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.607+0000 7f0aaf400640 1 --2- 172.21.15.17:0/2603267851 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0a900a1110 0x7f0a900a35d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8102fd0 tx=0x7f0a9c009630 comp rx=0 tx=0).stop 2024-09-13T16:12:59.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.607+0000 7f0aaf400640 1 -- 172.21.15.17:0/2603267851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0aa8103170 msgr2=0x7f0aa81984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:59.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.607+0000 7f0aaf400640 1 --2- 172.21.15.17:0/2603267851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0aa8103170 0x7f0aa81984c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400e9f0 tx=0x7f0a9400eeb0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.607+0000 7f0aaf400640 1 -- 172.21.15.17:0/2603267851 shutdown_connections 2024-09-13T16:12:59.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.607+0000 7f0aaf400640 1 --2- 172.21.15.17:0/2603267851 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f0a900a1110 0x7f0a900a35d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.607+0000 7f0aaf400640 1 --2- 172.21.15.17:0/2603267851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0aa8103b30 0x7f0aa819f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.607+0000 7f0aaf400640 1 --2- 172.21.15.17:0/2603267851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0aa8103170 0x7f0aa81984c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.607+0000 7f0aaf400640 1 --2- 172.21.15.17:0/2603267851 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0aa8101f80 0x7f0aa8197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.607+0000 7f0aaf400640 1 -- 172.21.15.17:0/2603267851 >> 172.21.15.17:0/2603267851 conn(0x7f0aa80fd700 msgr2=0x7f0aa8106590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:59.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.607+0000 7f0aaf400640 1 -- 172.21.15.17:0/2603267851 shutdown_connections 2024-09-13T16:12:59.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.607+0000 7f0aaf400640 1 -- 172.21.15.17:0/2603267851 wait complete. 2024-09-13T16:12:59.624 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:12:59.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.794+0000 7fc20a400640 1 -- 172.21.15.17:0/3460987960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc204103a40 msgr2=0x7fc20410a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:59.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.794+0000 7fc20a400640 1 --2- 172.21.15.17:0/3460987960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc204103a40 0x7fc20410a360 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc009ca0 tx=0x7fc1fc02a8c0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.794+0000 7fc20a400640 1 -- 172.21.15.17:0/3460987960 shutdown_connections 2024-09-13T16:12:59.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.794+0000 7fc20a400640 1 --2- 172.21.15.17:0/3460987960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc204103a40 0x7fc20410a360 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.794+0000 7fc20a400640 1 --2- 172.21.15.17:0/3460987960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc204103080 0x7fc204103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.794+0000 7fc20a400640 1 --2- 172.21.15.17:0/3460987960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc204101ea0 0x7fc2041022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.794+0000 7fc20a400640 1 -- 172.21.15.17:0/3460987960 >> 172.21.15.17:0/3460987960 conn(0x7fc2040fd650 msgr2=0x7fc2040ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:59.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.794+0000 7fc20a400640 1 -- 172.21.15.17:0/3460987960 shutdown_connections 2024-09-13T16:12:59.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.794+0000 7fc20a400640 1 -- 172.21.15.17:0/3460987960 wait complete. 2024-09-13T16:12:59.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.795+0000 7fc20a400640 1 Processor -- start 2024-09-13T16:12:59.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.795+0000 7fc20a400640 1 -- start start 2024-09-13T16:12:59.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.795+0000 7fc20a400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc204101ea0 0x7fc204197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:59.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.795+0000 7fc20a400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc204103080 0x7fc2041983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:59.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.795+0000 7fc20a400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc204103a40 0x7fc20419f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:59.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.795+0000 7fc20a400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20419f980 con 0x7fc204103080 2024-09-13T16:12:59.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.795+0000 7fc20a400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20419faf0 con 0x7fc204103a40 2024-09-13T16:12:59.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.795+0000 7fc20a400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20419fcb0 con 0x7fc204101ea0 2024-09-13T16:12:59.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.795+0000 7fc1fbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc204103080 0x7fc2041983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:59.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.796+0000 7fc1fbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc204103080 0x7fc2041983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42790/0 (socket says 172.21.15.17:42790) 2024-09-13T16:12:59.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.796+0000 7fc1fbe00640 1 -- 172.21.15.17:0/2255837648 learned_addr learned my addr 172.21.15.17:0/2255837648 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:12:59.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.796+0000 7fc209a00640 1 --2- 172.21.15.17:0/2255837648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc204103a40 0x7fc20419f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:59.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.796+0000 7fc209000640 1 --2- 172.21.15.17:0/2255837648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc204101ea0 0x7fc204197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:59.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.796+0000 7fc1fbe00640 1 -- 172.21.15.17:0/2255837648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc204101ea0 msgr2=0x7fc204197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:59.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.796+0000 7fc1fbe00640 1 --2- 172.21.15.17:0/2255837648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc204101ea0 0x7fc204197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.796+0000 7fc1fbe00640 1 -- 172.21.15.17:0/2255837648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc204103a40 msgr2=0x7fc20419f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:59.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.796+0000 7fc1fbe00640 1 --2- 172.21.15.17:0/2255837648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc204103a40 0x7fc20419f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.796+0000 7fc1fbe00640 1 -- 172.21.15.17:0/2255837648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1fc009900 con 0x7fc204103080 2024-09-13T16:12:59.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.796+0000 7fc1fbe00640 1 --2- 172.21.15.17:0/2255837648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc204103080 0x7fc2041983d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec00e9f0 tx=0x7fc1ec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:59.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.797+0000 7fc202000640 1 -- 172.21.15.17:0/2255837648 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec009700 con 0x7fc204103080 2024-09-13T16:12:59.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.797+0000 7fc202000640 1 -- 172.21.15.17:0/2255837648 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc1ec00cd80 con 0x7fc204103080 2024-09-13T16:12:59.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.797+0000 7fc202000640 1 -- 172.21.15.17:0/2255837648 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec018860 con 0x7fc204103080 2024-09-13T16:12:59.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.797+0000 7fc20a400640 1 -- 172.21.15.17:0/2255837648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc20419ff90 con 0x7fc204103080 2024-09-13T16:12:59.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.797+0000 7fc20a400640 1 -- 172.21.15.17:0/2255837648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2041a03c0 con 0x7fc204103080 2024-09-13T16:12:59.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.798+0000 7fc20a400640 1 -- 172.21.15.17:0/2255837648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc204109360 con 0x7fc204103080 2024-09-13T16:12:59.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.800+0000 7fc202000640 1 -- 172.21.15.17:0/2255837648 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc1ec0189c0 con 0x7fc204103080 2024-09-13T16:12:59.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.802+0000 7fc202000640 1 --2- 172.21.15.17:0/2255837648 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1e80a1110 0x7fc1e80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:12:59.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.802+0000 7fc202000640 1 -- 172.21.15.17:0/2255837648 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fc1ec014070 con 0x7fc204103080 2024-09-13T16:12:59.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.802+0000 7fc209000640 1 --2- 172.21.15.17:0/2255837648 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1e80a1110 0x7fc1e80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:12:59.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.803+0000 7fc209000640 1 --2- 172.21.15.17:0/2255837648 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1e80a1110 0x7fc1e80a35d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc204102bf0 tx=0x7fc1f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:12:59.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.806+0000 7fc202000640 1 -- 172.21.15.17:0/2255837648 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc1ec052e20 con 0x7fc204103080 2024-09-13T16:12:59.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.986+0000 7fc20a400640 1 -- 172.21.15.17:0/2255837648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc204108dd0 con 0x7fc204103080 2024-09-13T16:12:59.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.987+0000 7fc202000640 1 -- 172.21.15.17:0/2255837648 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc1ec096390 con 0x7fc204103080 2024-09-13T16:12:59.989 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-09-13T16:12:59.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.989+0000 7fc20a400640 1 -- 172.21.15.17:0/2255837648 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1e80a1110 msgr2=0x7fc1e80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:59.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.989+0000 7fc20a400640 1 --2- 172.21.15.17:0/2255837648 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1e80a1110 0x7fc1e80a35d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc204102bf0 tx=0x7fc1f4005f90 comp rx=0 tx=0).stop 2024-09-13T16:12:59.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.989+0000 7fc20a400640 1 -- 172.21.15.17:0/2255837648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc204103080 msgr2=0x7fc2041983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:12:59.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.989+0000 7fc20a400640 1 --2- 172.21.15.17:0/2255837648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc204103080 0x7fc2041983d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec00e9f0 tx=0x7fc1ec00eeb0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.989+0000 7fc20a400640 1 -- 172.21.15.17:0/2255837648 shutdown_connections 2024-09-13T16:12:59.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.989+0000 7fc20a400640 1 --2- 172.21.15.17:0/2255837648 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc1e80a1110 0x7fc1e80a35d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.989+0000 7fc20a400640 1 --2- 172.21.15.17:0/2255837648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc204103a40 0x7fc20419f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.989+0000 7fc20a400640 1 --2- 172.21.15.17:0/2255837648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc204103080 0x7fc2041983d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.989+0000 7fc20a400640 1 --2- 172.21.15.17:0/2255837648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc204101ea0 0x7fc204197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:12:59.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.989+0000 7fc20a400640 1 -- 172.21.15.17:0/2255837648 >> 172.21.15.17:0/2255837648 conn(0x7fc2040fd650 msgr2=0x7fc204106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:12:59.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.989+0000 7fc20a400640 1 -- 172.21.15.17:0/2255837648 shutdown_connections 2024-09-13T16:12:59.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:12:59.989+0000 7fc20a400640 1 -- 172.21.15.17:0/2255837648 wait complete. 2024-09-13T16:13:00.005 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:59 smithi017 ceph-mon[30494]: pgmap v842: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.5 MiB/s wr, 706 op/s 2024-09-13T16:13:00.005 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:59 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1146785012' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:13:00.006 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:59 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/330189724' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:13:00.006 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:12:59 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/2603267851' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:13:00.007 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T16:13:00.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:59 smithi189 ceph-mon[34790]: pgmap v842: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.5 MiB/s wr, 706 op/s 2024-09-13T16:13:00.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:59 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1146785012' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:13:00.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:59 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/330189724' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:13:00.107 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:12:59 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/2603267851' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:13:00.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.166+0000 7f066a200640 1 -- 172.21.15.17:0/237769980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0664103a40 msgr2=0x7f066410a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:00.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.166+0000 7f066a200640 1 --2- 172.21.15.17:0/237769980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0664103a40 0x7f066410a360 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f065c009ca0 tx=0x7f065c02a8c0 comp rx=0 tx=0).stop 2024-09-13T16:13:00.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.167+0000 7f066a200640 1 -- 172.21.15.17:0/237769980 shutdown_connections 2024-09-13T16:13:00.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.167+0000 7f066a200640 1 --2- 172.21.15.17:0/237769980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0664103a40 0x7f066410a360 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:00.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.167+0000 7f066a200640 1 --2- 172.21.15.17:0/237769980 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0664103080 0x7f0664103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:00.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.167+0000 7f066a200640 1 --2- 172.21.15.17:0/237769980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0664101ea0 0x7f06641022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:00.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.167+0000 7f066a200640 1 -- 172.21.15.17:0/237769980 >> 172.21.15.17:0/237769980 conn(0x7f06640fd670 msgr2=0x7f06640ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:00.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.167+0000 7f066a200640 1 -- 172.21.15.17:0/237769980 shutdown_connections 2024-09-13T16:13:00.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.167+0000 7f066a200640 1 -- 172.21.15.17:0/237769980 wait complete. 2024-09-13T16:13:00.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.168+0000 7f066a200640 1 Processor -- start 2024-09-13T16:13:00.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.168+0000 7f066a200640 1 -- start start 2024-09-13T16:13:00.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.168+0000 7f066a200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0664101ea0 0x7f0664197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:00.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.168+0000 7f066a200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0664103080 0x7f06641983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:00.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.168+0000 7f066a200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0664103a40 0x7f066419f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:00.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.168+0000 7f066a200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066419f940 con 0x7f0664103080 2024-09-13T16:13:00.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.168+0000 7f066a200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066419fab0 con 0x7f0664103a40 2024-09-13T16:13:00.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.168+0000 7f066a200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066419fc70 con 0x7f0664101ea0 2024-09-13T16:13:00.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.168+0000 7f065be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0664103080 0x7f06641983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:00.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.168+0000 7f065be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0664103080 0x7f06641983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42814/0 (socket says 172.21.15.17:42814) 2024-09-13T16:13:00.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.168+0000 7f065be00640 1 -- 172.21.15.17:0/1648692134 learned_addr learned my addr 172.21.15.17:0/1648692134 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:13:00.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.168+0000 7f0668e00640 1 --2- 172.21.15.17:0/1648692134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0664101ea0 0x7f0664197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:00.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.169+0000 7f0669800640 1 --2- 172.21.15.17:0/1648692134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0664103a40 0x7f066419f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:00.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.169+0000 7f065be00640 1 -- 172.21.15.17:0/1648692134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0664101ea0 msgr2=0x7f0664197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:00.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.169+0000 7f065be00640 1 --2- 172.21.15.17:0/1648692134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0664101ea0 0x7f0664197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:00.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.169+0000 7f065be00640 1 -- 172.21.15.17:0/1648692134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0664103a40 msgr2=0x7f066419f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:00.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.169+0000 7f065be00640 1 --2- 172.21.15.17:0/1648692134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0664103a40 0x7f066419f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:00.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.169+0000 7f065be00640 1 -- 172.21.15.17:0/1648692134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c009900 con 0x7f0664103080 2024-09-13T16:13:00.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.169+0000 7f065be00640 1 --2- 172.21.15.17:0/1648692134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0664103080 0x7f06641983e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f064c00e9f0 tx=0x7f064c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:00.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.169+0000 7f0662000640 1 -- 172.21.15.17:0/1648692134 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c009700 con 0x7f0664103080 2024-09-13T16:13:00.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.169+0000 7f0662000640 1 -- 172.21.15.17:0/1648692134 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f064c00cd80 con 0x7f0664103080 2024-09-13T16:13:00.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.169+0000 7f0662000640 1 -- 172.21.15.17:0/1648692134 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c018860 con 0x7f0664103080 2024-09-13T16:13:00.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.169+0000 7f066a200640 1 -- 172.21.15.17:0/1648692134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066419ff50 con 0x7f0664103080 2024-09-13T16:13:00.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.170+0000 7f066a200640 1 -- 172.21.15.17:0/1648692134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06641a03d0 con 0x7f0664103080 2024-09-13T16:13:00.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.171+0000 7f066a200640 1 -- 172.21.15.17:0/1648692134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0664109360 con 0x7f0664103080 2024-09-13T16:13:00.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.172+0000 7f0662000640 1 -- 172.21.15.17:0/1648692134 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f064c0189c0 con 0x7f0664103080 2024-09-13T16:13:00.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.174+0000 7f0662000640 1 --2- 172.21.15.17:0/1648692134 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f06480a1110 0x7f06480a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:00.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.174+0000 7f0662000640 1 -- 172.21.15.17:0/1648692134 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f064c014070 con 0x7f0664103080 2024-09-13T16:13:00.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.174+0000 7f0668e00640 1 --2- 172.21.15.17:0/1648692134 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f06480a1110 0x7f06480a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:00.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.175+0000 7f0668e00640 1 --2- 172.21.15.17:0/1648692134 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f06480a1110 0x7f06480a35d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0664102bf0 tx=0x7f0654005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:00.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.177+0000 7f0662000640 1 -- 172.21.15.17:0/1648692134 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f064c052e20 con 0x7f0664103080 2024-09-13T16:13:00.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:59 smithi193 ceph-mon[35248]: pgmap v842: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.5 MiB/s wr, 706 op/s 2024-09-13T16:13:00.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:59 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1146785012' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:13:00.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:59 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/330189724' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:13:00.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:12:59 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/2603267851' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:13:00.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.358+0000 7f066a200640 1 -- 172.21.15.17:0/1648692134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f066410d800 con 0x7f0664103080 2024-09-13T16:13:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.358+0000 7f0662000640 1 -- 172.21.15.17:0/1648692134 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7f066410d800 con 0x7f0664103080 2024-09-13T16:13:00.360 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-13T16:13:00.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.360+0000 7f066a200640 1 -- 172.21.15.17:0/1648692134 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f06480a1110 msgr2=0x7f06480a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:00.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.360+0000 7f066a200640 1 --2- 172.21.15.17:0/1648692134 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f06480a1110 0x7f06480a35d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0664102bf0 tx=0x7f0654005f90 comp rx=0 tx=0).stop 2024-09-13T16:13:00.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.360+0000 7f066a200640 1 -- 172.21.15.17:0/1648692134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0664103080 msgr2=0x7f06641983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:00.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.360+0000 7f066a200640 1 --2- 172.21.15.17:0/1648692134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0664103080 0x7f06641983e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f064c00e9f0 tx=0x7f064c00eeb0 comp rx=0 tx=0).stop 2024-09-13T16:13:00.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.360+0000 7f066a200640 1 -- 172.21.15.17:0/1648692134 shutdown_connections 2024-09-13T16:13:00.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.360+0000 7f066a200640 1 --2- 172.21.15.17:0/1648692134 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f06480a1110 0x7f06480a35d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:00.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.360+0000 7f066a200640 1 --2- 172.21.15.17:0/1648692134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0664103a40 0x7f066419f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:00.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.360+0000 7f066a200640 1 --2- 172.21.15.17:0/1648692134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0664103080 0x7f06641983e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:00.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.360+0000 7f066a200640 1 --2- 172.21.15.17:0/1648692134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0664101ea0 0x7f0664197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:00.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.360+0000 7f066a200640 1 -- 172.21.15.17:0/1648692134 >> 172.21.15.17:0/1648692134 conn(0x7f06640fd670 msgr2=0x7f0664106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:00.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.360+0000 7f066a200640 1 -- 172.21.15.17:0/1648692134 shutdown_connections 2024-09-13T16:13:00.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.361+0000 7f066a200640 1 -- 172.21.15.17:0/1648692134 wait complete. 2024-09-13T16:13:00.379 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-13T16:13:00.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.538+0000 7fea30600640 1 -- 172.21.15.17:0/1219578659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea28101950 msgr2=0x7fea281081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:00.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.538+0000 7fea30600640 1 --2- 172.21.15.17:0/1219578659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea28101950 0x7fea281081e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fea20009ca0 tx=0x7fea2002a8c0 comp rx=0 tx=0).stop 2024-09-13T16:13:00.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.538+0000 7fea30600640 1 -- 172.21.15.17:0/1219578659 shutdown_connections 2024-09-13T16:13:00.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.538+0000 7fea30600640 1 --2- 172.21.15.17:0/1219578659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea28101950 0x7fea281081e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:00.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.538+0000 7fea30600640 1 --2- 172.21.15.17:0/1219578659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea28100f90 0x7fea28101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:00.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.538+0000 7fea30600640 1 --2- 172.21.15.17:0/1219578659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea280ffda0 0x7fea281001a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:00.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.538+0000 7fea30600640 1 -- 172.21.15.17:0/1219578659 >> 172.21.15.17:0/1219578659 conn(0x7fea280fb520 msgr2=0x7fea280fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:00.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.538+0000 7fea30600640 1 -- 172.21.15.17:0/1219578659 shutdown_connections 2024-09-13T16:13:00.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.538+0000 7fea30600640 1 -- 172.21.15.17:0/1219578659 wait complete. 2024-09-13T16:13:00.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.539+0000 7fea30600640 1 Processor -- start 2024-09-13T16:13:00.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.539+0000 7fea30600640 1 -- start start 2024-09-13T16:13:00.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.540+0000 7fea30600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea280ffda0 0x7fea28197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:00.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.540+0000 7fea30600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea28100f90 0x7fea281984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:00.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.540+0000 7fea30600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea28101950 0x7fea2819f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:00.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.540+0000 7fea30600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2819faa0 con 0x7fea28101950 2024-09-13T16:13:00.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.540+0000 7fea30600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2819fc10 con 0x7fea280ffda0 2024-09-13T16:13:00.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.540+0000 7fea30600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2819fdd0 con 0x7fea28100f90 2024-09-13T16:13:00.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.540+0000 7fea2e600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea28101950 0x7fea2819f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:00.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.540+0000 7fea2dc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea280ffda0 0x7fea28197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:00.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.540+0000 7fea2d200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea28100f90 0x7fea281984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:00.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.540+0000 7fea2dc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea280ffda0 0x7fea28197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:37848/0 (socket says 172.21.15.17:37848) 2024-09-13T16:13:00.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.540+0000 7fea2d200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea28100f90 0x7fea281984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.17:58236/0 (socket says 172.21.15.17:58236) 2024-09-13T16:13:00.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.540+0000 7fea2e600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea28101950 0x7fea2819f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42836/0 (socket says 172.21.15.17:42836) 2024-09-13T16:13:00.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.540+0000 7fea2dc00640 1 -- 172.21.15.17:0/2286363382 learned_addr learned my addr 172.21.15.17:0/2286363382 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:13:00.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.540+0000 7fea2d200640 1 -- 172.21.15.17:0/2286363382 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea280ffda0 msgr2=0x7fea28197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:00.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.540+0000 7fea2d200640 1 --2- 172.21.15.17:0/2286363382 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea280ffda0 0x7fea28197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:00.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.540+0000 7fea2d200640 1 -- 172.21.15.17:0/2286363382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea28101950 msgr2=0x7fea2819f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:00.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.540+0000 7fea2d200640 1 --2- 172.21.15.17:0/2286363382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea28101950 0x7fea2819f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:00.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.541+0000 7fea2d200640 1 -- 172.21.15.17:0/2286363382 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea20009900 con 0x7fea28100f90 2024-09-13T16:13:00.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.541+0000 7fea2e600640 1 --2- 172.21.15.17:0/2286363382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea28101950 0x7fea2819f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:13:00.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.541+0000 7fea2d200640 1 --2- 172.21.15.17:0/2286363382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea28100f90 0x7fea281984f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fea1400e9f0 tx=0x7fea1400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:00.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.541+0000 7fea26000640 1 -- 172.21.15.17:0/2286363382 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1400ccc0 con 0x7fea28100f90 2024-09-13T16:13:00.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.541+0000 7fea30600640 1 -- 172.21.15.17:0/2286363382 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea281a00b0 con 0x7fea28100f90 2024-09-13T16:13:00.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.541+0000 7fea26000640 1 -- 172.21.15.17:0/2286363382 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea1400ce20 con 0x7fea28100f90 2024-09-13T16:13:00.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.541+0000 7fea26000640 1 -- 172.21.15.17:0/2286363382 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea140187c0 con 0x7fea28100f90 2024-09-13T16:13:00.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.541+0000 7fea30600640 1 -- 172.21.15.17:0/2286363382 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea281a05c0 con 0x7fea28100f90 2024-09-13T16:13:00.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.542+0000 7fea30600640 1 -- 172.21.15.17:0/2286363382 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea2810b690 con 0x7fea28100f90 2024-09-13T16:13:00.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.544+0000 7fea26000640 1 -- 172.21.15.17:0/2286363382 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fea14010430 con 0x7fea28100f90 2024-09-13T16:13:00.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.545+0000 7fea26000640 1 --2- 172.21.15.17:0/2286363382 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fea100a1090 0x7fea100a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:00.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.546+0000 7fea26000640 1 -- 172.21.15.17:0/2286363382 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fea14014070 con 0x7fea28100f90 2024-09-13T16:13:00.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.546+0000 7fea2dc00640 1 --2- 172.21.15.17:0/2286363382 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fea100a1090 0x7fea100a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:00.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.546+0000 7fea2dc00640 1 --2- 172.21.15.17:0/2286363382 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fea100a1090 0x7fea100a3550 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0058c0 tx=0x7fea1c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:00.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.547+0000 7fea26000640 1 -- 172.21.15.17:0/2286363382 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fea140968f0 con 0x7fea28100f90 2024-09-13T16:13:00.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.799+0000 7fea30600640 1 -- 172.21.15.17:0/2286363382 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7fea2810b820 con 0x7fea28100f90 2024-09-13T16:13:00.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.808+0000 7fea26000640 1 -- 172.21.15.17:0/2286363382 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) v1 ==== 81+0+733409 (secure 0 0 0) 0x7fea14099f10 con 0x7fea28100f90 2024-09-13T16:13:00.820 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:13:00.820 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-13T16:13:00.820 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 18, 2024-09-13T16:13:00.820 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.821 INFO:teuthology.orchestra.run.smithi017.stdout: "active_gid": 14150, 2024-09-13T16:13:00.821 INFO:teuthology.orchestra.run.smithi017.stdout: "active_name": "x", 2024-09-13T16:13:00.821 INFO:teuthology.orchestra.run.smithi017.stdout: "active_addrs": { 2024-09-13T16:13:00.821 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-13T16:13:00.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:00.821 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-13T16:13:00.821 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2024-09-13T16:13:00.821 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1039314076 2024-09-13T16:13:00.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:00.821 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-13T16:13:00.821 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2024-09-13T16:13:00.821 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1039314076 2024-09-13T16:13:00.822 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:00.822 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-13T16:13:00.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.822 INFO:teuthology.orchestra.run.smithi017.stdout: "active_addr": "172.21.15.17:6801/1039314076", 2024-09-13T16:13:00.822 INFO:teuthology.orchestra.run.smithi017.stdout: "active_change": "2024-09-13T15:47:42.048155+0000", 2024-09-13T16:13:00.822 INFO:teuthology.orchestra.run.smithi017.stdout: "active_mgr_features": 4540138322906710015, 2024-09-13T16:13:00.822 INFO:teuthology.orchestra.run.smithi017.stdout: "available": true, 2024-09-13T16:13:00.822 INFO:teuthology.orchestra.run.smithi017.stdout: "standbys": [ 2024-09-13T16:13:00.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:00.822 INFO:teuthology.orchestra.run.smithi017.stdout: "gid": 24109, 2024-09-13T16:13:00.822 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "z", 2024-09-13T16:13:00.822 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_features": 4540138322906710015, 2024-09-13T16:13:00.822 INFO:teuthology.orchestra.run.smithi017.stdout: "available_modules": [ 2024-09-13T16:13:00.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:00.823 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alerts", 2024-09-13T16:13:00.823 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:00.823 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:00.823 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:00.823 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-13T16:13:00.823 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-13T16:13:00.823 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:00.823 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.823 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.823 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-13T16:13:00.823 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.823 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.823 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.824 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How frequently to reexamine health status", 2024-09-13T16:13:00.824 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.824 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.824 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.824 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:00.824 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:00.824 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.824 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.824 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.824 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.824 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.824 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.825 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:00.825 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:00.825 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:00.825 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:00.825 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:00.825 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:00.825 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:00.825 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:00.825 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.825 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.826 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.826 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.826 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:00.826 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:00.826 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.826 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.826 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.826 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.826 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.826 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.826 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.826 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.827 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.827 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.827 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.827 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:00.827 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:00.827 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.827 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.827 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.827 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:00.827 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.827 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.827 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:00.827 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:00.828 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:00.828 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:00.828 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:00.828 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:00.828 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:00.828 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:00.828 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.828 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.828 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.828 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.828 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:00.828 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:00.829 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.829 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.829 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.829 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.829 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.829 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.829 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.829 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.829 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.829 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.829 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.829 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_destination": { 2024-09-13T16:13:00.830 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_destination", 2024-09-13T16:13:00.830 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.830 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.830 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.830 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.830 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.830 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.830 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.830 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email address to send alerts to", 2024-09-13T16:13:00.830 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.830 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.830 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.831 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_from_name": { 2024-09-13T16:13:00.831 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_from_name", 2024-09-13T16:13:00.831 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.831 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.831 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.831 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "Ceph", 2024-09-13T16:13:00.831 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.831 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.831 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.831 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email From: name", 2024-09-13T16:13:00.831 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.831 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.831 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.832 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_host": { 2024-09-13T16:13:00.832 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_host", 2024-09-13T16:13:00.832 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.832 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.832 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.832 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.832 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.832 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.832 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.832 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP server", 2024-09-13T16:13:00.832 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.832 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.832 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.833 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_password": { 2024-09-13T16:13:00.833 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_password", 2024-09-13T16:13:00.833 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.833 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.833 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.833 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.833 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.833 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.833 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.833 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Password to authenticate with", 2024-09-13T16:13:00.833 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.833 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.833 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.834 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_port": { 2024-09-13T16:13:00.834 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_port", 2024-09-13T16:13:00.834 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:00.834 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.834 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.834 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "465", 2024-09-13T16:13:00.834 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.834 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.834 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.834 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP port", 2024-09-13T16:13:00.834 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.834 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.834 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.835 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_sender": { 2024-09-13T16:13:00.835 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_sender", 2024-09-13T16:13:00.835 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.835 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.835 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.835 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.835 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.835 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.835 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.835 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP envelope sender", 2024-09-13T16:13:00.835 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.835 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.836 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.836 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_ssl": { 2024-09-13T16:13:00.836 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_ssl", 2024-09-13T16:13:00.836 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.836 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.836 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.836 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.836 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.836 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.836 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.836 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-13T16:13:00.837 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.837 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.837 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.837 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_user": { 2024-09-13T16:13:00.837 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_user", 2024-09-13T16:13:00.837 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.837 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.837 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.837 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.837 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.837 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.837 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.837 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "User to authenticate as", 2024-09-13T16:13:00.838 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.838 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.838 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.838 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:00.838 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:00.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:00.838 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "balancer", 2024-09-13T16:13:00.838 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:00.838 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:00.838 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:00.838 INFO:teuthology.orchestra.run.smithi017.stdout: "active": { 2024-09-13T16:13:00.838 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "active", 2024-09-13T16:13:00.839 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.839 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.839 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.839 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.839 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.839 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.839 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.839 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically balance PGs across cluster", 2024-09-13T16:13:00.839 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.839 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.839 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.839 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_time": { 2024-09-13T16:13:00.840 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_time", 2024-09-13T16:13:00.840 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.840 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.840 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.840 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0000", 2024-09-13T16:13:00.840 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.840 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.840 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.840 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "beginning time of day to automatically balance", 2024-09-13T16:13:00.840 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T16:13:00.840 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.840 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.841 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_weekday": { 2024-09-13T16:13:00.841 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_weekday", 2024-09-13T16:13:00.841 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-13T16:13:00.841 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.841 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.841 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-13T16:13:00.841 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-13T16:13:00.841 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-13T16:13:00.841 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.841 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-13T16:13:00.841 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T16:13:00.841 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.841 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.842 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_max_iterations": { 2024-09-13T16:13:00.842 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_max_iterations", 2024-09-13T16:13:00.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-13T16:13:00.842 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.842 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.842 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "25", 2024-09-13T16:13:00.842 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-13T16:13:00.842 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "250", 2024-09-13T16:13:00.842 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.842 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-13T16:13:00.842 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.842 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.842 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.843 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_metrics": { 2024-09-13T16:13:00.843 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_metrics", 2024-09-13T16:13:00.843 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.843 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.843 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.843 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "pgs,objects,bytes", 2024-09-13T16:13:00.843 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.843 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.843 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.843 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-13T16:13:00.843 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-13T16:13:00.843 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.843 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.844 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_step": { 2024-09-13T16:13:00.844 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_step", 2024-09-13T16:13:00.844 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-13T16:13:00.844 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.844 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.844 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.5", 2024-09-13T16:13:00.844 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0.001", 2024-09-13T16:13:00.844 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "0.999", 2024-09-13T16:13:00.844 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.844 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "aggressiveness of optimization", 2024-09-13T16:13:00.844 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-13T16:13:00.844 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.844 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.845 INFO:teuthology.orchestra.run.smithi017.stdout: "end_time": { 2024-09-13T16:13:00.845 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_time", 2024-09-13T16:13:00.845 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.845 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.845 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.845 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2359", 2024-09-13T16:13:00.845 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.845 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.845 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.845 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ending time of day to automatically balance", 2024-09-13T16:13:00.845 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T16:13:00.845 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.846 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.846 INFO:teuthology.orchestra.run.smithi017.stdout: "end_weekday": { 2024-09-13T16:13:00.846 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_weekday", 2024-09-13T16:13:00.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-13T16:13:00.846 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.846 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.846 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-13T16:13:00.846 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-13T16:13:00.846 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-13T16:13:00.846 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.846 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-13T16:13:00.846 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T16:13:00.846 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.847 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.847 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:00.847 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:00.847 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.847 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.847 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.847 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.847 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.847 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.847 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:00.847 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:00.847 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:00.847 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:00.848 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:00.848 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:00.848 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:00.848 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:00.848 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.848 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.848 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.848 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.848 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:00.848 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:00.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.848 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.849 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.849 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.849 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.849 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.849 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.849 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.849 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.849 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.849 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.849 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:00.850 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:00.850 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.850 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.850 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.850 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:00.850 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.850 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.850 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:00.850 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:00.850 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:00.850 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:00.850 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:00.850 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:00.850 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:00.851 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:00.851 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.851 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.851 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.851 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.851 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:00.851 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:00.851 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.851 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.851 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.851 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.851 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.852 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.852 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.852 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.852 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.852 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.852 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.852 INFO:teuthology.orchestra.run.smithi017.stdout: "min_score": { 2024-09-13T16:13:00.852 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_score", 2024-09-13T16:13:00.852 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-13T16:13:00.852 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.852 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.852 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-13T16:13:00.853 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.853 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.853 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.853 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-13T16:13:00.853 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.853 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.853 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.853 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-13T16:13:00.853 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-13T16:13:00.854 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.854 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.854 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.854 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "upmap", 2024-09-13T16:13:00.854 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.854 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.854 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:00.854 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-compat", 2024-09-13T16:13:00.854 INFO:teuthology.orchestra.run.smithi017.stdout: "none", 2024-09-13T16:13:00.854 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap" 2024-09-13T16:13:00.854 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:00.854 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Balancer mode", 2024-09-13T16:13:00.854 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.855 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.855 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.855 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ids": { 2024-09-13T16:13:00.855 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_ids", 2024-09-13T16:13:00.855 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.855 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.855 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.855 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.855 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.855 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.855 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.855 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-13T16:13:00.856 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.856 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.856 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.856 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-13T16:13:00.856 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-13T16:13:00.856 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:00.856 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.856 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.856 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-13T16:13:00.856 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.856 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.856 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.856 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-13T16:13:00.857 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.857 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.857 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.857 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_deviation": { 2024-09-13T16:13:00.857 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_deviation", 2024-09-13T16:13:00.857 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:00.857 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.857 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.857 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-13T16:13:00.857 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-13T16:13:00.857 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.857 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.858 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-13T16:13:00.858 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-13T16:13:00.858 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.858 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.858 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_optimizations": { 2024-09-13T16:13:00.858 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_optimizations", 2024-09-13T16:13:00.858 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-13T16:13:00.858 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.858 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.858 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:00.858 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.858 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.859 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.859 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-13T16:13:00.859 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.859 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.859 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.859 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:00.859 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:00.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:00.859 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm", 2024-09-13T16:13:00.859 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:00.859 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:00.859 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:00.860 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_down_multiplier": { 2024-09-13T16:13:00.860 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_down_multiplier", 2024-09-13T16:13:00.860 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-13T16:13:00.860 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.860 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.860 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-13T16:13:00.860 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.860 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.860 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.860 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-13T16:13:00.860 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.860 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.860 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.861 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_refresh_rate": { 2024-09-13T16:13:00.861 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_refresh_rate", 2024-09-13T16:13:00.861 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:00.861 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.861 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.861 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "20", 2024-09-13T16:13:00.861 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.861 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.861 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.861 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-13T16:13:00.861 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.861 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.861 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.862 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_starting_port": { 2024-09-13T16:13:00.862 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_starting_port", 2024-09-13T16:13:00.862 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:00.862 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.862 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.862 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4721", 2024-09-13T16:13:00.862 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.862 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.862 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.862 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-13T16:13:00.862 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.862 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.863 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.863 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_ptrace": { 2024-09-13T16:13:00.863 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_ptrace", 2024-09-13T16:13:00.863 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.863 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.863 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.863 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.863 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.863 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.863 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.863 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-13T16:13:00.863 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-13T16:13:00.864 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.864 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.864 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_interval": { 2024-09-13T16:13:00.864 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_interval", 2024-09-13T16:13:00.864 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:00.864 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.864 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.864 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-13T16:13:00.864 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.864 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.864 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.864 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-13T16:13:00.865 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.865 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.865 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.865 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_memory_target_ratio": { 2024-09-13T16:13:00.865 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_memory_target_ratio", 2024-09-13T16:13:00.865 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-13T16:13:00.865 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.865 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.865 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.7", 2024-09-13T16:13:00.865 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.865 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.865 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.865 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-13T16:13:00.866 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.866 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.866 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.866 INFO:teuthology.orchestra.run.smithi017.stdout: "cgroups_split": { 2024-09-13T16:13:00.866 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cgroups_split", 2024-09-13T16:13:00.866 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.866 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.866 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.866 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.866 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.866 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.866 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.867 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-13T16:13:00.867 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.867 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.867 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.867 INFO:teuthology.orchestra.run.smithi017.stdout: "config_checks_enabled": { 2024-09-13T16:13:00.867 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_checks_enabled", 2024-09-13T16:13:00.867 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.867 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.867 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.867 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.867 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.867 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.868 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.868 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-13T16:13:00.868 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.868 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.868 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.868 INFO:teuthology.orchestra.run.smithi017.stdout: "config_dashboard": { 2024-09-13T16:13:00.868 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_dashboard", 2024-09-13T16:13:00.868 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.868 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.868 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.868 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.868 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.868 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.869 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.869 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-13T16:13:00.869 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.869 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.869 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.869 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_alertmanager": { 2024-09-13T16:13:00.869 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_alertmanager", 2024-09-13T16:13:00.869 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.869 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.869 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.869 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-13T16:13:00.869 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.870 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.870 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.870 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:00.870 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.870 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.870 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.870 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_base": { 2024-09-13T16:13:00.870 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_base", 2024-09-13T16:13:00.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.870 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.870 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.870 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-13T16:13:00.870 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.871 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.871 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.871 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Container image name, without the tag", 2024-09-13T16:13:00.871 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.871 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.871 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.871 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_elasticsearch": { 2024-09-13T16:13:00.871 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_elasticsearch", 2024-09-13T16:13:00.871 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.871 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.871 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.871 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-13T16:13:00.871 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.872 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.872 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.872 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "elasticsearch container image", 2024-09-13T16:13:00.872 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.872 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.872 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.872 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_grafana": { 2024-09-13T16:13:00.872 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_grafana", 2024-09-13T16:13:00.872 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.872 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.872 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.872 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-09-13T16:13:00.872 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.873 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.873 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.873 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:00.873 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.873 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.873 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.873 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_haproxy": { 2024-09-13T16:13:00.873 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_haproxy", 2024-09-13T16:13:00.873 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.873 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.873 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.873 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-13T16:13:00.873 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.874 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.874 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.874 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "HAproxy container image", 2024-09-13T16:13:00.874 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.874 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.874 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.874 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_agent": { 2024-09-13T16:13:00.874 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_agent", 2024-09-13T16:13:00.874 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.874 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.874 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.874 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-13T16:13:00.874 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.875 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.875 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.875 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger agent container image", 2024-09-13T16:13:00.875 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.875 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.875 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.875 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_collector": { 2024-09-13T16:13:00.875 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_collector", 2024-09-13T16:13:00.875 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.875 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.875 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.876 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-13T16:13:00.876 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.876 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.876 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.876 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger collector container image", 2024-09-13T16:13:00.876 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.876 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.876 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.876 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_query": { 2024-09-13T16:13:00.876 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_query", 2024-09-13T16:13:00.876 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.877 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.877 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.877 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-13T16:13:00.877 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.877 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.877 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.877 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger query container image", 2024-09-13T16:13:00.877 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.877 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.877 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.877 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_keepalived": { 2024-09-13T16:13:00.877 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_keepalived", 2024-09-13T16:13:00.878 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.878 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.878 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.878 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-13T16:13:00.878 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.878 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.878 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.878 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Keepalived container image", 2024-09-13T16:13:00.878 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.878 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.878 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.878 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_loki": { 2024-09-13T16:13:00.878 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_loki", 2024-09-13T16:13:00.879 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.879 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.879 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.879 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-13T16:13:00.879 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.879 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.879 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.879 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Loki container image", 2024-09-13T16:13:00.879 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.879 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.879 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.879 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_node_exporter": { 2024-09-13T16:13:00.880 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_node_exporter", 2024-09-13T16:13:00.880 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.880 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.880 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.880 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-13T16:13:00.880 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.880 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.880 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.880 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:00.880 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.880 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.880 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.881 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_nvmeof": { 2024-09-13T16:13:00.881 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_nvmeof", 2024-09-13T16:13:00.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.881 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.881 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.881 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-09-13T16:13:00.881 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.881 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.881 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.881 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Nvme-of container image", 2024-09-13T16:13:00.881 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.881 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.881 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.882 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_prometheus": { 2024-09-13T16:13:00.882 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_prometheus", 2024-09-13T16:13:00.882 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.882 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.882 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.882 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-13T16:13:00.882 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.882 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.882 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.882 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:00.882 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.882 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.882 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.883 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_promtail": { 2024-09-13T16:13:00.883 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_promtail", 2024-09-13T16:13:00.883 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.883 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.883 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.883 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-13T16:13:00.883 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.883 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.883 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.883 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Promtail container image", 2024-09-13T16:13:00.883 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.883 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.883 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.884 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_snmp_gateway": { 2024-09-13T16:13:00.884 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_snmp_gateway", 2024-09-13T16:13:00.884 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.884 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.884 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.884 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-13T16:13:00.884 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.884 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.884 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.884 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SNMP Gateway container image", 2024-09-13T16:13:00.884 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.884 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.884 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.885 INFO:teuthology.orchestra.run.smithi017.stdout: "container_init": { 2024-09-13T16:13:00.885 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_init", 2024-09-13T16:13:00.885 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.885 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.885 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.885 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.885 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.885 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.885 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.885 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Run podman/docker with `--init`", 2024-09-13T16:13:00.885 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.885 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.885 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.886 INFO:teuthology.orchestra.run.smithi017.stdout: "daemon_cache_timeout": { 2024-09-13T16:13:00.886 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "daemon_cache_timeout", 2024-09-13T16:13:00.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:00.886 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.886 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.886 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-13T16:13:00.886 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.886 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.886 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.886 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-13T16:13:00.886 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.886 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.886 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.887 INFO:teuthology.orchestra.run.smithi017.stdout: "default_cephadm_command_timeout": { 2024-09-13T16:13:00.887 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_cephadm_command_timeout", 2024-09-13T16:13:00.887 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:00.887 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.887 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.887 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "900", 2024-09-13T16:13:00.887 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.887 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.887 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.887 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-13T16:13:00.887 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.888 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.888 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.888 INFO:teuthology.orchestra.run.smithi017.stdout: "default_registry": { 2024-09-13T16:13:00.888 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_registry", 2024-09-13T16:13:00.888 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.888 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.888 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.888 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io", 2024-09-13T16:13:00.888 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.888 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.888 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.888 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-13T16:13:00.889 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.889 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.889 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.889 INFO:teuthology.orchestra.run.smithi017.stdout: "device_cache_timeout": { 2024-09-13T16:13:00.889 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_cache_timeout", 2024-09-13T16:13:00.889 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:00.889 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.889 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.889 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1800", 2024-09-13T16:13:00.889 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.889 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.889 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.890 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache device inventory", 2024-09-13T16:13:00.890 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.890 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.890 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.890 INFO:teuthology.orchestra.run.smithi017.stdout: "device_enhanced_scan": { 2024-09-13T16:13:00.890 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_enhanced_scan", 2024-09-13T16:13:00.890 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.890 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.890 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.891 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.891 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.891 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.891 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.891 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-13T16:13:00.891 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.891 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.891 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.891 INFO:teuthology.orchestra.run.smithi017.stdout: "facts_cache_timeout": { 2024-09-13T16:13:00.891 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "facts_cache_timeout", 2024-09-13T16:13:00.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:00.891 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.892 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.892 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-13T16:13:00.892 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.892 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.892 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.892 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache host facts data", 2024-09-13T16:13:00.892 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.892 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.892 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.892 INFO:teuthology.orchestra.run.smithi017.stdout: "host_check_interval": { 2024-09-13T16:13:00.892 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "host_check_interval", 2024-09-13T16:13:00.892 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:00.892 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.893 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.893 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-13T16:13:00.893 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.893 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.893 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.893 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to perform a host check", 2024-09-13T16:13:00.893 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.893 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.893 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.893 INFO:teuthology.orchestra.run.smithi017.stdout: "hw_monitoring": { 2024-09-13T16:13:00.893 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hw_monitoring", 2024-09-13T16:13:00.893 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.894 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.894 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.894 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.894 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.894 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.894 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.894 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-13T16:13:00.894 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.894 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.894 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.894 INFO:teuthology.orchestra.run.smithi017.stdout: "inventory_list_all": { 2024-09-13T16:13:00.894 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "inventory_list_all", 2024-09-13T16:13:00.894 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.895 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.895 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.895 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.895 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.895 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.895 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.895 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-13T16:13:00.895 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.895 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.895 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.895 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:00.895 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:00.895 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.896 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.896 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.896 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.896 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.896 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.896 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:00.896 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:00.896 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:00.896 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:00.896 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:00.896 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:00.896 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:00.896 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:00.897 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.897 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.897 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.897 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.897 INFO:teuthology.orchestra.run.smithi017.stdout: "log_refresh_metadata": { 2024-09-13T16:13:00.897 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_refresh_metadata", 2024-09-13T16:13:00.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.897 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.897 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.897 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.897 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.897 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.897 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.898 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-13T16:13:00.898 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.898 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.898 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.898 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:00.898 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:00.898 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.898 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.898 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.898 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.898 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.898 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.898 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.899 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-13T16:13:00.899 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.899 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.899 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.899 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:00.899 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:00.899 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.899 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.899 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.899 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:00.899 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.899 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.899 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:00.900 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:00.900 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:00.900 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:00.900 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:00.900 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:00.900 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:00.900 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:00.900 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.900 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.900 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.900 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.900 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:00.901 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:00.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.901 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.901 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.901 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.901 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.901 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.901 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.901 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.901 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.901 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.902 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.902 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-13T16:13:00.902 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-13T16:13:00.902 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.902 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.902 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.902 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.902 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.902 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.902 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.902 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-13T16:13:00.902 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.902 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.903 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.903 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-13T16:13:00.903 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-13T16:13:00.903 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.903 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.903 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.903 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "*", 2024-09-13T16:13:00.903 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.903 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.903 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.903 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-13T16:13:00.903 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.903 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.904 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.904 INFO:teuthology.orchestra.run.smithi017.stdout: "max_count_per_host": { 2024-09-13T16:13:00.904 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_count_per_host", 2024-09-13T16:13:00.904 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:00.904 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.904 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.904 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:00.904 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.904 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.904 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.904 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of daemons per service per host", 2024-09-13T16:13:00.904 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.905 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.905 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.905 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd_draining_count": { 2024-09-13T16:13:00.905 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_osd_draining_count", 2024-09-13T16:13:00.905 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:00.905 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.905 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.905 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:00.905 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.905 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.905 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.905 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-13T16:13:00.906 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.906 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.906 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.906 INFO:teuthology.orchestra.run.smithi017.stdout: "migration_current": { 2024-09-13T16:13:00.906 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "migration_current", 2024-09-13T16:13:00.906 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:00.906 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.906 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.906 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.906 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.906 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.906 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.906 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "internal - do not modify", 2024-09-13T16:13:00.907 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.907 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.907 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.907 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-13T16:13:00.907 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-13T16:13:00.907 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.907 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.907 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.907 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "root", 2024-09-13T16:13:00.907 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.907 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.907 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:00.907 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm-package", 2024-09-13T16:13:00.908 INFO:teuthology.orchestra.run.smithi017.stdout: "root" 2024-09-13T16:13:00.908 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:00.908 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "mode for remote execution of cephadm", 2024-09-13T16:13:00.908 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.908 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.908 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.908 INFO:teuthology.orchestra.run.smithi017.stdout: "oob_default_addr": { 2024-09-13T16:13:00.908 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "oob_default_addr", 2024-09-13T16:13:00.908 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.908 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.908 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.908 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "169.254.1.1", 2024-09-13T16:13:00.909 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.909 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.909 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.909 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-13T16:13:00.909 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.909 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.909 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.909 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_alerts_path": { 2024-09-13T16:13:00.909 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_alerts_path", 2024-09-13T16:13:00.909 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.909 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.909 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.909 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-13T16:13:00.910 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.910 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.910 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.910 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-13T16:13:00.910 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.910 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.910 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.910 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_insecure": { 2024-09-13T16:13:00.910 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_insecure", 2024-09-13T16:13:00.910 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.910 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.910 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.910 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.911 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.911 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.911 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.911 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-13T16:13:00.911 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.911 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.911 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.911 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_password": { 2024-09-13T16:13:00.911 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_password", 2024-09-13T16:13:00.911 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.911 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.911 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.911 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.912 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.912 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.912 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.912 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-13T16:13:00.912 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.912 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.912 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.912 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_url": { 2024-09-13T16:13:00.912 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_url", 2024-09-13T16:13:00.912 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.912 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.912 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.913 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.913 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.913 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.913 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.913 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-13T16:13:00.913 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.913 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.913 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.913 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_username": { 2024-09-13T16:13:00.913 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_username", 2024-09-13T16:13:00.913 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.913 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.913 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.914 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.914 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.914 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.914 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.914 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-13T16:13:00.914 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.914 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.914 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.914 INFO:teuthology.orchestra.run.smithi017.stdout: "secure_monitoring_stack": { 2024-09-13T16:13:00.914 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secure_monitoring_stack", 2024-09-13T16:13:00.914 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.915 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.915 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.915 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.915 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.915 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.915 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.915 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-13T16:13:00.915 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.915 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.915 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.915 INFO:teuthology.orchestra.run.smithi017.stdout: "service_discovery_port": { 2024-09-13T16:13:00.915 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "service_discovery_port", 2024-09-13T16:13:00.916 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:00.916 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.916 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.916 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8765", 2024-09-13T16:13:00.916 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.916 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.916 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.916 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "cephadm service discovery port", 2024-09-13T16:13:00.916 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.916 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.916 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.916 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_config_file": { 2024-09-13T16:13:00.916 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_config_file", 2024-09-13T16:13:00.917 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.917 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.917 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.917 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.917 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.917 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.917 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.917 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-13T16:13:00.917 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.917 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.917 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.917 INFO:teuthology.orchestra.run.smithi017.stdout: "use_agent": { 2024-09-13T16:13:00.917 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_agent", 2024-09-13T16:13:00.918 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.918 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.918 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.918 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.918 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.918 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.918 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.918 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-13T16:13:00.918 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.918 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.918 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.918 INFO:teuthology.orchestra.run.smithi017.stdout: "use_repo_digest": { 2024-09-13T16:13:00.919 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_repo_digest", 2024-09-13T16:13:00.919 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.919 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.919 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.919 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.919 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.919 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.919 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.919 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-13T16:13:00.919 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.919 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.919 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.919 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_failed_host_check": { 2024-09-13T16:13:00.920 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_failed_host_check", 2024-09-13T16:13:00.920 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.920 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.920 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.920 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.920 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.920 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.920 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.920 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if the host check fails", 2024-09-13T16:13:00.920 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.920 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.920 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.921 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_daemons": { 2024-09-13T16:13:00.921 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_daemons", 2024-09-13T16:13:00.921 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.921 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.921 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.921 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.921 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.921 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.921 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.921 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-13T16:13:00.921 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.921 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.921 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.922 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_hosts": { 2024-09-13T16:13:00.922 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_hosts", 2024-09-13T16:13:00.922 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.922 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.922 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.922 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.922 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.922 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.922 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.922 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-13T16:13:00.922 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.922 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.922 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:00.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:00.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:00.923 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crash", 2024-09-13T16:13:00.923 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:00.923 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:00.923 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:00.923 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:00.923 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:00.923 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.923 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.923 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.923 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.924 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.924 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.924 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:00.924 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:00.924 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:00.924 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:00.924 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:00.924 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:00.924 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:00.924 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:00.924 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.924 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.924 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.924 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.925 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:00.925 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:00.925 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.925 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.925 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.925 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.925 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.925 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.925 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.925 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.925 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.925 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.925 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.926 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:00.926 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:00.926 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.926 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.926 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.926 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:00.926 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.926 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.926 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:00.926 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:00.926 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:00.926 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:00.927 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:00.927 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:00.927 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:00.927 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:00.927 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.927 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.927 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.927 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.927 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:00.927 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:00.927 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.928 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.928 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.928 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.928 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.928 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.928 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.928 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.928 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.928 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.928 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.928 INFO:teuthology.orchestra.run.smithi017.stdout: "retain_interval": { 2024-09-13T16:13:00.928 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retain_interval", 2024-09-13T16:13:00.929 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:00.929 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.929 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.929 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "31536000", 2024-09-13T16:13:00.929 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.929 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.929 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.929 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-13T16:13:00.929 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.929 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.929 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.929 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_recent_interval": { 2024-09-13T16:13:00.930 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_recent_interval", 2024-09-13T16:13:00.930 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:00.930 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.930 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.930 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1209600", 2024-09-13T16:13:00.930 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.930 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.930 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.930 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-13T16:13:00.930 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.930 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.930 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.930 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:00.930 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:00.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:00.931 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dashboard", 2024-09-13T16:13:00.931 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:00.931 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:00.931 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:00.931 INFO:teuthology.orchestra.run.smithi017.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-13T16:13:00.931 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-13T16:13:00.931 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:00.931 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.931 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.931 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:00.931 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.932 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.932 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.932 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.932 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.932 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.932 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.932 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_HOST": { 2024-09-13T16:13:00.932 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-13T16:13:00.932 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.932 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.932 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.932 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.933 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.933 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.933 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.933 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.933 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.933 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.933 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.933 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-13T16:13:00.933 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-13T16:13:00.933 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.933 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.933 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.934 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.934 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.934 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.934 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.934 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.934 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.934 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.934 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.934 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_ENABLED": { 2024-09-13T16:13:00.934 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_ENABLED", 2024-09-13T16:13:00.934 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.934 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.934 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.935 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.935 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.935 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.935 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.935 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.935 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.935 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.935 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.935 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-13T16:13:00.935 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-13T16:13:00.935 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.935 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.936 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.936 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.936 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.936 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.936 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.936 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.936 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.936 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.936 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.936 INFO:teuthology.orchestra.run.smithi017.stdout: "ENABLE_BROWSABLE_API": { 2024-09-13T16:13:00.936 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-13T16:13:00.936 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.936 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.937 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.937 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.937 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.937 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.937 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.937 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.937 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.937 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.937 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.937 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-13T16:13:00.937 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-13T16:13:00.937 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.938 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.938 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.938 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.938 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.938 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.938 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.938 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.938 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.938 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.938 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.938 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-13T16:13:00.938 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-13T16:13:00.938 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.939 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.939 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.939 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.939 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.939 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.939 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.939 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.939 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.939 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.939 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.939 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-13T16:13:00.939 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-13T16:13:00.939 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.940 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.940 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.940 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.940 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.940 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.940 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.940 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.940 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.940 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.940 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.940 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-13T16:13:00.940 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-13T16:13:00.940 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.941 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.941 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.941 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.941 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.941 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.941 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.941 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.941 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.941 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.941 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.942 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-13T16:13:00.942 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-13T16:13:00.942 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.942 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.942 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.942 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.942 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.942 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.942 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.942 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.942 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.942 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.942 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.943 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-13T16:13:00.943 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-13T16:13:00.943 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.943 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.943 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.943 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.943 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.943 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.943 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.943 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.943 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.943 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.943 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.944 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-13T16:13:00.944 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-13T16:13:00.944 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.944 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.944 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.944 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.944 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.944 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.944 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.944 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.944 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.944 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.944 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.945 INFO:teuthology.orchestra.run.smithi017.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-13T16:13:00.945 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-13T16:13:00.945 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.945 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.945 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.945 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.945 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.945 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.945 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.945 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.945 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.945 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.946 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.946 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_PASSWORD": { 2024-09-13T16:13:00.946 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-13T16:13:00.946 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.946 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.946 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.946 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-13T16:13:00.946 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.946 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.946 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.946 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.946 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.946 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.947 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.947 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-13T16:13:00.947 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-13T16:13:00.947 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.947 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.947 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.947 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.947 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.947 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.947 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.947 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.947 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.948 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.948 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.948 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_URL": { 2024-09-13T16:13:00.948 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_URL", 2024-09-13T16:13:00.948 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.948 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.948 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.948 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.948 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.948 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.948 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.948 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.949 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.949 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.949 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.949 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_USERNAME": { 2024-09-13T16:13:00.949 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-13T16:13:00.949 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.949 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.949 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.949 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-13T16:13:00.949 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.949 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.949 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.949 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.950 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.950 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.950 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.950 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-13T16:13:00.950 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-13T16:13:00.950 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.950 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.950 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.950 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.950 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.950 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.950 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.950 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.951 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.951 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.951 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.951 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-13T16:13:00.951 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-13T16:13:00.951 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.951 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.951 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.951 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.951 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.951 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.951 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.952 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.952 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.952 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.952 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.952 INFO:teuthology.orchestra.run.smithi017.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-13T16:13:00.952 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-13T16:13:00.952 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.952 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.952 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.952 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.952 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.952 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.953 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.953 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.953 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.953 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.953 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.953 INFO:teuthology.orchestra.run.smithi017.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-13T16:13:00.953 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-13T16:13:00.953 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.953 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.953 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.953 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.953 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.953 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.954 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.954 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.954 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.954 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.954 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.954 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_HOST": { 2024-09-13T16:13:00.954 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-13T16:13:00.954 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.954 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.954 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.954 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.954 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.954 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.955 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.955 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.955 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.955 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.955 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.955 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-13T16:13:00.955 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-13T16:13:00.955 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.955 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.955 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.955 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.956 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.956 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.956 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.956 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.956 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.956 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.956 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.956 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-13T16:13:00.956 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-13T16:13:00.956 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.956 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.956 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.957 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.957 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.957 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.957 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.957 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.957 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.957 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.957 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.957 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-13T16:13:00.957 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-13T16:13:00.957 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.957 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.958 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.958 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.958 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.958 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.958 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.958 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.958 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.958 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.958 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.958 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-13T16:13:00.958 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-13T16:13:00.958 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.958 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.959 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.959 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.959 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.959 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.959 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.959 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.959 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.959 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.959 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.959 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-13T16:13:00.959 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-13T16:13:00.959 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.960 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.960 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.960 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.960 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.960 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.960 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.960 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.960 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.960 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.960 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.960 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-13T16:13:00.960 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-13T16:13:00.960 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.961 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.961 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.961 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.961 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.961 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.961 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.961 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.961 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.961 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.961 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.961 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-13T16:13:00.961 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-13T16:13:00.962 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.962 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.962 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.962 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.962 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.962 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.962 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.962 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.962 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.962 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.962 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.962 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-13T16:13:00.962 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-13T16:13:00.963 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.963 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.963 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.963 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.963 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.963 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.963 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.963 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.963 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.963 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.963 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.963 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_ENABLED": { 2024-09-13T16:13:00.964 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-13T16:13:00.964 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.964 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.964 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.964 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.964 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.964 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.964 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.964 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.964 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.964 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.964 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.964 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-13T16:13:00.965 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-13T16:13:00.965 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.965 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.965 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.965 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-13T16:13:00.965 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.965 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.965 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.965 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.965 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.965 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.965 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.965 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-13T16:13:00.966 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-13T16:13:00.966 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:00.966 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.966 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.966 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:00.966 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.966 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.966 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.966 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.966 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.966 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.966 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.966 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-13T16:13:00.967 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-13T16:13:00.967 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:00.967 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.967 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.967 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8", 2024-09-13T16:13:00.967 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.967 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.967 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.967 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.967 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.967 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.967 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.967 INFO:teuthology.orchestra.run.smithi017.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-13T16:13:00.968 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-13T16:13:00.968 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:00.968 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.968 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.968 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "45", 2024-09-13T16:13:00.968 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.968 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.968 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.968 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.968 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.968 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.968 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.969 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ACCESS_KEY": { 2024-09-13T16:13:00.969 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-13T16:13:00.969 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.969 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.969 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.969 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.969 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.969 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.969 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.969 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.969 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.969 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.969 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.970 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-13T16:13:00.970 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-13T16:13:00.970 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.970 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.970 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.970 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-13T16:13:00.970 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.970 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.970 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.970 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.970 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.970 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.970 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.971 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SECRET_KEY": { 2024-09-13T16:13:00.971 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-13T16:13:00.971 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.971 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.971 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.971 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.971 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.971 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.971 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.971 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.971 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.971 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.972 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.972 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SSL_VERIFY": { 2024-09-13T16:13:00.972 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-13T16:13:00.972 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.972 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.972 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.972 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.972 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.972 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.972 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.972 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.972 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.973 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.973 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.973 INFO:teuthology.orchestra.run.smithi017.stdout: "UNSAFE_TLS_v1_2": { 2024-09-13T16:13:00.973 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-13T16:13:00.973 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.973 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.973 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.973 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.973 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.973 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.973 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.973 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.973 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.974 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.974 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.974 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-13T16:13:00.974 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-13T16:13:00.974 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:00.974 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.974 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.974 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-13T16:13:00.974 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.974 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.974 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.974 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.975 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.975 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.975 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.975 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-13T16:13:00.975 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-13T16:13:00.975 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:00.975 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.975 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.975 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:00.975 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.975 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.975 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.975 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.976 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.976 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.976 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.976 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-13T16:13:00.976 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-13T16:13:00.976 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:00.976 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.976 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.976 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-13T16:13:00.976 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.976 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.976 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.976 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.977 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.977 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.977 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.977 INFO:teuthology.orchestra.run.smithi017.stdout: "cross_origin_url": { 2024-09-13T16:13:00.977 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cross_origin_url", 2024-09-13T16:13:00.977 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.977 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.977 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.977 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.977 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.977 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.977 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.977 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.978 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.978 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.978 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.978 INFO:teuthology.orchestra.run.smithi017.stdout: "crt_file": { 2024-09-13T16:13:00.978 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crt_file", 2024-09-13T16:13:00.978 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.978 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.978 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.978 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.978 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.978 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.978 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.979 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.979 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.979 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.979 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.979 INFO:teuthology.orchestra.run.smithi017.stdout: "debug": { 2024-09-13T16:13:00.979 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "debug", 2024-09-13T16:13:00.979 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.979 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.979 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.979 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.979 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.979 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.979 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.980 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable/disable debug options", 2024-09-13T16:13:00.980 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.980 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.980 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.980 INFO:teuthology.orchestra.run.smithi017.stdout: "jwt_token_ttl": { 2024-09-13T16:13:00.980 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "jwt_token_ttl", 2024-09-13T16:13:00.980 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:00.980 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.980 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.980 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "28800", 2024-09-13T16:13:00.980 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.980 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.980 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.981 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.981 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.981 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.981 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.981 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-13T16:13:00.981 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-13T16:13:00.981 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.981 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.981 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.981 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.981 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.981 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.981 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.982 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.982 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.982 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.982 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.982 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:00.982 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:00.982 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.982 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.982 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.982 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.982 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.983 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.983 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:00.983 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:00.983 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:00.983 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:00.983 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:00.983 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:00.983 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:00.983 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:00.983 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.983 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.983 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.983 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.984 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:00.984 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:00.984 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.984 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.984 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.984 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.984 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.984 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.984 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.984 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.984 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.984 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.984 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.985 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:00.985 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:00.985 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.985 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.985 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.985 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:00.985 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.985 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.985 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:00.985 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:00.985 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:00.985 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:00.985 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:00.986 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:00.986 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:00.986 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:00.986 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.986 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.986 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.986 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.986 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:00.986 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:00.986 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.986 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.986 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.986 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.987 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.987 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.987 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.987 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.987 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.987 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.987 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.987 INFO:teuthology.orchestra.run.smithi017.stdout: "motd": { 2024-09-13T16:13:00.987 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "motd", 2024-09-13T16:13:00.987 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.987 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.987 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.987 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.988 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.988 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.988 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.988 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "The message of the day", 2024-09-13T16:13:00.988 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.988 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.988 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.988 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect_resolve_ip_addr": { 2024-09-13T16:13:00.988 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "redirect_resolve_ip_addr", 2024-09-13T16:13:00.988 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.988 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.988 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.989 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:00.989 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.989 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.989 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.989 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.989 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.989 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.989 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.989 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-13T16:13:00.989 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-13T16:13:00.989 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.989 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.989 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.990 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-13T16:13:00.990 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.990 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.990 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.990 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.990 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.990 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.990 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.990 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-13T16:13:00.990 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-13T16:13:00.990 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:00.990 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.991 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.991 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8080", 2024-09-13T16:13:00.991 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.991 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.991 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.991 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.991 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.991 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.991 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.991 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-13T16:13:00.991 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-13T16:13:00.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.991 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.992 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.992 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.992 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.992 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.992 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.992 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.992 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.992 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.992 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.992 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl_server_port": { 2024-09-13T16:13:00.992 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl_server_port", 2024-09-13T16:13:00.992 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:00.992 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.993 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.993 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8443", 2024-09-13T16:13:00.993 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.993 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.993 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.993 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.993 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.993 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.993 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.993 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-13T16:13:00.993 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-13T16:13:00.993 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.993 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.994 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.994 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "redirect", 2024-09-13T16:13:00.994 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.994 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.994 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:00.994 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:00.994 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect" 2024-09-13T16:13:00.994 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:00.994 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.994 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.994 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.994 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.994 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-13T16:13:00.995 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-13T16:13:00.995 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:00.995 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.995 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.995 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-13T16:13:00.995 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-13T16:13:00.995 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-13T16:13:00.995 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.995 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.995 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.995 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.995 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.995 INFO:teuthology.orchestra.run.smithi017.stdout: "url_prefix": { 2024-09-13T16:13:00.995 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url_prefix", 2024-09-13T16:13:00.996 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.996 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.996 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:00.996 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.996 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.996 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.996 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.996 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.996 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.996 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.996 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.996 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:00.997 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:00.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:00.997 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2024-09-13T16:13:00.997 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:00.997 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:00.997 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:00.997 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_monitoring": { 2024-09-13T16:13:00.997 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_monitoring", 2024-09-13T16:13:00.997 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:00.997 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.997 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.997 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:00.997 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.998 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.998 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:00.998 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "monitor device health metrics", 2024-09-13T16:13:00.998 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.998 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.998 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:00.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:00.998 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:00.998 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:00.998 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:00.998 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:00.998 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:00.998 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:00.999 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:00.999 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:00.999 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:00.999 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:00.999 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:00.999 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:00.999 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:00.999 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:00.999 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:00.999 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:00.999 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:00.999 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:00.999 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:00.999 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.000 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.000 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.000 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.000 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.000 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.000 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.000 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.000 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.000 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.000 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.000 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.000 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.000 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.001 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.001 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.001 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.001 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.001 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.001 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.001 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.001 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.001 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.001 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.001 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.001 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.001 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.002 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.002 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.002 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.002 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.002 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.002 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.002 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.002 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.002 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.002 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.002 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.002 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.003 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.003 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.003 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.003 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.003 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.003 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.003 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.003 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.003 INFO:teuthology.orchestra.run.smithi017.stdout: "mark_out_threshold": { 2024-09-13T16:13:01.003 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mark_out_threshold", 2024-09-13T16:13:01.003 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.003 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.003 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.004 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2419200", 2024-09-13T16:13:01.004 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.004 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.004 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.004 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-13T16:13:01.004 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.004 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.004 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.004 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": { 2024-09-13T16:13:01.004 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_name", 2024-09-13T16:13:01.004 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.004 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.004 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.005 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "device_health_metrics", 2024-09-13T16:13:01.005 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.005 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.005 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.005 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-13T16:13:01.005 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.005 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.005 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.005 INFO:teuthology.orchestra.run.smithi017.stdout: "retention_period": { 2024-09-13T16:13:01.005 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retention_period", 2024-09-13T16:13:01.005 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.005 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.006 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.006 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15552000", 2024-09-13T16:13:01.006 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.006 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.006 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.006 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain device health metrics", 2024-09-13T16:13:01.006 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.006 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.006 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.006 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_frequency": { 2024-09-13T16:13:01.006 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_frequency", 2024-09-13T16:13:01.006 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.006 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.007 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.007 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-13T16:13:01.007 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.007 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.007 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.007 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-13T16:13:01.007 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.007 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.007 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.007 INFO:teuthology.orchestra.run.smithi017.stdout: "self_heal": { 2024-09-13T16:13:01.007 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "self_heal", 2024-09-13T16:13:01.007 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.007 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.008 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.008 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.008 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.008 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.008 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.008 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-13T16:13:01.008 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.008 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.008 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.008 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-13T16:13:01.008 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-13T16:13:01.008 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.008 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.009 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.009 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-13T16:13:01.009 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.009 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.009 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.009 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and check device health", 2024-09-13T16:13:01.009 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.009 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.009 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.009 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_threshold": { 2024-09-13T16:13:01.009 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_threshold", 2024-09-13T16:13:01.010 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.010 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.010 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.010 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7257600", 2024-09-13T16:13:01.010 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.010 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.010 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.010 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-13T16:13:01.010 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.010 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.010 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.010 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.010 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.011 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "diskprediction_local", 2024-09-13T16:13:01.011 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.011 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.011 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.011 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.011 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.011 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.011 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.011 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.011 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.011 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.011 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.012 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.012 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.012 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.012 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.012 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.012 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.012 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.012 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.012 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.012 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.012 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.012 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.013 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.013 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.013 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.013 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.013 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.013 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.013 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.013 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.013 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.013 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.013 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.013 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.013 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.014 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.014 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.014 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.014 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.014 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.014 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.014 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.014 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.014 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.014 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.014 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.014 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.014 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.014 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.015 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.015 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.015 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.015 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.015 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.015 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.015 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.015 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.015 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.015 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.015 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.015 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.016 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.016 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.016 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.016 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.016 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.016 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.016 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.016 INFO:teuthology.orchestra.run.smithi017.stdout: "predict_interval": { 2024-09-13T16:13:01.016 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predict_interval", 2024-09-13T16:13:01.016 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.016 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.016 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.016 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-13T16:13:01.017 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.017 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.017 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.017 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.017 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.017 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.017 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.017 INFO:teuthology.orchestra.run.smithi017.stdout: "predictor_model": { 2024-09-13T16:13:01.017 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predictor_model", 2024-09-13T16:13:01.017 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.017 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.017 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "prophetstor", 2024-09-13T16:13:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-13T16:13:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-13T16:13:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.019 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-13T16:13:01.019 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.019 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.019 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.019 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.019 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.019 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.019 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.019 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.019 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.019 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "influx", 2024-09-13T16:13:01.019 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": false, 2024-09-13T16:13:01.019 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "influxdb python module not found", 2024-09-13T16:13:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: "batch_size": { 2024-09-13T16:13:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "batch_size", 2024-09-13T16:13:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5000", 2024-09-13T16:13:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-13T16:13:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.021 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.021 INFO:teuthology.orchestra.run.smithi017.stdout: "database": { 2024-09-13T16:13:01.021 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "database", 2024-09-13T16:13:01.021 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.021 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.021 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.021 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "ceph", 2024-09-13T16:13:01.021 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.021 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.021 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.021 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-13T16:13:01.021 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.021 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.022 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.022 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": { 2024-09-13T16:13:01.022 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hostname", 2024-09-13T16:13:01.022 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.022 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.022 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.022 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.022 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.022 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.022 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.022 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server hostname", 2024-09-13T16:13:01.022 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.022 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.023 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.023 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-13T16:13:01.023 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-13T16:13:01.023 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.023 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.023 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.023 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "30", 2024-09-13T16:13:01.023 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "5", 2024-09-13T16:13:01.023 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.023 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.023 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-13T16:13:01.023 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.024 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.024 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.024 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.024 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.024 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.024 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.024 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.024 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.024 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.024 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.024 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.024 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.025 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.025 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.025 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.025 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.025 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.025 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.025 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.025 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.025 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.025 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.025 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.025 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.025 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.026 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.026 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.026 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.026 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.026 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.026 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.026 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.026 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.026 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.026 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.026 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.027 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.027 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.027 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.027 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.027 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.027 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.027 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.027 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.027 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.027 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.027 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.027 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.027 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.027 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.028 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.028 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.028 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.028 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.028 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.028 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.028 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.028 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.028 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.028 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.028 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.028 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.029 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.029 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.029 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.029 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.029 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.029 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.029 INFO:teuthology.orchestra.run.smithi017.stdout: "password": { 2024-09-13T16:13:01.029 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "password", 2024-09-13T16:13:01.029 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.029 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.029 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.029 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.029 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.030 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.030 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.030 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "password of InfluxDB server user", 2024-09-13T16:13:01.030 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.030 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.030 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.030 INFO:teuthology.orchestra.run.smithi017.stdout: "port": { 2024-09-13T16:13:01.030 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "port", 2024-09-13T16:13:01.030 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.030 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.030 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.030 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8086", 2024-09-13T16:13:01.030 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.031 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.031 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.031 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server port", 2024-09-13T16:13:01.031 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.031 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.031 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.031 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-13T16:13:01.031 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-13T16:13:01.031 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.031 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.031 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.031 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "false", 2024-09-13T16:13:01.031 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.032 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.032 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.032 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T16:13:01.032 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.032 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.032 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.032 INFO:teuthology.orchestra.run.smithi017.stdout: "threads": { 2024-09-13T16:13:01.032 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threads", 2024-09-13T16:13:01.032 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.032 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.032 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.032 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-13T16:13:01.033 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-13T16:13:01.033 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "32", 2024-09-13T16:13:01.033 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.033 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-13T16:13:01.033 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.033 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.033 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.033 INFO:teuthology.orchestra.run.smithi017.stdout: "username": { 2024-09-13T16:13:01.033 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "username", 2024-09-13T16:13:01.033 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.033 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.033 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.033 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.034 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.034 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.034 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.034 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "username of InfluxDB server user", 2024-09-13T16:13:01.034 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.034 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.034 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.034 INFO:teuthology.orchestra.run.smithi017.stdout: "verify_ssl": { 2024-09-13T16:13:01.034 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "verify_ssl", 2024-09-13T16:13:01.034 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.034 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.034 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.034 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "true", 2024-09-13T16:13:01.035 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.035 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.035 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.035 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T16:13:01.035 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.035 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.035 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.035 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.035 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.035 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "insights", 2024-09-13T16:13:01.035 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.035 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.036 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.036 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.036 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.036 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.036 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.036 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.036 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.036 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.036 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.036 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.036 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.036 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.036 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.036 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.037 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.037 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.037 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.037 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.037 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.037 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.037 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.037 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.037 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.037 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.038 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.038 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.038 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.038 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.038 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.038 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.038 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.038 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.038 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.038 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.038 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.038 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.038 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.039 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.039 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.039 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.039 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.039 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.039 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.039 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.039 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.039 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.039 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.039 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.039 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.039 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.040 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.040 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.040 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.040 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.040 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.040 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.040 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.040 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.040 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.040 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.040 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.040 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.040 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.041 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.041 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.041 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.041 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.041 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.041 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.041 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "iostat", 2024-09-13T16:13:01.041 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.041 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.041 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.041 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.041 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.042 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.042 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.042 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.042 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.042 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.042 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.042 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.042 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.042 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.042 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.042 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.042 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.042 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.043 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.043 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.043 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.043 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.043 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.043 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.043 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.043 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.043 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.043 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.043 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.043 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.043 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.044 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.044 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.044 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.044 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.044 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.044 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.044 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.044 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.044 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.044 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.044 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.044 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.045 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.045 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.045 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.045 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.045 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.045 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.045 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.045 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.045 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.045 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.045 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.045 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.045 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.046 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.046 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.046 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.046 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.046 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.046 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.046 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.046 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.046 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.046 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.046 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.046 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.046 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.046 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.047 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.047 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "k8sevents", 2024-09-13T16:13:01.047 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.047 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.047 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.047 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_event_retention_days": { 2024-09-13T16:13:01.047 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ceph_event_retention_days", 2024-09-13T16:13:01.047 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.047 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.047 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.047 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2024-09-13T16:13:01.048 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.048 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.048 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.048 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-13T16:13:01.048 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.048 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.048 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.048 INFO:teuthology.orchestra.run.smithi017.stdout: "config_check_secs": { 2024-09-13T16:13:01.048 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_check_secs", 2024-09-13T16:13:01.048 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.048 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.048 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.048 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:01.049 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "10", 2024-09-13T16:13:01.049 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.049 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.049 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-13T16:13:01.049 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.049 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.049 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.049 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.049 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.049 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.049 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.049 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.049 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.050 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.050 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.050 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.050 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.050 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.050 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.050 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.050 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.050 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.050 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.050 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.050 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.050 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.050 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.051 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.051 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.051 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.051 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.051 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.051 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.051 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.051 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.051 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.051 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.051 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.051 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.052 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.052 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.052 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.052 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.052 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.052 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.052 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.052 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.052 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.052 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.052 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.052 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.053 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.053 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.053 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.053 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.053 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.053 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.053 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.053 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.053 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.053 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.053 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.053 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.053 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.054 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.054 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.054 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.054 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.054 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.054 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.054 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.054 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.054 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.054 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.054 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.055 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "localpool", 2024-09-13T16:13:01.055 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.055 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.055 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.055 INFO:teuthology.orchestra.run.smithi017.stdout: "failure_domain": { 2024-09-13T16:13:01.055 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "failure_domain", 2024-09-13T16:13:01.055 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.055 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.055 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.055 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "host", 2024-09-13T16:13:01.055 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.055 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.055 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.055 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "failure domain for any created local pool", 2024-09-13T16:13:01.056 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-13T16:13:01.056 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.056 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.056 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.056 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.056 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.056 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.056 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.056 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.056 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.056 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.056 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.056 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.057 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.057 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.057 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.057 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.057 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.057 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.057 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.057 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.057 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.057 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.057 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.057 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.057 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.058 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.058 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.058 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.058 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.058 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.058 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.058 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.058 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.058 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.058 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.058 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.058 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.058 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.059 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.059 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.059 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.059 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.059 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.059 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.059 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.059 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.059 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.059 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.059 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.059 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.059 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.060 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.060 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.060 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.060 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.060 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.060 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.060 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.060 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.060 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.060 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.060 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.060 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.060 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.061 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.061 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.061 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.061 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.061 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": { 2024-09-13T16:13:01.061 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_size", 2024-09-13T16:13:01.061 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.061 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.061 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.061 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.061 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.061 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.061 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.062 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default min_size for any created local pool", 2024-09-13T16:13:01.062 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-13T16:13:01.062 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.062 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.062 INFO:teuthology.orchestra.run.smithi017.stdout: "num_rep": { 2024-09-13T16:13:01.062 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "num_rep", 2024-09-13T16:13:01.062 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.062 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.062 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.062 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2024-09-13T16:13:01.062 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.062 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.062 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.063 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default replica count for any created local pool", 2024-09-13T16:13:01.063 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.063 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.063 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.063 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": { 2024-09-13T16:13:01.063 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_num", 2024-09-13T16:13:01.063 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.063 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.063 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.063 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "128", 2024-09-13T16:13:01.063 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.063 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.063 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.064 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default pg_num for any created local pool", 2024-09-13T16:13:01.064 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.064 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.064 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.064 INFO:teuthology.orchestra.run.smithi017.stdout: "prefix": { 2024-09-13T16:13:01.064 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prefix", 2024-09-13T16:13:01.064 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.064 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.064 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.064 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.064 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.064 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.064 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.065 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name prefix for any created local pool", 2024-09-13T16:13:01.065 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.065 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.065 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.065 INFO:teuthology.orchestra.run.smithi017.stdout: "subtree": { 2024-09-13T16:13:01.065 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "subtree", 2024-09-13T16:13:01.065 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.065 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.065 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.065 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "rack", 2024-09-13T16:13:01.065 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.066 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.066 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.066 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-13T16:13:01.066 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-13T16:13:01.066 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.066 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.066 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.066 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.066 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mds_autoscaler", 2024-09-13T16:13:01.066 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.066 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.067 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.067 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.067 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.067 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.067 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.067 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.067 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.067 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.067 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.067 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.067 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.067 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.067 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.067 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.068 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.068 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.068 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.068 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.068 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.068 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.068 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.068 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.068 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.068 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.068 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.069 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.069 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.069 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.069 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.069 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.069 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.069 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.069 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.069 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.069 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.069 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.069 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.069 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.070 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.070 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.070 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.070 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.070 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.070 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.070 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.070 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.070 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.070 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.070 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.070 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.070 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.070 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.071 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.071 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.071 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.071 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.071 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.071 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.071 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.071 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.071 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.071 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.071 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.071 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.072 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.072 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.072 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.072 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.072 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.072 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirroring", 2024-09-13T16:13:01.072 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.072 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.072 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.072 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.072 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.072 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.073 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.073 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.073 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.073 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.073 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.073 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.073 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.073 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.073 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.073 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.073 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.073 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.073 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.074 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.074 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.074 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.074 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.074 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.074 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.074 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.074 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.074 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.074 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.074 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.074 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.074 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.075 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.075 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.075 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.075 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.075 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.075 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.075 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.075 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.075 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.075 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.075 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.075 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.076 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.076 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.076 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.076 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.076 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.076 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.076 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.076 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.076 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.076 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.076 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.076 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.077 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.077 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.077 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.077 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.077 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.077 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.077 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.077 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.077 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.077 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.077 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.077 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.077 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.077 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.078 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.078 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "nfs", 2024-09-13T16:13:01.078 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.078 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.078 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.078 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.078 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.078 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.078 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.078 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.078 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.078 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.079 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.079 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.079 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.079 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.079 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.079 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.079 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.079 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.079 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.079 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.079 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.079 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.079 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.080 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.080 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.080 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.080 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.080 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.080 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.080 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.080 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.080 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.080 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.080 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.081 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.081 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.081 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.081 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.081 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.081 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.081 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.081 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.081 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.081 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.081 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.081 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.081 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.082 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.082 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.082 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.082 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.082 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.082 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.082 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.082 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.082 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.082 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.082 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.082 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.083 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.083 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.083 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.083 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.083 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.083 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.083 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.083 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.083 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.083 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.083 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.083 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.084 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-13T16:13:01.084 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.084 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.084 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.084 INFO:teuthology.orchestra.run.smithi017.stdout: "fail_fs": { 2024-09-13T16:13:01.084 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "fail_fs", 2024-09-13T16:13:01.084 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.084 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.084 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.084 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.084 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.084 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.084 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.085 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-13T16:13:01.085 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.085 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.085 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.085 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.085 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.085 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.085 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.085 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.085 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.085 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.085 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.086 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.086 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.086 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.086 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.086 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.086 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.086 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.086 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.086 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.086 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.086 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.086 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.087 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.087 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.087 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.087 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.087 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.087 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.087 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.087 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.087 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.087 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.087 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.087 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.088 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.088 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.088 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.088 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.088 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.088 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.088 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.088 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.088 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.088 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.088 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.088 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.089 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.089 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.089 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.089 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.089 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.089 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.089 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.089 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.089 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.089 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.089 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.089 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.090 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.090 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.090 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.090 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.090 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.090 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.090 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.090 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.090 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.090 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator": { 2024-09-13T16:13:01.090 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-13T16:13:01.090 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.090 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.091 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.091 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.091 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.091 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.091 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.091 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2024-09-13T16:13:01.091 INFO:teuthology.orchestra.run.smithi017.stdout: "rook", 2024-09-13T16:13:01.091 INFO:teuthology.orchestra.run.smithi017.stdout: "test_orchestrator" 2024-09-13T16:13:01.091 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.091 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Orchestrator backend", 2024-09-13T16:13:01.091 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.091 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.091 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.092 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.092 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.092 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_perf_query", 2024-09-13T16:13:01.092 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.092 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.092 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.092 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.092 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.092 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.092 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.092 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.092 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.093 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.093 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.093 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.093 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.093 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.093 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.093 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.093 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.093 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.093 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.093 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.093 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.093 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.094 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.094 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.094 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.094 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.094 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.094 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.094 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.094 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.094 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.094 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.094 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.094 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.094 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.095 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.095 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.095 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.095 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.095 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.095 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.095 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.095 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.095 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.095 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.095 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.096 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.096 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.096 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.096 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.096 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.096 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.096 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.096 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.096 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.096 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.096 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.096 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.096 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.097 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.097 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.097 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.097 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.097 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.097 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.097 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.097 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.097 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.097 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.097 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.097 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.098 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_support", 2024-09-13T16:13:01.098 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.098 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.098 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.098 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.098 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.098 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.098 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.098 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.098 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.098 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.098 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.098 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.099 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.099 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.099 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.099 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.099 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.099 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.099 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.099 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.099 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.099 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.099 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.099 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.099 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.100 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.100 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.100 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.100 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.100 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.100 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.100 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.100 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.100 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.100 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.100 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.100 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.101 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.101 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.101 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.101 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.101 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.101 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.101 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.101 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.101 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.101 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.101 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.101 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.101 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.101 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.102 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.102 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.102 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.102 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.102 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.102 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.102 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.102 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.102 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.102 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.102 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.102 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.103 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.103 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.103 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.103 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.103 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.103 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.103 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.103 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.103 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_autoscaler", 2024-09-13T16:13:01.103 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.103 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.103 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.104 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.104 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.104 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.104 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.104 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.104 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.104 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.104 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.104 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.104 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.104 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.104 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.104 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.104 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.105 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.105 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.105 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.105 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.105 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.105 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.105 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.105 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.105 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.105 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.105 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.105 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.106 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.106 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.106 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.106 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.106 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.106 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.106 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.106 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.106 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.106 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.106 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.106 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.106 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.107 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.107 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.107 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.107 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.107 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.107 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.107 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.107 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.107 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.107 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.107 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.107 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.107 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.107 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.108 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.108 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.108 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.108 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.108 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.108 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.108 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.108 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.108 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.108 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.108 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.108 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.108 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.109 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-13T16:13:01.109 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-13T16:13:01.109 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.109 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.109 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.109 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-13T16:13:01.109 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.109 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.109 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.109 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.109 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.109 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.110 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.110 INFO:teuthology.orchestra.run.smithi017.stdout: "threshold": { 2024-09-13T16:13:01.110 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threshold", 2024-09-13T16:13:01.110 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-13T16:13:01.110 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.110 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.110 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-13T16:13:01.110 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1.0", 2024-09-13T16:13:01.110 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.110 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.110 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "scaling threshold", 2024-09-13T16:13:01.110 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-13T16:13:01.111 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.111 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.111 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.111 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.111 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "progress", 2024-09-13T16:13:01.111 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.111 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.111 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.111 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_pg_recovery_event": { 2024-09-13T16:13:01.111 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_pg_recovery_event", 2024-09-13T16:13:01.111 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.112 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.112 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.112 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.112 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.112 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.112 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.112 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-13T16:13:01.112 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.112 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.112 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.112 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-13T16:13:01.112 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-13T16:13:01.113 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.113 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.113 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.113 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.113 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.113 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.113 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.113 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.113 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.113 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.113 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.113 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.113 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.114 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.114 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.114 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.114 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.114 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.114 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.114 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.114 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.114 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.114 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.114 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.114 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.114 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.115 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.115 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.115 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.115 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.115 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.115 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.115 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.115 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.115 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.115 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.115 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.115 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.115 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.116 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.116 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.116 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.116 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.116 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.116 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.116 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.116 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.116 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.116 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.116 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.116 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.117 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.117 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.117 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.117 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.117 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.117 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.117 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.117 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.117 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.117 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.117 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.117 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.117 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.118 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.118 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.118 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.118 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.118 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.118 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.118 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.118 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.118 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.118 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.118 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.118 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.118 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.119 INFO:teuthology.orchestra.run.smithi017.stdout: "max_completed_events": { 2024-09-13T16:13:01.119 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_completed_events", 2024-09-13T16:13:01.119 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.119 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.119 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.119 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "50", 2024-09-13T16:13:01.119 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.119 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.119 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.119 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "number of past completed events to remember", 2024-09-13T16:13:01.119 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.119 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.119 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.120 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-13T16:13:01.120 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-13T16:13:01.120 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.120 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.120 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.120 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-13T16:13:01.120 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.120 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.120 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.120 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long the module is going to sleep", 2024-09-13T16:13:01.120 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.120 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.120 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.121 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.121 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.121 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus", 2024-09-13T16:13:01.121 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.121 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.121 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.121 INFO:teuthology.orchestra.run.smithi017.stdout: "cache": { 2024-09-13T16:13:01.121 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cache", 2024-09-13T16:13:01.121 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.121 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.121 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.122 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.122 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.122 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.122 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.122 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.122 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.122 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.122 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.122 INFO:teuthology.orchestra.run.smithi017.stdout: "exclude_perf_counters": { 2024-09-13T16:13:01.122 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "exclude_perf_counters", 2024-09-13T16:13:01.122 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.122 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.122 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.123 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.123 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.123 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.123 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.123 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-13T16:13:01.123 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-13T16:13:01.123 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.123 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.123 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.123 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.123 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.124 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.124 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.124 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.124 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.124 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.124 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.124 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.124 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.124 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.124 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.124 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.124 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.124 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.125 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.125 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.125 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.125 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.125 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.125 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.125 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.125 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.125 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.125 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.125 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.125 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.125 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.126 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.126 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.126 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.126 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.126 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.126 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.126 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.126 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.126 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.126 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.126 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.126 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.126 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.127 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.127 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.127 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.127 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.127 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.127 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.127 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.127 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.127 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.127 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.127 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.127 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.128 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.128 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.128 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.128 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.128 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.128 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.128 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.128 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.128 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.128 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.128 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.128 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.129 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools": { 2024-09-13T16:13:01.129 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools", 2024-09-13T16:13:01.129 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.129 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.129 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.129 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.129 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.129 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.129 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.129 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.129 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.129 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.129 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.130 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-13T16:13:01.130 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-13T16:13:01.130 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.130 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.130 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.130 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300", 2024-09-13T16:13:01.130 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.130 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.130 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.130 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.130 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.130 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.130 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.131 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_interval": { 2024-09-13T16:13:01.131 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_interval", 2024-09-13T16:13:01.131 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-13T16:13:01.131 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.131 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.131 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15.0", 2024-09-13T16:13:01.131 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.131 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.131 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.131 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.131 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.131 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.131 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.132 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-13T16:13:01.132 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-13T16:13:01.132 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.132 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.132 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.132 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-13T16:13:01.132 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.132 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.132 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.132 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-13T16:13:01.132 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.132 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.133 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.133 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-13T16:13:01.133 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-13T16:13:01.133 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.133 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.133 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.133 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "9283", 2024-09-13T16:13:01.133 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.133 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.133 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.133 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-13T16:13:01.133 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.133 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.134 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.134 INFO:teuthology.orchestra.run.smithi017.stdout: "stale_cache_strategy": { 2024-09-13T16:13:01.134 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stale_cache_strategy", 2024-09-13T16:13:01.134 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.134 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.134 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.134 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "log", 2024-09-13T16:13:01.134 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.134 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.134 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.134 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.134 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.134 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.135 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.135 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-13T16:13:01.135 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-13T16:13:01.135 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.135 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.135 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.135 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "default", 2024-09-13T16:13:01.135 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.135 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.135 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.135 INFO:teuthology.orchestra.run.smithi017.stdout: "default", 2024-09-13T16:13:01.135 INFO:teuthology.orchestra.run.smithi017.stdout: "error" 2024-09-13T16:13:01.135 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.135 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.136 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.136 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.136 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.136 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-13T16:13:01.136 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-13T16:13:01.136 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.136 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.136 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.136 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-13T16:13:01.136 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-13T16:13:01.136 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-13T16:13:01.136 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.136 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.137 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.137 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.137 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.137 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.137 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.137 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2024-09-13T16:13:01.137 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.137 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.137 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.137 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.138 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.138 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.138 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.138 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.138 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.138 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.138 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.138 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.138 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.138 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.138 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.138 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.138 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.138 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.139 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.139 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.139 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.139 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.139 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.139 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.139 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.139 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.139 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.139 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.139 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.139 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.140 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.140 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.140 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.140 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.140 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.140 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.140 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.140 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.140 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.140 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.140 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.140 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.140 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.141 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.141 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.141 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.141 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.141 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.141 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.141 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.141 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.141 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.141 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.141 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.141 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.141 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.142 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.142 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.142 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.142 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.142 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.142 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.142 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.142 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.142 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.142 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.142 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.142 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.142 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.143 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_snap_create": { 2024-09-13T16:13:01.143 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_snap_create", 2024-09-13T16:13:01.143 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.143 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.143 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.143 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:01.143 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.143 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.143 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.143 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.143 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.143 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.143 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.144 INFO:teuthology.orchestra.run.smithi017.stdout: "mirror_snapshot_schedule": { 2024-09-13T16:13:01.144 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirror_snapshot_schedule", 2024-09-13T16:13:01.144 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.144 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.144 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.144 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.144 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.144 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.144 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.144 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.144 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.144 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.144 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.145 INFO:teuthology.orchestra.run.smithi017.stdout: "trash_purge_schedule": { 2024-09-13T16:13:01.145 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "trash_purge_schedule", 2024-09-13T16:13:01.145 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.145 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.145 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.145 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.145 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.145 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.145 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.145 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.145 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.145 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.145 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.146 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.146 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.146 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "restful", 2024-09-13T16:13:01.146 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.146 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.146 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.146 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_auth": { 2024-09-13T16:13:01.146 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_auth", 2024-09-13T16:13:01.146 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.146 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.146 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.146 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.146 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.147 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.147 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.147 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.147 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.147 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.147 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.147 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-13T16:13:01.147 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-13T16:13:01.147 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.147 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.147 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.147 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.147 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.148 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.148 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.148 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.148 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.148 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.148 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.148 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.148 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.148 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.148 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.148 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.148 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.148 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.149 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.149 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.149 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.149 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.149 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.149 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.149 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.149 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.149 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.149 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.149 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.149 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.149 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.150 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.150 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.150 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.150 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.150 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.150 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.150 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.150 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.150 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.150 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.150 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.150 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.150 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.151 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.151 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.151 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.151 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.151 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.151 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.151 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.151 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.151 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.151 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.152 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.152 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.152 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.152 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.152 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.152 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.152 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.152 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.152 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.152 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.152 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.152 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.152 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.153 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.153 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.153 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.153 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.153 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.153 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.153 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.153 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.153 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.153 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.153 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-13T16:13:01.153 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-13T16:13:01.154 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.154 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.154 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.154 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.154 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.154 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.154 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.154 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.154 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.154 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.154 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.154 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-13T16:13:01.154 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-13T16:13:01.155 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.155 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.155 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.155 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.155 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.155 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.155 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.155 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.155 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.155 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.155 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.155 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.155 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.156 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rgw", 2024-09-13T16:13:01.156 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.156 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.156 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.156 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.156 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.156 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.156 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.156 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.156 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.156 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.156 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.156 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.157 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.157 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.157 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.157 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.157 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.157 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.157 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.157 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.157 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.157 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.157 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.157 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.158 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.158 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.158 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.158 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.158 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.158 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.158 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.158 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.158 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.158 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.158 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.158 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.159 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.159 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.159 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.159 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.159 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.159 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.159 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.159 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.159 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.159 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.159 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.159 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.159 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.159 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.160 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.160 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.160 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.160 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.160 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.160 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.160 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.160 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.160 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.160 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.160 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.160 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.160 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.161 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.161 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.161 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.161 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.161 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.161 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.161 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.161 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.161 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rook", 2024-09-13T16:13:01.161 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.161 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.162 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.162 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.162 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.162 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.162 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.162 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.162 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.162 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.162 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.162 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.162 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.162 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.163 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.163 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.163 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.163 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.163 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.163 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.163 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.163 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.163 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.163 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.163 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.163 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.163 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.164 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.164 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.164 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.164 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.164 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.164 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.164 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.164 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.164 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.164 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.164 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.164 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.165 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.165 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.165 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.165 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.165 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.165 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.165 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.165 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.165 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.165 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.165 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.165 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.165 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.165 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.166 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.166 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.166 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.166 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.166 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.166 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.166 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.166 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.166 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.166 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.166 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.167 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.167 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.167 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.167 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.167 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.167 INFO:teuthology.orchestra.run.smithi017.stdout: "storage_class": { 2024-09-13T16:13:01.167 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "storage_class", 2024-09-13T16:13:01.167 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.167 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.167 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.167 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "local", 2024-09-13T16:13:01.168 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.168 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.168 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.168 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-13T16:13:01.168 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.168 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.168 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.168 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.168 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.168 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "selftest", 2024-09-13T16:13:01.168 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.169 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.169 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.169 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.169 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.169 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.169 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.169 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.169 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.169 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.169 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.169 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.169 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.169 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.170 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.170 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.170 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.170 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.170 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.170 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.170 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.170 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.170 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.170 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.170 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.170 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.171 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.171 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.171 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.171 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.171 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.171 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.171 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.171 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.171 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.171 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.171 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.171 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.171 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.172 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.172 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.172 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.172 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.172 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.172 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.172 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.172 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.172 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.172 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.172 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.172 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.172 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.172 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.173 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.173 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.173 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.173 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.173 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.173 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.173 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.173 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.173 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.173 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.173 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.174 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.174 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.174 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.174 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.174 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.174 INFO:teuthology.orchestra.run.smithi017.stdout: "roption1": { 2024-09-13T16:13:01.174 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption1", 2024-09-13T16:13:01.174 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.174 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.174 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.174 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.174 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.174 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.175 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.175 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.175 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.175 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.175 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.175 INFO:teuthology.orchestra.run.smithi017.stdout: "roption2": { 2024-09-13T16:13:01.175 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption2", 2024-09-13T16:13:01.175 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.175 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.175 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.175 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "xyz", 2024-09-13T16:13:01.175 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.175 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.176 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.176 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.176 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.176 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.176 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.176 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption1": { 2024-09-13T16:13:01.176 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption1", 2024-09-13T16:13:01.176 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.176 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.176 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.176 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.176 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.176 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.177 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.177 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.177 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.177 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.177 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.177 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption2": { 2024-09-13T16:13:01.177 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption2", 2024-09-13T16:13:01.177 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.177 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.177 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.177 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.177 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.178 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.178 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.178 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.178 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.178 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.178 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.178 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption3": { 2024-09-13T16:13:01.178 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption3", 2024-09-13T16:13:01.178 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-13T16:13:01.178 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.178 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.178 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.178 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.179 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.179 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.179 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.179 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.179 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.179 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.179 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption4": { 2024-09-13T16:13:01.179 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption4", 2024-09-13T16:13:01.179 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.179 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.179 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.179 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.179 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.180 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.180 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.180 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.180 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.180 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.180 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.180 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption5": { 2024-09-13T16:13:01.180 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption5", 2024-09-13T16:13:01.180 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.180 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.180 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.180 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.181 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.181 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.181 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.181 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.181 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.181 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.181 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.181 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption6": { 2024-09-13T16:13:01.181 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption6", 2024-09-13T16:13:01.181 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.181 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.181 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.181 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.182 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.182 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.182 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.182 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.182 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.182 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.182 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.182 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption7": { 2024-09-13T16:13:01.182 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption7", 2024-09-13T16:13:01.182 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.182 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.182 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.183 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.183 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-13T16:13:01.183 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "42", 2024-09-13T16:13:01.183 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.183 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.183 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.183 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.183 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.183 INFO:teuthology.orchestra.run.smithi017.stdout: "testkey": { 2024-09-13T16:13:01.183 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testkey", 2024-09-13T16:13:01.183 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.183 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.184 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.184 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.184 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.184 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.184 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.184 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.184 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.184 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.184 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.184 INFO:teuthology.orchestra.run.smithi017.stdout: "testlkey": { 2024-09-13T16:13:01.184 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testlkey", 2024-09-13T16:13:01.184 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.185 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.185 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.185 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.185 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.185 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.185 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.185 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.185 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.185 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.185 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.185 INFO:teuthology.orchestra.run.smithi017.stdout: "testnewline": { 2024-09-13T16:13:01.185 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testnewline", 2024-09-13T16:13:01.186 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.186 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.186 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.186 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.186 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.186 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.186 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.186 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.186 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.186 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.186 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.186 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.186 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.187 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2024-09-13T16:13:01.187 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.187 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.187 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.187 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_m_granularity": { 2024-09-13T16:13:01.187 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_m_granularity", 2024-09-13T16:13:01.187 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.187 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.187 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.187 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.187 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.188 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.188 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.188 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow minute scheduled snapshots", 2024-09-13T16:13:01.188 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.188 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.188 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.188 INFO:teuthology.orchestra.run.smithi017.stdout: "dump_on_update": { 2024-09-13T16:13:01.188 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dump_on_update", 2024-09-13T16:13:01.188 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.188 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.188 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.188 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.189 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.189 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.189 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.189 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "dump database to debug log on update", 2024-09-13T16:13:01.189 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.189 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.189 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.189 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.189 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.189 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.189 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.190 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.190 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.190 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.190 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.190 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.190 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.190 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.190 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.190 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.190 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.190 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.190 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.190 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.191 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.191 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.191 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.191 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.191 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.191 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.191 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.191 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.191 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.191 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.191 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.191 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.191 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.192 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.192 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.192 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.192 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.192 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.192 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.192 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.192 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.192 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.192 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.192 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.192 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.193 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.193 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.193 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.193 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.193 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.193 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.193 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.193 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.193 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.193 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.193 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.193 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.194 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.194 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.194 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.194 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.194 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.194 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.194 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.194 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.194 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.194 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.194 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.194 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.194 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.194 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.195 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stats", 2024-09-13T16:13:01.195 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.195 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.195 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.195 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.195 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.195 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.195 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.195 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.195 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.195 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.196 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.196 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.196 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.196 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.196 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.196 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.196 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.196 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.196 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.196 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.196 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.196 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.196 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.197 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.197 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.197 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.197 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.197 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.197 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.197 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.197 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.197 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.197 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.197 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.197 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.197 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.198 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.198 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.198 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.198 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.198 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.198 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.198 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.198 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.198 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.198 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.198 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.198 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.198 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.199 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.199 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.199 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.199 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.199 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.199 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.199 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.199 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.199 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.199 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.199 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.199 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.199 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.200 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.200 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.200 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.200 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.200 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.200 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.200 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.200 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.200 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.200 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "status", 2024-09-13T16:13:01.200 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.201 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.201 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.201 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.201 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.201 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.201 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.201 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.201 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.201 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.201 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.201 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.201 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.202 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.202 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.202 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.202 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.202 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.202 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.202 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.202 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.202 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.202 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.202 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.202 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.202 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.203 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.203 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.203 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.203 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.203 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.203 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.203 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.203 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.203 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.203 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.203 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.203 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.204 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.204 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.204 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.204 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.204 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.204 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.204 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.204 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.204 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.204 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.204 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.204 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.204 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.205 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.205 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.205 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.205 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.205 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.205 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.205 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.205 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.205 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.205 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.205 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.205 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.205 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.206 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.206 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.206 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.206 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.206 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.206 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.206 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.206 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telegraf", 2024-09-13T16:13:01.206 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.206 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.206 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.206 INFO:teuthology.orchestra.run.smithi017.stdout: "address": { 2024-09-13T16:13:01.207 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "address", 2024-09-13T16:13:01.207 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.207 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.207 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.207 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-13T16:13:01.207 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.207 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.207 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.207 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.207 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.207 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.207 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.207 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-13T16:13:01.208 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-13T16:13:01.208 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.208 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.208 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.208 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15", 2024-09-13T16:13:01.208 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.208 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.208 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.208 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.208 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.208 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.208 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.209 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.209 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.209 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.209 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.209 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.209 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.209 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.209 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.209 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.209 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.209 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.209 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.209 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.209 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.210 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.210 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.210 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.210 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.210 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.210 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.210 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.210 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.210 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.210 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.211 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.211 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.211 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.211 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.211 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.211 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.211 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.211 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.211 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.211 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.211 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.211 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.211 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.212 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.212 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.212 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.212 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.212 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.212 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.212 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.212 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.212 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.212 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.212 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.212 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.212 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.213 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.213 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.213 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.213 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.213 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.213 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.213 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.213 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.213 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.213 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.213 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.213 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.213 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.214 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.214 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.214 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.214 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.214 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.214 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telemetry", 2024-09-13T16:13:01.214 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.214 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.214 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.214 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_basic": { 2024-09-13T16:13:01.214 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_basic", 2024-09-13T16:13:01.215 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.215 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.215 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.215 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.215 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.215 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.215 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.215 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-13T16:13:01.215 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.215 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.215 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.215 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_crash": { 2024-09-13T16:13:01.215 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_crash", 2024-09-13T16:13:01.216 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.216 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.216 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.216 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.216 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.216 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.216 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.216 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-13T16:13:01.216 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.216 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.216 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.216 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_device": { 2024-09-13T16:13:01.216 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_device", 2024-09-13T16:13:01.217 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.217 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.217 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.217 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.217 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.217 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.217 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.217 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-13T16:13:01.217 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.217 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.217 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.218 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_ident": { 2024-09-13T16:13:01.218 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_ident", 2024-09-13T16:13:01.218 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.218 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.218 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.218 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.218 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.218 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.218 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.218 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-13T16:13:01.218 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.218 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.218 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.219 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_perf": { 2024-09-13T16:13:01.219 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_perf", 2024-09-13T16:13:01.219 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.219 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.219 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.219 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.219 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.219 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.219 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.219 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-13T16:13:01.219 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.219 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.219 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.220 INFO:teuthology.orchestra.run.smithi017.stdout: "contact": { 2024-09-13T16:13:01.220 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "contact", 2024-09-13T16:13:01.220 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.220 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.220 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.220 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.220 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.220 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.220 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.220 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.220 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.220 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.220 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.221 INFO:teuthology.orchestra.run.smithi017.stdout: "description": { 2024-09-13T16:13:01.221 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "description", 2024-09-13T16:13:01.221 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.221 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.221 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.221 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.221 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.221 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.221 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.221 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.221 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.221 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.221 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.222 INFO:teuthology.orchestra.run.smithi017.stdout: "device_url": { 2024-09-13T16:13:01.222 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_url", 2024-09-13T16:13:01.222 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.222 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.222 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.222 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-13T16:13:01.222 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.222 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.222 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.222 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.222 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.222 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.222 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.223 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-13T16:13:01.223 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-13T16:13:01.223 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.223 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.223 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.223 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.223 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.223 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.223 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.223 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.223 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.223 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.223 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.224 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-13T16:13:01.224 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-13T16:13:01.224 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.224 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.224 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.224 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "24", 2024-09-13T16:13:01.224 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "8", 2024-09-13T16:13:01.224 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.224 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.224 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.224 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.225 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.225 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.225 INFO:teuthology.orchestra.run.smithi017.stdout: "last_opt_revision": { 2024-09-13T16:13:01.225 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "last_opt_revision", 2024-09-13T16:13:01.225 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.225 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.225 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.225 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1", 2024-09-13T16:13:01.225 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.225 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.225 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.225 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.226 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.226 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.226 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.226 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard": { 2024-09-13T16:13:01.226 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard", 2024-09-13T16:13:01.226 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.226 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.226 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.226 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.226 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.226 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.226 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.227 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.227 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.227 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.227 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.227 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard_description": { 2024-09-13T16:13:01.227 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard_description", 2024-09-13T16:13:01.227 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.227 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.227 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.227 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.227 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.227 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.228 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.228 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.228 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.228 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.228 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.228 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.228 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.228 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.228 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.228 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.228 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.228 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.229 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.229 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.229 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.229 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.229 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.229 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.229 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.229 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.229 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.229 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.229 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.229 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.230 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.230 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.230 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.230 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.230 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.230 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.230 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.230 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.230 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.230 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.230 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.230 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.230 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.231 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.231 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.231 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.231 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.231 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.231 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.231 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.231 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.231 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.231 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.231 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.231 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.232 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.232 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.232 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.232 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.232 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.232 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.232 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.232 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.232 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.232 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.232 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.232 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.233 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.233 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.233 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.233 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.233 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.233 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.233 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.233 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.233 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.233 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.233 INFO:teuthology.orchestra.run.smithi017.stdout: "organization": { 2024-09-13T16:13:01.233 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "organization", 2024-09-13T16:13:01.234 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.234 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.234 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.234 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.234 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.234 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.234 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.234 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.234 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.234 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.234 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.234 INFO:teuthology.orchestra.run.smithi017.stdout: "proxy": { 2024-09-13T16:13:01.234 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "proxy", 2024-09-13T16:13:01.234 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.235 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.235 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.235 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.235 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.235 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.235 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.235 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.235 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.235 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.235 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.235 INFO:teuthology.orchestra.run.smithi017.stdout: "url": { 2024-09-13T16:13:01.235 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url", 2024-09-13T16:13:01.235 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.236 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.236 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.236 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-13T16:13:01.236 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.236 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.236 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.236 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.236 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.236 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.236 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.236 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.236 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.237 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "test_orchestrator", 2024-09-13T16:13:01.237 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.237 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.237 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.237 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.237 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.237 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.237 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.237 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.237 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.237 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.237 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.238 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.238 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.238 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.238 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.238 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.238 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.238 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.238 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.238 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.238 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.238 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.238 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.239 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.239 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.239 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.239 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.239 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.239 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.239 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.239 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.239 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.239 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.239 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.239 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.240 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.240 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.240 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.240 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.240 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.240 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.240 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.240 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.240 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.240 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.240 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.240 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.241 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.241 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.241 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.241 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.241 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.241 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.241 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.241 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.241 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.241 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.241 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.241 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.241 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.242 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.242 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.242 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.242 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.242 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.242 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.242 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.242 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.242 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.242 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.242 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.242 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2024-09-13T16:13:01.243 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.243 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.243 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.243 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.243 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.243 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.243 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.243 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.243 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.243 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.243 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.243 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.243 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.244 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.244 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.244 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.244 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.244 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.244 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.244 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.244 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.244 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.244 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.244 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.244 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.245 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.245 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.245 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.245 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.245 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.245 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.245 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.245 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.245 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.245 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.245 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.245 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.245 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.246 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.246 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.246 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.246 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.246 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.246 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.246 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.246 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.246 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.246 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.246 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.246 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.246 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.247 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.247 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.247 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.247 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.247 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.247 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.247 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.247 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.247 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.247 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.247 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.247 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.248 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.248 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.248 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.248 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.248 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.248 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.248 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_clones": { 2024-09-13T16:13:01.248 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_clones", 2024-09-13T16:13:01.248 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.248 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.248 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.248 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4", 2024-09-13T16:13:01.249 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.249 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.249 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.249 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-13T16:13:01.249 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.249 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.249 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.249 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_delay": { 2024-09-13T16:13:01.249 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_delay", 2024-09-13T16:13:01.249 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.249 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.249 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.250 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-13T16:13:01.250 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.250 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.250 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.250 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-13T16:13:01.250 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.250 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.250 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.250 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_no_wait": { 2024-09-13T16:13:01.250 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_no_wait", 2024-09-13T16:13:01.250 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.250 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.250 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.251 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.251 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.251 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.251 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.251 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-13T16:13:01.251 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.251 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.251 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.251 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.251 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.251 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix", 2024-09-13T16:13:01.251 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.252 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.252 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.252 INFO:teuthology.orchestra.run.smithi017.stdout: "discovery_interval": { 2024-09-13T16:13:01.252 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "discovery_interval", 2024-09-13T16:13:01.252 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-13T16:13:01.252 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.252 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.252 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "100", 2024-09-13T16:13:01.252 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.252 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.252 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.252 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.252 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.253 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.253 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.253 INFO:teuthology.orchestra.run.smithi017.stdout: "identifier": { 2024-09-13T16:13:01.253 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "identifier", 2024-09-13T16:13:01.253 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.253 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.253 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.253 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.253 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.253 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.253 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.253 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.254 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.254 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.254 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.254 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-13T16:13:01.254 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-13T16:13:01.254 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.254 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.254 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.254 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-13T16:13:01.254 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.254 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.254 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.254 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.255 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.255 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.255 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.255 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.255 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.255 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.255 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.255 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.255 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.255 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.255 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.255 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.255 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.256 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.256 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.256 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.256 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.256 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.256 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.256 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.256 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.256 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.256 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.256 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.256 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.257 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.257 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.257 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.257 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.257 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.257 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.257 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.257 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.257 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.257 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.257 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.257 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.258 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.258 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.258 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.258 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.258 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.258 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.258 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.258 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.258 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.258 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.258 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.258 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.258 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.259 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.259 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.259 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.259 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.259 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.259 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.259 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.259 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.259 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.259 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.259 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.260 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.260 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.260 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.260 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.260 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.260 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.260 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.260 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.260 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_host": { 2024-09-13T16:13:01.260 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_host", 2024-09-13T16:13:01.260 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.260 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.261 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.261 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.261 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.261 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.261 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.261 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.261 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.261 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.261 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.261 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_port": { 2024-09-13T16:13:01.261 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_port", 2024-09-13T16:13:01.262 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.262 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.262 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.262 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10051", 2024-09-13T16:13:01.262 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.262 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.262 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.262 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.262 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.262 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.262 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.262 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_sender": { 2024-09-13T16:13:01.262 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_sender", 2024-09-13T16:13:01.263 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.263 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.263 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.263 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-13T16:13:01.263 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.263 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.263 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.263 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.263 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.263 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.263 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.263 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.263 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.264 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.264 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-13T16:13:01.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.264 INFO:teuthology.orchestra.run.smithi017.stdout: "gid": 24110, 2024-09-13T16:13:01.264 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "y", 2024-09-13T16:13:01.264 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_features": 4540138322906710015, 2024-09-13T16:13:01.264 INFO:teuthology.orchestra.run.smithi017.stdout: "available_modules": [ 2024-09-13T16:13:01.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.264 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alerts", 2024-09-13T16:13:01.264 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.264 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.264 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.265 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-13T16:13:01.265 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-13T16:13:01.265 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.265 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.265 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.265 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-13T16:13:01.265 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.265 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.265 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.265 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How frequently to reexamine health status", 2024-09-13T16:13:01.265 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.265 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.265 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.265 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.266 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.266 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.266 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.266 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.266 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.266 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.266 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.266 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.266 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.266 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.266 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.266 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.266 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.266 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.267 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.267 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.267 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.267 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.267 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.267 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.267 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.267 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.267 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.267 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.267 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.267 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.268 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.268 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.268 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.268 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.268 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.268 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.268 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.268 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.268 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.268 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.268 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.268 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.270 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.270 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.270 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.270 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.270 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.270 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.270 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.270 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.270 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.270 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.270 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.270 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.271 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.271 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.271 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_destination": { 2024-09-13T16:13:01.271 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_destination", 2024-09-13T16:13:01.271 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.271 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.271 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.271 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.271 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.271 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.271 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.271 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email address to send alerts to", 2024-09-13T16:13:01.272 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.272 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.272 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.272 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_from_name": { 2024-09-13T16:13:01.272 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_from_name", 2024-09-13T16:13:01.272 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.272 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.272 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.272 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "Ceph", 2024-09-13T16:13:01.272 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.272 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.272 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.273 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email From: name", 2024-09-13T16:13:01.273 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.273 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.273 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.273 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_host": { 2024-09-13T16:13:01.273 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_host", 2024-09-13T16:13:01.273 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.273 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.273 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.273 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.273 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.273 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.273 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.274 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP server", 2024-09-13T16:13:01.274 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.274 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.274 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.274 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_password": { 2024-09-13T16:13:01.274 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_password", 2024-09-13T16:13:01.274 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.274 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.274 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.274 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.274 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.274 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.275 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.275 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Password to authenticate with", 2024-09-13T16:13:01.275 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.275 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.275 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.275 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_port": { 2024-09-13T16:13:01.275 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_port", 2024-09-13T16:13:01.275 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.275 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.275 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.275 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "465", 2024-09-13T16:13:01.275 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.276 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.276 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.276 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP port", 2024-09-13T16:13:01.276 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.276 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.276 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.276 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_sender": { 2024-09-13T16:13:01.276 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_sender", 2024-09-13T16:13:01.276 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.276 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.276 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.276 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.276 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.277 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.277 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.277 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP envelope sender", 2024-09-13T16:13:01.277 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.277 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.277 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.277 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_ssl": { 2024-09-13T16:13:01.277 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_ssl", 2024-09-13T16:13:01.277 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.277 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.277 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.277 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.278 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.278 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.278 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.278 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-13T16:13:01.278 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.278 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.278 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.278 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_user": { 2024-09-13T16:13:01.278 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_user", 2024-09-13T16:13:01.278 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.278 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.278 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.279 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.279 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.279 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.279 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.279 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "User to authenticate as", 2024-09-13T16:13:01.279 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.279 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.279 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.279 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.279 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.279 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "balancer", 2024-09-13T16:13:01.279 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.280 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.280 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.280 INFO:teuthology.orchestra.run.smithi017.stdout: "active": { 2024-09-13T16:13:01.280 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "active", 2024-09-13T16:13:01.280 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.280 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.280 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.280 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.280 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.280 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.280 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.280 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically balance PGs across cluster", 2024-09-13T16:13:01.280 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.281 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.281 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.281 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_time": { 2024-09-13T16:13:01.281 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_time", 2024-09-13T16:13:01.281 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.281 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.281 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.281 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0000", 2024-09-13T16:13:01.281 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.281 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.281 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.281 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "beginning time of day to automatically balance", 2024-09-13T16:13:01.281 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T16:13:01.282 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.282 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.282 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_weekday": { 2024-09-13T16:13:01.282 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_weekday", 2024-09-13T16:13:01.282 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-13T16:13:01.282 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.282 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.282 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-13T16:13:01.282 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-13T16:13:01.282 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-13T16:13:01.282 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.283 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-13T16:13:01.283 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T16:13:01.283 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.283 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.283 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_max_iterations": { 2024-09-13T16:13:01.283 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_max_iterations", 2024-09-13T16:13:01.283 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-13T16:13:01.283 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.283 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.283 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "25", 2024-09-13T16:13:01.283 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-13T16:13:01.283 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "250", 2024-09-13T16:13:01.284 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.284 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-13T16:13:01.284 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.284 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.284 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.284 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_metrics": { 2024-09-13T16:13:01.284 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_metrics", 2024-09-13T16:13:01.284 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.284 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.284 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.284 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "pgs,objects,bytes", 2024-09-13T16:13:01.284 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.284 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.285 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.285 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-13T16:13:01.285 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-13T16:13:01.285 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.285 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.285 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_step": { 2024-09-13T16:13:01.285 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_step", 2024-09-13T16:13:01.285 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-13T16:13:01.285 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.285 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.285 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.5", 2024-09-13T16:13:01.285 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0.001", 2024-09-13T16:13:01.286 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "0.999", 2024-09-13T16:13:01.286 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.286 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "aggressiveness of optimization", 2024-09-13T16:13:01.286 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-13T16:13:01.286 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.286 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.286 INFO:teuthology.orchestra.run.smithi017.stdout: "end_time": { 2024-09-13T16:13:01.286 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_time", 2024-09-13T16:13:01.286 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.286 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.286 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.286 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2359", 2024-09-13T16:13:01.287 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.287 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.287 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.287 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ending time of day to automatically balance", 2024-09-13T16:13:01.287 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T16:13:01.287 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.287 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.287 INFO:teuthology.orchestra.run.smithi017.stdout: "end_weekday": { 2024-09-13T16:13:01.287 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_weekday", 2024-09-13T16:13:01.287 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-13T16:13:01.287 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.287 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.287 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-13T16:13:01.288 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-13T16:13:01.288 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-13T16:13:01.288 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.288 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-13T16:13:01.288 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T16:13:01.288 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.288 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.288 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.288 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.288 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.288 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.289 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.289 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.289 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.289 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.289 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.289 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.289 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.289 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.289 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.289 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.289 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.289 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.289 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.290 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.290 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.290 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.290 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.290 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.290 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.290 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.290 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.290 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.290 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.290 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.290 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.291 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.291 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.291 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.291 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.291 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.291 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.291 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.291 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.291 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.291 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.291 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.291 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.291 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.292 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.292 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.292 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.292 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.292 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.292 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.292 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.292 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.292 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.292 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.292 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.292 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.292 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.293 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.293 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.293 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.293 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.293 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.293 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.293 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.293 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.293 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.293 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.293 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.293 INFO:teuthology.orchestra.run.smithi017.stdout: "min_score": { 2024-09-13T16:13:01.294 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_score", 2024-09-13T16:13:01.294 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-13T16:13:01.294 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.294 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.294 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-13T16:13:01.294 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.294 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.294 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.294 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-13T16:13:01.294 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.294 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.294 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.294 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-13T16:13:01.295 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-13T16:13:01.295 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.295 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.295 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.295 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "upmap", 2024-09-13T16:13:01.295 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.295 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.295 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.295 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-compat", 2024-09-13T16:13:01.295 INFO:teuthology.orchestra.run.smithi017.stdout: "none", 2024-09-13T16:13:01.295 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap" 2024-09-13T16:13:01.295 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.295 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Balancer mode", 2024-09-13T16:13:01.296 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.296 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.296 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.296 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ids": { 2024-09-13T16:13:01.296 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_ids", 2024-09-13T16:13:01.296 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.296 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.296 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.296 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.296 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.296 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.296 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.297 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-13T16:13:01.297 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.297 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.297 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.297 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-13T16:13:01.297 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-13T16:13:01.297 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.297 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.297 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.297 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-13T16:13:01.297 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.297 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.298 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.298 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-13T16:13:01.298 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.298 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.298 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.298 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_deviation": { 2024-09-13T16:13:01.298 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_deviation", 2024-09-13T16:13:01.298 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.298 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.298 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.298 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-13T16:13:01.298 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-13T16:13:01.298 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.299 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.299 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-13T16:13:01.299 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-13T16:13:01.299 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.299 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.299 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_optimizations": { 2024-09-13T16:13:01.299 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_optimizations", 2024-09-13T16:13:01.299 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-13T16:13:01.299 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.299 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.299 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:01.299 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.300 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.300 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.300 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-13T16:13:01.300 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.300 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.300 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.300 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.300 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.300 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm", 2024-09-13T16:13:01.300 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.300 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.301 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.301 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_down_multiplier": { 2024-09-13T16:13:01.301 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_down_multiplier", 2024-09-13T16:13:01.301 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-13T16:13:01.301 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.301 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.301 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-13T16:13:01.301 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.301 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.301 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.301 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-13T16:13:01.301 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.301 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.302 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.302 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_refresh_rate": { 2024-09-13T16:13:01.302 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_refresh_rate", 2024-09-13T16:13:01.302 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.302 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.302 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.302 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "20", 2024-09-13T16:13:01.302 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.302 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.302 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.302 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-13T16:13:01.302 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.303 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.303 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.303 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_starting_port": { 2024-09-13T16:13:01.303 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_starting_port", 2024-09-13T16:13:01.303 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.303 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.303 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.303 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4721", 2024-09-13T16:13:01.303 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.303 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.303 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.303 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-13T16:13:01.303 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.304 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.304 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.304 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_ptrace": { 2024-09-13T16:13:01.304 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_ptrace", 2024-09-13T16:13:01.304 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.304 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.304 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.304 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.304 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.304 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.304 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.304 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-13T16:13:01.305 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-13T16:13:01.305 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.305 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.305 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_interval": { 2024-09-13T16:13:01.305 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_interval", 2024-09-13T16:13:01.305 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.305 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.305 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.305 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-13T16:13:01.305 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.305 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.305 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.306 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-13T16:13:01.306 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.306 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.306 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.306 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_memory_target_ratio": { 2024-09-13T16:13:01.306 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_memory_target_ratio", 2024-09-13T16:13:01.306 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-13T16:13:01.306 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.306 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.306 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.7", 2024-09-13T16:13:01.306 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.306 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.307 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.307 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-13T16:13:01.307 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.307 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.307 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.307 INFO:teuthology.orchestra.run.smithi017.stdout: "cgroups_split": { 2024-09-13T16:13:01.307 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cgroups_split", 2024-09-13T16:13:01.307 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.307 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.307 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.307 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.307 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.307 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.308 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.308 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-13T16:13:01.308 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.308 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.308 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.308 INFO:teuthology.orchestra.run.smithi017.stdout: "config_checks_enabled": { 2024-09-13T16:13:01.308 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_checks_enabled", 2024-09-13T16:13:01.308 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.308 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.308 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.308 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.309 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.309 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.309 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.309 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-13T16:13:01.309 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.309 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.309 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.309 INFO:teuthology.orchestra.run.smithi017.stdout: "config_dashboard": { 2024-09-13T16:13:01.309 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_dashboard", 2024-09-13T16:13:01.309 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.309 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.309 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.309 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.310 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.310 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.310 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.310 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-13T16:13:01.310 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.310 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.310 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.310 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_alertmanager": { 2024-09-13T16:13:01.310 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_alertmanager", 2024-09-13T16:13:01.310 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.310 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.310 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.311 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-13T16:13:01.311 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.311 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.311 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.311 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:01.311 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.311 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.311 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.311 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_base": { 2024-09-13T16:13:01.311 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_base", 2024-09-13T16:13:01.311 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.311 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.311 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.312 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-13T16:13:01.312 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.312 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.312 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.312 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Container image name, without the tag", 2024-09-13T16:13:01.312 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.312 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.312 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.312 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_elasticsearch": { 2024-09-13T16:13:01.312 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_elasticsearch", 2024-09-13T16:13:01.312 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-13T16:13:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "elasticsearch container image", 2024-09-13T16:13:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_grafana": { 2024-09-13T16:13:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_grafana", 2024-09-13T16:13:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.314 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.314 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.314 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-09-13T16:13:01.314 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.314 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.314 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.314 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:01.314 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.314 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.314 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.314 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_haproxy": { 2024-09-13T16:13:01.314 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_haproxy", 2024-09-13T16:13:01.314 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.315 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.315 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.315 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-13T16:13:01.315 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.315 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.315 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.315 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "HAproxy container image", 2024-09-13T16:13:01.315 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.315 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.315 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.315 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_agent": { 2024-09-13T16:13:01.315 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_agent", 2024-09-13T16:13:01.316 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.316 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.316 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.316 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-13T16:13:01.316 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.316 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.316 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.316 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger agent container image", 2024-09-13T16:13:01.316 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.316 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.316 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.317 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_collector": { 2024-09-13T16:13:01.317 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_collector", 2024-09-13T16:13:01.317 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.317 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.317 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.317 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-13T16:13:01.317 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.317 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.317 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.317 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger collector container image", 2024-09-13T16:13:01.317 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.317 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.317 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.318 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_query": { 2024-09-13T16:13:01.318 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_query", 2024-09-13T16:13:01.318 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.318 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.318 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.318 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-13T16:13:01.318 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.318 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.318 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.318 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger query container image", 2024-09-13T16:13:01.318 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.318 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.318 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.319 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_keepalived": { 2024-09-13T16:13:01.319 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_keepalived", 2024-09-13T16:13:01.319 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.319 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.319 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.319 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-13T16:13:01.319 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.319 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.319 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.319 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Keepalived container image", 2024-09-13T16:13:01.319 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.319 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.319 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.320 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_loki": { 2024-09-13T16:13:01.320 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_loki", 2024-09-13T16:13:01.320 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.320 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.320 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.320 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-13T16:13:01.320 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.320 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.320 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.320 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Loki container image", 2024-09-13T16:13:01.320 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.320 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.320 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.321 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_node_exporter": { 2024-09-13T16:13:01.321 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_node_exporter", 2024-09-13T16:13:01.321 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.321 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.321 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.321 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-13T16:13:01.324 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.324 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.324 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.324 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:01.324 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.324 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.324 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.325 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_nvmeof": { 2024-09-13T16:13:01.325 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_nvmeof", 2024-09-13T16:13:01.325 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.325 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.325 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.325 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-09-13T16:13:01.325 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.325 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.325 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.325 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Nvme-of container image", 2024-09-13T16:13:01.325 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.325 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.326 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.326 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_prometheus": { 2024-09-13T16:13:01.326 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_prometheus", 2024-09-13T16:13:01.326 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.326 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.326 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.326 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-13T16:13:01.326 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.326 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.326 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.327 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:01.327 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.327 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.327 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.327 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_promtail": { 2024-09-13T16:13:01.327 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_promtail", 2024-09-13T16:13:01.327 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.327 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.327 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.327 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-13T16:13:01.328 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.328 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.328 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.328 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Promtail container image", 2024-09-13T16:13:01.328 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.328 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.328 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.328 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_snmp_gateway": { 2024-09-13T16:13:01.328 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_snmp_gateway", 2024-09-13T16:13:01.328 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.329 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.329 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.329 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-13T16:13:01.329 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.329 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.329 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.329 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SNMP Gateway container image", 2024-09-13T16:13:01.329 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.329 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.329 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.330 INFO:teuthology.orchestra.run.smithi017.stdout: "container_init": { 2024-09-13T16:13:01.330 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_init", 2024-09-13T16:13:01.330 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.330 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.330 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.330 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.330 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.330 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.330 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.330 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Run podman/docker with `--init`", 2024-09-13T16:13:01.330 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.330 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.331 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.331 INFO:teuthology.orchestra.run.smithi017.stdout: "daemon_cache_timeout": { 2024-09-13T16:13:01.331 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "daemon_cache_timeout", 2024-09-13T16:13:01.331 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.331 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.331 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.331 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-13T16:13:01.331 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.331 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.331 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.332 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-13T16:13:01.332 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.332 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.332 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.332 INFO:teuthology.orchestra.run.smithi017.stdout: "default_cephadm_command_timeout": { 2024-09-13T16:13:01.332 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_cephadm_command_timeout", 2024-09-13T16:13:01.332 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.332 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.332 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.332 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "900", 2024-09-13T16:13:01.332 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.333 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.333 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.333 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-13T16:13:01.333 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.333 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.333 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.333 INFO:teuthology.orchestra.run.smithi017.stdout: "default_registry": { 2024-09-13T16:13:01.333 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_registry", 2024-09-13T16:13:01.333 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.333 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.334 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.334 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io", 2024-09-13T16:13:01.334 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.334 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.334 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.334 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-13T16:13:01.334 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.334 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.334 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.334 INFO:teuthology.orchestra.run.smithi017.stdout: "device_cache_timeout": { 2024-09-13T16:13:01.334 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_cache_timeout", 2024-09-13T16:13:01.335 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.335 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.335 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.335 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1800", 2024-09-13T16:13:01.335 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.335 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.335 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.335 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache device inventory", 2024-09-13T16:13:01.335 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.335 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.335 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.336 INFO:teuthology.orchestra.run.smithi017.stdout: "device_enhanced_scan": { 2024-09-13T16:13:01.336 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_enhanced_scan", 2024-09-13T16:13:01.336 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.336 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.336 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.336 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.336 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.336 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.336 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.336 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-13T16:13:01.337 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.337 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.337 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.337 INFO:teuthology.orchestra.run.smithi017.stdout: "facts_cache_timeout": { 2024-09-13T16:13:01.337 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "facts_cache_timeout", 2024-09-13T16:13:01.337 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.337 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.337 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.337 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-13T16:13:01.337 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.337 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.338 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.338 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache host facts data", 2024-09-13T16:13:01.338 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.338 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.338 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.338 INFO:teuthology.orchestra.run.smithi017.stdout: "host_check_interval": { 2024-09-13T16:13:01.338 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "host_check_interval", 2024-09-13T16:13:01.338 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.338 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.339 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.339 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-13T16:13:01.339 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.339 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.339 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.339 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to perform a host check", 2024-09-13T16:13:01.339 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.339 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.339 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.339 INFO:teuthology.orchestra.run.smithi017.stdout: "hw_monitoring": { 2024-09-13T16:13:01.340 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hw_monitoring", 2024-09-13T16:13:01.340 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.340 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.340 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.340 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.340 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.340 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.340 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.340 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-13T16:13:01.340 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.340 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.340 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.341 INFO:teuthology.orchestra.run.smithi017.stdout: "inventory_list_all": { 2024-09-13T16:13:01.341 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "inventory_list_all", 2024-09-13T16:13:01.341 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.341 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.341 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.341 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.341 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.341 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.341 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.341 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-13T16:13:01.342 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.342 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.342 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.342 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.342 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.342 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.342 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.342 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.342 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.342 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.343 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.343 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.343 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.343 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.343 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.343 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.343 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.343 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.343 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.343 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.343 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.344 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.344 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.344 INFO:teuthology.orchestra.run.smithi017.stdout: "log_refresh_metadata": { 2024-09-13T16:13:01.344 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_refresh_metadata", 2024-09-13T16:13:01.344 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.344 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.344 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.344 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.344 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.344 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.344 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.345 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-13T16:13:01.345 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.345 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.345 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.345 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.345 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.345 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.345 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.345 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.345 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.346 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.346 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.346 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.346 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-13T16:13:01.346 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.346 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.346 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.346 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.346 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.346 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.346 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.347 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.347 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.347 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.347 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.347 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.347 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.347 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.347 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.347 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.347 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.347 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.347 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.348 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.348 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.348 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.348 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.348 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.348 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.348 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.348 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.348 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.348 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.349 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.349 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.349 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.349 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.349 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.349 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.349 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.349 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-13T16:13:01.349 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-13T16:13:01.349 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.349 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.350 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.350 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.350 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.350 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.350 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.350 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-13T16:13:01.350 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.350 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.350 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.350 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-13T16:13:01.350 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-13T16:13:01.351 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.351 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.351 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.351 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "*", 2024-09-13T16:13:01.351 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.351 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.351 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.351 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-13T16:13:01.351 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.351 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.351 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.352 INFO:teuthology.orchestra.run.smithi017.stdout: "max_count_per_host": { 2024-09-13T16:13:01.352 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_count_per_host", 2024-09-13T16:13:01.352 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.352 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.352 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.352 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:01.352 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.352 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.352 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.352 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of daemons per service per host", 2024-09-13T16:13:01.352 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.353 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.353 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.353 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd_draining_count": { 2024-09-13T16:13:01.353 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_osd_draining_count", 2024-09-13T16:13:01.353 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.353 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.353 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.353 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:01.353 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.353 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.353 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.354 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-13T16:13:01.354 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.354 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.354 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.354 INFO:teuthology.orchestra.run.smithi017.stdout: "migration_current": { 2024-09-13T16:13:01.354 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "migration_current", 2024-09-13T16:13:01.354 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.354 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.354 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.355 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.355 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.355 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.355 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.355 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "internal - do not modify", 2024-09-13T16:13:01.355 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.355 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.355 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.355 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-13T16:13:01.355 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-13T16:13:01.355 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.356 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.356 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.356 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "root", 2024-09-13T16:13:01.356 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.356 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.356 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.356 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm-package", 2024-09-13T16:13:01.356 INFO:teuthology.orchestra.run.smithi017.stdout: "root" 2024-09-13T16:13:01.356 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.356 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "mode for remote execution of cephadm", 2024-09-13T16:13:01.356 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.357 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.357 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.357 INFO:teuthology.orchestra.run.smithi017.stdout: "oob_default_addr": { 2024-09-13T16:13:01.357 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "oob_default_addr", 2024-09-13T16:13:01.357 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.357 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.357 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.357 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "169.254.1.1", 2024-09-13T16:13:01.357 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.357 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.357 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.358 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-13T16:13:01.358 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.358 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.358 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.358 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_alerts_path": { 2024-09-13T16:13:01.358 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_alerts_path", 2024-09-13T16:13:01.358 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.358 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.358 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.358 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-13T16:13:01.359 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.359 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.359 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.359 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-13T16:13:01.359 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.359 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.359 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.359 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_insecure": { 2024-09-13T16:13:01.359 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_insecure", 2024-09-13T16:13:01.359 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.359 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.360 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.360 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.360 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.360 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.360 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.360 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-13T16:13:01.360 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.360 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.360 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.361 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_password": { 2024-09-13T16:13:01.361 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_password", 2024-09-13T16:13:01.361 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.361 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.361 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.361 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.361 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.361 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.361 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.361 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-13T16:13:01.361 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.362 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.362 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.362 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_url": { 2024-09-13T16:13:01.362 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_url", 2024-09-13T16:13:01.362 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.362 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.362 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.362 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.362 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.362 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.362 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.363 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-13T16:13:01.363 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.363 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.363 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.363 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_username": { 2024-09-13T16:13:01.363 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_username", 2024-09-13T16:13:01.363 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.363 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.363 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.363 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.364 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.364 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.364 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.364 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-13T16:13:01.364 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.364 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.364 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.364 INFO:teuthology.orchestra.run.smithi017.stdout: "secure_monitoring_stack": { 2024-09-13T16:13:01.364 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secure_monitoring_stack", 2024-09-13T16:13:01.364 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.365 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.365 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.365 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.365 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.365 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.365 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.365 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-13T16:13:01.365 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.365 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.365 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.365 INFO:teuthology.orchestra.run.smithi017.stdout: "service_discovery_port": { 2024-09-13T16:13:01.366 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "service_discovery_port", 2024-09-13T16:13:01.366 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.366 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.366 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.366 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8765", 2024-09-13T16:13:01.366 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.366 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.366 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.366 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "cephadm service discovery port", 2024-09-13T16:13:01.366 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.366 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.367 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.367 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_config_file": { 2024-09-13T16:13:01.367 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_config_file", 2024-09-13T16:13:01.367 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.367 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.367 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.367 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.367 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.367 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.367 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.367 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-13T16:13:01.368 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.368 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.368 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.368 INFO:teuthology.orchestra.run.smithi017.stdout: "use_agent": { 2024-09-13T16:13:01.368 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_agent", 2024-09-13T16:13:01.368 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.368 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.368 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.368 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.368 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.369 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.369 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.369 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-13T16:13:01.369 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.369 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.369 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.369 INFO:teuthology.orchestra.run.smithi017.stdout: "use_repo_digest": { 2024-09-13T16:13:01.369 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_repo_digest", 2024-09-13T16:13:01.369 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.369 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.370 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.370 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.370 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.370 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.370 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.370 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-13T16:13:01.370 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.370 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.370 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.370 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_failed_host_check": { 2024-09-13T16:13:01.371 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_failed_host_check", 2024-09-13T16:13:01.371 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.371 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.371 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.371 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.371 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.371 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.371 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.371 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if the host check fails", 2024-09-13T16:13:01.371 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.371 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.371 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.372 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_daemons": { 2024-09-13T16:13:01.372 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_daemons", 2024-09-13T16:13:01.372 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.372 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.372 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.372 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.372 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.372 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.372 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.372 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-13T16:13:01.373 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.373 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.373 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.373 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_hosts": { 2024-09-13T16:13:01.373 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_hosts", 2024-09-13T16:13:01.373 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.373 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.373 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.373 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.373 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.374 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.374 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.374 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-13T16:13:01.374 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.374 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.374 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.374 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.374 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.374 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crash", 2024-09-13T16:13:01.375 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.375 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.375 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.375 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.375 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.375 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.375 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.375 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.375 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.375 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.375 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.375 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.376 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.376 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.376 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.376 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.376 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.376 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.376 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.376 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.376 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.376 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.377 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.377 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.377 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.377 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.377 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.377 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.377 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.377 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.377 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.377 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.378 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.378 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.378 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.378 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.378 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.378 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.378 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.378 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.378 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.378 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.378 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.379 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.379 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.379 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.379 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.379 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.379 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.379 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.379 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.379 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.379 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.379 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.379 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.380 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.380 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.380 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.380 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.380 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.380 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.380 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.380 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.380 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.380 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.380 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.381 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.381 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.381 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.381 INFO:teuthology.orchestra.run.smithi017.stdout: "retain_interval": { 2024-09-13T16:13:01.381 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retain_interval", 2024-09-13T16:13:01.381 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.381 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.381 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.381 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "31536000", 2024-09-13T16:13:01.381 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.382 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.382 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.382 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-13T16:13:01.382 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.382 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.382 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.382 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_recent_interval": { 2024-09-13T16:13:01.382 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_recent_interval", 2024-09-13T16:13:01.382 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.382 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.382 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.383 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1209600", 2024-09-13T16:13:01.383 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.383 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.383 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.383 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-13T16:13:01.383 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.383 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.383 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.383 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.383 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.384 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dashboard", 2024-09-13T16:13:01.384 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.384 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.384 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.384 INFO:teuthology.orchestra.run.smithi017.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-13T16:13:01.384 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-13T16:13:01.384 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.384 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.384 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.384 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:01.384 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.384 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.385 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.385 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.385 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.385 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.385 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.385 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_HOST": { 2024-09-13T16:13:01.385 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-13T16:13:01.385 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.385 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.386 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.386 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.386 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.386 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.386 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.386 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.386 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.386 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.386 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.386 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-13T16:13:01.386 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-13T16:13:01.387 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.387 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.387 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.387 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.387 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.387 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.387 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.387 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.387 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.387 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.387 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.388 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_ENABLED": { 2024-09-13T16:13:01.388 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_ENABLED", 2024-09-13T16:13:01.388 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.388 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.388 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.388 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.388 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.388 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.388 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.388 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.388 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.389 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.389 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.389 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-13T16:13:01.389 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-13T16:13:01.389 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.389 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.389 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.389 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.389 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.389 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.389 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.390 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.390 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.390 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.390 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.390 INFO:teuthology.orchestra.run.smithi017.stdout: "ENABLE_BROWSABLE_API": { 2024-09-13T16:13:01.390 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-13T16:13:01.390 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.390 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.390 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.390 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.391 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.391 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.391 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.391 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.391 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.391 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.391 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.391 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-13T16:13:01.391 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-13T16:13:01.391 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.391 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.392 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.392 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.392 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.392 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.392 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.392 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.392 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.392 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.392 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.392 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-13T16:13:01.393 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-13T16:13:01.393 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.393 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.393 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.393 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.393 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.393 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.393 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.393 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.393 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.393 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.393 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.394 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-13T16:13:01.394 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-13T16:13:01.394 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.394 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.394 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.394 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.394 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.394 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.394 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.394 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.395 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.395 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.395 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.395 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-13T16:13:01.395 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-13T16:13:01.395 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.395 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.395 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.395 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.395 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.395 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.396 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.396 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.396 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.396 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.396 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.396 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-13T16:13:01.396 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-13T16:13:01.396 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.396 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.396 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.396 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.397 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.397 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.397 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.397 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.397 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.397 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.397 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.397 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-13T16:13:01.397 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-13T16:13:01.397 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.398 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.398 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.398 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.398 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.398 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.398 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.398 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.398 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.398 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.398 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.398 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-13T16:13:01.399 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-13T16:13:01.399 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.399 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.399 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.399 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.399 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.399 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.399 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.399 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.399 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.399 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.400 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.400 INFO:teuthology.orchestra.run.smithi017.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-13T16:13:01.400 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-13T16:13:01.400 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.400 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.400 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.400 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.400 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.400 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.400 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.400 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.401 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.401 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.401 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.401 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_PASSWORD": { 2024-09-13T16:13:01.401 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-13T16:13:01.401 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.401 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.401 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.401 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-13T16:13:01.402 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.402 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.402 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.402 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.402 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.402 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.402 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.402 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-13T16:13:01.402 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-13T16:13:01.402 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.402 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.403 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.403 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.403 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.403 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.403 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.403 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.403 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.403 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.403 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.403 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_URL": { 2024-09-13T16:13:01.403 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_URL", 2024-09-13T16:13:01.404 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.404 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.404 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.404 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.404 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.404 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.404 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.404 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.404 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.404 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.404 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.405 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_USERNAME": { 2024-09-13T16:13:01.405 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-13T16:13:01.405 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.405 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.405 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.405 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-13T16:13:01.405 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.405 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.405 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.405 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.405 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.406 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.406 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.406 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-13T16:13:01.406 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-13T16:13:01.406 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.406 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.406 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.406 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.406 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.406 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.407 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.407 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.407 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.407 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.407 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.407 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-13T16:13:01.407 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-13T16:13:01.407 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.407 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.407 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.408 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.408 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.408 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.408 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.408 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.408 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.408 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.408 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.408 INFO:teuthology.orchestra.run.smithi017.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-13T16:13:01.408 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-13T16:13:01.408 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.409 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.409 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.409 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.409 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.409 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.409 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.409 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.409 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.409 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.409 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.410 INFO:teuthology.orchestra.run.smithi017.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-13T16:13:01.410 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-13T16:13:01.410 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.410 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.410 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.410 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.410 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.410 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.410 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.410 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.410 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.411 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.411 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.411 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_HOST": { 2024-09-13T16:13:01.411 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-13T16:13:01.411 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.411 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.411 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.411 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.411 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.411 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.412 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.412 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.412 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.412 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.412 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.412 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-13T16:13:01.412 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-13T16:13:01.412 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.412 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.412 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.413 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.413 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.413 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.413 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.413 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.413 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.413 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.413 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.413 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-13T16:13:01.413 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-13T16:13:01.413 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.415 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-13T16:13:01.415 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-13T16:13:01.415 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.415 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.415 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.415 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.415 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.415 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.415 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.415 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.415 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.416 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.416 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.416 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-13T16:13:01.416 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-13T16:13:01.416 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.416 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.416 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.416 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.416 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.416 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.417 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.417 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.417 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.417 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.417 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.417 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-13T16:13:01.417 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-13T16:13:01.417 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.417 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.417 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.418 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.418 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.418 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.418 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.418 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.418 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.418 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.418 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.418 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-13T16:13:01.418 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-13T16:13:01.418 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.419 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.419 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.419 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.419 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.419 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.419 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.419 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.419 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.419 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.419 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.420 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-13T16:13:01.420 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-13T16:13:01.420 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.420 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.420 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.420 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.420 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.420 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.420 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.420 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.420 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.420 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.421 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.421 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-13T16:13:01.421 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-13T16:13:01.421 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.421 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.421 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.421 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.421 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.421 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.421 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.421 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.422 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.422 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.422 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.422 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_ENABLED": { 2024-09-13T16:13:01.422 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-13T16:13:01.422 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.422 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.422 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.422 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.422 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.423 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.423 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.423 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.423 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.423 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.423 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.423 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-13T16:13:01.423 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-13T16:13:01.423 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.423 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.424 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.424 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-13T16:13:01.424 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.424 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.424 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.424 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.424 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.424 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.424 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.424 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-13T16:13:01.425 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-13T16:13:01.425 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.425 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.425 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.425 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:01.425 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.425 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.425 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.425 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.425 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.425 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.425 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.426 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-13T16:13:01.426 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-13T16:13:01.426 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.426 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.426 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.426 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8", 2024-09-13T16:13:01.426 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.426 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.426 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.426 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.427 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.427 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.427 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.427 INFO:teuthology.orchestra.run.smithi017.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-13T16:13:01.427 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-13T16:13:01.427 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.427 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.427 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.427 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "45", 2024-09-13T16:13:01.427 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.427 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.428 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.428 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.428 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.428 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.428 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.428 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ACCESS_KEY": { 2024-09-13T16:13:01.428 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-13T16:13:01.428 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.428 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.428 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.429 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.429 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.429 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.429 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.429 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.429 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.429 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.429 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.429 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-13T16:13:01.429 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-13T16:13:01.429 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.430 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.430 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.430 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-13T16:13:01.430 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.430 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.430 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.430 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.430 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.430 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.430 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.430 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SECRET_KEY": { 2024-09-13T16:13:01.431 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-13T16:13:01.431 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.431 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.431 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.431 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.431 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.431 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.431 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.431 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.431 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.431 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.432 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.432 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SSL_VERIFY": { 2024-09-13T16:13:01.432 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-13T16:13:01.432 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.432 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.432 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.432 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.432 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.432 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.433 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.433 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.433 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.433 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.433 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.433 INFO:teuthology.orchestra.run.smithi017.stdout: "UNSAFE_TLS_v1_2": { 2024-09-13T16:13:01.433 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-13T16:13:01.433 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.434 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.434 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.434 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.434 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.434 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.434 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.434 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.434 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.434 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.434 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.435 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-13T16:13:01.435 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-13T16:13:01.435 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.435 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.435 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.435 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-13T16:13:01.435 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.435 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.435 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.436 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.436 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.436 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.436 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.436 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-13T16:13:01.436 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-13T16:13:01.436 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.436 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.436 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.436 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:01.437 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.437 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.437 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.437 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.437 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.437 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.437 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.437 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-13T16:13:01.437 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-13T16:13:01.437 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.438 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.438 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.438 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-13T16:13:01.438 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.438 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.438 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.438 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.438 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.438 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.438 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.439 INFO:teuthology.orchestra.run.smithi017.stdout: "cross_origin_url": { 2024-09-13T16:13:01.439 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cross_origin_url", 2024-09-13T16:13:01.439 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.439 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.439 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.439 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.439 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.439 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.439 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.439 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.439 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.440 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.440 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.440 INFO:teuthology.orchestra.run.smithi017.stdout: "crt_file": { 2024-09-13T16:13:01.440 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crt_file", 2024-09-13T16:13:01.440 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.440 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.440 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.440 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.440 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.440 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.441 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.441 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.441 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.441 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.441 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.441 INFO:teuthology.orchestra.run.smithi017.stdout: "debug": { 2024-09-13T16:13:01.441 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "debug", 2024-09-13T16:13:01.441 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.441 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.441 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.442 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.442 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.442 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.442 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.442 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable/disable debug options", 2024-09-13T16:13:01.442 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.442 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.442 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.442 INFO:teuthology.orchestra.run.smithi017.stdout: "jwt_token_ttl": { 2024-09-13T16:13:01.442 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "jwt_token_ttl", 2024-09-13T16:13:01.442 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.443 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.443 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.443 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "28800", 2024-09-13T16:13:01.443 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.443 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.443 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.443 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.443 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.443 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.443 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.444 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-13T16:13:01.444 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-13T16:13:01.444 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.444 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.444 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.444 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.444 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.444 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.444 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.444 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.444 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.444 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.445 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.445 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.445 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.445 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.445 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.445 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.445 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.445 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.445 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.445 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.445 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.446 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.446 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.446 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.446 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.446 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.446 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.446 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.446 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.446 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.446 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.447 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.447 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.447 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.447 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.447 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.447 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.447 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.447 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.447 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.447 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.447 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.447 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.448 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.448 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.448 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.448 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.448 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.448 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.448 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.448 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.448 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.448 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.449 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.449 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.449 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.449 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.449 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.449 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.449 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.449 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.449 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.449 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.449 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.450 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.450 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.450 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.450 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.450 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.450 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.450 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.450 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.450 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.450 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.450 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.451 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.451 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.451 INFO:teuthology.orchestra.run.smithi017.stdout: "motd": { 2024-09-13T16:13:01.451 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "motd", 2024-09-13T16:13:01.451 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.451 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.451 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.451 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.451 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.451 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.452 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.452 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "The message of the day", 2024-09-13T16:13:01.452 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.452 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.452 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.452 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect_resolve_ip_addr": { 2024-09-13T16:13:01.452 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "redirect_resolve_ip_addr", 2024-09-13T16:13:01.452 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.452 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.452 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.453 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.453 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.453 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.453 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.453 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.453 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.453 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.453 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.453 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-13T16:13:01.453 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-13T16:13:01.453 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.454 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.454 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.454 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-13T16:13:01.454 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.454 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.454 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.454 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.454 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.454 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.454 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.454 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-13T16:13:01.455 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-13T16:13:01.455 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.455 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.455 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.455 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8080", 2024-09-13T16:13:01.455 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.455 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.455 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.455 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.455 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.455 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.455 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.456 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-13T16:13:01.456 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-13T16:13:01.456 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.456 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.456 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.456 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.456 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.456 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.456 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.456 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.457 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.457 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.457 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.457 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl_server_port": { 2024-09-13T16:13:01.457 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl_server_port", 2024-09-13T16:13:01.457 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.457 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.457 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.457 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8443", 2024-09-13T16:13:01.457 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.457 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.458 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.458 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.458 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.458 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.458 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.458 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-13T16:13:01.458 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-13T16:13:01.458 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.458 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.458 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.459 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "redirect", 2024-09-13T16:13:01.459 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.459 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.459 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.459 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.459 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect" 2024-09-13T16:13:01.459 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.459 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.459 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.459 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.459 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.460 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-13T16:13:01.460 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-13T16:13:01.460 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.460 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.460 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.460 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-13T16:13:01.460 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-13T16:13:01.460 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-13T16:13:01.460 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.460 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.460 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.460 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.461 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.461 INFO:teuthology.orchestra.run.smithi017.stdout: "url_prefix": { 2024-09-13T16:13:01.461 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url_prefix", 2024-09-13T16:13:01.461 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.461 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.461 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.461 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.461 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.461 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.461 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.461 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.462 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.462 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.462 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.462 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2024-09-13T16:13:01.462 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.462 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.462 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.462 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_monitoring": { 2024-09-13T16:13:01.463 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_monitoring", 2024-09-13T16:13:01.463 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.463 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.463 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.463 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.463 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.463 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.463 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.463 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "monitor device health metrics", 2024-09-13T16:13:01.463 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.463 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.464 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.464 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.464 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.464 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.464 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.464 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.464 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.464 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.464 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.464 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.464 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.465 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.465 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.465 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.465 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.465 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.465 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.465 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.465 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.465 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.465 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.465 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.466 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.466 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.466 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.466 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.466 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.466 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.466 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.466 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.466 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.466 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.466 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.466 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.467 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.467 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.467 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.467 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.467 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.467 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.467 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.467 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.467 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.468 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.468 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.468 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.468 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.468 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.468 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.468 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.468 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.468 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.468 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.468 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.469 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.469 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.469 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.469 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.469 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.469 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.469 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.469 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.469 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.469 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.470 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.470 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.470 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.470 INFO:teuthology.orchestra.run.smithi017.stdout: "mark_out_threshold": { 2024-09-13T16:13:01.470 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mark_out_threshold", 2024-09-13T16:13:01.470 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.470 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.470 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.470 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2419200", 2024-09-13T16:13:01.470 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.471 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.471 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.471 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-13T16:13:01.471 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.471 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.471 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.471 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": { 2024-09-13T16:13:01.471 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_name", 2024-09-13T16:13:01.471 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.471 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.471 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.472 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "device_health_metrics", 2024-09-13T16:13:01.472 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.472 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.472 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.472 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-13T16:13:01.472 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.472 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.472 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.472 INFO:teuthology.orchestra.run.smithi017.stdout: "retention_period": { 2024-09-13T16:13:01.472 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retention_period", 2024-09-13T16:13:01.473 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.473 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.473 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.473 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15552000", 2024-09-13T16:13:01.473 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.473 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.473 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.473 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain device health metrics", 2024-09-13T16:13:01.473 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.473 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.474 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.474 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_frequency": { 2024-09-13T16:13:01.474 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_frequency", 2024-09-13T16:13:01.474 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.474 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.474 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.474 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-13T16:13:01.474 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.474 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.474 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.475 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-13T16:13:01.475 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.475 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.475 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.475 INFO:teuthology.orchestra.run.smithi017.stdout: "self_heal": { 2024-09-13T16:13:01.475 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "self_heal", 2024-09-13T16:13:01.475 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.475 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.475 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.475 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.476 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.476 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.476 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.476 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-13T16:13:01.476 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.476 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.476 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.476 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-13T16:13:01.476 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-13T16:13:01.476 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.476 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.477 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.477 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-13T16:13:01.477 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.477 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.477 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.477 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and check device health", 2024-09-13T16:13:01.477 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.477 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.477 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.477 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_threshold": { 2024-09-13T16:13:01.477 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_threshold", 2024-09-13T16:13:01.478 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.478 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.478 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.478 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7257600", 2024-09-13T16:13:01.478 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.478 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.478 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.478 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-13T16:13:01.478 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.478 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.478 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.479 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.479 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.479 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "diskprediction_local", 2024-09-13T16:13:01.479 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.479 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.479 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.479 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.479 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.479 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.479 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.480 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.480 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.480 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.480 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.480 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.480 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.480 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.480 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.480 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.480 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.480 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.481 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.481 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.481 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.481 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.481 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.481 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.481 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.481 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.481 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.481 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.481 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.482 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.482 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.482 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.482 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.482 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.482 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.482 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.482 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.482 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.482 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.483 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.483 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.483 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.483 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.483 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.483 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.483 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.483 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.483 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.483 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.483 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.483 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.484 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.484 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.484 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.484 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.484 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.484 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.484 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.484 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.484 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.485 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.485 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.485 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.485 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.485 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.485 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.485 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.485 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.485 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.485 INFO:teuthology.orchestra.run.smithi017.stdout: "predict_interval": { 2024-09-13T16:13:01.486 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predict_interval", 2024-09-13T16:13:01.486 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.486 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.486 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.486 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-13T16:13:01.486 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.486 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.486 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.486 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.486 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.486 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.487 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.487 INFO:teuthology.orchestra.run.smithi017.stdout: "predictor_model": { 2024-09-13T16:13:01.487 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predictor_model", 2024-09-13T16:13:01.487 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.487 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.487 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.487 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "prophetstor", 2024-09-13T16:13:01.487 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.487 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.487 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.487 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.488 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.488 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.488 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.488 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-13T16:13:01.488 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-13T16:13:01.488 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.488 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.488 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.488 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-13T16:13:01.488 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.489 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.489 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.489 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.489 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.489 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.489 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.489 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.489 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.489 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "influx", 2024-09-13T16:13:01.489 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": false, 2024-09-13T16:13:01.490 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "influxdb python module not found", 2024-09-13T16:13:01.490 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.490 INFO:teuthology.orchestra.run.smithi017.stdout: "batch_size": { 2024-09-13T16:13:01.490 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "batch_size", 2024-09-13T16:13:01.490 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.490 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.490 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.490 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5000", 2024-09-13T16:13:01.490 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.490 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.490 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.490 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-13T16:13:01.491 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.491 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.491 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.491 INFO:teuthology.orchestra.run.smithi017.stdout: "database": { 2024-09-13T16:13:01.491 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "database", 2024-09-13T16:13:01.491 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.491 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.491 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.491 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "ceph", 2024-09-13T16:13:01.491 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.492 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.492 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.492 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-13T16:13:01.492 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.492 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.492 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.492 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": { 2024-09-13T16:13:01.492 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hostname", 2024-09-13T16:13:01.492 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.492 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.493 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.493 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.493 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.493 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.493 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.493 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server hostname", 2024-09-13T16:13:01.493 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.493 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.493 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.493 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-13T16:13:01.493 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-13T16:13:01.494 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.494 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.494 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.494 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "30", 2024-09-13T16:13:01.494 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "5", 2024-09-13T16:13:01.494 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.494 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.494 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-13T16:13:01.494 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.494 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.494 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.495 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.495 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.495 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.495 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.495 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.495 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.495 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.495 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.495 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.495 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.495 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.495 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.496 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.496 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.496 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.496 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.496 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.496 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.496 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.496 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.496 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.496 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.496 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.497 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.497 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.497 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.497 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.497 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.497 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.497 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.497 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.497 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.497 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.498 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.498 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.498 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.498 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.498 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.498 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.498 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.498 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.498 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.498 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.498 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.498 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.498 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.499 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.499 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.499 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.499 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.499 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.499 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.499 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.499 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.499 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.499 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.499 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.500 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.500 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.500 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.500 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.500 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.500 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.500 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.500 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.500 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.501 INFO:teuthology.orchestra.run.smithi017.stdout: "password": { 2024-09-13T16:13:01.501 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "password", 2024-09-13T16:13:01.501 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.501 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.501 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.501 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.501 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.501 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.501 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.501 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "password of InfluxDB server user", 2024-09-13T16:13:01.501 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.501 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.502 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.502 INFO:teuthology.orchestra.run.smithi017.stdout: "port": { 2024-09-13T16:13:01.502 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "port", 2024-09-13T16:13:01.502 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.502 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.502 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.502 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8086", 2024-09-13T16:13:01.502 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.502 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.502 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.503 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server port", 2024-09-13T16:13:01.503 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.503 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.503 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.503 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-13T16:13:01.503 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-13T16:13:01.503 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.503 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.503 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.503 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "false", 2024-09-13T16:13:01.503 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.504 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.504 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.504 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T16:13:01.504 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.504 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.504 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.504 INFO:teuthology.orchestra.run.smithi017.stdout: "threads": { 2024-09-13T16:13:01.504 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threads", 2024-09-13T16:13:01.504 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.504 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.505 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.505 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-13T16:13:01.505 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-13T16:13:01.505 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "32", 2024-09-13T16:13:01.505 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.505 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-13T16:13:01.505 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.505 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.505 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.505 INFO:teuthology.orchestra.run.smithi017.stdout: "username": { 2024-09-13T16:13:01.505 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "username", 2024-09-13T16:13:01.506 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.506 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.506 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.506 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.506 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.506 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.506 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.506 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "username of InfluxDB server user", 2024-09-13T16:13:01.506 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.506 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.506 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.507 INFO:teuthology.orchestra.run.smithi017.stdout: "verify_ssl": { 2024-09-13T16:13:01.507 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "verify_ssl", 2024-09-13T16:13:01.507 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.507 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.507 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.507 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "true", 2024-09-13T16:13:01.507 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.507 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.507 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.507 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T16:13:01.508 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.508 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.508 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.508 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.508 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.508 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "insights", 2024-09-13T16:13:01.508 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.508 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.508 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.508 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.509 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.509 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.509 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.509 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.509 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.509 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.509 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.509 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.509 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.509 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.510 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.510 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.510 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.510 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.510 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.510 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.510 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.510 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.510 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.510 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.510 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.511 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.511 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.511 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.511 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.511 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.511 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.511 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.511 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.511 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.511 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.511 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.512 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.512 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.512 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.512 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.512 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.512 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.512 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.512 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.512 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.512 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.512 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.512 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.513 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.513 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.513 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.513 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.513 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.513 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.513 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.513 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.513 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.513 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.514 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.514 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.514 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.514 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.514 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.514 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.514 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.514 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.514 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.514 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.514 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.515 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.515 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.515 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "iostat", 2024-09-13T16:13:01.515 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.515 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.515 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.515 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.515 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.515 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.516 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.516 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.516 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.516 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.516 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.516 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.516 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.516 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.516 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.516 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.516 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.517 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.517 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.517 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.517 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.517 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.517 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.517 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.517 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.517 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.517 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.518 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.518 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.518 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.518 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.518 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.518 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.518 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.518 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.518 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.518 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.519 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.519 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.519 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.519 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.519 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.519 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.519 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.519 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.519 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.519 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.519 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.520 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.520 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.520 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.520 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.520 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.520 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.520 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.520 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.520 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.521 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.521 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.521 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.521 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.521 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.521 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.521 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.521 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.521 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.521 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.521 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.522 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.522 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.522 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.522 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "k8sevents", 2024-09-13T16:13:01.522 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.522 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.522 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.522 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_event_retention_days": { 2024-09-13T16:13:01.522 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ceph_event_retention_days", 2024-09-13T16:13:01.522 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.523 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.523 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.523 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2024-09-13T16:13:01.523 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.523 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.523 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.523 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-13T16:13:01.523 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.523 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.523 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.523 INFO:teuthology.orchestra.run.smithi017.stdout: "config_check_secs": { 2024-09-13T16:13:01.524 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_check_secs", 2024-09-13T16:13:01.524 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.524 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.524 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.524 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:01.524 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "10", 2024-09-13T16:13:01.524 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.524 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.524 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-13T16:13:01.524 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.525 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.525 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.525 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.525 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.525 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.525 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.525 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.525 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.525 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.525 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.525 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.526 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.526 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.526 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.526 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.526 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.526 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.526 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.526 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.526 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.526 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.526 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.527 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.527 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.528 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.528 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.528 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.528 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.528 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.528 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.528 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.528 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.528 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.529 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.529 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.529 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.529 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.529 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.529 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.529 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.529 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.529 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.529 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.530 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.530 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.530 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.530 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.530 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.530 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.530 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.530 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.530 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.530 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.530 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.530 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.531 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.531 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.531 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.531 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.531 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.531 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.531 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.531 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.531 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.531 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.531 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.532 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.532 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.532 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.532 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.532 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "localpool", 2024-09-13T16:13:01.532 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.532 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.532 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.532 INFO:teuthology.orchestra.run.smithi017.stdout: "failure_domain": { 2024-09-13T16:13:01.533 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "failure_domain", 2024-09-13T16:13:01.533 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.533 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.533 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.533 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "host", 2024-09-13T16:13:01.533 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.533 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.533 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.533 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "failure domain for any created local pool", 2024-09-13T16:13:01.533 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-13T16:13:01.533 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.533 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.534 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.534 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.534 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.534 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.534 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.534 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.534 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.534 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.534 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.534 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.535 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.535 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.535 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.535 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.535 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.535 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.535 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.535 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.535 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.535 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.535 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.536 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.536 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.536 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.536 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.536 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.536 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.536 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.536 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.536 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.536 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.536 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.537 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.537 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.537 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.537 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.537 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.537 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.537 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.537 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.537 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.537 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.537 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.538 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.538 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.538 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.538 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.538 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.538 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.538 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.538 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.538 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.538 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.539 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.539 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.539 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.539 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.539 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.539 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.539 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.539 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.539 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.539 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.539 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.540 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.540 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.540 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": { 2024-09-13T16:13:01.540 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_size", 2024-09-13T16:13:01.540 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.540 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.540 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.540 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.540 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.540 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.541 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.541 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default min_size for any created local pool", 2024-09-13T16:13:01.541 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-13T16:13:01.541 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.541 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.541 INFO:teuthology.orchestra.run.smithi017.stdout: "num_rep": { 2024-09-13T16:13:01.541 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "num_rep", 2024-09-13T16:13:01.541 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.541 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.541 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.541 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2024-09-13T16:13:01.542 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.542 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.542 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.542 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default replica count for any created local pool", 2024-09-13T16:13:01.542 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.542 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.542 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.542 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": { 2024-09-13T16:13:01.542 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_num", 2024-09-13T16:13:01.542 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.543 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.543 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.543 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "128", 2024-09-13T16:13:01.543 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.543 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.543 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.543 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default pg_num for any created local pool", 2024-09-13T16:13:01.543 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.543 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.543 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.543 INFO:teuthology.orchestra.run.smithi017.stdout: "prefix": { 2024-09-13T16:13:01.544 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prefix", 2024-09-13T16:13:01.544 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.544 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.544 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.544 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.544 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.544 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.544 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.544 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name prefix for any created local pool", 2024-09-13T16:13:01.544 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.545 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.545 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.545 INFO:teuthology.orchestra.run.smithi017.stdout: "subtree": { 2024-09-13T16:13:01.545 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "subtree", 2024-09-13T16:13:01.545 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.545 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.545 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.545 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "rack", 2024-09-13T16:13:01.545 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.545 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.545 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.546 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-13T16:13:01.546 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-13T16:13:01.546 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.546 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.546 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.546 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.546 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mds_autoscaler", 2024-09-13T16:13:01.546 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.546 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.547 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.547 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.547 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.547 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.547 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.547 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.547 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.547 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.547 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.547 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.547 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.547 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.548 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.548 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.548 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.548 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.548 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.548 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.548 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.548 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.548 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.548 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.549 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.549 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.549 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.549 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.549 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.549 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.549 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.549 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.549 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.549 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.549 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.550 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.550 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.550 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.550 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.550 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.550 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.550 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.550 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.550 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.550 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.550 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.551 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.551 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.551 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.551 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.551 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.551 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.551 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.551 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.552 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.552 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.552 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.552 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.552 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.552 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.552 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.552 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.552 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.553 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.553 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.553 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.553 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.553 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.553 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.553 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.553 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.553 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirroring", 2024-09-13T16:13:01.554 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.554 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.554 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.554 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.554 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.554 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.554 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.554 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.554 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.554 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.554 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.554 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.555 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.555 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.555 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.555 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.555 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.555 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.555 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.555 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.555 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.555 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.555 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.556 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.556 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.556 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.556 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.556 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.556 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.556 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.556 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.556 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.556 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.557 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.557 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.557 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.557 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.557 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.557 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.557 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.557 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.557 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.557 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.557 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.558 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.558 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.558 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.558 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.558 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.558 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.558 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.558 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.558 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.558 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.558 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.559 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.559 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.559 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.559 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.559 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.559 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.559 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.559 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.559 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.559 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.559 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.560 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.560 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.560 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.560 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.560 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.560 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "nfs", 2024-09-13T16:13:01.560 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.560 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.560 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.561 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.561 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.561 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.561 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.561 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.561 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.561 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.561 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.561 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.561 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.561 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.561 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.562 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.562 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.562 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.562 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.562 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.562 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.562 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.562 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.562 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.562 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.562 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.563 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.563 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.563 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.563 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.563 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.563 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.563 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.563 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.563 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.563 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.564 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.564 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.564 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.564 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.564 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.564 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.564 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.564 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.564 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.564 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.564 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.565 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.565 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.565 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.565 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.565 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.565 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.565 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.565 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.565 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.565 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.565 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.566 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.566 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.566 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.566 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.566 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.566 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.566 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.566 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.566 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.566 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.566 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.567 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.567 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.567 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-13T16:13:01.567 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.567 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.567 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.567 INFO:teuthology.orchestra.run.smithi017.stdout: "fail_fs": { 2024-09-13T16:13:01.567 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "fail_fs", 2024-09-13T16:13:01.567 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.567 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.568 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.568 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.568 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.568 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.568 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.568 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-13T16:13:01.568 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.568 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.568 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.568 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.568 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.569 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.569 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.569 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.569 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.569 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.569 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.569 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.569 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.569 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.569 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.570 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.570 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.570 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.570 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.570 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.570 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.570 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.570 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.570 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.570 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.570 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.571 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.571 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.571 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.571 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.571 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.571 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.571 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.571 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.571 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.571 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.572 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.572 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.572 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.572 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.572 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.572 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.572 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.572 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.572 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.572 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.572 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.572 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.573 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.573 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.573 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.573 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.573 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.573 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.573 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.573 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.573 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.573 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.574 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.574 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.574 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.574 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.574 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.574 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.574 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.574 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.574 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.574 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.574 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.575 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator": { 2024-09-13T16:13:01.575 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-13T16:13:01.575 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.575 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.575 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.575 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.575 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.575 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.575 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.575 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2024-09-13T16:13:01.575 INFO:teuthology.orchestra.run.smithi017.stdout: "rook", 2024-09-13T16:13:01.576 INFO:teuthology.orchestra.run.smithi017.stdout: "test_orchestrator" 2024-09-13T16:13:01.576 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.576 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Orchestrator backend", 2024-09-13T16:13:01.576 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.576 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.576 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.576 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.576 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.576 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_perf_query", 2024-09-13T16:13:01.577 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.577 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.577 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.577 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.577 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.577 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.577 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.577 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.577 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.577 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.577 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.578 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.578 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.578 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.578 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.578 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.578 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.578 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.578 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.578 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.578 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.578 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.579 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.579 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.579 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.579 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.579 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.579 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.579 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.579 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.579 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.579 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.579 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.580 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.580 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.580 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.580 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.580 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.580 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.580 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.580 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.580 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.580 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.581 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.581 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.581 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.581 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.581 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.581 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.581 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.581 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.581 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.581 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.581 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.582 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.582 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.582 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.582 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.582 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.582 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.582 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.582 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.582 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.582 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.583 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.583 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.583 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.583 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.583 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.583 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.583 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.583 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_support", 2024-09-13T16:13:01.583 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.583 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.584 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.584 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.584 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.584 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.584 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.584 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.584 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.584 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.584 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.584 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.584 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.584 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.585 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.585 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.585 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.585 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.585 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.585 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.585 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.585 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.585 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.585 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.586 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.586 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.586 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.586 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.586 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.586 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.586 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.586 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.586 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.586 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.586 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.587 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.587 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.587 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.587 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.587 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.587 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.587 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.587 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.587 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.587 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.588 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.588 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.588 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.588 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.588 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.588 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.588 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.588 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.588 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.588 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.588 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.589 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.589 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.589 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.589 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.589 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.589 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.589 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.589 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.589 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.590 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.590 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.590 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.590 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.590 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.590 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.590 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_autoscaler", 2024-09-13T16:13:01.590 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.590 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.591 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.591 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.591 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.591 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.591 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.591 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.591 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.591 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.591 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.591 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.591 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.592 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.592 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.592 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.592 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.592 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.592 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.592 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.592 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.592 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.592 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.593 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.593 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.593 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.593 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.593 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.593 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.593 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.593 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.593 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.593 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.593 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.594 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.594 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.594 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.594 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.594 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.594 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.594 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.594 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.594 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.594 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.595 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.595 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.595 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.595 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.595 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.595 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.595 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.595 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.595 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.595 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.596 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.596 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.596 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.596 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.596 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.596 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.596 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.596 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.596 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.596 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.597 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.597 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.597 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.597 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.597 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.597 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-13T16:13:01.597 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-13T16:13:01.597 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.597 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.597 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.598 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-13T16:13:01.598 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.598 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.598 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.598 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.598 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.598 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.598 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.598 INFO:teuthology.orchestra.run.smithi017.stdout: "threshold": { 2024-09-13T16:13:01.598 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threshold", 2024-09-13T16:13:01.599 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-13T16:13:01.599 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.599 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.599 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-13T16:13:01.599 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1.0", 2024-09-13T16:13:01.599 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.599 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.599 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "scaling threshold", 2024-09-13T16:13:01.599 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-13T16:13:01.599 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.599 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.599 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.600 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.600 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "progress", 2024-09-13T16:13:01.600 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.600 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.600 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.600 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_pg_recovery_event": { 2024-09-13T16:13:01.600 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_pg_recovery_event", 2024-09-13T16:13:01.600 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.600 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.601 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.601 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.601 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.601 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.601 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.601 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-13T16:13:01.601 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.601 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.601 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.601 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-13T16:13:01.602 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-13T16:13:01.602 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.602 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.602 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.602 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.602 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.602 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.602 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.602 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.602 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.602 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.602 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.603 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.603 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.603 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.603 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.603 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.603 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.603 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.603 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.603 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.603 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.603 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.604 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.604 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.604 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.604 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.604 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.604 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.604 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.604 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.604 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.604 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.605 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.605 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.605 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.605 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.605 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.605 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.605 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.605 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.605 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.605 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.605 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.606 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.606 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.606 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.606 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.606 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.606 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.606 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.606 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.606 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.606 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.606 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.607 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.607 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.607 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.607 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.607 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.607 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.607 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.607 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.607 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.607 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.608 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.608 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.608 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.608 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.608 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.608 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.608 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.608 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.608 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.608 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.608 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.609 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.609 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.609 INFO:teuthology.orchestra.run.smithi017.stdout: "max_completed_events": { 2024-09-13T16:13:01.609 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_completed_events", 2024-09-13T16:13:01.609 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.609 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.609 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.609 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "50", 2024-09-13T16:13:01.609 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.609 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.609 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.610 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "number of past completed events to remember", 2024-09-13T16:13:01.610 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.610 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.610 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.610 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-13T16:13:01.610 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-13T16:13:01.610 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.610 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.610 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.610 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-13T16:13:01.611 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.611 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.611 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.611 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long the module is going to sleep", 2024-09-13T16:13:01.611 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.611 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.611 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.611 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.611 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.611 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus", 2024-09-13T16:13:01.612 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.612 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.612 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.612 INFO:teuthology.orchestra.run.smithi017.stdout: "cache": { 2024-09-13T16:13:01.612 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cache", 2024-09-13T16:13:01.612 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.612 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.612 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.612 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.612 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.612 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.613 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.613 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.613 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.613 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.613 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.613 INFO:teuthology.orchestra.run.smithi017.stdout: "exclude_perf_counters": { 2024-09-13T16:13:01.613 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "exclude_perf_counters", 2024-09-13T16:13:01.613 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.613 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.613 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.614 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.614 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.614 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.614 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.614 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-13T16:13:01.614 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-13T16:13:01.614 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.614 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.614 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.614 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.614 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.615 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.615 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.615 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.615 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.615 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.615 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.615 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.615 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.615 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.615 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.615 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.615 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.616 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.616 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.616 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.616 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.616 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.616 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.616 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.616 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.616 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.616 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.616 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.617 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.617 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.617 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.617 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.617 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.617 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.617 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.617 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.617 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.617 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.618 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.618 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.618 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.618 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.618 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.618 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.618 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.618 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.618 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.618 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.618 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.618 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.619 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.619 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.619 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.619 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.619 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.619 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.619 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.619 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.619 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.619 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.619 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.620 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.620 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.620 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.620 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.620 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.620 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.620 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.620 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools": { 2024-09-13T16:13:01.620 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools", 2024-09-13T16:13:01.621 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.621 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.621 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.621 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.621 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.621 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.621 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.621 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.621 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.621 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.621 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.622 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-13T16:13:01.622 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-13T16:13:01.622 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.622 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.622 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.622 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300", 2024-09-13T16:13:01.622 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.622 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.622 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.622 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.622 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.622 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.623 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.623 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_interval": { 2024-09-13T16:13:01.623 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_interval", 2024-09-13T16:13:01.623 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-13T16:13:01.623 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.623 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.623 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15.0", 2024-09-13T16:13:01.623 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.623 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.623 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.624 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.624 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.624 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.624 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.624 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-13T16:13:01.624 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-13T16:13:01.624 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.624 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.624 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.624 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-13T16:13:01.624 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.625 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.625 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.625 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-13T16:13:01.625 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.625 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.625 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.625 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-13T16:13:01.625 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-13T16:13:01.625 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.625 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.626 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.626 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "9283", 2024-09-13T16:13:01.626 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.626 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.626 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.626 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-13T16:13:01.626 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.626 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.626 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.626 INFO:teuthology.orchestra.run.smithi017.stdout: "stale_cache_strategy": { 2024-09-13T16:13:01.626 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stale_cache_strategy", 2024-09-13T16:13:01.627 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.627 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.627 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.627 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "log", 2024-09-13T16:13:01.627 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.627 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.627 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.627 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.627 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.627 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.627 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.628 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-13T16:13:01.628 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-13T16:13:01.628 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.628 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.628 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.628 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "default", 2024-09-13T16:13:01.628 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.628 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.628 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.628 INFO:teuthology.orchestra.run.smithi017.stdout: "default", 2024-09-13T16:13:01.628 INFO:teuthology.orchestra.run.smithi017.stdout: "error" 2024-09-13T16:13:01.629 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.629 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.629 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.629 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.629 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.629 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-13T16:13:01.629 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-13T16:13:01.629 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.629 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.629 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.630 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-13T16:13:01.630 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-13T16:13:01.630 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-13T16:13:01.630 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.630 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.630 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.630 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.630 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.630 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.630 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.631 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2024-09-13T16:13:01.631 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.631 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.631 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.631 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.631 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.631 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.631 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.631 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.631 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.631 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.632 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.632 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.632 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.632 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.632 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.632 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.632 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.632 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.632 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.632 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.632 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.633 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.633 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.633 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.633 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.633 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.633 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.633 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.633 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.633 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.633 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.633 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.634 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.634 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.634 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.634 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.634 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.634 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.634 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.634 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.634 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.634 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.634 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.635 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.635 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.635 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.635 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.635 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.635 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.635 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.635 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.635 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.635 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.636 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.636 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.636 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.636 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.636 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.636 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.636 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.636 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.636 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.636 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.637 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.637 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.637 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.637 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.637 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.637 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.637 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_snap_create": { 2024-09-13T16:13:01.637 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_snap_create", 2024-09-13T16:13:01.637 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.637 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.638 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.638 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:01.638 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.638 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.638 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.638 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.638 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.638 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.638 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.638 INFO:teuthology.orchestra.run.smithi017.stdout: "mirror_snapshot_schedule": { 2024-09-13T16:13:01.639 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirror_snapshot_schedule", 2024-09-13T16:13:01.639 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.639 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.639 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.639 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.639 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.639 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.639 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.639 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.639 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.639 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.639 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.640 INFO:teuthology.orchestra.run.smithi017.stdout: "trash_purge_schedule": { 2024-09-13T16:13:01.640 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "trash_purge_schedule", 2024-09-13T16:13:01.640 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.640 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.640 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.640 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.640 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.640 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.640 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.640 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.641 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.641 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.641 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.641 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.641 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.641 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "restful", 2024-09-13T16:13:01.641 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.641 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.641 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.641 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_auth": { 2024-09-13T16:13:01.642 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_auth", 2024-09-13T16:13:01.642 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.642 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.642 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.642 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.642 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.642 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.642 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.642 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.642 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.642 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.643 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.643 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-13T16:13:01.643 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-13T16:13:01.643 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.643 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.643 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.643 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.643 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.643 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.643 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.643 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.644 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.644 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.644 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.644 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.644 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.644 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.644 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.644 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.644 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.644 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.645 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.645 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.645 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.645 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.645 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.645 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.645 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.645 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.645 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.645 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.645 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.645 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.646 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.646 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.646 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.646 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.646 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.646 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.646 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.646 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.646 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.646 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.646 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.647 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.647 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.647 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.647 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.647 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.647 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.647 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.647 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.647 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.647 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.648 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.648 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.648 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.648 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.648 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.648 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.648 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.648 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.648 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.648 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.648 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.649 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.649 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.649 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.649 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.649 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.649 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.649 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.649 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.649 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.649 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.649 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.650 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.650 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.650 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.650 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.650 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-13T16:13:01.650 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-13T16:13:01.650 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.650 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.650 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.650 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.650 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.651 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.651 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.651 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.651 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.651 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.651 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.651 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-13T16:13:01.651 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-13T16:13:01.651 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.651 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rgw", 2024-09-13T16:13:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.655 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.656 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.657 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.658 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.659 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rook", 2024-09-13T16:13:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.661 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.662 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.663 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.665 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "storage_class": { 2024-09-13T16:13:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "storage_class", 2024-09-13T16:13:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.666 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "local", 2024-09-13T16:13:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-13T16:13:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "selftest", 2024-09-13T16:13:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.668 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.669 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.670 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.671 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.672 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.673 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "roption1": { 2024-09-13T16:13:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption1", 2024-09-13T16:13:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.674 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "roption2": { 2024-09-13T16:13:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption2", 2024-09-13T16:13:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.675 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "xyz", 2024-09-13T16:13:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption1": { 2024-09-13T16:13:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption1", 2024-09-13T16:13:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.677 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption2": { 2024-09-13T16:13:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption2", 2024-09-13T16:13:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.678 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption3": { 2024-09-13T16:13:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption3", 2024-09-13T16:13:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-13T16:13:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.679 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption4": { 2024-09-13T16:13:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption4", 2024-09-13T16:13:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.680 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption5": { 2024-09-13T16:13:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption5", 2024-09-13T16:13:01.681 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.682 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption6": { 2024-09-13T16:13:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption6", 2024-09-13T16:13:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.683 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption7": { 2024-09-13T16:13:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption7", 2024-09-13T16:13:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-13T16:13:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "42", 2024-09-13T16:13:01.684 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "testkey": { 2024-09-13T16:13:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testkey", 2024-09-13T16:13:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.685 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: "testlkey": { 2024-09-13T16:13:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testlkey", 2024-09-13T16:13:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.686 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.687 INFO:teuthology.orchestra.run.smithi017.stdout: "testnewline": { 2024-09-13T16:13:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testnewline", 2024-09-13T16:13:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.688 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2024-09-13T16:13:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_m_granularity": { 2024-09-13T16:13:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_m_granularity", 2024-09-13T16:13:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow minute scheduled snapshots", 2024-09-13T16:13:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.690 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "dump_on_update": { 2024-09-13T16:13:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dump_on_update", 2024-09-13T16:13:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.691 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "dump database to debug log on update", 2024-09-13T16:13:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.692 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.693 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.694 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.695 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.696 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.697 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.698 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stats", 2024-09-13T16:13:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.699 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.700 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.701 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.702 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.703 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.704 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "status", 2024-09-13T16:13:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.706 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.707 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.708 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.709 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.710 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.711 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.712 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telegraf", 2024-09-13T16:13:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "address": { 2024-09-13T16:13:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "address", 2024-09-13T16:13:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-13T16:13:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.713 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-13T16:13:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-13T16:13:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.714 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15", 2024-09-13T16:13:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.716 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.718 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.719 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.720 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.721 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telemetry", 2024-09-13T16:13:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_basic": { 2024-09-13T16:13:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_basic", 2024-09-13T16:13:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.722 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-13T16:13:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_crash": { 2024-09-13T16:13:01.723 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_crash", 2024-09-13T16:13:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-13T16:13:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.724 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_device": { 2024-09-13T16:13:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_device", 2024-09-13T16:13:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.725 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-13T16:13:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_ident": { 2024-09-13T16:13:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_ident", 2024-09-13T16:13:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.726 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-13T16:13:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_perf": { 2024-09-13T16:13:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_perf", 2024-09-13T16:13:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.727 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-13T16:13:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "contact": { 2024-09-13T16:13:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "contact", 2024-09-13T16:13:01.728 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "description": { 2024-09-13T16:13:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "description", 2024-09-13T16:13:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.730 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: "device_url": { 2024-09-13T16:13:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_url", 2024-09-13T16:13:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-13T16:13:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-13T16:13:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-13T16:13:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-13T16:13:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-13T16:13:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "24", 2024-09-13T16:13:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "8", 2024-09-13T16:13:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "last_opt_revision": { 2024-09-13T16:13:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "last_opt_revision", 2024-09-13T16:13:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1", 2024-09-13T16:13:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.736 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard": { 2024-09-13T16:13:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard", 2024-09-13T16:13:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.737 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard_description": { 2024-09-13T16:13:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard_description", 2024-09-13T16:13:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.738 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.740 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.741 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.742 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.743 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.744 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: "organization": { 2024-09-13T16:13:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "organization", 2024-09-13T16:13:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.745 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "proxy": { 2024-09-13T16:13:01.746 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "proxy", 2024-09-13T16:13:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "url": { 2024-09-13T16:13:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url", 2024-09-13T16:13:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-13T16:13:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.748 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "test_orchestrator", 2024-09-13T16:13:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.749 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.750 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.751 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.752 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.753 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.754 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.756 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2024-09-13T16:13:01.756 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.756 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.756 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.756 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.756 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.756 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.756 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.756 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.756 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.756 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.756 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.757 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.757 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.757 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.757 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.757 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.757 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.757 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.757 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.757 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.757 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.757 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.758 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.758 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.758 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.758 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.758 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.758 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.758 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.758 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.758 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.758 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.759 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.759 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.759 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.759 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.759 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.759 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.759 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.759 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.759 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.759 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.759 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.760 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.760 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.760 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.760 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.760 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.760 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.760 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.760 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.760 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.760 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.760 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.761 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.761 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.761 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.761 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.761 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.761 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.761 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.761 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.761 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.761 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.761 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.762 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.762 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.762 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.762 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.762 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_clones": { 2024-09-13T16:13:01.762 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_clones", 2024-09-13T16:13:01.762 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.762 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.762 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.762 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4", 2024-09-13T16:13:01.763 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.763 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.763 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.763 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-13T16:13:01.763 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.763 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.763 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.763 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_delay": { 2024-09-13T16:13:01.763 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_delay", 2024-09-13T16:13:01.763 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.763 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.764 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.764 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-13T16:13:01.764 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.764 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.764 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.764 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-13T16:13:01.764 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.764 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.764 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.764 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_no_wait": { 2024-09-13T16:13:01.765 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_no_wait", 2024-09-13T16:13:01.765 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.765 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.765 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.765 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.765 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.765 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.765 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.765 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-13T16:13:01.765 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.765 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.766 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.766 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.766 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.766 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix", 2024-09-13T16:13:01.766 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.766 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.766 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.766 INFO:teuthology.orchestra.run.smithi017.stdout: "discovery_interval": { 2024-09-13T16:13:01.766 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "discovery_interval", 2024-09-13T16:13:01.766 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-13T16:13:01.767 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.767 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.767 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "100", 2024-09-13T16:13:01.767 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.767 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.767 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.767 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.767 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.767 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.767 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.768 INFO:teuthology.orchestra.run.smithi017.stdout: "identifier": { 2024-09-13T16:13:01.768 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "identifier", 2024-09-13T16:13:01.768 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.768 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.768 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.768 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.768 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.768 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.768 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.768 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.769 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.769 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.769 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.769 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-13T16:13:01.769 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-13T16:13:01.769 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.769 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.769 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.769 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-13T16:13:01.769 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.769 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.770 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.770 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.770 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.770 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.770 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.770 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.770 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.770 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.770 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.770 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.771 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.772 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.772 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.772 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.772 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.772 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.772 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.772 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.772 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.772 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.772 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.773 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.773 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.773 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.773 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.773 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.773 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.773 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.773 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.773 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.773 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.773 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.774 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.774 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.774 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.774 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.774 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.774 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.774 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.774 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.774 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.774 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.774 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.775 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.775 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.775 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.775 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.775 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.775 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.775 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.775 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.775 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.775 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.775 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.776 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.776 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.776 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.776 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.776 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.776 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.776 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_host": { 2024-09-13T16:13:01.776 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_host", 2024-09-13T16:13:01.776 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.776 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.777 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.777 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.777 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.777 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.777 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.777 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.777 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.777 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.777 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.777 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_port": { 2024-09-13T16:13:01.778 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_port", 2024-09-13T16:13:01.778 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.778 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.778 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.778 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10051", 2024-09-13T16:13:01.778 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.778 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.778 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.778 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.778 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.778 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.778 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.779 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_sender": { 2024-09-13T16:13:01.779 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_sender", 2024-09-13T16:13:01.779 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.779 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.779 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.779 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-13T16:13:01.779 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.779 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.779 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.779 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.780 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.780 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.780 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.780 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.780 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.780 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.780 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-13T16:13:01.780 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.780 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.780 INFO:teuthology.orchestra.run.smithi017.stdout: "modules": [ 2024-09-13T16:13:01.780 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2024-09-13T16:13:01.780 INFO:teuthology.orchestra.run.smithi017.stdout: "dashboard", 2024-09-13T16:13:01.781 INFO:teuthology.orchestra.run.smithi017.stdout: "iostat", 2024-09-13T16:13:01.781 INFO:teuthology.orchestra.run.smithi017.stdout: "nfs", 2024-09-13T16:13:01.781 INFO:teuthology.orchestra.run.smithi017.stdout: "restful" 2024-09-13T16:13:01.781 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.781 INFO:teuthology.orchestra.run.smithi017.stdout: "available_modules": [ 2024-09-13T16:13:01.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.781 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alerts", 2024-09-13T16:13:01.781 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.781 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.781 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.781 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-13T16:13:01.781 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-13T16:13:01.782 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.782 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.782 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.782 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-13T16:13:01.782 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.782 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.782 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.782 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How frequently to reexamine health status", 2024-09-13T16:13:01.782 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.782 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.782 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.783 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.783 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.783 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.783 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.783 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.783 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.783 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.783 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.783 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.783 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.783 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.784 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.784 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.784 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.784 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.784 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.784 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.784 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.784 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.784 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.784 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.785 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.785 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.785 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.785 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.785 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.785 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.785 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.785 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.785 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.785 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.785 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.785 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.786 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.786 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.786 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.786 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.786 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.786 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.786 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.786 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.786 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.786 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.786 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.787 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.787 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.787 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.787 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.787 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.787 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.787 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.787 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.787 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.787 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.787 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.788 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.788 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.788 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.788 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.788 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.788 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.788 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.788 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.788 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.788 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.788 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.789 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_destination": { 2024-09-13T16:13:01.789 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_destination", 2024-09-13T16:13:01.789 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.789 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.789 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.789 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.789 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.789 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.789 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.789 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email address to send alerts to", 2024-09-13T16:13:01.789 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.790 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.790 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.790 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_from_name": { 2024-09-13T16:13:01.790 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_from_name", 2024-09-13T16:13:01.790 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.790 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.790 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.790 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "Ceph", 2024-09-13T16:13:01.790 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.790 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.790 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.791 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email From: name", 2024-09-13T16:13:01.791 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.791 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.791 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.791 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_host": { 2024-09-13T16:13:01.791 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_host", 2024-09-13T16:13:01.791 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.791 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.791 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.791 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.791 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.792 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.792 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.792 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP server", 2024-09-13T16:13:01.792 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.792 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.792 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.792 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_password": { 2024-09-13T16:13:01.792 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_password", 2024-09-13T16:13:01.792 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.792 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.792 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.793 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.793 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.793 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.793 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.793 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Password to authenticate with", 2024-09-13T16:13:01.793 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.793 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.793 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.793 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_port": { 2024-09-13T16:13:01.793 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_port", 2024-09-13T16:13:01.794 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.794 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.794 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.794 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "465", 2024-09-13T16:13:01.794 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.794 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.794 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.794 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP port", 2024-09-13T16:13:01.794 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.794 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.794 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.795 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_sender": { 2024-09-13T16:13:01.795 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_sender", 2024-09-13T16:13:01.795 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.795 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.795 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.795 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.795 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.795 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.795 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.795 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP envelope sender", 2024-09-13T16:13:01.795 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.796 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.796 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.796 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_ssl": { 2024-09-13T16:13:01.796 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_ssl", 2024-09-13T16:13:01.796 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.796 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.796 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.796 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.796 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.796 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.797 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.797 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-13T16:13:01.797 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.797 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.797 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.797 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_user": { 2024-09-13T16:13:01.797 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_user", 2024-09-13T16:13:01.797 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.797 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.797 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.797 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.798 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.798 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.798 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.798 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "User to authenticate as", 2024-09-13T16:13:01.798 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.798 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.798 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.798 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.798 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.798 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "balancer", 2024-09-13T16:13:01.799 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.799 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.799 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.799 INFO:teuthology.orchestra.run.smithi017.stdout: "active": { 2024-09-13T16:13:01.799 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "active", 2024-09-13T16:13:01.799 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.799 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.799 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.799 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.799 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.799 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.800 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.800 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically balance PGs across cluster", 2024-09-13T16:13:01.800 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.800 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.800 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.800 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_time": { 2024-09-13T16:13:01.800 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_time", 2024-09-13T16:13:01.800 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.800 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.800 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.801 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0000", 2024-09-13T16:13:01.801 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.801 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.801 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.801 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "beginning time of day to automatically balance", 2024-09-13T16:13:01.801 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T16:13:01.801 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.801 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.801 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_weekday": { 2024-09-13T16:13:01.801 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_weekday", 2024-09-13T16:13:01.801 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-13T16:13:01.802 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.802 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.802 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-13T16:13:01.802 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-13T16:13:01.802 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-13T16:13:01.802 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.802 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-13T16:13:01.802 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T16:13:01.802 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.802 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.802 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_max_iterations": { 2024-09-13T16:13:01.803 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_max_iterations", 2024-09-13T16:13:01.803 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-13T16:13:01.803 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.803 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.803 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "25", 2024-09-13T16:13:01.803 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-13T16:13:01.803 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "250", 2024-09-13T16:13:01.803 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.803 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-13T16:13:01.803 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.803 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.803 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.804 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_metrics": { 2024-09-13T16:13:01.804 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_metrics", 2024-09-13T16:13:01.804 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.804 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.804 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.804 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "pgs,objects,bytes", 2024-09-13T16:13:01.804 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.804 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.804 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.805 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-13T16:13:01.805 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-13T16:13:01.805 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.805 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.805 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_step": { 2024-09-13T16:13:01.805 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_step", 2024-09-13T16:13:01.805 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-13T16:13:01.805 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.805 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.805 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.5", 2024-09-13T16:13:01.805 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0.001", 2024-09-13T16:13:01.806 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "0.999", 2024-09-13T16:13:01.806 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.806 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "aggressiveness of optimization", 2024-09-13T16:13:01.806 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-13T16:13:01.806 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.806 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.806 INFO:teuthology.orchestra.run.smithi017.stdout: "end_time": { 2024-09-13T16:13:01.806 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_time", 2024-09-13T16:13:01.806 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.806 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.807 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.807 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2359", 2024-09-13T16:13:01.807 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.807 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.807 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.807 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ending time of day to automatically balance", 2024-09-13T16:13:01.807 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T16:13:01.807 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.807 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.807 INFO:teuthology.orchestra.run.smithi017.stdout: "end_weekday": { 2024-09-13T16:13:01.808 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_weekday", 2024-09-13T16:13:01.808 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-13T16:13:01.808 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.808 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.808 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-13T16:13:01.808 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-13T16:13:01.808 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-13T16:13:01.808 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.808 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-13T16:13:01.808 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T16:13:01.808 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.809 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.809 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.809 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.809 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.809 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.809 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.809 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.809 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.809 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.809 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.810 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.810 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.810 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.810 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.810 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.810 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.810 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.810 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.810 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.810 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.810 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.811 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.811 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.811 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.811 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.811 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.811 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.811 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.811 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.811 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.811 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.811 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.812 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.812 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.812 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.812 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.812 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.812 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.812 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.812 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.812 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.813 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.813 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.813 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.813 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.813 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.813 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.813 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.813 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.813 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.813 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.813 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.813 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.814 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.814 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.814 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.814 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.814 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.814 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.814 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.814 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.814 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.814 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.815 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.815 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.815 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.815 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.815 INFO:teuthology.orchestra.run.smithi017.stdout: "min_score": { 2024-09-13T16:13:01.815 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_score", 2024-09-13T16:13:01.815 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-13T16:13:01.815 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.815 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.815 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-13T16:13:01.815 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.816 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.816 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.816 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-13T16:13:01.816 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.816 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.816 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.816 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-13T16:13:01.816 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-13T16:13:01.816 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.816 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.817 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.817 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "upmap", 2024-09-13T16:13:01.817 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.817 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.817 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.817 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-compat", 2024-09-13T16:13:01.817 INFO:teuthology.orchestra.run.smithi017.stdout: "none", 2024-09-13T16:13:01.817 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap" 2024-09-13T16:13:01.817 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.817 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Balancer mode", 2024-09-13T16:13:01.817 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.817 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.818 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.818 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ids": { 2024-09-13T16:13:01.818 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_ids", 2024-09-13T16:13:01.818 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.818 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.818 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.818 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.818 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.818 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.818 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.819 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-13T16:13:01.819 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.819 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.819 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.819 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-13T16:13:01.819 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-13T16:13:01.819 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.819 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.819 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.819 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-13T16:13:01.819 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.820 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.820 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.820 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-13T16:13:01.820 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.820 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.820 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.820 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_deviation": { 2024-09-13T16:13:01.820 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_deviation", 2024-09-13T16:13:01.820 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.820 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.820 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.821 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-13T16:13:01.821 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-13T16:13:01.821 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.821 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.821 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-13T16:13:01.821 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-13T16:13:01.821 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.821 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.821 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_optimizations": { 2024-09-13T16:13:01.821 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_optimizations", 2024-09-13T16:13:01.822 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-13T16:13:01.822 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.822 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.822 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:01.822 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.822 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.822 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.822 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-13T16:13:01.822 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.822 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.822 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm", 2024-09-13T16:13:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_down_multiplier": { 2024-09-13T16:13:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_down_multiplier", 2024-09-13T16:13:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-13T16:13:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.824 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.824 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-13T16:13:01.824 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.824 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.824 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.824 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-13T16:13:01.824 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.824 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.824 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.824 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_refresh_rate": { 2024-09-13T16:13:01.824 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_refresh_rate", 2024-09-13T16:13:01.825 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.825 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.825 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.825 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "20", 2024-09-13T16:13:01.825 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.825 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.825 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.825 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-13T16:13:01.825 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.825 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.825 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.826 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_starting_port": { 2024-09-13T16:13:01.826 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_starting_port", 2024-09-13T16:13:01.826 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.826 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.826 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.826 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4721", 2024-09-13T16:13:01.826 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.826 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.826 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.826 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-13T16:13:01.826 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.826 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.827 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.827 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_ptrace": { 2024-09-13T16:13:01.827 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_ptrace", 2024-09-13T16:13:01.827 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.827 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.827 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.827 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.827 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.827 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.827 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.827 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-13T16:13:01.828 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-13T16:13:01.828 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.828 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.828 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_interval": { 2024-09-13T16:13:01.828 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_interval", 2024-09-13T16:13:01.828 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.828 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.828 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.828 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-13T16:13:01.828 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.829 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.829 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.829 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-13T16:13:01.829 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.829 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.829 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.829 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_memory_target_ratio": { 2024-09-13T16:13:01.829 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_memory_target_ratio", 2024-09-13T16:13:01.829 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-13T16:13:01.829 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.829 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.830 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.7", 2024-09-13T16:13:01.830 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.830 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.830 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.830 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-13T16:13:01.830 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.830 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.830 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.830 INFO:teuthology.orchestra.run.smithi017.stdout: "cgroups_split": { 2024-09-13T16:13:01.830 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cgroups_split", 2024-09-13T16:13:01.831 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.831 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.831 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.831 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.831 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.831 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.831 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.831 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-13T16:13:01.831 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.831 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.832 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.832 INFO:teuthology.orchestra.run.smithi017.stdout: "config_checks_enabled": { 2024-09-13T16:13:01.832 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_checks_enabled", 2024-09-13T16:13:01.832 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.832 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.832 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.832 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.832 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.832 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.833 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.833 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-13T16:13:01.833 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.833 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.833 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.833 INFO:teuthology.orchestra.run.smithi017.stdout: "config_dashboard": { 2024-09-13T16:13:01.833 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_dashboard", 2024-09-13T16:13:01.833 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.833 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.834 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.834 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.834 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.834 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.834 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.834 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-13T16:13:01.834 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.834 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.834 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.834 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_alertmanager": { 2024-09-13T16:13:01.834 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_alertmanager", 2024-09-13T16:13:01.835 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.835 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.835 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.835 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-13T16:13:01.835 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.835 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.835 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.835 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:01.835 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.835 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.836 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.836 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_base": { 2024-09-13T16:13:01.836 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_base", 2024-09-13T16:13:01.836 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.836 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.836 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.836 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-13T16:13:01.836 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.836 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.836 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.837 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Container image name, without the tag", 2024-09-13T16:13:01.837 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.837 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.837 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.837 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_elasticsearch": { 2024-09-13T16:13:01.837 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_elasticsearch", 2024-09-13T16:13:01.837 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.837 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.838 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.838 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-13T16:13:01.838 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.838 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.838 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.838 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "elasticsearch container image", 2024-09-13T16:13:01.838 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.838 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.838 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.839 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_grafana": { 2024-09-13T16:13:01.839 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_grafana", 2024-09-13T16:13:01.839 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.839 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.839 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.839 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-09-13T16:13:01.839 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.839 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.839 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.839 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:01.839 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.840 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.840 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.840 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_haproxy": { 2024-09-13T16:13:01.840 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_haproxy", 2024-09-13T16:13:01.840 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.840 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.840 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.840 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-13T16:13:01.840 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.840 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.841 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.841 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "HAproxy container image", 2024-09-13T16:13:01.841 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.841 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.841 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.841 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_agent": { 2024-09-13T16:13:01.841 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_agent", 2024-09-13T16:13:01.841 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.841 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.841 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.841 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-13T16:13:01.842 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.842 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.842 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.842 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger agent container image", 2024-09-13T16:13:01.842 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.842 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.842 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.842 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_collector": { 2024-09-13T16:13:01.842 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_collector", 2024-09-13T16:13:01.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.843 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.843 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.843 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-13T16:13:01.843 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.843 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.843 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.843 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger collector container image", 2024-09-13T16:13:01.843 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.843 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.843 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.843 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_query": { 2024-09-13T16:13:01.844 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_query", 2024-09-13T16:13:01.844 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.844 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.844 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.844 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-13T16:13:01.844 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.844 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.844 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.844 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger query container image", 2024-09-13T16:13:01.844 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.844 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.845 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.845 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_keepalived": { 2024-09-13T16:13:01.845 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_keepalived", 2024-09-13T16:13:01.845 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.845 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.845 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.845 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-13T16:13:01.845 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.845 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.845 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.845 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Keepalived container image", 2024-09-13T16:13:01.846 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.846 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.846 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.846 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_loki": { 2024-09-13T16:13:01.846 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_loki", 2024-09-13T16:13:01.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.846 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.846 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.846 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-13T16:13:01.846 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.846 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.847 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.847 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Loki container image", 2024-09-13T16:13:01.847 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.847 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.847 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.847 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_node_exporter": { 2024-09-13T16:13:01.847 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_node_exporter", 2024-09-13T16:13:01.847 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.847 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.847 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.847 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-13T16:13:01.848 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.848 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.848 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.848 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:01.848 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.848 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.848 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.848 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_nvmeof": { 2024-09-13T16:13:01.848 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_nvmeof", 2024-09-13T16:13:01.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.849 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.849 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.849 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-09-13T16:13:01.849 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.849 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.849 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.849 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Nvme-of container image", 2024-09-13T16:13:01.849 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.849 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.849 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.849 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_prometheus": { 2024-09-13T16:13:01.850 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_prometheus", 2024-09-13T16:13:01.850 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.850 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.850 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.850 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-13T16:13:01.850 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.850 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.850 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.850 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-13T16:13:01.850 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.850 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.850 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.851 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_promtail": { 2024-09-13T16:13:01.851 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_promtail", 2024-09-13T16:13:01.851 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.851 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.851 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.851 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-13T16:13:01.851 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.851 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.851 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.851 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Promtail container image", 2024-09-13T16:13:01.851 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.852 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.852 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.852 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_snmp_gateway": { 2024-09-13T16:13:01.852 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_snmp_gateway", 2024-09-13T16:13:01.852 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.852 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.852 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.852 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-13T16:13:01.852 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.852 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.853 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.853 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SNMP Gateway container image", 2024-09-13T16:13:01.853 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.853 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.853 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.853 INFO:teuthology.orchestra.run.smithi017.stdout: "container_init": { 2024-09-13T16:13:01.853 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_init", 2024-09-13T16:13:01.853 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.853 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.853 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.853 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.854 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.854 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.854 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.854 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Run podman/docker with `--init`", 2024-09-13T16:13:01.854 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.854 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.854 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.854 INFO:teuthology.orchestra.run.smithi017.stdout: "daemon_cache_timeout": { 2024-09-13T16:13:01.854 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "daemon_cache_timeout", 2024-09-13T16:13:01.854 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.854 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.855 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.855 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-13T16:13:01.855 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.855 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.855 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.855 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-13T16:13:01.855 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.855 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.855 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.855 INFO:teuthology.orchestra.run.smithi017.stdout: "default_cephadm_command_timeout": { 2024-09-13T16:13:01.856 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_cephadm_command_timeout", 2024-09-13T16:13:01.856 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.856 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.856 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.856 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "900", 2024-09-13T16:13:01.856 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.856 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.856 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.856 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-13T16:13:01.856 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.856 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.856 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.857 INFO:teuthology.orchestra.run.smithi017.stdout: "default_registry": { 2024-09-13T16:13:01.857 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_registry", 2024-09-13T16:13:01.857 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.857 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.857 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.857 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io", 2024-09-13T16:13:01.857 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.857 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.857 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.857 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-13T16:13:01.857 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.858 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.858 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.858 INFO:teuthology.orchestra.run.smithi017.stdout: "device_cache_timeout": { 2024-09-13T16:13:01.858 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_cache_timeout", 2024-09-13T16:13:01.858 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.858 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.858 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.858 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1800", 2024-09-13T16:13:01.858 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.858 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.859 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.859 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache device inventory", 2024-09-13T16:13:01.859 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.859 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.859 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.859 INFO:teuthology.orchestra.run.smithi017.stdout: "device_enhanced_scan": { 2024-09-13T16:13:01.859 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_enhanced_scan", 2024-09-13T16:13:01.859 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.859 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.859 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.859 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.860 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.860 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.860 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.860 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-13T16:13:01.860 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.860 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.860 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.860 INFO:teuthology.orchestra.run.smithi017.stdout: "facts_cache_timeout": { 2024-09-13T16:13:01.860 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "facts_cache_timeout", 2024-09-13T16:13:01.860 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.861 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.861 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.861 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-13T16:13:01.861 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.861 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.861 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.861 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache host facts data", 2024-09-13T16:13:01.861 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.861 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.861 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.861 INFO:teuthology.orchestra.run.smithi017.stdout: "host_check_interval": { 2024-09-13T16:13:01.862 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "host_check_interval", 2024-09-13T16:13:01.862 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.862 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.862 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.862 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-13T16:13:01.862 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.862 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.862 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.862 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to perform a host check", 2024-09-13T16:13:01.862 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.862 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.863 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.863 INFO:teuthology.orchestra.run.smithi017.stdout: "hw_monitoring": { 2024-09-13T16:13:01.863 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hw_monitoring", 2024-09-13T16:13:01.863 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.863 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.863 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.863 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.863 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.863 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.863 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.864 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-13T16:13:01.864 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.864 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.864 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.864 INFO:teuthology.orchestra.run.smithi017.stdout: "inventory_list_all": { 2024-09-13T16:13:01.864 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "inventory_list_all", 2024-09-13T16:13:01.864 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.864 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.864 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.864 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.864 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.865 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.865 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.865 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-13T16:13:01.865 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.865 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.865 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.865 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.865 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.865 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.865 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.865 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.866 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.866 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.866 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.866 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.866 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.866 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.866 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.866 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.866 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.866 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.867 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.867 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.867 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.867 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.867 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.867 INFO:teuthology.orchestra.run.smithi017.stdout: "log_refresh_metadata": { 2024-09-13T16:13:01.867 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_refresh_metadata", 2024-09-13T16:13:01.867 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.867 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.867 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.867 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.868 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.868 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.868 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.868 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-13T16:13:01.868 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.868 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.868 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.868 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.868 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.868 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.869 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.869 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.869 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.869 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.869 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.869 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.869 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-13T16:13:01.869 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.869 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.869 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.870 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.870 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.870 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.870 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.870 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.870 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.870 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.870 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.870 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.870 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.871 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.871 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.871 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.871 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.871 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.871 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.871 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.871 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.871 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.871 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.871 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.872 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.872 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.872 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.872 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.872 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.872 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.872 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.872 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.872 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.872 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.872 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.873 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-13T16:13:01.873 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-13T16:13:01.873 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.873 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.873 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.873 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.873 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.873 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.873 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.873 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-13T16:13:01.873 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.874 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.874 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.874 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-13T16:13:01.874 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-13T16:13:01.874 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.874 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.874 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.874 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "*", 2024-09-13T16:13:01.874 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.874 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.874 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.875 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-13T16:13:01.875 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.875 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.875 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.875 INFO:teuthology.orchestra.run.smithi017.stdout: "max_count_per_host": { 2024-09-13T16:13:01.875 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_count_per_host", 2024-09-13T16:13:01.875 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.875 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.875 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.875 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:01.875 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.876 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.876 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.876 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of daemons per service per host", 2024-09-13T16:13:01.876 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.876 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.876 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.876 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd_draining_count": { 2024-09-13T16:13:01.876 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_osd_draining_count", 2024-09-13T16:13:01.876 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.876 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.877 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.877 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:01.877 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.877 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.877 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.877 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-13T16:13:01.877 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.877 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.877 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.877 INFO:teuthology.orchestra.run.smithi017.stdout: "migration_current": { 2024-09-13T16:13:01.877 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "migration_current", 2024-09-13T16:13:01.878 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.878 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.878 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.878 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.878 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.878 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.878 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.878 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "internal - do not modify", 2024-09-13T16:13:01.878 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.878 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.878 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.879 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-13T16:13:01.879 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-13T16:13:01.879 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.879 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.879 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.879 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "root", 2024-09-13T16:13:01.879 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.879 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.879 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.879 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm-package", 2024-09-13T16:13:01.879 INFO:teuthology.orchestra.run.smithi017.stdout: "root" 2024-09-13T16:13:01.880 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.880 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "mode for remote execution of cephadm", 2024-09-13T16:13:01.880 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.880 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.880 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.880 INFO:teuthology.orchestra.run.smithi017.stdout: "oob_default_addr": { 2024-09-13T16:13:01.880 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "oob_default_addr", 2024-09-13T16:13:01.880 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.880 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.880 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "169.254.1.1", 2024-09-13T16:13:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-13T16:13:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_alerts_path": { 2024-09-13T16:13:01.882 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_alerts_path", 2024-09-13T16:13:01.882 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.882 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.882 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.882 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-13T16:13:01.882 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.882 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.882 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.882 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-13T16:13:01.882 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.882 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.882 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.883 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_insecure": { 2024-09-13T16:13:01.883 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_insecure", 2024-09-13T16:13:01.883 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.883 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.883 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.883 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.883 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.883 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.883 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.883 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-13T16:13:01.884 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.884 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.884 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.884 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_password": { 2024-09-13T16:13:01.884 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_password", 2024-09-13T16:13:01.884 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.884 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.884 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.884 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.884 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.884 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.885 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.885 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-13T16:13:01.885 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.885 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.885 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.885 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_url": { 2024-09-13T16:13:01.885 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_url", 2024-09-13T16:13:01.885 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.885 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.885 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.886 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.886 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.886 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.886 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.886 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-13T16:13:01.886 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.886 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.886 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.886 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_username": { 2024-09-13T16:13:01.886 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_username", 2024-09-13T16:13:01.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.887 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.887 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.887 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.887 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.887 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.887 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.887 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-13T16:13:01.887 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.887 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.887 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.888 INFO:teuthology.orchestra.run.smithi017.stdout: "secure_monitoring_stack": { 2024-09-13T16:13:01.888 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secure_monitoring_stack", 2024-09-13T16:13:01.888 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.888 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.888 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.888 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.888 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.888 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.888 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.888 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-13T16:13:01.888 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.888 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.889 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.889 INFO:teuthology.orchestra.run.smithi017.stdout: "service_discovery_port": { 2024-09-13T16:13:01.889 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "service_discovery_port", 2024-09-13T16:13:01.889 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.889 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.889 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.889 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8765", 2024-09-13T16:13:01.889 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.889 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.889 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.889 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "cephadm service discovery port", 2024-09-13T16:13:01.890 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.890 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.890 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.890 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_config_file": { 2024-09-13T16:13:01.890 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_config_file", 2024-09-13T16:13:01.890 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.890 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.890 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.890 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.890 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.890 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.891 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.891 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-13T16:13:01.891 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.891 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.891 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.891 INFO:teuthology.orchestra.run.smithi017.stdout: "use_agent": { 2024-09-13T16:13:01.891 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_agent", 2024-09-13T16:13:01.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.891 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.891 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.892 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.892 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.892 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.892 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.892 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-13T16:13:01.892 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.892 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.892 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.892 INFO:teuthology.orchestra.run.smithi017.stdout: "use_repo_digest": { 2024-09-13T16:13:01.892 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_repo_digest", 2024-09-13T16:13:01.893 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.893 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.893 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.893 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.893 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.893 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.893 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.893 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-13T16:13:01.893 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.893 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.893 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.894 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_failed_host_check": { 2024-09-13T16:13:01.894 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_failed_host_check", 2024-09-13T16:13:01.894 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.894 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.894 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.894 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.894 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.894 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.894 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.894 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if the host check fails", 2024-09-13T16:13:01.894 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.895 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.895 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.895 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_daemons": { 2024-09-13T16:13:01.895 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_daemons", 2024-09-13T16:13:01.895 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.895 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.895 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.895 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.895 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.895 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.895 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.896 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-13T16:13:01.896 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.896 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.896 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.896 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_hosts": { 2024-09-13T16:13:01.896 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_hosts", 2024-09-13T16:13:01.896 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.896 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.896 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.896 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.896 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.897 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.897 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.897 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-13T16:13:01.897 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.897 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.897 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.897 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.897 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.897 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crash", 2024-09-13T16:13:01.897 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.898 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.898 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.898 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.898 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.898 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.898 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.898 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.898 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.898 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.898 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.898 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.898 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.899 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.899 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.899 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.899 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.899 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.899 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.899 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.899 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.899 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.899 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.899 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.900 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.900 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.900 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.900 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.900 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.900 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.900 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.900 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.900 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.900 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.900 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.901 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.901 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.901 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.901 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.901 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.901 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.901 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.901 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.901 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.901 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.902 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.902 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.902 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.902 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.902 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.902 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.902 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.902 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.902 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.902 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.902 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.903 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.903 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.903 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.903 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.903 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.903 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.903 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.903 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.903 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.903 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.903 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.904 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.904 INFO:teuthology.orchestra.run.smithi017.stdout: "retain_interval": { 2024-09-13T16:13:01.904 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retain_interval", 2024-09-13T16:13:01.904 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.904 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.904 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.904 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "31536000", 2024-09-13T16:13:01.904 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.904 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.904 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.904 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-13T16:13:01.905 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.905 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.905 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.905 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_recent_interval": { 2024-09-13T16:13:01.905 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_recent_interval", 2024-09-13T16:13:01.905 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.905 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.905 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.905 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1209600", 2024-09-13T16:13:01.905 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.906 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.906 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.906 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-13T16:13:01.906 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.906 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.906 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.906 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.906 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.906 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dashboard", 2024-09-13T16:13:01.906 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.907 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.907 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.907 INFO:teuthology.orchestra.run.smithi017.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-13T16:13:01.907 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-13T16:13:01.907 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.907 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.907 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.907 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:01.907 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.907 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.907 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.907 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.908 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.908 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.908 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.908 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_HOST": { 2024-09-13T16:13:01.908 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-13T16:13:01.908 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.908 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.908 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.908 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.908 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.908 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.909 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.909 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.909 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.909 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.909 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.909 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-13T16:13:01.909 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-13T16:13:01.909 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.909 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.909 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.909 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.910 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.910 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.910 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.910 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.910 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.910 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.910 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.910 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_ENABLED": { 2024-09-13T16:13:01.910 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_ENABLED", 2024-09-13T16:13:01.910 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.911 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.911 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.911 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.911 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.911 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.911 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.911 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.911 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.911 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.911 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.911 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-13T16:13:01.912 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-13T16:13:01.912 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.912 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.912 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.912 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.912 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.912 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.912 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.912 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.912 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.912 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.913 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.913 INFO:teuthology.orchestra.run.smithi017.stdout: "ENABLE_BROWSABLE_API": { 2024-09-13T16:13:01.913 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-13T16:13:01.913 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.913 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.913 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.913 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.913 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.913 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.913 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.913 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.914 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.914 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.914 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.914 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-13T16:13:01.914 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-13T16:13:01.914 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.914 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.914 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.914 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.914 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.915 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.915 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.915 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.915 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.915 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.915 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.915 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-13T16:13:01.915 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-13T16:13:01.915 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.915 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.915 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.916 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.916 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.916 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.916 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.916 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.916 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.916 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.916 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.916 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-13T16:13:01.916 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-13T16:13:01.917 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.917 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.917 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.917 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.917 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.917 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.917 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.917 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.917 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.917 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.917 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.918 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-13T16:13:01.918 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-13T16:13:01.918 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.918 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.918 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.918 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.918 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.918 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.918 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.918 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.919 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.919 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.919 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.919 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-13T16:13:01.919 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-13T16:13:01.919 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.919 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.919 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.919 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.919 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.919 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.919 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.920 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.920 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.920 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.920 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.920 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-13T16:13:01.920 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-13T16:13:01.920 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.920 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.920 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.920 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.921 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.921 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.921 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.921 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.921 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.921 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.921 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.921 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-13T16:13:01.921 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-13T16:13:01.921 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.921 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.922 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.922 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.922 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.922 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.922 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.922 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.922 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.922 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.922 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.922 INFO:teuthology.orchestra.run.smithi017.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-13T16:13:01.922 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-13T16:13:01.923 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.923 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.923 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.923 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.923 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.923 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.923 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.923 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.923 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.923 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.923 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.924 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_PASSWORD": { 2024-09-13T16:13:01.924 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-13T16:13:01.924 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.924 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.924 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.924 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-13T16:13:01.924 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.924 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.924 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.924 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.925 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.925 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.925 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.925 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-13T16:13:01.925 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-13T16:13:01.925 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.925 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.925 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.925 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.925 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.925 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.926 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.926 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.926 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.926 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.926 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.926 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_URL": { 2024-09-13T16:13:01.926 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_URL", 2024-09-13T16:13:01.926 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.926 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.926 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.926 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.927 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.927 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.927 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.927 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.927 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.927 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.927 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.927 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_USERNAME": { 2024-09-13T16:13:01.927 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-13T16:13:01.927 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.927 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.928 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.928 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-13T16:13:01.928 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.928 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.928 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.928 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.928 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.928 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.928 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.928 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-13T16:13:01.929 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-13T16:13:01.929 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.929 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.929 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.929 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.929 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.929 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.929 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.929 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.929 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.929 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.929 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.930 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-13T16:13:01.930 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-13T16:13:01.930 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.930 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.930 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.930 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.930 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.930 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.930 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.930 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.930 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.931 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.931 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.931 INFO:teuthology.orchestra.run.smithi017.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-13T16:13:01.931 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-13T16:13:01.931 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.931 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.931 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.931 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.931 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.931 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.932 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.932 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.932 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.932 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.932 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.932 INFO:teuthology.orchestra.run.smithi017.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-13T16:13:01.932 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-13T16:13:01.932 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.932 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.932 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.933 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.933 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.933 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.933 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.933 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.933 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.933 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.933 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.933 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_HOST": { 2024-09-13T16:13:01.933 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-13T16:13:01.933 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.934 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.934 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.934 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.934 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.934 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.934 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.934 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.934 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.934 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.934 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.934 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-13T16:13:01.935 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-13T16:13:01.935 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.935 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.935 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.935 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.935 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.935 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.935 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.935 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.935 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.935 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.935 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.936 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-13T16:13:01.936 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-13T16:13:01.936 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.936 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.936 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.936 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.936 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.936 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.936 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.936 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.937 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.937 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.937 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.937 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-13T16:13:01.937 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-13T16:13:01.937 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.937 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.940 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.940 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.940 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.940 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.940 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.940 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.940 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.941 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.941 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.941 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-13T16:13:01.941 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-13T16:13:01.941 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.941 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.941 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.941 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.941 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.941 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.941 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.941 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.942 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.942 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.942 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.942 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-13T16:13:01.942 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-13T16:13:01.942 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.942 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.942 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.942 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.942 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.942 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.943 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.943 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.943 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.943 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.943 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.943 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-13T16:13:01.943 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-13T16:13:01.943 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.943 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.943 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.943 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.944 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.944 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.944 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.944 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.944 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.944 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.944 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.944 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-13T16:13:01.944 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-13T16:13:01.944 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.945 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.945 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.945 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.945 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.945 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.945 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.945 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.945 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.945 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.945 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.946 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-13T16:13:01.946 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-13T16:13:01.946 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.946 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.946 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.946 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.946 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.946 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.946 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.946 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.946 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.946 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.947 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.947 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_ENABLED": { 2024-09-13T16:13:01.947 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-13T16:13:01.947 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.947 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.947 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.947 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.947 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.947 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.947 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.947 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.948 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.948 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.948 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.948 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-13T16:13:01.948 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-13T16:13:01.948 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.948 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.948 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.948 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-13T16:13:01.948 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.949 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.949 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.949 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.949 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.949 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.949 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.949 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-13T16:13:01.949 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-13T16:13:01.949 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.949 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.950 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.950 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:01.950 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.950 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.950 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.950 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.950 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.950 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.950 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.950 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-13T16:13:01.951 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-13T16:13:01.951 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.951 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.951 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.951 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8", 2024-09-13T16:13:01.951 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.951 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.951 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.951 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.951 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.951 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.951 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.952 INFO:teuthology.orchestra.run.smithi017.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-13T16:13:01.952 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-13T16:13:01.952 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.952 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.952 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.952 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "45", 2024-09-13T16:13:01.952 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.952 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.952 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.952 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.953 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.953 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.953 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.953 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ACCESS_KEY": { 2024-09-13T16:13:01.953 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-13T16:13:01.953 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.953 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.953 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.953 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.953 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.953 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.954 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.954 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.954 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.954 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.954 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.954 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-13T16:13:01.954 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-13T16:13:01.954 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.954 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.954 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.955 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-13T16:13:01.955 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.955 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.955 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.955 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.955 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.955 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.955 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.955 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SECRET_KEY": { 2024-09-13T16:13:01.955 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-13T16:13:01.955 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.956 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.956 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.956 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.956 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.956 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.956 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.956 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.956 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.956 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.956 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.956 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SSL_VERIFY": { 2024-09-13T16:13:01.957 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-13T16:13:01.957 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.957 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.957 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.957 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.957 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.957 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.957 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.957 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.957 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.957 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.957 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.958 INFO:teuthology.orchestra.run.smithi017.stdout: "UNSAFE_TLS_v1_2": { 2024-09-13T16:13:01.958 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-13T16:13:01.958 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.958 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.958 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.958 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.958 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.958 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.958 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.958 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.958 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.959 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.959 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.959 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-13T16:13:01.959 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-13T16:13:01.959 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.959 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.959 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.959 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-13T16:13:01.959 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.959 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.959 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.960 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.960 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.960 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.960 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.960 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-13T16:13:01.960 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-13T16:13:01.960 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.960 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.960 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.960 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:01.961 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.961 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.961 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.961 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.961 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.961 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.961 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.961 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-13T16:13:01.961 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-13T16:13:01.961 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.961 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.962 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.962 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-13T16:13:01.962 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.962 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.962 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.962 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.962 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.962 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.962 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.962 INFO:teuthology.orchestra.run.smithi017.stdout: "cross_origin_url": { 2024-09-13T16:13:01.962 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cross_origin_url", 2024-09-13T16:13:01.963 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.963 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.963 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.963 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.963 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.963 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.963 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.963 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.963 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.963 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.963 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.964 INFO:teuthology.orchestra.run.smithi017.stdout: "crt_file": { 2024-09-13T16:13:01.964 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crt_file", 2024-09-13T16:13:01.964 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.964 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.964 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.964 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.964 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.964 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.964 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.964 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.964 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.965 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.965 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.965 INFO:teuthology.orchestra.run.smithi017.stdout: "debug": { 2024-09-13T16:13:01.965 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "debug", 2024-09-13T16:13:01.965 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.965 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.965 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.965 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.965 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.965 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.965 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.966 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable/disable debug options", 2024-09-13T16:13:01.966 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.966 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.966 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.966 INFO:teuthology.orchestra.run.smithi017.stdout: "jwt_token_ttl": { 2024-09-13T16:13:01.966 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "jwt_token_ttl", 2024-09-13T16:13:01.966 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.966 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.966 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.966 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "28800", 2024-09-13T16:13:01.966 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.967 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.967 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.967 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.967 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.967 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.967 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.967 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-13T16:13:01.967 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-13T16:13:01.967 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.967 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.968 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.968 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.968 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.968 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.968 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.968 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.968 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.968 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.968 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.968 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.968 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.969 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.969 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.969 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.969 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.969 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.969 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.969 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.969 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.969 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.969 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.969 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.969 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.970 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.970 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.970 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.970 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.970 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.970 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.970 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.970 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.970 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.970 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.970 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.971 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.971 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.971 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.971 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.971 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.971 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.971 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.971 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.971 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.971 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.971 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.972 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.972 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.972 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.972 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.972 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.972 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.972 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.972 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.972 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.972 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.972 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.973 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.973 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.973 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.973 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.973 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.973 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.973 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.973 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.973 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.973 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.974 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.974 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.974 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.974 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.974 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.974 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.974 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.974 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.974 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.974 INFO:teuthology.orchestra.run.smithi017.stdout: "motd": { 2024-09-13T16:13:01.974 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "motd", 2024-09-13T16:13:01.975 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.975 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.975 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.975 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.975 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.975 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.975 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.975 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "The message of the day", 2024-09-13T16:13:01.975 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.975 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.975 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.976 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect_resolve_ip_addr": { 2024-09-13T16:13:01.976 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "redirect_resolve_ip_addr", 2024-09-13T16:13:01.976 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.976 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.976 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.976 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.976 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.976 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.976 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.976 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.976 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.976 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.977 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.977 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-13T16:13:01.977 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-13T16:13:01.977 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.977 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.977 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.977 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-13T16:13:01.977 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.977 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.978 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.978 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.978 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.978 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.978 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.978 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-13T16:13:01.978 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-13T16:13:01.978 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.978 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.978 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.978 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8080", 2024-09-13T16:13:01.979 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.979 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.979 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.979 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.979 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.979 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.979 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.979 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-13T16:13:01.979 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-13T16:13:01.979 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.979 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.980 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.980 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.980 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.980 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.980 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.980 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.980 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.980 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.980 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.980 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl_server_port": { 2024-09-13T16:13:01.980 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl_server_port", 2024-09-13T16:13:01.981 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.981 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.981 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.981 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8443", 2024-09-13T16:13:01.981 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.981 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.981 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.981 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.981 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.981 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.981 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.982 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-13T16:13:01.982 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-13T16:13:01.982 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.982 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.982 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.982 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "redirect", 2024-09-13T16:13:01.982 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.982 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.982 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.982 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.982 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect" 2024-09-13T16:13:01.982 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.983 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.983 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.983 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.983 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.983 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-13T16:13:01.983 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-13T16:13:01.983 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:01.983 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.983 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.983 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-13T16:13:01.983 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-13T16:13:01.984 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-13T16:13:01.984 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.984 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.984 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.984 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.984 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.984 INFO:teuthology.orchestra.run.smithi017.stdout: "url_prefix": { 2024-09-13T16:13:01.984 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url_prefix", 2024-09-13T16:13:01.984 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.984 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.985 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:01.985 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.985 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.985 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.985 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.985 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.985 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.985 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.985 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.985 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.985 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:01.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:01.986 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2024-09-13T16:13:01.986 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:01.986 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:01.986 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:01.986 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_monitoring": { 2024-09-13T16:13:01.986 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_monitoring", 2024-09-13T16:13:01.986 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.986 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.986 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.986 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.987 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.987 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.987 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.987 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "monitor device health metrics", 2024-09-13T16:13:01.987 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.987 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.987 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.987 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:01.987 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:01.987 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.987 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.988 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.988 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:01.988 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.988 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.988 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.988 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.988 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.988 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.988 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.988 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.988 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.988 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.989 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.989 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.989 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.989 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.989 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:01.989 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:01.989 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.989 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.989 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.989 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.989 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.990 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.990 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.990 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.990 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.990 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.990 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.990 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:01.990 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:01.990 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.990 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.990 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.991 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:01.991 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.991 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.991 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:01.991 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:01.991 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:01.991 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:01.991 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:01.991 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:01.991 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:01.991 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:01.992 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.992 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.992 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.992 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.992 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:01.992 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:01.992 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.992 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.992 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.992 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:01.992 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.993 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.993 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.993 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:01.993 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.993 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.993 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.993 INFO:teuthology.orchestra.run.smithi017.stdout: "mark_out_threshold": { 2024-09-13T16:13:01.993 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mark_out_threshold", 2024-09-13T16:13:01.993 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.993 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.993 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.994 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2419200", 2024-09-13T16:13:01.994 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.994 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.994 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.994 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-13T16:13:01.994 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.994 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.994 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.994 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": { 2024-09-13T16:13:01.994 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_name", 2024-09-13T16:13:01.995 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:01.995 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.995 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.995 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "device_health_metrics", 2024-09-13T16:13:01.995 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.995 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.995 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.995 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-13T16:13:01.995 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.995 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.995 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.996 INFO:teuthology.orchestra.run.smithi017.stdout: "retention_period": { 2024-09-13T16:13:01.996 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retention_period", 2024-09-13T16:13:01.996 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.996 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.996 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.996 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15552000", 2024-09-13T16:13:01.996 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.996 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.996 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.996 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain device health metrics", 2024-09-13T16:13:01.996 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.997 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.997 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.997 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_frequency": { 2024-09-13T16:13:01.997 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_frequency", 2024-09-13T16:13:01.997 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.997 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.997 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.997 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-13T16:13:01.997 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.997 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.997 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.998 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-13T16:13:01.998 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.998 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.998 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.998 INFO:teuthology.orchestra.run.smithi017.stdout: "self_heal": { 2024-09-13T16:13:01.998 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "self_heal", 2024-09-13T16:13:01.998 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:01.998 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.998 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:01.998 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:01.998 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:01.999 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:01.999 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:01.999 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-13T16:13:01.999 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:01.999 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:01.999 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:01.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:01.999 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-13T16:13:01.999 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-13T16:13:01.999 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:01.999 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:01.999 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.000 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-13T16:13:02.000 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.000 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.000 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.000 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and check device health", 2024-09-13T16:13:02.000 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.000 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.000 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.000 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_threshold": { 2024-09-13T16:13:02.000 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_threshold", 2024-09-13T16:13:02.000 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:02.001 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.001 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.001 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7257600", 2024-09-13T16:13:02.001 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.001 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.001 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.001 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-13T16:13:02.001 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.001 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.001 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.001 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.001 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "diskprediction_local", 2024-09-13T16:13:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "predict_interval": { 2024-09-13T16:13:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predict_interval", 2024-09-13T16:13:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-13T16:13:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "predictor_model": { 2024-09-13T16:13:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predictor_model", 2024-09-13T16:13:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "prophetstor", 2024-09-13T16:13:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-13T16:13:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-13T16:13:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-13T16:13:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "influx", 2024-09-13T16:13:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": false, 2024-09-13T16:13:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "influxdb python module not found", 2024-09-13T16:13:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: "batch_size": { 2024-09-13T16:13:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "batch_size", 2024-09-13T16:13:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5000", 2024-09-13T16:13:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-13T16:13:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: "database": { 2024-09-13T16:13:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "database", 2024-09-13T16:13:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "ceph", 2024-09-13T16:13:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-13T16:13:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": { 2024-09-13T16:13:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hostname", 2024-09-13T16:13:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server hostname", 2024-09-13T16:13:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-13T16:13:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-13T16:13:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "30", 2024-09-13T16:13:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "5", 2024-09-13T16:13:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-13T16:13:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.023 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.023 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.023 INFO:teuthology.orchestra.run.smithi017.stdout: "password": { 2024-09-13T16:13:02.023 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "password", 2024-09-13T16:13:02.023 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.023 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.023 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.023 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "password of InfluxDB server user", 2024-09-13T16:13:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: "port": { 2024-09-13T16:13:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "port", 2024-09-13T16:13:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8086", 2024-09-13T16:13:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server port", 2024-09-13T16:13:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-13T16:13:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-13T16:13:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "false", 2024-09-13T16:13:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T16:13:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "threads": { 2024-09-13T16:13:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threads", 2024-09-13T16:13:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-13T16:13:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-13T16:13:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "32", 2024-09-13T16:13:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-13T16:13:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: "username": { 2024-09-13T16:13:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "username", 2024-09-13T16:13:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "username of InfluxDB server user", 2024-09-13T16:13:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: "verify_ssl": { 2024-09-13T16:13:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "verify_ssl", 2024-09-13T16:13:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "true", 2024-09-13T16:13:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T16:13:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "insights", 2024-09-13T16:13:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "iostat", 2024-09-13T16:13:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "k8sevents", 2024-09-13T16:13:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_event_retention_days": { 2024-09-13T16:13:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ceph_event_retention_days", 2024-09-13T16:13:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2024-09-13T16:13:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-13T16:13:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: "config_check_secs": { 2024-09-13T16:13:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_check_secs", 2024-09-13T16:13:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "10", 2024-09-13T16:13:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-13T16:13:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "localpool", 2024-09-13T16:13:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: "failure_domain": { 2024-09-13T16:13:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "failure_domain", 2024-09-13T16:13:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "host", 2024-09-13T16:13:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "failure domain for any created local pool", 2024-09-13T16:13:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-13T16:13:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": { 2024-09-13T16:13:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_size", 2024-09-13T16:13:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default min_size for any created local pool", 2024-09-13T16:13:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-13T16:13:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "num_rep": { 2024-09-13T16:13:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "num_rep", 2024-09-13T16:13:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2024-09-13T16:13:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default replica count for any created local pool", 2024-09-13T16:13:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": { 2024-09-13T16:13:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_num", 2024-09-13T16:13:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "128", 2024-09-13T16:13:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default pg_num for any created local pool", 2024-09-13T16:13:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: "prefix": { 2024-09-13T16:13:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prefix", 2024-09-13T16:13:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name prefix for any created local pool", 2024-09-13T16:13:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: "subtree": { 2024-09-13T16:13:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "subtree", 2024-09-13T16:13:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "rack", 2024-09-13T16:13:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-13T16:13:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-13T16:13:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mds_autoscaler", 2024-09-13T16:13:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirroring", 2024-09-13T16:13:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "nfs", 2024-09-13T16:13:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-13T16:13:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "fail_fs": { 2024-09-13T16:13:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "fail_fs", 2024-09-13T16:13:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-13T16:13:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator": { 2024-09-13T16:13:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-13T16:13:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2024-09-13T16:13:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "rook", 2024-09-13T16:13:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "test_orchestrator" 2024-09-13T16:13:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Orchestrator backend", 2024-09-13T16:13:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_perf_query", 2024-09-13T16:13:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_support", 2024-09-13T16:13:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_autoscaler", 2024-09-13T16:13:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-13T16:13:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-13T16:13:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-13T16:13:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "threshold": { 2024-09-13T16:13:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threshold", 2024-09-13T16:13:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-13T16:13:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-13T16:13:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1.0", 2024-09-13T16:13:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "scaling threshold", 2024-09-13T16:13:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-13T16:13:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "progress", 2024-09-13T16:13:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_pg_recovery_event": { 2024-09-13T16:13:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_pg_recovery_event", 2024-09-13T16:13:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-13T16:13:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-13T16:13:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-13T16:13:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "max_completed_events": { 2024-09-13T16:13:02.127 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_completed_events", 2024-09-13T16:13:02.127 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:02.127 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.127 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.127 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "50", 2024-09-13T16:13:02.127 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.127 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.127 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.127 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "number of past completed events to remember", 2024-09-13T16:13:02.127 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.127 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.128 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.128 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-13T16:13:02.128 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-13T16:13:02.128 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:02.128 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.128 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.128 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-13T16:13:02.128 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.128 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.128 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.128 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long the module is going to sleep", 2024-09-13T16:13:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus", 2024-09-13T16:13:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.129 INFO:teuthology.orchestra.run.smithi017.stdout: "cache": { 2024-09-13T16:13:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cache", 2024-09-13T16:13:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "exclude_perf_counters": { 2024-09-13T16:13:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "exclude_perf_counters", 2024-09-13T16:13:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-13T16:13:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-13T16:13:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.132 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.135 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.135 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.135 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.135 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.135 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.135 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.135 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.135 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.135 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.135 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.135 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.136 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.136 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.136 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.136 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.136 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.136 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.136 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.136 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.136 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.136 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.136 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.136 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.137 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.137 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.137 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.137 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.137 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.137 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.137 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.137 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.137 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.137 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.138 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.138 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.138 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.138 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.138 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools": { 2024-09-13T16:13:02.138 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools", 2024-09-13T16:13:02.138 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.138 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.138 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.138 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.138 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-13T16:13:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-13T16:13:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.139 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300", 2024-09-13T16:13:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_interval": { 2024-09-13T16:13:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_interval", 2024-09-13T16:13:02.140 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-13T16:13:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15.0", 2024-09-13T16:13:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.141 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-13T16:13:02.142 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-13T16:13:02.144 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.144 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.144 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.144 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-13T16:13:02.144 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.144 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.144 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.144 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-13T16:13:02.144 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-13T16:13:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-13T16:13:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "9283", 2024-09-13T16:13:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.145 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.146 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-13T16:13:02.146 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.146 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.146 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.146 INFO:teuthology.orchestra.run.smithi017.stdout: "stale_cache_strategy": { 2024-09-13T16:13:02.146 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stale_cache_strategy", 2024-09-13T16:13:02.146 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.146 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.146 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.146 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "log", 2024-09-13T16:13:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-13T16:13:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-13T16:13:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.147 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.148 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.148 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "default", 2024-09-13T16:13:02.148 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.148 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.148 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.148 INFO:teuthology.orchestra.run.smithi017.stdout: "default", 2024-09-13T16:13:02.148 INFO:teuthology.orchestra.run.smithi017.stdout: "error" 2024-09-13T16:13:02.148 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.148 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.148 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.148 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-13T16:13:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-13T16:13:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-13T16:13:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-13T16:13:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-13T16:13:02.149 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2024-09-13T16:13:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.150 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.151 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.152 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.152 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.152 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.152 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.152 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.152 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.152 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.152 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.152 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.152 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.153 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.153 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.153 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.153 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.153 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.153 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.153 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.153 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.153 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.153 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.153 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.154 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.154 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.154 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.154 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.154 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.154 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.154 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.154 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.154 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.154 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.154 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.156 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_snap_create": { 2024-09-13T16:13:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_snap_create", 2024-09-13T16:13:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-13T16:13:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.157 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: "mirror_snapshot_schedule": { 2024-09-13T16:13:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirror_snapshot_schedule", 2024-09-13T16:13:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.158 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: "trash_purge_schedule": { 2024-09-13T16:13:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "trash_purge_schedule", 2024-09-13T16:13:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.159 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.160 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "restful", 2024-09-13T16:13:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_auth": { 2024-09-13T16:13:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_auth", 2024-09-13T16:13:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.161 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-13T16:13:02.162 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-13T16:13:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.164 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.165 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.168 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.168 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.168 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.168 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.168 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.168 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.168 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.168 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.168 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.168 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.169 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.169 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.169 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.169 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.169 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.169 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.169 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.169 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.169 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.169 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.169 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.170 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-13T16:13:02.170 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-13T16:13:02.170 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.170 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.170 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.170 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.170 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.170 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.170 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.170 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.170 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.170 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.171 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.171 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-13T16:13:02.171 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-13T16:13:02.171 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.171 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.171 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.171 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.171 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.171 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.171 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.171 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.172 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.172 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.172 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.172 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.172 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.172 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rgw", 2024-09-13T16:13:02.172 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.172 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.172 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.173 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.173 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.173 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.173 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.173 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.173 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.173 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.173 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.173 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.173 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.173 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.173 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.174 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.174 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.174 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.174 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.174 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.174 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.174 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.174 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.174 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.174 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.174 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.175 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.175 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.175 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.175 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.175 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.175 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.175 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.175 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.175 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.175 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.176 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.176 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.176 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.176 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.176 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.176 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.176 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.176 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.176 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.176 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.176 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.177 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.177 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.177 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.177 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.177 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.177 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.177 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.177 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.177 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.177 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.177 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.178 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.178 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.178 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.178 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.178 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.178 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.178 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.178 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.178 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.178 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.178 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.178 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.179 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.179 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rook", 2024-09-13T16:13:02.179 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.179 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.179 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.179 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.179 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.179 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.179 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.179 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.180 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.180 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.180 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.180 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.180 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.180 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.180 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.180 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.180 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.180 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.180 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.181 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.181 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.181 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.181 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.181 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.181 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.181 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.181 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.181 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.181 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.181 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.182 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.182 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.182 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.182 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.182 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.182 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.182 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.182 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.182 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.182 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.182 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.183 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.183 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.183 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.183 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.183 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.183 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.183 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.183 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.183 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.183 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.183 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.183 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.184 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.184 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.184 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.184 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.184 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.184 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.184 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.184 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.184 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.184 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.184 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.185 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.185 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.185 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.185 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.185 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.185 INFO:teuthology.orchestra.run.smithi017.stdout: "storage_class": { 2024-09-13T16:13:02.185 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "storage_class", 2024-09-13T16:13:02.185 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.185 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.185 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.185 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "local", 2024-09-13T16:13:02.186 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.186 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.186 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.186 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-13T16:13:02.186 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.186 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.186 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.186 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.186 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.186 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "selftest", 2024-09-13T16:13:02.187 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.187 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.187 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.187 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.187 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.187 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.187 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.187 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.187 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.187 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.187 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.187 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.188 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.188 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.188 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.188 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.188 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.188 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.188 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.188 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.188 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.188 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.188 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.189 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.189 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.189 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.189 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.189 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.189 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.189 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.189 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.189 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.189 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.189 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.189 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.190 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.190 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.190 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.190 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.190 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.190 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.190 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.190 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.190 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.190 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.191 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.191 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.191 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.191 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.191 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.191 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.191 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.191 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.191 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.191 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.191 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.192 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.192 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.192 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.192 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.192 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.192 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.192 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.192 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.192 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.192 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.192 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.193 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.193 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.193 INFO:teuthology.orchestra.run.smithi017.stdout: "roption1": { 2024-09-13T16:13:02.193 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption1", 2024-09-13T16:13:02.193 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.193 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.193 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.193 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.193 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.193 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.194 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.194 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.194 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.194 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.194 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.194 INFO:teuthology.orchestra.run.smithi017.stdout: "roption2": { 2024-09-13T16:13:02.194 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption2", 2024-09-13T16:13:02.194 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.194 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.194 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.194 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "xyz", 2024-09-13T16:13:02.195 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.195 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.195 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.195 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.195 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.195 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.195 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.195 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption1": { 2024-09-13T16:13:02.195 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption1", 2024-09-13T16:13:02.195 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.195 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.196 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.196 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.196 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.196 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.196 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.196 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.196 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.196 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.196 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.196 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption2": { 2024-09-13T16:13:02.197 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption2", 2024-09-13T16:13:02.197 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:02.197 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.197 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.197 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.197 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.197 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.197 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.197 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.197 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.197 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.198 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.198 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption3": { 2024-09-13T16:13:02.198 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption3", 2024-09-13T16:13:02.198 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-13T16:13:02.198 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.198 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.198 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.198 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.198 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.198 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.198 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.199 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.199 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.199 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.199 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption4": { 2024-09-13T16:13:02.199 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption4", 2024-09-13T16:13:02.199 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.199 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.199 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.199 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.199 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.199 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.200 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.200 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.200 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.200 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.200 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.200 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption5": { 2024-09-13T16:13:02.200 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption5", 2024-09-13T16:13:02.200 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.200 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.200 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.201 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.201 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.201 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.201 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.201 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.201 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.201 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.201 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.201 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption6": { 2024-09-13T16:13:02.201 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption6", 2024-09-13T16:13:02.202 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.202 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.202 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.202 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:02.202 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.202 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.202 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.202 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.202 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.202 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.202 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.203 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption7": { 2024-09-13T16:13:02.203 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption7", 2024-09-13T16:13:02.203 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:02.203 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.203 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.203 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.203 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-13T16:13:02.203 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "42", 2024-09-13T16:13:02.203 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.203 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.203 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.203 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.204 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.204 INFO:teuthology.orchestra.run.smithi017.stdout: "testkey": { 2024-09-13T16:13:02.204 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testkey", 2024-09-13T16:13:02.204 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.204 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.204 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.204 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.204 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.204 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.204 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.204 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.205 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.205 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.205 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.205 INFO:teuthology.orchestra.run.smithi017.stdout: "testlkey": { 2024-09-13T16:13:02.205 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testlkey", 2024-09-13T16:13:02.205 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.205 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.205 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.205 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.205 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.205 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.206 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.206 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.206 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.206 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.206 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.206 INFO:teuthology.orchestra.run.smithi017.stdout: "testnewline": { 2024-09-13T16:13:02.206 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testnewline", 2024-09-13T16:13:02.206 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.206 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.206 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.206 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.207 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.207 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.207 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.207 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.207 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.207 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.207 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.207 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.207 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.207 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2024-09-13T16:13:02.208 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.208 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.208 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.208 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_m_granularity": { 2024-09-13T16:13:02.208 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_m_granularity", 2024-09-13T16:13:02.208 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.208 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.208 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.208 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.208 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.208 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.209 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.209 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow minute scheduled snapshots", 2024-09-13T16:13:02.209 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.209 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.209 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.209 INFO:teuthology.orchestra.run.smithi017.stdout: "dump_on_update": { 2024-09-13T16:13:02.209 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dump_on_update", 2024-09-13T16:13:02.209 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.209 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.209 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.209 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.210 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.210 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.210 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.210 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "dump database to debug log on update", 2024-09-13T16:13:02.210 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.210 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.210 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.210 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.210 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.210 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.211 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.211 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.211 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.211 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.211 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.211 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.211 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.211 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.211 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.211 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.211 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.212 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.212 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.212 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.212 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.212 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.212 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.212 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.212 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.212 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.212 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.212 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.213 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.213 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.213 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.213 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.213 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.213 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.213 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.213 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.213 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.213 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.214 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.214 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.214 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.214 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.214 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.214 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.214 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.214 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.214 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.214 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.214 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.214 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.215 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.215 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.215 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.215 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.215 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.215 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.215 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.215 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.215 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.215 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.215 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.216 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.216 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.216 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.216 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.216 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.216 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.216 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.216 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.216 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.216 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.217 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stats", 2024-09-13T16:13:02.217 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.217 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.217 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.217 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.217 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.217 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.217 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.217 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.217 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.217 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.217 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.218 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.218 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.218 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.218 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.218 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.218 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.218 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.218 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.218 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.218 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.218 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.218 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.219 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.219 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.219 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.219 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.219 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.219 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.219 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.219 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.219 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.219 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.219 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.220 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.220 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.220 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.220 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.220 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.220 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.220 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.220 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.220 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.220 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.221 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.221 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.221 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.221 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.221 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.221 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.221 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.221 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.221 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.221 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.221 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.221 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.222 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.222 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.222 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.222 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.222 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.222 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.222 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.222 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.222 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.222 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.222 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.223 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.223 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.223 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.223 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.223 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "status", 2024-09-13T16:13:02.223 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.223 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.223 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.223 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.223 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.223 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.224 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.224 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.224 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.224 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.224 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.224 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.224 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.224 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.224 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.224 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.224 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.225 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.225 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.225 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.225 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.225 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.225 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.225 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.225 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.225 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.225 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.226 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.226 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.226 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.226 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.226 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.226 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.226 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.226 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.226 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.226 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.226 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.227 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.227 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.227 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.227 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.227 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.227 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.227 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.227 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.227 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.227 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.227 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.227 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.228 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.228 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.228 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.228 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.228 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.228 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.228 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.228 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.228 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.228 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.228 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.229 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.229 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.229 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.229 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.229 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.229 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.229 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.229 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.229 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.229 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.230 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telegraf", 2024-09-13T16:13:02.230 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.230 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.230 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.230 INFO:teuthology.orchestra.run.smithi017.stdout: "address": { 2024-09-13T16:13:02.230 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "address", 2024-09-13T16:13:02.230 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.230 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.230 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.230 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-13T16:13:02.231 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.231 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.231 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.231 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.231 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.231 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.231 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.231 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-13T16:13:02.231 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-13T16:13:02.231 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:02.231 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.232 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.232 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15", 2024-09-13T16:13:02.232 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.232 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.232 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.232 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.232 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.232 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.232 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.232 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.232 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.233 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.233 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.233 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.233 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.233 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.233 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.233 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.233 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.233 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.233 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.233 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.234 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.235 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.236 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.237 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telemetry", 2024-09-13T16:13:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_basic": { 2024-09-13T16:13:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_basic", 2024-09-13T16:13:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.239 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-13T16:13:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_crash": { 2024-09-13T16:13:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_crash", 2024-09-13T16:13:02.240 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-13T16:13:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.241 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_device": { 2024-09-13T16:13:02.242 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_device", 2024-09-13T16:13:02.242 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.242 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.242 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.242 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:02.242 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.242 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.242 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.242 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-13T16:13:02.242 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.242 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.243 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.243 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_ident": { 2024-09-13T16:13:02.243 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_ident", 2024-09-13T16:13:02.243 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.243 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.243 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.243 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.243 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.243 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.243 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.243 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-13T16:13:02.244 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.244 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.244 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.244 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_perf": { 2024-09-13T16:13:02.244 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_perf", 2024-09-13T16:13:02.244 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.244 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.244 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.244 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.244 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.244 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.245 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.245 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-13T16:13:02.245 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.245 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.245 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.245 INFO:teuthology.orchestra.run.smithi017.stdout: "contact": { 2024-09-13T16:13:02.245 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "contact", 2024-09-13T16:13:02.245 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.245 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.245 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.245 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.246 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.246 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.246 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.246 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.246 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.246 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.246 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.246 INFO:teuthology.orchestra.run.smithi017.stdout: "description": { 2024-09-13T16:13:02.246 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "description", 2024-09-13T16:13:02.246 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.246 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.247 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.247 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.247 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.247 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.247 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.247 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.247 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.247 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.247 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.247 INFO:teuthology.orchestra.run.smithi017.stdout: "device_url": { 2024-09-13T16:13:02.247 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_url", 2024-09-13T16:13:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-13T16:13:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-13T16:13:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-13T16:13:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-13T16:13:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-13T16:13:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "24", 2024-09-13T16:13:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "8", 2024-09-13T16:13:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.250 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.251 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.251 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.251 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.251 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.251 INFO:teuthology.orchestra.run.smithi017.stdout: "last_opt_revision": { 2024-09-13T16:13:02.251 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "last_opt_revision", 2024-09-13T16:13:02.251 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:02.251 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.251 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.251 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1", 2024-09-13T16:13:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard": { 2024-09-13T16:13:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard", 2024-09-13T16:13:02.252 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.253 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard_description": { 2024-09-13T16:13:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard_description", 2024-09-13T16:13:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.254 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.255 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.256 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.257 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.258 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.259 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.260 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: "organization": { 2024-09-13T16:13:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "organization", 2024-09-13T16:13:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.261 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "proxy": { 2024-09-13T16:13:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "proxy", 2024-09-13T16:13:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.262 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "url": { 2024-09-13T16:13:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url", 2024-09-13T16:13:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-13T16:13:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "test_orchestrator", 2024-09-13T16:13:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.265 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.267 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.268 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.269 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.270 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2024-09-13T16:13:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.272 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.274 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.275 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.276 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.277 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_clones": { 2024-09-13T16:13:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_clones", 2024-09-13T16:13:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.278 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4", 2024-09-13T16:13:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-13T16:13:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_delay": { 2024-09-13T16:13:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_delay", 2024-09-13T16:13:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:02.279 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-13T16:13:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-13T16:13:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.280 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_no_wait": { 2024-09-13T16:13:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_no_wait", 2024-09-13T16:13:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-13T16:13:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-13T16:13:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.281 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix", 2024-09-13T16:13:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-13T16:13:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-13T16:13:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-13T16:13:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "discovery_interval": { 2024-09-13T16:13:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "discovery_interval", 2024-09-13T16:13:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-13T16:13:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "100", 2024-09-13T16:13:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "identifier": { 2024-09-13T16:13:02.283 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "identifier", 2024-09-13T16:13:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.284 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-13T16:13:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-13T16:13:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-13T16:13:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-13T16:13:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.285 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-13T16:13:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-13T16:13:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.286 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-13T16:13:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-13T16:13:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.288 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-13T16:13:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-13T16:13:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-13T16:13:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.289 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-13T16:13:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-13T16:13:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-13T16:13:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-13T16:13:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-13T16:13:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-13T16:13:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-13T16:13:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-13T16:13:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-13T16:13:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-13T16:13:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-13T16:13:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-13T16:13:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.291 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_host": { 2024-09-13T16:13:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_host", 2024-09-13T16:13:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-13T16:13:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.292 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_port": { 2024-09-13T16:13:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_port", 2024-09-13T16:13:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-13T16:13:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10051", 2024-09-13T16:13:02.293 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_sender": { 2024-09-13T16:13:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_sender", 2024-09-13T16:13:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-13T16:13:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-13T16:13:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-13T16:13:02.294 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-13T16:13:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-13T16:13:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-13T16:13:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-13T16:13:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-13T16:13:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-13T16:13:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-13T16:13:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-13T16:13:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.295 INFO:teuthology.orchestra.run.smithi017.stdout: "services": { 2024-09-13T16:13:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "dashboard": "https://172.21.15.17:8443/" 2024-09-13T16:13:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "always_on_modules": { 2024-09-13T16:13:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "octopus": [ 2024-09-13T16:13:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-09-13T16:13:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-13T16:13:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-09-13T16:13:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-09-13T16:13:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-09-13T16:13:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-09-13T16:13:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-09-13T16:13:02.296 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-09-13T16:13:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-09-13T16:13:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-09-13T16:13:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "pacific": [ 2024-09-13T16:13:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-09-13T16:13:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-13T16:13:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-09-13T16:13:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-09-13T16:13:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-09-13T16:13:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-09-13T16:13:02.297 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-09-13T16:13:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-09-13T16:13:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-09-13T16:13:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-09-13T16:13:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "quincy": [ 2024-09-13T16:13:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-09-13T16:13:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-13T16:13:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-09-13T16:13:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-09-13T16:13:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-09-13T16:13:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-09-13T16:13:02.298 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-09-13T16:13:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-09-13T16:13:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-09-13T16:13:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-09-13T16:13:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-13T16:13:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "reef": [ 2024-09-13T16:13:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-09-13T16:13:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-13T16:13:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-09-13T16:13:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-09-13T16:13:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-09-13T16:13:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-09-13T16:13:02.299 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-09-13T16:13:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-09-13T16:13:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-09-13T16:13:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-09-13T16:13:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-13T16:13:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "last_failure_osd_epoch": 3, 2024-09-13T16:13:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "active_clients": [ 2024-09-13T16:13:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2024-09-13T16:13:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-13T16:13:02.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-13T16:13:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-09-13T16:13:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3640681841 2024-09-13T16:13:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-13T16:13:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "libcephsqlite", 2024-09-13T16:13:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-13T16:13:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-13T16:13:02.301 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-09-13T16:13:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 327172059 2024-09-13T16:13:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-13T16:13:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2024-09-13T16:13:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-13T16:13:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-13T16:13:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-09-13T16:13:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3784934266 2024-09-13T16:13:02.302 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-13T16:13:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2024-09-13T16:13:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-13T16:13:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-13T16:13:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-13T16:13:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-09-13T16:13:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3556133227 2024-09-13T16:13:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-13T16:13:02.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-13T16:13:02.304 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-13T16:13:02.306 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:00 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/2255837648' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:13:02.306 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:00 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1648692134' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:13:02.306 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:00 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/2286363382' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-13T16:13:02.306 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:01 smithi193 ceph-mon[35248]: pgmap v843: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.2 MiB/s wr, 705 op/s 2024-09-13T16:13:02.306 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:00 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/2255837648' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:13:02.306 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:00 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1648692134' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:13:02.306 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:00 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/2286363382' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-13T16:13:02.306 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:01 smithi189 ceph-mon[34790]: pgmap v843: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.2 MiB/s wr, 705 op/s 2024-09-13T16:13:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.816+0000 7fea30600640 1 -- 172.21.15.17:0/2286363382 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fea100a1090 msgr2=0x7fea100a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.816+0000 7fea30600640 1 --2- 172.21.15.17:0/2286363382 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fea100a1090 0x7fea100a3550 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0058c0 tx=0x7fea1c005f90 comp rx=0 tx=0).stop 2024-09-13T16:13:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.816+0000 7fea30600640 1 -- 172.21.15.17:0/2286363382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea28100f90 msgr2=0x7fea281984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.816+0000 7fea30600640 1 --2- 172.21.15.17:0/2286363382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea28100f90 0x7fea281984f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fea1400e9f0 tx=0x7fea1400eeb0 comp rx=0 tx=0).stop 2024-09-13T16:13:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.816+0000 7fea30600640 1 -- 172.21.15.17:0/2286363382 shutdown_connections 2024-09-13T16:13:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.816+0000 7fea30600640 1 --2- 172.21.15.17:0/2286363382 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fea100a1090 0x7fea100a3550 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.816+0000 7fea30600640 1 --2- 172.21.15.17:0/2286363382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea28101950 0x7fea2819f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.816+0000 7fea30600640 1 --2- 172.21.15.17:0/2286363382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea28100f90 0x7fea281984f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.816+0000 7fea30600640 1 --2- 172.21.15.17:0/2286363382 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea280ffda0 0x7fea28197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.816+0000 7fea30600640 1 -- 172.21.15.17:0/2286363382 >> 172.21.15.17:0/2286363382 conn(0x7fea280fb520 msgr2=0x7fea28106760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.816+0000 7fea30600640 1 -- 172.21.15.17:0/2286363382 shutdown_connections 2024-09-13T16:13:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:00.816+0000 7fea30600640 1 -- 172.21.15.17:0/2286363382 wait complete. 2024-09-13T16:13:02.376 DEBUG:tasks.check_counter:Getting stats from a 2024-09-13T16:13:02.376 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-13T16:13:02.377 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:00 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/2255837648' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:13:02.377 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:00 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1648692134' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:13:02.377 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:00 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/2286363382' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-13T16:13:02.377 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:01 smithi017 ceph-mon[30494]: pgmap v843: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.2 MiB/s wr, 705 op/s 2024-09-13T16:13:02.710 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:13:04.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:03 smithi017 ceph-mon[30494]: pgmap v844: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 4.7 MiB/s wr, 558 op/s 2024-09-13T16:13:04.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:03 smithi189 ceph-mon[34790]: pgmap v844: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 4.7 MiB/s wr, 558 op/s 2024-09-13T16:13:04.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:03 smithi193 ceph-mon[35248]: pgmap v844: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 4.7 MiB/s wr, 558 op/s 2024-09-13T16:13:06.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:05 smithi189 ceph-mon[34790]: pgmap v845: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 3.4 MiB/s wr, 411 op/s 2024-09-13T16:13:06.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:05 smithi017 ceph-mon[30494]: pgmap v845: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 3.4 MiB/s wr, 411 op/s 2024-09-13T16:13:06.131 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-13T16:13:06.131 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:06.131 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 0, 2024-09-13T16:13:06.131 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 2, 2024-09-13T16:13:06.131 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 0, 2024-09-13T16:13:06.131 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 0, 2024-09-13T16:13:06.131 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2024-09-13T16:13:06.131 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 0, 2024-09-13T16:13:06.132 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.003496404, 2024-09-13T16:13:06.132 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.000000000, 2024-09-13T16:13:06.132 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.000588118, 2024-09-13T16:13:06.132 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:06.132 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:06.132 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:06.132 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:06.132 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:06.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:06.132 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:06.132 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:06.133 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:06.133 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:06.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:06.133 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T16:13:06.133 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T16:13:06.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:06.133 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:06.133 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 302, 2024-09-13T16:13:06.134 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 297, 2024-09-13T16:13:06.134 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 498192, 2024-09-13T16:13:06.134 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 168864, 2024-09-13T16:13:06.134 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 2, 2024-09-13T16:13:06.134 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2024-09-13T16:13:06.134 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.107822531, 2024-09-13T16:13:06.134 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.068619584, 2024-09-13T16:13:06.134 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.041569648, 2024-09-13T16:13:06.134 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:06.134 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:06.135 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 297, 2024-09-13T16:13:06.135 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.076951639, 2024-09-13T16:13:06.135 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000259096 2024-09-13T16:13:06.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:06.135 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:06.135 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:06.135 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:06.135 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:06.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:06.135 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 498192, 2024-09-13T16:13:06.136 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 168864 2024-09-13T16:13:06.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:06.136 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:06.136 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 2, 2024-09-13T16:13:06.136 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 225, 2024-09-13T16:13:06.136 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 320, 2024-09-13T16:13:06.136 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 192208, 2024-09-13T16:13:06.136 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2024-09-13T16:13:06.136 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 2, 2024-09-13T16:13:06.136 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.031919962, 2024-09-13T16:13:06.137 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.026114424, 2024-09-13T16:13:06.137 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.003163828, 2024-09-13T16:13:06.137 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:06.137 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:06.137 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 223, 2024-09-13T16:13:06.137 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.057953062, 2024-09-13T16:13:06.137 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000259879 2024-09-13T16:13:06.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:06.137 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:06.138 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:06.138 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:06.138 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:06.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:06.138 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-13T16:13:06.138 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 192208 2024-09-13T16:13:06.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:06.138 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-09-13T16:13:06.138 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 0, 2024-09-13T16:13:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-09-13T16:13:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-09-13T16:13:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-09-13T16:13:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 148721, 2024-09-13T16:13:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 30, 2024-09-13T16:13:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2024-09-13T16:13:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2024-09-13T16:13:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-09-13T16:13:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-09-13T16:13:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 0, 2024-09-13T16:13:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 0, 2024-09-13T16:13:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-09-13T16:13:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 928, 2024-09-13T16:13:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 2, 2024-09-13T16:13:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-09-13T16:13:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-09-13T16:13:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-13T16:13:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-13T16:13:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-13T16:13:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 300, 2024-09-13T16:13:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 453070, 2024-09-13T16:13:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 300, 2024-09-13T16:13:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-13T16:13:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-13T16:13:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 300, 2024-09-13T16:13:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 453070, 2024-09-13T16:13:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-13T16:13:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:06.147 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-13T16:13:06.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:05 smithi193 ceph-mon[35248]: pgmap v845: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 3.4 MiB/s wr, 411 op/s 2024-09-13T16:13:06.909 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-13T16:13:06.909 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-13T16:13:06.910 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-13T16:13:06.910 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-13T16:13:06.910 DEBUG:tasks.check_counter:Getting stats from d 2024-09-13T16:13:06.910 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-13T16:13:07.234 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:13:07.953 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:07 smithi017 ceph-mon[30494]: pgmap v846: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 3.2 MiB/s wr, 385 op/s 2024-09-13T16:13:07.953 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:07 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:13:08.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:07 smithi189 ceph-mon[34790]: pgmap v846: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 3.2 MiB/s wr, 385 op/s 2024-09-13T16:13:08.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:07 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:13:08.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:07 smithi193 ceph-mon[35248]: pgmap v846: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 3.2 MiB/s wr, 385 op/s 2024-09-13T16:13:08.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:07 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:13:09.629 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-13T16:13:09.629 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:09.629 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 304, 2024-09-13T16:13:09.629 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 301, 2024-09-13T16:13:09.629 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 496832, 2024-09-13T16:13:09.629 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 171968, 2024-09-13T16:13:09.629 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2024-09-13T16:13:09.629 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 0, 2024-09-13T16:13:09.629 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.088531392, 2024-09-13T16:13:09.629 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.051214656, 2024-09-13T16:13:09.630 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.035366589, 2024-09-13T16:13:09.630 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:09.630 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:09.630 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 300, 2024-09-13T16:13:09.630 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.061021365, 2024-09-13T16:13:09.630 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000203404 2024-09-13T16:13:09.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:09.630 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:09.630 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:09.631 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:09.631 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:09.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:09.631 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 496832, 2024-09-13T16:13:09.631 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 171968 2024-09-13T16:13:09.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:09.631 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:09.631 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 6, 2024-09-13T16:13:09.631 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 231, 2024-09-13T16:13:09.631 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 3312, 2024-09-13T16:13:09.631 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 193360, 2024-09-13T16:13:09.631 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2024-09-13T16:13:09.631 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 2, 2024-09-13T16:13:09.632 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.035394718, 2024-09-13T16:13:09.632 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.027468755, 2024-09-13T16:13:09.632 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.005208831, 2024-09-13T16:13:09.632 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:09.632 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:09.632 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 230, 2024-09-13T16:13:09.632 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.072384381, 2024-09-13T16:13:09.632 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000314714 2024-09-13T16:13:09.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:09.632 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:09.632 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:09.632 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:09.633 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:09.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:09.633 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-13T16:13:09.633 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 193360 2024-09-13T16:13:09.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:09.633 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:09.633 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 0, 2024-09-13T16:13:09.633 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 2, 2024-09-13T16:13:09.633 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 0, 2024-09-13T16:13:09.633 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 0, 2024-09-13T16:13:09.633 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 2, 2024-09-13T16:13:09.633 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2024-09-13T16:13:09.633 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.000843862, 2024-09-13T16:13:09.633 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.000000000, 2024-09-13T16:13:09.634 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.000645438, 2024-09-13T16:13:09.634 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:09.634 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:09.634 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:09.634 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:09.634 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:09.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:09.634 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:09.634 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:09.635 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:09.635 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:09.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:09.635 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T16:13:09.635 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T16:13:09.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:09.636 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-09-13T16:13:09.636 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 0, 2024-09-13T16:13:09.636 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-09-13T16:13:09.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:09.636 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-09-13T16:13:09.636 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:09.636 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:09.636 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:09.636 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:09.637 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:09.637 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:09.637 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:09.637 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:09.637 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:09.637 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:09.637 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:09.637 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:09.637 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:09.637 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:09.637 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:09.638 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:09.638 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:09.638 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:09.638 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:09.638 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:09.638 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:09.638 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:09.638 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:09.638 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:09.638 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:09.638 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:09.638 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:09.638 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:09.638 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:09.639 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:09.639 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:09.639 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-09-13T16:13:09.639 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:09.639 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:09.639 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:09.639 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:09.639 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 149735, 2024-09-13T16:13:09.639 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 30, 2024-09-13T16:13:09.639 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2024-09-13T16:13:09.639 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2024-09-13T16:13:09.639 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-09-13T16:13:09.639 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-09-13T16:13:09.640 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:09.640 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:09.640 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:09.640 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:09.640 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 0, 2024-09-13T16:13:09.640 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 0, 2024-09-13T16:13:09.640 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:09.640 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:09.640 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:09.640 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-09-13T16:13:09.640 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 928, 2024-09-13T16:13:09.640 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 2, 2024-09-13T16:13:09.640 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:09.640 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-09-13T16:13:09.641 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:09.641 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-09-13T16:13:09.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:09.641 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:09.641 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-13T16:13:09.641 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-13T16:13:09.641 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-13T16:13:09.641 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 306, 2024-09-13T16:13:09.641 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 453850, 2024-09-13T16:13:09.641 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:09.641 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 306, 2024-09-13T16:13:09.641 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-13T16:13:09.641 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-13T16:13:09.642 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 306, 2024-09-13T16:13:09.642 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 453850, 2024-09-13T16:13:09.642 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-13T16:13:09.642 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:09.642 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:09.642 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:09.642 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:09.642 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:09.642 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-13T16:13:10.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:09 smithi017 ceph-mon[30494]: pgmap v847: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.5 MiB/s wr, 186 op/s 2024-09-13T16:13:10.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:09 smithi189 ceph-mon[34790]: pgmap v847: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.5 MiB/s wr, 186 op/s 2024-09-13T16:13:10.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:09 smithi193 ceph-mon[35248]: pgmap v847: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.5 MiB/s wr, 186 op/s 2024-09-13T16:13:10.491 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-13T16:13:10.491 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-13T16:13:10.492 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-13T16:13:10.492 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-13T16:13:10.492 DEBUG:tasks.check_counter:Getting stats from g 2024-09-13T16:13:10.492 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-13T16:13:10.813 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:13:12.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:11 smithi189 ceph-mon[34790]: pgmap v848: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 909 KiB/s wr, 117 op/s 2024-09-13T16:13:12.243 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:11 smithi017 ceph-mon[30494]: pgmap v848: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 909 KiB/s wr, 117 op/s 2024-09-13T16:13:12.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:11 smithi193 ceph-mon[35248]: pgmap v848: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 909 KiB/s wr, 117 op/s 2024-09-13T16:13:12.970 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-13T16:13:12.970 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:12.970 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 3556, 2024-09-13T16:13:12.970 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 3788, 2024-09-13T16:13:12.970 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 2375659, 2024-09-13T16:13:12.970 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 6236209, 2024-09-13T16:13:12.971 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 10, 2024-09-13T16:13:12.971 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 4, 2024-09-13T16:13:12.971 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.537599767, 2024-09-13T16:13:12.971 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.200048172, 2024-09-13T16:13:12.971 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.306819832, 2024-09-13T16:13:12.971 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.074061048, 2024-09-13T16:13:12.971 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:12.971 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 3786, 2024-09-13T16:13:12.971 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 1.192088089, 2024-09-13T16:13:12.971 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000314867 2024-09-13T16:13:12.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.971 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:12.971 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 4810, 2024-09-13T16:13:12.971 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.002007353, 2024-09-13T16:13:12.972 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000417 2024-09-13T16:13:12.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.972 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T16:13:12.972 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T16:13:12.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.972 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:12.972 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 2583, 2024-09-13T16:13:12.972 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 4524, 2024-09-13T16:13:12.972 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 770526, 2024-09-13T16:13:12.972 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 2879148, 2024-09-13T16:13:12.972 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 13, 2024-09-13T16:13:12.972 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 7, 2024-09-13T16:13:12.972 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 1.423023427, 2024-09-13T16:13:12.973 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 1.139255916, 2024-09-13T16:13:12.973 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 1.700529359, 2024-09-13T16:13:12.973 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.003779973, 2024-09-13T16:13:12.973 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:12.973 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 4522, 2024-09-13T16:13:12.973 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 3.644948664, 2024-09-13T16:13:12.973 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000806047 2024-09-13T16:13:12.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.973 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:12.973 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2664, 2024-09-13T16:13:12.973 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.004622331, 2024-09-13T16:13:12.973 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000001735 2024-09-13T16:13:12.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.974 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T16:13:12.974 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 467056 2024-09-13T16:13:12.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.974 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:12.974 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 1973, 2024-09-13T16:13:12.974 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 2130, 2024-09-13T16:13:12.974 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 1528629, 2024-09-13T16:13:12.974 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 880606, 2024-09-13T16:13:12.974 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 7, 2024-09-13T16:13:12.974 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 6, 2024-09-13T16:13:12.974 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.297565165, 2024-09-13T16:13:12.974 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.116883110, 2024-09-13T16:13:12.974 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.210168739, 2024-09-13T16:13:12.974 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.010308089, 2024-09-13T16:13:12.975 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:12.975 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2130, 2024-09-13T16:13:12.975 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.614718045, 2024-09-13T16:13:12.975 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000288600 2024-09-13T16:13:12.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.975 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:12.975 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2794, 2024-09-13T16:13:12.975 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.003763455, 2024-09-13T16:13:12.975 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000001346 2024-09-13T16:13:12.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.975 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 647744, 2024-09-13T16:13:12.975 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 177744 2024-09-13T16:13:12.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.976 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-09-13T16:13:12.976 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 1, 2024-09-13T16:13:12.976 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-09-13T16:13:12.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.976 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-MDSRank": { 2024-09-13T16:13:12.976 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2024-09-13T16:13:12.976 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2024-09-13T16:13:12.976 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1505, 2024-09-13T16:13:12.976 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 1.321841781, 2024-09-13T16:13:12.976 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000878300 2024-09-13T16:13:12.976 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:12.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.976 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-PurgeQueue": { 2024-09-13T16:13:12.977 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2024-09-13T16:13:12.977 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2024-09-13T16:13:12.977 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 327, 2024-09-13T16:13:12.977 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.075897697, 2024-09-13T16:13:12.977 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000232103 2024-09-13T16:13:12.977 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:12.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.977 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-13T16:13:12.977 INFO:teuthology.orchestra.run.smithi017.stdout: "request": 1093, 2024-09-13T16:13:12.977 INFO:teuthology.orchestra.run.smithi017.stdout: "reply": 920, 2024-09-13T16:13:12.977 INFO:teuthology.orchestra.run.smithi017.stdout: "reply_latency": { 2024-09-13T16:13:12.977 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 920, 2024-09-13T16:13:12.977 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 4.107286712, 2024-09-13T16:13:12.977 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.004464442 2024-09-13T16:13:12.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.978 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_reply": 0, 2024-09-13T16:13:12.978 INFO:teuthology.orchestra.run.smithi017.stdout: "forward": 173, 2024-09-13T16:13:12.978 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_complete": 6, 2024-09-13T16:13:12.978 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_keys": 0, 2024-09-13T16:13:12.978 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_commit": 11, 2024-09-13T16:13:12.978 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_split": 0, 2024-09-13T16:13:12.978 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_merge": 0, 2024-09-13T16:13:12.978 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes": 621, 2024-09-13T16:13:12.978 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_top": 0, 2024-09-13T16:13:12.978 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_bottom": 0, 2024-09-13T16:13:12.978 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pin_tail": 621, 2024-09-13T16:13:12.978 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pinned": 621, 2024-09-13T16:13:12.979 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_expired": 1174, 2024-09-13T16:13:12.979 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_with_caps": 563, 2024-09-13T16:13:12.979 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": 563, 2024-09-13T16:13:12.979 INFO:teuthology.orchestra.run.smithi017.stdout: "subtrees": 20, 2024-09-13T16:13:12.979 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse": 1925, 2024-09-13T16:13:12.979 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_hit": 1557, 2024-09-13T16:13:12.979 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_forward": 170, 2024-09-13T16:13:12.979 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_discover": 36, 2024-09-13T16:13:12.979 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_dir_fetch": 3, 2024-09-13T16:13:12.979 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_remote_ino": 0, 2024-09-13T16:13:12.979 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_lock": 29, 2024-09-13T16:13:12.979 INFO:teuthology.orchestra.run.smithi017.stdout: "load_cent": 50705, 2024-09-13T16:13:12.979 INFO:teuthology.orchestra.run.smithi017.stdout: "q": 0, 2024-09-13T16:13:12.980 INFO:teuthology.orchestra.run.smithi017.stdout: "exported": 38, 2024-09-13T16:13:12.980 INFO:teuthology.orchestra.run.smithi017.stdout: "exported_inodes": 1165, 2024-09-13T16:13:12.980 INFO:teuthology.orchestra.run.smithi017.stdout: "imported": 39, 2024-09-13T16:13:12.980 INFO:teuthology.orchestra.run.smithi017.stdout: "imported_inodes": 1676, 2024-09-13T16:13:12.980 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_dir_fetch": 0, 2024-09-13T16:13:12.980 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_backtrace_fetch": 0, 2024-09-13T16:13:12.980 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_peer_discover": 0, 2024-09-13T16:13:12.980 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rfiles": 1022, 2024-09-13T16:13:12.980 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rbytes": 1584583718, 2024-09-13T16:13:12.980 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rsnaps": 0, 2024-09-13T16:13:12.980 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T16:13:12.980 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_set_tag": 0, 2024-09-13T16:13:12.981 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T16:13:12.981 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_inotable_repaired": 0, 2024-09-13T16:13:12.981 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_inodes": 0, 2024-09-13T16:13:12.981 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T16:13:12.981 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T16:13:12.981 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_file_inodes": 0, 2024-09-13T16:13:12.981 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_inode_file_caps": 6, 2024-09-13T16:13:12.981 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_revoke": 65, 2024-09-13T16:13:12.981 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_grant": 536, 2024-09-13T16:13:12.981 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T16:13:12.981 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T16:13:12.981 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T16:13:12.981 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps": 1001, 2024-09-13T16:13:12.981 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps_dirty": 441, 2024-09-13T16:13:12.982 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_cap_release": 81, 2024-09-13T16:13:12.982 INFO:teuthology.orchestra.run.smithi017.stdout: "process_request_cap_release": 415 2024-09-13T16:13:12.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.982 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache": { 2024-09-13T16:13:12.982 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update": 55, 2024-09-13T16:13:12.982 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update_receipt": 99, 2024-09-13T16:13:12.982 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_try_discover": 60, 2024-09-13T16:13:12.982 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_send_discover": 98, 2024-09-13T16:13:12.982 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_handle_discover": 151, 2024-09-13T16:13:12.982 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays": 0, 2024-09-13T16:13:12.982 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_delayed": 0, 2024-09-13T16:13:12.982 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_enqueuing": 0, 2024-09-13T16:13:12.982 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_created": 120, 2024-09-13T16:13:12.982 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_enqueued": 107, 2024-09-13T16:13:12.983 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_reintegrated": 13, 2024-09-13T16:13:12.983 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_migrated": 0, 2024-09-13T16:13:12.983 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_processing": 0, 2024-09-13T16:13:12.983 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_enqueued": 0, 2024-09-13T16:13:12.983 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_prioritized": 0, 2024-09-13T16:13:12.983 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_started": 0, 2024-09-13T16:13:12.983 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_completed": 0, 2024-09-13T16:13:12.983 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T16:13:12.983 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_exportdir": 38, 2024-09-13T16:13:12.983 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_flush": 0, 2024-09-13T16:13:12.983 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragmentdir": 0, 2024-09-13T16:13:12.983 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragstats": 0, 2024-09-13T16:13:12.983 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_inodestats": 0 2024-09-13T16:13:12.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.984 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log": { 2024-09-13T16:13:12.984 INFO:teuthology.orchestra.run.smithi017.stdout: "evadd": 1973, 2024-09-13T16:13:12.984 INFO:teuthology.orchestra.run.smithi017.stdout: "evex": 0, 2024-09-13T16:13:12.984 INFO:teuthology.orchestra.run.smithi017.stdout: "evtrm": 0, 2024-09-13T16:13:12.984 INFO:teuthology.orchestra.run.smithi017.stdout: "ev": 1973, 2024-09-13T16:13:12.984 INFO:teuthology.orchestra.run.smithi017.stdout: "evexg": 0, 2024-09-13T16:13:12.984 INFO:teuthology.orchestra.run.smithi017.stdout: "evexd": 0, 2024-09-13T16:13:12.984 INFO:teuthology.orchestra.run.smithi017.stdout: "segadd": 3, 2024-09-13T16:13:12.984 INFO:teuthology.orchestra.run.smithi017.stdout: "segex": 0, 2024-09-13T16:13:12.984 INFO:teuthology.orchestra.run.smithi017.stdout: "segtrm": 0, 2024-09-13T16:13:12.984 INFO:teuthology.orchestra.run.smithi017.stdout: "seg": 3, 2024-09-13T16:13:12.984 INFO:teuthology.orchestra.run.smithi017.stdout: "segexg": 0, 2024-09-13T16:13:12.984 INFO:teuthology.orchestra.run.smithi017.stdout: "segexd": 0, 2024-09-13T16:13:12.984 INFO:teuthology.orchestra.run.smithi017.stdout: "expos": 4194304, 2024-09-13T16:13:12.985 INFO:teuthology.orchestra.run.smithi017.stdout: "wrpos": 9391139, 2024-09-13T16:13:12.985 INFO:teuthology.orchestra.run.smithi017.stdout: "rdpos": 0, 2024-09-13T16:13:12.985 INFO:teuthology.orchestra.run.smithi017.stdout: "jlat": { 2024-09-13T16:13:12.985 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 769, 2024-09-13T16:13:12.985 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 22.670131892, 2024-09-13T16:13:12.985 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.029480015 2024-09-13T16:13:12.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.985 INFO:teuthology.orchestra.run.smithi017.stdout: "replayed": 0 2024-09-13T16:13:12.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.985 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_mem": { 2024-09-13T16:13:12.985 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 581, 2024-09-13T16:13:12.985 INFO:teuthology.orchestra.run.smithi017.stdout: "ino+": 1800, 2024-09-13T16:13:12.985 INFO:teuthology.orchestra.run.smithi017.stdout: "ino-": 1219, 2024-09-13T16:13:12.986 INFO:teuthology.orchestra.run.smithi017.stdout: "dir": 60, 2024-09-13T16:13:12.986 INFO:teuthology.orchestra.run.smithi017.stdout: "dir+": 131, 2024-09-13T16:13:12.986 INFO:teuthology.orchestra.run.smithi017.stdout: "dir-": 71, 2024-09-13T16:13:12.986 INFO:teuthology.orchestra.run.smithi017.stdout: "dn": 596, 2024-09-13T16:13:12.986 INFO:teuthology.orchestra.run.smithi017.stdout: "dn+": 1891, 2024-09-13T16:13:12.986 INFO:teuthology.orchestra.run.smithi017.stdout: "dn-": 1295, 2024-09-13T16:13:12.986 INFO:teuthology.orchestra.run.smithi017.stdout: "cap": 532, 2024-09-13T16:13:12.986 INFO:teuthology.orchestra.run.smithi017.stdout: "cap+": 1818, 2024-09-13T16:13:12.986 INFO:teuthology.orchestra.run.smithi017.stdout: "cap-": 1286, 2024-09-13T16:13:12.986 INFO:teuthology.orchestra.run.smithi017.stdout: "rss": 60360, 2024-09-13T16:13:12.986 INFO:teuthology.orchestra.run.smithi017.stdout: "heap": 198932 2024-09-13T16:13:12.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.986 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_server": { 2024-09-13T16:13:12.986 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_client_request": 1274, 2024-09-13T16:13:12.986 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_server_request": 42, 2024-09-13T16:13:12.987 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_request": 1093, 2024-09-13T16:13:12.987 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_session": 193, 2024-09-13T16:13:12.987 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_peer_request": 95, 2024-09-13T16:13:12.987 INFO:teuthology.orchestra.run.smithi017.stdout: "req_create_latency": { 2024-09-13T16:13:12.987 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 118, 2024-09-13T16:13:12.987 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.417589640, 2024-09-13T16:13:12.987 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.003538895 2024-09-13T16:13:12.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.987 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getattr_latency": { 2024-09-13T16:13:12.987 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 17, 2024-09-13T16:13:12.987 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 1.962296845, 2024-09-13T16:13:12.988 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.115429226 2024-09-13T16:13:12.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.988 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getfilelock_latency": { 2024-09-13T16:13:12.988 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:12.988 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:12.988 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:12.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.988 INFO:teuthology.orchestra.run.smithi017.stdout: "req_link_latency": { 2024-09-13T16:13:12.988 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 13, 2024-09-13T16:13:12.988 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.017669164, 2024-09-13T16:13:12.988 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.001359166 2024-09-13T16:13:12.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.988 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookup_latency": { 2024-09-13T16:13:12.988 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 467, 2024-09-13T16:13:12.989 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.929821031, 2024-09-13T16:13:12.989 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.001991051 2024-09-13T16:13:12.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.989 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookuphash_latency": { 2024-09-13T16:13:12.989 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:12.989 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:12.989 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:12.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.989 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupino_latency": { 2024-09-13T16:13:12.989 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1, 2024-09-13T16:13:12.989 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000102385, 2024-09-13T16:13:12.989 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000102385 2024-09-13T16:13:12.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.989 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupname_latency": { 2024-09-13T16:13:12.990 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:12.990 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:12.990 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:12.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.990 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupparent_latency": { 2024-09-13T16:13:12.990 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:12.990 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:12.990 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:12.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.990 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupsnap_latency": { 2024-09-13T16:13:12.990 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:12.990 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:12.990 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:12.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.991 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lssnap_latency": { 2024-09-13T16:13:12.991 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:12.991 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:12.991 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:12.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.991 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mkdir_latency": { 2024-09-13T16:13:12.992 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:12.992 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:12.992 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:12.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.992 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mknod_latency": { 2024-09-13T16:13:12.992 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:12.992 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:12.992 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:12.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.992 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mksnap_latency": { 2024-09-13T16:13:12.992 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:12.992 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:12.992 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:12.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.993 INFO:teuthology.orchestra.run.smithi017.stdout: "req_open_latency": { 2024-09-13T16:13:12.993 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 135, 2024-09-13T16:13:12.993 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.154374589, 2024-09-13T16:13:12.993 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.001143515 2024-09-13T16:13:12.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.993 INFO:teuthology.orchestra.run.smithi017.stdout: "req_readdir_latency": { 2024-09-13T16:13:12.993 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 33, 2024-09-13T16:13:12.993 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.059876411, 2024-09-13T16:13:12.993 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.001814436 2024-09-13T16:13:12.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.993 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rename_latency": { 2024-09-13T16:13:12.993 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 107, 2024-09-13T16:13:12.993 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.483033827, 2024-09-13T16:13:12.994 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.004514334 2024-09-13T16:13:12.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.994 INFO:teuthology.orchestra.run.smithi017.stdout: "req_renamesnap_latency": { 2024-09-13T16:13:12.994 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:12.994 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:12.994 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:12.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.994 INFO:teuthology.orchestra.run.smithi017.stdout: "req_snapdiff_latency": { 2024-09-13T16:13:12.994 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:12.994 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:12.994 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:12.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.994 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmdir_latency": { 2024-09-13T16:13:12.994 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:12.995 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:12.995 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:12.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.995 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmsnap_latency": { 2024-09-13T16:13:12.995 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:12.995 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:12.995 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:12.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.995 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmxattr_latency": { 2024-09-13T16:13:12.995 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:12.995 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:12.995 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:12.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.996 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setattr_latency": { 2024-09-13T16:13:12.996 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:12.996 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:12.996 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:12.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.996 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setdirlayout_latency": { 2024-09-13T16:13:12.996 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:12.996 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:12.996 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:12.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.996 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setfilelock_latency": { 2024-09-13T16:13:12.996 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:12.996 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:12.996 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:12.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.997 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setlayout_latency": { 2024-09-13T16:13:12.997 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:12.997 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:12.997 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:12.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.997 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setxattr_latency": { 2024-09-13T16:13:12.997 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:12.997 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:12.997 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:12.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.997 INFO:teuthology.orchestra.run.smithi017.stdout: "req_symlink_latency": { 2024-09-13T16:13:12.997 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:12.997 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:12.998 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:12.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.998 INFO:teuthology.orchestra.run.smithi017.stdout: "req_unlink_latency": { 2024-09-13T16:13:12.998 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 29, 2024-09-13T16:13:12.998 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.082522820, 2024-09-13T16:13:12.998 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.002845614 2024-09-13T16:13:12.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.998 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_revoke_eviction": 0, 2024-09-13T16:13:12.998 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_acquisition_throttle": 0, 2024-09-13T16:13:12.998 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getvxattr_latency": { 2024-09-13T16:13:12.998 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:12.998 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:12.998 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:12.998 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:12.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.999 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_sessions": { 2024-09-13T16:13:12.999 INFO:teuthology.orchestra.run.smithi017.stdout: "session_count": 1, 2024-09-13T16:13:12.999 INFO:teuthology.orchestra.run.smithi017.stdout: "session_add": 1, 2024-09-13T16:13:12.999 INFO:teuthology.orchestra.run.smithi017.stdout: "session_remove": 0, 2024-09-13T16:13:12.999 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_open": 1, 2024-09-13T16:13:12.999 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_stale": 0, 2024-09-13T16:13:12.999 INFO:teuthology.orchestra.run.smithi017.stdout: "total_load": 115, 2024-09-13T16:13:12.999 INFO:teuthology.orchestra.run.smithi017.stdout: "average_load": 115, 2024-09-13T16:13:12.999 INFO:teuthology.orchestra.run.smithi017.stdout: "avg_session_uptime": 946, 2024-09-13T16:13:12.999 INFO:teuthology.orchestra.run.smithi017.stdout: "mdthresh_evicted": 0 2024-09-13T16:13:12.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:12.999 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-09-13T16:13:12.999 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:13.000 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:13.000 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:13.000 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:13.000 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:13.000 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:13.000 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:13.000 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:13.000 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:13.000 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:13.000 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:13.000 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:13.000 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:13.000 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:13.001 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:13.001 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:13.001 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:13.001 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:13.001 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:13.001 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:13.001 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:13.001 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:13.001 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:13.001 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:13.001 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:13.001 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:13.001 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:13.001 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:13.002 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:13.002 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:13.002 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:13.002 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-09-13T16:13:13.002 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:13.002 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:13.002 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:13.002 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:13.002 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 321035, 2024-09-13T16:13:13.002 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 710, 2024-09-13T16:13:13.002 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 264, 2024-09-13T16:13:13.002 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 3, 2024-09-13T16:13:13.002 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-09-13T16:13:13.002 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-09-13T16:13:13.003 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:13.003 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:13.003 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:13.003 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:13.003 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 8864, 2024-09-13T16:13:13.003 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 167, 2024-09-13T16:13:13.003 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:13.003 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:13.003 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:13.003 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-09-13T16:13:13.004 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 2137464, 2024-09-13T16:13:13.004 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 21287, 2024-09-13T16:13:13.004 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:13.004 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-09-13T16:13:13.004 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:13.004 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-09-13T16:13:13.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:13.004 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter": { 2024-09-13T16:13:13.004 INFO:teuthology.orchestra.run.smithi017.stdout: "op_active": 0, 2024-09-13T16:13:13.004 INFO:teuthology.orchestra.run.smithi017.stdout: "op_laggy": 0, 2024-09-13T16:13:13.004 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send": 1274, 2024-09-13T16:13:13.004 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send_bytes": 5317370, 2024-09-13T16:13:13.004 INFO:teuthology.orchestra.run.smithi017.stdout: "op_resend": 27, 2024-09-13T16:13:13.005 INFO:teuthology.orchestra.run.smithi017.stdout: "op_reply": 1274, 2024-09-13T16:13:13.005 INFO:teuthology.orchestra.run.smithi017.stdout: "op_latency": { 2024-09-13T16:13:13.005 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1274, 2024-09-13T16:13:13.005 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 35.531659000, 2024-09-13T16:13:13.005 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.027889842 2024-09-13T16:13:13.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:13.005 INFO:teuthology.orchestra.run.smithi017.stdout: "op_inflight": 0, 2024-09-13T16:13:13.005 INFO:teuthology.orchestra.run.smithi017.stdout: "oplen_avg": { 2024-09-13T16:13:13.005 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1274, 2024-09-13T16:13:13.005 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 1393 2024-09-13T16:13:13.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:13.006 INFO:teuthology.orchestra.run.smithi017.stdout: "op": 1274, 2024-09-13T16:13:13.006 INFO:teuthology.orchestra.run.smithi017.stdout: "op_r": 52, 2024-09-13T16:13:13.006 INFO:teuthology.orchestra.run.smithi017.stdout: "op_w": 1222, 2024-09-13T16:13:13.006 INFO:teuthology.orchestra.run.smithi017.stdout: "op_rmw": 0, 2024-09-13T16:13:13.006 INFO:teuthology.orchestra.run.smithi017.stdout: "op_pg": 0, 2024-09-13T16:13:13.006 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_stat": 0, 2024-09-13T16:13:13.006 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_create": 10, 2024-09-13T16:13:13.006 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_read": 39, 2024-09-13T16:13:13.006 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_write": 808, 2024-09-13T16:13:13.006 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writefull": 97, 2024-09-13T16:13:13.007 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writesame": 0, 2024-09-13T16:13:13.007 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_append": 0, 2024-09-13T16:13:13.007 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_zero": 0, 2024-09-13T16:13:13.007 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_truncate": 0, 2024-09-13T16:13:13.007 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_delete": 227, 2024-09-13T16:13:13.007 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_mapext": 0, 2024-09-13T16:13:13.007 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_sparse_read": 0, 2024-09-13T16:13:13.007 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_clonerange": 0, 2024-09-13T16:13:13.007 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_getxattr": 4, 2024-09-13T16:13:13.007 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_setxattr": 20, 2024-09-13T16:13:13.007 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_cmpxattr": 0, 2024-09-13T16:13:13.007 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_rmxattr": 0, 2024-09-13T16:13:13.007 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_resetxattrs": 0, 2024-09-13T16:13:13.007 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_call": 0, 2024-09-13T16:13:13.008 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_watch": 0, 2024-09-13T16:13:13.008 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_notify": 0, 2024-09-13T16:13:13.008 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T16:13:13.008 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls": 0, 2024-09-13T16:13:13.008 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls_filter": 0, 2024-09-13T16:13:13.008 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_other": 0, 2024-09-13T16:13:13.008 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_active": 0, 2024-09-13T16:13:13.008 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_send": 0, 2024-09-13T16:13:13.008 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_resend": 0, 2024-09-13T16:13:13.008 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_ping": 0, 2024-09-13T16:13:13.008 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_active": 0, 2024-09-13T16:13:13.008 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_send": 0, 2024-09-13T16:13:13.008 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_resend": 0, 2024-09-13T16:13:13.008 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_active": 0, 2024-09-13T16:13:13.009 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_send": 0, 2024-09-13T16:13:13.009 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_resend": 0, 2024-09-13T16:13:13.009 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_active": 0, 2024-09-13T16:13:13.009 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_send": 0, 2024-09-13T16:13:13.009 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_resend": 0, 2024-09-13T16:13:13.009 INFO:teuthology.orchestra.run.smithi017.stdout: "command_active": 0, 2024-09-13T16:13:13.009 INFO:teuthology.orchestra.run.smithi017.stdout: "command_send": 0, 2024-09-13T16:13:13.009 INFO:teuthology.orchestra.run.smithi017.stdout: "command_resend": 0, 2024-09-13T16:13:13.009 INFO:teuthology.orchestra.run.smithi017.stdout: "map_epoch": 94, 2024-09-13T16:13:13.009 INFO:teuthology.orchestra.run.smithi017.stdout: "map_full": 0, 2024-09-13T16:13:13.009 INFO:teuthology.orchestra.run.smithi017.stdout: "map_inc": 4, 2024-09-13T16:13:13.009 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_sessions": 12, 2024-09-13T16:13:13.009 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_open": 12, 2024-09-13T16:13:13.009 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_close": 0, 2024-09-13T16:13:13.010 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_laggy": 0, 2024-09-13T16:13:13.010 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_wr": 132, 2024-09-13T16:13:13.010 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_rd": 19, 2024-09-13T16:13:13.010 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_del": 37 2024-09-13T16:13:13.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:13.010 INFO:teuthology.orchestra.run.smithi017.stdout: "oft": { 2024-09-13T16:13:13.010 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_objs": 1, 2024-09-13T16:13:13.010 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_kv_pairs": 0, 2024-09-13T16:13:13.010 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_updates": 0, 2024-09-13T16:13:13.010 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_removes": 0 2024-09-13T16:13:13.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:13.010 INFO:teuthology.orchestra.run.smithi017.stdout: "osd-slow-ops": { 2024-09-13T16:13:13.010 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_ops_count": 0 2024-09-13T16:13:13.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:13.011 INFO:teuthology.orchestra.run.smithi017.stdout: "purge_queue": { 2024-09-13T16:13:13.011 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops": 0, 2024-09-13T16:13:13.011 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops_high_water": 16, 2024-09-13T16:13:13.011 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing": 0, 2024-09-13T16:13:13.011 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_high_water": 8, 2024-09-13T16:13:13.011 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed_ops": 214, 2024-09-13T16:13:13.011 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed": 107, 2024-09-13T16:13:13.011 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_item_in_journal": 0 2024-09-13T16:13:13.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:13.011 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:13.011 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-13T16:13:13.011 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-13T16:13:13.011 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-13T16:13:13.011 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 8108, 2024-09-13T16:13:13.012 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 3963248, 2024-09-13T16:13:13.012 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:13.012 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 8108, 2024-09-13T16:13:13.012 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-13T16:13:13.012 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-13T16:13:13.012 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 8108, 2024-09-13T16:13:13.012 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 3963248, 2024-09-13T16:13:13.012 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-13T16:13:13.012 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:13.012 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:13.012 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:13.012 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:13.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:13.012 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_bytes": { 2024-09-13T16:13:13.013 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-13T16:13:13.013 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-13T16:13:13.013 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-13T16:13:13.013 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-13T16:13:13.013 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-13T16:13:13.013 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:13.013 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:13.013 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 1274, 2024-09-13T16:13:13.013 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 5328758, 2024-09-13T16:13:13.013 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 1274, 2024-09-13T16:13:13.013 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 5328758, 2024-09-13T16:13:13.013 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-13T16:13:13.013 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:13.013 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:13.014 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:13.014 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:13.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:13.014 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_ops": { 2024-09-13T16:13:13.014 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-13T16:13:13.014 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 1024, 2024-09-13T16:13:13.014 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-13T16:13:13.014 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-13T16:13:13.014 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-13T16:13:13.014 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:13.014 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:13.014 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 1274, 2024-09-13T16:13:13.014 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 1274, 2024-09-13T16:13:13.014 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 1274, 2024-09-13T16:13:13.015 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 1274, 2024-09-13T16:13:13.015 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-13T16:13:13.015 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:13.015 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:13.015 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:13.015 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:13.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:13.015 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle": { 2024-09-13T16:13:13.015 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-13T16:13:13.015 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2024-09-13T16:13:13.015 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-13T16:13:13.015 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 107, 2024-09-13T16:13:13.015 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 11663, 2024-09-13T16:13:13.015 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:13.016 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 107, 2024-09-13T16:13:13.016 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-13T16:13:13.016 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-13T16:13:13.016 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 39, 2024-09-13T16:13:13.016 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 11663, 2024-09-13T16:13:13.016 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-13T16:13:13.016 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:13.016 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:13.016 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:13.016 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:13.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:13.016 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle-0x563f84ac2500": { 2024-09-13T16:13:13.016 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-13T16:13:13.016 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2024-09-13T16:13:13.017 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-13T16:13:13.017 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 1973, 2024-09-13T16:13:13.017 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 5196835, 2024-09-13T16:13:13.017 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:13.017 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 1973, 2024-09-13T16:13:13.017 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-13T16:13:13.017 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-13T16:13:13.017 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 769, 2024-09-13T16:13:13.017 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 5196835, 2024-09-13T16:13:13.017 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-13T16:13:13.017 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:13.017 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:13.017 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:13.017 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:13.018 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:13.018 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-13T16:13:13.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:12 smithi189 ceph-mon[34790]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:13:13.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:12 smithi193 ceph-mon[35248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:13:13.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:12 smithi017 ceph-mon[30494]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T16:13:13.834 INFO:tasks.check_counter:Daemon mds.g mds.exported=38 2024-09-13T16:13:13.834 INFO:tasks.check_counter:Daemon mds.g mds.imported=39 2024-09-13T16:13:13.835 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=55 2024-09-13T16:13:13.835 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=99 2024-09-13T16:13:13.835 DEBUG:tasks.check_counter:Getting stats from j 2024-09-13T16:13:13.835 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-13T16:13:14.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:13 smithi189 ceph-mon[34790]: pgmap v849: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 343 KiB/s wr, 49 op/s 2024-09-13T16:13:14.158 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T16:13:14.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:13 smithi193 ceph-mon[35248]: pgmap v849: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 343 KiB/s wr, 49 op/s 2024-09-13T16:13:14.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:13 smithi017 ceph-mon[30494]: pgmap v849: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 343 KiB/s wr, 49 op/s 2024-09-13T16:13:15.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:15 smithi017 ceph-mon[30494]: pgmap v850: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 11 op/s 2024-09-13T16:13:16.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:15 smithi189 ceph-mon[34790]: pgmap v850: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 11 op/s 2024-09-13T16:13:16.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:15 smithi193 ceph-mon[35248]: pgmap v850: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 11 op/s 2024-09-13T16:13:16.338 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-13T16:13:16.338 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:16.338 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 306, 2024-09-13T16:13:16.338 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 303, 2024-09-13T16:13:16.338 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 497376, 2024-09-13T16:13:16.338 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 173152, 2024-09-13T16:13:16.338 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2024-09-13T16:13:16.339 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 0, 2024-09-13T16:13:16.339 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.064282767, 2024-09-13T16:13:16.339 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.023360205, 2024-09-13T16:13:16.339 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.040696858, 2024-09-13T16:13:16.339 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:16.339 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:16.339 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 302, 2024-09-13T16:13:16.339 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.084896874, 2024-09-13T16:13:16.339 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000281115 2024-09-13T16:13:16.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:16.339 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:16.339 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:16.340 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:16.340 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:16.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:16.340 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 497376, 2024-09-13T16:13:16.340 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 173152 2024-09-13T16:13:16.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:16.340 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:16.340 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 2, 2024-09-13T16:13:16.340 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 231, 2024-09-13T16:13:16.340 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 320, 2024-09-13T16:13:16.340 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 193264, 2024-09-13T16:13:16.340 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2024-09-13T16:13:16.340 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 2, 2024-09-13T16:13:16.341 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.038423110, 2024-09-13T16:13:16.341 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.031440598, 2024-09-13T16:13:16.341 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.003084110, 2024-09-13T16:13:16.341 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:16.341 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:16.341 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 229, 2024-09-13T16:13:16.341 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.070537364, 2024-09-13T16:13:16.341 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000308023 2024-09-13T16:13:16.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:16.341 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:16.341 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:16.341 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:16.341 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:16.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:16.342 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-13T16:13:16.342 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 193264 2024-09-13T16:13:16.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:16.342 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:16.342 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 4, 2024-09-13T16:13:16.342 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 4, 2024-09-13T16:13:16.342 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 2992, 2024-09-13T16:13:16.342 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 448, 2024-09-13T16:13:16.342 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 2, 2024-09-13T16:13:16.342 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2024-09-13T16:13:16.342 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.003740760, 2024-09-13T16:13:16.342 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.000067965, 2024-09-13T16:13:16.342 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.003591299, 2024-09-13T16:13:16.343 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:16.343 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:16.343 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 3, 2024-09-13T16:13:16.343 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.005741654, 2024-09-13T16:13:16.343 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.001913884 2024-09-13T16:13:16.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:16.343 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:16.343 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:16.343 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:16.343 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:16.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:16.343 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-13T16:13:16.343 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 448 2024-09-13T16:13:16.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:16.344 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-09-13T16:13:16.344 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 0, 2024-09-13T16:13:16.344 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-09-13T16:13:16.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:16.344 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-09-13T16:13:16.344 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:16.344 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:16.344 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:16.344 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:16.344 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:16.344 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:16.345 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:16.345 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:16.345 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:16.345 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:16.345 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:16.345 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:16.345 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:16.345 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:16.345 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:16.345 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:16.345 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:16.345 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:16.345 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:16.346 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:16.346 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:16.346 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:16.346 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:16.346 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:16.347 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:16.347 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:16.347 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:16.347 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:16.347 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:16.347 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:16.348 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:16.348 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-09-13T16:13:16.348 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:16.348 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:16.348 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:16.348 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:16.349 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 149735, 2024-09-13T16:13:16.349 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 30, 2024-09-13T16:13:16.349 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2024-09-13T16:13:16.349 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2024-09-13T16:13:16.349 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-09-13T16:13:16.349 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-09-13T16:13:16.350 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:16.350 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:16.350 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:16.350 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:16.350 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 0, 2024-09-13T16:13:16.350 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 0, 2024-09-13T16:13:16.351 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:16.351 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:16.351 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:16.351 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-09-13T16:13:16.351 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 928, 2024-09-13T16:13:16.351 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 2, 2024-09-13T16:13:16.351 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:16.352 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-09-13T16:13:16.352 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:16.352 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-09-13T16:13:16.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-13T16:13:16.352 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:16.352 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-13T16:13:16.353 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-13T16:13:16.353 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-13T16:13:16.353 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 308, 2024-09-13T16:13:16.353 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 454110, 2024-09-13T16:13:16.353 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:16.353 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 308, 2024-09-13T16:13:16.354 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-13T16:13:16.354 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-13T16:13:16.354 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 308, 2024-09-13T16:13:16.354 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 454110, 2024-09-13T16:13:16.354 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-13T16:13:16.354 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-13T16:13:16.354 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-13T16:13:16.354 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-13T16:13:16.355 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:16.355 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-13T16:13:16.355 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-13T16:13:17.231 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-13T16:13:17.231 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-13T16:13:17.231 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-13T16:13:17.231 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-13T16:13:17.231 DEBUG:tasks.check_counter:Getting stats from b 2024-09-13T16:13:17.232 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-13T16:13:17.502 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:13:17.964 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:17 smithi189 ceph-mon[34790]: pgmap v851: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 14 op/s 2024-09-13T16:13:18.240 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:17 smithi017 ceph-mon[30494]: pgmap v851: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 14 op/s 2024-09-13T16:13:18.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:17 smithi193 ceph-mon[35248]: pgmap v851: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 14 op/s 2024-09-13T16:13:19.556 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-13T16:13:19.556 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:19.557 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 5583, 2024-09-13T16:13:19.557 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 5352, 2024-09-13T16:13:19.557 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 2801284, 2024-09-13T16:13:19.557 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 12853411, 2024-09-13T16:13:19.557 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 147, 2024-09-13T16:13:19.557 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 7, 2024-09-13T16:13:19.557 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.399306013, 2024-09-13T16:13:19.557 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.128487717, 2024-09-13T16:13:19.557 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.216122000, 2024-09-13T16:13:19.557 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.067716951, 2024-09-13T16:13:19.557 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:19.558 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 5352, 2024-09-13T16:13:19.558 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 1.342357339, 2024-09-13T16:13:19.558 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000250814 2024-09-13T16:13:19.558 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.558 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:19.558 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 4811, 2024-09-13T16:13:19.558 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000859006, 2024-09-13T16:13:19.558 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000178 2024-09-13T16:13:19.558 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.558 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T16:13:19.558 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T16:13:19.558 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.559 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:19.559 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 6259, 2024-09-13T16:13:19.559 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 10036, 2024-09-13T16:13:19.559 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 2044100, 2024-09-13T16:13:19.559 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 7012742, 2024-09-13T16:13:19.559 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 14, 2024-09-13T16:13:19.559 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 6, 2024-09-13T16:13:19.559 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.452829187, 2024-09-13T16:13:19.559 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.172295945, 2024-09-13T16:13:19.559 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.260508064, 2024-09-13T16:13:19.559 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.092411000, 2024-09-13T16:13:19.560 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:19.560 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 10035, 2024-09-13T16:13:19.560 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 2.209313187, 2024-09-13T16:13:19.560 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000220160 2024-09-13T16:13:19.560 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.560 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:19.560 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 5984, 2024-09-13T16:13:19.560 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.001958250, 2024-09-13T16:13:19.560 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000327 2024-09-13T16:13:19.560 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.560 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 59152, 2024-09-13T16:13:19.560 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 596016 2024-09-13T16:13:19.561 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.561 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:19.561 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 3508, 2024-09-13T16:13:19.561 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 3787, 2024-09-13T16:13:19.561 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 1824492, 2024-09-13T16:13:19.561 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 2943691, 2024-09-13T16:13:19.561 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 11, 2024-09-13T16:13:19.561 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 7, 2024-09-13T16:13:19.561 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.256762251, 2024-09-13T16:13:19.561 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.095000881, 2024-09-13T16:13:19.561 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.204521336, 2024-09-13T16:13:19.561 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.038780795, 2024-09-13T16:13:19.561 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:19.561 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3784, 2024-09-13T16:13:19.562 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 1.307342017, 2024-09-13T16:13:19.562 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000345492 2024-09-13T16:13:19.562 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.562 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:19.562 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3419, 2024-09-13T16:13:19.562 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000679933, 2024-09-13T16:13:19.562 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000198 2024-09-13T16:13:19.562 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.562 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 657088, 2024-09-13T16:13:19.562 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 179776 2024-09-13T16:13:19.562 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.562 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-13T16:13:19.562 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 1, 2024-09-13T16:13:19.563 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-13T16:13:19.563 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.563 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-MDSRank": { 2024-09-13T16:13:19.563 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-13T16:13:19.563 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-13T16:13:19.563 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3505, 2024-09-13T16:13:19.563 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 1.637087592, 2024-09-13T16:13:19.563 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000467072 2024-09-13T16:13:19.563 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-13T16:13:19.563 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.563 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-PurgeQueue": { 2024-09-13T16:13:19.563 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-13T16:13:19.563 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-13T16:13:19.564 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 509, 2024-09-13T16:13:19.564 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.023481210, 2024-09-13T16:13:19.564 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000046132 2024-09-13T16:13:19.564 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-13T16:13:19.564 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.564 INFO:teuthology.orchestra.run.smithi189.stdout: "mds": { 2024-09-13T16:13:19.564 INFO:teuthology.orchestra.run.smithi189.stdout: "request": 2259, 2024-09-13T16:13:19.564 INFO:teuthology.orchestra.run.smithi189.stdout: "reply": 2180, 2024-09-13T16:13:19.564 INFO:teuthology.orchestra.run.smithi189.stdout: "reply_latency": { 2024-09-13T16:13:19.564 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 2180, 2024-09-13T16:13:19.564 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 6.044570622, 2024-09-13T16:13:19.564 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.002772738 2024-09-13T16:13:19.564 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.565 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_reply": 0, 2024-09-13T16:13:19.565 INFO:teuthology.orchestra.run.smithi189.stdout: "forward": 79, 2024-09-13T16:13:19.565 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_complete": 2, 2024-09-13T16:13:19.565 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_keys": 0, 2024-09-13T16:13:19.565 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_commit": 529, 2024-09-13T16:13:19.565 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_split": 3, 2024-09-13T16:13:19.565 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_merge": 0, 2024-09-13T16:13:19.565 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes": 364, 2024-09-13T16:13:19.565 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_top": 1, 2024-09-13T16:13:19.565 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_bottom": 350, 2024-09-13T16:13:19.565 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pin_tail": 13, 2024-09-13T16:13:19.565 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pinned": 363, 2024-09-13T16:13:19.566 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_expired": 1893, 2024-09-13T16:13:19.566 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_with_caps": 331, 2024-09-13T16:13:19.566 INFO:teuthology.orchestra.run.smithi189.stdout: "caps": 331, 2024-09-13T16:13:19.566 INFO:teuthology.orchestra.run.smithi189.stdout: "subtrees": 20, 2024-09-13T16:13:19.566 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse": 2988, 2024-09-13T16:13:19.566 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_hit": 2306, 2024-09-13T16:13:19.566 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_forward": 78, 2024-09-13T16:13:19.566 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_discover": 16, 2024-09-13T16:13:19.566 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_dir_fetch": 2, 2024-09-13T16:13:19.566 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_remote_ino": 0, 2024-09-13T16:13:19.566 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_lock": 75, 2024-09-13T16:13:19.566 INFO:teuthology.orchestra.run.smithi189.stdout: "load_cent": 2612, 2024-09-13T16:13:19.566 INFO:teuthology.orchestra.run.smithi189.stdout: "q": 0, 2024-09-13T16:13:19.567 INFO:teuthology.orchestra.run.smithi189.stdout: "exported": 49, 2024-09-13T16:13:19.567 INFO:teuthology.orchestra.run.smithi189.stdout: "exported_inodes": 1869, 2024-09-13T16:13:19.567 INFO:teuthology.orchestra.run.smithi189.stdout: "imported": 41, 2024-09-13T16:13:19.567 INFO:teuthology.orchestra.run.smithi189.stdout: "imported_inodes": 1180, 2024-09-13T16:13:19.567 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_dir_fetch": 0, 2024-09-13T16:13:19.567 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_backtrace_fetch": 0, 2024-09-13T16:13:19.567 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_peer_discover": 0, 2024-09-13T16:13:19.567 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rfiles": 1021, 2024-09-13T16:13:19.567 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rbytes": 1538675918, 2024-09-13T16:13:19.567 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rsnaps": 0, 2024-09-13T16:13:19.567 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T16:13:19.567 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_set_tag": 0, 2024-09-13T16:13:19.567 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T16:13:19.568 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_inotable_repaired": 0, 2024-09-13T16:13:19.568 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_inodes": 0, 2024-09-13T16:13:19.568 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T16:13:19.568 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T16:13:19.568 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_file_inodes": 0, 2024-09-13T16:13:19.568 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_inode_file_caps": 5, 2024-09-13T16:13:19.568 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_revoke": 109, 2024-09-13T16:13:19.568 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_grant": 1591, 2024-09-13T16:13:19.568 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T16:13:19.568 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T16:13:19.568 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T16:13:19.568 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps": 1356, 2024-09-13T16:13:19.568 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps_dirty": 1115, 2024-09-13T16:13:19.568 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_cap_release": 82, 2024-09-13T16:13:19.569 INFO:teuthology.orchestra.run.smithi189.stdout: "process_request_cap_release": 697 2024-09-13T16:13:19.569 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.569 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_cache": { 2024-09-13T16:13:19.569 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update": 97, 2024-09-13T16:13:19.569 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update_receipt": 149, 2024-09-13T16:13:19.569 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_try_discover": 79, 2024-09-13T16:13:19.569 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_send_discover": 142, 2024-09-13T16:13:19.569 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_handle_discover": 175, 2024-09-13T16:13:19.569 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays": 0, 2024-09-13T16:13:19.569 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_delayed": 0, 2024-09-13T16:13:19.569 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_enqueuing": 0, 2024-09-13T16:13:19.569 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_created": 167, 2024-09-13T16:13:19.569 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_enqueued": 144, 2024-09-13T16:13:19.570 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_reintegrated": 23, 2024-09-13T16:13:19.570 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_migrated": 0, 2024-09-13T16:13:19.570 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_processing": 0, 2024-09-13T16:13:19.570 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_enqueued": 0, 2024-09-13T16:13:19.570 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_prioritized": 0, 2024-09-13T16:13:19.570 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_started": 0, 2024-09-13T16:13:19.570 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_completed": 0, 2024-09-13T16:13:19.570 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T16:13:19.570 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_exportdir": 49, 2024-09-13T16:13:19.570 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_flush": 0, 2024-09-13T16:13:19.570 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragmentdir": 3, 2024-09-13T16:13:19.570 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragstats": 0, 2024-09-13T16:13:19.570 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_inodestats": 0 2024-09-13T16:13:19.571 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.571 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_log": { 2024-09-13T16:13:19.571 INFO:teuthology.orchestra.run.smithi189.stdout: "evadd": 3587, 2024-09-13T16:13:19.571 INFO:teuthology.orchestra.run.smithi189.stdout: "evex": 3549, 2024-09-13T16:13:19.571 INFO:teuthology.orchestra.run.smithi189.stdout: "evtrm": 3549, 2024-09-13T16:13:19.571 INFO:teuthology.orchestra.run.smithi189.stdout: "ev": 38, 2024-09-13T16:13:19.571 INFO:teuthology.orchestra.run.smithi189.stdout: "evexg": 0, 2024-09-13T16:13:19.571 INFO:teuthology.orchestra.run.smithi189.stdout: "evexd": 36, 2024-09-13T16:13:19.571 INFO:teuthology.orchestra.run.smithi189.stdout: "segadd": 73, 2024-09-13T16:13:19.571 INFO:teuthology.orchestra.run.smithi189.stdout: "segex": 72, 2024-09-13T16:13:19.571 INFO:teuthology.orchestra.run.smithi189.stdout: "segtrm": 72, 2024-09-13T16:13:19.571 INFO:teuthology.orchestra.run.smithi189.stdout: "seg": 2, 2024-09-13T16:13:19.571 INFO:teuthology.orchestra.run.smithi189.stdout: "segexg": 0, 2024-09-13T16:13:19.571 INFO:teuthology.orchestra.run.smithi189.stdout: "segexd": 1, 2024-09-13T16:13:19.572 INFO:teuthology.orchestra.run.smithi189.stdout: "expos": 13330277, 2024-09-13T16:13:19.572 INFO:teuthology.orchestra.run.smithi189.stdout: "wrpos": 13607172, 2024-09-13T16:13:19.572 INFO:teuthology.orchestra.run.smithi189.stdout: "rdpos": 0, 2024-09-13T16:13:19.572 INFO:teuthology.orchestra.run.smithi189.stdout: "jlat": { 2024-09-13T16:13:19.572 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1389, 2024-09-13T16:13:19.572 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 12.781378558, 2024-09-13T16:13:19.572 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.009201856 2024-09-13T16:13:19.572 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.572 INFO:teuthology.orchestra.run.smithi189.stdout: "replayed": 0 2024-09-13T16:13:19.572 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.572 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_mem": { 2024-09-13T16:13:19.572 INFO:teuthology.orchestra.run.smithi189.stdout: "ino": 359, 2024-09-13T16:13:19.572 INFO:teuthology.orchestra.run.smithi189.stdout: "ino+": 2320, 2024-09-13T16:13:19.573 INFO:teuthology.orchestra.run.smithi189.stdout: "ino-": 1961, 2024-09-13T16:13:19.573 INFO:teuthology.orchestra.run.smithi189.stdout: "dir": 52, 2024-09-13T16:13:19.573 INFO:teuthology.orchestra.run.smithi189.stdout: "dir+": 169, 2024-09-13T16:13:19.573 INFO:teuthology.orchestra.run.smithi189.stdout: "dir-": 117, 2024-09-13T16:13:19.573 INFO:teuthology.orchestra.run.smithi189.stdout: "dn": 367, 2024-09-13T16:13:19.573 INFO:teuthology.orchestra.run.smithi189.stdout: "dn+": 2681, 2024-09-13T16:13:19.573 INFO:teuthology.orchestra.run.smithi189.stdout: "dn-": 2314, 2024-09-13T16:13:19.573 INFO:teuthology.orchestra.run.smithi189.stdout: "cap": 331, 2024-09-13T16:13:19.573 INFO:teuthology.orchestra.run.smithi189.stdout: "cap+": 1974, 2024-09-13T16:13:19.573 INFO:teuthology.orchestra.run.smithi189.stdout: "cap-": 1643, 2024-09-13T16:13:19.573 INFO:teuthology.orchestra.run.smithi189.stdout: "rss": 69364, 2024-09-13T16:13:19.573 INFO:teuthology.orchestra.run.smithi189.stdout: "heap": 207124 2024-09-13T16:13:19.573 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.573 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_server": { 2024-09-13T16:13:19.574 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_client_request": 2515, 2024-09-13T16:13:19.574 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_server_request": 19, 2024-09-13T16:13:19.574 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_request": 2259, 2024-09-13T16:13:19.574 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_session": 117, 2024-09-13T16:13:19.574 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_peer_request": 49, 2024-09-13T16:13:19.574 INFO:teuthology.orchestra.run.smithi189.stdout: "req_create_latency": { 2024-09-13T16:13:19.574 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1129, 2024-09-13T16:13:19.574 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 2.741268344, 2024-09-13T16:13:19.574 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.002428049 2024-09-13T16:13:19.574 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.574 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getattr_latency": { 2024-09-13T16:13:19.574 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 34, 2024-09-13T16:13:19.574 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.024455291, 2024-09-13T16:13:19.575 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000719273 2024-09-13T16:13:19.575 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.575 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getfilelock_latency": { 2024-09-13T16:13:19.575 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.575 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.575 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.575 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.575 INFO:teuthology.orchestra.run.smithi189.stdout: "req_link_latency": { 2024-09-13T16:13:19.575 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 23, 2024-09-13T16:13:19.575 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.036532258, 2024-09-13T16:13:19.575 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.001588359 2024-09-13T16:13:19.575 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.575 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookup_latency": { 2024-09-13T16:13:19.576 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 195, 2024-09-13T16:13:19.576 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 2.097833819, 2024-09-13T16:13:19.576 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.010758122 2024-09-13T16:13:19.576 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.576 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookuphash_latency": { 2024-09-13T16:13:19.576 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.576 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.576 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.576 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.576 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupino_latency": { 2024-09-13T16:13:19.576 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.576 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.576 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.576 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.577 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupname_latency": { 2024-09-13T16:13:19.577 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.577 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.577 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.577 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.577 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupparent_latency": { 2024-09-13T16:13:19.577 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.577 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.577 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.577 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.577 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupsnap_latency": { 2024-09-13T16:13:19.577 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.577 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.578 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.578 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.578 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lssnap_latency": { 2024-09-13T16:13:19.578 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.578 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.578 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.578 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.579 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mkdir_latency": { 2024-09-13T16:13:19.579 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 37, 2024-09-13T16:13:19.579 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.424530030, 2024-09-13T16:13:19.579 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.011473784 2024-09-13T16:13:19.579 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.579 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mknod_latency": { 2024-09-13T16:13:19.579 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.579 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.579 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.579 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.579 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mksnap_latency": { 2024-09-13T16:13:19.580 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.580 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.580 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.580 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.580 INFO:teuthology.orchestra.run.smithi189.stdout: "req_open_latency": { 2024-09-13T16:13:19.580 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 510, 2024-09-13T16:13:19.580 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.156902668, 2024-09-13T16:13:19.580 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000307652 2024-09-13T16:13:19.580 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.580 INFO:teuthology.orchestra.run.smithi189.stdout: "req_readdir_latency": { 2024-09-13T16:13:19.580 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 40, 2024-09-13T16:13:19.581 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.082482943, 2024-09-13T16:13:19.581 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.002062073 2024-09-13T16:13:19.581 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.581 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rename_latency": { 2024-09-13T16:13:19.581 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 163, 2024-09-13T16:13:19.581 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.383043643, 2024-09-13T16:13:19.581 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.002349961 2024-09-13T16:13:19.581 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.581 INFO:teuthology.orchestra.run.smithi189.stdout: "req_renamesnap_latency": { 2024-09-13T16:13:19.581 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.582 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.582 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.582 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.582 INFO:teuthology.orchestra.run.smithi189.stdout: "req_snapdiff_latency": { 2024-09-13T16:13:19.582 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.582 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.582 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.582 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.582 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmdir_latency": { 2024-09-13T16:13:19.582 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 2, 2024-09-13T16:13:19.582 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.011321981, 2024-09-13T16:13:19.582 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.005660990 2024-09-13T16:13:19.583 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.583 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmsnap_latency": { 2024-09-13T16:13:19.583 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.583 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.583 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.583 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.583 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmxattr_latency": { 2024-09-13T16:13:19.583 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.583 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.583 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.583 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.583 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setattr_latency": { 2024-09-13T16:13:19.583 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3, 2024-09-13T16:13:19.584 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.010784032, 2024-09-13T16:13:19.584 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.003594677 2024-09-13T16:13:19.584 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.584 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setdirlayout_latency": { 2024-09-13T16:13:19.584 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.584 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.584 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.584 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.584 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setfilelock_latency": { 2024-09-13T16:13:19.584 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.584 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.584 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.584 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.585 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setlayout_latency": { 2024-09-13T16:13:19.585 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.585 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.585 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.585 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.585 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setxattr_latency": { 2024-09-13T16:13:19.585 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 8, 2024-09-13T16:13:19.585 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.020546681, 2024-09-13T16:13:19.585 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.002568335 2024-09-13T16:13:19.585 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.585 INFO:teuthology.orchestra.run.smithi189.stdout: "req_symlink_latency": { 2024-09-13T16:13:19.585 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.586 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.586 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.586 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.586 INFO:teuthology.orchestra.run.smithi189.stdout: "req_unlink_latency": { 2024-09-13T16:13:19.586 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 36, 2024-09-13T16:13:19.586 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.054868932, 2024-09-13T16:13:19.586 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.001524137 2024-09-13T16:13:19.586 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.586 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_revoke_eviction": 0, 2024-09-13T16:13:19.586 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_acquisition_throttle": 0, 2024-09-13T16:13:19.586 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getvxattr_latency": { 2024-09-13T16:13:19.586 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.586 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.587 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.587 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-13T16:13:19.587 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.587 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_sessions": { 2024-09-13T16:13:19.587 INFO:teuthology.orchestra.run.smithi189.stdout: "session_count": 1, 2024-09-13T16:13:19.587 INFO:teuthology.orchestra.run.smithi189.stdout: "session_add": 3, 2024-09-13T16:13:19.587 INFO:teuthology.orchestra.run.smithi189.stdout: "session_remove": 2, 2024-09-13T16:13:19.587 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_open": 1, 2024-09-13T16:13:19.587 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_stale": 0, 2024-09-13T16:13:19.587 INFO:teuthology.orchestra.run.smithi189.stdout: "total_load": 73, 2024-09-13T16:13:19.587 INFO:teuthology.orchestra.run.smithi189.stdout: "average_load": 73, 2024-09-13T16:13:19.587 INFO:teuthology.orchestra.run.smithi189.stdout: "avg_session_uptime": 953, 2024-09-13T16:13:19.587 INFO:teuthology.orchestra.run.smithi189.stdout: "mdthresh_evicted": 0 2024-09-13T16:13:19.588 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.588 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-13T16:13:19.588 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:19.588 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:19.588 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:19.588 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:19.588 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:19.588 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:19.588 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:19.588 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:19.588 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:19.588 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:19.588 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:19.589 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:19.589 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:19.589 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:19.589 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:19.589 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:19.589 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:19.589 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:19.589 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:19.589 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:19.589 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:19.589 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:19.589 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:19.589 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:19.590 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:19.590 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:19.590 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:19.590 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:19.590 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:19.590 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:19.590 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:19.590 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-13T16:13:19.590 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:19.590 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:19.590 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:19.590 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:19.590 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 297521, 2024-09-13T16:13:19.591 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 466, 2024-09-13T16:13:19.591 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 704, 2024-09-13T16:13:19.591 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 8, 2024-09-13T16:13:19.591 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-13T16:13:19.591 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-13T16:13:19.591 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:19.591 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:19.591 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:19.591 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:19.591 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 8864, 2024-09-13T16:13:19.591 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 167, 2024-09-13T16:13:19.591 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:19.591 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:19.592 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:19.592 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-13T16:13:19.592 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 1280915, 2024-09-13T16:13:19.592 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 11984, 2024-09-13T16:13:19.592 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:19.592 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-13T16:13:19.592 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:19.592 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-13T16:13:19.592 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.592 INFO:teuthology.orchestra.run.smithi189.stdout: "objecter": { 2024-09-13T16:13:19.592 INFO:teuthology.orchestra.run.smithi189.stdout: "op_active": 0, 2024-09-13T16:13:19.592 INFO:teuthology.orchestra.run.smithi189.stdout: "op_laggy": 0, 2024-09-13T16:13:19.592 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send": 5581, 2024-09-13T16:13:19.593 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send_bytes": 12053894, 2024-09-13T16:13:19.593 INFO:teuthology.orchestra.run.smithi189.stdout: "op_resend": 37, 2024-09-13T16:13:19.593 INFO:teuthology.orchestra.run.smithi189.stdout: "op_reply": 5581, 2024-09-13T16:13:19.593 INFO:teuthology.orchestra.run.smithi189.stdout: "op_latency": { 2024-09-13T16:13:19.593 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 5581, 2024-09-13T16:13:19.593 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 394.350494254, 2024-09-13T16:13:19.593 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.070659468 2024-09-13T16:13:19.593 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.593 INFO:teuthology.orchestra.run.smithi189.stdout: "op_inflight": 0, 2024-09-13T16:13:19.593 INFO:teuthology.orchestra.run.smithi189.stdout: "oplen_avg": { 2024-09-13T16:13:19.593 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 5581, 2024-09-13T16:13:19.593 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 10091 2024-09-13T16:13:19.593 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.594 INFO:teuthology.orchestra.run.smithi189.stdout: "op": 5581, 2024-09-13T16:13:19.594 INFO:teuthology.orchestra.run.smithi189.stdout: "op_r": 68, 2024-09-13T16:13:19.594 INFO:teuthology.orchestra.run.smithi189.stdout: "op_w": 5513, 2024-09-13T16:13:19.594 INFO:teuthology.orchestra.run.smithi189.stdout: "op_rmw": 0, 2024-09-13T16:13:19.594 INFO:teuthology.orchestra.run.smithi189.stdout: "op_pg": 0, 2024-09-13T16:13:19.594 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_stat": 458, 2024-09-13T16:13:19.594 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_create": 2266, 2024-09-13T16:13:19.594 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_read": 60, 2024-09-13T16:13:19.594 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_write": 1449, 2024-09-13T16:13:19.594 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writefull": 292, 2024-09-13T16:13:19.594 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writesame": 0, 2024-09-13T16:13:19.594 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_append": 0, 2024-09-13T16:13:19.594 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_zero": 0, 2024-09-13T16:13:19.594 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_truncate": 3, 2024-09-13T16:13:19.595 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_delete": 816, 2024-09-13T16:13:19.595 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_mapext": 0, 2024-09-13T16:13:19.595 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_sparse_read": 0, 2024-09-13T16:13:19.595 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_clonerange": 0, 2024-09-13T16:13:19.595 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_getxattr": 0, 2024-09-13T16:13:19.595 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_setxattr": 3429, 2024-09-13T16:13:19.595 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_cmpxattr": 0, 2024-09-13T16:13:19.595 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_rmxattr": 0, 2024-09-13T16:13:19.595 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_resetxattrs": 0, 2024-09-13T16:13:19.595 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_call": 0, 2024-09-13T16:13:19.595 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_watch": 0, 2024-09-13T16:13:19.595 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_notify": 0, 2024-09-13T16:13:19.595 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T16:13:19.596 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls": 0, 2024-09-13T16:13:19.596 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls_filter": 0, 2024-09-13T16:13:19.596 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_other": 0, 2024-09-13T16:13:19.596 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_active": 0, 2024-09-13T16:13:19.596 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_send": 0, 2024-09-13T16:13:19.596 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_resend": 0, 2024-09-13T16:13:19.596 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_ping": 0, 2024-09-13T16:13:19.596 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_active": 0, 2024-09-13T16:13:19.596 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_send": 0, 2024-09-13T16:13:19.596 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_resend": 0, 2024-09-13T16:13:19.596 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_active": 0, 2024-09-13T16:13:19.596 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_send": 0, 2024-09-13T16:13:19.596 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_resend": 0, 2024-09-13T16:13:19.597 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_active": 0, 2024-09-13T16:13:19.597 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_send": 0, 2024-09-13T16:13:19.597 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_resend": 0, 2024-09-13T16:13:19.597 INFO:teuthology.orchestra.run.smithi189.stdout: "command_active": 0, 2024-09-13T16:13:19.597 INFO:teuthology.orchestra.run.smithi189.stdout: "command_send": 0, 2024-09-13T16:13:19.597 INFO:teuthology.orchestra.run.smithi189.stdout: "command_resend": 0, 2024-09-13T16:13:19.597 INFO:teuthology.orchestra.run.smithi189.stdout: "map_epoch": 94, 2024-09-13T16:13:19.597 INFO:teuthology.orchestra.run.smithi189.stdout: "map_full": 0, 2024-09-13T16:13:19.597 INFO:teuthology.orchestra.run.smithi189.stdout: "map_inc": 9, 2024-09-13T16:13:19.597 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_sessions": 12, 2024-09-13T16:13:19.597 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_open": 12, 2024-09-13T16:13:19.597 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_close": 0, 2024-09-13T16:13:19.598 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_laggy": 0, 2024-09-13T16:13:19.598 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_wr": 1210, 2024-09-13T16:13:19.598 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_rd": 10, 2024-09-13T16:13:19.598 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_del": 98 2024-09-13T16:13:19.598 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.598 INFO:teuthology.orchestra.run.smithi189.stdout: "oft": { 2024-09-13T16:13:19.598 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_objs": 1, 2024-09-13T16:13:19.598 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_kv_pairs": 0, 2024-09-13T16:13:19.598 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_updates": 0, 2024-09-13T16:13:19.598 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_removes": 0 2024-09-13T16:13:19.598 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.598 INFO:teuthology.orchestra.run.smithi189.stdout: "osd-slow-ops": { 2024-09-13T16:13:19.598 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_ops_count": 0 2024-09-13T16:13:19.599 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.599 INFO:teuthology.orchestra.run.smithi189.stdout: "purge_queue": { 2024-09-13T16:13:19.599 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops": 0, 2024-09-13T16:13:19.599 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops_high_water": 18, 2024-09-13T16:13:19.599 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing": 0, 2024-09-13T16:13:19.599 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_high_water": 8, 2024-09-13T16:13:19.599 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed_ops": 300, 2024-09-13T16:13:19.599 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed": 144, 2024-09-13T16:13:19.599 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_item_in_journal": 0 2024-09-13T16:13:19.599 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.599 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:19.599 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-13T16:13:19.599 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-13T16:13:19.599 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-13T16:13:19.600 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 15346, 2024-09-13T16:13:19.600 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 5335184, 2024-09-13T16:13:19.600 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:19.600 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 15346, 2024-09-13T16:13:19.600 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-13T16:13:19.600 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-13T16:13:19.600 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 15346, 2024-09-13T16:13:19.600 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 5335184, 2024-09-13T16:13:19.600 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-13T16:13:19.600 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.600 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.601 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.601 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-13T16:13:19.601 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.601 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_bytes": { 2024-09-13T16:13:19.601 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-13T16:13:19.601 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-13T16:13:19.601 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-13T16:13:19.601 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-13T16:13:19.601 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-13T16:13:19.601 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:19.601 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:19.601 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 5581, 2024-09-13T16:13:19.602 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 12069392, 2024-09-13T16:13:19.602 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 5581, 2024-09-13T16:13:19.602 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 12069392, 2024-09-13T16:13:19.602 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-13T16:13:19.602 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.602 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.602 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.602 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-13T16:13:19.602 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.602 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_ops": { 2024-09-13T16:13:19.602 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-13T16:13:19.602 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 1024, 2024-09-13T16:13:19.603 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-13T16:13:19.603 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-13T16:13:19.603 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-13T16:13:19.603 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:19.603 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:19.603 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 5581, 2024-09-13T16:13:19.603 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 5581, 2024-09-13T16:13:19.603 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 5581, 2024-09-13T16:13:19.603 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 5581, 2024-09-13T16:13:19.603 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-13T16:13:19.603 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.603 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.603 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.604 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-13T16:13:19.604 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.604 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle": { 2024-09-13T16:13:19.604 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-13T16:13:19.604 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-13T16:13:19.604 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-13T16:13:19.604 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 144, 2024-09-13T16:13:19.604 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 15680, 2024-09-13T16:13:19.604 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:19.604 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 144, 2024-09-13T16:13:19.604 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-13T16:13:19.604 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-13T16:13:19.604 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 60, 2024-09-13T16:13:19.605 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 15680, 2024-09-13T16:13:19.605 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-13T16:13:19.605 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.605 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.605 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.605 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-13T16:13:19.605 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:19.605 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle-0x5635bbb36500": { 2024-09-13T16:13:19.605 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-13T16:13:19.605 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-13T16:13:19.605 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-13T16:13:19.605 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 3587, 2024-09-13T16:13:19.605 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 9412868, 2024-09-13T16:13:19.605 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:19.606 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 3587, 2024-09-13T16:13:19.606 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-13T16:13:19.606 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-13T16:13:19.606 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 1389, 2024-09-13T16:13:19.606 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 9412868, 2024-09-13T16:13:19.606 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-13T16:13:19.606 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:19.606 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:19.606 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:19.606 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-13T16:13:19.606 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-13T16:13:19.606 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-13T16:13:20.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:19 smithi193 ceph-mon[35248]: pgmap v852: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-09-13T16:13:20.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:19 smithi017 ceph-mon[30494]: pgmap v852: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-09-13T16:13:20.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:19 smithi189 ceph-mon[34790]: pgmap v852: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-09-13T16:13:20.501 INFO:tasks.check_counter:Daemon mds.b mds.exported=49 2024-09-13T16:13:20.502 INFO:tasks.check_counter:Daemon mds.b mds.imported=41 2024-09-13T16:13:20.502 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=97 2024-09-13T16:13:20.502 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=149 2024-09-13T16:13:20.502 DEBUG:tasks.check_counter:Getting stats from e 2024-09-13T16:13:20.502 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-13T16:13:20.701 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:13:22.187 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:21 smithi189 ceph-mon[34790]: pgmap v853: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-09-13T16:13:22.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:21 smithi193 ceph-mon[35248]: pgmap v853: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-09-13T16:13:22.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:21 smithi017 ceph-mon[30494]: pgmap v853: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-09-13T16:13:22.452 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-13T16:13:22.452 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:22.452 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 310, 2024-09-13T16:13:22.452 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 305, 2024-09-13T16:13:22.453 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 500368, 2024-09-13T16:13:22.453 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 173600, 2024-09-13T16:13:22.453 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 4, 2024-09-13T16:13:22.453 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 0, 2024-09-13T16:13:22.453 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.041652871, 2024-09-13T16:13:22.453 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.017586842, 2024-09-13T16:13:22.453 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.027791625, 2024-09-13T16:13:22.453 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:22.453 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:22.453 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 305, 2024-09-13T16:13:22.453 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.023750121, 2024-09-13T16:13:22.453 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000077869 2024-09-13T16:13:22.453 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:22.454 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:22.454 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:22.454 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.454 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.454 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:22.454 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 500368, 2024-09-13T16:13:22.454 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 173600 2024-09-13T16:13:22.454 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:22.454 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:22.454 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 2, 2024-09-13T16:13:22.454 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 231, 2024-09-13T16:13:22.454 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 320, 2024-09-13T16:13:22.455 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 193264, 2024-09-13T16:13:22.455 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 4, 2024-09-13T16:13:22.455 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-13T16:13:22.455 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.012059089, 2024-09-13T16:13:22.455 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.009060495, 2024-09-13T16:13:22.455 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.000842975, 2024-09-13T16:13:22.455 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:22.455 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:22.455 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 229, 2024-09-13T16:13:22.455 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.015907424, 2024-09-13T16:13:22.455 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000069464 2024-09-13T16:13:22.455 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:22.455 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:22.456 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:22.456 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.456 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.456 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:22.456 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-13T16:13:22.456 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 193264 2024-09-13T16:13:22.456 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:22.456 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:22.456 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 0, 2024-09-13T16:13:22.456 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 2, 2024-09-13T16:13:22.456 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 0, 2024-09-13T16:13:22.456 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 0, 2024-09-13T16:13:22.457 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 2, 2024-09-13T16:13:22.457 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 1, 2024-09-13T16:13:22.457 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.000258332, 2024-09-13T16:13:22.457 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.000000000, 2024-09-13T16:13:22.457 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.000183599, 2024-09-13T16:13:22.457 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:22.457 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:22.457 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:22.457 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.457 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.457 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:22.457 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:22.457 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:22.458 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.458 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.458 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:22.458 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T16:13:22.458 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T16:13:22.458 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:22.458 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-13T16:13:22.458 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 0, 2024-09-13T16:13:22.458 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-13T16:13:22.458 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:22.458 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-13T16:13:22.458 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:22.458 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:22.458 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:22.459 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:22.459 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:22.459 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:22.459 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:22.459 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:22.459 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:22.459 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:22.459 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:22.459 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:22.459 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:22.459 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:22.459 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:22.459 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:22.460 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:22.460 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:22.460 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:22.460 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:22.460 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:22.460 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:22.460 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:22.460 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:22.460 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:22.460 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:22.460 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:22.460 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:22.461 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:22.461 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:22.461 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:22.461 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-13T16:13:22.461 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:22.461 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:22.461 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:22.461 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:22.461 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 148682, 2024-09-13T16:13:22.461 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 29, 2024-09-13T16:13:22.461 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-13T16:13:22.461 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-13T16:13:22.462 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-13T16:13:22.462 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-13T16:13:22.462 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:22.462 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:22.462 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:22.462 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:22.462 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 0, 2024-09-13T16:13:22.462 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 0, 2024-09-13T16:13:22.462 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:22.462 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:22.462 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:22.462 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-13T16:13:22.462 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 928, 2024-09-13T16:13:22.463 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 2, 2024-09-13T16:13:22.463 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:22.463 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-13T16:13:22.463 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:22.463 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-13T16:13:22.463 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:22.463 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:22.463 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-13T16:13:22.463 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-13T16:13:22.463 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-13T16:13:22.463 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 308, 2024-09-13T16:13:22.463 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 454110, 2024-09-13T16:13:22.463 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:22.463 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 308, 2024-09-13T16:13:22.464 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-13T16:13:22.464 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-13T16:13:22.464 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 308, 2024-09-13T16:13:22.464 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 454110, 2024-09-13T16:13:22.464 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-13T16:13:22.464 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:22.464 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:22.464 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:22.464 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-13T16:13:22.464 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-13T16:13:22.464 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-13T16:13:23.289 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.e 2024-09-13T16:13:23.290 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.e 2024-09-13T16:13:23.290 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.e 2024-09-13T16:13:23.290 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.e 2024-09-13T16:13:23.290 DEBUG:tasks.check_counter:Getting stats from h 2024-09-13T16:13:23.290 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-13T16:13:23.493 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:13:24.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:23 smithi193 ceph-mon[35248]: pgmap v854: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-09-13T16:13:24.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:23 smithi017 ceph-mon[30494]: pgmap v854: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-09-13T16:13:24.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:23 smithi189 ceph-mon[34790]: pgmap v854: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-09-13T16:13:25.247 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-13T16:13:25.247 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:25.247 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 3388, 2024-09-13T16:13:25.247 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 3390, 2024-09-13T16:13:25.247 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 6144852, 2024-09-13T16:13:25.247 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 1053675, 2024-09-13T16:13:25.247 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 6, 2024-09-13T16:13:25.247 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-13T16:13:25.247 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.275522749, 2024-09-13T16:13:25.248 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.068439631, 2024-09-13T16:13:25.248 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.072775172, 2024-09-13T16:13:25.248 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.117737088, 2024-09-13T16:13:25.248 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:25.248 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3388, 2024-09-13T16:13:25.248 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.146715029, 2024-09-13T16:13:25.248 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000043304 2024-09-13T16:13:25.248 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.248 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:25.248 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.248 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.249 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.249 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.249 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T16:13:25.249 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T16:13:25.249 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.249 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:25.249 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 347, 2024-09-13T16:13:25.249 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 313, 2024-09-13T16:13:25.249 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 634300, 2024-09-13T16:13:25.249 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 174780, 2024-09-13T16:13:25.249 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 3, 2024-09-13T16:13:25.249 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-13T16:13:25.250 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.041660468, 2024-09-13T16:13:25.250 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.017980305, 2024-09-13T16:13:25.250 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.027939833, 2024-09-13T16:13:25.250 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000049439, 2024-09-13T16:13:25.250 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:25.250 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 312, 2024-09-13T16:13:25.250 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.025677772, 2024-09-13T16:13:25.250 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000082300 2024-09-13T16:13:25.250 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.250 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:25.250 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.250 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.250 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.251 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.251 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 633744, 2024-09-13T16:13:25.251 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 174096 2024-09-13T16:13:25.251 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.251 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:25.251 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 7, 2024-09-13T16:13:25.251 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 233, 2024-09-13T16:13:25.251 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 3580, 2024-09-13T16:13:25.251 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 555591, 2024-09-13T16:13:25.251 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 6, 2024-09-13T16:13:25.252 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 3, 2024-09-13T16:13:25.252 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.014523460, 2024-09-13T16:13:25.252 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.009092073, 2024-09-13T16:13:25.252 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.003529370, 2024-09-13T16:13:25.252 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000025487, 2024-09-13T16:13:25.252 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:25.252 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 232, 2024-09-13T16:13:25.252 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.015547248, 2024-09-13T16:13:25.252 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000067014 2024-09-13T16:13:25.252 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.252 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:25.253 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.253 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.253 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.253 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.253 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-13T16:13:25.253 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 555280 2024-09-13T16:13:25.253 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.253 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-13T16:13:25.253 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 1, 2024-09-13T16:13:25.253 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-13T16:13:25.253 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.253 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-MDSRank": { 2024-09-13T16:13:25.254 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-13T16:13:25.254 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-13T16:13:25.254 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 5796, 2024-09-13T16:13:25.254 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.123757116, 2024-09-13T16:13:25.254 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000021352 2024-09-13T16:13:25.254 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-13T16:13:25.254 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.254 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-PurgeQueue": { 2024-09-13T16:13:25.254 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-13T16:13:25.254 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-13T16:13:25.254 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.254 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.254 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.254 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-13T16:13:25.255 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.255 INFO:teuthology.orchestra.run.smithi189.stdout: "mds": { 2024-09-13T16:13:25.255 INFO:teuthology.orchestra.run.smithi189.stdout: "request": 0, 2024-09-13T16:13:25.255 INFO:teuthology.orchestra.run.smithi189.stdout: "reply": 0, 2024-09-13T16:13:25.255 INFO:teuthology.orchestra.run.smithi189.stdout: "reply_latency": { 2024-09-13T16:13:25.255 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.255 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.255 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.255 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.255 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_reply": 0, 2024-09-13T16:13:25.255 INFO:teuthology.orchestra.run.smithi189.stdout: "forward": 0, 2024-09-13T16:13:25.255 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_complete": 0, 2024-09-13T16:13:25.256 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_keys": 0, 2024-09-13T16:13:25.256 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_commit": 0, 2024-09-13T16:13:25.256 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_split": 0, 2024-09-13T16:13:25.256 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_merge": 0, 2024-09-13T16:13:25.256 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes": 664, 2024-09-13T16:13:25.256 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_top": 135, 2024-09-13T16:13:25.256 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_bottom": 529, 2024-09-13T16:13:25.256 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pin_tail": 0, 2024-09-13T16:13:25.256 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pinned": 471, 2024-09-13T16:13:25.256 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_expired": 0, 2024-09-13T16:13:25.256 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_with_caps": 0, 2024-09-13T16:13:25.256 INFO:teuthology.orchestra.run.smithi189.stdout: "caps": 0, 2024-09-13T16:13:25.256 INFO:teuthology.orchestra.run.smithi189.stdout: "subtrees": 20, 2024-09-13T16:13:25.257 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse": 0, 2024-09-13T16:13:25.257 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_hit": 0, 2024-09-13T16:13:25.257 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_forward": 0, 2024-09-13T16:13:25.257 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_discover": 0, 2024-09-13T16:13:25.257 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_dir_fetch": 0, 2024-09-13T16:13:25.257 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_remote_ino": 0, 2024-09-13T16:13:25.257 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_lock": 0, 2024-09-13T16:13:25.257 INFO:teuthology.orchestra.run.smithi189.stdout: "load_cent": 0, 2024-09-13T16:13:25.257 INFO:teuthology.orchestra.run.smithi189.stdout: "q": 0, 2024-09-13T16:13:25.257 INFO:teuthology.orchestra.run.smithi189.stdout: "exported": 0, 2024-09-13T16:13:25.257 INFO:teuthology.orchestra.run.smithi189.stdout: "exported_inodes": 0, 2024-09-13T16:13:25.257 INFO:teuthology.orchestra.run.smithi189.stdout: "imported": 0, 2024-09-13T16:13:25.257 INFO:teuthology.orchestra.run.smithi189.stdout: "imported_inodes": 0, 2024-09-13T16:13:25.258 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_dir_fetch": 0, 2024-09-13T16:13:25.258 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_backtrace_fetch": 0, 2024-09-13T16:13:25.258 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_peer_discover": 0, 2024-09-13T16:13:25.258 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rfiles": 0, 2024-09-13T16:13:25.258 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rbytes": 0, 2024-09-13T16:13:25.258 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rsnaps": 0, 2024-09-13T16:13:25.258 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T16:13:25.258 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_set_tag": 0, 2024-09-13T16:13:25.258 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T16:13:25.258 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_inotable_repaired": 0, 2024-09-13T16:13:25.258 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_inodes": 0, 2024-09-13T16:13:25.258 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T16:13:25.258 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T16:13:25.258 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_file_inodes": 0, 2024-09-13T16:13:25.259 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_inode_file_caps": 0, 2024-09-13T16:13:25.259 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T16:13:25.259 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_grant": 0, 2024-09-13T16:13:25.259 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T16:13:25.259 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T16:13:25.259 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T16:13:25.259 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps": 0, 2024-09-13T16:13:25.259 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps_dirty": 0, 2024-09-13T16:13:25.259 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_cap_release": 0, 2024-09-13T16:13:25.259 INFO:teuthology.orchestra.run.smithi189.stdout: "process_request_cap_release": 0 2024-09-13T16:13:25.259 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.259 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_cache": { 2024-09-13T16:13:25.259 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update": 0, 2024-09-13T16:13:25.260 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update_receipt": 0, 2024-09-13T16:13:25.260 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_try_discover": 0, 2024-09-13T16:13:25.260 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_send_discover": 0, 2024-09-13T16:13:25.260 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_handle_discover": 0, 2024-09-13T16:13:25.260 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays": 0, 2024-09-13T16:13:25.260 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_delayed": 0, 2024-09-13T16:13:25.260 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_enqueuing": 0, 2024-09-13T16:13:25.260 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_created": 0, 2024-09-13T16:13:25.260 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_enqueued": 0, 2024-09-13T16:13:25.260 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_reintegrated": 0, 2024-09-13T16:13:25.260 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_migrated": 0, 2024-09-13T16:13:25.260 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_processing": 0, 2024-09-13T16:13:25.260 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_enqueued": 0, 2024-09-13T16:13:25.261 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_prioritized": 0, 2024-09-13T16:13:25.261 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_started": 0, 2024-09-13T16:13:25.261 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_completed": 0, 2024-09-13T16:13:25.261 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T16:13:25.261 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_exportdir": 0, 2024-09-13T16:13:25.261 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_flush": 0, 2024-09-13T16:13:25.261 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragmentdir": 0, 2024-09-13T16:13:25.261 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragstats": 0, 2024-09-13T16:13:25.261 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_inodestats": 0 2024-09-13T16:13:25.261 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.261 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_log": { 2024-09-13T16:13:25.261 INFO:teuthology.orchestra.run.smithi189.stdout: "evadd": 0, 2024-09-13T16:13:25.261 INFO:teuthology.orchestra.run.smithi189.stdout: "evex": 0, 2024-09-13T16:13:25.262 INFO:teuthology.orchestra.run.smithi189.stdout: "evtrm": 0, 2024-09-13T16:13:25.262 INFO:teuthology.orchestra.run.smithi189.stdout: "ev": 1973, 2024-09-13T16:13:25.262 INFO:teuthology.orchestra.run.smithi189.stdout: "evexg": 0, 2024-09-13T16:13:25.262 INFO:teuthology.orchestra.run.smithi189.stdout: "evexd": 0, 2024-09-13T16:13:25.262 INFO:teuthology.orchestra.run.smithi189.stdout: "segadd": 0, 2024-09-13T16:13:25.262 INFO:teuthology.orchestra.run.smithi189.stdout: "segex": 0, 2024-09-13T16:13:25.262 INFO:teuthology.orchestra.run.smithi189.stdout: "segtrm": 0, 2024-09-13T16:13:25.262 INFO:teuthology.orchestra.run.smithi189.stdout: "seg": 3, 2024-09-13T16:13:25.262 INFO:teuthology.orchestra.run.smithi189.stdout: "segexg": 0, 2024-09-13T16:13:25.262 INFO:teuthology.orchestra.run.smithi189.stdout: "segexd": 0, 2024-09-13T16:13:25.262 INFO:teuthology.orchestra.run.smithi189.stdout: "expos": 4194304, 2024-09-13T16:13:25.262 INFO:teuthology.orchestra.run.smithi189.stdout: "wrpos": 9391139, 2024-09-13T16:13:25.263 INFO:teuthology.orchestra.run.smithi189.stdout: "rdpos": 9389100, 2024-09-13T16:13:25.263 INFO:teuthology.orchestra.run.smithi189.stdout: "jlat": { 2024-09-13T16:13:25.263 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.263 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.263 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.263 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.263 INFO:teuthology.orchestra.run.smithi189.stdout: "replayed": 1973 2024-09-13T16:13:25.263 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.263 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_mem": { 2024-09-13T16:13:25.263 INFO:teuthology.orchestra.run.smithi189.stdout: "ino": 537, 2024-09-13T16:13:25.263 INFO:teuthology.orchestra.run.smithi189.stdout: "ino+": 1782, 2024-09-13T16:13:25.263 INFO:teuthology.orchestra.run.smithi189.stdout: "ino-": 1245, 2024-09-13T16:13:25.263 INFO:teuthology.orchestra.run.smithi189.stdout: "dir": 54, 2024-09-13T16:13:25.264 INFO:teuthology.orchestra.run.smithi189.stdout: "dir+": 108, 2024-09-13T16:13:25.264 INFO:teuthology.orchestra.run.smithi189.stdout: "dir-": 54, 2024-09-13T16:13:25.264 INFO:teuthology.orchestra.run.smithi189.stdout: "dn": 664, 2024-09-13T16:13:25.264 INFO:teuthology.orchestra.run.smithi189.stdout: "dn+": 1863, 2024-09-13T16:13:25.264 INFO:teuthology.orchestra.run.smithi189.stdout: "dn-": 1199, 2024-09-13T16:13:25.264 INFO:teuthology.orchestra.run.smithi189.stdout: "cap": 0, 2024-09-13T16:13:25.264 INFO:teuthology.orchestra.run.smithi189.stdout: "cap+": 0, 2024-09-13T16:13:25.264 INFO:teuthology.orchestra.run.smithi189.stdout: "cap-": 0, 2024-09-13T16:13:25.264 INFO:teuthology.orchestra.run.smithi189.stdout: "rss": 52760, 2024-09-13T16:13:25.264 INFO:teuthology.orchestra.run.smithi189.stdout: "heap": 207124 2024-09-13T16:13:25.264 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.264 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_server": { 2024-09-13T16:13:25.264 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_client_request": 0, 2024-09-13T16:13:25.264 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_server_request": 0, 2024-09-13T16:13:25.265 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_request": 0, 2024-09-13T16:13:25.265 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_session": 0, 2024-09-13T16:13:25.265 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_peer_request": 0, 2024-09-13T16:13:25.265 INFO:teuthology.orchestra.run.smithi189.stdout: "req_create_latency": { 2024-09-13T16:13:25.265 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.265 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.265 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.265 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.265 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getattr_latency": { 2024-09-13T16:13:25.265 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.265 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.265 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.265 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.265 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getfilelock_latency": { 2024-09-13T16:13:25.266 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.266 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.266 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.266 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.266 INFO:teuthology.orchestra.run.smithi189.stdout: "req_link_latency": { 2024-09-13T16:13:25.266 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.266 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.266 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.266 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.266 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookup_latency": { 2024-09-13T16:13:25.266 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.266 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.266 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.266 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.267 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookuphash_latency": { 2024-09-13T16:13:25.267 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.267 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.267 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.267 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.267 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupino_latency": { 2024-09-13T16:13:25.267 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.267 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.267 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.267 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.267 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupname_latency": { 2024-09-13T16:13:25.267 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.267 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.267 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.268 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.268 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupparent_latency": { 2024-09-13T16:13:25.268 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.268 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.268 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.268 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.268 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupsnap_latency": { 2024-09-13T16:13:25.268 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.268 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.268 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.268 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.268 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lssnap_latency": { 2024-09-13T16:13:25.268 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.268 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.269 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.269 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.269 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mkdir_latency": { 2024-09-13T16:13:25.269 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.269 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.269 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.269 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.270 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mknod_latency": { 2024-09-13T16:13:25.270 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.270 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.270 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.270 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.270 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mksnap_latency": { 2024-09-13T16:13:25.270 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.270 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.271 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.271 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.271 INFO:teuthology.orchestra.run.smithi189.stdout: "req_open_latency": { 2024-09-13T16:13:25.271 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.271 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.271 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.271 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.271 INFO:teuthology.orchestra.run.smithi189.stdout: "req_readdir_latency": { 2024-09-13T16:13:25.271 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.271 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.271 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.271 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.272 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rename_latency": { 2024-09-13T16:13:25.272 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.272 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.272 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.272 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.272 INFO:teuthology.orchestra.run.smithi189.stdout: "req_renamesnap_latency": { 2024-09-13T16:13:25.272 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.272 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.272 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.272 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.272 INFO:teuthology.orchestra.run.smithi189.stdout: "req_snapdiff_latency": { 2024-09-13T16:13:25.273 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.273 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.273 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.273 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.273 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmdir_latency": { 2024-09-13T16:13:25.273 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.273 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.273 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.273 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.273 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmsnap_latency": { 2024-09-13T16:13:25.273 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.273 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.273 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.274 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.274 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmxattr_latency": { 2024-09-13T16:13:25.274 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.274 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.274 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.274 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.274 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setattr_latency": { 2024-09-13T16:13:25.274 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.274 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.274 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.274 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.274 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setdirlayout_latency": { 2024-09-13T16:13:25.274 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.275 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.275 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.275 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.275 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setfilelock_latency": { 2024-09-13T16:13:25.275 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.275 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.275 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.275 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.275 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setlayout_latency": { 2024-09-13T16:13:25.275 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.275 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.275 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.275 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.276 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setxattr_latency": { 2024-09-13T16:13:25.276 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.276 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.276 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.276 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.276 INFO:teuthology.orchestra.run.smithi189.stdout: "req_symlink_latency": { 2024-09-13T16:13:25.276 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.276 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.276 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.276 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.276 INFO:teuthology.orchestra.run.smithi189.stdout: "req_unlink_latency": { 2024-09-13T16:13:25.276 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.277 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.277 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.277 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.277 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_revoke_eviction": 0, 2024-09-13T16:13:25.277 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_acquisition_throttle": 0, 2024-09-13T16:13:25.277 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getvxattr_latency": { 2024-09-13T16:13:25.277 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.277 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.277 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.277 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-13T16:13:25.277 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.277 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_sessions": { 2024-09-13T16:13:25.277 INFO:teuthology.orchestra.run.smithi189.stdout: "session_count": 1, 2024-09-13T16:13:25.278 INFO:teuthology.orchestra.run.smithi189.stdout: "session_add": 1, 2024-09-13T16:13:25.278 INFO:teuthology.orchestra.run.smithi189.stdout: "session_remove": 0, 2024-09-13T16:13:25.278 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_open": 1, 2024-09-13T16:13:25.278 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_stale": 0, 2024-09-13T16:13:25.278 INFO:teuthology.orchestra.run.smithi189.stdout: "total_load": 0, 2024-09-13T16:13:25.278 INFO:teuthology.orchestra.run.smithi189.stdout: "average_load": 0, 2024-09-13T16:13:25.278 INFO:teuthology.orchestra.run.smithi189.stdout: "avg_session_uptime": 2333, 2024-09-13T16:13:25.278 INFO:teuthology.orchestra.run.smithi189.stdout: "mdthresh_evicted": 0 2024-09-13T16:13:25.278 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.278 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-13T16:13:25.278 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:25.278 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:25.278 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:25.279 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:25.279 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:25.279 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:25.279 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:25.279 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:25.279 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:25.279 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:25.279 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:25.279 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:25.279 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:25.279 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:25.279 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:25.279 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:25.280 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:25.280 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:25.280 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:25.280 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:25.280 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:25.280 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:25.280 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:25.280 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:25.280 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:25.280 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:25.280 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:25.280 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:25.280 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:25.281 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:25.281 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:25.281 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-13T16:13:25.281 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:25.281 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:25.281 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:25.281 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:25.281 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 201666, 2024-09-13T16:13:25.281 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 577, 2024-09-13T16:13:25.281 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-13T16:13:25.281 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-13T16:13:25.281 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-13T16:13:25.282 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-13T16:13:25.282 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:25.282 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:25.282 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:25.282 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:25.282 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 8864, 2024-09-13T16:13:25.282 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 167, 2024-09-13T16:13:25.282 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:25.282 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:25.282 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:25.282 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-13T16:13:25.282 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 1753562, 2024-09-13T16:13:25.282 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 14561, 2024-09-13T16:13:25.283 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:25.283 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-13T16:13:25.283 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:25.283 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-13T16:13:25.283 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.283 INFO:teuthology.orchestra.run.smithi189.stdout: "objecter": { 2024-09-13T16:13:25.283 INFO:teuthology.orchestra.run.smithi189.stdout: "op_active": 0, 2024-09-13T16:13:25.283 INFO:teuthology.orchestra.run.smithi189.stdout: "op_laggy": 0, 2024-09-13T16:13:25.283 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send": 3391, 2024-09-13T16:13:25.283 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send_bytes": 21, 2024-09-13T16:13:25.283 INFO:teuthology.orchestra.run.smithi189.stdout: "op_resend": 3, 2024-09-13T16:13:25.283 INFO:teuthology.orchestra.run.smithi189.stdout: "op_reply": 3391, 2024-09-13T16:13:25.284 INFO:teuthology.orchestra.run.smithi189.stdout: "op_latency": { 2024-09-13T16:13:25.284 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3391, 2024-09-13T16:13:25.284 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 24.923556810, 2024-09-13T16:13:25.284 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.007349913 2024-09-13T16:13:25.284 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.284 INFO:teuthology.orchestra.run.smithi189.stdout: "op_inflight": 0, 2024-09-13T16:13:25.284 INFO:teuthology.orchestra.run.smithi189.stdout: "oplen_avg": { 2024-09-13T16:13:25.284 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3391, 2024-09-13T16:13:25.284 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 3392 2024-09-13T16:13:25.284 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.284 INFO:teuthology.orchestra.run.smithi189.stdout: "op": 3391, 2024-09-13T16:13:25.284 INFO:teuthology.orchestra.run.smithi189.stdout: "op_r": 3391, 2024-09-13T16:13:25.285 INFO:teuthology.orchestra.run.smithi189.stdout: "op_w": 0, 2024-09-13T16:13:25.285 INFO:teuthology.orchestra.run.smithi189.stdout: "op_rmw": 0, 2024-09-13T16:13:25.285 INFO:teuthology.orchestra.run.smithi189.stdout: "op_pg": 0, 2024-09-13T16:13:25.285 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_stat": 2016, 2024-09-13T16:13:25.285 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_create": 0, 2024-09-13T16:13:25.285 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_read": 1373, 2024-09-13T16:13:25.285 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_write": 0, 2024-09-13T16:13:25.285 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writefull": 0, 2024-09-13T16:13:25.285 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writesame": 0, 2024-09-13T16:13:25.285 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_append": 0, 2024-09-13T16:13:25.286 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_zero": 0, 2024-09-13T16:13:25.286 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_truncate": 0, 2024-09-13T16:13:25.286 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_delete": 0, 2024-09-13T16:13:25.286 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_mapext": 0, 2024-09-13T16:13:25.286 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_sparse_read": 0, 2024-09-13T16:13:25.286 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_clonerange": 0, 2024-09-13T16:13:25.286 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_getxattr": 1, 2024-09-13T16:13:25.286 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_setxattr": 0, 2024-09-13T16:13:25.287 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_cmpxattr": 0, 2024-09-13T16:13:25.287 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_rmxattr": 0, 2024-09-13T16:13:25.287 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_resetxattrs": 0, 2024-09-13T16:13:25.287 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_call": 0, 2024-09-13T16:13:25.287 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_watch": 0, 2024-09-13T16:13:25.287 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_notify": 0, 2024-09-13T16:13:25.287 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T16:13:25.287 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls": 0, 2024-09-13T16:13:25.287 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls_filter": 0, 2024-09-13T16:13:25.287 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_other": 0, 2024-09-13T16:13:25.287 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_active": 0, 2024-09-13T16:13:25.287 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_send": 0, 2024-09-13T16:13:25.287 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_resend": 0, 2024-09-13T16:13:25.288 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_ping": 0, 2024-09-13T16:13:25.288 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_active": 0, 2024-09-13T16:13:25.288 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_send": 0, 2024-09-13T16:13:25.288 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_resend": 0, 2024-09-13T16:13:25.288 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_active": 0, 2024-09-13T16:13:25.288 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_send": 0, 2024-09-13T16:13:25.288 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_resend": 0, 2024-09-13T16:13:25.288 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_active": 0, 2024-09-13T16:13:25.288 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_send": 0, 2024-09-13T16:13:25.288 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_resend": 0, 2024-09-13T16:13:25.288 INFO:teuthology.orchestra.run.smithi189.stdout: "command_active": 0, 2024-09-13T16:13:25.288 INFO:teuthology.orchestra.run.smithi189.stdout: "command_send": 0, 2024-09-13T16:13:25.288 INFO:teuthology.orchestra.run.smithi189.stdout: "command_resend": 0, 2024-09-13T16:13:25.289 INFO:teuthology.orchestra.run.smithi189.stdout: "map_epoch": 94, 2024-09-13T16:13:25.289 INFO:teuthology.orchestra.run.smithi189.stdout: "map_full": 0, 2024-09-13T16:13:25.289 INFO:teuthology.orchestra.run.smithi189.stdout: "map_inc": 4, 2024-09-13T16:13:25.289 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_sessions": 4, 2024-09-13T16:13:25.289 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_open": 5, 2024-09-13T16:13:25.289 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_close": 1, 2024-09-13T16:13:25.289 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_laggy": 0, 2024-09-13T16:13:25.289 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_wr": 0, 2024-09-13T16:13:25.289 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_rd": 2, 2024-09-13T16:13:25.289 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_del": 0 2024-09-13T16:13:25.289 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.289 INFO:teuthology.orchestra.run.smithi189.stdout: "oft": { 2024-09-13T16:13:25.289 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_objs": 0, 2024-09-13T16:13:25.290 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_kv_pairs": 0, 2024-09-13T16:13:25.290 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_updates": 0, 2024-09-13T16:13:25.290 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_removes": 0 2024-09-13T16:13:25.290 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.290 INFO:teuthology.orchestra.run.smithi189.stdout: "osd-slow-ops": { 2024-09-13T16:13:25.290 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_ops_count": 0 2024-09-13T16:13:25.290 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.290 INFO:teuthology.orchestra.run.smithi189.stdout: "purge_queue": { 2024-09-13T16:13:25.290 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops": 0, 2024-09-13T16:13:25.290 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T16:13:25.290 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing": 0, 2024-09-13T16:13:25.290 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_high_water": 0, 2024-09-13T16:13:25.290 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed_ops": 0, 2024-09-13T16:13:25.291 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed": 0, 2024-09-13T16:13:25.291 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_item_in_journal": 0 2024-09-13T16:13:25.291 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.291 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:25.291 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-13T16:13:25.291 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-13T16:13:25.291 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-13T16:13:25.291 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 3738, 2024-09-13T16:13:25.291 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 6425593, 2024-09-13T16:13:25.291 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:25.291 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 3738, 2024-09-13T16:13:25.291 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-13T16:13:25.291 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-13T16:13:25.291 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 3738, 2024-09-13T16:13:25.292 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 6425593, 2024-09-13T16:13:25.292 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-13T16:13:25.292 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.292 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.292 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.292 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-13T16:13:25.292 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.292 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_bytes": { 2024-09-13T16:13:25.292 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-13T16:13:25.292 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-13T16:13:25.292 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-13T16:13:25.292 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-13T16:13:25.292 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-13T16:13:25.293 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:25.293 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:25.293 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 3391, 2024-09-13T16:13:25.293 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 5196840, 2024-09-13T16:13:25.293 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 3391, 2024-09-13T16:13:25.293 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 5196840, 2024-09-13T16:13:25.293 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-13T16:13:25.293 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.293 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.293 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.294 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-13T16:13:25.294 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.294 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_ops": { 2024-09-13T16:13:25.294 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-13T16:13:25.294 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 1024, 2024-09-13T16:13:25.294 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-13T16:13:25.294 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-13T16:13:25.294 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-13T16:13:25.294 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:25.294 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:25.294 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 3391, 2024-09-13T16:13:25.294 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 3391, 2024-09-13T16:13:25.294 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 3391, 2024-09-13T16:13:25.294 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 3391, 2024-09-13T16:13:25.295 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-13T16:13:25.295 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.295 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.295 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.295 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-13T16:13:25.295 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.295 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle": { 2024-09-13T16:13:25.295 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-13T16:13:25.295 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-13T16:13:25.295 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-13T16:13:25.295 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-13T16:13:25.295 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-13T16:13:25.295 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:25.296 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:25.296 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-13T16:13:25.296 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-13T16:13:25.296 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-13T16:13:25.296 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-13T16:13:25.296 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-13T16:13:25.296 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.296 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.296 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.296 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-13T16:13:25.296 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:25.296 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle-0x5568f9e568c0": { 2024-09-13T16:13:25.296 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-13T16:13:25.297 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-13T16:13:25.297 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-13T16:13:25.297 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-13T16:13:25.297 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-13T16:13:25.297 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:25.297 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:25.297 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-13T16:13:25.297 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-13T16:13:25.297 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-13T16:13:25.297 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-13T16:13:25.297 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-13T16:13:25.297 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:25.297 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:25.297 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:25.298 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-13T16:13:25.298 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-13T16:13:25.298 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-13T16:13:26.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:25 smithi189 ceph-mon[34790]: pgmap v855: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-09-13T16:13:26.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:25 smithi193 ceph-mon[35248]: pgmap v855: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-09-13T16:13:26.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:25 smithi017 ceph-mon[30494]: pgmap v855: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-09-13T16:13:26.276 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-13T16:13:26.276 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-13T16:13:26.276 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-13T16:13:26.276 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-09-13T16:13:26.276 DEBUG:tasks.check_counter:Getting stats from k 2024-09-13T16:13:26.277 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-13T16:13:26.475 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T16:13:28.207 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:27 smithi189 ceph-mon[34790]: pgmap v856: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.0 KiB/s wr, 9 op/s 2024-09-13T16:13:28.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:27 smithi193 ceph-mon[35248]: pgmap v856: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.0 KiB/s wr, 9 op/s 2024-09-13T16:13:28.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:27 smithi017 ceph-mon[30494]: pgmap v856: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.0 KiB/s wr, 9 op/s 2024-09-13T16:13:28.475 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-13T16:13:28.475 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:28.475 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 310, 2024-09-13T16:13:28.475 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 307, 2024-09-13T16:13:28.475 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 498464, 2024-09-13T16:13:28.475 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 175520, 2024-09-13T16:13:28.475 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 4, 2024-09-13T16:13:28.475 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 0, 2024-09-13T16:13:28.476 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.042823391, 2024-09-13T16:13:28.476 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.018777793, 2024-09-13T16:13:28.476 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.028515925, 2024-09-13T16:13:28.476 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:28.476 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:28.476 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 306, 2024-09-13T16:13:28.476 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.015420963, 2024-09-13T16:13:28.476 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000050395 2024-09-13T16:13:28.476 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:28.476 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:28.476 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:28.476 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:28.477 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:28.477 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:28.477 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 498464, 2024-09-13T16:13:28.477 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 175520 2024-09-13T16:13:28.477 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:28.477 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:28.477 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 2, 2024-09-13T16:13:28.477 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 234, 2024-09-13T16:13:28.477 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 320, 2024-09-13T16:13:28.477 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 193792, 2024-09-13T16:13:28.477 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 4, 2024-09-13T16:13:28.477 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-13T16:13:28.477 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.012501178, 2024-09-13T16:13:28.478 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.009136273, 2024-09-13T16:13:28.478 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.001111440, 2024-09-13T16:13:28.478 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:28.478 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:28.478 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 232, 2024-09-13T16:13:28.478 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.011440453, 2024-09-13T16:13:28.478 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000049312 2024-09-13T16:13:28.478 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:28.478 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:28.478 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:28.478 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:28.478 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:28.478 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:28.479 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-13T16:13:28.479 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 193792 2024-09-13T16:13:28.479 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:28.479 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:28.479 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 4, 2024-09-13T16:13:28.479 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 4, 2024-09-13T16:13:28.479 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 2992, 2024-09-13T16:13:28.479 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 448, 2024-09-13T16:13:28.479 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 2, 2024-09-13T16:13:28.479 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 1, 2024-09-13T16:13:28.479 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.002280213, 2024-09-13T16:13:28.479 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.000044048, 2024-09-13T16:13:28.479 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.002225164, 2024-09-13T16:13:28.479 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:28.480 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:28.480 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3, 2024-09-13T16:13:28.480 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.004107197, 2024-09-13T16:13:28.480 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.001369065 2024-09-13T16:13:28.480 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:28.480 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:28.480 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:28.480 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:28.480 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:28.480 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:28.480 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-13T16:13:28.480 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 448 2024-09-13T16:13:28.481 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:28.481 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-13T16:13:28.481 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 0, 2024-09-13T16:13:28.481 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-13T16:13:28.481 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:28.481 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-13T16:13:28.481 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:28.481 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:28.481 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:28.481 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:28.481 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:28.481 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:28.481 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:28.482 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:28.482 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:28.482 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:28.482 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:28.482 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:28.482 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:28.482 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:28.482 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:28.482 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:28.482 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:28.482 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:28.482 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:28.483 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:28.483 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:28.483 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:28.483 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:28.483 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:28.483 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:28.483 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:28.483 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:28.483 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:28.483 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:28.483 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:28.483 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:28.483 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-13T16:13:28.484 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:28.484 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:28.484 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:28.485 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:28.485 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 148704, 2024-09-13T16:13:28.485 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 29, 2024-09-13T16:13:28.485 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-13T16:13:28.485 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-13T16:13:28.485 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-13T16:13:28.485 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-13T16:13:28.485 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:28.485 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:28.485 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:28.485 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:28.485 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 0, 2024-09-13T16:13:28.486 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 0, 2024-09-13T16:13:28.486 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:28.486 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:28.486 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:28.486 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-13T16:13:28.486 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 928, 2024-09-13T16:13:28.486 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 2, 2024-09-13T16:13:28.486 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:28.486 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-13T16:13:28.486 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:28.486 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-13T16:13:28.486 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-13T16:13:28.486 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:28.486 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-13T16:13:28.487 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-13T16:13:28.487 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-13T16:13:28.487 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 312, 2024-09-13T16:13:28.487 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 454630, 2024-09-13T16:13:28.487 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:28.487 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 312, 2024-09-13T16:13:28.487 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-13T16:13:28.487 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-13T16:13:28.487 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 312, 2024-09-13T16:13:28.487 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 454630, 2024-09-13T16:13:28.487 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-13T16:13:28.487 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-13T16:13:28.487 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-13T16:13:28.488 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-13T16:13:28.488 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-13T16:13:28.488 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-13T16:13:28.488 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-13T16:13:29.386 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-13T16:13:29.386 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-13T16:13:29.386 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-13T16:13:29.386 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-13T16:13:29.386 DEBUG:tasks.check_counter:Getting stats from c 2024-09-13T16:13:29.387 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-13T16:13:29.685 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:13:30.136 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:29 smithi193 ceph-mon[35248]: pgmap v857: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-09-13T16:13:30.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:29 smithi017 ceph-mon[30494]: pgmap v857: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-09-13T16:13:30.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:29 smithi189 ceph-mon[34790]: pgmap v857: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-09-13T16:13:31.578 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-09-13T16:13:31.578 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 1244, 2024-09-13T16:13:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 1245, 2024-09-13T16:13:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 4600519, 2024-09-13T16:13:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 386583, 2024-09-13T16:13:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 6, 2024-09-13T16:13:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 2, 2024-09-13T16:13:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.122227237, 2024-09-13T16:13:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.035749416, 2024-09-13T16:13:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.035340153, 2024-09-13T16:13:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.040061648, 2024-09-13T16:13:31.579 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1243, 2024-09-13T16:13:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.076393345, 2024-09-13T16:13:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000061458 2024-09-13T16:13:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T16:13:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T16:13:31.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 1291, 2024-09-13T16:13:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 1519, 2024-09-13T16:13:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 1355173, 2024-09-13T16:13:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 873148, 2024-09-13T16:13:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 5, 2024-09-13T16:13:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 4, 2024-09-13T16:13:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.121450731, 2024-09-13T16:13:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.039569690, 2024-09-13T16:13:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.029505117, 2024-09-13T16:13:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.042610897, 2024-09-13T16:13:31.581 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1518, 2024-09-13T16:13:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.099288322, 2024-09-13T16:13:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000065407 2024-09-13T16:13:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-13T16:13:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 473136 2024-09-13T16:13:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.582 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 1361, 2024-09-13T16:13:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 1327, 2024-09-13T16:13:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 5088677, 2024-09-13T16:13:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 490484, 2024-09-13T16:13:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 3, 2024-09-13T16:13:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 2, 2024-09-13T16:13:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.123972964, 2024-09-13T16:13:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.044943376, 2024-09-13T16:13:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.051590236, 2024-09-13T16:13:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.027279039, 2024-09-13T16:13:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1326, 2024-09-13T16:13:31.583 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.080156724, 2024-09-13T16:13:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000060450 2024-09-13T16:13:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 634448, 2024-09-13T16:13:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 175440 2024-09-13T16:13:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: "cct": { 2024-09-13T16:13:31.584 INFO:teuthology.orchestra.run.smithi193.stdout: "total_workers": 1, 2024-09-13T16:13:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: "unhealthy_workers": 0 2024-09-13T16:13:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: "finisher-MDSRank": { 2024-09-13T16:13:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: "queue_len": 0, 2024-09-13T16:13:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: "complete_latency": { 2024-09-13T16:13:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 5927, 2024-09-13T16:13:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.168369306, 2024-09-13T16:13:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000028407 2024-09-13T16:13:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.585 INFO:teuthology.orchestra.run.smithi193.stdout: "finisher-PurgeQueue": { 2024-09-13T16:13:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: "queue_len": 0, 2024-09-13T16:13:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: "complete_latency": { 2024-09-13T16:13:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: "mds": { 2024-09-13T16:13:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: "request": 0, 2024-09-13T16:13:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: "reply": 0, 2024-09-13T16:13:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: "reply_latency": { 2024-09-13T16:13:31.586 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: "slow_reply": 0, 2024-09-13T16:13:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: "forward": 0, 2024-09-13T16:13:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_fetch_complete": 0, 2024-09-13T16:13:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_fetch_keys": 0, 2024-09-13T16:13:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_commit": 0, 2024-09-13T16:13:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_split": 0, 2024-09-13T16:13:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_merge": 0, 2024-09-13T16:13:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes": 526, 2024-09-13T16:13:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_top": 212, 2024-09-13T16:13:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_bottom": 314, 2024-09-13T16:13:31.587 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_pin_tail": 0, 2024-09-13T16:13:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_pinned": 223, 2024-09-13T16:13:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_expired": 0, 2024-09-13T16:13:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_with_caps": 0, 2024-09-13T16:13:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: "caps": 0, 2024-09-13T16:13:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: "subtrees": 16, 2024-09-13T16:13:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse": 0, 2024-09-13T16:13:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_hit": 0, 2024-09-13T16:13:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_forward": 0, 2024-09-13T16:13:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_discover": 0, 2024-09-13T16:13:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_dir_fetch": 0, 2024-09-13T16:13:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_remote_ino": 0, 2024-09-13T16:13:31.588 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_lock": 0, 2024-09-13T16:13:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: "load_cent": 0, 2024-09-13T16:13:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: "q": 0, 2024-09-13T16:13:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: "exported": 0, 2024-09-13T16:13:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: "exported_inodes": 0, 2024-09-13T16:13:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: "imported": 0, 2024-09-13T16:13:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: "imported_inodes": 0, 2024-09-13T16:13:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_dir_fetch": 0, 2024-09-13T16:13:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_backtrace_fetch": 0, 2024-09-13T16:13:31.589 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_peer_discover": 0, 2024-09-13T16:13:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rfiles": 1021, 2024-09-13T16:13:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rbytes": 1538675918, 2024-09-13T16:13:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rsnaps": 0, 2024-09-13T16:13:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T16:13:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_set_tag": 0, 2024-09-13T16:13:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T16:13:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_inotable_repaired": 0, 2024-09-13T16:13:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dir_inodes": 0, 2024-09-13T16:13:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T16:13:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T16:13:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_file_inodes": 0, 2024-09-13T16:13:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_inode_file_caps": 0, 2024-09-13T16:13:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T16:13:31.590 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_grant": 0, 2024-09-13T16:13:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T16:13:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T16:13:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T16:13:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_caps": 0, 2024-09-13T16:13:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_caps_dirty": 0, 2024-09-13T16:13:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_cap_release": 0, 2024-09-13T16:13:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "process_request_cap_release": 0 2024-09-13T16:13:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_cache": { 2024-09-13T16:13:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_update": 0, 2024-09-13T16:13:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_update_receipt": 0, 2024-09-13T16:13:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_try_discover": 0, 2024-09-13T16:13:31.591 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_send_discover": 0, 2024-09-13T16:13:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_handle_discover": 0, 2024-09-13T16:13:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays": 0, 2024-09-13T16:13:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays_delayed": 0, 2024-09-13T16:13:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays_enqueuing": 0, 2024-09-13T16:13:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_created": 0, 2024-09-13T16:13:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_enqueued": 0, 2024-09-13T16:13:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_reintegrated": 0, 2024-09-13T16:13:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_migrated": 0, 2024-09-13T16:13:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_processing": 0, 2024-09-13T16:13:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_enqueued": 0, 2024-09-13T16:13:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_prioritized": 0, 2024-09-13T16:13:31.592 INFO:teuthology.orchestra.run.smithi193.stdout: "recovery_started": 0, 2024-09-13T16:13:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: "recovery_completed": 0, 2024-09-13T16:13:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T16:13:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_exportdir": 0, 2024-09-13T16:13:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_flush": 0, 2024-09-13T16:13:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_fragmentdir": 0, 2024-09-13T16:13:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_fragstats": 0, 2024-09-13T16:13:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_inodestats": 0 2024-09-13T16:13:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_log": { 2024-09-13T16:13:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: "evadd": 0, 2024-09-13T16:13:31.593 INFO:teuthology.orchestra.run.smithi193.stdout: "evex": 0, 2024-09-13T16:13:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "evtrm": 0, 2024-09-13T16:13:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "ev": 3592, 2024-09-13T16:13:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "evexg": 0, 2024-09-13T16:13:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "evexd": 0, 2024-09-13T16:13:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "segadd": 0, 2024-09-13T16:13:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "segex": 0, 2024-09-13T16:13:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "segtrm": 0, 2024-09-13T16:13:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "seg": 2, 2024-09-13T16:13:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "segexg": 0, 2024-09-13T16:13:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "segexd": 0, 2024-09-13T16:13:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "expos": 13330277, 2024-09-13T16:13:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "wrpos": 13613457, 2024-09-13T16:13:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "rdpos": 13611805, 2024-09-13T16:13:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "jlat": { 2024-09-13T16:13:31.594 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "replayed": 3592 2024-09-13T16:13:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_mem": { 2024-09-13T16:13:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "ino": 353, 2024-09-13T16:13:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "ino+": 2334, 2024-09-13T16:13:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "ino-": 1981, 2024-09-13T16:13:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "dir": 31, 2024-09-13T16:13:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "dir+": 126, 2024-09-13T16:13:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "dir-": 95, 2024-09-13T16:13:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "dn": 526, 2024-09-13T16:13:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "dn+": 2415, 2024-09-13T16:13:31.595 INFO:teuthology.orchestra.run.smithi193.stdout: "dn-": 1889, 2024-09-13T16:13:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: "cap": 0, 2024-09-13T16:13:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: "cap+": 0, 2024-09-13T16:13:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: "cap-": 0, 2024-09-13T16:13:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: "rss": 51608, 2024-09-13T16:13:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: "heap": 207124 2024-09-13T16:13:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_server": { 2024-09-13T16:13:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: "dispatch_client_request": 0, 2024-09-13T16:13:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: "dispatch_server_request": 0, 2024-09-13T16:13:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_request": 0, 2024-09-13T16:13:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_session": 0, 2024-09-13T16:13:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_peer_request": 0, 2024-09-13T16:13:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: "req_create_latency": { 2024-09-13T16:13:31.596 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getattr_latency": { 2024-09-13T16:13:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getfilelock_latency": { 2024-09-13T16:13:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.597 INFO:teuthology.orchestra.run.smithi193.stdout: "req_link_latency": { 2024-09-13T16:13:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookup_latency": { 2024-09-13T16:13:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookuphash_latency": { 2024-09-13T16:13:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.598 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupino_latency": { 2024-09-13T16:13:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupname_latency": { 2024-09-13T16:13:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupparent_latency": { 2024-09-13T16:13:31.599 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupsnap_latency": { 2024-09-13T16:13:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lssnap_latency": { 2024-09-13T16:13:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.600 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mkdir_latency": { 2024-09-13T16:13:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mknod_latency": { 2024-09-13T16:13:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mksnap_latency": { 2024-09-13T16:13:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.601 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: "req_open_latency": { 2024-09-13T16:13:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: "req_readdir_latency": { 2024-09-13T16:13:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.602 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rename_latency": { 2024-09-13T16:13:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: "req_renamesnap_latency": { 2024-09-13T16:13:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.603 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: "req_snapdiff_latency": { 2024-09-13T16:13:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmdir_latency": { 2024-09-13T16:13:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.604 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmsnap_latency": { 2024-09-13T16:13:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmxattr_latency": { 2024-09-13T16:13:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setattr_latency": { 2024-09-13T16:13:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.605 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setdirlayout_latency": { 2024-09-13T16:13:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setfilelock_latency": { 2024-09-13T16:13:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setlayout_latency": { 2024-09-13T16:13:31.606 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setxattr_latency": { 2024-09-13T16:13:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: "req_symlink_latency": { 2024-09-13T16:13:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.607 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: "req_unlink_latency": { 2024-09-13T16:13:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: "cap_revoke_eviction": 0, 2024-09-13T16:13:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: "cap_acquisition_throttle": 0, 2024-09-13T16:13:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getvxattr_latency": { 2024-09-13T16:13:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.608 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_sessions": { 2024-09-13T16:13:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: "session_count": 1, 2024-09-13T16:13:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: "session_add": 3, 2024-09-13T16:13:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: "session_remove": 2, 2024-09-13T16:13:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: "sessions_open": 1, 2024-09-13T16:13:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: "sessions_stale": 0, 2024-09-13T16:13:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: "total_load": 0, 2024-09-13T16:13:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: "average_load": 0, 2024-09-13T16:13:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: "avg_session_uptime": 2362, 2024-09-13T16:13:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: "mdthresh_evicted": 0 2024-09-13T16:13:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: "mempool": { 2024-09-13T16:13:31.609 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:31.610 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:31.611 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_items": 0, 2024-09-13T16:13:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_bytes": 201889, 2024-09-13T16:13:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_items": 388, 2024-09-13T16:13:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_bytes": 0, 2024-09-13T16:13:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_items": 0, 2024-09-13T16:13:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_bytes": 0, 2024-09-13T16:13:31.612 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_items": 0, 2024-09-13T16:13:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_bytes": 8864, 2024-09-13T16:13:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_items": 167, 2024-09-13T16:13:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_items": 0, 2024-09-13T16:13:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_bytes": 1210216, 2024-09-13T16:13:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_items": 9957, 2024-09-13T16:13:31.613 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_items": 0, 2024-09-13T16:13:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_items": 0 2024-09-13T16:13:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: "objecter": { 2024-09-13T16:13:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: "op_active": 0, 2024-09-13T16:13:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: "op_laggy": 0, 2024-09-13T16:13:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: "op_send": 3542, 2024-09-13T16:13:31.614 INFO:teuthology.orchestra.run.smithi193.stdout: "op_send_bytes": 26, 2024-09-13T16:13:31.615 INFO:teuthology.orchestra.run.smithi193.stdout: "op_resend": 4, 2024-09-13T16:13:31.615 INFO:teuthology.orchestra.run.smithi193.stdout: "op_reply": 3542, 2024-09-13T16:13:31.615 INFO:teuthology.orchestra.run.smithi193.stdout: "op_latency": { 2024-09-13T16:13:31.615 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 3542, 2024-09-13T16:13:31.615 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 16.585746927, 2024-09-13T16:13:31.615 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.004682593 2024-09-13T16:13:31.616 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.616 INFO:teuthology.orchestra.run.smithi193.stdout: "op_inflight": 0, 2024-09-13T16:13:31.616 INFO:teuthology.orchestra.run.smithi193.stdout: "oplen_avg": { 2024-09-13T16:13:31.616 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 3542, 2024-09-13T16:13:31.616 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 3543 2024-09-13T16:13:31.616 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.617 INFO:teuthology.orchestra.run.smithi193.stdout: "op": 3542, 2024-09-13T16:13:31.617 INFO:teuthology.orchestra.run.smithi193.stdout: "op_r": 3542, 2024-09-13T16:13:31.617 INFO:teuthology.orchestra.run.smithi193.stdout: "op_w": 0, 2024-09-13T16:13:31.617 INFO:teuthology.orchestra.run.smithi193.stdout: "op_rmw": 0, 2024-09-13T16:13:31.617 INFO:teuthology.orchestra.run.smithi193.stdout: "op_pg": 0, 2024-09-13T16:13:31.617 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_stat": 2158, 2024-09-13T16:13:31.618 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_create": 0, 2024-09-13T16:13:31.618 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_read": 1381, 2024-09-13T16:13:31.618 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_write": 0, 2024-09-13T16:13:31.618 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_writefull": 0, 2024-09-13T16:13:31.618 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_writesame": 0, 2024-09-13T16:13:31.618 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_append": 0, 2024-09-13T16:13:31.618 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_zero": 0, 2024-09-13T16:13:31.618 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_truncate": 0, 2024-09-13T16:13:31.618 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_delete": 0, 2024-09-13T16:13:31.619 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_mapext": 0, 2024-09-13T16:13:31.619 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_sparse_read": 0, 2024-09-13T16:13:31.619 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_clonerange": 0, 2024-09-13T16:13:31.619 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_getxattr": 2, 2024-09-13T16:13:31.619 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_setxattr": 0, 2024-09-13T16:13:31.619 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_cmpxattr": 0, 2024-09-13T16:13:31.619 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_rmxattr": 0, 2024-09-13T16:13:31.620 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_resetxattrs": 0, 2024-09-13T16:13:31.620 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_call": 0, 2024-09-13T16:13:31.620 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_watch": 0, 2024-09-13T16:13:31.620 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_notify": 0, 2024-09-13T16:13:31.620 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T16:13:31.620 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_pgls": 0, 2024-09-13T16:13:31.620 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_pgls_filter": 0, 2024-09-13T16:13:31.621 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_other": 0, 2024-09-13T16:13:31.621 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_active": 0, 2024-09-13T16:13:31.621 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_send": 0, 2024-09-13T16:13:31.621 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_resend": 0, 2024-09-13T16:13:31.621 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_ping": 0, 2024-09-13T16:13:31.621 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_active": 0, 2024-09-13T16:13:31.622 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_send": 0, 2024-09-13T16:13:31.622 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_resend": 0, 2024-09-13T16:13:31.622 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_active": 0, 2024-09-13T16:13:31.622 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_send": 0, 2024-09-13T16:13:31.622 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_resend": 0, 2024-09-13T16:13:31.622 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_active": 0, 2024-09-13T16:13:31.622 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_send": 0, 2024-09-13T16:13:31.622 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_resend": 0, 2024-09-13T16:13:31.622 INFO:teuthology.orchestra.run.smithi193.stdout: "command_active": 0, 2024-09-13T16:13:31.622 INFO:teuthology.orchestra.run.smithi193.stdout: "command_send": 0, 2024-09-13T16:13:31.623 INFO:teuthology.orchestra.run.smithi193.stdout: "command_resend": 0, 2024-09-13T16:13:31.623 INFO:teuthology.orchestra.run.smithi193.stdout: "map_epoch": 94, 2024-09-13T16:13:31.623 INFO:teuthology.orchestra.run.smithi193.stdout: "map_full": 0, 2024-09-13T16:13:31.623 INFO:teuthology.orchestra.run.smithi193.stdout: "map_inc": 4, 2024-09-13T16:13:31.623 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_sessions": 5, 2024-09-13T16:13:31.623 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_session_open": 5, 2024-09-13T16:13:31.623 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_session_close": 0, 2024-09-13T16:13:31.623 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_laggy": 0, 2024-09-13T16:13:31.623 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_wr": 0, 2024-09-13T16:13:31.623 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_rd": 2, 2024-09-13T16:13:31.623 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_del": 0 2024-09-13T16:13:31.623 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.623 INFO:teuthology.orchestra.run.smithi193.stdout: "oft": { 2024-09-13T16:13:31.624 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_objs": 0, 2024-09-13T16:13:31.624 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_kv_pairs": 0, 2024-09-13T16:13:31.624 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_updates": 0, 2024-09-13T16:13:31.624 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_removes": 0 2024-09-13T16:13:31.624 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.624 INFO:teuthology.orchestra.run.smithi193.stdout: "osd-slow-ops": { 2024-09-13T16:13:31.624 INFO:teuthology.orchestra.run.smithi193.stdout: "slow_ops_count": 0 2024-09-13T16:13:31.624 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.624 INFO:teuthology.orchestra.run.smithi193.stdout: "purge_queue": { 2024-09-13T16:13:31.624 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_ops": 0, 2024-09-13T16:13:31.624 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T16:13:31.624 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing": 0, 2024-09-13T16:13:31.625 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_high_water": 0, 2024-09-13T16:13:31.625 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executed_ops": 0, 2024-09-13T16:13:31.625 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executed": 0, 2024-09-13T16:13:31.625 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_item_in_journal": 0 2024-09-13T16:13:31.625 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.625 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:31.625 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-13T16:13:31.625 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 104857600, 2024-09-13T16:13:31.625 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-13T16:13:31.625 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 3892, 2024-09-13T16:13:31.625 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 10673263, 2024-09-13T16:13:31.625 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:31.626 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 3892, 2024-09-13T16:13:31.626 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-13T16:13:31.626 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-13T16:13:31.626 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 3892, 2024-09-13T16:13:31.626 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 10673263, 2024-09-13T16:13:31.626 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-13T16:13:31.626 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.626 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.626 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.626 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:31.626 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.626 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-objecter_bytes": { 2024-09-13T16:13:31.626 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-13T16:13:31.626 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 104857600, 2024-09-13T16:13:31.627 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-13T16:13:31.627 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-13T16:13:31.627 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-13T16:13:31.627 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:31.627 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:31.627 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 3542, 2024-09-13T16:13:31.627 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 9419163, 2024-09-13T16:13:31.627 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 3542, 2024-09-13T16:13:31.627 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 9419163, 2024-09-13T16:13:31.627 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-13T16:13:31.627 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.627 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.627 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.627 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:31.628 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.628 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-objecter_ops": { 2024-09-13T16:13:31.628 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-13T16:13:31.628 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 1024, 2024-09-13T16:13:31.628 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-13T16:13:31.628 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-13T16:13:31.628 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-13T16:13:31.628 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:31.628 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:31.628 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 3542, 2024-09-13T16:13:31.628 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 3542, 2024-09-13T16:13:31.628 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 3542, 2024-09-13T16:13:31.628 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 3542, 2024-09-13T16:13:31.628 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-13T16:13:31.629 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.629 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.629 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.629 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:31.629 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.629 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-write_buf_throttle": { 2024-09-13T16:13:31.629 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-13T16:13:31.629 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 3758096384, 2024-09-13T16:13:31.629 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-13T16:13:31.629 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-13T16:13:31.629 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-13T16:13:31.629 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:31.629 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:31.629 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-13T16:13:31.630 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-13T16:13:31.630 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 0, 2024-09-13T16:13:31.630 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 0, 2024-09-13T16:13:31.630 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-13T16:13:31.630 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.630 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.630 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.630 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:31.630 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:31.630 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-write_buf_throttle-0x55909520c960": { 2024-09-13T16:13:31.630 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-13T16:13:31.630 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 3758096384, 2024-09-13T16:13:31.630 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-13T16:13:31.630 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-13T16:13:31.631 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-13T16:13:31.631 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:31.631 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:31.631 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-13T16:13:31.631 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-13T16:13:31.631 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 0, 2024-09-13T16:13:31.631 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 0, 2024-09-13T16:13:31.631 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-13T16:13:31.631 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:31.631 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:31.631 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:31.631 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:31.632 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:31.632 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-09-13T16:13:32.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:31 smithi193 ceph-mon[35248]: pgmap v858: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-13T16:13:32.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:31 smithi017 ceph-mon[30494]: pgmap v858: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-13T16:13:32.299 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-13T16:13:32.299 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-13T16:13:32.299 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-13T16:13:32.299 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-09-13T16:13:32.299 DEBUG:tasks.check_counter:Getting stats from f 2024-09-13T16:13:32.300 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-13T16:13:32.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:31 smithi189 ceph-mon[34790]: pgmap v858: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-13T16:13:32.527 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:13:33.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:32 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:13:33.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:32 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:13:33.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:32 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T16:13:34.216 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:33 smithi193 ceph-mon[35248]: pgmap v859: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-13T16:13:34.216 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:33 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:13:34.217 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:33 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:13:34.217 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:33 smithi193 ceph-mon[35248]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:13:34.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:33 smithi017 ceph-mon[30494]: pgmap v859: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-13T16:13:34.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:33 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:13:34.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:33 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:13:34.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:33 smithi017 ceph-mon[30494]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:13:34.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:33 smithi189 ceph-mon[34790]: pgmap v859: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-13T16:13:34.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:33 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T16:13:34.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:33 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T16:13:34.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:33 smithi189 ceph-mon[34790]: from='mgr.14150 ' entity='mgr.x' 2024-09-13T16:13:34.543 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-09-13T16:13:34.543 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:34.543 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 1312, 2024-09-13T16:13:34.543 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 1314, 2024-09-13T16:13:34.543 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 3607155, 2024-09-13T16:13:34.543 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 408096, 2024-09-13T16:13:34.543 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 7, 2024-09-13T16:13:34.543 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 2, 2024-09-13T16:13:34.543 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.103888867, 2024-09-13T16:13:34.543 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.028365997, 2024-09-13T16:13:34.544 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.031474491, 2024-09-13T16:13:34.544 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.033507434, 2024-09-13T16:13:34.544 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:34.544 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1312, 2024-09-13T16:13:34.544 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.077474507, 2024-09-13T16:13:34.544 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000059050 2024-09-13T16:13:34.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.544 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:34.544 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.544 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.544 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.544 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.545 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T16:13:34.545 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T16:13:34.545 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.545 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:34.545 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 1007, 2024-09-13T16:13:34.545 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 1236, 2024-09-13T16:13:34.545 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 249666, 2024-09-13T16:13:34.545 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 784939, 2024-09-13T16:13:34.545 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 5, 2024-09-13T16:13:34.545 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 4, 2024-09-13T16:13:34.545 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.101841164, 2024-09-13T16:13:34.545 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.028743895, 2024-09-13T16:13:34.545 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.024477472, 2024-09-13T16:13:34.546 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.039039103, 2024-09-13T16:13:34.546 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:34.546 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1235, 2024-09-13T16:13:34.546 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.065587479, 2024-09-13T16:13:34.546 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000053107 2024-09-13T16:13:34.546 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.546 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:34.546 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.546 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.547 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.547 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-13T16:13:34.547 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 473312 2024-09-13T16:13:34.547 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.547 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:34.547 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 1434, 2024-09-13T16:13:34.547 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 1400, 2024-09-13T16:13:34.547 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 999456, 2024-09-13T16:13:34.547 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 513618, 2024-09-13T16:13:34.548 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 3, 2024-09-13T16:13:34.548 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 2, 2024-09-13T16:13:34.548 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.152063854, 2024-09-13T16:13:34.548 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.049858086, 2024-09-13T16:13:34.549 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.058944658, 2024-09-13T16:13:34.549 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.039624945, 2024-09-13T16:13:34.549 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:34.549 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1399, 2024-09-13T16:13:34.549 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.097582638, 2024-09-13T16:13:34.549 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000069751 2024-09-13T16:13:34.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.549 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:34.549 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.549 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.549 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.549 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.549 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 634560, 2024-09-13T16:13:34.550 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 175872 2024-09-13T16:13:34.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.550 INFO:teuthology.orchestra.run.smithi193.stdout: "cct": { 2024-09-13T16:13:34.550 INFO:teuthology.orchestra.run.smithi193.stdout: "total_workers": 1, 2024-09-13T16:13:34.550 INFO:teuthology.orchestra.run.smithi193.stdout: "unhealthy_workers": 0 2024-09-13T16:13:34.550 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.550 INFO:teuthology.orchestra.run.smithi193.stdout: "finisher-MDSRank": { 2024-09-13T16:13:34.550 INFO:teuthology.orchestra.run.smithi193.stdout: "queue_len": 0, 2024-09-13T16:13:34.550 INFO:teuthology.orchestra.run.smithi193.stdout: "complete_latency": { 2024-09-13T16:13:34.550 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 5753, 2024-09-13T16:13:34.550 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.164279805, 2024-09-13T16:13:34.550 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000028555 2024-09-13T16:13:34.550 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:34.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.551 INFO:teuthology.orchestra.run.smithi193.stdout: "finisher-PurgeQueue": { 2024-09-13T16:13:34.551 INFO:teuthology.orchestra.run.smithi193.stdout: "queue_len": 0, 2024-09-13T16:13:34.551 INFO:teuthology.orchestra.run.smithi193.stdout: "complete_latency": { 2024-09-13T16:13:34.551 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.551 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.551 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.551 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:34.551 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.551 INFO:teuthology.orchestra.run.smithi193.stdout: "mds": { 2024-09-13T16:13:34.551 INFO:teuthology.orchestra.run.smithi193.stdout: "request": 0, 2024-09-13T16:13:34.551 INFO:teuthology.orchestra.run.smithi193.stdout: "reply": 0, 2024-09-13T16:13:34.551 INFO:teuthology.orchestra.run.smithi193.stdout: "reply_latency": { 2024-09-13T16:13:34.551 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.552 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.552 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.552 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.552 INFO:teuthology.orchestra.run.smithi193.stdout: "slow_reply": 0, 2024-09-13T16:13:34.552 INFO:teuthology.orchestra.run.smithi193.stdout: "forward": 0, 2024-09-13T16:13:34.552 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_fetch_complete": 0, 2024-09-13T16:13:34.552 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_fetch_keys": 0, 2024-09-13T16:13:34.552 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_commit": 0, 2024-09-13T16:13:34.552 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_split": 0, 2024-09-13T16:13:34.552 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_merge": 0, 2024-09-13T16:13:34.552 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes": 419, 2024-09-13T16:13:34.552 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_top": 69, 2024-09-13T16:13:34.552 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_bottom": 350, 2024-09-13T16:13:34.553 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_pin_tail": 0, 2024-09-13T16:13:34.553 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_pinned": 321, 2024-09-13T16:13:34.553 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_expired": 0, 2024-09-13T16:13:34.553 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_with_caps": 0, 2024-09-13T16:13:34.553 INFO:teuthology.orchestra.run.smithi193.stdout: "caps": 0, 2024-09-13T16:13:34.553 INFO:teuthology.orchestra.run.smithi193.stdout: "subtrees": 10, 2024-09-13T16:13:34.553 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse": 0, 2024-09-13T16:13:34.553 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_hit": 0, 2024-09-13T16:13:34.553 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_forward": 0, 2024-09-13T16:13:34.553 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_discover": 0, 2024-09-13T16:13:34.553 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_dir_fetch": 0, 2024-09-13T16:13:34.553 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_remote_ino": 0, 2024-09-13T16:13:34.553 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_lock": 0, 2024-09-13T16:13:34.554 INFO:teuthology.orchestra.run.smithi193.stdout: "load_cent": 0, 2024-09-13T16:13:34.554 INFO:teuthology.orchestra.run.smithi193.stdout: "q": 0, 2024-09-13T16:13:34.554 INFO:teuthology.orchestra.run.smithi193.stdout: "exported": 0, 2024-09-13T16:13:34.554 INFO:teuthology.orchestra.run.smithi193.stdout: "exported_inodes": 0, 2024-09-13T16:13:34.554 INFO:teuthology.orchestra.run.smithi193.stdout: "imported": 0, 2024-09-13T16:13:34.554 INFO:teuthology.orchestra.run.smithi193.stdout: "imported_inodes": 0, 2024-09-13T16:13:34.554 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_dir_fetch": 0, 2024-09-13T16:13:34.554 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_backtrace_fetch": 0, 2024-09-13T16:13:34.554 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_peer_discover": 0, 2024-09-13T16:13:34.554 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rfiles": 0, 2024-09-13T16:13:34.554 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rbytes": 0, 2024-09-13T16:13:34.554 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rsnaps": 0, 2024-09-13T16:13:34.554 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T16:13:34.554 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_set_tag": 0, 2024-09-13T16:13:34.555 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T16:13:34.555 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_inotable_repaired": 0, 2024-09-13T16:13:34.555 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dir_inodes": 0, 2024-09-13T16:13:34.555 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T16:13:34.555 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T16:13:34.555 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_file_inodes": 0, 2024-09-13T16:13:34.555 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_inode_file_caps": 0, 2024-09-13T16:13:34.555 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T16:13:34.555 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_grant": 0, 2024-09-13T16:13:34.555 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T16:13:34.555 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T16:13:34.555 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T16:13:34.555 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_caps": 0, 2024-09-13T16:13:34.555 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_caps_dirty": 0, 2024-09-13T16:13:34.556 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_cap_release": 0, 2024-09-13T16:13:34.556 INFO:teuthology.orchestra.run.smithi193.stdout: "process_request_cap_release": 0 2024-09-13T16:13:34.556 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.556 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_cache": { 2024-09-13T16:13:34.556 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_update": 0, 2024-09-13T16:13:34.556 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_update_receipt": 0, 2024-09-13T16:13:34.556 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_try_discover": 0, 2024-09-13T16:13:34.556 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_send_discover": 0, 2024-09-13T16:13:34.556 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_handle_discover": 0, 2024-09-13T16:13:34.556 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays": 0, 2024-09-13T16:13:34.556 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays_delayed": 0, 2024-09-13T16:13:34.556 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays_enqueuing": 0, 2024-09-13T16:13:34.556 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_created": 0, 2024-09-13T16:13:34.556 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_enqueued": 0, 2024-09-13T16:13:34.557 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_reintegrated": 0, 2024-09-13T16:13:34.557 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_migrated": 0, 2024-09-13T16:13:34.557 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_processing": 0, 2024-09-13T16:13:34.557 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_enqueued": 0, 2024-09-13T16:13:34.557 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_prioritized": 0, 2024-09-13T16:13:34.557 INFO:teuthology.orchestra.run.smithi193.stdout: "recovery_started": 0, 2024-09-13T16:13:34.557 INFO:teuthology.orchestra.run.smithi193.stdout: "recovery_completed": 0, 2024-09-13T16:13:34.557 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T16:13:34.558 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_exportdir": 0, 2024-09-13T16:13:34.558 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_flush": 0, 2024-09-13T16:13:34.558 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_fragmentdir": 0, 2024-09-13T16:13:34.558 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_fragstats": 0, 2024-09-13T16:13:34.558 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_inodestats": 0 2024-09-13T16:13:34.558 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.558 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_log": { 2024-09-13T16:13:34.558 INFO:teuthology.orchestra.run.smithi193.stdout: "evadd": 0, 2024-09-13T16:13:34.558 INFO:teuthology.orchestra.run.smithi193.stdout: "evex": 0, 2024-09-13T16:13:34.558 INFO:teuthology.orchestra.run.smithi193.stdout: "evtrm": 0, 2024-09-13T16:13:34.558 INFO:teuthology.orchestra.run.smithi193.stdout: "ev": 1839, 2024-09-13T16:13:34.558 INFO:teuthology.orchestra.run.smithi193.stdout: "evexg": 0, 2024-09-13T16:13:34.558 INFO:teuthology.orchestra.run.smithi193.stdout: "evexd": 0, 2024-09-13T16:13:34.558 INFO:teuthology.orchestra.run.smithi193.stdout: "segadd": 0, 2024-09-13T16:13:34.559 INFO:teuthology.orchestra.run.smithi193.stdout: "segex": 0, 2024-09-13T16:13:34.559 INFO:teuthology.orchestra.run.smithi193.stdout: "segtrm": 0, 2024-09-13T16:13:34.559 INFO:teuthology.orchestra.run.smithi193.stdout: "seg": 2, 2024-09-13T16:13:34.559 INFO:teuthology.orchestra.run.smithi193.stdout: "segexg": 0, 2024-09-13T16:13:34.559 INFO:teuthology.orchestra.run.smithi193.stdout: "segexd": 0, 2024-09-13T16:13:34.559 INFO:teuthology.orchestra.run.smithi193.stdout: "expos": 4194304, 2024-09-13T16:13:34.559 INFO:teuthology.orchestra.run.smithi193.stdout: "wrpos": 7460644, 2024-09-13T16:13:34.559 INFO:teuthology.orchestra.run.smithi193.stdout: "rdpos": 7460070, 2024-09-13T16:13:34.559 INFO:teuthology.orchestra.run.smithi193.stdout: "jlat": { 2024-09-13T16:13:34.559 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.559 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.559 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.559 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.560 INFO:teuthology.orchestra.run.smithi193.stdout: "replayed": 1839 2024-09-13T16:13:34.560 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.560 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_mem": { 2024-09-13T16:13:34.560 INFO:teuthology.orchestra.run.smithi193.stdout: "ino": 204, 2024-09-13T16:13:34.560 INFO:teuthology.orchestra.run.smithi193.stdout: "ino+": 648, 2024-09-13T16:13:34.560 INFO:teuthology.orchestra.run.smithi193.stdout: "ino-": 444, 2024-09-13T16:13:34.560 INFO:teuthology.orchestra.run.smithi193.stdout: "dir": 20, 2024-09-13T16:13:34.560 INFO:teuthology.orchestra.run.smithi193.stdout: "dir+": 36, 2024-09-13T16:13:34.560 INFO:teuthology.orchestra.run.smithi193.stdout: "dir-": 16, 2024-09-13T16:13:34.560 INFO:teuthology.orchestra.run.smithi193.stdout: "dn": 419, 2024-09-13T16:13:34.560 INFO:teuthology.orchestra.run.smithi193.stdout: "dn+": 867, 2024-09-13T16:13:34.560 INFO:teuthology.orchestra.run.smithi193.stdout: "dn-": 448, 2024-09-13T16:13:34.560 INFO:teuthology.orchestra.run.smithi193.stdout: "cap": 0, 2024-09-13T16:13:34.560 INFO:teuthology.orchestra.run.smithi193.stdout: "cap+": 0, 2024-09-13T16:13:34.561 INFO:teuthology.orchestra.run.smithi193.stdout: "cap-": 0, 2024-09-13T16:13:34.561 INFO:teuthology.orchestra.run.smithi193.stdout: "rss": 51288, 2024-09-13T16:13:34.561 INFO:teuthology.orchestra.run.smithi193.stdout: "heap": 207124 2024-09-13T16:13:34.561 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.561 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_server": { 2024-09-13T16:13:34.561 INFO:teuthology.orchestra.run.smithi193.stdout: "dispatch_client_request": 0, 2024-09-13T16:13:34.561 INFO:teuthology.orchestra.run.smithi193.stdout: "dispatch_server_request": 0, 2024-09-13T16:13:34.561 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_request": 0, 2024-09-13T16:13:34.561 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_session": 0, 2024-09-13T16:13:34.561 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_peer_request": 0, 2024-09-13T16:13:34.561 INFO:teuthology.orchestra.run.smithi193.stdout: "req_create_latency": { 2024-09-13T16:13:34.561 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.561 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.561 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.562 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getattr_latency": { 2024-09-13T16:13:34.562 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.562 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.562 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.562 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.562 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getfilelock_latency": { 2024-09-13T16:13:34.562 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.562 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.562 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.563 INFO:teuthology.orchestra.run.smithi193.stdout: "req_link_latency": { 2024-09-13T16:13:34.563 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.563 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.563 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.563 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookup_latency": { 2024-09-13T16:13:34.563 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.563 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.563 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.563 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.563 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookuphash_latency": { 2024-09-13T16:13:34.563 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.564 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.564 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.564 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupino_latency": { 2024-09-13T16:13:34.564 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.564 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.564 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.564 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupname_latency": { 2024-09-13T16:13:34.564 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.564 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.564 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.564 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.565 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupparent_latency": { 2024-09-13T16:13:34.565 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.565 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.565 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.565 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupsnap_latency": { 2024-09-13T16:13:34.565 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.565 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.565 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.565 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.565 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lssnap_latency": { 2024-09-13T16:13:34.565 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.565 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.565 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.566 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mkdir_latency": { 2024-09-13T16:13:34.566 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.566 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.566 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.566 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.566 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mknod_latency": { 2024-09-13T16:13:34.566 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.566 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.567 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.567 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mksnap_latency": { 2024-09-13T16:13:34.567 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.567 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.567 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.567 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.567 INFO:teuthology.orchestra.run.smithi193.stdout: "req_open_latency": { 2024-09-13T16:13:34.567 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.568 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.568 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.568 INFO:teuthology.orchestra.run.smithi193.stdout: "req_readdir_latency": { 2024-09-13T16:13:34.568 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.568 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.568 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.568 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rename_latency": { 2024-09-13T16:13:34.568 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.568 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.568 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.568 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.569 INFO:teuthology.orchestra.run.smithi193.stdout: "req_renamesnap_latency": { 2024-09-13T16:13:34.569 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.569 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.569 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.569 INFO:teuthology.orchestra.run.smithi193.stdout: "req_snapdiff_latency": { 2024-09-13T16:13:34.569 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.569 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.569 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.569 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.569 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmdir_latency": { 2024-09-13T16:13:34.569 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.569 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.569 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.570 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmsnap_latency": { 2024-09-13T16:13:34.570 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.570 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.570 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.570 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmxattr_latency": { 2024-09-13T16:13:34.570 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.570 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.570 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.570 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.570 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setattr_latency": { 2024-09-13T16:13:34.570 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.570 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.571 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.571 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setdirlayout_latency": { 2024-09-13T16:13:34.571 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.571 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.571 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.571 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setfilelock_latency": { 2024-09-13T16:13:34.571 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.571 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.571 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.571 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.571 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setlayout_latency": { 2024-09-13T16:13:34.572 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.572 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.572 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.572 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setxattr_latency": { 2024-09-13T16:13:34.572 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.572 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.572 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.572 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.572 INFO:teuthology.orchestra.run.smithi193.stdout: "req_symlink_latency": { 2024-09-13T16:13:34.572 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.572 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.572 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.573 INFO:teuthology.orchestra.run.smithi193.stdout: "req_unlink_latency": { 2024-09-13T16:13:34.573 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.573 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.573 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.573 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.573 INFO:teuthology.orchestra.run.smithi193.stdout: "cap_revoke_eviction": 0, 2024-09-13T16:13:34.573 INFO:teuthology.orchestra.run.smithi193.stdout: "cap_acquisition_throttle": 0, 2024-09-13T16:13:34.573 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getvxattr_latency": { 2024-09-13T16:13:34.573 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.573 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.573 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.573 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:34.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.574 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_sessions": { 2024-09-13T16:13:34.574 INFO:teuthology.orchestra.run.smithi193.stdout: "session_count": 1, 2024-09-13T16:13:34.574 INFO:teuthology.orchestra.run.smithi193.stdout: "session_add": 2, 2024-09-13T16:13:34.574 INFO:teuthology.orchestra.run.smithi193.stdout: "session_remove": 1, 2024-09-13T16:13:34.574 INFO:teuthology.orchestra.run.smithi193.stdout: "sessions_open": 1, 2024-09-13T16:13:34.574 INFO:teuthology.orchestra.run.smithi193.stdout: "sessions_stale": 0, 2024-09-13T16:13:34.574 INFO:teuthology.orchestra.run.smithi193.stdout: "total_load": 0, 2024-09-13T16:13:34.574 INFO:teuthology.orchestra.run.smithi193.stdout: "average_load": 0, 2024-09-13T16:13:34.574 INFO:teuthology.orchestra.run.smithi193.stdout: "avg_session_uptime": 2365, 2024-09-13T16:13:34.574 INFO:teuthology.orchestra.run.smithi193.stdout: "mdthresh_evicted": 0 2024-09-13T16:13:34.574 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.575 INFO:teuthology.orchestra.run.smithi193.stdout: "mempool": { 2024-09-13T16:13:34.575 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:34.575 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:34.575 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:34.575 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:34.575 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:34.575 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:34.575 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:34.575 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:34.575 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:34.575 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:34.575 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:34.575 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:34.575 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:34.576 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:34.576 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:34.576 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:34.576 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:34.576 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:34.576 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:34.576 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:34.576 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:34.576 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:34.576 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:34.576 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:34.576 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:34.577 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:34.577 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:34.577 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:34.577 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:34.577 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:34.577 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:34.577 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_items": 0, 2024-09-13T16:13:34.577 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:34.577 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:34.578 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:34.578 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:34.578 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_bytes": 197362, 2024-09-13T16:13:34.578 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_items": 247, 2024-09-13T16:13:34.578 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_bytes": 0, 2024-09-13T16:13:34.578 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_items": 0, 2024-09-13T16:13:34.578 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_bytes": 0, 2024-09-13T16:13:34.578 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_items": 0, 2024-09-13T16:13:34.578 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:34.578 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:34.578 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:34.578 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:34.578 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_bytes": 8864, 2024-09-13T16:13:34.578 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_items": 167, 2024-09-13T16:13:34.579 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:34.579 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:34.579 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:34.579 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_items": 0, 2024-09-13T16:13:34.579 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_bytes": 794366, 2024-09-13T16:13:34.579 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_items": 15832, 2024-09-13T16:13:34.579 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:34.579 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_items": 0, 2024-09-13T16:13:34.580 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:34.580 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_items": 0 2024-09-13T16:13:34.580 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.580 INFO:teuthology.orchestra.run.smithi193.stdout: "objecter": { 2024-09-13T16:13:34.580 INFO:teuthology.orchestra.run.smithi193.stdout: "op_active": 0, 2024-09-13T16:13:34.580 INFO:teuthology.orchestra.run.smithi193.stdout: "op_laggy": 0, 2024-09-13T16:13:34.580 INFO:teuthology.orchestra.run.smithi193.stdout: "op_send": 3400, 2024-09-13T16:13:34.580 INFO:teuthology.orchestra.run.smithi193.stdout: "op_send_bytes": 21, 2024-09-13T16:13:34.580 INFO:teuthology.orchestra.run.smithi193.stdout: "op_resend": 3, 2024-09-13T16:13:34.580 INFO:teuthology.orchestra.run.smithi193.stdout: "op_reply": 3400, 2024-09-13T16:13:34.580 INFO:teuthology.orchestra.run.smithi193.stdout: "op_latency": { 2024-09-13T16:13:34.580 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 3400, 2024-09-13T16:13:34.580 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 12.891801893, 2024-09-13T16:13:34.580 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.003791706 2024-09-13T16:13:34.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.581 INFO:teuthology.orchestra.run.smithi193.stdout: "op_inflight": 0, 2024-09-13T16:13:34.581 INFO:teuthology.orchestra.run.smithi193.stdout: "oplen_avg": { 2024-09-13T16:13:34.581 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 3400, 2024-09-13T16:13:34.581 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 3401 2024-09-13T16:13:34.581 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.581 INFO:teuthology.orchestra.run.smithi193.stdout: "op": 3400, 2024-09-13T16:13:34.581 INFO:teuthology.orchestra.run.smithi193.stdout: "op_r": 3400, 2024-09-13T16:13:34.581 INFO:teuthology.orchestra.run.smithi193.stdout: "op_w": 0, 2024-09-13T16:13:34.581 INFO:teuthology.orchestra.run.smithi193.stdout: "op_rmw": 0, 2024-09-13T16:13:34.581 INFO:teuthology.orchestra.run.smithi193.stdout: "op_pg": 0, 2024-09-13T16:13:34.581 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_stat": 2086, 2024-09-13T16:13:34.581 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_create": 0, 2024-09-13T16:13:34.582 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_read": 1312, 2024-09-13T16:13:34.582 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_write": 0, 2024-09-13T16:13:34.582 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_writefull": 0, 2024-09-13T16:13:34.582 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_writesame": 0, 2024-09-13T16:13:34.582 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_append": 0, 2024-09-13T16:13:34.582 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_zero": 0, 2024-09-13T16:13:34.582 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_truncate": 0, 2024-09-13T16:13:34.582 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_delete": 0, 2024-09-13T16:13:34.582 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_mapext": 0, 2024-09-13T16:13:34.582 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_sparse_read": 0, 2024-09-13T16:13:34.582 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_clonerange": 0, 2024-09-13T16:13:34.582 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_getxattr": 1, 2024-09-13T16:13:34.582 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_setxattr": 0, 2024-09-13T16:13:34.582 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_cmpxattr": 0, 2024-09-13T16:13:34.583 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_rmxattr": 0, 2024-09-13T16:13:34.583 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_resetxattrs": 0, 2024-09-13T16:13:34.583 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_call": 0, 2024-09-13T16:13:34.583 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_watch": 0, 2024-09-13T16:13:34.583 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_notify": 0, 2024-09-13T16:13:34.583 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T16:13:34.583 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_pgls": 0, 2024-09-13T16:13:34.583 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_pgls_filter": 0, 2024-09-13T16:13:34.583 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_other": 0, 2024-09-13T16:13:34.584 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_active": 0, 2024-09-13T16:13:34.584 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_send": 0, 2024-09-13T16:13:34.584 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_resend": 0, 2024-09-13T16:13:34.584 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_ping": 0, 2024-09-13T16:13:34.584 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_active": 0, 2024-09-13T16:13:34.584 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_send": 0, 2024-09-13T16:13:34.584 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_resend": 0, 2024-09-13T16:13:34.584 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_active": 0, 2024-09-13T16:13:34.584 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_send": 0, 2024-09-13T16:13:34.584 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_resend": 0, 2024-09-13T16:13:34.584 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_active": 0, 2024-09-13T16:13:34.584 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_send": 0, 2024-09-13T16:13:34.584 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_resend": 0, 2024-09-13T16:13:34.585 INFO:teuthology.orchestra.run.smithi193.stdout: "command_active": 0, 2024-09-13T16:13:34.585 INFO:teuthology.orchestra.run.smithi193.stdout: "command_send": 0, 2024-09-13T16:13:34.585 INFO:teuthology.orchestra.run.smithi193.stdout: "command_resend": 0, 2024-09-13T16:13:34.585 INFO:teuthology.orchestra.run.smithi193.stdout: "map_epoch": 94, 2024-09-13T16:13:34.585 INFO:teuthology.orchestra.run.smithi193.stdout: "map_full": 0, 2024-09-13T16:13:34.585 INFO:teuthology.orchestra.run.smithi193.stdout: "map_inc": 4, 2024-09-13T16:13:34.585 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_sessions": 5, 2024-09-13T16:13:34.585 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_session_open": 6, 2024-09-13T16:13:34.585 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_session_close": 1, 2024-09-13T16:13:34.585 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_laggy": 0, 2024-09-13T16:13:34.585 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_wr": 0, 2024-09-13T16:13:34.585 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_rd": 2, 2024-09-13T16:13:34.586 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_del": 0 2024-09-13T16:13:34.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.586 INFO:teuthology.orchestra.run.smithi193.stdout: "oft": { 2024-09-13T16:13:34.586 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_objs": 0, 2024-09-13T16:13:34.586 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_kv_pairs": 0, 2024-09-13T16:13:34.586 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_updates": 0, 2024-09-13T16:13:34.586 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_removes": 0 2024-09-13T16:13:34.586 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.587 INFO:teuthology.orchestra.run.smithi193.stdout: "osd-slow-ops": { 2024-09-13T16:13:34.587 INFO:teuthology.orchestra.run.smithi193.stdout: "slow_ops_count": 0 2024-09-13T16:13:34.587 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.587 INFO:teuthology.orchestra.run.smithi193.stdout: "purge_queue": { 2024-09-13T16:13:34.587 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_ops": 0, 2024-09-13T16:13:34.588 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T16:13:34.588 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing": 0, 2024-09-13T16:13:34.588 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_high_water": 0, 2024-09-13T16:13:34.588 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executed_ops": 0, 2024-09-13T16:13:34.588 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executed": 0, 2024-09-13T16:13:34.588 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_item_in_journal": 0 2024-09-13T16:13:34.588 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.589 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:34.589 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-13T16:13:34.589 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 104857600, 2024-09-13T16:13:34.589 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-13T16:13:34.589 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 3749, 2024-09-13T16:13:34.589 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 4498035, 2024-09-13T16:13:34.589 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:34.589 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 3749, 2024-09-13T16:13:34.589 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-13T16:13:34.589 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-13T16:13:34.589 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 3749, 2024-09-13T16:13:34.589 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 4498035, 2024-09-13T16:13:34.589 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-13T16:13:34.589 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.590 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.590 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.590 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:34.590 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.590 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-objecter_bytes": { 2024-09-13T16:13:34.590 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-13T16:13:34.590 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 104857600, 2024-09-13T16:13:34.590 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-13T16:13:34.590 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-13T16:13:34.590 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-13T16:13:34.590 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:34.590 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:34.591 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 3400, 2024-09-13T16:13:34.591 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 3266345, 2024-09-13T16:13:34.591 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 3400, 2024-09-13T16:13:34.591 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 3266345, 2024-09-13T16:13:34.591 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-13T16:13:34.591 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.591 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.591 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.592 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:34.592 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.592 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-objecter_ops": { 2024-09-13T16:13:34.592 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-13T16:13:34.592 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 1024, 2024-09-13T16:13:34.592 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-13T16:13:34.592 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-13T16:13:34.592 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-13T16:13:34.592 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:34.592 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:34.592 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 3400, 2024-09-13T16:13:34.592 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 3400, 2024-09-13T16:13:34.593 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 3400, 2024-09-13T16:13:34.593 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 3400, 2024-09-13T16:13:34.593 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-13T16:13:34.593 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.593 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.593 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.593 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:34.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.593 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-write_buf_throttle": { 2024-09-13T16:13:34.593 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-13T16:13:34.593 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 3758096384, 2024-09-13T16:13:34.593 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-13T16:13:34.593 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-13T16:13:34.593 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-13T16:13:34.594 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:34.594 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:34.594 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-13T16:13:34.594 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-13T16:13:34.594 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 0, 2024-09-13T16:13:34.594 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 0, 2024-09-13T16:13:34.594 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-13T16:13:34.594 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.594 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.594 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.594 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:34.594 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:34.594 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-write_buf_throttle-0x5652b44148c0": { 2024-09-13T16:13:34.594 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-13T16:13:34.595 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 3758096384, 2024-09-13T16:13:34.595 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-13T16:13:34.595 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-13T16:13:34.595 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-13T16:13:34.595 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:34.595 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:34.595 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-13T16:13:34.595 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-13T16:13:34.595 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 0, 2024-09-13T16:13:34.595 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 0, 2024-09-13T16:13:34.595 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-13T16:13:34.596 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:34.596 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:34.596 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:34.596 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:34.596 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:34.596 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-09-13T16:13:35.725 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-13T16:13:35.726 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-13T16:13:35.726 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-13T16:13:35.726 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-13T16:13:35.726 DEBUG:tasks.check_counter:Getting stats from i 2024-09-13T16:13:35.726 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-13T16:13:35.933 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:13:36.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:35 smithi193 ceph-mon[35248]: pgmap v860: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-13T16:13:36.158 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:35 smithi189 ceph-mon[34790]: pgmap v860: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-13T16:13:36.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:35 smithi017 ceph-mon[30494]: pgmap v860: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-13T16:13:37.671 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-09-13T16:13:37.671 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:37.671 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 3820, 2024-09-13T16:13:37.672 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 4614, 2024-09-13T16:13:37.672 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 1645638, 2024-09-13T16:13:37.672 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 5561306, 2024-09-13T16:13:37.672 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 14, 2024-09-13T16:13:37.672 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 6, 2024-09-13T16:13:37.672 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.263336369, 2024-09-13T16:13:37.672 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.102805189, 2024-09-13T16:13:37.672 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.158271504, 2024-09-13T16:13:37.672 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.024327693, 2024-09-13T16:13:37.672 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:37.672 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 4613, 2024-09-13T16:13:37.673 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.192132835, 2024-09-13T16:13:37.673 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000041650 2024-09-13T16:13:37.673 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.673 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:37.673 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 2635, 2024-09-13T16:13:37.673 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.001156025, 2024-09-13T16:13:37.673 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000438 2024-09-13T16:13:37.673 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.673 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 644656, 2024-09-13T16:13:37.673 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 182864 2024-09-13T16:13:37.673 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.674 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:37.674 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 120, 2024-09-13T16:13:37.674 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 350, 2024-09-13T16:13:37.674 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 65884, 2024-09-13T16:13:37.674 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 658896, 2024-09-13T16:13:37.674 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 12, 2024-09-13T16:13:37.674 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 7, 2024-09-13T16:13:37.674 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.027918929, 2024-09-13T16:13:37.674 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.013022807, 2024-09-13T16:13:37.674 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.008225940, 2024-09-13T16:13:37.674 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.004148472, 2024-09-13T16:13:37.675 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:37.675 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 347, 2024-09-13T16:13:37.675 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.035627616, 2024-09-13T16:13:37.675 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000102673 2024-09-13T16:13:37.675 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.675 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:37.675 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.675 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.675 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.675 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.675 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-13T16:13:37.675 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 560384 2024-09-13T16:13:37.675 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.675 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:37.676 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 3676, 2024-09-13T16:13:37.676 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 3164, 2024-09-13T16:13:37.676 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 1810419, 2024-09-13T16:13:37.676 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 1551809, 2024-09-13T16:13:37.676 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 8, 2024-09-13T16:13:37.676 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 6, 2024-09-13T16:13:37.676 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.210344206, 2024-09-13T16:13:37.676 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.077051056, 2024-09-13T16:13:37.676 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.160212581, 2024-09-13T16:13:37.676 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.008142651, 2024-09-13T16:13:37.676 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:37.677 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 3164, 2024-09-13T16:13:37.677 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.180573348, 2024-09-13T16:13:37.677 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000057071 2024-09-13T16:13:37.677 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.677 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:37.677 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 6314, 2024-09-13T16:13:37.677 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.001169782, 2024-09-13T16:13:37.677 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000185 2024-09-13T16:13:37.677 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.677 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T16:13:37.677 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T16:13:37.678 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.678 INFO:teuthology.orchestra.run.smithi193.stdout: "cct": { 2024-09-13T16:13:37.678 INFO:teuthology.orchestra.run.smithi193.stdout: "total_workers": 1, 2024-09-13T16:13:37.678 INFO:teuthology.orchestra.run.smithi193.stdout: "unhealthy_workers": 0 2024-09-13T16:13:37.678 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.678 INFO:teuthology.orchestra.run.smithi193.stdout: "finisher-MDSRank": { 2024-09-13T16:13:37.678 INFO:teuthology.orchestra.run.smithi193.stdout: "queue_len": 0, 2024-09-13T16:13:37.678 INFO:teuthology.orchestra.run.smithi193.stdout: "complete_latency": { 2024-09-13T16:13:37.678 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1788, 2024-09-13T16:13:37.678 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.569205193, 2024-09-13T16:13:37.678 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000318347 2024-09-13T16:13:37.678 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:37.679 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.679 INFO:teuthology.orchestra.run.smithi193.stdout: "finisher-PurgeQueue": { 2024-09-13T16:13:37.679 INFO:teuthology.orchestra.run.smithi193.stdout: "queue_len": 0, 2024-09-13T16:13:37.679 INFO:teuthology.orchestra.run.smithi193.stdout: "complete_latency": { 2024-09-13T16:13:37.679 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 44, 2024-09-13T16:13:37.679 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.001410097, 2024-09-13T16:13:37.679 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000032047 2024-09-13T16:13:37.679 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:37.679 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.679 INFO:teuthology.orchestra.run.smithi193.stdout: "mds": { 2024-09-13T16:13:37.679 INFO:teuthology.orchestra.run.smithi193.stdout: "request": 1220, 2024-09-13T16:13:37.679 INFO:teuthology.orchestra.run.smithi193.stdout: "reply": 1183, 2024-09-13T16:13:37.680 INFO:teuthology.orchestra.run.smithi193.stdout: "reply_latency": { 2024-09-13T16:13:37.680 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1183, 2024-09-13T16:13:37.680 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 1.924868259, 2024-09-13T16:13:37.680 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.001627107 2024-09-13T16:13:37.680 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.680 INFO:teuthology.orchestra.run.smithi193.stdout: "slow_reply": 0, 2024-09-13T16:13:37.680 INFO:teuthology.orchestra.run.smithi193.stdout: "forward": 37, 2024-09-13T16:13:37.680 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_fetch_complete": 3, 2024-09-13T16:13:37.680 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_fetch_keys": 0, 2024-09-13T16:13:37.680 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_commit": 11, 2024-09-13T16:13:37.680 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_split": 0, 2024-09-13T16:13:37.680 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_merge": 0, 2024-09-13T16:13:37.681 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes": 435, 2024-09-13T16:13:37.681 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_top": 14, 2024-09-13T16:13:37.681 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_bottom": 405, 2024-09-13T16:13:37.681 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_pin_tail": 16, 2024-09-13T16:13:37.681 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_pinned": 415, 2024-09-13T16:13:37.681 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_expired": 462, 2024-09-13T16:13:37.681 INFO:teuthology.orchestra.run.smithi193.stdout: "inodes_with_caps": 194, 2024-09-13T16:13:37.681 INFO:teuthology.orchestra.run.smithi193.stdout: "caps": 194, 2024-09-13T16:13:37.681 INFO:teuthology.orchestra.run.smithi193.stdout: "subtrees": 17, 2024-09-13T16:13:37.681 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse": 3142, 2024-09-13T16:13:37.682 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_hit": 2489, 2024-09-13T16:13:37.682 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_forward": 36, 2024-09-13T16:13:37.682 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_discover": 29, 2024-09-13T16:13:37.682 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_dir_fetch": 2, 2024-09-13T16:13:37.682 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_remote_ino": 0, 2024-09-13T16:13:37.682 INFO:teuthology.orchestra.run.smithi193.stdout: "traverse_lock": 188, 2024-09-13T16:13:37.682 INFO:teuthology.orchestra.run.smithi193.stdout: "load_cent": 540, 2024-09-13T16:13:37.682 INFO:teuthology.orchestra.run.smithi193.stdout: "q": 0, 2024-09-13T16:13:37.682 INFO:teuthology.orchestra.run.smithi193.stdout: "exported": 15, 2024-09-13T16:13:37.682 INFO:teuthology.orchestra.run.smithi193.stdout: "exported_inodes": 445, 2024-09-13T16:13:37.683 INFO:teuthology.orchestra.run.smithi193.stdout: "imported": 22, 2024-09-13T16:13:37.683 INFO:teuthology.orchestra.run.smithi193.stdout: "imported_inodes": 623, 2024-09-13T16:13:37.683 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_dir_fetch": 0, 2024-09-13T16:13:37.683 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_backtrace_fetch": 0, 2024-09-13T16:13:37.683 INFO:teuthology.orchestra.run.smithi193.stdout: "openino_peer_discover": 0, 2024-09-13T16:13:37.683 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rfiles": 1022, 2024-09-13T16:13:37.683 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rbytes": 1584583718, 2024-09-13T16:13:37.683 INFO:teuthology.orchestra.run.smithi193.stdout: "root_rsnaps": 0, 2024-09-13T16:13:37.683 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T16:13:37.683 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_set_tag": 0, 2024-09-13T16:13:37.683 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T16:13:37.683 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_inotable_repaired": 0, 2024-09-13T16:13:37.684 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dir_inodes": 0, 2024-09-13T16:13:37.684 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T16:13:37.684 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T16:13:37.684 INFO:teuthology.orchestra.run.smithi193.stdout: "scrub_file_inodes": 0, 2024-09-13T16:13:37.684 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_inode_file_caps": 6, 2024-09-13T16:13:37.684 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_revoke": 186, 2024-09-13T16:13:37.684 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_grant": 552, 2024-09-13T16:13:37.684 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T16:13:37.684 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T16:13:37.684 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T16:13:37.685 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_caps": 901, 2024-09-13T16:13:37.685 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_caps_dirty": 498, 2024-09-13T16:13:37.685 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_cap_release": 40, 2024-09-13T16:13:37.685 INFO:teuthology.orchestra.run.smithi193.stdout: "process_request_cap_release": 534 2024-09-13T16:13:37.685 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.685 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_cache": { 2024-09-13T16:13:37.685 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_update": 48, 2024-09-13T16:13:37.685 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_update_receipt": 206, 2024-09-13T16:13:37.685 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_try_discover": 115, 2024-09-13T16:13:37.685 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_send_discover": 155, 2024-09-13T16:13:37.685 INFO:teuthology.orchestra.run.smithi193.stdout: "dir_handle_discover": 69, 2024-09-13T16:13:37.686 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays": 0, 2024-09-13T16:13:37.686 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays_delayed": 0, 2024-09-13T16:13:37.686 INFO:teuthology.orchestra.run.smithi193.stdout: "num_strays_enqueuing": 0, 2024-09-13T16:13:37.686 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_created": 128, 2024-09-13T16:13:37.686 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_enqueued": 5, 2024-09-13T16:13:37.686 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_reintegrated": 123, 2024-09-13T16:13:37.686 INFO:teuthology.orchestra.run.smithi193.stdout: "strays_migrated": 0, 2024-09-13T16:13:37.686 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_processing": 0, 2024-09-13T16:13:37.686 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_enqueued": 0, 2024-09-13T16:13:37.686 INFO:teuthology.orchestra.run.smithi193.stdout: "num_recovering_prioritized": 0, 2024-09-13T16:13:37.687 INFO:teuthology.orchestra.run.smithi193.stdout: "recovery_started": 0, 2024-09-13T16:13:37.687 INFO:teuthology.orchestra.run.smithi193.stdout: "recovery_completed": 0, 2024-09-13T16:13:37.687 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T16:13:37.687 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_exportdir": 15, 2024-09-13T16:13:37.687 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_flush": 0, 2024-09-13T16:13:37.687 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_fragmentdir": 0, 2024-09-13T16:13:37.687 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_fragstats": 0, 2024-09-13T16:13:37.687 INFO:teuthology.orchestra.run.smithi193.stdout: "ireq_inodestats": 0 2024-09-13T16:13:37.687 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.687 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_log": { 2024-09-13T16:13:37.687 INFO:teuthology.orchestra.run.smithi193.stdout: "evadd": 1852, 2024-09-13T16:13:37.687 INFO:teuthology.orchestra.run.smithi193.stdout: "evex": 0, 2024-09-13T16:13:37.687 INFO:teuthology.orchestra.run.smithi193.stdout: "evtrm": 0, 2024-09-13T16:13:37.688 INFO:teuthology.orchestra.run.smithi193.stdout: "ev": 1852, 2024-09-13T16:13:37.688 INFO:teuthology.orchestra.run.smithi193.stdout: "evexg": 0, 2024-09-13T16:13:37.688 INFO:teuthology.orchestra.run.smithi193.stdout: "evexd": 0, 2024-09-13T16:13:37.688 INFO:teuthology.orchestra.run.smithi193.stdout: "segadd": 2, 2024-09-13T16:13:37.688 INFO:teuthology.orchestra.run.smithi193.stdout: "segex": 0, 2024-09-13T16:13:37.688 INFO:teuthology.orchestra.run.smithi193.stdout: "segtrm": 0, 2024-09-13T16:13:37.688 INFO:teuthology.orchestra.run.smithi193.stdout: "seg": 2, 2024-09-13T16:13:37.688 INFO:teuthology.orchestra.run.smithi193.stdout: "segexg": 0, 2024-09-13T16:13:37.688 INFO:teuthology.orchestra.run.smithi193.stdout: "segexd": 0, 2024-09-13T16:13:37.688 INFO:teuthology.orchestra.run.smithi193.stdout: "expos": 4194304, 2024-09-13T16:13:37.689 INFO:teuthology.orchestra.run.smithi193.stdout: "wrpos": 7483952, 2024-09-13T16:13:37.689 INFO:teuthology.orchestra.run.smithi193.stdout: "rdpos": 0, 2024-09-13T16:13:37.689 INFO:teuthology.orchestra.run.smithi193.stdout: "jlat": { 2024-09-13T16:13:37.689 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 820, 2024-09-13T16:13:37.689 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 3.437142691, 2024-09-13T16:13:37.689 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.004191637 2024-09-13T16:13:37.689 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.689 INFO:teuthology.orchestra.run.smithi193.stdout: "replayed": 0 2024-09-13T16:13:37.689 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.689 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_mem": { 2024-09-13T16:13:37.689 INFO:teuthology.orchestra.run.smithi193.stdout: "ino": 235, 2024-09-13T16:13:37.689 INFO:teuthology.orchestra.run.smithi193.stdout: "ino+": 682, 2024-09-13T16:13:37.690 INFO:teuthology.orchestra.run.smithi193.stdout: "ino-": 447, 2024-09-13T16:13:37.690 INFO:teuthology.orchestra.run.smithi193.stdout: "dir": 49, 2024-09-13T16:13:37.690 INFO:teuthology.orchestra.run.smithi193.stdout: "dir+": 124, 2024-09-13T16:13:37.690 INFO:teuthology.orchestra.run.smithi193.stdout: "dir-": 75, 2024-09-13T16:13:37.690 INFO:teuthology.orchestra.run.smithi193.stdout: "dn": 435, 2024-09-13T16:13:37.690 INFO:teuthology.orchestra.run.smithi193.stdout: "dn+": 904, 2024-09-13T16:13:37.690 INFO:teuthology.orchestra.run.smithi193.stdout: "dn-": 469, 2024-09-13T16:13:37.690 INFO:teuthology.orchestra.run.smithi193.stdout: "cap": 181, 2024-09-13T16:13:37.690 INFO:teuthology.orchestra.run.smithi193.stdout: "cap+": 610, 2024-09-13T16:13:37.690 INFO:teuthology.orchestra.run.smithi193.stdout: "cap-": 429, 2024-09-13T16:13:37.690 INFO:teuthology.orchestra.run.smithi193.stdout: "rss": 56616, 2024-09-13T16:13:37.690 INFO:teuthology.orchestra.run.smithi193.stdout: "heap": 198932 2024-09-13T16:13:37.691 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.691 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_server": { 2024-09-13T16:13:37.691 INFO:teuthology.orchestra.run.smithi193.stdout: "dispatch_client_request": 2008, 2024-09-13T16:13:37.691 INFO:teuthology.orchestra.run.smithi193.stdout: "dispatch_server_request": 1, 2024-09-13T16:13:37.691 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_request": 1220, 2024-09-13T16:13:37.691 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_client_session": 262, 2024-09-13T16:13:37.691 INFO:teuthology.orchestra.run.smithi193.stdout: "handle_peer_request": 28, 2024-09-13T16:13:37.691 INFO:teuthology.orchestra.run.smithi193.stdout: "req_create_latency": { 2024-09-13T16:13:37.691 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 28, 2024-09-13T16:13:37.691 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.084423450, 2024-09-13T16:13:37.691 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.003015123 2024-09-13T16:13:37.691 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.691 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getattr_latency": { 2024-09-13T16:13:37.692 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1, 2024-09-13T16:13:37.692 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000201062, 2024-09-13T16:13:37.692 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000201062 2024-09-13T16:13:37.692 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.692 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getfilelock_latency": { 2024-09-13T16:13:37.692 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.692 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.692 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.692 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.692 INFO:teuthology.orchestra.run.smithi193.stdout: "req_link_latency": { 2024-09-13T16:13:37.692 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 123, 2024-09-13T16:13:37.692 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.214806500, 2024-09-13T16:13:37.692 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.001746394 2024-09-13T16:13:37.693 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.693 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookup_latency": { 2024-09-13T16:13:37.693 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 676, 2024-09-13T16:13:37.693 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.479574584, 2024-09-13T16:13:37.693 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000709429 2024-09-13T16:13:37.693 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.693 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookuphash_latency": { 2024-09-13T16:13:37.693 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.693 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.693 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.693 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.693 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupino_latency": { 2024-09-13T16:13:37.694 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1, 2024-09-13T16:13:37.694 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000101680, 2024-09-13T16:13:37.694 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000101680 2024-09-13T16:13:37.694 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.694 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupname_latency": { 2024-09-13T16:13:37.694 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.694 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.694 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.694 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.694 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupparent_latency": { 2024-09-13T16:13:37.694 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.695 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.695 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.695 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.695 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lookupsnap_latency": { 2024-09-13T16:13:37.695 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.695 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.695 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.695 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.695 INFO:teuthology.orchestra.run.smithi193.stdout: "req_lssnap_latency": { 2024-09-13T16:13:37.695 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.695 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.695 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.696 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.696 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mkdir_latency": { 2024-09-13T16:13:37.696 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.697 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.697 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.697 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.697 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mknod_latency": { 2024-09-13T16:13:37.697 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.697 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.697 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.697 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.697 INFO:teuthology.orchestra.run.smithi193.stdout: "req_mksnap_latency": { 2024-09-13T16:13:37.697 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.697 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.697 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.697 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.698 INFO:teuthology.orchestra.run.smithi193.stdout: "req_open_latency": { 2024-09-13T16:13:37.698 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 94, 2024-09-13T16:13:37.698 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.069823494, 2024-09-13T16:13:37.698 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000742803 2024-09-13T16:13:37.698 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.698 INFO:teuthology.orchestra.run.smithi193.stdout: "req_readdir_latency": { 2024-09-13T16:13:37.698 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 9, 2024-09-13T16:13:37.698 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.023328326, 2024-09-13T16:13:37.698 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.002592036 2024-09-13T16:13:37.698 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.698 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rename_latency": { 2024-09-13T16:13:37.698 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 123, 2024-09-13T16:13:37.698 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.794439521, 2024-09-13T16:13:37.699 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.006458857 2024-09-13T16:13:37.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.699 INFO:teuthology.orchestra.run.smithi193.stdout: "req_renamesnap_latency": { 2024-09-13T16:13:37.699 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.699 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.699 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.699 INFO:teuthology.orchestra.run.smithi193.stdout: "req_snapdiff_latency": { 2024-09-13T16:13:37.699 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.699 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.699 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.699 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.699 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmdir_latency": { 2024-09-13T16:13:37.700 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.700 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.700 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.700 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.700 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmsnap_latency": { 2024-09-13T16:13:37.700 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.700 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.700 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.700 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.700 INFO:teuthology.orchestra.run.smithi193.stdout: "req_rmxattr_latency": { 2024-09-13T16:13:37.700 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.700 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.700 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.700 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.701 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setattr_latency": { 2024-09-13T16:13:37.701 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.701 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.701 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.701 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.701 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setdirlayout_latency": { 2024-09-13T16:13:37.701 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.701 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.701 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.701 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.701 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setfilelock_latency": { 2024-09-13T16:13:37.701 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.701 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.702 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.702 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.702 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setlayout_latency": { 2024-09-13T16:13:37.702 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.702 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.702 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.702 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.702 INFO:teuthology.orchestra.run.smithi193.stdout: "req_setxattr_latency": { 2024-09-13T16:13:37.702 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.702 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.702 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.702 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.702 INFO:teuthology.orchestra.run.smithi193.stdout: "req_symlink_latency": { 2024-09-13T16:13:37.702 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.703 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.703 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.703 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.703 INFO:teuthology.orchestra.run.smithi193.stdout: "req_unlink_latency": { 2024-09-13T16:13:37.703 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 128, 2024-09-13T16:13:37.703 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.258169642, 2024-09-13T16:13:37.703 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.002016950 2024-09-13T16:13:37.703 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.703 INFO:teuthology.orchestra.run.smithi193.stdout: "cap_revoke_eviction": 0, 2024-09-13T16:13:37.703 INFO:teuthology.orchestra.run.smithi193.stdout: "cap_acquisition_throttle": 0, 2024-09-13T16:13:37.703 INFO:teuthology.orchestra.run.smithi193.stdout: "req_getvxattr_latency": { 2024-09-13T16:13:37.703 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.703 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.703 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.704 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:37.704 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.704 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_sessions": { 2024-09-13T16:13:37.704 INFO:teuthology.orchestra.run.smithi193.stdout: "session_count": 1, 2024-09-13T16:13:37.704 INFO:teuthology.orchestra.run.smithi193.stdout: "session_add": 2, 2024-09-13T16:13:37.704 INFO:teuthology.orchestra.run.smithi193.stdout: "session_remove": 1, 2024-09-13T16:13:37.704 INFO:teuthology.orchestra.run.smithi193.stdout: "sessions_open": 1, 2024-09-13T16:13:37.704 INFO:teuthology.orchestra.run.smithi193.stdout: "sessions_stale": 0, 2024-09-13T16:13:37.704 INFO:teuthology.orchestra.run.smithi193.stdout: "total_load": 221, 2024-09-13T16:13:37.704 INFO:teuthology.orchestra.run.smithi193.stdout: "average_load": 221, 2024-09-13T16:13:37.704 INFO:teuthology.orchestra.run.smithi193.stdout: "avg_session_uptime": 967, 2024-09-13T16:13:37.704 INFO:teuthology.orchestra.run.smithi193.stdout: "mdthresh_evicted": 0 2024-09-13T16:13:37.705 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.705 INFO:teuthology.orchestra.run.smithi193.stdout: "mempool": { 2024-09-13T16:13:37.705 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:37.705 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:37.705 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:37.705 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:37.705 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:37.705 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:37.705 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:37.705 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:37.705 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:37.705 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:37.705 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:37.705 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:37.706 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:37.706 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:37.706 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:37.706 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:37.706 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:37.706 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:37.706 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:37.706 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:37.706 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:37.706 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:37.706 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:37.706 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:37.706 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:37.707 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:37.707 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:37.707 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:37.707 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:37.707 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:37.707 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:37.707 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_items": 0, 2024-09-13T16:13:37.707 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:37.707 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:37.707 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:37.707 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:37.707 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_bytes": 330348, 2024-09-13T16:13:37.707 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_items": 344, 2024-09-13T16:13:37.708 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_bytes": 88, 2024-09-13T16:13:37.708 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_items": 1, 2024-09-13T16:13:37.708 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_bytes": 0, 2024-09-13T16:13:37.708 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_items": 0, 2024-09-13T16:13:37.708 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:37.708 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:37.708 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:37.708 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:37.708 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_bytes": 8864, 2024-09-13T16:13:37.708 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_items": 167, 2024-09-13T16:13:37.708 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:37.708 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:37.709 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:37.709 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_items": 0, 2024-09-13T16:13:37.709 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_bytes": 1016202, 2024-09-13T16:13:37.709 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_items": 20457, 2024-09-13T16:13:37.709 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:37.709 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_items": 0, 2024-09-13T16:13:37.709 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:37.709 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_items": 0 2024-09-13T16:13:37.709 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.709 INFO:teuthology.orchestra.run.smithi193.stdout: "objecter": { 2024-09-13T16:13:37.709 INFO:teuthology.orchestra.run.smithi193.stdout: "op_active": 0, 2024-09-13T16:13:37.709 INFO:teuthology.orchestra.run.smithi193.stdout: "op_laggy": 0, 2024-09-13T16:13:37.709 INFO:teuthology.orchestra.run.smithi193.stdout: "op_send": 1040, 2024-09-13T16:13:37.710 INFO:teuthology.orchestra.run.smithi193.stdout: "op_send_bytes": 3356952, 2024-09-13T16:13:37.710 INFO:teuthology.orchestra.run.smithi193.stdout: "op_resend": 27, 2024-09-13T16:13:37.710 INFO:teuthology.orchestra.run.smithi193.stdout: "op_reply": 1040, 2024-09-13T16:13:37.710 INFO:teuthology.orchestra.run.smithi193.stdout: "op_latency": { 2024-09-13T16:13:37.710 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1040, 2024-09-13T16:13:37.710 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 8.032875888, 2024-09-13T16:13:37.710 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.007723919 2024-09-13T16:13:37.710 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.710 INFO:teuthology.orchestra.run.smithi193.stdout: "op_inflight": 0, 2024-09-13T16:13:37.710 INFO:teuthology.orchestra.run.smithi193.stdout: "oplen_avg": { 2024-09-13T16:13:37.710 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 1040, 2024-09-13T16:13:37.710 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 1167 2024-09-13T16:13:37.710 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.710 INFO:teuthology.orchestra.run.smithi193.stdout: "op": 1040, 2024-09-13T16:13:37.711 INFO:teuthology.orchestra.run.smithi193.stdout: "op_r": 14, 2024-09-13T16:13:37.711 INFO:teuthology.orchestra.run.smithi193.stdout: "op_w": 1026, 2024-09-13T16:13:37.711 INFO:teuthology.orchestra.run.smithi193.stdout: "op_rmw": 0, 2024-09-13T16:13:37.711 INFO:teuthology.orchestra.run.smithi193.stdout: "op_pg": 0, 2024-09-13T16:13:37.711 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_stat": 0, 2024-09-13T16:13:37.711 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_create": 10, 2024-09-13T16:13:37.711 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_read": 3, 2024-09-13T16:13:37.711 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_write": 823, 2024-09-13T16:13:37.711 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_writefull": 66, 2024-09-13T16:13:37.711 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_writesame": 0, 2024-09-13T16:13:37.711 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_append": 0, 2024-09-13T16:13:37.711 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_zero": 0, 2024-09-13T16:13:37.711 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_truncate": 0, 2024-09-13T16:13:37.711 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_delete": 31, 2024-09-13T16:13:37.712 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_mapext": 0, 2024-09-13T16:13:37.712 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_sparse_read": 0, 2024-09-13T16:13:37.712 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_clonerange": 0, 2024-09-13T16:13:37.712 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_getxattr": 2, 2024-09-13T16:13:37.712 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_setxattr": 20, 2024-09-13T16:13:37.712 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_cmpxattr": 0, 2024-09-13T16:13:37.712 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_rmxattr": 0, 2024-09-13T16:13:37.712 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_resetxattrs": 0, 2024-09-13T16:13:37.712 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_call": 0, 2024-09-13T16:13:37.712 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_watch": 0, 2024-09-13T16:13:37.712 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_notify": 0, 2024-09-13T16:13:37.712 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T16:13:37.712 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_pgls": 0, 2024-09-13T16:13:37.713 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_pgls_filter": 0, 2024-09-13T16:13:37.713 INFO:teuthology.orchestra.run.smithi193.stdout: "osdop_other": 0, 2024-09-13T16:13:37.713 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_active": 0, 2024-09-13T16:13:37.713 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_send": 0, 2024-09-13T16:13:37.713 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_resend": 0, 2024-09-13T16:13:37.713 INFO:teuthology.orchestra.run.smithi193.stdout: "linger_ping": 0, 2024-09-13T16:13:37.713 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_active": 0, 2024-09-13T16:13:37.713 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_send": 0, 2024-09-13T16:13:37.713 INFO:teuthology.orchestra.run.smithi193.stdout: "poolop_resend": 0, 2024-09-13T16:13:37.713 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_active": 0, 2024-09-13T16:13:37.713 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_send": 0, 2024-09-13T16:13:37.713 INFO:teuthology.orchestra.run.smithi193.stdout: "poolstat_resend": 0, 2024-09-13T16:13:37.713 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_active": 0, 2024-09-13T16:13:37.714 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_send": 0, 2024-09-13T16:13:37.714 INFO:teuthology.orchestra.run.smithi193.stdout: "statfs_resend": 0, 2024-09-13T16:13:37.714 INFO:teuthology.orchestra.run.smithi193.stdout: "command_active": 0, 2024-09-13T16:13:37.714 INFO:teuthology.orchestra.run.smithi193.stdout: "command_send": 0, 2024-09-13T16:13:37.714 INFO:teuthology.orchestra.run.smithi193.stdout: "command_resend": 0, 2024-09-13T16:13:37.714 INFO:teuthology.orchestra.run.smithi193.stdout: "map_epoch": 94, 2024-09-13T16:13:37.714 INFO:teuthology.orchestra.run.smithi193.stdout: "map_full": 0, 2024-09-13T16:13:37.714 INFO:teuthology.orchestra.run.smithi193.stdout: "map_inc": 4, 2024-09-13T16:13:37.714 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_sessions": 12, 2024-09-13T16:13:37.714 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_session_open": 15, 2024-09-13T16:13:37.714 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_session_close": 3, 2024-09-13T16:13:37.714 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_laggy": 0, 2024-09-13T16:13:37.714 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_wr": 158, 2024-09-13T16:13:37.714 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_rd": 14, 2024-09-13T16:13:37.715 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_del": 40 2024-09-13T16:13:37.715 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.715 INFO:teuthology.orchestra.run.smithi193.stdout: "oft": { 2024-09-13T16:13:37.715 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_objs": 1, 2024-09-13T16:13:37.715 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_kv_pairs": 0, 2024-09-13T16:13:37.715 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_updates": 0, 2024-09-13T16:13:37.715 INFO:teuthology.orchestra.run.smithi193.stdout: "omap_total_removes": 0 2024-09-13T16:13:37.715 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.715 INFO:teuthology.orchestra.run.smithi193.stdout: "osd-slow-ops": { 2024-09-13T16:13:37.715 INFO:teuthology.orchestra.run.smithi193.stdout: "slow_ops_count": 0 2024-09-13T16:13:37.715 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.715 INFO:teuthology.orchestra.run.smithi193.stdout: "purge_queue": { 2024-09-13T16:13:37.715 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_ops": 0, 2024-09-13T16:13:37.716 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_ops_high_water": 15, 2024-09-13T16:13:37.716 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing": 0, 2024-09-13T16:13:37.716 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executing_high_water": 3, 2024-09-13T16:13:37.716 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executed_ops": 19, 2024-09-13T16:13:37.716 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_executed": 5, 2024-09-13T16:13:37.716 INFO:teuthology.orchestra.run.smithi193.stdout: "pq_item_in_journal": 0 2024-09-13T16:13:37.716 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.716 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:37.716 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-13T16:13:37.716 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 104857600, 2024-09-13T16:13:37.717 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-13T16:13:37.717 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 7612, 2024-09-13T16:13:37.717 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 2856030, 2024-09-13T16:13:37.717 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:37.717 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 7612, 2024-09-13T16:13:37.717 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-13T16:13:37.717 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-13T16:13:37.717 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 7612, 2024-09-13T16:13:37.717 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 2856030, 2024-09-13T16:13:37.717 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-13T16:13:37.717 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.717 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.717 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.718 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:37.718 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.718 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-objecter_bytes": { 2024-09-13T16:13:37.718 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-13T16:13:37.718 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 104857600, 2024-09-13T16:13:37.718 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-13T16:13:37.718 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-13T16:13:37.718 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-13T16:13:37.718 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:37.718 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:37.718 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 1040, 2024-09-13T16:13:37.718 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 3357185, 2024-09-13T16:13:37.719 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 1040, 2024-09-13T16:13:37.719 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 3357185, 2024-09-13T16:13:37.719 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-13T16:13:37.719 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.719 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.719 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.719 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:37.719 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.719 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-objecter_ops": { 2024-09-13T16:13:37.719 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-13T16:13:37.719 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 1024, 2024-09-13T16:13:37.719 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-13T16:13:37.719 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 0, 2024-09-13T16:13:37.720 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 0, 2024-09-13T16:13:37.720 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:37.720 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 0, 2024-09-13T16:13:37.720 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 1040, 2024-09-13T16:13:37.720 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 1040, 2024-09-13T16:13:37.720 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 1040, 2024-09-13T16:13:37.720 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 1040, 2024-09-13T16:13:37.720 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-13T16:13:37.720 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.720 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.721 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.721 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:37.721 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.721 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-write_buf_throttle": { 2024-09-13T16:13:37.721 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-13T16:13:37.721 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 3758096384, 2024-09-13T16:13:37.721 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-13T16:13:37.721 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 5, 2024-09-13T16:13:37.721 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 545, 2024-09-13T16:13:37.721 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:37.721 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 5, 2024-09-13T16:13:37.721 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-13T16:13:37.721 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-13T16:13:37.722 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 3, 2024-09-13T16:13:37.722 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 545, 2024-09-13T16:13:37.722 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-13T16:13:37.722 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.722 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.722 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.722 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:37.722 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:37.722 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-write_buf_throttle-0x55c040fb4500": { 2024-09-13T16:13:37.722 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-13T16:13:37.722 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 3758096384, 2024-09-13T16:13:37.722 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-13T16:13:37.722 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 1852, 2024-09-13T16:13:37.723 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 3289648, 2024-09-13T16:13:37.723 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:37.723 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 1852, 2024-09-13T16:13:37.723 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-13T16:13:37.723 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-13T16:13:37.723 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 820, 2024-09-13T16:13:37.723 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 3289648, 2024-09-13T16:13:37.723 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-13T16:13:37.723 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:37.723 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:37.723 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:37.723 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:37.723 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:37.724 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-09-13T16:13:38.005 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:37 smithi193 ceph-mon[35248]: pgmap v861: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.3 KiB/s wr, 10 op/s 2024-09-13T16:13:38.188 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:37 smithi189 ceph-mon[34790]: pgmap v861: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.3 KiB/s wr, 10 op/s 2024-09-13T16:13:38.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:37 smithi017 ceph-mon[30494]: pgmap v861: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.3 KiB/s wr, 10 op/s 2024-09-13T16:13:38.480 INFO:tasks.check_counter:Daemon mds.i mds.exported=15 2024-09-13T16:13:38.480 INFO:tasks.check_counter:Daemon mds.i mds.imported=22 2024-09-13T16:13:38.480 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=48 2024-09-13T16:13:38.480 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=206 2024-09-13T16:13:38.481 DEBUG:tasks.check_counter:Getting stats from l 2024-09-13T16:13:38.481 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361 shell --fsid 3334a620-71e7-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-13T16:13:38.682 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T16:13:40.145 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:39 smithi193 ceph-mon[35248]: pgmap v862: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.0 KiB/s wr, 7 op/s 2024-09-13T16:13:40.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:39 smithi017 ceph-mon[30494]: pgmap v862: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.0 KiB/s wr, 7 op/s 2024-09-13T16:13:40.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:39 smithi189 ceph-mon[34790]: pgmap v862: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.0 KiB/s wr, 7 op/s 2024-09-13T16:13:40.394 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-09-13T16:13:40.394 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T16:13:40.394 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 318, 2024-09-13T16:13:40.394 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 313, 2024-09-13T16:13:40.394 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 502544, 2024-09-13T16:13:40.394 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 178336, 2024-09-13T16:13:40.394 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 4, 2024-09-13T16:13:40.394 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 0, 2024-09-13T16:13:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.039287176, 2024-09-13T16:13:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.017773766, 2024-09-13T16:13:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.024501929, 2024-09-13T16:13:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 313, 2024-09-13T16:13:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.022834485, 2024-09-13T16:13:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000072953 2024-09-13T16:13:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:40.395 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 502544, 2024-09-13T16:13:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 178336 2024-09-13T16:13:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T16:13:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 2, 2024-09-13T16:13:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 237, 2024-09-13T16:13:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 320, 2024-09-13T16:13:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 194320, 2024-09-13T16:13:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 4, 2024-09-13T16:13:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 2, 2024-09-13T16:13:40.396 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.011631458, 2024-09-13T16:13:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.008753544, 2024-09-13T16:13:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.000734217, 2024-09-13T16:13:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 235, 2024-09-13T16:13:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.012947728, 2024-09-13T16:13:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000055096 2024-09-13T16:13:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:40.397 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-13T16:13:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 194320 2024-09-13T16:13:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T16:13:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_messages": 0, 2024-09-13T16:13:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages": 2, 2024-09-13T16:13:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_bytes": 0, 2024-09-13T16:13:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_bytes": 0, 2024-09-13T16:13:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_created_connections": 2, 2024-09-13T16:13:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_active_connections": 1, 2024-09-13T16:13:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_total_time": 0.000345966, 2024-09-13T16:13:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_send_time": 0.000000000, 2024-09-13T16:13:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_recv_time": 0.000271651, 2024-09-13T16:13:40.398 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T16:13:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T16:13:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_handle_ack_lat": { 2024-09-13T16:13:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T16:13:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T16:13:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:40.399 INFO:teuthology.orchestra.run.smithi193.stdout: "cct": { 2024-09-13T16:13:40.400 INFO:teuthology.orchestra.run.smithi193.stdout: "total_workers": 0, 2024-09-13T16:13:40.400 INFO:teuthology.orchestra.run.smithi193.stdout: "unhealthy_workers": 0 2024-09-13T16:13:40.400 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:40.400 INFO:teuthology.orchestra.run.smithi193.stdout: "mempool": { 2024-09-13T16:13:40.400 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_bytes": 0, 2024-09-13T16:13:40.400 INFO:teuthology.orchestra.run.smithi193.stdout: "bloom_filter_items": 0, 2024-09-13T16:13:40.400 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T16:13:40.400 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_alloc_items": 0, 2024-09-13T16:13:40.400 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T16:13:40.400 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_data_items": 0, 2024-09-13T16:13:40.400 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T16:13:40.400 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T16:13:40.400 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T16:13:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T16:13:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T16:13:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_other_items": 0, 2024-09-13T16:13:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T16:13:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T16:13:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_bytes": 0, 2024-09-13T16:13:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_extent_items": 0, 2024-09-13T16:13:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_bytes": 0, 2024-09-13T16:13:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_blob_items": 0, 2024-09-13T16:13:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T16:13:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T16:13:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T16:13:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T16:13:40.401 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T16:13:40.402 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_fsck_items": 0, 2024-09-13T16:13:40.402 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_bytes": 0, 2024-09-13T16:13:40.402 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_txc_items": 0, 2024-09-13T16:13:40.402 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T16:13:40.402 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T16:13:40.402 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_bytes": 0, 2024-09-13T16:13:40.403 INFO:teuthology.orchestra.run.smithi193.stdout: "bluestore_writing_items": 0, 2024-09-13T16:13:40.403 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_bytes": 0, 2024-09-13T16:13:40.403 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_items": 0, 2024-09-13T16:13:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T16:13:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_reader_items": 0, 2024-09-13T16:13:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T16:13:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: "bluefs_file_writer_items": 0, 2024-09-13T16:13:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_bytes": 148721, 2024-09-13T16:13:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_anon_items": 30, 2024-09-13T16:13:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_bytes": 0, 2024-09-13T16:13:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: "buffer_meta_items": 0, 2024-09-13T16:13:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_bytes": 0, 2024-09-13T16:13:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_items": 0, 2024-09-13T16:13:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_bytes": 0, 2024-09-13T16:13:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_mapbl_items": 0, 2024-09-13T16:13:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_bytes": 0, 2024-09-13T16:13:40.404 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_pglog_items": 0, 2024-09-13T16:13:40.405 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_bytes": 0, 2024-09-13T16:13:40.405 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_items": 0, 2024-09-13T16:13:40.405 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T16:13:40.405 INFO:teuthology.orchestra.run.smithi193.stdout: "osdmap_mapping_items": 0, 2024-09-13T16:13:40.405 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_bytes": 0, 2024-09-13T16:13:40.405 INFO:teuthology.orchestra.run.smithi193.stdout: "pgmap_items": 0, 2024-09-13T16:13:40.405 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_bytes": 928, 2024-09-13T16:13:40.405 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_co_items": 2, 2024-09-13T16:13:40.405 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_bytes": 0, 2024-09-13T16:13:40.405 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_1_items": 0, 2024-09-13T16:13:40.405 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_bytes": 0, 2024-09-13T16:13:40.405 INFO:teuthology.orchestra.run.smithi193.stdout: "unittest_2_items": 0 2024-09-13T16:13:40.405 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-13T16:13:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T16:13:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "val": 0, 2024-09-13T16:13:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "max": 104857600, 2024-09-13T16:13:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "get_started": 0, 2024-09-13T16:13:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "get": 316, 2024-09-13T16:13:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "get_sum": 455150, 2024-09-13T16:13:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_fail": 0, 2024-09-13T16:13:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "get_or_fail_success": 316, 2024-09-13T16:13:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "take": 0, 2024-09-13T16:13:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "take_sum": 0, 2024-09-13T16:13:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "put": 316, 2024-09-13T16:13:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "put_sum": 455150, 2024-09-13T16:13:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "wait": { 2024-09-13T16:13:40.406 INFO:teuthology.orchestra.run.smithi193.stdout: "avgcount": 0, 2024-09-13T16:13:40.407 INFO:teuthology.orchestra.run.smithi193.stdout: "sum": 0.000000000, 2024-09-13T16:13:40.407 INFO:teuthology.orchestra.run.smithi193.stdout: "avgtime": 0.000000000 2024-09-13T16:13:40.407 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:40.407 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-13T16:13:40.407 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-09-13T16:13:41.104 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-13T16:13:41.104 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-13T16:13:41.104 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-13T16:13:41.104 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-13T16:13:41.105 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-13T16:13:41.114 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-13T16:13:41.114 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T16:13:41.114 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:13:41.161 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T16:13:41.161 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T16:13:41.242 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:13:41.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.445+0000 7f2f19000640 1 -- 172.21.15.17:0/435745593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f14105a70 msgr2=0x7f2f14107ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:41.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.445+0000 7f2f19000640 1 --2- 172.21.15.17:0/435745593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f14105a70 0x7f2f14107ee0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009be0 tx=0x7f2f0c02a6c0 comp rx=0 tx=0).stop 2024-09-13T16:13:41.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.445+0000 7f2f19000640 1 -- 172.21.15.17:0/435745593 shutdown_connections 2024-09-13T16:13:41.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.445+0000 7f2f19000640 1 --2- 172.21.15.17:0/435745593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f14105a70 0x7f2f14107ee0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:41.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.445+0000 7f2f19000640 1 --2- 172.21.15.17:0/435745593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f14103140 0x7f2f14105530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:41.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.445+0000 7f2f19000640 1 --2- 172.21.15.17:0/435745593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f14100810 0x7f2f14102c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:41.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.445+0000 7f2f19000640 1 -- 172.21.15.17:0/435745593 >> 172.21.15.17:0/435745593 conn(0x7f2f140fa3f0 msgr2=0x7f2f140fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:41.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.445+0000 7f2f19000640 1 -- 172.21.15.17:0/435745593 shutdown_connections 2024-09-13T16:13:41.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.445+0000 7f2f19000640 1 -- 172.21.15.17:0/435745593 wait complete. 2024-09-13T16:13:41.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.446+0000 7f2f19000640 1 Processor -- start 2024-09-13T16:13:41.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.446+0000 7f2f19000640 1 -- start start 2024-09-13T16:13:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.446+0000 7f2f19000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f14100810 0x7f2f141980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.446+0000 7f2f19000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f14103140 0x7f2f14198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.446+0000 7f2f19000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f14105a70 0x7f2f1419f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.446+0000 7f2f19000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1419fbe0 con 0x7f2f14103140 2024-09-13T16:13:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.446+0000 7f2f19000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1419fd50 con 0x7f2f14100810 2024-09-13T16:13:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.446+0000 7f2f19000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1419ff10 con 0x7f2f14105a70 2024-09-13T16:13:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.447+0000 7f2f11400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f14103140 0x7f2f14198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.447+0000 7f2f11400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f14103140 0x7f2f14198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51600/0 (socket says 172.21.15.17:51600) 2024-09-13T16:13:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.447+0000 7f2f11400640 1 -- 172.21.15.17:0/1846301181 learned_addr learned my addr 172.21.15.17:0/1846301181 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:13:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.447+0000 7f2f12800640 1 --2- 172.21.15.17:0/1846301181 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f14105a70 0x7f2f1419f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.447+0000 7f2f11e00640 1 --2- 172.21.15.17:0/1846301181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f14100810 0x7f2f141980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.447+0000 7f2f11400640 1 -- 172.21.15.17:0/1846301181 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f14105a70 msgr2=0x7f2f1419f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.447+0000 7f2f11400640 1 --2- 172.21.15.17:0/1846301181 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f14105a70 0x7f2f1419f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.447+0000 7f2f11400640 1 -- 172.21.15.17:0/1846301181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f14100810 msgr2=0x7f2f141980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.447+0000 7f2f11400640 1 --2- 172.21.15.17:0/1846301181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f14100810 0x7f2f141980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.447+0000 7f2f11400640 1 -- 172.21.15.17:0/1846301181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c009840 con 0x7f2f14103140 2024-09-13T16:13:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.447+0000 7f2f11e00640 1 --2- 172.21.15.17:0/1846301181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f14100810 0x7f2f141980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:13:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.447+0000 7f2f11400640 1 --2- 172.21.15.17:0/1846301181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f14103140 0x7f2f14198630 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000e9f0 tx=0x7f2f0000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.448+0000 7f2f0aa00640 1 -- 172.21.15.17:0/1846301181 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f00009600 con 0x7f2f14103140 2024-09-13T16:13:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.448+0000 7f2f19000640 1 -- 172.21.15.17:0/1846301181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f141a01f0 con 0x7f2f14103140 2024-09-13T16:13:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.448+0000 7f2f0aa00640 1 -- 172.21.15.17:0/1846301181 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f0000ccc0 con 0x7f2f14103140 2024-09-13T16:13:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.448+0000 7f2f0aa00640 1 -- 172.21.15.17:0/1846301181 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f00018820 con 0x7f2f14103140 2024-09-13T16:13:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.448+0000 7f2f19000640 1 -- 172.21.15.17:0/1846301181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f141a0750 con 0x7f2f14103140 2024-09-13T16:13:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.449+0000 7f2f19000640 1 -- 172.21.15.17:0/1846301181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f14107560 con 0x7f2f14103140 2024-09-13T16:13:41.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.451+0000 7f2f0aa00640 1 -- 172.21.15.17:0/1846301181 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2f00018980 con 0x7f2f14103140 2024-09-13T16:13:41.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.452+0000 7f2f0aa00640 1 --2- 172.21.15.17:0/1846301181 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2ef80a1110 0x7f2ef80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:41.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.452+0000 7f2f0aa00640 1 -- 172.21.15.17:0/1846301181 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f2f00014070 con 0x7f2f14103140 2024-09-13T16:13:41.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.452+0000 7f2f11e00640 1 --2- 172.21.15.17:0/1846301181 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2ef80a1110 0x7f2ef80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:41.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.453+0000 7f2f11e00640 1 --2- 172.21.15.17:0/1846301181 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2ef80a1110 0x7f2ef80a35d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009c20 tx=0x7f2f04005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:41.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.454+0000 7f2f0aa00640 1 -- 172.21.15.17:0/1846301181 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2f000967d0 con 0x7f2f14103140 2024-09-13T16:13:41.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.637+0000 7f2f19000640 1 -- 172.21.15.17:0/1846301181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f1410b690 con 0x7f2f14103140 2024-09-13T16:13:41.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.639+0000 7f2f0aa00640 1 -- 172.21.15.17:0/1846301181 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24575 (secure 0 0 0) 0x7f2f00099df0 con 0x7f2f14103140 2024-09-13T16:13:41.640 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:13:41.640 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":94,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","created":"2024-09-13T15:46:50.475750+0000","modified":"2024-09-13T15:56:44.228817+0000","last_up_change":"2024-09-13T15:53:59.138985+0000","last_in_change":"2024-09-13T15:53:39.220264+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:50:10.657011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:54:51.436469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:54:52.427930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:54:55.478058+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5d39d6af-15e6-463b-b9ff-a9a5dd94e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6803","nonce":158651212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6805","nonce":158651212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6809","nonce":158651212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6807","nonce":158651212}]},"public_addr":"172.21.15.17:6803/158651212","cluster_addr":"172.21.15.17:6805/158651212","heartbeat_back_addr":"172.21.15.17:6809/158651212","heartbeat_front_addr":"172.21.15.17:6807/158651212","state":["exists","up"]},{"osd":1,"uuid":"0da621c7-645b-44ae-ba7c-a573861c3aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6801","nonce":964319421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6803","nonce":964319421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6807","nonce":964319421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6805","nonce":964319421}]},"public_addr":"172.21.15.189:6801/964319421","cluster_addr":"172.21.15.189:6803/964319421","heartbeat_back_addr":"172.21.15.189:6807/964319421","heartbeat_front_addr":"172.21.15.189:6805/964319421","state":["exists","up"]},{"osd":2,"uuid":"fa95af60-1486-4a29-8c79-8a73a4146552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6801","nonce":138468002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6803","nonce":138468002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6807","nonce":138468002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6805","nonce":138468002}]},"public_addr":"172.21.15.193:6801/138468002","cluster_addr":"172.21.15.193:6803/138468002","heartbeat_back_addr":"172.21.15.193:6807/138468002","heartbeat_front_addr":"172.21.15.193:6805/138468002","state":["exists","up"]},{"osd":3,"uuid":"90428e5f-dfd4-4cda-b240-fdb9079bcb7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6811","nonce":919913803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6813","nonce":919913803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6817","nonce":919913803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6815","nonce":919913803}]},"public_addr":"172.21.15.17:6811/919913803","cluster_addr":"172.21.15.17:6813/919913803","heartbeat_back_addr":"172.21.15.17:6817/919913803","heartbeat_front_addr":"172.21.15.17:6815/919913803","state":["exists","up"]},{"osd":4,"uuid":"e1c537b6-98d2-4b66-b15a-65fe70b0ce25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6809","nonce":2310375565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6811","nonce":2310375565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6815","nonce":2310375565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6813","nonce":2310375565}]},"public_addr":"172.21.15.189:6809/2310375565","cluster_addr":"172.21.15.189:6811/2310375565","heartbeat_back_addr":"172.21.15.189:6815/2310375565","heartbeat_front_addr":"172.21.15.189:6813/2310375565","state":["exists","up"]},{"osd":5,"uuid":"48522fd7-d781-4447-873f-174dabd1e33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6809","nonce":1330877824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6811","nonce":1330877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6815","nonce":1330877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6813","nonce":1330877824}]},"public_addr":"172.21.15.193:6809/1330877824","cluster_addr":"172.21.15.193:6811/1330877824","heartbeat_back_addr":"172.21.15.193:6815/1330877824","heartbeat_front_addr":"172.21.15.193:6813/1330877824","state":["exists","up"]},{"osd":6,"uuid":"47bea191-fb53-40a7-8563-8ebf17dd5bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6819","nonce":3930545382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6821","nonce":3930545382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6825","nonce":3930545382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6823","nonce":3930545382}]},"public_addr":"172.21.15.17:6819/3930545382","cluster_addr":"172.21.15.17:6821/3930545382","heartbeat_back_addr":"172.21.15.17:6825/3930545382","heartbeat_front_addr":"172.21.15.17:6823/3930545382","state":["exists","up"]},{"osd":7,"uuid":"a98f36f9-0a19-4c9a-8ed1-615c4a6e7658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6817","nonce":3691677495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6819","nonce":3691677495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6823","nonce":3691677495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6821","nonce":3691677495}]},"public_addr":"172.21.15.189:6817/3691677495","cluster_addr":"172.21.15.189:6819/3691677495","heartbeat_back_addr":"172.21.15.189:6823/3691677495","heartbeat_front_addr":"172.21.15.189:6821/3691677495","state":["exists","up"]},{"osd":8,"uuid":"7a372d9f-c40f-4ead-87da-2f3a570c1373","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6817","nonce":4112907498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6819","nonce":4112907498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6823","nonce":4112907498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6821","nonce":4112907498}]},"public_addr":"172.21.15.193:6817/4112907498","cluster_addr":"172.21.15.193:6819/4112907498","heartbeat_back_addr":"172.21.15.193:6823/4112907498","heartbeat_front_addr":"172.21.15.193:6821/4112907498","state":["exists","up"]},{"osd":9,"uuid":"ac3d983c-c5e7-456b-8271-7c4e6169de61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6827","nonce":663424274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6829","nonce":663424274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6833","nonce":663424274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6831","nonce":663424274}]},"public_addr":"172.21.15.17:6827/663424274","cluster_addr":"172.21.15.17:6829/663424274","heartbeat_back_addr":"172.21.15.17:6833/663424274","heartbeat_front_addr":"172.21.15.17:6831/663424274","state":["exists","up"]},{"osd":10,"uuid":"08dcae02-6c79-4a06-ae88-6eb6e6941cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6825","nonce":3153990375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6827","nonce":3153990375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6831","nonce":3153990375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6829","nonce":3153990375}]},"public_addr":"172.21.15.189:6825/3153990375","cluster_addr":"172.21.15.189:6827/3153990375","heartbeat_back_addr":"172.21.15.189:6831/3153990375","heartbeat_front_addr":"172.21.15.189:6829/3153990375","state":["exists","up"]},{"osd":11,"uuid":"a4ebcf41-d805-4d44-b112-13ae84d51868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6825","nonce":4088053907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6827","nonce":4088053907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6831","nonce":4088053907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6829","nonce":4088053907}]},"public_addr":"172.21.15.193:6825/4088053907","cluster_addr":"172.21.15.193:6827/4088053907","heartbeat_back_addr":"172.21.15.193:6831/4088053907","heartbeat_front_addr":"172.21.15.193:6829/4088053907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:22.172370+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:44.802224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:06.641435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:34.536515+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:58.789324+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:22.189862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:50.382257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:14.678047+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:38.581105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:07.258150+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:32.261383+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:56.739338+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8},{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/1550067038":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/3360683829":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/634066188":"2024-09-14T15:47:42.048005+0000","172.21.15.17:6801/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1945536687":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/2214214377":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1224386591":"2024-09-14T15:47:14.996424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:13:41.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.642+0000 7f2f19000640 1 -- 172.21.15.17:0/1846301181 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2ef80a1110 msgr2=0x7f2ef80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:41.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.642+0000 7f2f19000640 1 --2- 172.21.15.17:0/1846301181 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2ef80a1110 0x7f2ef80a35d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009c20 tx=0x7f2f04005f90 comp rx=0 tx=0).stop 2024-09-13T16:13:41.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.642+0000 7f2f19000640 1 -- 172.21.15.17:0/1846301181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f14103140 msgr2=0x7f2f14198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:41.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.642+0000 7f2f19000640 1 --2- 172.21.15.17:0/1846301181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f14103140 0x7f2f14198630 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000e9f0 tx=0x7f2f0000eeb0 comp rx=0 tx=0).stop 2024-09-13T16:13:41.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.642+0000 7f2f19000640 1 -- 172.21.15.17:0/1846301181 shutdown_connections 2024-09-13T16:13:41.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.642+0000 7f2f19000640 1 --2- 172.21.15.17:0/1846301181 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f2ef80a1110 0x7f2ef80a35d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:41.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.642+0000 7f2f19000640 1 --2- 172.21.15.17:0/1846301181 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f14105a70 0x7f2f1419f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:41.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.642+0000 7f2f19000640 1 --2- 172.21.15.17:0/1846301181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f14103140 0x7f2f14198630 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:41.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.642+0000 7f2f19000640 1 --2- 172.21.15.17:0/1846301181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f14100810 0x7f2f141980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:41.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.642+0000 7f2f19000640 1 -- 172.21.15.17:0/1846301181 >> 172.21.15.17:0/1846301181 conn(0x7f2f140fa3f0 msgr2=0x7f2f140fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:41.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.642+0000 7f2f19000640 1 -- 172.21.15.17:0/1846301181 shutdown_connections 2024-09-13T16:13:41.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.642+0000 7f2f19000640 1 -- 172.21.15.17:0/1846301181 wait complete. 2024-09-13T16:13:41.659 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:50:10.657011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:54:51.436469+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:54:52.427930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:54:55.478058+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T16:13:41.659 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T16:13:41.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.819+0000 7f5473c00640 1 -- 172.21.15.17:0/1779608192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f546c076a50 msgr2=0x7f546c0772f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:41.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.819+0000 7f5473c00640 1 --2- 172.21.15.17:0/1779608192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f546c076a50 0x7f546c0772f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5464009ca0 tx=0x7f546402a8c0 comp rx=0 tx=0).stop 2024-09-13T16:13:41.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.819+0000 7f5473c00640 1 -- 172.21.15.17:0/1779608192 shutdown_connections 2024-09-13T16:13:41.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.819+0000 7f5473c00640 1 --2- 172.21.15.17:0/1779608192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f546c076a50 0x7f546c0772f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:41.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.819+0000 7f5473c00640 1 --2- 172.21.15.17:0/1779608192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f546c0760b0 0x7f546c076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:41.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.819+0000 7f5473c00640 1 --2- 172.21.15.17:0/1779608192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f546c074e70 0x7f546c075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:41.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.819+0000 7f5473c00640 1 -- 172.21.15.17:0/1779608192 >> 172.21.15.17:0/1779608192 conn(0x7f546c0fd700 msgr2=0x7f546c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:41.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.819+0000 7f5473c00640 1 -- 172.21.15.17:0/1779608192 shutdown_connections 2024-09-13T16:13:41.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.819+0000 7f5473c00640 1 -- 172.21.15.17:0/1779608192 wait complete. 2024-09-13T16:13:41.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.820+0000 7f5473c00640 1 Processor -- start 2024-09-13T16:13:41.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.820+0000 7f5473c00640 1 -- start start 2024-09-13T16:13:41.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.821+0000 7f5473c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f546c074e70 0x7f546c19c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:41.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.821+0000 7f5473c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f546c0760b0 0x7f546c19c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:41.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.821+0000 7f5473c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f546c076a50 0x7f546c1a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:41.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.821+0000 7f5473c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c1a3e50 con 0x7f546c074e70 2024-09-13T16:13:41.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.821+0000 7f5473c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c1a3fc0 con 0x7f546c0760b0 2024-09-13T16:13:41.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.821+0000 7f5473c00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c1a4180 con 0x7f546c076a50 2024-09-13T16:13:41.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.821+0000 7f5471200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f546c074e70 0x7f546c19c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:41.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.821+0000 7f5471200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f546c074e70 0x7f546c19c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51614/0 (socket says 172.21.15.17:51614) 2024-09-13T16:13:41.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.821+0000 7f5471200640 1 -- 172.21.15.17:0/1718486968 learned_addr learned my addr 172.21.15.17:0/1718486968 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:13:41.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.821+0000 7f546be00640 1 --2- 172.21.15.17:0/1718486968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f546c0760b0 0x7f546c19c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:41.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.821+0000 7f5471c00640 1 --2- 172.21.15.17:0/1718486968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f546c076a50 0x7f546c1a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:41.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.821+0000 7f5471200640 1 -- 172.21.15.17:0/1718486968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f546c076a50 msgr2=0x7f546c1a3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:41.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.821+0000 7f5471200640 1 --2- 172.21.15.17:0/1718486968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f546c076a50 0x7f546c1a3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:41.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.821+0000 7f5471200640 1 -- 172.21.15.17:0/1718486968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f546c0760b0 msgr2=0x7f546c19c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:41.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.821+0000 7f5471200640 1 --2- 172.21.15.17:0/1718486968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f546c0760b0 0x7f546c19c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:41.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.821+0000 7f5471200640 1 -- 172.21.15.17:0/1718486968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5464009900 con 0x7f546c074e70 2024-09-13T16:13:41.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.821+0000 7f546be00640 1 --2- 172.21.15.17:0/1718486968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f546c0760b0 0x7f546c19c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:13:41.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.822+0000 7f5471200640 1 --2- 172.21.15.17:0/1718486968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f546c074e70 0x7f546c19c360 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f546000d770 tx=0x7f546000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:41.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.822+0000 7f5469600640 1 -- 172.21.15.17:0/1718486968 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460009c30 con 0x7f546c074e70 2024-09-13T16:13:41.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.822+0000 7f5469600640 1 -- 172.21.15.17:0/1718486968 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f546000de80 con 0x7f546c074e70 2024-09-13T16:13:41.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.822+0000 7f5473c00640 1 -- 172.21.15.17:0/1718486968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f546c1a4460 con 0x7f546c074e70 2024-09-13T16:13:41.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.822+0000 7f5469600640 1 -- 172.21.15.17:0/1718486968 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460004de0 con 0x7f546c074e70 2024-09-13T16:13:41.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.822+0000 7f5473c00640 1 -- 172.21.15.17:0/1718486968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f546c1a4920 con 0x7f546c074e70 2024-09-13T16:13:41.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.823+0000 7f5473c00640 1 -- 172.21.15.17:0/1718486968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f546c10e8f0 con 0x7f546c074e70 2024-09-13T16:13:41.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.825+0000 7f5469600640 1 -- 172.21.15.17:0/1718486968 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5460004f40 con 0x7f546c074e70 2024-09-13T16:13:41.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.826+0000 7f5469600640 1 --2- 172.21.15.17:0/1718486968 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f54540a1090 0x7f54540a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:41.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.827+0000 7f5469600640 1 -- 172.21.15.17:0/1718486968 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f54600cc800 con 0x7f546c074e70 2024-09-13T16:13:41.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.827+0000 7f546be00640 1 --2- 172.21.15.17:0/1718486968 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f54540a1090 0x7f54540a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:41.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.827+0000 7f546be00640 1 --2- 172.21.15.17:0/1718486968 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f54540a1090 0x7f54540a3550 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f54580058c0 tx=0x7f5458005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:41.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:41.831+0000 7f5469600640 1 -- 172.21.15.17:0/1718486968 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5460095be0 con 0x7f546c074e70 2024-09-13T16:13:42.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:41 smithi017 ceph-mon[30494]: pgmap v863: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.9 KiB/s wr, 9 op/s 2024-09-13T16:13:42.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:41 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1846301181' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:13:42.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.013+0000 7f5473c00640 1 -- 172.21.15.17:0/1718486968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f546c111c70 con 0x7f546c074e70 2024-09-13T16:13:42.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.013+0000 7f5469600640 1 -- 172.21.15.17:0/1718486968 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5460099200 con 0x7f546c074e70 2024-09-13T16:13:42.014 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-13T16:13:42.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.016+0000 7f5473c00640 1 -- 172.21.15.17:0/1718486968 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f54540a1090 msgr2=0x7f54540a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:42.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.016+0000 7f5473c00640 1 --2- 172.21.15.17:0/1718486968 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f54540a1090 0x7f54540a3550 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f54580058c0 tx=0x7f5458005850 comp rx=0 tx=0).stop 2024-09-13T16:13:42.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.016+0000 7f5473c00640 1 -- 172.21.15.17:0/1718486968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f546c074e70 msgr2=0x7f546c19c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:42.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.016+0000 7f5473c00640 1 --2- 172.21.15.17:0/1718486968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f546c074e70 0x7f546c19c360 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f546000d770 tx=0x7f546000dc30 comp rx=0 tx=0).stop 2024-09-13T16:13:42.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.016+0000 7f5473c00640 1 -- 172.21.15.17:0/1718486968 shutdown_connections 2024-09-13T16:13:42.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.016+0000 7f5473c00640 1 --2- 172.21.15.17:0/1718486968 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f54540a1090 0x7f54540a3550 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.016+0000 7f5473c00640 1 --2- 172.21.15.17:0/1718486968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f546c076a50 0x7f546c1a3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.016+0000 7f5473c00640 1 --2- 172.21.15.17:0/1718486968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f546c0760b0 0x7f546c19c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.016+0000 7f5473c00640 1 --2- 172.21.15.17:0/1718486968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f546c074e70 0x7f546c19c360 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.016+0000 7f5473c00640 1 -- 172.21.15.17:0/1718486968 >> 172.21.15.17:0/1718486968 conn(0x7f546c0fd700 msgr2=0x7f546c0ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:42.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.016+0000 7f5473c00640 1 -- 172.21.15.17:0/1718486968 shutdown_connections 2024-09-13T16:13:42.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.016+0000 7f5473c00640 1 -- 172.21.15.17:0/1718486968 wait complete. 2024-09-13T16:13:42.033 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T16:13:42.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.192+0000 7f67b5000640 1 -- 172.21.15.17:0/883438016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67b0101ea0 msgr2=0x7f67b01022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:42.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.192+0000 7f67b5000640 1 --2- 172.21.15.17:0/883438016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67b0101ea0 0x7f67b01022a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f67a0009900 tx=0x7f67a002a410 comp rx=0 tx=0).stop 2024-09-13T16:13:42.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.192+0000 7f67b5000640 1 -- 172.21.15.17:0/883438016 shutdown_connections 2024-09-13T16:13:42.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.192+0000 7f67b5000640 1 --2- 172.21.15.17:0/883438016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67b0103a40 0x7f67b010a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.192+0000 7f67b5000640 1 --2- 172.21.15.17:0/883438016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67b0103080 0x7f67b0103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.192+0000 7f67b5000640 1 --2- 172.21.15.17:0/883438016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67b0101ea0 0x7f67b01022a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.192+0000 7f67b5000640 1 -- 172.21.15.17:0/883438016 >> 172.21.15.17:0/883438016 conn(0x7f67b00fd650 msgr2=0x7f67b00ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:42.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.192+0000 7f67b5000640 1 -- 172.21.15.17:0/883438016 shutdown_connections 2024-09-13T16:13:42.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.192+0000 7f67b5000640 1 -- 172.21.15.17:0/883438016 wait complete. 2024-09-13T16:13:42.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.193+0000 7f67b5000640 1 Processor -- start 2024-09-13T16:13:42.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.193+0000 7f67b5000640 1 -- start start 2024-09-13T16:13:42.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.194+0000 7f67b5000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67b0101ea0 0x7f67b0197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:42.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.194+0000 7f67b5000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67b0103080 0x7f67b01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:42.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.194+0000 7f67b5000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67b0103a40 0x7f67b019f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:42.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.194+0000 7f67b5000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b019f9a0 con 0x7f67b0101ea0 2024-09-13T16:13:42.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.194+0000 7f67b5000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b019fb10 con 0x7f67b0103080 2024-09-13T16:13:42.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.194+0000 7f67b5000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b019fcd0 con 0x7f67b0103a40 2024-09-13T16:13:42.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.194+0000 7f67af400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67b0101ea0 0x7f67b0197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:42.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.194+0000 7f67af400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67b0101ea0 0x7f67b0197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51624/0 (socket says 172.21.15.17:51624) 2024-09-13T16:13:42.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.194+0000 7f67af400640 1 -- 172.21.15.17:0/4120104192 learned_addr learned my addr 172.21.15.17:0/4120104192 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:13:42.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.194+0000 7f67aea00640 1 --2- 172.21.15.17:0/4120104192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67b0103080 0x7f67b01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:42.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.194+0000 7f67afe00640 1 --2- 172.21.15.17:0/4120104192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67b0103a40 0x7f67b019f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:42.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.194+0000 7f67af400640 1 -- 172.21.15.17:0/4120104192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67b0103a40 msgr2=0x7f67b019f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:42.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.194+0000 7f67af400640 1 --2- 172.21.15.17:0/4120104192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67b0103a40 0x7f67b019f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.194+0000 7f67af400640 1 -- 172.21.15.17:0/4120104192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67b0103080 msgr2=0x7f67b01983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:42.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.194+0000 7f67af400640 1 --2- 172.21.15.17:0/4120104192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67b0103080 0x7f67b01983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.194+0000 7f67af400640 1 -- 172.21.15.17:0/4120104192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a0009560 con 0x7f67b0101ea0 2024-09-13T16:13:42.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.194+0000 7f67afe00640 1 --2- 172.21.15.17:0/4120104192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67b0103a40 0x7f67b019f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:13:42.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.195+0000 7f67af400640 1 --2- 172.21.15.17:0/4120104192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67b0101ea0 0x7f67b0197eb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f67a00057c0 tx=0x7f67a00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:42.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.195+0000 7f67a7e00640 1 -- 172.21.15.17:0/4120104192 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a0004bd0 con 0x7f67b0101ea0 2024-09-13T16:13:42.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.195+0000 7f67a7e00640 1 -- 172.21.15.17:0/4120104192 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67a0004d30 con 0x7f67b0101ea0 2024-09-13T16:13:42.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.195+0000 7f67a7e00640 1 -- 172.21.15.17:0/4120104192 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a0031b60 con 0x7f67b0101ea0 2024-09-13T16:13:42.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.195+0000 7f67b5000640 1 -- 172.21.15.17:0/4120104192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b019ff50 con 0x7f67b0101ea0 2024-09-13T16:13:42.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.195+0000 7f67b5000640 1 -- 172.21.15.17:0/4120104192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b01a0320 con 0x7f67b0101ea0 2024-09-13T16:13:42.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.196+0000 7f67b5000640 1 -- 172.21.15.17:0/4120104192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b0109450 con 0x7f67b0101ea0 2024-09-13T16:13:42.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.198+0000 7f67a7e00640 1 -- 172.21.15.17:0/4120104192 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f67a0003cb0 con 0x7f67b0101ea0 2024-09-13T16:13:42.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.199+0000 7f67a7e00640 1 --2- 172.21.15.17:0/4120104192 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f67940a1110 0x7f67940a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:42.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.199+0000 7f67a7e00640 1 -- 172.21.15.17:0/4120104192 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f67a00edc30 con 0x7f67b0101ea0 2024-09-13T16:13:42.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.200+0000 7f67aea00640 1 --2- 172.21.15.17:0/4120104192 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f67940a1110 0x7f67940a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:42.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.200+0000 7f67aea00640 1 --2- 172.21.15.17:0/4120104192 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f67940a1110 0x7f67940a35d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f67b01993c0 tx=0x7f679c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:42.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.203+0000 7f67a7e00640 1 -- 172.21.15.17:0/4120104192 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f67a00b7010 con 0x7f67b0101ea0 2024-09-13T16:13:42.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:41 smithi193 ceph-mon[35248]: pgmap v863: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.9 KiB/s wr, 9 op/s 2024-09-13T16:13:42.256 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:41 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1846301181' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:13:42.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:41 smithi189 ceph-mon[34790]: pgmap v863: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.9 KiB/s wr, 9 op/s 2024-09-13T16:13:42.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:41 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1846301181' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:13:42.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.383+0000 7f67b5000640 1 -- 172.21.15.17:0/4120104192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f67b010d7b0 con 0x7f67b0101ea0 2024-09-13T16:13:42.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.383+0000 7f67a7e00640 1 -- 172.21.15.17:0/4120104192 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f67b010d7b0 con 0x7f67b0101ea0 2024-09-13T16:13:42.384 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-13T16:13:42.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.385+0000 7f67b5000640 1 -- 172.21.15.17:0/4120104192 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f67940a1110 msgr2=0x7f67940a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:42.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.385+0000 7f67b5000640 1 --2- 172.21.15.17:0/4120104192 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f67940a1110 0x7f67940a35d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f67b01993c0 tx=0x7f679c00b410 comp rx=0 tx=0).stop 2024-09-13T16:13:42.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.385+0000 7f67b5000640 1 -- 172.21.15.17:0/4120104192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67b0101ea0 msgr2=0x7f67b0197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:42.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.385+0000 7f67b5000640 1 --2- 172.21.15.17:0/4120104192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67b0101ea0 0x7f67b0197eb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f67a00057c0 tx=0x7f67a00055a0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.385+0000 7f67b5000640 1 -- 172.21.15.17:0/4120104192 shutdown_connections 2024-09-13T16:13:42.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.385+0000 7f67b5000640 1 --2- 172.21.15.17:0/4120104192 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f67940a1110 0x7f67940a35d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.385+0000 7f67b5000640 1 --2- 172.21.15.17:0/4120104192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67b0103a40 0x7f67b019f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.385+0000 7f67b5000640 1 --2- 172.21.15.17:0/4120104192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67b0103080 0x7f67b01983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.385+0000 7f67b5000640 1 --2- 172.21.15.17:0/4120104192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67b0101ea0 0x7f67b0197eb0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.385+0000 7f67b5000640 1 -- 172.21.15.17:0/4120104192 >> 172.21.15.17:0/4120104192 conn(0x7f67b00fd650 msgr2=0x7f67b0106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:42.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.385+0000 7f67b5000640 1 -- 172.21.15.17:0/4120104192 shutdown_connections 2024-09-13T16:13:42.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.386+0000 7f67b5000640 1 -- 172.21.15.17:0/4120104192 wait complete. 2024-09-13T16:13:42.402 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T16:13:42.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.562+0000 7f4423600640 1 -- 172.21.15.17:0/1848981515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f441c100f60 msgr2=0x7f441c1013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:42.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.562+0000 7f4423600640 1 --2- 172.21.15.17:0/1848981515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f441c100f60 0x7f441c1013e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4408009900 tx=0x7f440802a410 comp rx=0 tx=0).stop 2024-09-13T16:13:42.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.563+0000 7f4423600640 1 -- 172.21.15.17:0/1848981515 shutdown_connections 2024-09-13T16:13:42.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.563+0000 7f4423600640 1 --2- 172.21.15.17:0/1848981515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f441c101920 0x7f441c1081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.563+0000 7f4423600640 1 --2- 172.21.15.17:0/1848981515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f441c100f60 0x7f441c1013e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.563+0000 7f4423600640 1 --2- 172.21.15.17:0/1848981515 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f441c0ffd70 0x7f441c100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.563+0000 7f4423600640 1 -- 172.21.15.17:0/1848981515 >> 172.21.15.17:0/1848981515 conn(0x7f441c0fb4d0 msgr2=0x7f441c0fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:42.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.563+0000 7f4423600640 1 -- 172.21.15.17:0/1848981515 shutdown_connections 2024-09-13T16:13:42.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.563+0000 7f4423600640 1 -- 172.21.15.17:0/1848981515 wait complete. 2024-09-13T16:13:42.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.564+0000 7f4423600640 1 Processor -- start 2024-09-13T16:13:42.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.564+0000 7f4423600640 1 -- start start 2024-09-13T16:13:42.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.564+0000 7f4423600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f441c0ffd70 0x7f441c195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:42.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.564+0000 7f4423600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f441c100f60 0x7f441c196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:42.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.564+0000 7f4423600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f441c101920 0x7f441c19d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:42.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.564+0000 7f4423600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c19d8d0 con 0x7f441c0ffd70 2024-09-13T16:13:42.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.564+0000 7f4423600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c19da40 con 0x7f441c101920 2024-09-13T16:13:42.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.564+0000 7f4423600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c19dc00 con 0x7f441c100f60 2024-09-13T16:13:42.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.564+0000 7f4420c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f441c0ffd70 0x7f441c195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:42.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.564+0000 7f4420c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f441c0ffd70 0x7f441c195de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51638/0 (socket says 172.21.15.17:51638) 2024-09-13T16:13:42.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.564+0000 7f4420c00640 1 -- 172.21.15.17:0/3856367721 learned_addr learned my addr 172.21.15.17:0/3856367721 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:13:42.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.564+0000 7f441be00640 1 --2- 172.21.15.17:0/3856367721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f441c100f60 0x7f441c196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:42.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.564+0000 7f4421600640 1 --2- 172.21.15.17:0/3856367721 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f441c101920 0x7f441c19d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:42.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.565+0000 7f4420c00640 1 -- 172.21.15.17:0/3856367721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f441c100f60 msgr2=0x7f441c196320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:42.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.565+0000 7f4420c00640 1 --2- 172.21.15.17:0/3856367721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f441c100f60 0x7f441c196320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.565+0000 7f4420c00640 1 -- 172.21.15.17:0/3856367721 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f441c101920 msgr2=0x7f441c19d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:42.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.565+0000 7f4420c00640 1 --2- 172.21.15.17:0/3856367721 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f441c101920 0x7f441c19d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.565+0000 7f4420c00640 1 -- 172.21.15.17:0/3856367721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4408009560 con 0x7f441c0ffd70 2024-09-13T16:13:42.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.565+0000 7f4420c00640 1 --2- 172.21.15.17:0/3856367721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f441c0ffd70 0x7f441c195de0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f441000e9c0 tx=0x7f441000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:42.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.565+0000 7f4419600640 1 -- 172.21.15.17:0/3856367721 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44100096e0 con 0x7f441c0ffd70 2024-09-13T16:13:42.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.565+0000 7f4419600640 1 -- 172.21.15.17:0/3856367721 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f44100044f0 con 0x7f441c0ffd70 2024-09-13T16:13:42.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.565+0000 7f4423600640 1 -- 172.21.15.17:0/3856367721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441c19dee0 con 0x7f441c0ffd70 2024-09-13T16:13:42.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.565+0000 7f4419600640 1 -- 172.21.15.17:0/3856367721 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4410010430 con 0x7f441c0ffd70 2024-09-13T16:13:42.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.565+0000 7f4423600640 1 -- 172.21.15.17:0/3856367721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441c19e300 con 0x7f441c0ffd70 2024-09-13T16:13:42.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.566+0000 7f4423600640 1 -- 172.21.15.17:0/3856367721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441c107220 con 0x7f441c0ffd70 2024-09-13T16:13:42.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.568+0000 7f4419600640 1 -- 172.21.15.17:0/3856367721 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f44100035f0 con 0x7f441c0ffd70 2024-09-13T16:13:42.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.569+0000 7f4419600640 1 --2- 172.21.15.17:0/3856367721 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f44040a1110 0x7f44040a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:42.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.570+0000 7f4419600640 1 -- 172.21.15.17:0/3856367721 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f4410014070 con 0x7f441c0ffd70 2024-09-13T16:13:42.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.570+0000 7f441be00640 1 --2- 172.21.15.17:0/3856367721 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f44040a1110 0x7f44040a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:42.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.571+0000 7f441be00640 1 --2- 172.21.15.17:0/3856367721 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f44040a1110 0x7f44040a35d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4408005ab0 tx=0x7f4408005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:42.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.572+0000 7f4419600640 1 -- 172.21.15.17:0/3856367721 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4410096470 con 0x7f441c0ffd70 2024-09-13T16:13:42.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.753+0000 7f4423600640 1 -- 172.21.15.17:0/3856367721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f441c02c480 con 0x7f441c0ffd70 2024-09-13T16:13:42.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.753+0000 7f4419600640 1 -- 172.21.15.17:0/3856367721 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4410099a90 con 0x7f441c0ffd70 2024-09-13T16:13:42.754 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-09-13T16:13:42.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.755+0000 7f4423600640 1 -- 172.21.15.17:0/3856367721 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f44040a1110 msgr2=0x7f44040a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:42.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.755+0000 7f4423600640 1 --2- 172.21.15.17:0/3856367721 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f44040a1110 0x7f44040a35d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4408005ab0 tx=0x7f4408005780 comp rx=0 tx=0).stop 2024-09-13T16:13:42.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.755+0000 7f4423600640 1 -- 172.21.15.17:0/3856367721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f441c0ffd70 msgr2=0x7f441c195de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:42.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.755+0000 7f4423600640 1 --2- 172.21.15.17:0/3856367721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f441c0ffd70 0x7f441c195de0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f441000e9c0 tx=0x7f441000ee80 comp rx=0 tx=0).stop 2024-09-13T16:13:42.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.756+0000 7f4423600640 1 -- 172.21.15.17:0/3856367721 shutdown_connections 2024-09-13T16:13:42.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.756+0000 7f4423600640 1 --2- 172.21.15.17:0/3856367721 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f44040a1110 0x7f44040a35d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.756+0000 7f4423600640 1 --2- 172.21.15.17:0/3856367721 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f441c101920 0x7f441c19d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.756+0000 7f4423600640 1 --2- 172.21.15.17:0/3856367721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f441c100f60 0x7f441c196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.756+0000 7f4423600640 1 --2- 172.21.15.17:0/3856367721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f441c0ffd70 0x7f441c195de0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.756+0000 7f4423600640 1 -- 172.21.15.17:0/3856367721 >> 172.21.15.17:0/3856367721 conn(0x7f441c0fb4d0 msgr2=0x7f441c1043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:42.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.756+0000 7f4423600640 1 -- 172.21.15.17:0/3856367721 shutdown_connections 2024-09-13T16:13:42.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.756+0000 7f4423600640 1 -- 172.21.15.17:0/3856367721 wait complete. 2024-09-13T16:13:42.773 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T16:13:42.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.935+0000 7fa4d2200640 1 -- 172.21.15.17:0/3061216951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4cc10c340 msgr2=0x7fa4cc10e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:42.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.935+0000 7fa4d2200640 1 --2- 172.21.15.17:0/3061216951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4cc10c340 0x7fa4cc10e730 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009ca0 tx=0x7fa4c402a8c0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.935+0000 7fa4d2200640 1 -- 172.21.15.17:0/3061216951 shutdown_connections 2024-09-13T16:13:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.935+0000 7fa4d2200640 1 --2- 172.21.15.17:0/3061216951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4cc10c340 0x7fa4cc10e730 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.935+0000 7fa4d2200640 1 --2- 172.21.15.17:0/3061216951 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4cc072f10 0x7fa4cc073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.935+0000 7fa4d2200640 1 --2- 172.21.15.17:0/3061216951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4cc0744f0 0x7fa4cc072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.935+0000 7fa4d2200640 1 -- 172.21.15.17:0/3061216951 >> 172.21.15.17:0/3061216951 conn(0x7fa4cc0fb4d0 msgr2=0x7fa4cc0fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.935+0000 7fa4d2200640 1 -- 172.21.15.17:0/3061216951 shutdown_connections 2024-09-13T16:13:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.935+0000 7fa4d2200640 1 -- 172.21.15.17:0/3061216951 wait complete. 2024-09-13T16:13:42.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.936+0000 7fa4d2200640 1 Processor -- start 2024-09-13T16:13:42.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.936+0000 7fa4d2200640 1 -- start start 2024-09-13T16:13:42.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.937+0000 7fa4d2200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4cc072f10 0x7fa4cc19c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:42.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.937+0000 7fa4d2200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4cc0744f0 0x7fa4cc19c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:42.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.937+0000 7fa4d2200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4cc10c340 0x7fa4cc1a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:42.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.937+0000 7fa4d2200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc1a3e40 con 0x7fa4cc10c340 2024-09-13T16:13:42.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.937+0000 7fa4d2200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc1a3fb0 con 0x7fa4cc0744f0 2024-09-13T16:13:42.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.937+0000 7fa4d2200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc1a4170 con 0x7fa4cc072f10 2024-09-13T16:13:42.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.937+0000 7fa4cbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4cc10c340 0x7fa4cc1a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:42.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.937+0000 7fa4cbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4cc10c340 0x7fa4cc1a3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51668/0 (socket says 172.21.15.17:51668) 2024-09-13T16:13:42.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.937+0000 7fa4cbe00640 1 -- 172.21.15.17:0/3532250835 learned_addr learned my addr 172.21.15.17:0/3532250835 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:13:42.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.937+0000 7fa4c3e00640 1 --2- 172.21.15.17:0/3532250835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4cc0744f0 0x7fa4cc19c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:42.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.937+0000 7fa4cb400640 1 --2- 172.21.15.17:0/3532250835 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4cc072f10 0x7fa4cc19c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:42.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.937+0000 7fa4c3e00640 1 -- 172.21.15.17:0/3532250835 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4cc072f10 msgr2=0x7fa4cc19c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:42.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.937+0000 7fa4c3e00640 1 --2- 172.21.15.17:0/3532250835 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4cc072f10 0x7fa4cc19c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.937+0000 7fa4c3e00640 1 -- 172.21.15.17:0/3532250835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4cc10c340 msgr2=0x7fa4cc1a3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:42.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.937+0000 7fa4c3e00640 1 --2- 172.21.15.17:0/3532250835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4cc10c340 0x7fa4cc1a3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:42.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.938+0000 7fa4c3e00640 1 -- 172.21.15.17:0/3532250835 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c4009900 con 0x7fa4cc0744f0 2024-09-13T16:13:42.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.938+0000 7fa4cbe00640 1 --2- 172.21.15.17:0/3532250835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4cc10c340 0x7fa4cc1a3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:13:42.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.938+0000 7fa4c3e00640 1 --2- 172.21.15.17:0/3532250835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4cc0744f0 0x7fa4cc19c890 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400e9f0 tx=0x7fa4b400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:42.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.938+0000 7fa4c8c00640 1 -- 172.21.15.17:0/3532250835 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b400ccc0 con 0x7fa4cc0744f0 2024-09-13T16:13:42.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.938+0000 7fa4c8c00640 1 -- 172.21.15.17:0/3532250835 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4b400ce20 con 0x7fa4cc0744f0 2024-09-13T16:13:42.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.938+0000 7fa4c8c00640 1 -- 172.21.15.17:0/3532250835 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4004a00 con 0x7fa4cc0744f0 2024-09-13T16:13:42.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.938+0000 7fa4d2200640 1 -- 172.21.15.17:0/3532250835 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4cc1a4450 con 0x7fa4cc0744f0 2024-09-13T16:13:42.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.938+0000 7fa4d2200640 1 -- 172.21.15.17:0/3532250835 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4cc1a4910 con 0x7fa4cc0744f0 2024-09-13T16:13:42.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.939+0000 7fa4d2200640 1 -- 172.21.15.17:0/3532250835 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4cc102510 con 0x7fa4cc0744f0 2024-09-13T16:13:42.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.942+0000 7fa4c8c00640 1 -- 172.21.15.17:0/3532250835 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa4b4005020 con 0x7fa4cc0744f0 2024-09-13T16:13:42.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.943+0000 7fa4c8c00640 1 --2- 172.21.15.17:0/3532250835 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa4b00a1090 0x7fa4b00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:42.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.943+0000 7fa4c8c00640 1 -- 172.21.15.17:0/3532250835 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fa4b4014070 con 0x7fa4cc0744f0 2024-09-13T16:13:42.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.943+0000 7fa4cb400640 1 --2- 172.21.15.17:0/3532250835 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa4b00a1090 0x7fa4b00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:42.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.944+0000 7fa4cb400640 1 --2- 172.21.15.17:0/3532250835 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa4b00a1090 0x7fa4b00a3550 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009bd0 tx=0x7fa4bc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:42.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:42.948+0000 7fa4c8c00640 1 -- 172.21.15.17:0/3532250835 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa4b4095fe0 con 0x7fa4cc0744f0 2024-09-13T16:13:43.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.129+0000 7fa4d2200640 1 -- 172.21.15.17:0/3532250835 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa4cc101f80 con 0x7fa4cc0744f0 2024-09-13T16:13:43.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.129+0000 7fa4c8c00640 1 -- 172.21.15.17:0/3532250835 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa4b4099600 con 0x7fa4cc0744f0 2024-09-13T16:13:43.130 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-13T16:13:43.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.132+0000 7fa4d2200640 1 -- 172.21.15.17:0/3532250835 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa4b00a1090 msgr2=0x7fa4b00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:43.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.132+0000 7fa4d2200640 1 --2- 172.21.15.17:0/3532250835 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa4b00a1090 0x7fa4b00a3550 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009bd0 tx=0x7fa4bc005f90 comp rx=0 tx=0).stop 2024-09-13T16:13:43.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.132+0000 7fa4d2200640 1 -- 172.21.15.17:0/3532250835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4cc0744f0 msgr2=0x7fa4cc19c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:43.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.132+0000 7fa4d2200640 1 --2- 172.21.15.17:0/3532250835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4cc0744f0 0x7fa4cc19c890 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400e9f0 tx=0x7fa4b400eeb0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.132+0000 7fa4d2200640 1 -- 172.21.15.17:0/3532250835 shutdown_connections 2024-09-13T16:13:43.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.132+0000 7fa4d2200640 1 --2- 172.21.15.17:0/3532250835 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa4b00a1090 0x7fa4b00a3550 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.132+0000 7fa4d2200640 1 --2- 172.21.15.17:0/3532250835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4cc10c340 0x7fa4cc1a3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.132+0000 7fa4d2200640 1 --2- 172.21.15.17:0/3532250835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4cc0744f0 0x7fa4cc19c890 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.132+0000 7fa4d2200640 1 --2- 172.21.15.17:0/3532250835 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4cc072f10 0x7fa4cc19c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.132+0000 7fa4d2200640 1 -- 172.21.15.17:0/3532250835 >> 172.21.15.17:0/3532250835 conn(0x7fa4cc0fb4d0 msgr2=0x7fa4cc0ff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:43.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.132+0000 7fa4d2200640 1 -- 172.21.15.17:0/3532250835 shutdown_connections 2024-09-13T16:13:43.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.132+0000 7fa4d2200640 1 -- 172.21.15.17:0/3532250835 wait complete. 2024-09-13T16:13:43.147 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:42 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1718486968' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:13:43.147 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:42 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/4120104192' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:13:43.147 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:42 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3856367721' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:13:43.149 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T16:13:43.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:42 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1718486968' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:13:43.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:42 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/4120104192' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:13:43.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:42 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3856367721' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:13:43.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.308+0000 7f8d68200640 1 -- 172.21.15.17:0/265760827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d60107be0 msgr2=0x7f8d6010a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:43.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.308+0000 7f8d68200640 1 --2- 172.21.15.17:0/265760827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d60107be0 0x7f8d6010a0a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009ca0 tx=0x7f8d5802a8c0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.308+0000 7f8d68200640 1 -- 172.21.15.17:0/265760827 shutdown_connections 2024-09-13T16:13:43.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.308+0000 7f8d68200640 1 --2- 172.21.15.17:0/265760827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d60107be0 0x7f8d6010a0a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.308+0000 7f8d68200640 1 --2- 172.21.15.17:0/265760827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d60072f10 0x7f8d60073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.308+0000 7f8d68200640 1 --2- 172.21.15.17:0/265760827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d600744f0 0x7f8d60072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.308+0000 7f8d68200640 1 -- 172.21.15.17:0/265760827 >> 172.21.15.17:0/265760827 conn(0x7f8d600fb4d0 msgr2=0x7f8d600fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:43.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.308+0000 7f8d68200640 1 -- 172.21.15.17:0/265760827 shutdown_connections 2024-09-13T16:13:43.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.308+0000 7f8d68200640 1 -- 172.21.15.17:0/265760827 wait complete. 2024-09-13T16:13:43.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.309+0000 7f8d68200640 1 Processor -- start 2024-09-13T16:13:43.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.309+0000 7f8d68200640 1 -- start start 2024-09-13T16:13:43.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.309+0000 7f8d68200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d60072f10 0x7f8d60197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:43.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.309+0000 7f8d68200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d600744f0 0x7f8d601984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:43.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.310+0000 7f8d68200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d60107be0 0x7f8d6019f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:43.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.310+0000 7f8d68200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6019fa70 con 0x7f8d60072f10 2024-09-13T16:13:43.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.310+0000 7f8d68200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6019fbe0 con 0x7f8d60107be0 2024-09-13T16:13:43.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.310+0000 7f8d68200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6019fda0 con 0x7f8d600744f0 2024-09-13T16:13:43.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.310+0000 7f8d65800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d60072f10 0x7f8d60197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:43.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.310+0000 7f8d65800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d60072f10 0x7f8d60197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51684/0 (socket says 172.21.15.17:51684) 2024-09-13T16:13:43.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.310+0000 7f8d65800640 1 -- 172.21.15.17:0/1757196323 learned_addr learned my addr 172.21.15.17:0/1757196323 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:13:43.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.310+0000 7f8d64e00640 1 --2- 172.21.15.17:0/1757196323 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d600744f0 0x7f8d601984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:43.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.310+0000 7f8d66200640 1 --2- 172.21.15.17:0/1757196323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d60107be0 0x7f8d6019f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:43.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.310+0000 7f8d65800640 1 -- 172.21.15.17:0/1757196323 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d600744f0 msgr2=0x7f8d601984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:43.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.310+0000 7f8d65800640 1 --2- 172.21.15.17:0/1757196323 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d600744f0 0x7f8d601984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.310+0000 7f8d65800640 1 -- 172.21.15.17:0/1757196323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d60107be0 msgr2=0x7f8d6019f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:43.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.310+0000 7f8d65800640 1 --2- 172.21.15.17:0/1757196323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d60107be0 0x7f8d6019f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.310+0000 7f8d65800640 1 -- 172.21.15.17:0/1757196323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d58009900 con 0x7f8d60072f10 2024-09-13T16:13:43.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.310+0000 7f8d64e00640 1 --2- 172.21.15.17:0/1757196323 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d600744f0 0x7f8d601984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:13:43.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.310+0000 7f8d66200640 1 --2- 172.21.15.17:0/1757196323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d60107be0 0x7f8d6019f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:13:43.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.311+0000 7f8d65800640 1 --2- 172.21.15.17:0/1757196323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d60072f10 0x7f8d60197f80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400e9f0 tx=0x7f8d5400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:43.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.311+0000 7f8d5e000640 1 -- 172.21.15.17:0/1757196323 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d54009700 con 0x7f8d60072f10 2024-09-13T16:13:43.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.311+0000 7f8d5e000640 1 -- 172.21.15.17:0/1757196323 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d5400cd80 con 0x7f8d60072f10 2024-09-13T16:13:43.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.311+0000 7f8d68200640 1 -- 172.21.15.17:0/1757196323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d601a0080 con 0x7f8d60072f10 2024-09-13T16:13:43.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.311+0000 7f8d5e000640 1 -- 172.21.15.17:0/1757196323 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d54018860 con 0x7f8d60072f10 2024-09-13T16:13:43.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.311+0000 7f8d68200640 1 -- 172.21.15.17:0/1757196323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d601a05e0 con 0x7f8d60072f10 2024-09-13T16:13:43.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.312+0000 7f8d68200640 1 -- 172.21.15.17:0/1757196323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d60106960 con 0x7f8d60072f10 2024-09-13T16:13:43.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.314+0000 7f8d5e000640 1 -- 172.21.15.17:0/1757196323 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8d540189c0 con 0x7f8d60072f10 2024-09-13T16:13:43.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.315+0000 7f8d5e000640 1 --2- 172.21.15.17:0/1757196323 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8d480a1110 0x7f8d480a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:43.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.316+0000 7f8d5e000640 1 -- 172.21.15.17:0/1757196323 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7f8d54014070 con 0x7f8d60072f10 2024-09-13T16:13:43.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.316+0000 7f8d64e00640 1 --2- 172.21.15.17:0/1757196323 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8d480a1110 0x7f8d480a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.316+0000 7f8d64e00640 1 --2- 172.21.15.17:0/1757196323 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8d480a1110 0x7f8d480a35d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8d60199490 tx=0x7f8d4c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:43.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.321+0000 7f8d5e000640 1 -- 172.21.15.17:0/1757196323 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8d54052e20 con 0x7f8d60072f10 2024-09-13T16:13:43.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:42 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1718486968' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T16:13:43.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:42 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/4120104192' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T16:13:43.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:42 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3856367721' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T16:13:43.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.514+0000 7f8d68200640 1 -- 172.21.15.17:0/1757196323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8d6010d850 con 0x7f8d60072f10 2024-09-13T16:13:43.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.514+0000 7f8d5e000640 1 -- 172.21.15.17:0/1757196323 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v94) v1 ==== 81+0+589 (secure 0 0 0) 0x7f8d54096410 con 0x7f8d60072f10 2024-09-13T16:13:43.515 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/386837955 2024-09-14T15:47:42.048005+0000 2024-09-13T16:13:43.515 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1550067038 2024-09-14T15:47:42.048005+0000 2024-09-13T16:13:43.516 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3360683829 2024-09-14T15:47:42.048005+0000 2024-09-13T16:13:43.516 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/634066188 2024-09-14T15:47:42.048005+0000 2024-09-13T16:13:43.516 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/1047258336 2024-09-14T15:47:14.996424+0000 2024-09-13T16:13:43.516 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/1047258336 2024-09-14T15:47:14.996424+0000 2024-09-13T16:13:43.516 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1945536687 2024-09-14T15:47:14.996424+0000 2024-09-13T16:13:43.516 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/386837955 2024-09-14T15:47:42.048005+0000 2024-09-13T16:13:43.516 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2214214377 2024-09-14T15:47:14.996424+0000 2024-09-13T16:13:43.516 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1224386591 2024-09-14T15:47:14.996424+0000 2024-09-13T16:13:43.516 INFO:teuthology.orchestra.run.smithi017.stderr:listed 10 entries 2024-09-13T16:13:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.517+0000 7f8d68200640 1 -- 172.21.15.17:0/1757196323 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8d480a1110 msgr2=0x7f8d480a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.517+0000 7f8d68200640 1 --2- 172.21.15.17:0/1757196323 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8d480a1110 0x7f8d480a35d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8d60199490 tx=0x7f8d4c005f90 comp rx=0 tx=0).stop 2024-09-13T16:13:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.517+0000 7f8d68200640 1 -- 172.21.15.17:0/1757196323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d60072f10 msgr2=0x7f8d60197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.517+0000 7f8d68200640 1 --2- 172.21.15.17:0/1757196323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d60072f10 0x7f8d60197f80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400e9f0 tx=0x7f8d5400eeb0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.517+0000 7f8d68200640 1 -- 172.21.15.17:0/1757196323 shutdown_connections 2024-09-13T16:13:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.517+0000 7f8d68200640 1 --2- 172.21.15.17:0/1757196323 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f8d480a1110 0x7f8d480a35d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.517+0000 7f8d68200640 1 --2- 172.21.15.17:0/1757196323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d60107be0 0x7f8d6019f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.517+0000 7f8d68200640 1 --2- 172.21.15.17:0/1757196323 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d600744f0 0x7f8d601984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.517+0000 7f8d68200640 1 --2- 172.21.15.17:0/1757196323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d60072f10 0x7f8d60197f80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.517+0000 7f8d68200640 1 -- 172.21.15.17:0/1757196323 >> 172.21.15.17:0/1757196323 conn(0x7f8d600fb4d0 msgr2=0x7f8d60103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.517+0000 7f8d68200640 1 -- 172.21.15.17:0/1757196323 shutdown_connections 2024-09-13T16:13:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:43.517+0000 7f8d68200640 1 -- 172.21.15.17:0/1757196323 wait complete. 2024-09-13T16:13:43.533 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T16:13:43.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:13:43.534 DEBUG:teuthology.orchestra.run.smithi017:> sudo umount /tmp/cephfs 2024-09-13T16:13:43.661 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-13T16:13:43.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:13:43.662 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-09-13T16:13:43.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:13:43.740 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-13T16:13:43.815 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-09-13T16:13:43.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:13:43.816 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-09-13T16:13:43.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T16:13:43.875 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-09-13T16:13:44.133 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:43 smithi017 ceph-mon[30494]: pgmap v864: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.0 KiB/s wr, 9 op/s 2024-09-13T16:13:44.133 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:43 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3532250835' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:13:44.133 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:43 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1757196323' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T16:13:44.225 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-13T16:13:44.235 INFO:tasks.cephadm:Teardown begin 2024-09-13T16:13:44.235 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T16:13:44.235 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:13:44.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:43 smithi193 ceph-mon[35248]: pgmap v864: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.0 KiB/s wr, 9 op/s 2024-09-13T16:13:44.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:43 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3532250835' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:13:44.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:43 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1757196323' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T16:13:44.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:43 smithi189 ceph-mon[34790]: pgmap v864: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.0 KiB/s wr, 9 op/s 2024-09-13T16:13:44.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:43 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3532250835' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T16:13:44.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:43 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1757196323' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T16:13:44.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.396+0000 7fdd62c00640 1 -- 172.21.15.17:0/367973193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd5c101950 msgr2=0x7fdd5c1081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:44.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.396+0000 7fdd62c00640 1 --2- 172.21.15.17:0/367973193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd5c101950 0x7fdd5c1081e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdd54009ca0 tx=0x7fdd5402a8c0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.396+0000 7fdd62c00640 1 -- 172.21.15.17:0/367973193 shutdown_connections 2024-09-13T16:13:44.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.396+0000 7fdd62c00640 1 --2- 172.21.15.17:0/367973193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd5c101950 0x7fdd5c1081e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.396+0000 7fdd62c00640 1 --2- 172.21.15.17:0/367973193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd5c100f90 0x7fdd5c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.396+0000 7fdd62c00640 1 --2- 172.21.15.17:0/367973193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd5c0ffda0 0x7fdd5c1001a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.396+0000 7fdd62c00640 1 -- 172.21.15.17:0/367973193 >> 172.21.15.17:0/367973193 conn(0x7fdd5c0fb520 msgr2=0x7fdd5c0fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:44.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.396+0000 7fdd62c00640 1 -- 172.21.15.17:0/367973193 shutdown_connections 2024-09-13T16:13:44.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.396+0000 7fdd62c00640 1 -- 172.21.15.17:0/367973193 wait complete. 2024-09-13T16:13:44.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.397+0000 7fdd62c00640 1 Processor -- start 2024-09-13T16:13:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.397+0000 7fdd62c00640 1 -- start start 2024-09-13T16:13:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.397+0000 7fdd62c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd5c0ffda0 0x7fdd5c197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.397+0000 7fdd62c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd5c100f90 0x7fdd5c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.397+0000 7fdd62c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd5c101950 0x7fdd5c19f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.397+0000 7fdd62c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c19fa40 con 0x7fdd5c100f90 2024-09-13T16:13:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.397+0000 7fdd62c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c19fbb0 con 0x7fdd5c101950 2024-09-13T16:13:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.397+0000 7fdd62c00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c19fd70 con 0x7fdd5c0ffda0 2024-09-13T16:13:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.398+0000 7fdd53400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd5c100f90 0x7fdd5c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.398+0000 7fdd5be00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd5c0ffda0 0x7fdd5c197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.398+0000 7fdd53400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd5c100f90 0x7fdd5c1984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51704/0 (socket says 172.21.15.17:51704) 2024-09-13T16:13:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.398+0000 7fdd53400640 1 -- 172.21.15.17:0/2748224045 learned_addr learned my addr 172.21.15.17:0/2748224045 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:13:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.398+0000 7fdd60c00640 1 --2- 172.21.15.17:0/2748224045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd5c101950 0x7fdd5c19f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.398+0000 7fdd5be00640 1 -- 172.21.15.17:0/2748224045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd5c101950 msgr2=0x7fdd5c19f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.398+0000 7fdd5be00640 1 --2- 172.21.15.17:0/2748224045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd5c101950 0x7fdd5c19f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.398+0000 7fdd5be00640 1 -- 172.21.15.17:0/2748224045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd5c100f90 msgr2=0x7fdd5c1984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.398+0000 7fdd5be00640 1 --2- 172.21.15.17:0/2748224045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd5c100f90 0x7fdd5c1984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.398+0000 7fdd5be00640 1 -- 172.21.15.17:0/2748224045 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c009490 con 0x7fdd5c0ffda0 2024-09-13T16:13:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.398+0000 7fdd53400640 1 --2- 172.21.15.17:0/2748224045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd5c100f90 0x7fdd5c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:13:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.398+0000 7fdd5be00640 1 --2- 172.21.15.17:0/2748224045 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd5c0ffda0 0x7fdd5c197fa0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c00e9c0 tx=0x7fdd4c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.399+0000 7fdd59600640 1 -- 172.21.15.17:0/2748224045 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c00cd80 con 0x7fdd5c0ffda0 2024-09-13T16:13:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.399+0000 7fdd59600640 1 -- 172.21.15.17:0/2748224045 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd4c0108f0 con 0x7fdd5c0ffda0 2024-09-13T16:13:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.399+0000 7fdd62c00640 1 -- 172.21.15.17:0/2748224045 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd54009900 con 0x7fdd5c0ffda0 2024-09-13T16:13:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.399+0000 7fdd59600640 1 -- 172.21.15.17:0/2748224045 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c018840 con 0x7fdd5c0ffda0 2024-09-13T16:13:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.399+0000 7fdd62c00640 1 -- 172.21.15.17:0/2748224045 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5c1a0330 con 0x7fdd5c0ffda0 2024-09-13T16:13:44.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.400+0000 7fdd62c00640 1 -- 172.21.15.17:0/2748224045 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5c10b640 con 0x7fdd5c0ffda0 2024-09-13T16:13:44.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.402+0000 7fdd59600640 1 -- 172.21.15.17:0/2748224045 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fdd4c010a60 con 0x7fdd5c0ffda0 2024-09-13T16:13:44.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.403+0000 7fdd59600640 1 --2- 172.21.15.17:0/2748224045 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdd400a1110 0x7fdd400a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:44.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.403+0000 7fdd59600640 1 -- 172.21.15.17:0/2748224045 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fdd4c014070 con 0x7fdd5c0ffda0 2024-09-13T16:13:44.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.403+0000 7fdd53400640 1 --2- 172.21.15.17:0/2748224045 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdd400a1110 0x7fdd400a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:44.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.404+0000 7fdd53400640 1 --2- 172.21.15.17:0/2748224045 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdd400a1110 0x7fdd400a35d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c199460 tx=0x7fdd44005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:44.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.406+0000 7fdd59600640 1 -- 172.21.15.17:0/2748224045 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdd4c096c00 con 0x7fdd5c0ffda0 2024-09-13T16:13:44.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.623+0000 7fdd62c00640 1 -- 172.21.15.17:0/2748224045 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd5c1a0550 con 0x7fdd5c0ffda0 2024-09-13T16:13:44.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.624+0000 7fdd59600640 1 -- 172.21.15.17:0/2748224045 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+10885 (secure 0 0 0) 0x7fdd5c1a0550 con 0x7fdd5c0ffda0 2024-09-13T16:13:44.625 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:13:44.626 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":55,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1730156534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1730156534},{"type":"v1","addr":"172.21.15.17:6837","nonce":1730156534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/1295854211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1295854211},{"type":"v1","addr":"172.21.15.17:6841","nonce":1295854211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2888593680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2888593680},{"type":"v1","addr":"172.21.15.17:6835","nonce":2888593680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4135454212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4135454212},{"type":"v1","addr":"172.21.15.189:6835","nonce":4135454212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":55,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T15:54:52.929867+0000","modified":"2024-09-13T16:13:11.834271+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24565,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24520":{"gid":24520,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/4049465204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":4049465204},{"type":"v1","addr":"172.21.15.193:6835","nonce":4049465204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/2079181485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2079181485},{"type":"v1","addr":"172.21.15.189:6837","nonce":2079181485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24532":{"gid":24532,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/792056943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":792056943},{"type":"v1","addr":"172.21.15.193:6837","nonce":792056943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24553":{"gid":24553,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6839/3012199875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":3012199875},{"type":"v1","addr":"172.21.15.193:6839","nonce":3012199875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24565":{"gid":24565,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.17:6839/3750040765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3750040765},{"type":"v1","addr":"172.21.15.17:6839","nonce":3750040765}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6839/2624723395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2624723395},{"type":"v1","addr":"172.21.15.189:6839","nonce":2624723395}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:13:44.626 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 55 2024-09-13T16:13:44.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.627+0000 7fdd62c00640 1 -- 172.21.15.17:0/2748224045 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdd400a1110 msgr2=0x7fdd400a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:44.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.627+0000 7fdd62c00640 1 --2- 172.21.15.17:0/2748224045 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdd400a1110 0x7fdd400a35d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c199460 tx=0x7fdd44005f90 comp rx=0 tx=0).stop 2024-09-13T16:13:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.627+0000 7fdd62c00640 1 -- 172.21.15.17:0/2748224045 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd5c0ffda0 msgr2=0x7fdd5c197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.627+0000 7fdd62c00640 1 --2- 172.21.15.17:0/2748224045 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd5c0ffda0 0x7fdd5c197fa0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c00e9c0 tx=0x7fdd4c00ee80 comp rx=0 tx=0).stop 2024-09-13T16:13:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.627+0000 7fdd62c00640 1 -- 172.21.15.17:0/2748224045 shutdown_connections 2024-09-13T16:13:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.627+0000 7fdd62c00640 1 --2- 172.21.15.17:0/2748224045 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdd400a1110 0x7fdd400a35d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.627+0000 7fdd62c00640 1 --2- 172.21.15.17:0/2748224045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd5c101950 0x7fdd5c19f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.627+0000 7fdd62c00640 1 --2- 172.21.15.17:0/2748224045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd5c100f90 0x7fdd5c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.627+0000 7fdd62c00640 1 --2- 172.21.15.17:0/2748224045 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd5c0ffda0 0x7fdd5c197fa0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.627+0000 7fdd62c00640 1 -- 172.21.15.17:0/2748224045 >> 172.21.15.17:0/2748224045 conn(0x7fdd5c0fb520 msgr2=0x7fdd5c106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.627+0000 7fdd62c00640 1 -- 172.21.15.17:0/2748224045 shutdown_connections 2024-09-13T16:13:44.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.627+0000 7fdd62c00640 1 -- 172.21.15.17:0/2748224045 wait complete. 2024-09-13T16:13:44.644 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T16:13:44.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.802+0000 7fe741600640 1 -- 172.21.15.17:0/1915115484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe73c101950 msgr2=0x7fe73c1081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:44.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.802+0000 7fe741600640 1 --2- 172.21.15.17:0/1915115484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe73c101950 0x7fe73c1081e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe734009ca0 tx=0x7fe73402a8c0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.802+0000 7fe741600640 1 -- 172.21.15.17:0/1915115484 shutdown_connections 2024-09-13T16:13:44.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.802+0000 7fe741600640 1 --2- 172.21.15.17:0/1915115484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe73c101950 0x7fe73c1081e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.802+0000 7fe741600640 1 --2- 172.21.15.17:0/1915115484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe73c100f90 0x7fe73c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.802+0000 7fe741600640 1 --2- 172.21.15.17:0/1915115484 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe73c0ffda0 0x7fe73c1001a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.802+0000 7fe741600640 1 -- 172.21.15.17:0/1915115484 >> 172.21.15.17:0/1915115484 conn(0x7fe73c0fb520 msgr2=0x7fe73c0fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:44.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.802+0000 7fe741600640 1 -- 172.21.15.17:0/1915115484 shutdown_connections 2024-09-13T16:13:44.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.803+0000 7fe741600640 1 -- 172.21.15.17:0/1915115484 wait complete. 2024-09-13T16:13:44.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.803+0000 7fe741600640 1 Processor -- start 2024-09-13T16:13:44.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.804+0000 7fe741600640 1 -- start start 2024-09-13T16:13:44.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.804+0000 7fe741600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe73c0ffda0 0x7fe73c195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:44.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.804+0000 7fe741600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe73c100f90 0x7fe73c196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:44.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.804+0000 7fe741600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe73c101950 0x7fe73c19d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.804+0000 7fe741600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c19d860 con 0x7fe73c101950 2024-09-13T16:13:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.804+0000 7fe741600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c19d9d0 con 0x7fe73c100f90 2024-09-13T16:13:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.804+0000 7fe741600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c19db90 con 0x7fe73c0ffda0 2024-09-13T16:13:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.804+0000 7fe73b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe73c101950 0x7fe73c19d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.804+0000 7fe73b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe73c101950 0x7fe73c19d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51728/0 (socket says 172.21.15.17:51728) 2024-09-13T16:13:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.804+0000 7fe73b400640 1 -- 172.21.15.17:0/3746158102 learned_addr learned my addr 172.21.15.17:0/3746158102 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:13:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.804+0000 7fe73aa00640 1 --2- 172.21.15.17:0/3746158102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe73c0ffda0 0x7fe73c195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.804+0000 7fe733e00640 1 --2- 172.21.15.17:0/3746158102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe73c100f90 0x7fe73c196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.805+0000 7fe73b400640 1 -- 172.21.15.17:0/3746158102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe73c0ffda0 msgr2=0x7fe73c195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.805+0000 7fe73b400640 1 --2- 172.21.15.17:0/3746158102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe73c0ffda0 0x7fe73c195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.805+0000 7fe73b400640 1 -- 172.21.15.17:0/3746158102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe73c100f90 msgr2=0x7fe73c196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.805+0000 7fe73b400640 1 --2- 172.21.15.17:0/3746158102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe73c100f90 0x7fe73c196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.805+0000 7fe73b400640 1 -- 172.21.15.17:0/3746158102 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe724009490 con 0x7fe73c101950 2024-09-13T16:13:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.805+0000 7fe73b400640 1 --2- 172.21.15.17:0/3746158102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe73c101950 0x7fe73c19d320 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe7340098d0 tx=0x7fe734032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.805+0000 7fe733400640 1 -- 172.21.15.17:0/3746158102 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe734003b70 con 0x7fe73c101950 2024-09-13T16:13:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.805+0000 7fe733400640 1 -- 172.21.15.17:0/3746158102 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe734040070 con 0x7fe73c101950 2024-09-13T16:13:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.805+0000 7fe733400640 1 -- 172.21.15.17:0/3746158102 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7340044a0 con 0x7fe73c101950 2024-09-13T16:13:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.805+0000 7fe741600640 1 -- 172.21.15.17:0/3746158102 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe734009900 con 0x7fe73c101950 2024-09-13T16:13:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.805+0000 7fe741600640 1 -- 172.21.15.17:0/3746158102 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe73c19e140 con 0x7fe73c101950 2024-09-13T16:13:44.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.806+0000 7fe741600640 1 -- 172.21.15.17:0/3746158102 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73c1001a0 con 0x7fe73c101950 2024-09-13T16:13:44.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.808+0000 7fe733400640 1 -- 172.21.15.17:0/3746158102 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe734042030 con 0x7fe73c101950 2024-09-13T16:13:44.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.809+0000 7fe733400640 1 --2- 172.21.15.17:0/3746158102 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe7200a1090 0x7fe7200a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:44.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.810+0000 7fe733400640 1 -- 172.21.15.17:0/3746158102 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fe7340ee170 con 0x7fe73c101950 2024-09-13T16:13:44.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.810+0000 7fe73aa00640 1 --2- 172.21.15.17:0/3746158102 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe7200a1090 0x7fe7200a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:44.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.810+0000 7fe73aa00640 1 --2- 172.21.15.17:0/3746158102 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe7200a1090 0x7fe7200a3550 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe73c100df0 tx=0x7fe72c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:44.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:44.813+0000 7fe733400640 1 -- 172.21.15.17:0/3746158102 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe7340b75e0 con 0x7fe73c101950 2024-09-13T16:13:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.036+0000 7fe741600640 1 -- 172.21.15.17:0/3746158102 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe73c107230 con 0x7fe73c101950 2024-09-13T16:13:45.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.037+0000 7fe733400640 1 -- 172.21.15.17:0/3746158102 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+10885 (secure 0 0 0) 0x7fe7340bac00 con 0x7fe73c101950 2024-09-13T16:13:45.038 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:13:45.038 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":55,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1730156534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1730156534},{"type":"v1","addr":"172.21.15.17:6837","nonce":1730156534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/1295854211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1295854211},{"type":"v1","addr":"172.21.15.17:6841","nonce":1295854211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3777024343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3777024343},{"type":"v1","addr":"172.21.15.189:6833","nonce":3777024343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/2264195842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":2264195842},{"type":"v1","addr":"172.21.15.193:6833","nonce":2264195842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2888593680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2888593680},{"type":"v1","addr":"172.21.15.17:6835","nonce":2888593680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/4135454212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":4135454212},{"type":"v1","addr":"172.21.15.189:6835","nonce":4135454212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":55,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T15:54:52.929867+0000","modified":"2024-09-13T16:13:11.834271+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24565,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24520":{"gid":24520,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/4049465204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":4049465204},{"type":"v1","addr":"172.21.15.193:6835","nonce":4049465204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/2079181485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2079181485},{"type":"v1","addr":"172.21.15.189:6837","nonce":2079181485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24532":{"gid":24532,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/792056943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":792056943},{"type":"v1","addr":"172.21.15.193:6837","nonce":792056943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24553":{"gid":24553,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6839/3012199875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":3012199875},{"type":"v1","addr":"172.21.15.193:6839","nonce":3012199875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24565":{"gid":24565,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.17:6839/3750040765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3750040765},{"type":"v1","addr":"172.21.15.17:6839","nonce":3750040765}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.189:6839/2624723395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2624723395},{"type":"v1","addr":"172.21.15.189:6839","nonce":2624723395}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T16:13:45.039 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 55 2024-09-13T16:13:45.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.039+0000 7fe741600640 1 -- 172.21.15.17:0/3746158102 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe7200a1090 msgr2=0x7fe7200a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:45.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.039+0000 7fe741600640 1 --2- 172.21.15.17:0/3746158102 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe7200a1090 0x7fe7200a3550 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe73c100df0 tx=0x7fe72c00b390 comp rx=0 tx=0).stop 2024-09-13T16:13:45.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.039+0000 7fe741600640 1 -- 172.21.15.17:0/3746158102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe73c101950 msgr2=0x7fe73c19d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:45.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.039+0000 7fe741600640 1 --2- 172.21.15.17:0/3746158102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe73c101950 0x7fe73c19d320 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe7340098d0 tx=0x7fe734032f20 comp rx=0 tx=0).stop 2024-09-13T16:13:45.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.039+0000 7fe741600640 1 -- 172.21.15.17:0/3746158102 shutdown_connections 2024-09-13T16:13:45.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.039+0000 7fe741600640 1 --2- 172.21.15.17:0/3746158102 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fe7200a1090 0x7fe7200a3550 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.039+0000 7fe741600640 1 --2- 172.21.15.17:0/3746158102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe73c101950 0x7fe73c19d320 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.039+0000 7fe741600640 1 --2- 172.21.15.17:0/3746158102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe73c100f90 0x7fe73c196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.039+0000 7fe741600640 1 --2- 172.21.15.17:0/3746158102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe73c0ffda0 0x7fe73c195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.039+0000 7fe741600640 1 -- 172.21.15.17:0/3746158102 >> 172.21.15.17:0/3746158102 conn(0x7fe73c0fb520 msgr2=0x7fe73c104400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:45.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.040+0000 7fe741600640 1 -- 172.21.15.17:0/3746158102 shutdown_connections 2024-09-13T16:13:45.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.040+0000 7fe741600640 1 -- 172.21.15.17:0/3746158102 wait complete. 2024-09-13T16:13:45.057 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T16:13:45.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.214+0000 7efce2200640 1 -- 172.21.15.17:0/1785434566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcdc103b50 msgr2=0x7efcdc10a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:45.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.214+0000 7efce2200640 1 --2- 172.21.15.17:0/1785434566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcdc103b50 0x7efcdc10a3e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009ca0 tx=0x7efcd402a8c0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.214+0000 7efce2200640 1 -- 172.21.15.17:0/1785434566 shutdown_connections 2024-09-13T16:13:45.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.214+0000 7efce2200640 1 --2- 172.21.15.17:0/1785434566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcdc103b50 0x7efcdc10a3e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.214+0000 7efce2200640 1 --2- 172.21.15.17:0/1785434566 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcdc103190 0x7efcdc103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.214+0000 7efce2200640 1 --2- 172.21.15.17:0/1785434566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efcdc101fa0 0x7efcdc1023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.214+0000 7efce2200640 1 -- 172.21.15.17:0/1785434566 >> 172.21.15.17:0/1785434566 conn(0x7efcdc0fd700 msgr2=0x7efcdc0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:45.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.214+0000 7efce2200640 1 -- 172.21.15.17:0/1785434566 shutdown_connections 2024-09-13T16:13:45.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.214+0000 7efce2200640 1 -- 172.21.15.17:0/1785434566 wait complete. 2024-09-13T16:13:45.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.215+0000 7efce2200640 1 Processor -- start 2024-09-13T16:13:45.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.215+0000 7efce2200640 1 -- start start 2024-09-13T16:13:45.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.216+0000 7efce2200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efcdc101fa0 0x7efcdc197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:45.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.216+0000 7efce2200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcdc103190 0x7efcdc198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:45.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.216+0000 7efce2200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcdc103b50 0x7efcdc19f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:45.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.216+0000 7efce2200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc19f9e0 con 0x7efcdc103190 2024-09-13T16:13:45.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.216+0000 7efce2200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc19fb50 con 0x7efcdc101fa0 2024-09-13T16:13:45.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.216+0000 7efce2200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc19fd10 con 0x7efcdc103b50 2024-09-13T16:13:45.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.216+0000 7efcdaa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcdc103190 0x7efcdc198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:45.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.216+0000 7efcdaa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcdc103190 0x7efcdc198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51746/0 (socket says 172.21.15.17:51746) 2024-09-13T16:13:45.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.216+0000 7efcdaa00640 1 -- 172.21.15.17:0/2076503709 learned_addr learned my addr 172.21.15.17:0/2076503709 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:13:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.216+0000 7efcdbe00640 1 --2- 172.21.15.17:0/2076503709 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcdc103b50 0x7efcdc19f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.216+0000 7efcdb400640 1 --2- 172.21.15.17:0/2076503709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efcdc101fa0 0x7efcdc197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.216+0000 7efcdaa00640 1 -- 172.21.15.17:0/2076503709 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcdc103b50 msgr2=0x7efcdc19f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.216+0000 7efcdaa00640 1 --2- 172.21.15.17:0/2076503709 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcdc103b50 0x7efcdc19f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.216+0000 7efcdaa00640 1 -- 172.21.15.17:0/2076503709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efcdc101fa0 msgr2=0x7efcdc197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.216+0000 7efcdaa00640 1 --2- 172.21.15.17:0/2076503709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efcdc101fa0 0x7efcdc197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.216+0000 7efcdaa00640 1 -- 172.21.15.17:0/2076503709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc009490 con 0x7efcdc103190 2024-09-13T16:13:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.217+0000 7efcdaa00640 1 --2- 172.21.15.17:0/2076503709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcdc103190 0x7efcdc198430 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7efcc800e9f0 tx=0x7efcc800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.217+0000 7efcd3e00640 1 -- 172.21.15.17:0/2076503709 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc8009720 con 0x7efcdc103190 2024-09-13T16:13:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.217+0000 7efcd3e00640 1 -- 172.21.15.17:0/2076503709 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efcc800cd80 con 0x7efcdc103190 2024-09-13T16:13:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.217+0000 7efce2200640 1 -- 172.21.15.17:0/2076503709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd4009900 con 0x7efcdc103190 2024-09-13T16:13:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.217+0000 7efcd3e00640 1 -- 172.21.15.17:0/2076503709 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc8010430 con 0x7efcdc103190 2024-09-13T16:13:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.217+0000 7efce2200640 1 -- 172.21.15.17:0/2076503709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc1a0290 con 0x7efcdc103190 2024-09-13T16:13:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.218+0000 7efce2200640 1 -- 172.21.15.17:0/2076503709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcdc1023a0 con 0x7efcdc103190 2024-09-13T16:13:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.221+0000 7efcd3e00640 1 -- 172.21.15.17:0/2076503709 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7efcc8005020 con 0x7efcdc103190 2024-09-13T16:13:45.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.222+0000 7efcd3e00640 1 --2- 172.21.15.17:0/2076503709 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efcc00a1090 0x7efcc00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:45.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.222+0000 7efcd3e00640 1 -- 172.21.15.17:0/2076503709 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7efcc8014070 con 0x7efcdc103190 2024-09-13T16:13:45.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.222+0000 7efcdb400640 1 --2- 172.21.15.17:0/2076503709 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efcc00a1090 0x7efcc00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:45.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.223+0000 7efcdb400640 1 --2- 172.21.15.17:0/2076503709 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efcc00a1090 0x7efcc00a3550 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efcdc102ff0 tx=0x7efccc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:45.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.225+0000 7efcd3e00640 1 -- 172.21.15.17:0/2076503709 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efcc80964a0 con 0x7efcdc103190 2024-09-13T16:13:45.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:44 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/2748224045' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:13:45.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:44 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/2748224045' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:13:45.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:44 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/2748224045' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:13:45.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.408+0000 7efce2200640 1 -- 172.21.15.17:0/2076503709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcdc109390 con 0x7efcdc103190 2024-09-13T16:13:45.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.410+0000 7efcd3e00640 1 -- 172.21.15.17:0/2076503709 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24575 (secure 0 0 0) 0x7efcc8099ac0 con 0x7efcdc103190 2024-09-13T16:13:45.411 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T16:13:45.411 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":94,"fsid":"3334a620-71e7-11ef-bceb-c7b262605968","created":"2024-09-13T15:46:50.475750+0000","modified":"2024-09-13T15:56:44.228817+0000","last_up_change":"2024-09-13T15:53:59.138985+0000","last_in_change":"2024-09-13T15:53:39.220264+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:50:10.657011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:54:51.436469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:54:52.427930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:54:55.478058+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5d39d6af-15e6-463b-b9ff-a9a5dd94e839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6803","nonce":158651212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6805","nonce":158651212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6809","nonce":158651212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":158651212},{"type":"v1","addr":"172.21.15.17:6807","nonce":158651212}]},"public_addr":"172.21.15.17:6803/158651212","cluster_addr":"172.21.15.17:6805/158651212","heartbeat_back_addr":"172.21.15.17:6809/158651212","heartbeat_front_addr":"172.21.15.17:6807/158651212","state":["exists","up"]},{"osd":1,"uuid":"0da621c7-645b-44ae-ba7c-a573861c3aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6801","nonce":964319421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6803","nonce":964319421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6807","nonce":964319421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":964319421},{"type":"v1","addr":"172.21.15.189:6805","nonce":964319421}]},"public_addr":"172.21.15.189:6801/964319421","cluster_addr":"172.21.15.189:6803/964319421","heartbeat_back_addr":"172.21.15.189:6807/964319421","heartbeat_front_addr":"172.21.15.189:6805/964319421","state":["exists","up"]},{"osd":2,"uuid":"fa95af60-1486-4a29-8c79-8a73a4146552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6801","nonce":138468002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6803","nonce":138468002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6807","nonce":138468002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":138468002},{"type":"v1","addr":"172.21.15.193:6805","nonce":138468002}]},"public_addr":"172.21.15.193:6801/138468002","cluster_addr":"172.21.15.193:6803/138468002","heartbeat_back_addr":"172.21.15.193:6807/138468002","heartbeat_front_addr":"172.21.15.193:6805/138468002","state":["exists","up"]},{"osd":3,"uuid":"90428e5f-dfd4-4cda-b240-fdb9079bcb7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6811","nonce":919913803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6813","nonce":919913803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6817","nonce":919913803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":919913803},{"type":"v1","addr":"172.21.15.17:6815","nonce":919913803}]},"public_addr":"172.21.15.17:6811/919913803","cluster_addr":"172.21.15.17:6813/919913803","heartbeat_back_addr":"172.21.15.17:6817/919913803","heartbeat_front_addr":"172.21.15.17:6815/919913803","state":["exists","up"]},{"osd":4,"uuid":"e1c537b6-98d2-4b66-b15a-65fe70b0ce25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6809","nonce":2310375565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6811","nonce":2310375565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6815","nonce":2310375565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2310375565},{"type":"v1","addr":"172.21.15.189:6813","nonce":2310375565}]},"public_addr":"172.21.15.189:6809/2310375565","cluster_addr":"172.21.15.189:6811/2310375565","heartbeat_back_addr":"172.21.15.189:6815/2310375565","heartbeat_front_addr":"172.21.15.189:6813/2310375565","state":["exists","up"]},{"osd":5,"uuid":"48522fd7-d781-4447-873f-174dabd1e33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6809","nonce":1330877824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6811","nonce":1330877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6815","nonce":1330877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1330877824},{"type":"v1","addr":"172.21.15.193:6813","nonce":1330877824}]},"public_addr":"172.21.15.193:6809/1330877824","cluster_addr":"172.21.15.193:6811/1330877824","heartbeat_back_addr":"172.21.15.193:6815/1330877824","heartbeat_front_addr":"172.21.15.193:6813/1330877824","state":["exists","up"]},{"osd":6,"uuid":"47bea191-fb53-40a7-8563-8ebf17dd5bf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6819","nonce":3930545382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6821","nonce":3930545382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6825","nonce":3930545382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3930545382},{"type":"v1","addr":"172.21.15.17:6823","nonce":3930545382}]},"public_addr":"172.21.15.17:6819/3930545382","cluster_addr":"172.21.15.17:6821/3930545382","heartbeat_back_addr":"172.21.15.17:6825/3930545382","heartbeat_front_addr":"172.21.15.17:6823/3930545382","state":["exists","up"]},{"osd":7,"uuid":"a98f36f9-0a19-4c9a-8ed1-615c4a6e7658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6817","nonce":3691677495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6819","nonce":3691677495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6823","nonce":3691677495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3691677495},{"type":"v1","addr":"172.21.15.189:6821","nonce":3691677495}]},"public_addr":"172.21.15.189:6817/3691677495","cluster_addr":"172.21.15.189:6819/3691677495","heartbeat_back_addr":"172.21.15.189:6823/3691677495","heartbeat_front_addr":"172.21.15.189:6821/3691677495","state":["exists","up"]},{"osd":8,"uuid":"7a372d9f-c40f-4ead-87da-2f3a570c1373","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6817","nonce":4112907498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6819","nonce":4112907498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6823","nonce":4112907498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4112907498},{"type":"v1","addr":"172.21.15.193:6821","nonce":4112907498}]},"public_addr":"172.21.15.193:6817/4112907498","cluster_addr":"172.21.15.193:6819/4112907498","heartbeat_back_addr":"172.21.15.193:6823/4112907498","heartbeat_front_addr":"172.21.15.193:6821/4112907498","state":["exists","up"]},{"osd":9,"uuid":"ac3d983c-c5e7-456b-8271-7c4e6169de61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6827","nonce":663424274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6829","nonce":663424274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6833","nonce":663424274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":663424274},{"type":"v1","addr":"172.21.15.17:6831","nonce":663424274}]},"public_addr":"172.21.15.17:6827/663424274","cluster_addr":"172.21.15.17:6829/663424274","heartbeat_back_addr":"172.21.15.17:6833/663424274","heartbeat_front_addr":"172.21.15.17:6831/663424274","state":["exists","up"]},{"osd":10,"uuid":"08dcae02-6c79-4a06-ae88-6eb6e6941cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6825","nonce":3153990375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6827","nonce":3153990375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6831","nonce":3153990375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3153990375},{"type":"v1","addr":"172.21.15.189:6829","nonce":3153990375}]},"public_addr":"172.21.15.189:6825/3153990375","cluster_addr":"172.21.15.189:6827/3153990375","heartbeat_back_addr":"172.21.15.189:6831/3153990375","heartbeat_front_addr":"172.21.15.189:6829/3153990375","state":["exists","up"]},{"osd":11,"uuid":"a4ebcf41-d805-4d44-b112-13ae84d51868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6825","nonce":4088053907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6827","nonce":4088053907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6831","nonce":4088053907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":4088053907},{"type":"v1","addr":"172.21.15.193:6829","nonce":4088053907}]},"public_addr":"172.21.15.193:6825/4088053907","cluster_addr":"172.21.15.193:6827/4088053907","heartbeat_back_addr":"172.21.15.193:6831/4088053907","heartbeat_front_addr":"172.21.15.193:6829/4088053907","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:22.172370+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:49:44.802224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:06.641435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:34.536515+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:50:58.789324+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:22.189862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:51:50.382257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:14.678047+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:52:38.581105+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:07.258150+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:32.261383+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:53:56.739338+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8},{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/1550067038":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/3360683829":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/634066188":"2024-09-14T15:47:42.048005+0000","172.21.15.17:6801/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/1047258336":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1945536687":"2024-09-14T15:47:14.996424+0000","172.21.15.17:6800/386837955":"2024-09-14T15:47:42.048005+0000","172.21.15.17:0/2214214377":"2024-09-14T15:47:14.996424+0000","172.21.15.17:0/1224386591":"2024-09-14T15:47:14.996424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T16:13:45.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.412+0000 7efce2200640 1 -- 172.21.15.17:0/2076503709 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efcc00a1090 msgr2=0x7efcc00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:45.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.412+0000 7efce2200640 1 --2- 172.21.15.17:0/2076503709 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efcc00a1090 0x7efcc00a3550 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efcdc102ff0 tx=0x7efccc005f90 comp rx=0 tx=0).stop 2024-09-13T16:13:45.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.412+0000 7efce2200640 1 -- 172.21.15.17:0/2076503709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcdc103190 msgr2=0x7efcdc198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:45.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.412+0000 7efce2200640 1 --2- 172.21.15.17:0/2076503709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcdc103190 0x7efcdc198430 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7efcc800e9f0 tx=0x7efcc800edf0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.412+0000 7efce2200640 1 -- 172.21.15.17:0/2076503709 shutdown_connections 2024-09-13T16:13:45.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.412+0000 7efce2200640 1 --2- 172.21.15.17:0/2076503709 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7efcc00a1090 0x7efcc00a3550 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.412+0000 7efce2200640 1 --2- 172.21.15.17:0/2076503709 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcdc103b50 0x7efcdc19f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.412+0000 7efce2200640 1 --2- 172.21.15.17:0/2076503709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcdc103190 0x7efcdc198430 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.412+0000 7efce2200640 1 --2- 172.21.15.17:0/2076503709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efcdc101fa0 0x7efcdc197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.412+0000 7efce2200640 1 -- 172.21.15.17:0/2076503709 >> 172.21.15.17:0/2076503709 conn(0x7efcdc0fd700 msgr2=0x7efcdc106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:45.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.412+0000 7efce2200640 1 -- 172.21.15.17:0/2076503709 shutdown_connections 2024-09-13T16:13:45.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.412+0000 7efce2200640 1 -- 172.21.15.17:0/2076503709 wait complete. 2024-09-13T16:13:45.429 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T16:13:45.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.587+0000 7fddba200640 1 -- 172.21.15.17:0/2011840114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb4105a60 msgr2=0x7fddb4107ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:45.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.587+0000 7fddba200640 1 --2- 172.21.15.17:0/2011840114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb4105a60 0x7fddb4107ed0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fddac009ca0 tx=0x7fddac02a8c0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.587+0000 7fddba200640 1 -- 172.21.15.17:0/2011840114 shutdown_connections 2024-09-13T16:13:45.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.587+0000 7fddba200640 1 --2- 172.21.15.17:0/2011840114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb4105a60 0x7fddb4107ed0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.587+0000 7fddba200640 1 --2- 172.21.15.17:0/2011840114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddb4103130 0x7fddb4105520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.587+0000 7fddba200640 1 --2- 172.21.15.17:0/2011840114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddb4100800 0x7fddb4102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.587+0000 7fddba200640 1 -- 172.21.15.17:0/2011840114 >> 172.21.15.17:0/2011840114 conn(0x7fddb40fa3e0 msgr2=0x7fddb40fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:45.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.587+0000 7fddba200640 1 -- 172.21.15.17:0/2011840114 shutdown_connections 2024-09-13T16:13:45.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.587+0000 7fddba200640 1 -- 172.21.15.17:0/2011840114 wait complete. 2024-09-13T16:13:45.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.588+0000 7fddba200640 1 Processor -- start 2024-09-13T16:13:45.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.588+0000 7fddba200640 1 -- start start 2024-09-13T16:13:45.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.588+0000 7fddba200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb4100800 0x7fddb4100170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:45.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.588+0000 7fddba200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddb4103130 0x7fddb40fe7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:45.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.588+0000 7fddba200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddb4105a60 0x7fddb40fecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:45.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.588+0000 7fddba200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb40ff450 con 0x7fddb4100800 2024-09-13T16:13:45.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.588+0000 7fddba200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb40ff5c0 con 0x7fddb4105a60 2024-09-13T16:13:45.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.588+0000 7fddba200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb419fe10 con 0x7fddb4103130 2024-09-13T16:13:45.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.589+0000 7fddb3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb4100800 0x7fddb4100170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:45.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.589+0000 7fddb3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddb4105a60 0x7fddb40fecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:45.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.589+0000 7fddb3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb4100800 0x7fddb4100170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51766/0 (socket says 172.21.15.17:51766) 2024-09-13T16:13:45.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.589+0000 7fddb3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddb4105a60 0x7fddb40fecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:41954/0 (socket says 172.21.15.17:41954) 2024-09-13T16:13:45.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.589+0000 7fddb3400640 1 -- 172.21.15.17:0/112661026 learned_addr learned my addr 172.21.15.17:0/112661026 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:13:45.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.589+0000 7fddabe00640 1 --2- 172.21.15.17:0/112661026 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddb4103130 0x7fddb40fe7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:45.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.589+0000 7fddb3e00640 1 -- 172.21.15.17:0/112661026 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddb4103130 msgr2=0x7fddb40fe7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:45.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.589+0000 7fddb3e00640 1 --2- 172.21.15.17:0/112661026 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddb4103130 0x7fddb40fe7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.589+0000 7fddb3e00640 1 -- 172.21.15.17:0/112661026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb4100800 msgr2=0x7fddb4100170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:45.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.589+0000 7fddb3e00640 1 --2- 172.21.15.17:0/112661026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb4100800 0x7fddb4100170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.589+0000 7fddb3e00640 1 -- 172.21.15.17:0/112661026 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c009490 con 0x7fddb4105a60 2024-09-13T16:13:45.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.589+0000 7fddb3400640 1 --2- 172.21.15.17:0/112661026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb4100800 0x7fddb4100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:13:45.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.589+0000 7fddb3e00640 1 --2- 172.21.15.17:0/112661026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddb4105a60 0x7fddb40fecf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fddac031b10 tx=0x7fddac032f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:45.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.590+0000 7fddb0c00640 1 -- 172.21.15.17:0/112661026 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac003b70 con 0x7fddb4105a60 2024-09-13T16:13:45.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.590+0000 7fddba200640 1 -- 172.21.15.17:0/112661026 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddac009900 con 0x7fddb4105a60 2024-09-13T16:13:45.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.590+0000 7fddba200640 1 -- 172.21.15.17:0/112661026 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb41a0430 con 0x7fddb4105a60 2024-09-13T16:13:45.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.590+0000 7fddb0c00640 1 -- 172.21.15.17:0/112661026 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fddac040070 con 0x7fddb4105a60 2024-09-13T16:13:45.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.590+0000 7fddb0c00640 1 -- 172.21.15.17:0/112661026 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac0043a0 con 0x7fddb4105a60 2024-09-13T16:13:45.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.591+0000 7fddba200640 1 -- 172.21.15.17:0/112661026 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb40fbed0 con 0x7fddb4105a60 2024-09-13T16:13:45.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.593+0000 7fddb0c00640 1 -- 172.21.15.17:0/112661026 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fddac042030 con 0x7fddb4105a60 2024-09-13T16:13:45.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.594+0000 7fddb0c00640 1 --2- 172.21.15.17:0/112661026 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdd980a1110 0x7fdd980a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:45.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.594+0000 7fddb0c00640 1 -- 172.21.15.17:0/112661026 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9086+0+0 (secure 0 0 0) 0x7fddac0ee1f0 con 0x7fddb4105a60 2024-09-13T16:13:45.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.595+0000 7fddb3400640 1 --2- 172.21.15.17:0/112661026 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdd980a1110 0x7fdd980a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:45.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.595+0000 7fddb3400640 1 --2- 172.21.15.17:0/112661026 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdd980a1110 0x7fdd980a35d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fdda4011500 tx=0x7fdda4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:45.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.596+0000 7fddb0c00640 1 -- 172.21.15.17:0/112661026 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fddac0b7660 con 0x7fddb4105a60 2024-09-13T16:13:45.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.814+0000 7fddba200640 1 -- 172.21.15.17:0/112661026 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fddb40fb940 con 0x7fddb4105a60 2024-09-13T16:13:45.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.840+0000 7fddb0c00640 1 -- 172.21.15.17:0/112661026 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) v1 ==== 161+0+0 (secure 0 0 0) 0x7fddac0bac80 con 0x7fddb4105a60 2024-09-13T16:13:45.841 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T16:13:45.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.842+0000 7fddba200640 1 -- 172.21.15.17:0/112661026 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdd980a1110 msgr2=0x7fdd980a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:45.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.842+0000 7fddba200640 1 --2- 172.21.15.17:0/112661026 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdd980a1110 0x7fdd980a35d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fdda4011500 tx=0x7fdda4005f90 comp rx=0 tx=0).stop 2024-09-13T16:13:45.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.843+0000 7fddba200640 1 -- 172.21.15.17:0/112661026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddb4105a60 msgr2=0x7fddb40fecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:45.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.843+0000 7fddba200640 1 --2- 172.21.15.17:0/112661026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddb4105a60 0x7fddb40fecf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fddac031b10 tx=0x7fddac032f20 comp rx=0 tx=0).stop 2024-09-13T16:13:45.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.843+0000 7fddba200640 1 -- 172.21.15.17:0/112661026 shutdown_connections 2024-09-13T16:13:45.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.843+0000 7fddba200640 1 --2- 172.21.15.17:0/112661026 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fdd980a1110 0x7fdd980a35d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.843+0000 7fddba200640 1 --2- 172.21.15.17:0/112661026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddb4105a60 0x7fddb40fecf0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.843+0000 7fddba200640 1 --2- 172.21.15.17:0/112661026 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddb4103130 0x7fddb40fe7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.843+0000 7fddba200640 1 --2- 172.21.15.17:0/112661026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb4100800 0x7fddb4100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:45.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.843+0000 7fddba200640 1 -- 172.21.15.17:0/112661026 >> 172.21.15.17:0/112661026 conn(0x7fddb40fa3e0 msgr2=0x7fddb4101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:45.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.843+0000 7fddba200640 1 -- 172.21.15.17:0/112661026 shutdown_connections 2024-09-13T16:13:45.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:45.843+0000 7fddba200640 1 -- 172.21.15.17:0/112661026 wait complete. 2024-09-13T16:13:45.862 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T16:13:46.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.025+0000 7fc71f400640 1 -- 172.21.15.17:0/947321833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc718107540 msgr2=0x7fc7181079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:46.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.025+0000 7fc71f400640 1 --2- 172.21.15.17:0/947321833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc718107540 0x7fc7181079c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc700009900 tx=0x7fc70002a3f0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.025+0000 7fc71f400640 1 -- 172.21.15.17:0/947321833 shutdown_connections 2024-09-13T16:13:46.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.025+0000 7fc71f400640 1 --2- 172.21.15.17:0/947321833 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc718107f00 0x7fc71810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.025+0000 7fc71f400640 1 --2- 172.21.15.17:0/947321833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc718107540 0x7fc7181079c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.025+0000 7fc71f400640 1 --2- 172.21.15.17:0/947321833 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc718106680 0x7fc718106a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.025+0000 7fc71f400640 1 -- 172.21.15.17:0/947321833 >> 172.21.15.17:0/947321833 conn(0x7fc718075510 msgr2=0x7fc718077970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:46.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.026+0000 7fc71f400640 1 -- 172.21.15.17:0/947321833 shutdown_connections 2024-09-13T16:13:46.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.026+0000 7fc71f400640 1 -- 172.21.15.17:0/947321833 wait complete. 2024-09-13T16:13:46.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.026+0000 7fc71f400640 1 Processor -- start 2024-09-13T16:13:46.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.027+0000 7fc71f400640 1 -- start start 2024-09-13T16:13:46.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.027+0000 7fc71f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc718106680 0x7fc71819c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:46.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.027+0000 7fc71f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc718107540 0x7fc71819c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:46.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.027+0000 7fc71f400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc718107f00 0x7fc7181a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:46.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.027+0000 7fc71f400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7181a3ed0 con 0x7fc718107540 2024-09-13T16:13:46.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.027+0000 7fc71f400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7181a4040 con 0x7fc718106680 2024-09-13T16:13:46.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.027+0000 7fc71f400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7181a4200 con 0x7fc718107f00 2024-09-13T16:13:46.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.027+0000 7fc70fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc718107540 0x7fc71819c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:46.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.027+0000 7fc70fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc718107540 0x7fc71819c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51814/0 (socket says 172.21.15.17:51814) 2024-09-13T16:13:46.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.027+0000 7fc70fe00640 1 -- 172.21.15.17:0/3392033100 learned_addr learned my addr 172.21.15.17:0/3392033100 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:13:46.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.027+0000 7fc71d400640 1 --2- 172.21.15.17:0/3392033100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc718107f00 0x7fc7181a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:46.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.028+0000 7fc70fe00640 1 -- 172.21.15.17:0/3392033100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc718107f00 msgr2=0x7fc7181a3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:46.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.028+0000 7fc70fe00640 1 --2- 172.21.15.17:0/3392033100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc718107f00 0x7fc7181a3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.028+0000 7fc70fe00640 1 -- 172.21.15.17:0/3392033100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc718106680 msgr2=0x7fc71819c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:46.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.028+0000 7fc70fe00640 1 --2- 172.21.15.17:0/3392033100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc718106680 0x7fc71819c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.028+0000 7fc70fe00640 1 -- 172.21.15.17:0/3392033100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc710009840 con 0x7fc718107540 2024-09-13T16:13:46.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.028+0000 7fc71d400640 1 --2- 172.21.15.17:0/3392033100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc718107f00 0x7fc7181a3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:13:46.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.028+0000 7fc70fe00640 1 --2- 172.21.15.17:0/3392033100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc718107540 0x7fc71819c920 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc700031500 tx=0x7fc700003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:46.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.028+0000 7fc716000640 1 -- 172.21.15.17:0/3392033100 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700005d50 con 0x7fc718107540 2024-09-13T16:13:46.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.028+0000 7fc716000640 1 -- 172.21.15.17:0/3392033100 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc700003e00 con 0x7fc718107540 2024-09-13T16:13:46.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.028+0000 7fc716000640 1 -- 172.21.15.17:0/3392033100 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70003bb50 con 0x7fc718107540 2024-09-13T16:13:46.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.028+0000 7fc71f400640 1 -- 172.21.15.17:0/3392033100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc700009560 con 0x7fc718107540 2024-09-13T16:13:46.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.028+0000 7fc71f400640 1 -- 172.21.15.17:0/3392033100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7181a4750 con 0x7fc718107540 2024-09-13T16:13:46.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.029+0000 7fc71f400640 1 -- 172.21.15.17:0/3392033100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc71810d910 con 0x7fc718107540 2024-09-13T16:13:46.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.031+0000 7fc716000640 1 -- 172.21.15.17:0/3392033100 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc70003bcb0 con 0x7fc718107540 2024-09-13T16:13:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.033+0000 7fc716000640 1 --2- 172.21.15.17:0/3392033100 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc6fc0a1110 0x7fc6fc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.033+0000 7fc716000640 1 -- 172.21.15.17:0/3392033100 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9344+0+0 (secure 0 0 0) 0x7fc7000eda20 con 0x7fc718107540 2024-09-13T16:13:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.033+0000 7fc71ca00640 1 --2- 172.21.15.17:0/3392033100 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc6fc0a1110 0x7fc6fc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:46.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.033+0000 7fc71ca00640 1 --2- 172.21.15.17:0/3392033100 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc6fc0a1110 0x7fc6fc0a35d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc7080058c0 tx=0x7fc708005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:46.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.034+0000 7fc716000640 1 -- 172.21.15.17:0/3392033100 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc7000b6d20 con 0x7fc718107540 2024-09-13T16:13:46.254 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 13 16:13:45 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-i[65798]: ignoring --setuser ceph since I am not root 2024-09-13T16:13:46.254 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 13 16:13:45 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-i[65798]: ignoring --setgroup ceph since I am not root 2024-09-13T16:13:46.255 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 13 16:13:45 smithi193 ceph-mds[65802]: -- 172.21.15.193:0/2835640097 <== mon.1 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c157b0cd00 con 0x55c157ae0800 2024-09-13T16:13:46.255 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 13 16:13:45 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-i[65798]: starting mds.i at 2024-09-13T16:13:46.255 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 13 16:13:45 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-c[65492]: ignoring --setuser ceph since I am not root 2024-09-13T16:13:46.255 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 13 16:13:45 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-c[65492]: ignoring --setgroup ceph since I am not root 2024-09-13T16:13:46.255 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 13 16:13:45 smithi193 ceph-mds[65496]: -- 172.21.15.193:0/3639429421 <== mon.1 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e9455ccd00 con 0x55e9455a1400 2024-09-13T16:13:46.255 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 13 16:13:45 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-c[65492]: starting mds.c at 2024-09-13T16:13:46.256 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:45 smithi193 ceph-mon[35248]: pgmap v865: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 KiB/s wr, 7 op/s 2024-09-13T16:13:46.256 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:45 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3746158102' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:13:46.256 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:45 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/2076503709' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:13:46.256 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:45 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/112661026' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T16:13:46.256 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:45 smithi193 ceph-mon[35248]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T16:13:46.256 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:45 smithi193 ceph-mon[35248]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T16:13:46.256 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:45 smithi193 ceph-mon[35248]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T16:13:46.256 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:45 smithi193 ceph-mon[35248]: osdmap e95: 12 total, 12 up, 12 in 2024-09-13T16:13:46.256 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:45 smithi193 ceph-mon[35248]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-13T16:13:46.256 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:45 smithi193 ceph-mon[35248]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-13T16:13:46.257 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 13 16:13:45 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-f[65189]: ignoring --setuser ceph since I am not root 2024-09-13T16:13:46.257 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 13 16:13:45 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-f[65189]: ignoring --setgroup ceph since I am not root 2024-09-13T16:13:46.257 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 13 16:13:45 smithi193 ceph-mds[65193]: -- 172.21.15.193:0/3801138326 <== mon.2 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ea2ee56d00 con 0x55ea2ee2a800 2024-09-13T16:13:46.257 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 13 16:13:45 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-f[65189]: starting mds.f at 2024-09-13T16:13:46.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.254+0000 7fc71f400640 1 -- 172.21.15.17:0/3392033100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc718111cc0 con 0x7fc718107540 2024-09-13T16:13:46.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:45 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-a[30490]: 2024-09-13T16:13:45.829+0000 7fedede00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T16:13:46.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:45 smithi017 ceph-mon[30494]: pgmap v865: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 KiB/s wr, 7 op/s 2024-09-13T16:13:46.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:45 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3746158102' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:13:46.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:45 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/2076503709' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:13:46.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:45 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/112661026' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T16:13:46.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:45 smithi017 ceph-mon[30494]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T16:13:46.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:45 smithi017 ceph-mon[30494]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T16:13:46.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:45 smithi017 ceph-mon[30494]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T16:13:46.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:45 smithi017 ceph-mon[30494]: osdmap e95: 12 total, 12 up, 12 in 2024-09-13T16:13:46.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:45 smithi017 ceph-mon[30494]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-13T16:13:46.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:45 smithi017 ceph-mon[30494]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-13T16:13:46.262 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 13 16:13:45 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-g[72089]: ignoring --setuser ceph since I am not root 2024-09-13T16:13:46.262 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 13 16:13:45 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-g[72089]: ignoring --setgroup ceph since I am not root 2024-09-13T16:13:46.262 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 13 16:13:45 smithi017 ceph-mds[72114]: -- 172.21.15.17:0/3037562388 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c3b85e6d00 con 0x55c3b85bb400 2024-09-13T16:13:46.262 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 13 16:13:45 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-g[72089]: starting mds.g at 2024-09-13T16:13:46.356 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 13 16:13:45 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-h[64705]: ignoring --setuser ceph since I am not root 2024-09-13T16:13:46.357 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 13 16:13:45 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-h[64705]: ignoring --setgroup ceph since I am not root 2024-09-13T16:13:46.357 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 13 16:13:45 smithi189 ceph-mds[64709]: -- 172.21.15.189:0/2846848677 <== mon.2 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55898dc58d00 con 0x55898dc2c800 2024-09-13T16:13:46.357 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 13 16:13:45 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-h[64705]: starting mds.h at 2024-09-13T16:13:46.357 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 13 16:13:45 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-b[65010]: ignoring --setuser ceph since I am not root 2024-09-13T16:13:46.357 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 13 16:13:45 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-b[65010]: ignoring --setgroup ceph since I am not root 2024-09-13T16:13:46.357 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 13 16:13:45 smithi189 ceph-mds[65014]: -- 172.21.15.189:0/1846349417 <== mon.2 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56341398ed00 con 0x563413963000 2024-09-13T16:13:46.357 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 13 16:13:45 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-b[65010]: starting mds.b at 2024-09-13T16:13:46.358 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:45 smithi189 ceph-mon[34790]: pgmap v865: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 KiB/s wr, 7 op/s 2024-09-13T16:13:46.358 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:45 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3746158102' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T16:13:46.358 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:45 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/2076503709' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T16:13:46.358 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:45 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/112661026' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T16:13:46.358 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:45 smithi189 ceph-mon[34790]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T16:13:46.358 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:45 smithi189 ceph-mon[34790]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T16:13:46.358 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:45 smithi189 ceph-mon[34790]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T16:13:46.358 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:45 smithi189 ceph-mon[34790]: osdmap e95: 12 total, 12 up, 12 in 2024-09-13T16:13:46.359 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:45 smithi189 ceph-mon[34790]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-13T16:13:46.359 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:45 smithi189 ceph-mon[34790]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-13T16:13:46.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.840+0000 7fc716000640 1 -- 172.21.15.17:0/3392033100 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc7000490a0 con 0x7fc718107540 2024-09-13T16:13:46.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.843+0000 7fc71f400640 1 -- 172.21.15.17:0/3392033100 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc6fc0a1110 msgr2=0x7fc6fc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:46.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.843+0000 7fc71f400640 1 --2- 172.21.15.17:0/3392033100 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc6fc0a1110 0x7fc6fc0a35d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc7080058c0 tx=0x7fc708005850 comp rx=0 tx=0).stop 2024-09-13T16:13:46.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.843+0000 7fc71f400640 1 -- 172.21.15.17:0/3392033100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc718107540 msgr2=0x7fc71819c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:46.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.843+0000 7fc71f400640 1 --2- 172.21.15.17:0/3392033100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc718107540 0x7fc71819c920 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc700031500 tx=0x7fc700003c10 comp rx=0 tx=0).stop 2024-09-13T16:13:46.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.843+0000 7fc71f400640 1 -- 172.21.15.17:0/3392033100 shutdown_connections 2024-09-13T16:13:46.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.843+0000 7fc71f400640 1 --2- 172.21.15.17:0/3392033100 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fc6fc0a1110 0x7fc6fc0a35d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.843+0000 7fc71f400640 1 --2- 172.21.15.17:0/3392033100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc718107f00 0x7fc7181a3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.843+0000 7fc71f400640 1 --2- 172.21.15.17:0/3392033100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc718107540 0x7fc71819c920 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.843+0000 7fc71f400640 1 --2- 172.21.15.17:0/3392033100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc718106680 0x7fc71819c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:46.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.843+0000 7fc71f400640 1 -- 172.21.15.17:0/3392033100 >> 172.21.15.17:0/3392033100 conn(0x7fc718075510 msgr2=0x7fc71810aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:46.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.843+0000 7fc71f400640 1 -- 172.21.15.17:0/3392033100 shutdown_connections 2024-09-13T16:13:46.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:46.843+0000 7fc71f400640 1 -- 172.21.15.17:0/3392033100 wait complete. 2024-09-13T16:13:46.863 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T16:13:47.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.029+0000 7fa65f200640 1 -- 172.21.15.17:0/4059859773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa660100ee0 msgr2=0x7fa660101360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.029+0000 7fa65f200640 1 --2- 172.21.15.17:0/4059859773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa660100ee0 0x7fa660101360 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa648009900 tx=0x7fa64802a3f0 comp rx=0 tx=0).stop 2024-09-13T16:13:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.029+0000 7fa65f200640 1 -- 172.21.15.17:0/4059859773 shutdown_connections 2024-09-13T16:13:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.029+0000 7fa65f200640 1 --2- 172.21.15.17:0/4059859773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6601018a0 0x7fa660108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.029+0000 7fa65f200640 1 --2- 172.21.15.17:0/4059859773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa660100ee0 0x7fa660101360 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.029+0000 7fa65f200640 1 --2- 172.21.15.17:0/4059859773 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa6600ffcf0 0x7fa6601000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.029+0000 7fa65f200640 1 -- 172.21.15.17:0/4059859773 >> 172.21.15.17:0/4059859773 conn(0x7fa6600fb450 msgr2=0x7fa6600fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.029+0000 7fa65f200640 1 -- 172.21.15.17:0/4059859773 shutdown_connections 2024-09-13T16:13:47.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.029+0000 7fa65f200640 1 -- 172.21.15.17:0/4059859773 wait complete. 2024-09-13T16:13:47.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.030+0000 7fa65f200640 1 Processor -- start 2024-09-13T16:13:47.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.030+0000 7fa65f200640 1 -- start start 2024-09-13T16:13:47.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.031+0000 7fa65f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6600ffcf0 0x7fa660074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:47.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.031+0000 7fa65f200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa660100ee0 0x7fa6600728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:47.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.031+0000 7fa65f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6601018a0 0x7fa660072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:47.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.031+0000 7fa65f200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa660073540 con 0x7fa6601018a0 2024-09-13T16:13:47.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.031+0000 7fa65f200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6600736b0 con 0x7fa6600ffcf0 2024-09-13T16:13:47.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.031+0000 7fa65f200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66019fcf0 con 0x7fa660100ee0 2024-09-13T16:13:47.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.031+0000 7fa65de00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6600ffcf0 0x7fa660074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:47.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.031+0000 7fa65e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6601018a0 0x7fa660072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:47.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.031+0000 7fa65de00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6600ffcf0 0x7fa660074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.17:42000/0 (socket says 172.21.15.17:42000) 2024-09-13T16:13:47.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.031+0000 7fa65de00640 1 -- 172.21.15.17:0/1765012888 learned_addr learned my addr 172.21.15.17:0/1765012888 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:13:47.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.031+0000 7fa655400640 1 --2- 172.21.15.17:0/1765012888 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa660100ee0 0x7fa6600728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:47.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.031+0000 7fa65de00640 1 -- 172.21.15.17:0/1765012888 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa660100ee0 msgr2=0x7fa6600728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:47.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.031+0000 7fa65de00640 1 --2- 172.21.15.17:0/1765012888 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa660100ee0 0x7fa6600728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:47.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.031+0000 7fa65de00640 1 -- 172.21.15.17:0/1765012888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6601018a0 msgr2=0x7fa660072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:47.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.031+0000 7fa65de00640 1 --2- 172.21.15.17:0/1765012888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6601018a0 0x7fa660072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:47.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.031+0000 7fa65de00640 1 -- 172.21.15.17:0/1765012888 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa648009560 con 0x7fa6600ffcf0 2024-09-13T16:13:47.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.031+0000 7fa655400640 1 --2- 172.21.15.17:0/1765012888 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa660100ee0 0x7fa6600728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:13:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.032+0000 7fa65de00640 1 --2- 172.21.15.17:0/1765012888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6600ffcf0 0x7fa660074260 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa65000e9f0 tx=0x7fa65000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.032+0000 7fa657400640 1 -- 172.21.15.17:0/1765012888 <== mon.2 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6500096e0 con 0x7fa6600ffcf0 2024-09-13T16:13:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.032+0000 7fa657400640 1 -- 172.21.15.17:0/1765012888 <== mon.2 v2:172.21.15.189:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa6500044f0 con 0x7fa6600ffcf0 2024-09-13T16:13:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.032+0000 7fa65f200640 1 -- 172.21.15.17:0/1765012888 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66019ffa0 con 0x7fa6600ffcf0 2024-09-13T16:13:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.032+0000 7fa657400640 1 -- 172.21.15.17:0/1765012888 <== mon.2 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650010430 con 0x7fa6600ffcf0 2024-09-13T16:13:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.032+0000 7fa65f200640 1 -- 172.21.15.17:0/1765012888 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6601a0370 con 0x7fa6600ffcf0 2024-09-13T16:13:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.033+0000 7fa65f200640 1 -- 172.21.15.17:0/1765012888 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa660107170 con 0x7fa6600ffcf0 2024-09-13T16:13:47.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.035+0000 7fa657400640 1 -- 172.21.15.17:0/1765012888 <== mon.2 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa650003fa0 con 0x7fa6600ffcf0 2024-09-13T16:13:47.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.036+0000 7fa657400640 1 --2- 172.21.15.17:0/1765012888 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa6440a1090 0x7fa6440a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:47.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.036+0000 7fa657400640 1 -- 172.21.15.17:0/1765012888 <== mon.2 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9344+0+0 (secure 0 0 0) 0x7fa650014070 con 0x7fa6600ffcf0 2024-09-13T16:13:47.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.037+0000 7fa655400640 1 --2- 172.21.15.17:0/1765012888 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa6440a1090 0x7fa6440a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:47.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.037+0000 7fa655400640 1 --2- 172.21.15.17:0/1765012888 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa6440a1090 0x7fa6440a3550 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa648000c00 tx=0x7fa648005760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:47.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.038+0000 7fa657400640 1 -- 172.21.15.17:0/1765012888 <== mon.2 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa650096520 con 0x7fa6600ffcf0 2024-09-13T16:13:47.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.219+0000 7fa65f200640 1 -- 172.21.15.17:0/1765012888 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa66010b5b0 con 0x7fa6600ffcf0 2024-09-13T16:13:47.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:46 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3392033100' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T16:13:47.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:46 smithi193 ceph-mon[35248]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T16:13:47.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:46 smithi193 ceph-mon[35248]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T16:13:47.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:46 smithi193 ceph-mon[35248]: Cluster is now healthy 2024-09-13T16:13:47.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:46 smithi193 ceph-mon[35248]: mds.? [v2:172.21.15.189:6836/2677084402,v1:172.21.15.189:6838/2677084402] up:boot 2024-09-13T16:13:47.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:46 smithi193 ceph-mon[35248]: mds.? [v2:172.21.15.189:6837/1204402327,v1:172.21.15.189:6839/1204402327] up:boot 2024-09-13T16:13:47.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:46 smithi193 ceph-mon[35248]: mds.? [v2:172.21.15.193:6834/1693850162,v1:172.21.15.193:6835/1693850162] up:boot 2024-09-13T16:13:47.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:46 smithi193 ceph-mon[35248]: mds.? [v2:172.21.15.193:6836/415590410,v1:172.21.15.193:6837/415590410] up:boot 2024-09-13T16:13:47.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:46 smithi193 ceph-mon[35248]: mds.? [v2:172.21.15.193:6838/1031386298,v1:172.21.15.193:6839/1031386298] up:boot 2024-09-13T16:13:47.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:46 smithi193 ceph-mon[35248]: mds.? [v2:172.21.15.17:6838/1155721375,v1:172.21.15.17:6839/1155721375] up:boot 2024-09-13T16:13:47.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:46 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3392033100' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-13T16:13:47.256 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:46 smithi193 ceph-mon[35248]: fsmap 12 up:standby 2024-09-13T16:13:47.256 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:46 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T16:13:47.256 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:46 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T16:13:47.256 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:46 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T16:13:47.256 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:46 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T16:13:47.256 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:46 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T16:13:47.256 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:46 smithi193 ceph-mon[35248]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T16:13:47.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:46 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3392033100' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T16:13:47.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:46 smithi017 ceph-mon[30494]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T16:13:47.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:46 smithi017 ceph-mon[30494]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T16:13:47.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:46 smithi017 ceph-mon[30494]: Cluster is now healthy 2024-09-13T16:13:47.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:46 smithi017 ceph-mon[30494]: mds.? [v2:172.21.15.189:6836/2677084402,v1:172.21.15.189:6838/2677084402] up:boot 2024-09-13T16:13:47.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:46 smithi017 ceph-mon[30494]: mds.? [v2:172.21.15.189:6837/1204402327,v1:172.21.15.189:6839/1204402327] up:boot 2024-09-13T16:13:47.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:46 smithi017 ceph-mon[30494]: mds.? [v2:172.21.15.193:6834/1693850162,v1:172.21.15.193:6835/1693850162] up:boot 2024-09-13T16:13:47.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:46 smithi017 ceph-mon[30494]: mds.? [v2:172.21.15.193:6836/415590410,v1:172.21.15.193:6837/415590410] up:boot 2024-09-13T16:13:47.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:46 smithi017 ceph-mon[30494]: mds.? [v2:172.21.15.193:6838/1031386298,v1:172.21.15.193:6839/1031386298] up:boot 2024-09-13T16:13:47.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:46 smithi017 ceph-mon[30494]: mds.? [v2:172.21.15.17:6838/1155721375,v1:172.21.15.17:6839/1155721375] up:boot 2024-09-13T16:13:47.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:46 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3392033100' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-13T16:13:47.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:46 smithi017 ceph-mon[30494]: fsmap 12 up:standby 2024-09-13T16:13:47.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T16:13:47.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T16:13:47.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T16:13:47.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T16:13:47.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T16:13:47.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:46 smithi017 ceph-mon[30494]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T16:13:47.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:46 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3392033100' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T16:13:47.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:46 smithi189 ceph-mon[34790]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T16:13:47.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:46 smithi189 ceph-mon[34790]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T16:13:47.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:46 smithi189 ceph-mon[34790]: Cluster is now healthy 2024-09-13T16:13:47.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:46 smithi189 ceph-mon[34790]: mds.? [v2:172.21.15.189:6836/2677084402,v1:172.21.15.189:6838/2677084402] up:boot 2024-09-13T16:13:47.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:46 smithi189 ceph-mon[34790]: mds.? [v2:172.21.15.189:6837/1204402327,v1:172.21.15.189:6839/1204402327] up:boot 2024-09-13T16:13:47.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:46 smithi189 ceph-mon[34790]: mds.? [v2:172.21.15.193:6834/1693850162,v1:172.21.15.193:6835/1693850162] up:boot 2024-09-13T16:13:47.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:46 smithi189 ceph-mon[34790]: mds.? [v2:172.21.15.193:6836/415590410,v1:172.21.15.193:6837/415590410] up:boot 2024-09-13T16:13:47.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:46 smithi189 ceph-mon[34790]: mds.? [v2:172.21.15.193:6838/1031386298,v1:172.21.15.193:6839/1031386298] up:boot 2024-09-13T16:13:47.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:46 smithi189 ceph-mon[34790]: mds.? [v2:172.21.15.17:6838/1155721375,v1:172.21.15.17:6839/1155721375] up:boot 2024-09-13T16:13:47.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:46 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3392033100' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-13T16:13:47.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:46 smithi189 ceph-mon[34790]: fsmap 12 up:standby 2024-09-13T16:13:47.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:46 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T16:13:47.357 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:46 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T16:13:47.358 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:46 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T16:13:47.358 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:46 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T16:13:47.358 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:46 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T16:13:47.358 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:46 smithi189 ceph-mon[34790]: from='mgr.14150 172.21.15.17:0/3059688275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T16:13:47.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.931+0000 7fa657400640 1 -- 172.21.15.17:0/1765012888 <== mon.2 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v96) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa650099b40 con 0x7fa6600ffcf0 2024-09-13T16:13:47.932 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-09-13T16:13:47.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.934+0000 7fa65f200640 1 -- 172.21.15.17:0/1765012888 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa6440a1090 msgr2=0x7fa6440a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:47.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.934+0000 7fa65f200640 1 --2- 172.21.15.17:0/1765012888 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa6440a1090 0x7fa6440a3550 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa648000c00 tx=0x7fa648005760 comp rx=0 tx=0).stop 2024-09-13T16:13:47.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.934+0000 7fa65f200640 1 -- 172.21.15.17:0/1765012888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6600ffcf0 msgr2=0x7fa660074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:47.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.934+0000 7fa65f200640 1 --2- 172.21.15.17:0/1765012888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6600ffcf0 0x7fa660074260 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa65000e9f0 tx=0x7fa65000eeb0 comp rx=0 tx=0).stop 2024-09-13T16:13:47.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.934+0000 7fa65f200640 1 -- 172.21.15.17:0/1765012888 shutdown_connections 2024-09-13T16:13:47.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.934+0000 7fa65f200640 1 --2- 172.21.15.17:0/1765012888 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7fa6440a1090 0x7fa6440a3550 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:47.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.934+0000 7fa65f200640 1 --2- 172.21.15.17:0/1765012888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6601018a0 0x7fa660072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:47.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.934+0000 7fa65f200640 1 --2- 172.21.15.17:0/1765012888 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa660100ee0 0x7fa6600728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:47.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.934+0000 7fa65f200640 1 --2- 172.21.15.17:0/1765012888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6600ffcf0 0x7fa660074260 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:47.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.934+0000 7fa65f200640 1 -- 172.21.15.17:0/1765012888 >> 172.21.15.17:0/1765012888 conn(0x7fa6600fb450 msgr2=0x7fa660104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:47.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.934+0000 7fa65f200640 1 -- 172.21.15.17:0/1765012888 shutdown_connections 2024-09-13T16:13:47.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:47.934+0000 7fa65f200640 1 -- 172.21.15.17:0/1765012888 wait complete. 2024-09-13T16:13:47.955 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T16:13:48.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.121+0000 7ff16e400640 1 -- 172.21.15.17:0/2300045754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff168103130 msgr2=0x7ff168105520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:48.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.121+0000 7ff16e400640 1 --2- 172.21.15.17:0/2300045754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff168103130 0x7ff168105520 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff154009900 tx=0x7ff15402a440 comp rx=0 tx=0).stop 2024-09-13T16:13:48.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.121+0000 7ff16e400640 1 -- 172.21.15.17:0/2300045754 shutdown_connections 2024-09-13T16:13:48.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.121+0000 7ff16e400640 1 --2- 172.21.15.17:0/2300045754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff168105a60 0x7ff168107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:48.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.121+0000 7ff16e400640 1 --2- 172.21.15.17:0/2300045754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff168103130 0x7ff168105520 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:48.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.121+0000 7ff16e400640 1 --2- 172.21.15.17:0/2300045754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff168100800 0x7ff168102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:48.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.121+0000 7ff16e400640 1 -- 172.21.15.17:0/2300045754 >> 172.21.15.17:0/2300045754 conn(0x7ff1680fa3e0 msgr2=0x7ff1680fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:48.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.121+0000 7ff16e400640 1 -- 172.21.15.17:0/2300045754 shutdown_connections 2024-09-13T16:13:48.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.121+0000 7ff16e400640 1 -- 172.21.15.17:0/2300045754 wait complete. 2024-09-13T16:13:48.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.122+0000 7ff16e400640 1 Processor -- start 2024-09-13T16:13:48.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.122+0000 7ff16e400640 1 -- start start 2024-09-13T16:13:48.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.123+0000 7ff16e400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff168100800 0x7ff168196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:48.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.123+0000 7ff16e400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff168103130 0x7ff168196550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:48.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.123+0000 7ff16e400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff168105a60 0x7ff16819d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:48.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.123+0000 7ff16e400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16819db00 con 0x7ff168103130 2024-09-13T16:13:48.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.123+0000 7ff16e400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16819dc70 con 0x7ff168105a60 2024-09-13T16:13:48.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.123+0000 7ff16e400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16819de30 con 0x7ff168100800 2024-09-13T16:13:48.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.123+0000 7ff166a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff168103130 0x7ff168196550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:48.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.123+0000 7ff166a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff168103130 0x7ff168196550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51860/0 (socket says 172.21.15.17:51860) 2024-09-13T16:13:48.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.123+0000 7ff166a00640 1 -- 172.21.15.17:0/1182832078 learned_addr learned my addr 172.21.15.17:0/1182832078 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:13:48.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.123+0000 7ff167400640 1 --2- 172.21.15.17:0/1182832078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff168100800 0x7ff168196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:48.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.123+0000 7ff167e00640 1 --2- 172.21.15.17:0/1182832078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff168105a60 0x7ff16819d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:48.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.123+0000 7ff166a00640 1 -- 172.21.15.17:0/1182832078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff168100800 msgr2=0x7ff168196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:48.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.123+0000 7ff166a00640 1 --2- 172.21.15.17:0/1182832078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff168100800 0x7ff168196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:48.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.123+0000 7ff166a00640 1 -- 172.21.15.17:0/1182832078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff168105a60 msgr2=0x7ff16819d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:48.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.123+0000 7ff166a00640 1 --2- 172.21.15.17:0/1182832078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff168105a60 0x7ff16819d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:48.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.123+0000 7ff166a00640 1 -- 172.21.15.17:0/1182832078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff154009560 con 0x7ff168103130 2024-09-13T16:13:48.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.123+0000 7ff167e00640 1 --2- 172.21.15.17:0/1182832078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff168105a60 0x7ff16819d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T16:13:48.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.124+0000 7ff166a00640 1 --2- 172.21.15.17:0/1182832078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff168103130 0x7ff168196550 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff15402aa30 tx=0x7ff154003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:48.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.124+0000 7ff15fe00640 1 -- 172.21.15.17:0/1182832078 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1540317b0 con 0x7ff168103130 2024-09-13T16:13:48.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.124+0000 7ff15fe00640 1 -- 172.21.15.17:0/1182832078 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff154031dd0 con 0x7ff168103130 2024-09-13T16:13:48.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.124+0000 7ff16e400640 1 -- 172.21.15.17:0/1182832078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff16819e0b0 con 0x7ff168103130 2024-09-13T16:13:48.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.124+0000 7ff15fe00640 1 -- 172.21.15.17:0/1182832078 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15403be60 con 0x7ff168103130 2024-09-13T16:13:48.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.124+0000 7ff16e400640 1 -- 172.21.15.17:0/1182832078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16819e630 con 0x7ff168103130 2024-09-13T16:13:48.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.125+0000 7ff16e400640 1 -- 172.21.15.17:0/1182832078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1680fbed0 con 0x7ff168103130 2024-09-13T16:13:48.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.127+0000 7ff15fe00640 1 -- 172.21.15.17:0/1182832078 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff15403b560 con 0x7ff168103130 2024-09-13T16:13:48.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.128+0000 7ff15fe00640 1 --2- 172.21.15.17:0/1182832078 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff14c0a1110 0x7ff14c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:48.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.128+0000 7ff15fe00640 1 -- 172.21.15.17:0/1182832078 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8819+0+0 (secure 0 0 0) 0x7ff1540ed660 con 0x7ff168103130 2024-09-13T16:13:48.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.128+0000 7ff167400640 1 --2- 172.21.15.17:0/1182832078 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff14c0a1110 0x7ff14c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:48.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.129+0000 7ff167400640 1 --2- 172.21.15.17:0/1182832078 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff14c0a1110 0x7ff14c0a35d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff158006fd0 tx=0x7ff1580090e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:48.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.132+0000 7ff15fe00640 1 -- 172.21.15.17:0/1182832078 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff1540b6b40 con 0x7ff168103130 2024-09-13T16:13:48.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:47 smithi193 ceph-mon[35248]: pgmap v867: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-13T16:13:48.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:47 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1765012888' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:48.255 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:47 smithi193 ceph-mon[35248]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:48.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:47 smithi017 ceph-mon[30494]: pgmap v867: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-13T16:13:48.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:47 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1765012888' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:48.262 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:47 smithi017 ceph-mon[30494]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:48.262 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:47 smithi189 ceph-mon[34790]: pgmap v867: 129 pgs: 129 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-13T16:13:48.262 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:47 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1765012888' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:48.262 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:47 smithi189 ceph-mon[34790]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:48.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.317+0000 7ff16e400640 1 -- 172.21.15.17:0/1182832078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff1680fb940 con 0x7ff168103130 2024-09-13T16:13:48.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.940+0000 7ff15fe00640 1 -- 172.21.15.17:0/1182832078 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v97) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff1540ba160 con 0x7ff168103130 2024-09-13T16:13:48.941 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-09-13T16:13:48.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.942+0000 7ff16e400640 1 -- 172.21.15.17:0/1182832078 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff14c0a1110 msgr2=0x7ff14c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:48.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.942+0000 7ff16e400640 1 --2- 172.21.15.17:0/1182832078 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff14c0a1110 0x7ff14c0a35d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff158006fd0 tx=0x7ff1580090e0 comp rx=0 tx=0).stop 2024-09-13T16:13:48.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.942+0000 7ff16e400640 1 -- 172.21.15.17:0/1182832078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff168103130 msgr2=0x7ff168196550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:48.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.942+0000 7ff16e400640 1 --2- 172.21.15.17:0/1182832078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff168103130 0x7ff168196550 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff15402aa30 tx=0x7ff154003c80 comp rx=0 tx=0).stop 2024-09-13T16:13:48.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.942+0000 7ff16e400640 1 -- 172.21.15.17:0/1182832078 shutdown_connections 2024-09-13T16:13:48.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.942+0000 7ff16e400640 1 --2- 172.21.15.17:0/1182832078 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7ff14c0a1110 0x7ff14c0a35d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:48.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.942+0000 7ff16e400640 1 --2- 172.21.15.17:0/1182832078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff168105a60 0x7ff16819d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:48.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.942+0000 7ff16e400640 1 --2- 172.21.15.17:0/1182832078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff168103130 0x7ff168196550 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:48.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.942+0000 7ff16e400640 1 --2- 172.21.15.17:0/1182832078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff168100800 0x7ff168196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:48.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.942+0000 7ff16e400640 1 -- 172.21.15.17:0/1182832078 >> 172.21.15.17:0/1182832078 conn(0x7ff1680fa3e0 msgr2=0x7ff168101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:48.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.942+0000 7ff16e400640 1 -- 172.21.15.17:0/1182832078 shutdown_connections 2024-09-13T16:13:48.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:48.943+0000 7ff16e400640 1 -- 172.21.15.17:0/1182832078 wait complete. 2024-09-13T16:13:48.960 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-13T16:13:49.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.123+0000 7f6d3f200640 1 -- 172.21.15.17:0/3876625676 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d40101ea0 msgr2=0x7f6d401022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:49.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.123+0000 7f6d3f200640 1 --2- 172.21.15.17:0/3876625676 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d40101ea0 0x7f6d401022a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009860 tx=0x7f6d3002a340 comp rx=0 tx=0).stop 2024-09-13T16:13:49.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.123+0000 7f6d3f200640 1 -- 172.21.15.17:0/3876625676 shutdown_connections 2024-09-13T16:13:49.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.123+0000 7f6d3f200640 1 --2- 172.21.15.17:0/3876625676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d40103a40 0x7f6d4010a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:49.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.123+0000 7f6d3f200640 1 --2- 172.21.15.17:0/3876625676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d40103080 0x7f6d40103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:49.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.123+0000 7f6d3f200640 1 --2- 172.21.15.17:0/3876625676 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d40101ea0 0x7f6d401022a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:49.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.123+0000 7f6d3f200640 1 -- 172.21.15.17:0/3876625676 >> 172.21.15.17:0/3876625676 conn(0x7f6d400fd670 msgr2=0x7f6d400ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:49.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.123+0000 7f6d3f200640 1 -- 172.21.15.17:0/3876625676 shutdown_connections 2024-09-13T16:13:49.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.123+0000 7f6d3f200640 1 -- 172.21.15.17:0/3876625676 wait complete. 2024-09-13T16:13:49.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.124+0000 7f6d3f200640 1 Processor -- start 2024-09-13T16:13:49.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.124+0000 7f6d3f200640 1 -- start start 2024-09-13T16:13:49.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.125+0000 7f6d3f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d40101ea0 0x7f6d40197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:49.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.125+0000 7f6d3f200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d40103080 0x7f6d40198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:49.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.125+0000 7f6d3f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d40103a40 0x7f6d4019f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:49.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.125+0000 7f6d3f200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4019fa20 con 0x7f6d40103a40 2024-09-13T16:13:49.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.125+0000 7f6d3f200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4019fb90 con 0x7f6d40101ea0 2024-09-13T16:13:49.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.125+0000 7f6d3f200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4019fd50 con 0x7f6d40103080 2024-09-13T16:13:49.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.125+0000 7f6d3e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d40103a40 0x7f6d4019f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.125+0000 7f6d3e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d40103a40 0x7f6d4019f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58866/0 (socket says 172.21.15.17:58866) 2024-09-13T16:13:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.125+0000 7f6d3e800640 1 -- 172.21.15.17:0/3552541898 learned_addr learned my addr 172.21.15.17:0/3552541898 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T16:13:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.125+0000 7f6d3de00640 1 --2- 172.21.15.17:0/3552541898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d40101ea0 0x7f6d40197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.125+0000 7f6d37e00640 1 --2- 172.21.15.17:0/3552541898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d40103080 0x7f6d40198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.125+0000 7f6d3e800640 1 -- 172.21.15.17:0/3552541898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d40103080 msgr2=0x7f6d40198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.125+0000 7f6d3e800640 1 --2- 172.21.15.17:0/3552541898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d40103080 0x7f6d40198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.125+0000 7f6d3e800640 1 -- 172.21.15.17:0/3552541898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d40101ea0 msgr2=0x7f6d40197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.125+0000 7f6d3e800640 1 --2- 172.21.15.17:0/3552541898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d40101ea0 0x7f6d40197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.125+0000 7f6d3e800640 1 -- 172.21.15.17:0/3552541898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d38009900 con 0x7f6d40103a40 2024-09-13T16:13:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.125+0000 7f6d37e00640 1 --2- 172.21.15.17:0/3552541898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d40103080 0x7f6d40198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T16:13:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.126+0000 7f6d3e800640 1 --2- 172.21.15.17:0/3552541898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d40103a40 0x7f6d4019f4e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800efc0 tx=0x7f6d3800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.126+0000 7f6d36a00640 1 -- 172.21.15.17:0/3552541898 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d38003970 con 0x7f6d40103a40 2024-09-13T16:13:49.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.126+0000 7f6d36a00640 1 -- 172.21.15.17:0/3552541898 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d38004020 con 0x7f6d40103a40 2024-09-13T16:13:49.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.126+0000 7f6d3f200640 1 -- 172.21.15.17:0/3552541898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d30009490 con 0x7f6d40103a40 2024-09-13T16:13:49.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.126+0000 7f6d36a00640 1 -- 172.21.15.17:0/3552541898 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3800b850 con 0x7f6d40103a40 2024-09-13T16:13:49.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.126+0000 7f6d3f200640 1 -- 172.21.15.17:0/3552541898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d401a02d0 con 0x7f6d40103a40 2024-09-13T16:13:49.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.127+0000 7f6d3f200640 1 -- 172.21.15.17:0/3552541898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d401094a0 con 0x7f6d40103a40 2024-09-13T16:13:49.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.129+0000 7f6d36a00640 1 -- 172.21.15.17:0/3552541898 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6d3800a040 con 0x7f6d40103a40 2024-09-13T16:13:49.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.130+0000 7f6d36a00640 1 --2- 172.21.15.17:0/3552541898 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6d240a1090 0x7f6d240a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T16:13:49.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.130+0000 7f6d36a00640 1 -- 172.21.15.17:0/3552541898 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8252+0+0 (secure 0 0 0) 0x7f6d380ccb00 con 0x7f6d40103a40 2024-09-13T16:13:49.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.130+0000 7f6d3de00640 1 --2- 172.21.15.17:0/3552541898 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6d240a1090 0x7f6d240a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T16:13:49.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.131+0000 7f6d3de00640 1 --2- 172.21.15.17:0/3552541898 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6d240a1090 0x7f6d240a3550 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6d30030410 tx=0x7f6d300305a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T16:13:49.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.134+0000 7f6d36a00640 1 -- 172.21.15.17:0/3552541898 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6d380cee60 con 0x7f6d40103a40 2024-09-13T16:13:49.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:48 smithi193 ceph-mon[35248]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T16:13:49.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:48 smithi193 ceph-mon[35248]: osdmap e96: 12 total, 12 up, 12 in 2024-09-13T16:13:49.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:48 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1182832078' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:49.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:48 smithi017 ceph-mon[30494]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T16:13:49.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:48 smithi017 ceph-mon[30494]: osdmap e96: 12 total, 12 up, 12 in 2024-09-13T16:13:49.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:48 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1182832078' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:49.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.338+0000 7f6d3f200640 1 -- 172.21.15.17:0/3552541898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6d40108f10 con 0x7f6d40103a40 2024-09-13T16:13:49.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:48 smithi189 ceph-mon[34790]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T16:13:49.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:48 smithi189 ceph-mon[34790]: osdmap e96: 12 total, 12 up, 12 in 2024-09-13T16:13:49.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:48 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1182832078' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:49.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.946+0000 7f6d36a00640 1 -- 172.21.15.17:0/3552541898 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v98) v1 ==== 178+0+0 (secure 0 0 0) 0x7f6d38096220 con 0x7f6d40103a40 2024-09-13T16:13:49.947 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data_ec' removed 2024-09-13T16:13:49.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.949+0000 7f6d3f200640 1 -- 172.21.15.17:0/3552541898 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6d240a1090 msgr2=0x7f6d240a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.949+0000 7f6d3f200640 1 --2- 172.21.15.17:0/3552541898 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6d240a1090 0x7f6d240a3550 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6d30030410 tx=0x7f6d300305a0 comp rx=0 tx=0).stop 2024-09-13T16:13:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.949+0000 7f6d3f200640 1 -- 172.21.15.17:0/3552541898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d40103a40 msgr2=0x7f6d4019f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T16:13:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.949+0000 7f6d3f200640 1 --2- 172.21.15.17:0/3552541898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d40103a40 0x7f6d4019f4e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800efc0 tx=0x7f6d3800c800 comp rx=0 tx=0).stop 2024-09-13T16:13:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.949+0000 7f6d3f200640 1 -- 172.21.15.17:0/3552541898 shutdown_connections 2024-09-13T16:13:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.949+0000 7f6d3f200640 1 --2- 172.21.15.17:0/3552541898 >> [v2:172.21.15.17:6800/1039314076,v1:172.21.15.17:6801/1039314076] conn(0x7f6d240a1090 0x7f6d240a3550 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.949+0000 7f6d3f200640 1 --2- 172.21.15.17:0/3552541898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d40103a40 0x7f6d4019f4e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.949+0000 7f6d3f200640 1 --2- 172.21.15.17:0/3552541898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d40103080 0x7f6d40198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.949+0000 7f6d3f200640 1 --2- 172.21.15.17:0/3552541898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d40101ea0 0x7f6d40197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T16:13:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.949+0000 7f6d3f200640 1 -- 172.21.15.17:0/3552541898 >> 172.21.15.17:0/3552541898 conn(0x7f6d400fd670 msgr2=0x7f6d40106670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T16:13:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.949+0000 7f6d3f200640 1 -- 172.21.15.17:0/3552541898 shutdown_connections 2024-09-13T16:13:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T16:13:49.949+0000 7f6d3f200640 1 -- 172.21.15.17:0/3552541898 wait complete. 2024-09-13T16:13:49.968 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T16:13:50.026 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T16:13:50.066 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T16:13:50.106 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-13T16:13:50.107 DEBUG:teuthology.orchestra.run.smithi017:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T16:13:50.142 DEBUG:teuthology.orchestra.run.smithi189:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T16:13:50.165 DEBUG:teuthology.orchestra.run.smithi193:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T16:13:50.180 INFO:tasks.cephadm:Stopping all daemons... 2024-09-13T16:13:50.181 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-13T16:13:50.181 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@mon.a 2024-09-13T16:13:50.230 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:49 smithi017 ceph-mon[30494]: pgmap v869: 97 pgs: 97 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:13:50.230 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:49 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/1182832078' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T16:13:50.230 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:49 smithi017 ceph-mon[30494]: osdmap e97: 12 total, 12 up, 12 in 2024-09-13T16:13:50.231 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:49 smithi017 ceph-mon[30494]: from='client.? 172.21.15.17:0/3552541898' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:50.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:49 smithi193 ceph-mon[35248]: pgmap v869: 97 pgs: 97 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:13:50.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:49 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/1182832078' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T16:13:50.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:49 smithi193 ceph-mon[35248]: osdmap e97: 12 total, 12 up, 12 in 2024-09-13T16:13:50.254 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:49 smithi193 ceph-mon[35248]: from='client.? 172.21.15.17:0/3552541898' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:50.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:49 smithi189 ceph-mon[34790]: pgmap v869: 97 pgs: 97 active+clean; 1.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T16:13:50.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:49 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/1182832078' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T16:13:50.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:49 smithi189 ceph-mon[34790]: osdmap e97: 12 total, 12 up, 12 in 2024-09-13T16:13:50.356 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:49 smithi189 ceph-mon[34790]: from='client.? 172.21.15.17:0/3552541898' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T16:13:50.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:50 smithi017 systemd[1]: Stopping Ceph mon.a for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:13:51.082 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:50 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-a[30490]: 2024-09-13T16:13:50.832+0000 7fedf4c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:13:51.083 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:50 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-a[30490]: 2024-09-13T16:13:50.832+0000 7fedf4c00640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-13T16:13:51.412 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:51 smithi017 podman[92820]: 2024-09-13 16:13:51.081369013 +0000 UTC m=+0.432870250 container died 14945298a9848fdf15ea3a380264236d33988d5dc2e5f6015fdb2494a21c2607 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T16:13:52.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:51 smithi017 podman[92820]: 2024-09-13 16:13:51.827907912 +0000 UTC m=+1.179409148 container cleanup 14945298a9848fdf15ea3a380264236d33988d5dc2e5f6015fdb2494a21c2607 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-13T16:13:52.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:51 smithi017 bash[92820]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-a 2024-09-13T16:13:52.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 13 16:13:52 smithi017 podman[92829]: 2024-09-13 16:13:52.285365338 +0000 UTC m=+1.191658492 container remove 14945298a9848fdf15ea3a380264236d33988d5dc2e5f6015fdb2494a21c2607 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-a, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:13:52.627 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mon.a.service' 2024-09-13T16:13:52.741 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:13:52.742 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-13T16:13:52.742 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-13T16:13:52.742 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@mon.b 2024-09-13T16:13:53.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:52 smithi189 systemd[1]: Stopping Ceph mon.b for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:13:53.606 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:53 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-b[34783]: 2024-09-13T16:13:53.300+0000 7f9e82b4f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:13:53.676 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:53 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-b[34783]: 2024-09-13T16:13:53.300+0000 7f9e82b4f640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-13T16:13:53.677 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:53 smithi189 podman[70259]: 2024-09-13 16:13:53.331360089 +0000 UTC m=+0.183694257 container died 57064e1ca85e84348d702d399fc8293fda8f622446e99840fc3168a73fe55c52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T16:13:54.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:53 smithi189 podman[70259]: 2024-09-13 16:13:53.7262949 +0000 UTC m=+0.578629055 container cleanup 57064e1ca85e84348d702d399fc8293fda8f622446e99840fc3168a73fe55c52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-b, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-13T16:13:54.106 INFO:journalctl@ceph.mon.b.smithi189.stdout:Sep 13 16:13:53 smithi189 bash[70259]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-b 2024-09-13T16:13:54.409 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mon.b.service' 2024-09-13T16:13:54.542 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:13:54.543 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-13T16:13:54.543 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-13T16:13:54.543 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@mon.c 2024-09-13T16:13:55.004 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:54 smithi193 systemd[1]: Stopping Ceph mon.c for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:13:55.453 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:55 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-c[35244]: 2024-09-13T16:13:55.035+0000 7fa896c78640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:13:55.453 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:55 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-c[35244]: 2024-09-13T16:13:55.035+0000 7fa896c78640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-13T16:13:55.453 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:55 smithi193 podman[71283]: 2024-09-13 16:13:55.137877046 +0000 UTC m=+0.233643261 container died 8652ef6e8fe5bca1044f46d1b05628926639eb1fc3b0c35468e1ad2142357288 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-c, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:13:55.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:55 smithi193 podman[71283]: 2024-09-13 16:13:55.552030785 +0000 UTC m=+0.647796991 container cleanup 8652ef6e8fe5bca1044f46d1b05628926639eb1fc3b0c35468e1ad2142357288 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-c, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T16:13:55.754 INFO:journalctl@ceph.mon.c.smithi193.stdout:Sep 13 16:13:55 smithi193 bash[71283]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-mon-c 2024-09-13T16:13:55.944 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mon.c.service' 2024-09-13T16:13:55.986 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:13:55.986 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-13T16:13:55.987 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-13T16:13:55.987 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@mgr.x 2024-09-13T16:13:56.430 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 16:13:56 smithi017 systemd[1]: Stopping Ceph mgr.x for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:13:56.761 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 16:13:56 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T16:13:56.427+0000 7f3c1aa00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:13:56.761 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 16:13:56 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x[30721]: 2024-09-13T16:13:56.427+0000 7f3c1aa00640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-13T16:13:56.761 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 16:13:56 smithi017 podman[92949]: 2024-09-13 16:13:56.511364356 +0000 UTC m=+0.232183323 container died 3d6d82a23b12c04fb00f5ba9ef69ef9b5635b3b7226c02c14e48fe46a440b0f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-13T16:13:57.708 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 16:13:57 smithi017 podman[92949]: 2024-09-13 16:13:57.442411841 +0000 UTC m=+1.163230815 container cleanup 3d6d82a23b12c04fb00f5ba9ef69ef9b5635b3b7226c02c14e48fe46a440b0f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, CEPH_POINT_RELEASE=) 2024-09-13T16:13:57.709 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 16:13:57 smithi017 bash[92949]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x 2024-09-13T16:13:57.961 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 13 16:13:57 smithi017 podman[92961]: 2024-09-13 16:13:57.707695654 +0000 UTC m=+1.187318336 container remove 3d6d82a23b12c04fb00f5ba9ef69ef9b5635b3b7226c02c14e48fe46a440b0f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50bbe7f395997dcd871813949c49addbbf630361, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True) 2024-09-13T16:13:57.981 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-13T16:13:58.058 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:13:58.058 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-13T16:13:58.058 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-13T16:13:58.058 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@mgr.y 2024-09-13T16:13:58.356 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 16:13:58 smithi189 systemd[1]: Stopping Ceph mgr.y for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:13:58.842 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 16:13:58 smithi189 podman[70381]: 2024-09-13 16:13:58.394197474 +0000 UTC m=+0.143525176 container died 7de588e4c513418a210aa618801c98cde3cc3d0b0b2e43c2c0f799141915d87f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:13:59.106 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 16:13:58 smithi189 podman[70381]: 2024-09-13 16:13:58.948995308 +0000 UTC m=+0.698323009 container cleanup 7de588e4c513418a210aa618801c98cde3cc3d0b0b2e43c2c0f799141915d87f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-13T16:13:59.106 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 13 16:13:58 smithi189 bash[70381]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-y 2024-09-13T16:13:59.381 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-13T16:13:59.417 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:13:59.418 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-13T16:13:59.418 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-13T16:13:59.418 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@mgr.z 2024-09-13T16:13:59.737 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 16:13:59 smithi193 systemd[1]: Stopping Ceph mgr.z for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:13:59.992 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 16:13:59 smithi193 podman[71406]: 2024-09-13 16:13:59.736151149 +0000 UTC m=+0.126539633 container died 6190eecc54c947d685a48f675a496487e4b4ca947e188903231200d046252fcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-13T16:14:00.254 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 16:14:00 smithi193 podman[71406]: 2024-09-13 16:14:00.090223527 +0000 UTC m=+0.480612011 container cleanup 6190eecc54c947d685a48f675a496487e4b4ca947e188903231200d046252fcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-13T16:14:00.254 INFO:journalctl@ceph.mgr.z.smithi193.stdout:Sep 13 16:14:00 smithi193 bash[71406]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-mgr-z 2024-09-13T16:14:00.570 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-13T16:14:00.605 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:14:00.605 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-13T16:14:00.605 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-13T16:14:00.605 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.0 2024-09-13T16:14:01.011 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 16:14:00 smithi017 systemd[1]: Stopping Ceph osd.0 for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:14:01.513 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 16:14:01 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-0[44912]: 2024-09-13T16:14:01.033+0000 7f8373800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:14:01.513 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 16:14:01 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-0[44912]: 2024-09-13T16:14:01.033+0000 7f8373800640 -1 osd.0 98 *** Got signal Terminated *** 2024-09-13T16:14:01.513 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 16:14:01 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-0[44912]: 2024-09-13T16:14:01.033+0000 7f8373800640 -1 osd.0 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:14:07.261 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 16:14:06 smithi017 podman[93070]: 2024-09-13 16:14:06.962345533 +0000 UTC m=+6.062478310 container died 7c94656ec2706e13f4d77817103ef8bfc58a94a33bfc0c22f4ee64641e76dbfb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:14:07.675 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 16:14:07 smithi017 podman[93070]: 2024-09-13 16:14:07.406215849 +0000 UTC m=+6.506348626 container cleanup 7c94656ec2706e13f4d77817103ef8bfc58a94a33bfc0c22f4ee64641e76dbfb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-13T16:14:07.675 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 16:14:07 smithi017 bash[93070]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-0 2024-09-13T16:14:08.011 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 16:14:07 smithi017 podman[93091]: 2024-09-13 16:14:07.674219096 +0000 UTC m=+0.693920691 container remove 7c94656ec2706e13f4d77817103ef8bfc58a94a33bfc0c22f4ee64641e76dbfb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-13T16:14:08.504 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 16:14:08 smithi017 podman[93175]: 2024-09-13 16:14:08.147458708 +0000 UTC m=+0.027445357 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:14:08.504 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 16:14:08 smithi017 podman[93175]: 2024-09-13 16:14:08.258576802 +0000 UTC m=+0.138563420 container create 4f49091aece9fcd4007d52295a0de115f1ab8a3b0d30d9f32b08eb1257cd1a20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-13T16:14:08.504 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 16:14:08 smithi017 podman[93175]: 2024-09-13 16:14:08.503704467 +0000 UTC m=+0.383691110 container init 4f49091aece9fcd4007d52295a0de115f1ab8a3b0d30d9f32b08eb1257cd1a20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-13T16:14:08.761 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 16:14:08 smithi017 podman[93175]: 2024-09-13 16:14:08.510866426 +0000 UTC m=+0.390853054 container start 4f49091aece9fcd4007d52295a0de115f1ab8a3b0d30d9f32b08eb1257cd1a20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-13T16:14:08.761 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 16:14:08 smithi017 podman[93175]: 2024-09-13 16:14:08.628697637 +0000 UTC m=+0.508684260 container attach 4f49091aece9fcd4007d52295a0de115f1ab8a3b0d30d9f32b08eb1257cd1a20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-13T16:14:09.248 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 13 16:14:08 smithi017 podman[93175]: 2024-09-13 16:14:08.912142504 +0000 UTC m=+0.792129126 container died 4f49091aece9fcd4007d52295a0de115f1ab8a3b0d30d9f32b08eb1257cd1a20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True) 2024-09-13T16:14:09.627 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.0.service' 2024-09-13T16:14:09.704 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:14:09.704 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-13T16:14:09.704 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-13T16:14:09.705 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.1 2024-09-13T16:14:10.022 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 16:14:09 smithi189 systemd[1]: Stopping Ceph osd.1 for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:14:10.356 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 16:14:10 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-1[39283]: 2024-09-13T16:14:10.020+0000 7f74f034d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:14:10.357 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 16:14:10 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-1[39283]: 2024-09-13T16:14:10.020+0000 7f74f034d640 -1 osd.1 98 *** Got signal Terminated *** 2024-09-13T16:14:10.357 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 16:14:10 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-1[39283]: 2024-09-13T16:14:10.020+0000 7f74f034d640 -1 osd.1 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:14:15.814 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 16:14:15 smithi189 podman[70517]: 2024-09-13 16:14:15.494446487 +0000 UTC m=+5.596529509 container died 21b3d4764a2dc1eafbb6d7be1bcbdb82910480dbb66d8db25c3b0706e7cb57a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-1, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-13T16:14:16.106 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 16:14:15 smithi189 podman[70517]: 2024-09-13 16:14:15.912882395 +0000 UTC m=+6.014965409 container cleanup 21b3d4764a2dc1eafbb6d7be1bcbdb82910480dbb66d8db25c3b0706e7cb57a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-13T16:14:16.106 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 16:14:15 smithi189 bash[70517]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-1 2024-09-13T16:14:16.585 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 16:14:16 smithi189 podman[70533]: 2024-09-13 16:14:16.172895804 +0000 UTC m=+0.675392532 container remove 21b3d4764a2dc1eafbb6d7be1bcbdb82910480dbb66d8db25c3b0706e7cb57a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True) 2024-09-13T16:14:16.856 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 16:14:16 smithi189 podman[70626]: 2024-09-13 16:14:16.487085747 +0000 UTC m=+0.015942510 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:14:16.856 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 16:14:16 smithi189 podman[70626]: 2024-09-13 16:14:16.623887758 +0000 UTC m=+0.152744573 container create 73bfd811ff9b1531cf0031e4b419622d8d397d221cdf087e895c346649a864bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-13T16:14:17.117 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 16:14:16 smithi189 podman[70626]: 2024-09-13 16:14:16.885059114 +0000 UTC m=+0.413915857 container init 73bfd811ff9b1531cf0031e4b419622d8d397d221cdf087e895c346649a864bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T16:14:17.118 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 16:14:16 smithi189 podman[70626]: 2024-09-13 16:14:16.88833108 +0000 UTC m=+0.417187822 container start 73bfd811ff9b1531cf0031e4b419622d8d397d221cdf087e895c346649a864bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:14:17.118 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 16:14:16 smithi189 podman[70626]: 2024-09-13 16:14:16.976739191 +0000 UTC m=+0.505595956 container attach 73bfd811ff9b1531cf0031e4b419622d8d397d221cdf087e895c346649a864bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-13T16:14:17.464 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 13 16:14:17 smithi189 podman[70626]: 2024-09-13 16:14:17.117215785 +0000 UTC m=+0.646072528 container died 73bfd811ff9b1531cf0031e4b419622d8d397d221cdf087e895c346649a864bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-13T16:14:17.798 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.1.service' 2024-09-13T16:14:17.839 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:14:17.840 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-13T16:14:17.840 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-13T16:14:17.840 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.2 2024-09-13T16:14:18.162 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 16:14:17 smithi193 systemd[1]: Stopping Ceph osd.2 for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:14:18.504 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 16:14:18 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-2[40266]: 2024-09-13T16:14:18.160+0000 7f28234fb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:14:18.504 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 16:14:18 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-2[40266]: 2024-09-13T16:14:18.160+0000 7f28234fb640 -1 osd.2 98 *** Got signal Terminated *** 2024-09-13T16:14:18.504 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 16:14:18 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-2[40266]: 2024-09-13T16:14:18.160+0000 7f28234fb640 -1 osd.2 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:14:24.104 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 16:14:23 smithi193 podman[71543]: 2024-09-13 16:14:23.802513495 +0000 UTC m=+5.756440106 container died 261ff178af76d85e9386024956287315a0798ed96cd197eedc0c4e032074d0bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-13T16:14:24.455 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 16:14:24 smithi193 podman[71543]: 2024-09-13 16:14:24.185128769 +0000 UTC m=+6.139055365 container cleanup 261ff178af76d85e9386024956287315a0798ed96cd197eedc0c4e032074d0bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2) 2024-09-13T16:14:24.455 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 16:14:24 smithi193 bash[71543]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-2 2024-09-13T16:14:24.754 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 16:14:24 smithi193 podman[71558]: 2024-09-13 16:14:24.453376954 +0000 UTC m=+0.647285653 container remove 261ff178af76d85e9386024956287315a0798ed96cd197eedc0c4e032074d0bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2) 2024-09-13T16:14:25.090 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 16:14:24 smithi193 podman[71647]: 2024-09-13 16:14:24.692592847 +0000 UTC m=+0.016169425 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:14:25.091 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 16:14:24 smithi193 podman[71647]: 2024-09-13 16:14:24.829302039 +0000 UTC m=+0.152878598 container create aa189814caeaa435e84a09f6576c280a3247f71621f23a045b6ce458b03d0ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T16:14:25.350 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 16:14:25 smithi193 podman[71647]: 2024-09-13 16:14:25.090241669 +0000 UTC m=+0.413818232 container init aa189814caeaa435e84a09f6576c280a3247f71621f23a045b6ce458b03d0ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-13T16:14:25.350 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 16:14:25 smithi193 podman[71647]: 2024-09-13 16:14:25.09377079 +0000 UTC m=+0.417347349 container start aa189814caeaa435e84a09f6576c280a3247f71621f23a045b6ce458b03d0ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-13T16:14:25.350 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 16:14:25 smithi193 podman[71647]: 2024-09-13 16:14:25.181886106 +0000 UTC m=+0.505462666 container attach aa189814caeaa435e84a09f6576c280a3247f71621f23a045b6ce458b03d0ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-13T16:14:25.662 INFO:journalctl@ceph.osd.2.smithi193.stdout:Sep 13 16:14:25 smithi193 podman[71671]: 2024-09-13 16:14:25.37895975 +0000 UTC m=+0.017075416 container died aa189814caeaa435e84a09f6576c280a3247f71621f23a045b6ce458b03d0ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-13T16:14:25.935 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.2.service' 2024-09-13T16:14:25.976 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:14:25.976 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-13T16:14:25.976 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-13T16:14:25.976 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.3 2024-09-13T16:14:26.415 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 13 16:14:26 smithi017 systemd[1]: Stopping Ceph osd.3 for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:14:26.761 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 13 16:14:26 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-3[51777]: 2024-09-13T16:14:26.412+0000 7feb1ac00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:14:26.761 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 13 16:14:26 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-3[51777]: 2024-09-13T16:14:26.412+0000 7feb1ac00640 -1 osd.3 98 *** Got signal Terminated *** 2024-09-13T16:14:26.761 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 13 16:14:26 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-3[51777]: 2024-09-13T16:14:26.412+0000 7feb1ac00640 -1 osd.3 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:14:28.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:27 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:27.963+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:28.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:28 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:28.034+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:29.011 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 13 16:14:28 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-3[51777]: 2024-09-13T16:14:28.608+0000 7feb11600640 -1 osd.3 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:05.640547+0000 front 2024-09-13T16:14:05.640525+0000 (oldest deadline 2024-09-13T16:14:28.441864+0000) 2024-09-13T16:14:29.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:28 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:28.922+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:29.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:29 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:29.079+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:30.011 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 13 16:14:29 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-3[51777]: 2024-09-13T16:14:29.615+0000 7feb11600640 -1 osd.3 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:05.640547+0000 front 2024-09-13T16:14:05.640525+0000 (oldest deadline 2024-09-13T16:14:28.441864+0000) 2024-09-13T16:14:30.011 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:29 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:29.779+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:30.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:29 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:29.905+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:30.423 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:30 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:30.075+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:30.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:30 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:30.422+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:30.754 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:30 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:30.649+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:05.588908+0000 front 2024-09-13T16:14:05.588955+0000 (oldest deadline 2024-09-13T16:14:30.288964+0000) 2024-09-13T16:14:31.011 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 13 16:14:30 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-3[51777]: 2024-09-13T16:14:30.658+0000 7feb11600640 -1 osd.3 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:05.640547+0000 front 2024-09-13T16:14:05.640525+0000 (oldest deadline 2024-09-13T16:14:28.441864+0000) 2024-09-13T16:14:31.011 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:30 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:30.762+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:31.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:30 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:30.916+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:31.465 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:31 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:31.070+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:31.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:31 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:31.464+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:31.754 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:31 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:31.651+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:05.588908+0000 front 2024-09-13T16:14:05.588955+0000 (oldest deadline 2024-09-13T16:14:30.288964+0000) 2024-09-13T16:14:32.011 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:31 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:31.735+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:32.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:31 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:31.903+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:32.439 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:32 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:32.036+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:32.600 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 13 16:14:32 smithi017 podman[93272]: 2024-09-13 16:14:32.263780802 +0000 UTC m=+5.985594564 container died 05b49605f9610238d0c1b0543c559ded484709c94454896945936c83d3fb148c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=) 2024-09-13T16:14:32.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:32 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:32.438+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:32.754 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:32 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:32.688+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:05.588908+0000 front 2024-09-13T16:14:05.588955+0000 (oldest deadline 2024-09-13T16:14:30.288964+0000) 2024-09-13T16:14:32.937 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 13 16:14:32 smithi017 podman[93272]: 2024-09-13 16:14:32.734761116 +0000 UTC m=+6.456574887 container cleanup 05b49605f9610238d0c1b0543c559ded484709c94454896945936c83d3fb148c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-13T16:14:32.937 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 13 16:14:32 smithi017 bash[93272]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-3 2024-09-13T16:14:32.937 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:32 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:32.706+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:33.261 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 13 16:14:32 smithi017 podman[93303]: 2024-09-13 16:14:32.936327643 +0000 UTC m=+0.661074727 container remove 05b49605f9610238d0c1b0543c559ded484709c94454896945936c83d3fb148c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-13T16:14:33.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:32 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:32.889+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:33.413 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:33 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:33.033+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:33.751 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 13 16:14:33 smithi017 podman[93387]: 2024-09-13 16:14:33.403743264 +0000 UTC m=+0.027818007 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:14:33.751 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 13 16:14:33 smithi017 podman[93387]: 2024-09-13 16:14:33.545666089 +0000 UTC m=+0.169740829 container create a7ca7f1ce2f70a4de3ac575e0ff58a3b4ff645f00e5af2b091c71b80a7124d5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-09-13T16:14:33.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:33 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:33.412+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:33.754 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:33 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:33.654+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:05.588908+0000 front 2024-09-13T16:14:05.588955+0000 (oldest deadline 2024-09-13T16:14:30.288964+0000) 2024-09-13T16:14:34.011 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:33 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:33.749+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:34.011 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 13 16:14:33 smithi017 podman[93387]: 2024-09-13 16:14:33.815088182 +0000 UTC m=+0.439162926 container init a7ca7f1ce2f70a4de3ac575e0ff58a3b4ff645f00e5af2b091c71b80a7124d5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-13T16:14:34.012 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 13 16:14:33 smithi017 podman[93387]: 2024-09-13 16:14:33.8219709 +0000 UTC m=+0.446045643 container start a7ca7f1ce2f70a4de3ac575e0ff58a3b4ff645f00e5af2b091c71b80a7124d5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2) 2024-09-13T16:14:34.012 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 13 16:14:33 smithi017 podman[93387]: 2024-09-13 16:14:33.906681188 +0000 UTC m=+0.530755943 container attach a7ca7f1ce2f70a4de3ac575e0ff58a3b4ff645f00e5af2b091c71b80a7124d5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-13T16:14:34.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:33 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:33.927+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:34.413 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:34 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:34.039+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:34.418 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 13 16:14:34 smithi017 podman[93387]: 2024-09-13 16:14:34.082762382 +0000 UTC m=+0.706837125 container died a7ca7f1ce2f70a4de3ac575e0ff58a3b4ff645f00e5af2b091c71b80a7124d5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-13T16:14:34.705 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:34 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:34.412+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:34.792 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.3.service' 2024-09-13T16:14:34.869 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:14:34.870 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-13T16:14:34.870 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-13T16:14:34.870 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.4 2024-09-13T16:14:35.004 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:34 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:34.703+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:05.588908+0000 front 2024-09-13T16:14:05.588955+0000 (oldest deadline 2024-09-13T16:14:30.288964+0000) 2024-09-13T16:14:35.218 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 13 16:14:34 smithi189 systemd[1]: Stopping Ceph osd.4 for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:14:35.218 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:34 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:34.975+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:35.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:34 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:34.783+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:35.410 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:35 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:35.078+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:35.606 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 13 16:14:35 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-4[46014]: 2024-09-13T16:14:35.216+0000 7fb7bba0a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:14:35.606 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 13 16:14:35 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-4[46014]: 2024-09-13T16:14:35.216+0000 7fb7bba0a640 -1 osd.4 98 *** Got signal Terminated *** 2024-09-13T16:14:35.606 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 13 16:14:35 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-4[46014]: 2024-09-13T16:14:35.216+0000 7fb7bba0a640 -1 osd.4 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:14:35.727 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:35 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:35.409+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:36.004 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:35 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:35.726+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:05.588908+0000 front 2024-09-13T16:14:05.588955+0000 (oldest deadline 2024-09-13T16:14:30.288964+0000) 2024-09-13T16:14:36.011 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:35 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:35.764+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:36.011 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:35 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:35.749+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.353359+0000 front 2024-09-13T16:14:13.353246+0000 (oldest deadline 2024-09-13T16:14:35.653228+0000) 2024-09-13T16:14:36.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:35 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:35.937+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:36.377 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:36 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:36.109+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:36.684 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:36 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:36.375+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:37.004 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:36 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:36.682+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:05.588908+0000 front 2024-09-13T16:14:05.588955+0000 (oldest deadline 2024-09-13T16:14:30.288964+0000) 2024-09-13T16:14:37.011 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:36 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:36.785+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:37.011 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:36 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:36.721+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.353359+0000 front 2024-09-13T16:14:13.353246+0000 (oldest deadline 2024-09-13T16:14:35.653228+0000) 2024-09-13T16:14:37.272 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:37 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:37.123+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:37.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:36 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:36.965+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:37.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:36 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:36.965+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:37.635 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:37 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:37.360+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:38.004 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:37 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:37.633+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:05.588908+0000 front 2024-09-13T16:14:05.588955+0000 (oldest deadline 2024-09-13T16:14:30.288964+0000) 2024-09-13T16:14:38.011 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:37 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:37.758+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.353359+0000 front 2024-09-13T16:14:13.353246+0000 (oldest deadline 2024-09-13T16:14:35.653228+0000) 2024-09-13T16:14:38.011 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:37 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:37.784+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:38.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:37 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:37.994+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:38.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:37 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:37.994+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:38.504 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:38 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:38.408+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:38.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:38 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:38.170+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:39.004 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:38 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:38.683+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:05.588908+0000 front 2024-09-13T16:14:05.588955+0000 (oldest deadline 2024-09-13T16:14:30.288964+0000) 2024-09-13T16:14:39.106 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 13 16:14:38 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-4[46014]: 2024-09-13T16:14:38.833+0000 7fb7b801e640 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.668998+0000 front 2024-09-13T16:14:13.668972+0000 (oldest deadline 2024-09-13T16:14:38.369130+0000) 2024-09-13T16:14:39.106 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:38 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:38.984+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:39.107 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:38 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:38.984+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:39.261 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:38 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:38.773+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.353359+0000 front 2024-09-13T16:14:13.353246+0000 (oldest deadline 2024-09-13T16:14:35.653228+0000) 2024-09-13T16:14:39.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:38 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:38.814+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:39.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:38 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:38.814+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:14:39.429 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:39 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:39.153+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:39.689 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:39 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:39.427+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:40.004 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:39 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:39.687+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:05.588908+0000 front 2024-09-13T16:14:05.588955+0000 (oldest deadline 2024-09-13T16:14:30.288964+0000) 2024-09-13T16:14:40.261 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:39 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:39.780+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.353359+0000 front 2024-09-13T16:14:13.353246+0000 (oldest deadline 2024-09-13T16:14:35.653228+0000) 2024-09-13T16:14:40.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:39 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:39.858+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:40.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:39 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:39.858+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:14:40.356 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 13 16:14:39 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-4[46014]: 2024-09-13T16:14:39.866+0000 7fb7b801e640 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.668998+0000 front 2024-09-13T16:14:13.668972+0000 (oldest deadline 2024-09-13T16:14:38.369130+0000) 2024-09-13T16:14:40.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:40 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:40.028+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:40.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:40 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:40.028+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:40.444 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:40 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:40.141+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:40.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:40 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:40.443+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:40.755 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:40 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:40.656+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:05.588908+0000 front 2024-09-13T16:14:05.588955+0000 (oldest deadline 2024-09-13T16:14:30.288964+0000) 2024-09-13T16:14:40.900 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:40 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:40.820+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.353359+0000 front 2024-09-13T16:14:13.353246+0000 (oldest deadline 2024-09-13T16:14:35.653228+0000) 2024-09-13T16:14:41.210 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 13 16:14:40 smithi189 podman[70732]: 2024-09-13 16:14:40.865365052 +0000 UTC m=+5.800182786 container died 625bb6080eef4f686d681e6b1a35eeb7340cd160fd22908ad0b73684c13f7541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-13T16:14:41.211 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:41 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:41.001+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:41.211 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:41 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:41.001+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:41.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:40 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:40.898+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:41.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:40 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:40.898+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:14:41.477 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:41 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:41.159+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:41.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:41 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:41.323+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:14:41.607 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 13 16:14:41 smithi189 podman[70732]: 2024-09-13 16:14:41.309183611 +0000 UTC m=+6.244001345 container cleanup 625bb6080eef4f686d681e6b1a35eeb7340cd160fd22908ad0b73684c13f7541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:14:41.607 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 13 16:14:41 smithi189 bash[70732]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-4 2024-09-13T16:14:41.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:41 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:41.475+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:41.754 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:41 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:41.705+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:05.588908+0000 front 2024-09-13T16:14:05.588955+0000 (oldest deadline 2024-09-13T16:14:30.288964+0000) 2024-09-13T16:14:41.755 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:41 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:41.705+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:11.890769+0000 front 2024-09-13T16:14:11.890824+0000 (oldest deadline 2024-09-13T16:14:40.691511+0000) 2024-09-13T16:14:41.945 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 13 16:14:41 smithi189 podman[70748]: 2024-09-13 16:14:41.635577341 +0000 UTC m=+0.769138743 container remove 625bb6080eef4f686d681e6b1a35eeb7340cd160fd22908ad0b73684c13f7541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-13T16:14:42.231 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 13 16:14:41 smithi189 podman[70839]: 2024-09-13 16:14:41.944751017 +0000 UTC m=+0.111543663 container create fc64041d1fab6205945279ce485332762b8ab26658d6bb4f5e51b0b8f7272898 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-13T16:14:42.232 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 13 16:14:41 smithi189 podman[70839]: 2024-09-13 16:14:41.849051457 +0000 UTC m=+0.015844125 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:14:42.232 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:41 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:41.986+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:42.232 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:41 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:41.986+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:42.261 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:41 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:41.785+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.353359+0000 front 2024-09-13T16:14:13.353246+0000 (oldest deadline 2024-09-13T16:14:35.653228+0000) 2024-09-13T16:14:42.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:41 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:41.945+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:42.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:41 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:41.945+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:14:42.438 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:42 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:42.163+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:42.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:42 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:42.275+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:14:42.607 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 13 16:14:42 smithi189 podman[70839]: 2024-09-13 16:14:42.230794417 +0000 UTC m=+0.397587064 container init fc64041d1fab6205945279ce485332762b8ab26658d6bb4f5e51b0b8f7272898 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-13T16:14:42.607 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 13 16:14:42 smithi189 podman[70839]: 2024-09-13 16:14:42.234120493 +0000 UTC m=+0.400913148 container start fc64041d1fab6205945279ce485332762b8ab26658d6bb4f5e51b0b8f7272898 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T16:14:42.607 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 13 16:14:42 smithi189 podman[70839]: 2024-09-13 16:14:42.339189154 +0000 UTC m=+0.505981817 container attach fc64041d1fab6205945279ce485332762b8ab26658d6bb4f5e51b0b8f7272898 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T16:14:42.607 INFO:journalctl@ceph.osd.4.smithi189.stdout:Sep 13 16:14:42 smithi189 podman[70862]: 2024-09-13 16:14:42.445960242 +0000 UTC m=+0.017008208 container died fc64041d1fab6205945279ce485332762b8ab26658d6bb4f5e51b0b8f7272898 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-13T16:14:42.700 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:42 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:42.435+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:43.004 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:42 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:42.699+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:05.588908+0000 front 2024-09-13T16:14:05.588955+0000 (oldest deadline 2024-09-13T16:14:30.288964+0000) 2024-09-13T16:14:43.004 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:42 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:42.699+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:11.890769+0000 front 2024-09-13T16:14:11.890824+0000 (oldest deadline 2024-09-13T16:14:40.691511+0000) 2024-09-13T16:14:43.011 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:42 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:42.746+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.353359+0000 front 2024-09-13T16:14:13.353246+0000 (oldest deadline 2024-09-13T16:14:35.653228+0000) 2024-09-13T16:14:43.011 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:42 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:42.968+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:43.011 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:42 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:42.968+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:14:43.079 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.4.service' 2024-09-13T16:14:43.121 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:14:43.122 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-13T16:14:43.122 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-13T16:14:43.122 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.5 2024-09-13T16:14:43.311 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:42 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:42.996+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:43.312 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:42 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:42.996+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:43.447 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:43 smithi193 systemd[1]: Stopping Ceph osd.5 for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:14:43.448 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:43 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:43.172+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:43.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:43 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:43.310+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:14:43.708 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:43 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:43.472+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:43.708 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:43 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:43.445+0000 7f4fd15c3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:14:43.708 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:43 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:43.445+0000 7f4fd15c3640 -1 osd.5 98 *** Got signal Terminated *** 2024-09-13T16:14:43.708 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:43 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:43.445+0000 7f4fd15c3640 -1 osd.5 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:14:43.709 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:43 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:43.706+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:05.588908+0000 front 2024-09-13T16:14:05.588955+0000 (oldest deadline 2024-09-13T16:14:30.288964+0000) 2024-09-13T16:14:44.004 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:43 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:43.706+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:11.890769+0000 front 2024-09-13T16:14:11.890824+0000 (oldest deadline 2024-09-13T16:14:40.691511+0000) 2024-09-13T16:14:44.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:43.943+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:44.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:43.943+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:14:44.262 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:43 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:43.787+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.353359+0000 front 2024-09-13T16:14:13.353246+0000 (oldest deadline 2024-09-13T16:14:35.653228+0000) 2024-09-13T16:14:44.341 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:43 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:43.982+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:44.341 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:43 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:43.982+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:44.497 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:44 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:44.126+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:44.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:44 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:44.340+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:14:44.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:44 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:44.496+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:44.755 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:44 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:44.713+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:05.588908+0000 front 2024-09-13T16:14:05.588955+0000 (oldest deadline 2024-09-13T16:14:30.288964+0000) 2024-09-13T16:14:44.755 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:44 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:44.713+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:11.890769+0000 front 2024-09-13T16:14:11.890824+0000 (oldest deadline 2024-09-13T16:14:40.691511+0000) 2024-09-13T16:14:45.261 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:44 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:44.804+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.353359+0000 front 2024-09-13T16:14:13.353246+0000 (oldest deadline 2024-09-13T16:14:35.653228+0000) 2024-09-13T16:14:45.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:44 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:44.985+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:45.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:44 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:44.985+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:14:45.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:44 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:44.985+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:14:45.299 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:44 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:44.968+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:45.299 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:44 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:44.968+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:45.499 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:45 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:45.088+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:45.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:45 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:45.297+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:14:45.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:45 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:45.498+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:45.754 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:45 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:45.702+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:05.588908+0000 front 2024-09-13T16:14:05.588955+0000 (oldest deadline 2024-09-13T16:14:30.288964+0000) 2024-09-13T16:14:45.754 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:45 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:45.702+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:11.890769+0000 front 2024-09-13T16:14:11.890824+0000 (oldest deadline 2024-09-13T16:14:40.691511+0000) 2024-09-13T16:14:46.261 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:45 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:45.793+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.353359+0000 front 2024-09-13T16:14:13.353246+0000 (oldest deadline 2024-09-13T16:14:35.653228+0000) 2024-09-13T16:14:46.261 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:45 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:45.793+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.154965+0000 front 2024-09-13T16:14:19.155291+0000 (oldest deadline 2024-09-13T16:14:45.055088+0000) 2024-09-13T16:14:46.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:45 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:45.954+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:46.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:45 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:45.954+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:14:46.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:45 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:45.954+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:14:46.316 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:45 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:45.921+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:46.316 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:45 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:45.921+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:46.316 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:45 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:45.921+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:14:46.471 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:46 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:46.115+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:46.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:46 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:46.314+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:14:46.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:46 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:46.314+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:20.696908+0000 front 2024-09-13T16:14:20.696931+0000 (oldest deadline 2024-09-13T16:14:45.997098+0000) 2024-09-13T16:14:46.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:46 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:46.469+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:46.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:46 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:46.469+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:14:46.755 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:46 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:46.701+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:05.588908+0000 front 2024-09-13T16:14:05.588955+0000 (oldest deadline 2024-09-13T16:14:30.288964+0000) 2024-09-13T16:14:46.755 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:46 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:46.701+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:11.890769+0000 front 2024-09-13T16:14:11.890824+0000 (oldest deadline 2024-09-13T16:14:40.691511+0000) 2024-09-13T16:14:46.755 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:46 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:46.701+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.992538+0000 front 2024-09-13T16:14:22.992566+0000 (oldest deadline 2024-09-13T16:14:45.892775+0000) 2024-09-13T16:14:47.261 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:46 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:46.830+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.353359+0000 front 2024-09-13T16:14:13.353246+0000 (oldest deadline 2024-09-13T16:14:35.653228+0000) 2024-09-13T16:14:47.261 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:46 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:46.830+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.154965+0000 front 2024-09-13T16:14:19.155291+0000 (oldest deadline 2024-09-13T16:14:45.055088+0000) 2024-09-13T16:14:47.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:46 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:46.998+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:47.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:46 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:46.998+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:14:47.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:46 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:46.998+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:14:47.287 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:46 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:46.969+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:47.287 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:46 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:46.969+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:47.287 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:46 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:46.969+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:14:47.482 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:47 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:47.084+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:47.483 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:47 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:47.084+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:14:47.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:47 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:47.286+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:14:47.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:47 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:47.286+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:20.696908+0000 front 2024-09-13T16:14:20.696931+0000 (oldest deadline 2024-09-13T16:14:45.997098+0000) 2024-09-13T16:14:47.734 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:47 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:47.480+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:47.734 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:47 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:47.480+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:14:48.004 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:47 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:47.733+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:05.588908+0000 front 2024-09-13T16:14:05.588955+0000 (oldest deadline 2024-09-13T16:14:30.288964+0000) 2024-09-13T16:14:48.004 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:47 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:47.733+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:11.890769+0000 front 2024-09-13T16:14:11.890824+0000 (oldest deadline 2024-09-13T16:14:40.691511+0000) 2024-09-13T16:14:48.004 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:47 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5[46868]: 2024-09-13T16:14:47.733+0000 7f4fcdbd7640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.992538+0000 front 2024-09-13T16:14:22.992566+0000 (oldest deadline 2024-09-13T16:14:45.892775+0000) 2024-09-13T16:14:48.261 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:47 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:47.821+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.353359+0000 front 2024-09-13T16:14:13.353246+0000 (oldest deadline 2024-09-13T16:14:35.653228+0000) 2024-09-13T16:14:48.262 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:47 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:47.821+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.154965+0000 front 2024-09-13T16:14:19.155291+0000 (oldest deadline 2024-09-13T16:14:45.055088+0000) 2024-09-13T16:14:48.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:47 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:47.980+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:48.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:47 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:47.980+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:14:48.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:47 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:47.980+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:14:48.277 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:47 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:47.970+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:48.277 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:47 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:47.970+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:48.277 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:47 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:47.970+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:14:48.492 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:48 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:48.074+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:48.492 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:48 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:48.074+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:14:48.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:48 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:48.275+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:14:48.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:48 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:48.275+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:20.696908+0000 front 2024-09-13T16:14:20.696931+0000 (oldest deadline 2024-09-13T16:14:45.997098+0000) 2024-09-13T16:14:48.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:48 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:48.489+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:48.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:48 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:48.489+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:14:49.261 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:48 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:48.806+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.353359+0000 front 2024-09-13T16:14:13.353246+0000 (oldest deadline 2024-09-13T16:14:35.653228+0000) 2024-09-13T16:14:49.261 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:48 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:48.806+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.154965+0000 front 2024-09-13T16:14:19.155291+0000 (oldest deadline 2024-09-13T16:14:45.055088+0000) 2024-09-13T16:14:49.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:48 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:48.961+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:49.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:48 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:48.961+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:14:49.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:48 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:48.961+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:14:49.284 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:48 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:48.990+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:49.284 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:48 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:48.990+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:49.284 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:48 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:48.990+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:14:49.389 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:49 smithi193 podman[71762]: 2024-09-13 16:14:49.094251448 +0000 UTC m=+5.763488762 container died e6be28a1813bf1722ef95c1999ca28774e365f1ca6a0a07fcc4c90a88cf1af50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-13T16:14:49.389 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:49 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:49.028+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:49.389 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:49 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:49.028+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:14:49.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:49 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:49.282+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:14:49.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:49 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:49.282+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:20.696908+0000 front 2024-09-13T16:14:20.696931+0000 (oldest deadline 2024-09-13T16:14:45.997098+0000) 2024-09-13T16:14:49.754 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:49 smithi193 podman[71762]: 2024-09-13 16:14:49.470838676 +0000 UTC m=+6.140075988 container cleanup e6be28a1813bf1722ef95c1999ca28774e365f1ca6a0a07fcc4c90a88cf1af50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0) 2024-09-13T16:14:49.754 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:49 smithi193 bash[71762]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5 2024-09-13T16:14:49.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:49 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:49.519+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:49.755 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:49 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:49.519+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:14:50.015 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:49 smithi193 podman[71779]: 2024-09-13 16:14:49.755858137 +0000 UTC m=+0.648458633 container remove e6be28a1813bf1722ef95c1999ca28774e365f1ca6a0a07fcc4c90a88cf1af50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:14:50.261 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:49 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:49.852+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.353359+0000 front 2024-09-13T16:14:13.353246+0000 (oldest deadline 2024-09-13T16:14:35.653228+0000) 2024-09-13T16:14:50.261 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:49 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:49.852+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.154965+0000 front 2024-09-13T16:14:19.155291+0000 (oldest deadline 2024-09-13T16:14:45.055088+0000) 2024-09-13T16:14:50.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:49 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:49.961+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:50.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:49 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:49.961+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:14:50.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:49 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:49.961+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:14:50.287 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:49 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:49.984+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:50.287 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:49 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:49.984+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:50.287 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:49 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:49.984+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:14:50.327 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:50 smithi193 podman[71864]: 2024-09-13 16:14:49.981512102 +0000 UTC m=+0.016504982 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:14:50.327 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:50 smithi193 podman[71864]: 2024-09-13 16:14:50.090223327 +0000 UTC m=+0.125216197 container create 92b77b86651ad1c40d864e2820fb3cdc13c7f8de163e9907e32810a83572ca2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-13T16:14:50.327 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:50 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:50.013+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:50.327 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:50 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:50.013+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:14:50.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:50 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:50.285+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:14:50.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:50 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:50.285+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:20.696908+0000 front 2024-09-13T16:14:20.696931+0000 (oldest deadline 2024-09-13T16:14:45.997098+0000) 2024-09-13T16:14:50.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:50 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:50.476+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:50.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:50 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:50.476+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:14:50.754 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:50 smithi193 podman[71864]: 2024-09-13 16:14:50.325979902 +0000 UTC m=+0.360972775 container init 92b77b86651ad1c40d864e2820fb3cdc13c7f8de163e9907e32810a83572ca2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-13T16:14:50.755 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:50 smithi193 podman[71864]: 2024-09-13 16:14:50.329636792 +0000 UTC m=+0.364629671 container start 92b77b86651ad1c40d864e2820fb3cdc13c7f8de163e9907e32810a83572ca2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:14:50.755 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:50 smithi193 podman[71864]: 2024-09-13 16:14:50.409410304 +0000 UTC m=+0.444403192 container attach 92b77b86651ad1c40d864e2820fb3cdc13c7f8de163e9907e32810a83572ca2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0) 2024-09-13T16:14:50.755 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:50 smithi193 podman[71864]: 2024-09-13 16:14:50.519819385 +0000 UTC m=+0.554812268 container died 92b77b86651ad1c40d864e2820fb3cdc13c7f8de163e9907e32810a83572ca2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True) 2024-09-13T16:14:51.083 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 13 16:14:51 smithi193 podman[71887]: 2024-09-13 16:14:51.063348387 +0000 UTC m=+0.537877732 container remove 92b77b86651ad1c40d864e2820fb3cdc13c7f8de163e9907e32810a83572ca2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2) 2024-09-13T16:14:51.084 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:50 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:50.986+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:51.084 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:50 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:50.986+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:14:51.089 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.5.service' 2024-09-13T16:14:51.127 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:14:51.127 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-13T16:14:51.127 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-13T16:14:51.128 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.6 2024-09-13T16:14:51.183 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:50 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:50.804+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.353359+0000 front 2024-09-13T16:14:13.353246+0000 (oldest deadline 2024-09-13T16:14:35.653228+0000) 2024-09-13T16:14:51.183 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:50 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:50.804+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.154965+0000 front 2024-09-13T16:14:19.155291+0000 (oldest deadline 2024-09-13T16:14:45.055088+0000) 2024-09-13T16:14:51.183 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:51 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:51.001+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:51.184 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:51 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:51.001+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:14:51.184 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:51 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:51.001+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:14:51.258 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:50 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:50.998+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:51.259 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:50 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:50.998+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:51.259 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:50 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:50.998+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:14:51.511 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:51 smithi017 systemd[1]: Stopping Ceph osd.6 for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:14:51.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:51 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:51.257+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:14:51.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:51 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:51.257+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:20.696908+0000 front 2024-09-13T16:14:20.696931+0000 (oldest deadline 2024-09-13T16:14:45.997098+0000) 2024-09-13T16:14:51.810 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:51 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:51.548+0000 7f4b95c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:14:51.810 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:51 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:51.548+0000 7f4b95c00640 -1 osd.6 98 *** Got signal Terminated *** 2024-09-13T16:14:51.811 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:51 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:51.548+0000 7f4b95c00640 -1 osd.6 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:14:51.811 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:51 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:51.809+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.353359+0000 front 2024-09-13T16:14:13.353246+0000 (oldest deadline 2024-09-13T16:14:35.653228+0000) 2024-09-13T16:14:51.811 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:51 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:51.809+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.154965+0000 front 2024-09-13T16:14:19.155291+0000 (oldest deadline 2024-09-13T16:14:45.055088+0000) 2024-09-13T16:14:52.004 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:51 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:51.513+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:52.004 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:51 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:51.513+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:14:52.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:51 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:51.984+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:52.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:51 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:51.984+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:14:52.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:51 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:51.984+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:14:52.274 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:51 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:51.977+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:52.274 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:51 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:51.977+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:52.275 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:51 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:51.977+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:14:52.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:52 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:52.024+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:52.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:52 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:52.024+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:14:52.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:52 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:52.273+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:14:52.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:52 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:52.273+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:20.696908+0000 front 2024-09-13T16:14:20.696931+0000 (oldest deadline 2024-09-13T16:14:45.997098+0000) 2024-09-13T16:14:53.004 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:52 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:52.554+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:53.004 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:52 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:52.554+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:14:53.261 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:52 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:52.816+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.353359+0000 front 2024-09-13T16:14:13.353246+0000 (oldest deadline 2024-09-13T16:14:35.653228+0000) 2024-09-13T16:14:53.261 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:52 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:52.816+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.154965+0000 front 2024-09-13T16:14:19.155291+0000 (oldest deadline 2024-09-13T16:14:45.055088+0000) 2024-09-13T16:14:53.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:52 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:52.961+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:53.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:52 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:52.961+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:14:53.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:52 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:52.961+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:14:53.324 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:53 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:53.020+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:53.324 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:53 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:53.020+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:53.324 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:53 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:53.020+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:14:53.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:53 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:53.070+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:53.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:53 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:53.070+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:14:53.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:53 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:53.323+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:14:53.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:53 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:53.323+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:20.696908+0000 front 2024-09-13T16:14:20.696931+0000 (oldest deadline 2024-09-13T16:14:45.997098+0000) 2024-09-13T16:14:53.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:53 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:53.323+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.098335+0000 front 2024-09-13T16:14:30.098275+0000 (oldest deadline 2024-09-13T16:14:52.998377+0000) 2024-09-13T16:14:54.004 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:53 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:53.555+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:54.004 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:53 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:53.555+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:14:54.261 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:53 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:53.837+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.353359+0000 front 2024-09-13T16:14:13.353246+0000 (oldest deadline 2024-09-13T16:14:35.653228+0000) 2024-09-13T16:14:54.261 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:53 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:53.837+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.154965+0000 front 2024-09-13T16:14:19.155291+0000 (oldest deadline 2024-09-13T16:14:45.055088+0000) 2024-09-13T16:14:54.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:53 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:53.939+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:54.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:53 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:53.939+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:14:54.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:53 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:53.939+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:14:54.315 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:53 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:53.987+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:54.315 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:53 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:53.987+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:54.315 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:53 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:53.987+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:14:54.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:54 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:54.071+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:54.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:54 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:54.071+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:14:54.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:54 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:54.313+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:14:54.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:54 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:54.313+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:20.696908+0000 front 2024-09-13T16:14:20.696931+0000 (oldest deadline 2024-09-13T16:14:45.997098+0000) 2024-09-13T16:14:54.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:54 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:54.313+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.098335+0000 front 2024-09-13T16:14:30.098275+0000 (oldest deadline 2024-09-13T16:14:52.998377+0000) 2024-09-13T16:14:55.005 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:54 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:54.520+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:55.005 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:54 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:54.520+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:14:55.261 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:54 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:54.855+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.353359+0000 front 2024-09-13T16:14:13.353246+0000 (oldest deadline 2024-09-13T16:14:35.653228+0000) 2024-09-13T16:14:55.261 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:54 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:54.855+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.154965+0000 front 2024-09-13T16:14:19.155291+0000 (oldest deadline 2024-09-13T16:14:45.055088+0000) 2024-09-13T16:14:55.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:54 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:54.975+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:55.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:54 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:54.975+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:14:55.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:54 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:54.975+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:14:55.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:54 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:54.979+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:55.359 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:54 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:54.979+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:55.359 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:54 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:54.979+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:14:55.480 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:55 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:55.064+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:55.480 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:55 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:55.064+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:14:55.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:55 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:55.478+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:55.755 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:55 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:55.478+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:14:55.856 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:55 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:55.358+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:14:55.856 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:55 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:55.358+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:20.696908+0000 front 2024-09-13T16:14:20.696931+0000 (oldest deadline 2024-09-13T16:14:45.997098+0000) 2024-09-13T16:14:55.857 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:55 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:55.358+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.098335+0000 front 2024-09-13T16:14:30.098275+0000 (oldest deadline 2024-09-13T16:14:52.998377+0000) 2024-09-13T16:14:56.261 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:55 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:55.809+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.353359+0000 front 2024-09-13T16:14:13.353246+0000 (oldest deadline 2024-09-13T16:14:35.653228+0000) 2024-09-13T16:14:56.261 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:55 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:55.809+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.154965+0000 front 2024-09-13T16:14:19.155291+0000 (oldest deadline 2024-09-13T16:14:45.055088+0000) 2024-09-13T16:14:56.262 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:55 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6[58648]: 2024-09-13T16:14:55.809+0000 7f4b8c600640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.758327+0000 front 2024-09-13T16:14:30.758351+0000 (oldest deadline 2024-09-13T16:14:54.858524+0000) 2024-09-13T16:14:56.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:55 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:55.974+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:56.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:55 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:55.974+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:14:56.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:55 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:55.974+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:14:56.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:55 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:55.974+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:14:56.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:55 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:55.963+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:56.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:55 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:55.963+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:56.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:55 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:55.963+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:14:56.446 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:56 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:56.082+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:56.446 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:56 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:56.082+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:14:56.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:56 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:56.444+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:56.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:56 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:56.444+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:14:56.856 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:56 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:56.365+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:14:56.856 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:56 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:56.365+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:20.696908+0000 front 2024-09-13T16:14:20.696931+0000 (oldest deadline 2024-09-13T16:14:45.997098+0000) 2024-09-13T16:14:56.856 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:56 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:56.365+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.098335+0000 front 2024-09-13T16:14:30.098275+0000 (oldest deadline 2024-09-13T16:14:52.998377+0000) 2024-09-13T16:14:57.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:56 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:56.953+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:57.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:56 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:56.953+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:14:57.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:56 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:56.953+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:14:57.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:56 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:56.953+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:14:57.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:56 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:56.960+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:57.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:56 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:56.960+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:57.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:56 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:56.960+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:14:57.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:56 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:56.960+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:14:57.406 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:57 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:57.042+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:57.406 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:57 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:57.042+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:14:57.407 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:57 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:57.042+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:14:57.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:57 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:57.405+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:57.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:57 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:57.405+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:14:57.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:57 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:57.405+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:29.153721+0000 front 2024-09-13T16:14:29.153854+0000 (oldest deadline 2024-09-13T16:14:57.354687+0000) 2024-09-13T16:14:57.761 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:57 smithi017 podman[93488]: 2024-09-13 16:14:57.433747962 +0000 UTC m=+6.008622608 container died 47ff242672ef7d59916e50be43d732b3ff5439098aa9d83b739e476f62bf8e29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:14:57.856 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:57 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:57.403+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:14:57.856 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:57 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:57.403+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:20.696908+0000 front 2024-09-13T16:14:20.696931+0000 (oldest deadline 2024-09-13T16:14:45.997098+0000) 2024-09-13T16:14:57.856 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:57 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:57.403+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.098335+0000 front 2024-09-13T16:14:30.098275+0000 (oldest deadline 2024-09-13T16:14:52.998377+0000) 2024-09-13T16:14:58.232 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:57 smithi017 podman[93488]: 2024-09-13 16:14:57.89653111 +0000 UTC m=+6.471405749 container cleanup 47ff242672ef7d59916e50be43d732b3ff5439098aa9d83b739e476f62bf8e29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS) 2024-09-13T16:14:58.232 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:57 smithi017 bash[93488]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6 2024-09-13T16:14:58.232 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:57 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:57.969+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:58.232 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:57 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:57.969+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:14:58.232 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:57 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:57.969+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:14:58.232 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:57 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:57.969+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:14:58.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:58 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:58.008+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:58.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:58 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:58.008+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:58.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:58 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:58.008+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:14:58.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:58 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:58.008+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:14:58.357 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:58 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:58.074+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:58.357 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:58 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:58.074+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:14:58.358 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:58 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:58.074+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:14:58.511 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:58 smithi017 podman[93504]: 2024-09-13 16:14:58.23109672 +0000 UTC m=+0.787814299 container remove 47ff242672ef7d59916e50be43d732b3ff5439098aa9d83b739e476f62bf8e29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:14:58.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:58 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:58.356+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:58.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:58 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:58.356+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:14:58.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:58 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:58.356+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:29.153721+0000 front 2024-09-13T16:14:29.153854+0000 (oldest deadline 2024-09-13T16:14:57.354687+0000) 2024-09-13T16:14:58.856 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:58 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:58.355+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:14:58.856 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:58 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:58.355+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:20.696908+0000 front 2024-09-13T16:14:20.696931+0000 (oldest deadline 2024-09-13T16:14:45.997098+0000) 2024-09-13T16:14:58.856 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:58 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:58.355+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.098335+0000 front 2024-09-13T16:14:30.098275+0000 (oldest deadline 2024-09-13T16:14:52.998377+0000) 2024-09-13T16:14:59.102 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:58 smithi017 podman[93592]: 2024-09-13 16:14:58.729976568 +0000 UTC m=+0.028128620 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:14:59.102 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:58 smithi017 podman[93592]: 2024-09-13 16:14:58.848689373 +0000 UTC m=+0.146841424 container create b5a7b16218ab8bb780d28b61b6da451ee138bf00ee95bb35ca9e5bd7c1f7286e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:14:59.102 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:58 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:58.922+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:14:59.102 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:58 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:58.922+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:14:59.102 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:58 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:58.922+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:14:59.103 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:58 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:58.922+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:14:59.313 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:59 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:59.040+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:14:59.314 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:59 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:59.040+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:14:59.314 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:14:59 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:14:59.040+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:14:59.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:59 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:59.039+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:14:59.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:59 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:59.039+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:14:59.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:59 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:59.039+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:14:59.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:14:59 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:14:59.039+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:14:59.378 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:59 smithi017 podman[93592]: 2024-09-13 16:14:59.101297695 +0000 UTC m=+0.399449746 container init b5a7b16218ab8bb780d28b61b6da451ee138bf00ee95bb35ca9e5bd7c1f7286e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:14:59.379 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:59 smithi017 podman[93592]: 2024-09-13 16:14:59.109900941 +0000 UTC m=+0.408052993 container start b5a7b16218ab8bb780d28b61b6da451ee138bf00ee95bb35ca9e5bd7c1f7286e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-13T16:14:59.379 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:59 smithi017 podman[93592]: 2024-09-13 16:14:59.192644904 +0000 UTC m=+0.490796955 container attach b5a7b16218ab8bb780d28b61b6da451ee138bf00ee95bb35ca9e5bd7c1f7286e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6-deactivate, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:14:59.753 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 13 16:14:59 smithi017 podman[93592]: 2024-09-13 16:14:59.378034978 +0000 UTC m=+0.676187035 container died b5a7b16218ab8bb780d28b61b6da451ee138bf00ee95bb35ca9e5bd7c1f7286e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=) 2024-09-13T16:14:59.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:59 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:59.312+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:14:59.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:59 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:59.312+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:14:59.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:14:59 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:14:59.312+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:29.153721+0000 front 2024-09-13T16:14:29.153854+0000 (oldest deadline 2024-09-13T16:14:57.354687+0000) 2024-09-13T16:14:59.856 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:59 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:59.386+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:14:59.856 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:59 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:59.386+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:20.696908+0000 front 2024-09-13T16:14:20.696931+0000 (oldest deadline 2024-09-13T16:14:45.997098+0000) 2024-09-13T16:14:59.856 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:14:59 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:14:59.386+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.098335+0000 front 2024-09-13T16:14:30.098275+0000 (oldest deadline 2024-09-13T16:14:52.998377+0000) 2024-09-13T16:15:00.011 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:59 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:59.945+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:15:00.011 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:59 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:59.945+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:15:00.011 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:59 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:59.945+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:15:00.012 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:14:59 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:14:59.945+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:15:00.272 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.6.service' 2024-09-13T16:15:00.349 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:15:00.349 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-13T16:15:00.349 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-13T16:15:00.349 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.7 2024-09-13T16:15:00.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:00 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:00.013+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:00.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:00 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:00.013+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:00.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:00 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:00.013+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:00.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:00 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:00.013+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:00.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:00 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:00.035+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:00.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:00 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:00.035+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:00.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:00 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:00.035+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:00.505 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:00 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:00.263+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:15:00.505 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:00 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:00.263+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:15:00.505 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:00 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:00.263+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:29.153721+0000 front 2024-09-13T16:14:29.153854+0000 (oldest deadline 2024-09-13T16:14:57.354687+0000) 2024-09-13T16:15:00.664 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:00 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:00.381+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:15:00.664 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:00 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:00.381+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:20.696908+0000 front 2024-09-13T16:14:20.696931+0000 (oldest deadline 2024-09-13T16:14:45.997098+0000) 2024-09-13T16:15:00.664 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:00 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:00.381+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.098335+0000 front 2024-09-13T16:14:30.098275+0000 (oldest deadline 2024-09-13T16:14:52.998377+0000) 2024-09-13T16:15:00.664 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:00 smithi189 systemd[1]: Stopping Ceph osd.7 for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:15:01.047 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:00 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:00.662+0000 7f66f92ec640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:15:01.047 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:00 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:00.662+0000 7f66f92ec640 -1 osd.7 98 *** Got signal Terminated *** 2024-09-13T16:15:01.048 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:00 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:00.662+0000 7f66f92ec640 -1 osd.7 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:15:01.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:00 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:00.954+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:15:01.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:00 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:00.954+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:15:01.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:00 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:00.954+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:15:01.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:00 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:00.954+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:15:01.351 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:01 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:01.046+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:01.351 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:01 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:01.046+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:01.351 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:01 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:01.046+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:01.351 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:01 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:01.046+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:01.504 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:01 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:01.249+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:15:01.504 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:01 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:01.249+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:15:01.505 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:01 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:01.249+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:29.153721+0000 front 2024-09-13T16:14:29.153854+0000 (oldest deadline 2024-09-13T16:14:57.354687+0000) 2024-09-13T16:15:01.505 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:01 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:01.011+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:01.505 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:01 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:01.011+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:01.505 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:01 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:01.011+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:01.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:01 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:01.350+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:15:01.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:01 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:01.350+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:20.696908+0000 front 2024-09-13T16:14:20.696931+0000 (oldest deadline 2024-09-13T16:14:45.997098+0000) 2024-09-13T16:15:01.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:01 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:01.350+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.098335+0000 front 2024-09-13T16:14:30.098275+0000 (oldest deadline 2024-09-13T16:14:52.998377+0000) 2024-09-13T16:15:02.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:01 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:01.912+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:15:02.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:01 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:01.912+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:15:02.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:01 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:01.912+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:15:02.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:01 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:01.912+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:15:02.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:01 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:01.912+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:39.437732+0000 front 2024-09-13T16:14:39.438661+0000 (oldest deadline 2024-09-13T16:15:01.737835+0000) 2024-09-13T16:15:02.279 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:02 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:02.004+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:02.279 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:02 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:02.004+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:02.279 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:02 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:02.004+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:02.305 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:02 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:02.017+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:02.305 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:02 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:02.017+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:02.305 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:02 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:02.017+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:02.306 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:02 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:02.017+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:02.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:02 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:02.304+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:15:02.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:02 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:02.304+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:20.696908+0000 front 2024-09-13T16:14:20.696931+0000 (oldest deadline 2024-09-13T16:14:45.997098+0000) 2024-09-13T16:15:02.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:02 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:02.304+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.098335+0000 front 2024-09-13T16:14:30.098275+0000 (oldest deadline 2024-09-13T16:14:52.998377+0000) 2024-09-13T16:15:02.607 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:02 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:02.304+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.799906+0000 front 2024-09-13T16:14:38.799896+0000 (oldest deadline 2024-09-13T16:15:02.299972+0000) 2024-09-13T16:15:02.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:02 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:02.278+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:15:02.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:02 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:02.278+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:15:02.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:02 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:02.278+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:29.153721+0000 front 2024-09-13T16:14:29.153854+0000 (oldest deadline 2024-09-13T16:14:57.354687+0000) 2024-09-13T16:15:03.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:02 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:02.872+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:15:03.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:02 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:02.872+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:15:03.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:02 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:02.872+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:15:03.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:02 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:02.872+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:15:03.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:02 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:02.872+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:39.437732+0000 front 2024-09-13T16:14:39.438661+0000 (oldest deadline 2024-09-13T16:15:01.737835+0000) 2024-09-13T16:15:03.285 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:03 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:03.003+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:03.285 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:03 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:03.004+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:03.285 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:03 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:03.004+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:03.285 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:03 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:03.004+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:03.285 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:03 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:03.004+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:03.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:03 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:03.039+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:03.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:03 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:03.039+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:03.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:03 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:03.039+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:03.505 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:03 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:03.039+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:03.505 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:03 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:03.263+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:15:03.505 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:03 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:03.263+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:15:03.505 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:03 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:03.263+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:29.153721+0000 front 2024-09-13T16:14:29.153854+0000 (oldest deadline 2024-09-13T16:14:57.354687+0000) 2024-09-13T16:15:03.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:03 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:03.284+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:15:03.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:03 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:03.284+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:20.696908+0000 front 2024-09-13T16:14:20.696931+0000 (oldest deadline 2024-09-13T16:14:45.997098+0000) 2024-09-13T16:15:03.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:03 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:03.284+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.098335+0000 front 2024-09-13T16:14:30.098275+0000 (oldest deadline 2024-09-13T16:14:52.998377+0000) 2024-09-13T16:15:03.607 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:03 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:03.284+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.799906+0000 front 2024-09-13T16:14:38.799896+0000 (oldest deadline 2024-09-13T16:15:02.299972+0000) 2024-09-13T16:15:04.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:03 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:03.890+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:15:04.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:03 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:03.890+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:15:04.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:03 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:03.890+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:15:04.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:03 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:03.890+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:15:04.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:03 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:03.890+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:39.437732+0000 front 2024-09-13T16:14:39.438661+0000 (oldest deadline 2024-09-13T16:15:01.737835+0000) 2024-09-13T16:15:04.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:04 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:04.008+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:04.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:04 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:04.008+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:04.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:04 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:04.008+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:04.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:04 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:04.008+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:04.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:04 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:04.008+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:04.357 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:04 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:04.237+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:15:04.357 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:04 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:04.237+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:20.696908+0000 front 2024-09-13T16:14:20.696931+0000 (oldest deadline 2024-09-13T16:14:45.997098+0000) 2024-09-13T16:15:04.357 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:04 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:04.237+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.098335+0000 front 2024-09-13T16:14:30.098275+0000 (oldest deadline 2024-09-13T16:14:52.998377+0000) 2024-09-13T16:15:04.357 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:04 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:04.237+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.799906+0000 front 2024-09-13T16:14:38.799896+0000 (oldest deadline 2024-09-13T16:15:02.299972+0000) 2024-09-13T16:15:04.504 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:04 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:04.296+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:15:04.504 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:04 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:04.296+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:15:04.504 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:04 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:04.296+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:29.153721+0000 front 2024-09-13T16:14:29.153854+0000 (oldest deadline 2024-09-13T16:14:57.354687+0000) 2024-09-13T16:15:04.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:04 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:04.078+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:04.505 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:04 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:04.078+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:04.505 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:04 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:04.078+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:04.505 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:04 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:04.078+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:05.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:04 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:04.933+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:15:05.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:04 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:04.933+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:15:05.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:04 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:04.933+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:15:05.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:04 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:04.933+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:15:05.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:04 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:04.933+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:39.437732+0000 front 2024-09-13T16:14:39.438661+0000 (oldest deadline 2024-09-13T16:15:01.737835+0000) 2024-09-13T16:15:05.272 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:04 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:04.980+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:05.273 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:04 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:04.980+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:05.273 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:04 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:04.980+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:05.273 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:04 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:04.980+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:05.273 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:04 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:04.980+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:05.504 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:05 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:05.255+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:15:05.504 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:05 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:05.255+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:15:05.504 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:05 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:05.255+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:29.153721+0000 front 2024-09-13T16:14:29.153854+0000 (oldest deadline 2024-09-13T16:14:57.354687+0000) 2024-09-13T16:15:05.505 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:05 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:05.255+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:37.855735+0000 front 2024-09-13T16:14:37.855727+0000 (oldest deadline 2024-09-13T16:15:04.856439+0000) 2024-09-13T16:15:05.505 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:05 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:05.126+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:05.505 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:05 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:05.126+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:05.505 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:05 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:05.126+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:05.505 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:05 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:05.126+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:05.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:05 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:05.271+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:09.495531+0000 front 2024-09-13T16:14:09.495551+0000 (oldest deadline 2024-09-13T16:14:40.696342+0000) 2024-09-13T16:15:05.606 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:05 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:05.271+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:20.696908+0000 front 2024-09-13T16:14:20.696931+0000 (oldest deadline 2024-09-13T16:14:45.997098+0000) 2024-09-13T16:15:05.607 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:05 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:05.271+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.098335+0000 front 2024-09-13T16:14:30.098275+0000 (oldest deadline 2024-09-13T16:14:52.998377+0000) 2024-09-13T16:15:05.607 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:05 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7[52822]: 2024-09-13T16:15:05.271+0000 7f66f18f8640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.799906+0000 front 2024-09-13T16:14:38.799896+0000 (oldest deadline 2024-09-13T16:15:02.299972+0000) 2024-09-13T16:15:06.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:05 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:05.951+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:15:06.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:05 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:05.951+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:15:06.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:05 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:05.951+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:15:06.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:05 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:05.951+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:15:06.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:05 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:05.951+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:39.437732+0000 front 2024-09-13T16:14:39.438661+0000 (oldest deadline 2024-09-13T16:15:01.737835+0000) 2024-09-13T16:15:06.356 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:06 smithi189 podman[70941]: 2024-09-13 16:15:06.205254854 +0000 UTC m=+5.667917502 container died 59937874497a5d4b3fb7a1a6c2d17e0f5f9fb02409a01a8f1af1a313b4c346b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-13T16:15:06.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:06 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:06.003+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:06.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:06 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:06.003+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:06.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:06 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:06.003+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:06.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:06 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:06.003+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:06.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:06 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:06.003+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:06.504 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:06 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:06.239+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:15:06.504 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:06 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:06.239+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:15:06.504 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:06 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:06.239+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:29.153721+0000 front 2024-09-13T16:14:29.153854+0000 (oldest deadline 2024-09-13T16:14:57.354687+0000) 2024-09-13T16:15:06.504 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:06 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:06.239+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:37.855735+0000 front 2024-09-13T16:14:37.855727+0000 (oldest deadline 2024-09-13T16:15:04.856439+0000) 2024-09-13T16:15:06.505 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:06 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:06.093+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:06.505 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:06 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:06.093+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:06.505 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:06 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:06.093+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:06.505 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:06 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:06.093+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:06.882 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:06 smithi189 podman[70941]: 2024-09-13 16:15:06.646335388 +0000 UTC m=+6.108998030 container cleanup 59937874497a5d4b3fb7a1a6c2d17e0f5f9fb02409a01a8f1af1a313b4c346b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-13T16:15:06.882 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:06 smithi189 bash[70941]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7 2024-09-13T16:15:07.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:06 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:06.976+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:15:07.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:06 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:06.976+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:15:07.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:06 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:06.976+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:15:07.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:06 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:06.976+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:15:07.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:06 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:06.976+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:39.437732+0000 front 2024-09-13T16:14:39.438661+0000 (oldest deadline 2024-09-13T16:15:01.737835+0000) 2024-09-13T16:15:07.324 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:06 smithi189 podman[70955]: 2024-09-13 16:15:06.881121826 +0000 UTC m=+0.674735551 container remove 59937874497a5d4b3fb7a1a6c2d17e0f5f9fb02409a01a8f1af1a313b4c346b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-13T16:15:07.324 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:06 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:06.987+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:07.324 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:06 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:06.987+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:07.324 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:06 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:06.987+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:07.325 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:06 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:06.987+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:07.325 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:06 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:06.987+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:07.405 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:07 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:07.046+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:07.406 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:07 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:07.046+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:07.406 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:07 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:07.046+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:07.406 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:07 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:07.046+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:07.406 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:07 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:07.285+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:15:07.406 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:07 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:07.285+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:15:07.406 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:07 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:07.285+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:29.153721+0000 front 2024-09-13T16:14:29.153854+0000 (oldest deadline 2024-09-13T16:14:57.354687+0000) 2024-09-13T16:15:07.406 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:07 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:07.285+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:37.855735+0000 front 2024-09-13T16:14:37.855727+0000 (oldest deadline 2024-09-13T16:15:04.856439+0000) 2024-09-13T16:15:07.577 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:07 smithi189 podman[71057]: 2024-09-13 16:15:07.323609801 +0000 UTC m=+0.109628472 container create 9a4d905479329313669b15015c9aa9e934f2cf024d6d2e87dd368086ea669599 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:15:07.577 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:07 smithi189 podman[71057]: 2024-09-13 16:15:07.230446919 +0000 UTC m=+0.016465599 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:15:07.577 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:07 smithi189 podman[71057]: 2024-09-13 16:15:07.576360135 +0000 UTC m=+0.362378820 container init 9a4d905479329313669b15015c9aa9e934f2cf024d6d2e87dd368086ea669599 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7-deactivate, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-13T16:15:07.856 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:07 smithi189 podman[71057]: 2024-09-13 16:15:07.580488016 +0000 UTC m=+0.366506692 container start 9a4d905479329313669b15015c9aa9e934f2cf024d6d2e87dd368086ea669599 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-13T16:15:07.856 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:07 smithi189 podman[71057]: 2024-09-13 16:15:07.667880758 +0000 UTC m=+0.453899438 container attach 9a4d905479329313669b15015c9aa9e934f2cf024d6d2e87dd368086ea669599 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:15:07.856 INFO:journalctl@ceph.osd.7.smithi189.stdout:Sep 13 16:15:07 smithi189 podman[71057]: 2024-09-13 16:15:07.768009755 +0000 UTC m=+0.554028434 container died 9a4d905479329313669b15015c9aa9e934f2cf024d6d2e87dd368086ea669599 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-7-deactivate, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-13T16:15:08.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:08 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:08.004+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:15:08.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:08 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:08.004+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:15:08.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:08 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:08.004+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:15:08.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:08 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:08.004+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:15:08.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:08 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:08.004+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:39.437732+0000 front 2024-09-13T16:14:39.438661+0000 (oldest deadline 2024-09-13T16:15:01.737835+0000) 2024-09-13T16:15:08.323 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:08 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:08.042+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:08.324 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:08 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:08.042+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:08.324 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:08 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:08.042+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:08.324 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:08 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:08.042+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:08.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:08 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:07.999+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:08.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:08 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:07.999+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:08.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:08 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:07.999+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:08.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:08 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:07.999+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:08.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:08 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:07.999+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:08.389 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.7.service' 2024-09-13T16:15:08.470 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:15:08.470 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-13T16:15:08.470 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-13T16:15:08.470 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.8 2024-09-13T16:15:08.695 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:08 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:08.322+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:15:08.695 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:08 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:08.322+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:15:08.696 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:08 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:08.322+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:29.153721+0000 front 2024-09-13T16:14:29.153854+0000 (oldest deadline 2024-09-13T16:14:57.354687+0000) 2024-09-13T16:15:08.696 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:08 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:08.322+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:37.855735+0000 front 2024-09-13T16:14:37.855727+0000 (oldest deadline 2024-09-13T16:15:04.856439+0000) 2024-09-13T16:15:08.696 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:08 smithi193 systemd[1]: Stopping Ceph osd.8 for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:15:09.004 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:08 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:08.798+0000 7fe494660640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:15:09.004 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:08 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:08.798+0000 7fe494660640 -1 osd.8 98 *** Got signal Terminated *** 2024-09-13T16:15:09.004 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:08 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:08.798+0000 7fe494660640 -1 osd.8 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:15:09.304 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:09 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:09.010+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:09.304 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:09 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:09.010+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:09.304 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:09 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:09.010+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:09.304 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:09 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:09.010+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:09.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:08 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:08.954+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:09.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:08 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:08.954+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:09.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:08 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:08.954+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:09.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:08 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:08.954+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:09.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:08 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:08.954+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:09.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:09 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:09.018+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:15:09.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:09 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:09.018+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:15:09.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:09 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:09.018+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:15:09.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:09 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:09.018+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:15:09.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:09 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:09.018+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:39.437732+0000 front 2024-09-13T16:14:39.438661+0000 (oldest deadline 2024-09-13T16:15:01.737835+0000) 2024-09-13T16:15:09.653 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:09 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:09.302+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:15:09.653 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:09 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:09.302+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:15:09.653 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:09 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:09.302+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:29.153721+0000 front 2024-09-13T16:14:29.153854+0000 (oldest deadline 2024-09-13T16:14:57.354687+0000) 2024-09-13T16:15:09.653 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:09 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:09.302+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:37.855735+0000 front 2024-09-13T16:14:37.855727+0000 (oldest deadline 2024-09-13T16:15:04.856439+0000) 2024-09-13T16:15:10.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:09 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:09.982+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:15:10.261 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:09 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:09.982+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:15:10.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:09 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:09.982+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:15:10.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:09 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:09.982+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:15:10.262 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:09 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:09.982+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:39.437732+0000 front 2024-09-13T16:14:39.438661+0000 (oldest deadline 2024-09-13T16:15:01.737835+0000) 2024-09-13T16:15:10.267 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:10 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:10.013+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:10.267 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:10 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:10.013+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:10.267 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:10 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:10.013+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:10.267 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:10 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:10.013+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:10.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:09 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:09.949+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:10.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:09 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:09.949+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:10.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:09 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:09.949+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:10.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:09 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:09.949+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:10.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:09 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:09.949+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:10.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:10 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:10.266+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:15:10.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:10 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:10.266+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:15:10.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:10 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:10.266+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:29.153721+0000 front 2024-09-13T16:14:29.153854+0000 (oldest deadline 2024-09-13T16:14:57.354687+0000) 2024-09-13T16:15:10.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:10 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:10.266+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:37.855735+0000 front 2024-09-13T16:14:37.855727+0000 (oldest deadline 2024-09-13T16:15:04.856439+0000) 2024-09-13T16:15:11.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:10 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:10.962+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:11.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:10 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:10.962+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:11.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:10 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:10.962+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:11.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:10 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:10.962+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:11.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:10 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:10.962+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:11.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:11 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:11.006+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:11.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:11 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:11.006+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:11.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:11 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:11.006+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:11.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:11 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:11.006+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:11.505 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:11 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:11.006+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:11.505 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:11 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:11.226+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:15:11.505 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:11 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:11.226+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:15:11.505 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:11 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:11.226+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:29.153721+0000 front 2024-09-13T16:14:29.153854+0000 (oldest deadline 2024-09-13T16:14:57.354687+0000) 2024-09-13T16:15:11.505 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:11 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:11.226+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:37.855735+0000 front 2024-09-13T16:14:37.855727+0000 (oldest deadline 2024-09-13T16:15:04.856439+0000) 2024-09-13T16:15:11.505 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:11 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:11.226+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:48.357475+0000 front 2024-09-13T16:14:48.357457+0000 (oldest deadline 2024-09-13T16:15:10.657692+0000) 2024-09-13T16:15:11.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:11 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:11.025+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:15:11.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:11 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:11.025+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:15:11.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:11 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:11.025+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:15:11.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:11 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:11.025+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:15:11.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:11 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:11.025+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:39.437732+0000 front 2024-09-13T16:14:39.438661+0000 (oldest deadline 2024-09-13T16:15:01.737835+0000) 2024-09-13T16:15:12.273 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:12 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:12.010+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:12.273 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:12 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:12.010+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:12.273 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:12 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:12.010+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:12.273 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:12 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:12.010+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:12.273 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:12 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:12.010+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:12.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:11 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:11.946+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:12.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:11 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:11.946+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:12.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:11 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:11.946+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:12.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:11 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:11.946+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:12.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:11 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:11.946+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:12.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:12 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:12.030+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:15:12.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:12 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:12.030+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:15:12.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:12 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:12.030+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:15:12.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:12 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:12.030+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:15:12.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:12 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:12.030+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:39.437732+0000 front 2024-09-13T16:14:39.438661+0000 (oldest deadline 2024-09-13T16:15:01.737835+0000) 2024-09-13T16:15:12.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:12 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:12.030+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:46.339839+0000 front 2024-09-13T16:14:46.339859+0000 (oldest deadline 2024-09-13T16:15:11.039737+0000) 2024-09-13T16:15:12.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:12 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:12.271+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:15:12.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:12 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:12.271+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:15:12.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:12 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:12.272+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:29.153721+0000 front 2024-09-13T16:14:29.153854+0000 (oldest deadline 2024-09-13T16:14:57.354687+0000) 2024-09-13T16:15:12.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:12 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:12.272+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:37.855735+0000 front 2024-09-13T16:14:37.855727+0000 (oldest deadline 2024-09-13T16:15:04.856439+0000) 2024-09-13T16:15:12.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:12 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:12.272+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:48.357475+0000 front 2024-09-13T16:14:48.357457+0000 (oldest deadline 2024-09-13T16:15:10.657692+0000) 2024-09-13T16:15:13.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:13 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:13.002+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:13.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:13 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:13.002+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:13.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:13 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:13.002+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:13.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:13 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:13.002+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:13.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:13 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:13.002+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:13.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:12 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:12.898+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:13.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:12 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:12.898+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:13.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:12 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:12.898+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:13.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:12 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:12.898+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:13.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:12 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:12.898+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:13.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:12 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:12.898+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:43.653192+0000 front 2024-09-13T16:14:43.653215+0000 (oldest deadline 2024-09-13T16:15:12.453598+0000) 2024-09-13T16:15:13.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:13 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:13.065+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:15:13.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:13 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:13.065+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:15:13.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:13 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:13.065+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:15:13.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:13 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:13.065+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:15:13.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:13 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:13.065+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:39.437732+0000 front 2024-09-13T16:14:39.438661+0000 (oldest deadline 2024-09-13T16:15:01.737835+0000) 2024-09-13T16:15:13.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:13 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:13.065+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:46.339839+0000 front 2024-09-13T16:14:46.339859+0000 (oldest deadline 2024-09-13T16:15:11.039737+0000) 2024-09-13T16:15:13.754 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:13 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:13.280+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.050014+0000 front 2024-09-13T16:14:04.050063+0000 (oldest deadline 2024-09-13T16:14:29.950067+0000) 2024-09-13T16:15:13.755 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:13 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:13.280+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:22.152672+0000 front 2024-09-13T16:14:22.152696+0000 (oldest deadline 2024-09-13T16:14:45.652893+0000) 2024-09-13T16:15:13.755 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:13 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:13.280+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:29.153721+0000 front 2024-09-13T16:14:29.153854+0000 (oldest deadline 2024-09-13T16:14:57.354687+0000) 2024-09-13T16:15:13.755 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:13 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:13.280+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:37.855735+0000 front 2024-09-13T16:14:37.855727+0000 (oldest deadline 2024-09-13T16:15:04.856439+0000) 2024-09-13T16:15:13.755 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:13 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8[53648]: 2024-09-13T16:15:13.280+0000 7fe490c74640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:48.357475+0000 front 2024-09-13T16:14:48.357457+0000 (oldest deadline 2024-09-13T16:15:10.657692+0000) 2024-09-13T16:15:14.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:13 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:13.977+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:14.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:13 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:13.977+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:14.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:13 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:13.977+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:14.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:13 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:13.977+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:14.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:13 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:13.977+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:14.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:13 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:13.900+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:14.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:13 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:13.900+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:14.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:13 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:13.900+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:14.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:13 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:13.900+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:14.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:13 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:13.900+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:14.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:13 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:13.900+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:43.653192+0000 front 2024-09-13T16:14:43.653215+0000 (oldest deadline 2024-09-13T16:15:12.453598+0000) 2024-09-13T16:15:14.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:14 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:14.110+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:15:14.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:14 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:14.110+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:15:14.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:14 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:14.110+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:15:14.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:14 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:14.110+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:15:14.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:14 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:14.110+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:39.437732+0000 front 2024-09-13T16:14:39.438661+0000 (oldest deadline 2024-09-13T16:15:01.737835+0000) 2024-09-13T16:15:14.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:14 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:14.110+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:46.339839+0000 front 2024-09-13T16:14:46.339859+0000 (oldest deadline 2024-09-13T16:15:11.039737+0000) 2024-09-13T16:15:14.575 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:14 smithi193 podman[71968]: 2024-09-13 16:15:14.277956417 +0000 UTC m=+5.605305823 container died 1a72f2c27639dffefcadd27f14c64d0914876b5bfc3755df4f1136e5c001aeba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-13T16:15:14.909 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:14 smithi193 podman[71968]: 2024-09-13 16:15:14.664969044 +0000 UTC m=+5.992318406 container cleanup 1a72f2c27639dffefcadd27f14c64d0914876b5bfc3755df4f1136e5c001aeba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-13T16:15:14.909 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:14 smithi193 bash[71968]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8 2024-09-13T16:15:15.222 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:14 smithi193 podman[71994]: 2024-09-13 16:15:14.908208099 +0000 UTC m=+0.622180034 container remove 1a72f2c27639dffefcadd27f14c64d0914876b5bfc3755df4f1136e5c001aeba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T16:15:15.223 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:15 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:15.025+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:15.223 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:15 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:15.025+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:15.223 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:15 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:15.025+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:15.223 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:15 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:15.025+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:15.223 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:15 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:15.025+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:15.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:14 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:14.887+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:15.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:14 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:14.887+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:15.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:14 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:14.887+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:15.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:14 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:14.887+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:15.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:14 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:14.887+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:15.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:14 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:14.887+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:43.653192+0000 front 2024-09-13T16:14:43.653215+0000 (oldest deadline 2024-09-13T16:15:12.453598+0000) 2024-09-13T16:15:15.504 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:15 smithi193 podman[72087]: 2024-09-13 16:15:15.124759064 +0000 UTC m=+0.015736314 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:15:15.505 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:15 smithi193 podman[72087]: 2024-09-13 16:15:15.225589004 +0000 UTC m=+0.116566292 container create 729a483e136717d903c8a6c8221469e1fd6483c8d12ce29bf1d26ef923b1b80a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-13T16:15:15.505 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:15 smithi193 podman[72087]: 2024-09-13 16:15:15.463476059 +0000 UTC m=+0.354453305 container init 729a483e136717d903c8a6c8221469e1fd6483c8d12ce29bf1d26ef923b1b80a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:15:15.505 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:15 smithi193 podman[72087]: 2024-09-13 16:15:15.466880556 +0000 UTC m=+0.357857799 container start 729a483e136717d903c8a6c8221469e1fd6483c8d12ce29bf1d26ef923b1b80a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8-deactivate, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T16:15:15.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:15 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:15.149+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:15:15.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:15 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:15.149+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:15:15.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:15 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:15.149+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:15:15.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:15 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:15.149+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:15:15.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:15 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:15.149+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:39.437732+0000 front 2024-09-13T16:14:39.438661+0000 (oldest deadline 2024-09-13T16:15:01.737835+0000) 2024-09-13T16:15:15.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:15 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:15.149+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:46.339839+0000 front 2024-09-13T16:14:46.339859+0000 (oldest deadline 2024-09-13T16:15:11.039737+0000) 2024-09-13T16:15:15.976 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:15 smithi193 podman[72087]: 2024-09-13 16:15:15.571941164 +0000 UTC m=+0.462918418 container attach 729a483e136717d903c8a6c8221469e1fd6483c8d12ce29bf1d26ef923b1b80a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:15:15.976 INFO:journalctl@ceph.osd.8.smithi193.stdout:Sep 13 16:15:15 smithi193 podman[72087]: 2024-09-13 16:15:15.661672768 +0000 UTC m=+0.552650014 container died 729a483e136717d903c8a6c8221469e1fd6483c8d12ce29bf1d26ef923b1b80a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T16:15:16.251 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:16 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:16.015+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:16.251 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:16 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:16.015+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:16.252 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:16 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:16.015+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:16.252 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:16 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:16.015+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:16.252 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:16 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:16.015+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:16.274 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.8.service' 2024-09-13T16:15:16.315 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:15:16.316 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-13T16:15:16.316 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-13T16:15:16.316 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.9 2024-09-13T16:15:16.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:15 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:15.932+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:16.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:15 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:15.932+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:16.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:15 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:15.932+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:16.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:15 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:15.932+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:16.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:15 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:15.932+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:16.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:15 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:15.932+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:43.653192+0000 front 2024-09-13T16:14:43.653215+0000 (oldest deadline 2024-09-13T16:15:12.453598+0000) 2024-09-13T16:15:16.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:16.171+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:15:16.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:16.171+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:15:16.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:16.171+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:15:16.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:16.171+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:15:16.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:16.171+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:39.437732+0000 front 2024-09-13T16:14:39.438661+0000 (oldest deadline 2024-09-13T16:15:01.737835+0000) 2024-09-13T16:15:16.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:16.171+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:46.339839+0000 front 2024-09-13T16:14:46.339859+0000 (oldest deadline 2024-09-13T16:15:11.039737+0000) 2024-09-13T16:15:16.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:16 smithi017 systemd[1]: Stopping Ceph osd.9 for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:15:17.183 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:16.776+0000 7f57d6a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:15:17.184 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:16.776+0000 7f57d6a00640 -1 osd.9 98 *** Got signal Terminated *** 2024-09-13T16:15:17.184 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:16 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:16.776+0000 7f57d6a00640 -1 osd.9 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:15:17.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:16 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:16.972+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:17.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:16 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:16.972+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:17.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:16 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:16.972+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:17.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:16 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:16.972+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:17.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:16 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:16.972+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:17.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:16 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:16.972+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:43.653192+0000 front 2024-09-13T16:14:43.653215+0000 (oldest deadline 2024-09-13T16:15:12.453598+0000) 2024-09-13T16:15:17.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:17 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:17.005+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:17.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:17 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:17.005+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:17.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:17 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:17.005+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:17.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:17 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:17.005+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:17.505 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:17 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:17.005+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:17.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:17 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:17.182+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:15:17.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:17 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:17.182+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:15:17.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:17 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:17.182+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:15:17.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:17 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:17.182+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:15:17.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:17 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:17.182+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:39.437732+0000 front 2024-09-13T16:14:39.438661+0000 (oldest deadline 2024-09-13T16:15:01.737835+0000) 2024-09-13T16:15:17.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:17 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:17.182+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:46.339839+0000 front 2024-09-13T16:14:46.339859+0000 (oldest deadline 2024-09-13T16:15:11.039737+0000) 2024-09-13T16:15:18.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:17 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:17.968+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:18.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:17 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:17.968+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:18.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:17 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:17.968+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:18.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:17 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:17.968+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:18.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:17 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:17.968+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:18.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:17 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:17.943+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:18.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:17 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:17.943+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:18.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:17 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:17.943+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:18.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:17 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:17.943+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:18.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:17 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:17.943+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:18.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:17 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:17.943+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:43.653192+0000 front 2024-09-13T16:14:43.653215+0000 (oldest deadline 2024-09-13T16:15:12.453598+0000) 2024-09-13T16:15:18.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:18 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:18.145+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:15:18.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:18 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:18.145+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:15:18.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:18 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:18.145+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:15:18.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:18 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:18.145+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:15:18.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:18 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:18.145+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:39.437732+0000 front 2024-09-13T16:14:39.438661+0000 (oldest deadline 2024-09-13T16:15:01.737835+0000) 2024-09-13T16:15:18.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:18 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:18.145+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:46.339839+0000 front 2024-09-13T16:14:46.339859+0000 (oldest deadline 2024-09-13T16:15:11.039737+0000) 2024-09-13T16:15:19.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:18 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:18.987+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:19.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:18 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:18.987+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:19.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:18 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:18.987+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:19.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:18 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:18.987+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:19.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:18 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:18.987+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:19.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:18 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:18.987+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:54.287987+0000 front 2024-09-13T16:14:54.287892+0000 (oldest deadline 2024-09-13T16:15:18.387744+0000) 2024-09-13T16:15:19.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:18 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:18.991+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:19.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:18 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:18.991+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:19.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:18 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:18.991+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:19.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:18 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:18.991+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:19.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:18 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:18.991+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:19.358 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:18 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:18.991+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:43.653192+0000 front 2024-09-13T16:14:43.653215+0000 (oldest deadline 2024-09-13T16:15:12.453598+0000) 2024-09-13T16:15:19.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:19 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:19.188+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:15:19.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:19 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:19.188+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:15:19.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:19 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:19.188+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:15:19.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:19 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:19.188+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:15:19.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:19 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:19.188+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:39.437732+0000 front 2024-09-13T16:14:39.438661+0000 (oldest deadline 2024-09-13T16:15:01.737835+0000) 2024-09-13T16:15:19.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:19 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:19.188+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:46.339839+0000 front 2024-09-13T16:14:46.339859+0000 (oldest deadline 2024-09-13T16:15:11.039737+0000) 2024-09-13T16:15:20.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:19 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:19.984+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:20.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:19 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:19.984+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:20.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:19 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:19.984+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:20.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:19 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:19.984+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:20.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:19 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:19.984+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:20.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:19 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:19.984+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:54.287987+0000 front 2024-09-13T16:14:54.287892+0000 (oldest deadline 2024-09-13T16:15:18.387744+0000) 2024-09-13T16:15:20.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:20 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:20.039+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:20.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:20 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:20.039+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:20.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:20 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:20.039+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:20.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:20 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:20.039+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:20.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:20 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:20.039+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:20.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:20 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:20.039+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:43.653192+0000 front 2024-09-13T16:14:43.653215+0000 (oldest deadline 2024-09-13T16:15:12.453598+0000) 2024-09-13T16:15:20.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:20 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:20.039+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:53.554850+0000 front 2024-09-13T16:14:53.554763+0000 (oldest deadline 2024-09-13T16:15:19.454746+0000) 2024-09-13T16:15:20.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:20.205+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:15:20.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:20.205+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:15:20.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:20.205+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:15:20.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:20.205+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:15:20.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:20.205+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:39.437732+0000 front 2024-09-13T16:14:39.438661+0000 (oldest deadline 2024-09-13T16:15:01.737835+0000) 2024-09-13T16:15:20.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:20 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:20.205+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:46.339839+0000 front 2024-09-13T16:14:46.339859+0000 (oldest deadline 2024-09-13T16:15:11.039737+0000) 2024-09-13T16:15:21.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:21 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:21.001+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:21.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:21 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:21.001+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:21.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:21 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:21.001+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:21.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:21 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:21.001+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:21.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:21 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:21.001+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:21.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:21 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:21.001+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:54.287987+0000 front 2024-09-13T16:14:54.287892+0000 (oldest deadline 2024-09-13T16:15:18.387744+0000) 2024-09-13T16:15:21.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:20 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:20.996+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:21.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:20 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:20.996+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:21.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:20 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:20.996+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:21.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:20 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:20.996+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:21.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:20 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:20.996+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:21.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:20 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:20.996+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:43.653192+0000 front 2024-09-13T16:14:43.653215+0000 (oldest deadline 2024-09-13T16:15:12.453598+0000) 2024-09-13T16:15:21.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:20 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:20.996+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:53.554850+0000 front 2024-09-13T16:14:53.554763+0000 (oldest deadline 2024-09-13T16:15:19.454746+0000) 2024-09-13T16:15:21.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:21 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:21.160+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:04.825371+0000 front 2024-09-13T16:14:04.825338+0000 (oldest deadline 2024-09-13T16:14:28.925554+0000) 2024-09-13T16:15:21.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:21 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:21.160+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:14.029388+0000 front 2024-09-13T16:14:14.029331+0000 (oldest deadline 2024-09-13T16:14:38.729402+0000) 2024-09-13T16:15:21.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:21 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:21.160+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:18.730080+0000 front 2024-09-13T16:14:18.730242+0000 (oldest deadline 2024-09-13T16:14:44.030111+0000) 2024-09-13T16:15:21.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:21 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:21.160+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:30.636018+0000 front 2024-09-13T16:14:30.636046+0000 (oldest deadline 2024-09-13T16:14:55.936239+0000) 2024-09-13T16:15:21.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:21 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:21.160+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:39.437732+0000 front 2024-09-13T16:14:39.438661+0000 (oldest deadline 2024-09-13T16:15:01.737835+0000) 2024-09-13T16:15:21.512 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:21 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9[65630]: 2024-09-13T16:15:21.160+0000 7f57d2400640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:46.339839+0000 front 2024-09-13T16:14:46.339859+0000 (oldest deadline 2024-09-13T16:15:11.039737+0000) 2024-09-13T16:15:22.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:21 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:21.958+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:22.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:21 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:21.958+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:22.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:21 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:21.958+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:22.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:21 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:21.958+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:22.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:21 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:21.958+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:22.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:21 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:21.958+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:54.287987+0000 front 2024-09-13T16:14:54.287892+0000 (oldest deadline 2024-09-13T16:15:18.387744+0000) 2024-09-13T16:15:22.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:22 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:22.022+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:22.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:22 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:22.022+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:22.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:22 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:22.022+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:22.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:22 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:22.022+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:22.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:22 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:22.022+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:22.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:22 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:22.022+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:43.653192+0000 front 2024-09-13T16:14:43.653215+0000 (oldest deadline 2024-09-13T16:15:12.453598+0000) 2024-09-13T16:15:22.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:22 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:22.022+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:53.554850+0000 front 2024-09-13T16:14:53.554763+0000 (oldest deadline 2024-09-13T16:15:19.454746+0000) 2024-09-13T16:15:22.761 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:22 smithi017 podman[93707]: 2024-09-13 16:15:22.495641422 +0000 UTC m=+5.878894796 container died f942766c871466bb63eccd14f6b18af1f27029f8c94c707c0c491ece2a62adc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2) 2024-09-13T16:15:23.050 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:22 smithi017 podman[93707]: 2024-09-13 16:15:22.873568226 +0000 UTC m=+6.256821598 container cleanup f942766c871466bb63eccd14f6b18af1f27029f8c94c707c0c491ece2a62adc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-13T16:15:23.050 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:22 smithi017 bash[93707]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9 2024-09-13T16:15:23.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:22 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:22.934+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:23.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:22 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:22.934+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:23.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:22 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:22.934+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:23.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:22 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:22.934+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:23.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:22 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:22.934+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:23.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:22 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:22.934+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:54.287987+0000 front 2024-09-13T16:14:54.287892+0000 (oldest deadline 2024-09-13T16:15:18.387744+0000) 2024-09-13T16:15:23.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:22 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:22.986+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:23.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:22 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:22.986+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:23.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:22 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:22.986+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:23.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:22 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:22.986+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:23.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:22 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:22.986+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:23.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:22 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:22.986+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:43.653192+0000 front 2024-09-13T16:14:43.653215+0000 (oldest deadline 2024-09-13T16:15:12.453598+0000) 2024-09-13T16:15:23.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:22 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:22.986+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:53.554850+0000 front 2024-09-13T16:14:53.554763+0000 (oldest deadline 2024-09-13T16:15:19.454746+0000) 2024-09-13T16:15:23.511 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:23 smithi017 podman[93725]: 2024-09-13 16:15:23.049610923 +0000 UTC m=+0.533594547 container remove f942766c871466bb63eccd14f6b18af1f27029f8c94c707c0c491ece2a62adc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-13T16:15:23.844 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:23 smithi017 podman[93809]: 2024-09-13 16:15:23.498319103 +0000 UTC m=+0.027507124 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:15:23.844 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:23 smithi017 podman[93809]: 2024-09-13 16:15:23.625821612 +0000 UTC m=+0.155009622 container create 2cf52aa07789ecf50991df011d56dc94c66f8463630f7f9b62f5fdfa203d7ab6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:15:23.844 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:23 smithi017 podman[93809]: 2024-09-13 16:15:23.836471543 +0000 UTC m=+0.365659549 container init 2cf52aa07789ecf50991df011d56dc94c66f8463630f7f9b62f5fdfa203d7ab6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-13T16:15:23.844 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:23 smithi017 podman[93809]: 2024-09-13 16:15:23.843249631 +0000 UTC m=+0.372437638 container start 2cf52aa07789ecf50991df011d56dc94c66f8463630f7f9b62f5fdfa203d7ab6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:15:24.100 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:23 smithi017 podman[93809]: 2024-09-13 16:15:23.919739767 +0000 UTC m=+0.448927773 container attach 2cf52aa07789ecf50991df011d56dc94c66f8463630f7f9b62f5fdfa203d7ab6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-13T16:15:24.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:23 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:23.971+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:24.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:23 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:23.971+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:24.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:23 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:23.971+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:24.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:23 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:23.971+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:24.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:23 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:23.971+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:24.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:23 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:23.971+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:54.287987+0000 front 2024-09-13T16:14:54.287892+0000 (oldest deadline 2024-09-13T16:15:18.387744+0000) 2024-09-13T16:15:24.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:23 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:23.938+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:24.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:23 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:23.938+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:24.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:23 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:23.938+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:24.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:23 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:23.938+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:24.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:23 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:23.938+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:24.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:23 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:23.938+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:43.653192+0000 front 2024-09-13T16:14:43.653215+0000 (oldest deadline 2024-09-13T16:15:12.453598+0000) 2024-09-13T16:15:24.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:23 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:23.938+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:53.554850+0000 front 2024-09-13T16:14:53.554763+0000 (oldest deadline 2024-09-13T16:15:19.454746+0000) 2024-09-13T16:15:24.390 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 13 16:15:24 smithi017 podman[93809]: 2024-09-13 16:15:24.100323209 +0000 UTC m=+0.629511229 container died 2cf52aa07789ecf50991df011d56dc94c66f8463630f7f9b62f5fdfa203d7ab6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-13T16:15:24.743 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.9.service' 2024-09-13T16:15:24.821 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:15:24.821 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-13T16:15:24.821 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-13T16:15:24.821 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.10 2024-09-13T16:15:25.106 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:24 smithi189 systemd[1]: Stopping Ceph osd.10 for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:15:25.107 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:24 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:24.896+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:25.107 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:24 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:24.896+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:25.107 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:24 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:24.896+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:25.107 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:24 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:24.896+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:25.107 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:24 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:24.896+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:25.107 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:24 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:24.896+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:43.653192+0000 front 2024-09-13T16:14:43.653215+0000 (oldest deadline 2024-09-13T16:15:12.453598+0000) 2024-09-13T16:15:25.107 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:24 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:24.896+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:53.554850+0000 front 2024-09-13T16:14:53.554763+0000 (oldest deadline 2024-09-13T16:15:19.454746+0000) 2024-09-13T16:15:25.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:24 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:24.974+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:25.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:24 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:24.974+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:25.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:24 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:24.974+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:25.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:24 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:24.974+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:25.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:24 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:24.974+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:25.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:24 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:24.974+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:54.287987+0000 front 2024-09-13T16:14:54.287892+0000 (oldest deadline 2024-09-13T16:15:18.387744+0000) 2024-09-13T16:15:25.606 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:25 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:25.115+0000 7f2d60412640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:15:25.606 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:25 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:25.115+0000 7f2d60412640 -1 osd.10 98 *** Got signal Terminated *** 2024-09-13T16:15:25.606 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:25 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:25.115+0000 7f2d60412640 -1 osd.10 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:15:26.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:25 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:25.956+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:26.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:25 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:25.956+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:26.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:25 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:25.956+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:26.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:25 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:25.956+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:26.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:25 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:25.956+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:26.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:25 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:25.956+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:54.287987+0000 front 2024-09-13T16:14:54.287892+0000 (oldest deadline 2024-09-13T16:15:18.387744+0000) 2024-09-13T16:15:26.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:25 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:25.897+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:26.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:25 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:25.897+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:26.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:25 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:25.897+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:26.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:25 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:25.897+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:26.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:25 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:25.897+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:26.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:25 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:25.897+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:43.653192+0000 front 2024-09-13T16:14:43.653215+0000 (oldest deadline 2024-09-13T16:15:12.453598+0000) 2024-09-13T16:15:26.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:25 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:25.897+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:53.554850+0000 front 2024-09-13T16:14:53.554763+0000 (oldest deadline 2024-09-13T16:15:19.454746+0000) 2024-09-13T16:15:27.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:26 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:26.962+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:27.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:26 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:26.962+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:27.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:26 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:26.962+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:27.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:26 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:26.962+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:27.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:26 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:26.962+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:27.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:26 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:26.962+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:54.287987+0000 front 2024-09-13T16:14:54.287892+0000 (oldest deadline 2024-09-13T16:15:18.387744+0000) 2024-09-13T16:15:27.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:26 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:26.927+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:27.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:26 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:26.927+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:27.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:26 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:26.927+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:27.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:26 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:26.927+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:27.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:26 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:26.927+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:27.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:26 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:26.927+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:43.653192+0000 front 2024-09-13T16:14:43.653215+0000 (oldest deadline 2024-09-13T16:15:12.453598+0000) 2024-09-13T16:15:27.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:26 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:26.927+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:53.554850+0000 front 2024-09-13T16:14:53.554763+0000 (oldest deadline 2024-09-13T16:15:19.454746+0000) 2024-09-13T16:15:28.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:27 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:27.913+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:28.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:27 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:27.913+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:28.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:27 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:27.913+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:28.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:27 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:27.913+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:28.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:27 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:27.913+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:28.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:27 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:27.913+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:54.287987+0000 front 2024-09-13T16:14:54.287892+0000 (oldest deadline 2024-09-13T16:15:18.387744+0000) 2024-09-13T16:15:28.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:27 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:27.913+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6820 osd.7 since back 2024-09-13T16:15:01.288631+0000 front 2024-09-13T16:15:01.288643+0000 (oldest deadline 2024-09-13T16:15:27.188538+0000) 2024-09-13T16:15:28.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:27 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:27.908+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:28.358 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:27 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:27.908+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:28.358 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:27 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:27.908+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:28.358 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:27 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:27.908+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:28.358 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:27 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:27.908+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:28.358 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:27 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:27.908+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:43.653192+0000 front 2024-09-13T16:14:43.653215+0000 (oldest deadline 2024-09-13T16:15:12.453598+0000) 2024-09-13T16:15:28.358 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:27 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:27.908+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:53.554850+0000 front 2024-09-13T16:14:53.554763+0000 (oldest deadline 2024-09-13T16:15:19.454746+0000) 2024-09-13T16:15:29.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:28 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:28.902+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:29.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:28 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:28.902+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:29.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:28 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:28.902+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:29.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:28 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:28.902+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:29.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:28 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:28.902+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:29.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:28 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:28.902+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:54.287987+0000 front 2024-09-13T16:14:54.287892+0000 (oldest deadline 2024-09-13T16:15:18.387744+0000) 2024-09-13T16:15:29.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:28 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:28.902+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6820 osd.7 since back 2024-09-13T16:15:01.288631+0000 front 2024-09-13T16:15:01.288643+0000 (oldest deadline 2024-09-13T16:15:27.188538+0000) 2024-09-13T16:15:29.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:28 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:28.911+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:29.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:28 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:28.911+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:29.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:28 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:28.911+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:29.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:28 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:28.911+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:29.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:28 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:28.911+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:29.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:28 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:28.911+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:43.653192+0000 front 2024-09-13T16:14:43.653215+0000 (oldest deadline 2024-09-13T16:15:12.453598+0000) 2024-09-13T16:15:29.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:28 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:28.911+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:53.554850+0000 front 2024-09-13T16:14:53.554763+0000 (oldest deadline 2024-09-13T16:15:19.454746+0000) 2024-09-13T16:15:30.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:29 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:29.894+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:30.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:29 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:29.894+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:30.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:29 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:29.894+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:30.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:29 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:29.894+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:30.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:29 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:29.894+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:30.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:29 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:29.894+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:54.287987+0000 front 2024-09-13T16:14:54.287892+0000 (oldest deadline 2024-09-13T16:15:18.387744+0000) 2024-09-13T16:15:30.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:29 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:29.894+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6820 osd.7 since back 2024-09-13T16:15:01.288631+0000 front 2024-09-13T16:15:01.288643+0000 (oldest deadline 2024-09-13T16:15:27.188538+0000) 2024-09-13T16:15:30.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:29 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:29.909+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:01.845580+0000 front 2024-09-13T16:14:01.845515+0000 (oldest deadline 2024-09-13T16:14:27.745778+0000) 2024-09-13T16:15:30.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:29 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:29.909+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6804 osd.1 since back 2024-09-13T16:14:13.948797+0000 front 2024-09-13T16:14:13.948835+0000 (oldest deadline 2024-09-13T16:14:36.248903+0000) 2024-09-13T16:15:30.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:29 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:29.909+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:19.149781+0000 front 2024-09-13T16:14:19.149973+0000 (oldest deadline 2024-09-13T16:14:45.049802+0000) 2024-09-13T16:15:30.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:29 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:29.909+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.350800+0000 front 2024-09-13T16:14:27.350768+0000 (oldest deadline 2024-09-13T16:14:56.151325+0000) 2024-09-13T16:15:30.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:29 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:29.909+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:38.452085+0000 front 2024-09-13T16:14:38.452142+0000 (oldest deadline 2024-09-13T16:15:02.552341+0000) 2024-09-13T16:15:30.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:29 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:29.909+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:43.653192+0000 front 2024-09-13T16:14:43.653215+0000 (oldest deadline 2024-09-13T16:15:12.453598+0000) 2024-09-13T16:15:30.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:29 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10[59517]: 2024-09-13T16:15:29.909+0000 7f2d5ca26640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:53.554850+0000 front 2024-09-13T16:14:53.554763+0000 (oldest deadline 2024-09-13T16:15:19.454746+0000) 2024-09-13T16:15:30.833 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:30 smithi189 podman[71161]: 2024-09-13 16:15:30.561505944 +0000 UTC m=+5.544813239 container died ec8e606ae6434dd64fced663c1500f291628c2da36ff12581d8c726c76fa3d47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:15:31.106 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:30 smithi189 podman[71161]: 2024-09-13 16:15:30.923854783 +0000 UTC m=+5.907162069 container cleanup ec8e606ae6434dd64fced663c1500f291628c2da36ff12581d8c726c76fa3d47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-13T16:15:31.106 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:30 smithi189 bash[71161]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10 2024-09-13T16:15:31.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:30 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:30.924+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:31.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:30 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:30.924+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:31.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:30 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:30.924+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:31.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:30 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:30.924+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:31.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:30 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:30.924+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:31.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:30 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:30.924+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:54.287987+0000 front 2024-09-13T16:14:54.287892+0000 (oldest deadline 2024-09-13T16:15:18.387744+0000) 2024-09-13T16:15:31.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:30 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:30.924+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6820 osd.7 since back 2024-09-13T16:15:01.288631+0000 front 2024-09-13T16:15:01.288643+0000 (oldest deadline 2024-09-13T16:15:27.188538+0000) 2024-09-13T16:15:31.539 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:31 smithi189 podman[71175]: 2024-09-13 16:15:31.191598952 +0000 UTC m=+0.632450001 container remove ec8e606ae6434dd64fced663c1500f291628c2da36ff12581d8c726c76fa3d47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:15:31.856 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:31 smithi189 podman[71262]: 2024-09-13 16:15:31.440849095 +0000 UTC m=+0.015979789 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:15:31.856 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:31 smithi189 podman[71262]: 2024-09-13 16:15:31.584274908 +0000 UTC m=+0.159405648 container create 6163c9d63724232f836d6526d7d30d40b65119f0382c5bdb643613867b597d93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:15:32.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:31 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:31.911+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:32.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:31 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:31.911+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:32.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:31 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:31.911+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:32.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:31 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:31.911+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:32.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:31 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:31.911+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:32.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:31 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:31.911+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:54.287987+0000 front 2024-09-13T16:14:54.287892+0000 (oldest deadline 2024-09-13T16:15:18.387744+0000) 2024-09-13T16:15:32.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:31 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:31.911+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6820 osd.7 since back 2024-09-13T16:15:01.288631+0000 front 2024-09-13T16:15:01.288643+0000 (oldest deadline 2024-09-13T16:15:27.188538+0000) 2024-09-13T16:15:32.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:31 smithi189 podman[71262]: 2024-09-13 16:15:31.903522885 +0000 UTC m=+0.478653579 container init 6163c9d63724232f836d6526d7d30d40b65119f0382c5bdb643613867b597d93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2) 2024-09-13T16:15:32.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:31 smithi189 podman[71262]: 2024-09-13 16:15:31.906853651 +0000 UTC m=+0.481984353 container start 6163c9d63724232f836d6526d7d30d40b65119f0382c5bdb643613867b597d93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-13T16:15:32.356 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:31 smithi189 podman[71262]: 2024-09-13 16:15:31.986673419 +0000 UTC m=+0.561804134 container attach 6163c9d63724232f836d6526d7d30d40b65119f0382c5bdb643613867b597d93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-13T16:15:32.357 INFO:journalctl@ceph.osd.10.smithi189.stdout:Sep 13 16:15:32 smithi189 podman[71262]: 2024-09-13 16:15:32.091670611 +0000 UTC m=+0.666801307 container died 6163c9d63724232f836d6526d7d30d40b65119f0382c5bdb643613867b597d93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-13T16:15:32.680 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.10.service' 2024-09-13T16:15:32.721 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:15:32.721 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-13T16:15:32.721 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-13T16:15:32.721 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.11 2024-09-13T16:15:33.005 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:32 smithi193 systemd[1]: Stopping Ceph osd.11 for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:15:33.005 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:32 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:32.922+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:33.005 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:32 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:32.922+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:33.005 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:32 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:32.922+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:33.005 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:32 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:32.922+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:33.005 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:32 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:32.922+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:33.005 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:32 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:32.922+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:54.287987+0000 front 2024-09-13T16:14:54.287892+0000 (oldest deadline 2024-09-13T16:15:18.387744+0000) 2024-09-13T16:15:33.005 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:32 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:32.922+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6820 osd.7 since back 2024-09-13T16:15:01.288631+0000 front 2024-09-13T16:15:01.288643+0000 (oldest deadline 2024-09-13T16:15:27.188538+0000) 2024-09-13T16:15:33.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:33 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:33.028+0000 7fb69ef9f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:15:33.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:33 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:33.028+0000 7fb69ef9f640 -1 osd.11 98 *** Got signal Terminated *** 2024-09-13T16:15:33.504 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:33 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:33.028+0000 7fb69ef9f640 -1 osd.11 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T16:15:34.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:33 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:33.904+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:34.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:33 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:33.904+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:34.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:33 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:33.904+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:34.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:33 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:33.904+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:34.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:33 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:33.904+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:34.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:33 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:33.904+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:54.287987+0000 front 2024-09-13T16:14:54.287892+0000 (oldest deadline 2024-09-13T16:15:18.387744+0000) 2024-09-13T16:15:34.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:33 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:33.904+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6820 osd.7 since back 2024-09-13T16:15:01.288631+0000 front 2024-09-13T16:15:01.288643+0000 (oldest deadline 2024-09-13T16:15:27.188538+0000) 2024-09-13T16:15:35.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:34 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:34.868+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:35.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:34 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:34.868+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:35.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:34 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:34.868+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:35.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:34 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:34.868+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:35.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:34 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:34.868+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:35.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:34 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:34.868+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:54.287987+0000 front 2024-09-13T16:14:54.287892+0000 (oldest deadline 2024-09-13T16:15:18.387744+0000) 2024-09-13T16:15:35.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:34 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:34.868+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6820 osd.7 since back 2024-09-13T16:15:01.288631+0000 front 2024-09-13T16:15:01.288643+0000 (oldest deadline 2024-09-13T16:15:27.188538+0000) 2024-09-13T16:15:36.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:35 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:35.898+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:36.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:35 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:35.898+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:36.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:35 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:35.898+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:36.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:35 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:35.898+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:36.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:35 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:35.898+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:36.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:35 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:35.898+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:54.287987+0000 front 2024-09-13T16:14:54.287892+0000 (oldest deadline 2024-09-13T16:15:18.387744+0000) 2024-09-13T16:15:36.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:35 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:35.898+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6820 osd.7 since back 2024-09-13T16:15:01.288631+0000 front 2024-09-13T16:15:01.288643+0000 (oldest deadline 2024-09-13T16:15:27.188538+0000) 2024-09-13T16:15:36.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:35 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:35.898+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6820 osd.8 since back 2024-09-13T16:15:12.890176+0000 front 2024-09-13T16:15:12.890201+0000 (oldest deadline 2024-09-13T16:15:35.790267+0000) 2024-09-13T16:15:37.175 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:36 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:36.909+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:37.175 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:36 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:36.909+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:37.175 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:36 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:36.909+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:37.175 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:36 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:36.909+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:37.175 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:36 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:36.909+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:37.175 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:36 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:36.909+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:54.287987+0000 front 2024-09-13T16:14:54.287892+0000 (oldest deadline 2024-09-13T16:15:18.387744+0000) 2024-09-13T16:15:37.175 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:36 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:36.909+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6820 osd.7 since back 2024-09-13T16:15:01.288631+0000 front 2024-09-13T16:15:01.288643+0000 (oldest deadline 2024-09-13T16:15:27.188538+0000) 2024-09-13T16:15:37.175 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:36 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:36.909+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6820 osd.8 since back 2024-09-13T16:15:12.890176+0000 front 2024-09-13T16:15:12.890201+0000 (oldest deadline 2024-09-13T16:15:35.790267+0000) 2024-09-13T16:15:38.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:37 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:37.880+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-13T16:14:02.279638+0000 front 2024-09-13T16:14:02.279772+0000 (oldest deadline 2024-09-13T16:14:27.579769+0000) 2024-09-13T16:15:38.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:37 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:37.880+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6804 osd.2 since back 2024-09-13T16:14:21.582779+0000 front 2024-09-13T16:14:21.582912+0000 (oldest deadline 2024-09-13T16:14:46.283036+0000) 2024-09-13T16:15:38.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:37 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:37.880+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-13T16:14:27.984054+0000 front 2024-09-13T16:14:27.984175+0000 (oldest deadline 2024-09-13T16:14:56.784586+0000) 2024-09-13T16:15:38.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:37 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:37.880+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6812 osd.4 since back 2024-09-13T16:14:36.785082+0000 front 2024-09-13T16:14:36.785071+0000 (oldest deadline 2024-09-13T16:15:02.085086+0000) 2024-09-13T16:15:38.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:37 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:37.880+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6812 osd.5 since back 2024-09-13T16:14:47.886295+0000 front 2024-09-13T16:14:47.886376+0000 (oldest deadline 2024-09-13T16:15:10.186416+0000) 2024-09-13T16:15:38.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:37 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:37.880+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-13T16:14:54.287987+0000 front 2024-09-13T16:14:54.287892+0000 (oldest deadline 2024-09-13T16:15:18.387744+0000) 2024-09-13T16:15:38.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:37 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:37.880+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.189:6820 osd.7 since back 2024-09-13T16:15:01.288631+0000 front 2024-09-13T16:15:01.288643+0000 (oldest deadline 2024-09-13T16:15:27.188538+0000) 2024-09-13T16:15:38.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:37 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11[60365]: 2024-09-13T16:15:37.880+0000 7fb6975ab640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.193:6820 osd.8 since back 2024-09-13T16:15:12.890176+0000 front 2024-09-13T16:15:12.890201+0000 (oldest deadline 2024-09-13T16:15:35.790267+0000) 2024-09-13T16:15:38.977 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:38 smithi193 podman[72190]: 2024-09-13 16:15:38.679763869 +0000 UTC m=+5.759403874 container died 68d1f3a3c4124c21e0ceb4bca832562f4cc331cec703be68f6d645c0411c22b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0) 2024-09-13T16:15:39.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:38 smithi193 podman[72190]: 2024-09-13 16:15:38.976885828 +0000 UTC m=+6.056525822 container cleanup 68d1f3a3c4124c21e0ceb4bca832562f4cc331cec703be68f6d645c0411c22b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-13T16:15:39.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:38 smithi193 bash[72190]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11 2024-09-13T16:15:39.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:39 smithi193 podman[72217]: 2024-09-13 16:15:39.144953103 +0000 UTC m=+0.459267330 container remove 68d1f3a3c4124c21e0ceb4bca832562f4cc331cec703be68f6d645c0411c22b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T16:15:39.873 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:39 smithi193 podman[72304]: 2024-09-13 16:15:39.578988709 +0000 UTC m=+0.107152874 container create 7904e799360a6cfb485e7fa5bdee965d36826c35608d6895156e2497425203a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-13T16:15:39.874 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:39 smithi193 podman[72304]: 2024-09-13 16:15:39.487694816 +0000 UTC m=+0.015858992 image pull 152d8bc6b19e354515e8ba109d4619445de0e09b4d4a747c2f16eb5c0edb670c quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a 2024-09-13T16:15:39.874 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:39 smithi193 podman[72304]: 2024-09-13 16:15:39.806020266 +0000 UTC m=+0.334184438 container init 7904e799360a6cfb485e7fa5bdee965d36826c35608d6895156e2497425203a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-13T16:15:39.874 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:39 smithi193 podman[72304]: 2024-09-13 16:15:39.80937661 +0000 UTC m=+0.337540784 container start 7904e799360a6cfb485e7fa5bdee965d36826c35608d6895156e2497425203a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-13T16:15:40.254 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:39 smithi193 podman[72304]: 2024-09-13 16:15:39.872822915 +0000 UTC m=+0.400987096 container attach 7904e799360a6cfb485e7fa5bdee965d36826c35608d6895156e2497425203a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-13T16:15:40.255 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:39 smithi193 podman[72304]: 2024-09-13 16:15:39.995567812 +0000 UTC m=+0.523731978 container died 7904e799360a6cfb485e7fa5bdee965d36826c35608d6895156e2497425203a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-09-13T16:15:40.510 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.11.service' 2024-09-13T16:15:40.533 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:40 smithi193 podman[72327]: 2024-09-13 16:15:40.492909361 +0000 UTC m=+0.490837464 container remove 7904e799360a6cfb485e7fa5bdee965d36826c35608d6895156e2497425203a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:15:40.533 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:40 smithi193 systemd[1]: ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.11.service: Deactivated successfully. 2024-09-13T16:15:40.533 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:40 smithi193 systemd[1]: Stopped Ceph osd.11 for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T16:15:40.533 INFO:journalctl@ceph.osd.11.smithi193.stdout:Sep 13 16:15:40 smithi193 systemd[1]: ceph-3334a620-71e7-11ef-bceb-c7b262605968@osd.11.service: Consumed 13min 35.382s CPU time. 2024-09-13T16:15:40.548 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:15:40.548 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-13T16:15:40.548 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-13T16:15:40.548 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.a 2024-09-13T16:15:40.962 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 13 16:15:40 smithi017 systemd[1]: Stopping Ceph mds.a for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:15:41.261 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 13 16:15:40 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-a[72484]: 2024-09-13T16:15:40.961+0000 7f5b48a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:15:41.261 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 13 16:15:40 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-a[72484]: 2024-09-13T16:15:40.961+0000 7f5b48a00640 -1 mds.a *** got signal Terminated *** 2024-09-13T16:15:45.185 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 13 16:15:44 smithi017 podman[93924]: 2024-09-13 16:15:44.922498527 +0000 UTC m=+4.073796214 container died bd97b9a2c4b3cb30141b9307d111070497611d3338dd7e65d5aa0c1b8d31e2f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-13T16:15:45.460 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 13 16:15:45 smithi017 podman[93924]: 2024-09-13 16:15:45.29093665 +0000 UTC m=+4.442234333 container cleanup bd97b9a2c4b3cb30141b9307d111070497611d3338dd7e65d5aa0c1b8d31e2f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-13T16:15:45.460 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 13 16:15:45 smithi017 bash[93924]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-a 2024-09-13T16:15:45.727 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 13 16:15:45 smithi017 podman[93937]: 2024-09-13 16:15:45.459094219 +0000 UTC m=+0.522404618 container remove bd97b9a2c4b3cb30141b9307d111070497611d3338dd7e65d5aa0c1b8d31e2f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS) 2024-09-13T16:15:45.756 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.a.service' 2024-09-13T16:15:45.829 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:15:45.829 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-13T16:15:45.830 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-13T16:15:45.830 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.d 2024-09-13T16:15:46.011 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 13 16:15:45 smithi017 systemd[1]: Stopping Ceph mds.d for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:15:46.511 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 13 16:15:46 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-d[71541]: 2024-09-13T16:15:46.214+0000 7f0abb000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:15:46.511 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 13 16:15:46 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-d[71541]: 2024-09-13T16:15:46.214+0000 7f0abb000640 -1 mds.d *** got signal Terminated *** 2024-09-13T16:15:49.696 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 13 16:15:49 smithi017 podman[94043]: 2024-09-13 16:15:49.434709861 +0000 UTC m=+3.330066771 container died b08731d97bbba29542f4a7be35a264de371efd70494f8ff3f819e31435e7b1ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:15:50.011 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 13 16:15:49 smithi017 podman[94043]: 2024-09-13 16:15:49.802711698 +0000 UTC m=+3.698068602 container cleanup b08731d97bbba29542f4a7be35a264de371efd70494f8ff3f819e31435e7b1ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T16:15:50.011 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 13 16:15:49 smithi017 bash[94043]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-d 2024-09-13T16:15:50.258 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.d.service' 2024-09-13T16:15:50.328 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:15:50.329 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-13T16:15:50.329 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-13T16:15:50.329 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.g 2024-09-13T16:15:50.718 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 13 16:15:50 smithi017 systemd[1]: Stopping Ceph mds.g for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:15:51.011 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 13 16:15:50 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-g[72089]: 2024-09-13T16:15:50.717+0000 7ff0c0c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:15:51.011 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 13 16:15:50 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-g[72089]: 2024-09-13T16:15:50.717+0000 7ff0c0c00640 -1 mds.g *** got signal Terminated *** 2024-09-13T16:15:54.258 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 13 16:15:53 smithi017 podman[94159]: 2024-09-13 16:15:53.961317583 +0000 UTC m=+3.355092567 container died 7d5f25adab6e60603219a0c3b01bc5485b205afa4af5f2f5f9faf3bdc4af9ff9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:15:54.511 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 13 16:15:54 smithi017 podman[94159]: 2024-09-13 16:15:54.365261905 +0000 UTC m=+3.759036896 container cleanup 7d5f25adab6e60603219a0c3b01bc5485b205afa4af5f2f5f9faf3bdc4af9ff9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-g, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-13T16:15:54.511 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 13 16:15:54 smithi017 bash[94159]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-g 2024-09-13T16:15:54.791 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 13 16:15:54 smithi017 podman[94170]: 2024-09-13 16:15:54.641317905 +0000 UTC m=+0.673666144 container remove 7d5f25adab6e60603219a0c3b01bc5485b205afa4af5f2f5f9faf3bdc4af9ff9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T16:15:54.821 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.g.service' 2024-09-13T16:15:54.891 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:15:54.891 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-13T16:15:54.891 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-13T16:15:54.891 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.j 2024-09-13T16:15:55.261 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 13 16:15:54 smithi017 systemd[1]: Stopping Ceph mds.j for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:15:55.761 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 13 16:15:55 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-j[71160]: 2024-09-13T16:15:55.288+0000 7f141ea00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:15:55.761 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 13 16:15:55 smithi017 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-j[71160]: 2024-09-13T16:15:55.288+0000 7f141ea00640 -1 mds.j *** got signal Terminated *** 2024-09-13T16:15:58.453 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 13 16:15:58 smithi017 podman[94280]: 2024-09-13 16:15:58.127603361 +0000 UTC m=+2.955848661 container died ff6c25f0daf619c8f6a2b69909cbdf38761d640699294dc777e9810284c4b138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-j, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:15:58.761 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 13 16:15:58 smithi017 podman[94280]: 2024-09-13 16:15:58.618385347 +0000 UTC m=+3.446630638 container cleanup ff6c25f0daf619c8f6a2b69909cbdf38761d640699294dc777e9810284c4b138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-j, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-13T16:15:58.761 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 13 16:15:58 smithi017 bash[94280]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-j 2024-09-13T16:15:59.054 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.j.service' 2024-09-13T16:15:59.103 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 13 16:15:58 smithi017 podman[94305]: 2024-09-13 16:15:58.803133067 +0000 UTC m=+0.663156016 container remove ff6c25f0daf619c8f6a2b69909cbdf38761d640699294dc777e9810284c4b138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-09-13T16:15:59.103 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 13 16:15:59 smithi017 systemd[1]: ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.j.service: Deactivated successfully. 2024-09-13T16:15:59.103 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 13 16:15:59 smithi017 systemd[1]: Stopped Ceph mds.j for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T16:15:59.103 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 13 16:15:59 smithi017 systemd[1]: ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.j.service: Consumed 1.626s CPU time. 2024-09-13T16:15:59.126 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:15:59.126 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-13T16:15:59.126 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-13T16:15:59.126 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.b 2024-09-13T16:15:59.508 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 13 16:15:59 smithi189 systemd[1]: Stopping Ceph mds.b for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:15:59.856 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 13 16:15:59 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-b[65010]: 2024-09-13T16:15:59.506+0000 7fe6fc8f5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:15:59.856 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 13 16:15:59 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-b[65010]: 2024-09-13T16:15:59.506+0000 7fe6fc8f5640 -1 mds.b *** got signal Terminated *** 2024-09-13T16:16:02.174 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 13 16:16:01 smithi189 podman[71365]: 2024-09-13 16:16:01.903256725 +0000 UTC m=+2.586980626 container died bc454ee8254709cd0ce8dfc0a48962d68516fff07725921a151c4cd4d3486c54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-13T16:16:02.534 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 13 16:16:02 smithi189 podman[71365]: 2024-09-13 16:16:02.273489779 +0000 UTC m=+2.957213679 container cleanup bc454ee8254709cd0ce8dfc0a48962d68516fff07725921a151c4cd4d3486c54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-b, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f) 2024-09-13T16:16:02.534 INFO:journalctl@ceph.mds.b.smithi189.stdout:Sep 13 16:16:02 smithi189 bash[71365]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-b 2024-09-13T16:16:02.677 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.b.service' 2024-09-13T16:16:02.713 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:16:02.713 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-13T16:16:02.714 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-13T16:16:02.714 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.e 2024-09-13T16:16:03.106 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 13 16:16:02 smithi189 systemd[1]: Stopping Ceph mds.e for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:16:03.106 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 13 16:16:03 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-e[64404]: 2024-09-13T16:16:03.035+0000 7f97a0c28640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:16:03.106 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 13 16:16:03 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-e[64404]: 2024-09-13T16:16:03.035+0000 7f97a0c28640 -1 mds.e *** got signal Terminated *** 2024-09-13T16:16:04.279 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 13 16:16:04 smithi189 podman[71499]: 2024-09-13 16:16:04.025453377 +0000 UTC m=+1.090802679 container died cd9adcd13e9cd4b61eec86f62a7b89ad2068706c25aa9b54b8f5ae6ca919225f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-13T16:16:04.606 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 13 16:16:04 smithi189 podman[71499]: 2024-09-13 16:16:04.377564401 +0000 UTC m=+1.442913700 container cleanup cd9adcd13e9cd4b61eec86f62a7b89ad2068706c25aa9b54b8f5ae6ca919225f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-e, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-13T16:16:04.607 INFO:journalctl@ceph.mds.e.smithi189.stdout:Sep 13 16:16:04 smithi189 bash[71499]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-e 2024-09-13T16:16:04.809 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.e.service' 2024-09-13T16:16:04.843 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:16:04.843 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-13T16:16:04.843 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-13T16:16:04.843 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.h 2024-09-13T16:16:05.174 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 13 16:16:04 smithi189 systemd[1]: Stopping Ceph mds.h for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:16:05.606 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 13 16:16:05 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-h[64705]: 2024-09-13T16:16:05.172+0000 7f199bfc1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:16:05.606 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 13 16:16:05 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-h[64705]: 2024-09-13T16:16:05.172+0000 7f199bfc1640 -1 mds.h *** got signal Terminated *** 2024-09-13T16:16:09.606 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 13 16:16:09 smithi189 podman[71622]: 2024-09-13 16:16:09.178475934 +0000 UTC m=+4.119781969 container died ec4d76c37ef10876b67c67cb472d58b09b7669cab59fe7292aaaba70d6c85a12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-13T16:16:09.916 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 13 16:16:09 smithi189 podman[71622]: 2024-09-13 16:16:09.714472745 +0000 UTC m=+4.655778779 container cleanup ec4d76c37ef10876b67c67cb472d58b09b7669cab59fe7292aaaba70d6c85a12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS) 2024-09-13T16:16:09.917 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 13 16:16:09 smithi189 bash[71622]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-h 2024-09-13T16:16:10.145 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.h.service' 2024-09-13T16:16:10.167 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 13 16:16:09 smithi189 podman[71637]: 2024-09-13 16:16:09.915739408 +0000 UTC m=+0.730406729 container remove ec4d76c37ef10876b67c67cb472d58b09b7669cab59fe7292aaaba70d6c85a12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-h, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T16:16:10.167 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 13 16:16:10 smithi189 systemd[1]: ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.h.service: Deactivated successfully. 2024-09-13T16:16:10.167 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 13 16:16:10 smithi189 systemd[1]: Stopped Ceph mds.h for 3334a620-71e7-11ef-bceb-c7b262605968. 2024-09-13T16:16:10.167 INFO:journalctl@ceph.mds.h.smithi189.stdout:Sep 13 16:16:10 smithi189 systemd[1]: ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.h.service: Consumed 2.848s CPU time. 2024-09-13T16:16:10.179 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:16:10.179 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-13T16:16:10.179 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-13T16:16:10.179 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.k 2024-09-13T16:16:10.536 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 13 16:16:10 smithi189 systemd[1]: Stopping Ceph mds.k for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:16:10.856 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 13 16:16:10 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-k[64088]: 2024-09-13T16:16:10.534+0000 7f37a0158640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:16:10.856 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 13 16:16:10 smithi189 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-k[64088]: 2024-09-13T16:16:10.534+0000 7f37a0158640 -1 mds.k *** got signal Terminated *** 2024-09-13T16:16:14.856 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 13 16:16:14 smithi189 podman[71744]: 2024-09-13 16:16:14.549875257 +0000 UTC m=+4.156266929 container died 6f78886a39d7c9306395bb2fb722b58dcb90ea7c2b0337e604313a87f190c6c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-k, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:16:15.286 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 13 16:16:15 smithi189 podman[71744]: 2024-09-13 16:16:15.026050834 +0000 UTC m=+4.632442496 container cleanup 6f78886a39d7c9306395bb2fb722b58dcb90ea7c2b0337e604313a87f190c6c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T16:16:15.286 INFO:journalctl@ceph.mds.k.smithi189.stdout:Sep 13 16:16:15 smithi189 bash[71744]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-k 2024-09-13T16:16:15.411 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.k.service' 2024-09-13T16:16:15.444 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:16:15.444 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-13T16:16:15.445 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-13T16:16:15.445 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.c 2024-09-13T16:16:15.754 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 13 16:16:15 smithi193 systemd[1]: Stopping Ceph mds.c for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:16:16.009 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 13 16:16:15 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-c[65492]: 2024-09-13T16:16:15.799+0000 7efc90c8b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:16:16.009 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 13 16:16:15 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-c[65492]: 2024-09-13T16:16:15.799+0000 7efc90c8b640 -1 mds.c *** got signal Terminated *** 2024-09-13T16:16:18.176 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 13 16:16:17 smithi193 podman[72406]: 2024-09-13 16:16:17.909181814 +0000 UTC m=+2.275625512 container died b39c8b57f39f5194be55c1122fe1e49ab1e15a1e23e895b480dfa342252b8548 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-13T16:16:18.504 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 13 16:16:18 smithi193 podman[72406]: 2024-09-13 16:16:18.25780414 +0000 UTC m=+2.624247838 container cleanup b39c8b57f39f5194be55c1122fe1e49ab1e15a1e23e895b480dfa342252b8548 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-13T16:16:18.504 INFO:journalctl@ceph.mds.c.smithi193.stdout:Sep 13 16:16:18 smithi193 bash[72406]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-c 2024-09-13T16:16:18.681 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.c.service' 2024-09-13T16:16:18.716 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:16:18.717 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-13T16:16:18.717 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-13T16:16:18.717 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.f 2024-09-13T16:16:19.064 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 13 16:16:18 smithi193 systemd[1]: Stopping Ceph mds.f for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:16:19.504 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 13 16:16:19 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-f[65189]: 2024-09-13T16:16:19.062+0000 7fcbfdcda640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:16:19.504 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 13 16:16:19 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-f[65189]: 2024-09-13T16:16:19.062+0000 7fcbfdcda640 -1 mds.f *** got signal Terminated *** 2024-09-13T16:16:22.254 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 13 16:16:21 smithi193 podman[72538]: 2024-09-13 16:16:21.910402894 +0000 UTC m=+2.963385840 container died 526cecdd5fe90560bedef316e819f52ed7d1a13944182af5562825d8d65fe233 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-f, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-13T16:16:22.605 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 13 16:16:22 smithi193 podman[72538]: 2024-09-13 16:16:22.412052271 +0000 UTC m=+3.465035216 container cleanup 526cecdd5fe90560bedef316e819f52ed7d1a13944182af5562825d8d65fe233 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-13T16:16:22.605 INFO:journalctl@ceph.mds.f.smithi193.stdout:Sep 13 16:16:22 smithi193 bash[72538]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-f 2024-09-13T16:16:22.745 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.f.service' 2024-09-13T16:16:22.779 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:16:22.779 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-13T16:16:22.779 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-13T16:16:22.779 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.i 2024-09-13T16:16:23.254 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 13 16:16:22 smithi193 systemd[1]: Stopping Ceph mds.i for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:16:23.254 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 13 16:16:23 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-i[65798]: 2024-09-13T16:16:23.098+0000 7f25db454640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:16:23.254 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 13 16:16:23 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-i[65798]: 2024-09-13T16:16:23.098+0000 7f25db454640 -1 mds.i *** got signal Terminated *** 2024-09-13T16:16:26.175 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 13 16:16:25 smithi193 podman[72659]: 2024-09-13 16:16:25.899217821 +0000 UTC m=+2.900871170 container died 47a924b6838ef815fee5fdc87404b9b4e4bc82b4e656a03204f312137c99072b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-13T16:16:26.466 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 13 16:16:26 smithi193 podman[72659]: 2024-09-13 16:16:26.2572934 +0000 UTC m=+3.258946749 container cleanup 47a924b6838ef815fee5fdc87404b9b4e4bc82b4e656a03204f312137c99072b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-13T16:16:26.466 INFO:journalctl@ceph.mds.i.smithi193.stdout:Sep 13 16:16:26 smithi193 bash[72659]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-i 2024-09-13T16:16:26.641 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.i.service' 2024-09-13T16:16:26.673 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:16:26.674 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-13T16:16:26.674 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-13T16:16:26.674 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.l 2024-09-13T16:16:27.004 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 13 16:16:26 smithi193 systemd[1]: Stopping Ceph mds.l for 3334a620-71e7-11ef-bceb-c7b262605968... 2024-09-13T16:16:27.004 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 13 16:16:26 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-l[64877]: 2024-09-13T16:16:26.977+0000 7f42e752a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T16:16:27.004 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 13 16:16:26 smithi193 ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-l[64877]: 2024-09-13T16:16:26.977+0000 7f42e752a640 -1 mds.l *** got signal Terminated *** 2024-09-13T16:16:28.254 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 13 16:16:27 smithi193 podman[72777]: 2024-09-13 16:16:27.990122499 +0000 UTC m=+1.104155283 container died 83eb180d4af28dcb3ebcaae17d24a5dff1eefca9a14590086342229ff3f136cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-l, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T16:16:28.721 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 13 16:16:28 smithi193 podman[72777]: 2024-09-13 16:16:28.336721726 +0000 UTC m=+1.450754511 container cleanup 83eb180d4af28dcb3ebcaae17d24a5dff1eefca9a14590086342229ff3f136cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-13T16:16:28.721 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 13 16:16:28 smithi193 bash[72777]: ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-l 2024-09-13T16:16:28.722 INFO:journalctl@ceph.mds.l.smithi193.stdout:Sep 13 16:16:28 smithi193 podman[72789]: 2024-09-13 16:16:28.52936478 +0000 UTC m=+0.536741442 container remove 83eb180d4af28dcb3ebcaae17d24a5dff1eefca9a14590086342229ff3f136cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:195bcc5557a21b1fc5da9f42b2147dd7b8d9c3a0edf068f394db39472062247a, name=ceph-3334a620-71e7-11ef-bceb-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.095512-reef-50bbe7f, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-13T16:16:28.731 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3334a620-71e7-11ef-bceb-c7b262605968@mds.l.service' 2024-09-13T16:16:28.762 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T16:16:28.762 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-13T16:16:28.763 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3334a620-71e7-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T16:16:28.988 INFO:teuthology.orchestra.run.smithi017.stdout:Deleting cluster with fsid: 3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T16:16:32.632 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3334a620-71e7-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T16:16:32.787 INFO:teuthology.orchestra.run.smithi189.stdout:Deleting cluster with fsid: 3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T16:16:35.159 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3334a620-71e7-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T16:16:35.312 INFO:teuthology.orchestra.run.smithi193.stdout:Deleting cluster with fsid: 3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T16:16:37.557 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T16:16:37.621 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T16:16:37.653 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T16:16:37.680 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-13T16:16:37.682 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903758/remote/smithi017/crash 2024-09-13T16:16:37.683 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/crash -- . 2024-09-13T16:16:37.759 INFO:teuthology.orchestra.run.smithi017.stderr:tar: /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T16:16:37.759 INFO:teuthology.orchestra.run.smithi017.stderr:tar: Error is not recoverable: exiting now 2024-09-13T16:16:37.762 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903758/remote/smithi189/crash 2024-09-13T16:16:37.763 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/crash -- . 2024-09-13T16:16:37.871 INFO:teuthology.orchestra.run.smithi189.stderr:tar: /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T16:16:37.871 INFO:teuthology.orchestra.run.smithi189.stderr:tar: Error is not recoverable: exiting now 2024-09-13T16:16:37.874 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903758/remote/smithi193/crash 2024-09-13T16:16:37.875 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/crash -- . 2024-09-13T16:16:37.906 INFO:teuthology.orchestra.run.smithi193.stderr:tar: /var/lib/ceph/3334a620-71e7-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T16:16:37.906 INFO:teuthology.orchestra.run.smithi193.stderr:tar: Error is not recoverable: exiting now 2024-09-13T16:16:37.907 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-13T16:16:37.908 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/3334a620-71e7-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T16:16:37.980 INFO:teuthology.orchestra.run.smithi017.stderr:grep: /var/log/ceph/3334a620-71e7-11ef-bceb-c7b262605968/ceph.log: No such file or directory 2024-09-13T16:16:37.987 INFO:tasks.cephadm:Compressing logs... 2024-09-13T16:16:37.988 DEBUG:teuthology.orchestra.run.smithi017:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T16:16:37.993 DEBUG:teuthology.orchestra.run.smithi189:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T16:16:37.995 DEBUG:teuthology.orchestra.run.smithi193:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T16:16:38.036 INFO:teuthology.orchestra.run.smithi193.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T16:16:38.042 INFO:teuthology.orchestra.run.smithi189.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T16:16:38.053 INFO:teuthology.orchestra.run.smithi017.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T16:26:32.867 INFO:tasks.cephadm:Archiving logs... 2024-09-13T16:26:32.868 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903758/remote/smithi017/log 2024-09-13T16:26:32.870 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T16:27:41.083 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903758/remote/smithi189/log 2024-09-13T16:27:41.084 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T16:28:32.523 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903758/remote/smithi193/log 2024-09-13T16:28:32.525 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T16:29:33.723 INFO:tasks.cephadm:Removing cluster... 2024-09-13T16:29:33.724 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3334a620-71e7-11ef-bceb-c7b262605968 --force 2024-09-13T16:29:33.949 INFO:teuthology.orchestra.run.smithi017.stdout:Deleting cluster with fsid: 3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T16:29:35.959 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3334a620-71e7-11ef-bceb-c7b262605968 --force 2024-09-13T16:29:36.113 INFO:teuthology.orchestra.run.smithi189.stdout:Deleting cluster with fsid: 3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T16:29:36.824 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3334a620-71e7-11ef-bceb-c7b262605968 --force 2024-09-13T16:29:36.977 INFO:teuthology.orchestra.run.smithi193.stdout:Deleting cluster with fsid: 3334a620-71e7-11ef-bceb-c7b262605968 2024-09-13T16:29:37.755 INFO:tasks.cephadm:Removing cephadm ... 2024-09-13T16:29:37.755 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T16:29:37.796 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T16:29:37.814 DEBUG:teuthology.orchestra.run.smithi193:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T16:29:37.830 INFO:tasks.cephadm:Teardown complete 2024-09-13T16:29:37.830 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T16:29:37.840 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T16:29:37.840 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T16:29:37.845 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T16:29:37.856 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T16:29:38.015 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T16:29:38.026 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T16:29:38.026 DEBUG:teuthology.orchestra.run.smithi017:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T16:29:38.030 DEBUG:teuthology.orchestra.run.smithi189:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T16:29:38.033 DEBUG:teuthology.orchestra.run.smithi193:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T16:29:38.047 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-09-13T16:29:38.047 INFO:teuthology.orchestra.run.smithi193.stderr:bash: line 1: ntpq: command not found 2024-09-13T16:29:38.058 INFO:teuthology.orchestra.run.smithi193.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T16:29:38.058 INFO:teuthology.orchestra.run.smithi193.stdout:=============================================================================== 2024-09-13T16:29:38.058 INFO:teuthology.orchestra.run.smithi193.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 +242us[ +269us] +/- 50ms 2024-09-13T16:29:38.058 INFO:teuthology.orchestra.run.smithi193.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 29 +963ns[ +963ns] +/- 51ms 2024-09-13T16:29:38.058 INFO:teuthology.orchestra.run.smithi193.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 -321us[ -294us] +/- 69ms 2024-09-13T16:29:38.058 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:29:38.062 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-09-13T16:29:38.066 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T16:29:38.066 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-09-13T16:29:38.066 INFO:teuthology.orchestra.run.smithi189.stdout:^* hv01.front.sepia.ceph.com 3 6 377 31 +276us[ +309us] +/- 50ms 2024-09-13T16:29:38.066 INFO:teuthology.orchestra.run.smithi189.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 30 +24us[ +24us] +/- 51ms 2024-09-13T16:29:38.066 INFO:teuthology.orchestra.run.smithi189.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 29 -275us[ -275us] +/- 69ms 2024-09-13T16:29:38.067 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:29:38.070 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T16:29:38.070 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-09-13T16:29:38.070 INFO:teuthology.orchestra.run.smithi017.stdout:^* hv01.front.sepia.ceph.com 3 6 377 35 +230us[ +237us] +/- 50ms 2024-09-13T16:29:38.070 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 30 +19us[ +19us] +/- 51ms 2024-09-13T16:29:38.070 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 32 -291us[ -291us] +/- 69ms 2024-09-13T16:29:38.070 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T16:29:38.071 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T16:29:38.082 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T16:29:38.082 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T16:29:38.092 DEBUG:teuthology.orchestra.run.smithi017:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T16:29:38.263 DEBUG:teuthology.orchestra.run.smithi189:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T16:29:38.380 DEBUG:teuthology.orchestra.run.smithi193:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T16:29:38.501 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T16:29:38.563 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:29:38.563 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T16:29:38.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:29:38.594 DEBUG:teuthology.orchestra.run.smithi193:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T16:29:38.622 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:29:38.622 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T16:29:38.633 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T16:29:38.644 INFO:teuthology.task.internal:Duration was 3038.817572 seconds 2024-09-13T16:29:38.645 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T16:29:38.655 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T16:29:38.655 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T16:29:38.660 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T16:29:38.663 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T16:29:38.726 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T16:29:38.728 INFO:teuthology.orchestra.run.smithi193.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T16:29:38.773 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T16:29:39.109 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T16:29:39.109 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi017.front.sepia.ceph.com 2024-09-13T16:29:39.110 DEBUG:teuthology.orchestra.run.smithi017:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T16:29:39.159 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi189.front.sepia.ceph.com 2024-09-13T16:29:39.160 DEBUG:teuthology.orchestra.run.smithi189:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T16:29:39.201 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi193.front.sepia.ceph.com 2024-09-13T16:29:39.201 DEBUG:teuthology.orchestra.run.smithi193:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T16:29:39.238 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T16:29:39.239 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T16:29:39.243 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T16:29:39.246 DEBUG:teuthology.orchestra.run.smithi193:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T16:29:39.305 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T16:29:39.305 DEBUG:teuthology.orchestra.run.smithi017:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T16:29:39.309 DEBUG:teuthology.orchestra.run.smithi189:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T16:29:39.315 DEBUG:teuthology.orchestra.run.smithi193:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T16:29:39.799 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T16:29:39.812 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T16:29:39.812 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T16:29:39.875 DEBUG:teuthology.orchestra.run.smithi189:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T16:29:39.914 DEBUG:teuthology.orchestra.run.smithi193:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T16:29:39.958 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T16:29:40.360 DEBUG:teuthology.orchestra.run.smithi017:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T16:29:40.365 DEBUG:teuthology.orchestra.run.smithi189:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T16:29:40.367 DEBUG:teuthology.orchestra.run.smithi193:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T16:29:40.400 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern = core 2024-09-13T16:29:40.404 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = core 2024-09-13T16:29:40.441 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = core 2024-09-13T16:29:40.472 DEBUG:teuthology.orchestra.run.smithi017:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T16:29:40.505 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:29:40.505 DEBUG:teuthology.orchestra.run.smithi189:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T16:29:40.523 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:29:40.524 DEBUG:teuthology.orchestra.run.smithi193:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T16:29:40.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:29:40.541 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T16:29:40.585 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T16:29:40.587 DEBUG:teuthology.misc:Transferring archived files from smithi017:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903758/remote/smithi017 2024-09-13T16:29:40.587 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T16:29:40.661 DEBUG:teuthology.misc:Transferring archived files from smithi189:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903758/remote/smithi189 2024-09-13T16:29:40.661 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T16:29:40.702 DEBUG:teuthology.misc:Transferring archived files from smithi193:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903758/remote/smithi193 2024-09-13T16:29:40.702 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T16:29:40.741 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T16:29:40.742 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T16:29:40.746 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T16:29:40.749 DEBUG:teuthology.orchestra.run.smithi193:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T16:29:40.793 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T16:29:40.806 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T16:29:40.806 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T16:29:40.817 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T16:29:40.817 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T16:29:40.821 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T16:29:40.824 DEBUG:teuthology.orchestra.run.smithi193:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T16:29:40.839 INFO:teuthology.orchestra.run.smithi189.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 16:29 /home/ubuntu/cephtest 2024-09-13T16:29:40.849 INFO:teuthology.orchestra.run.smithi193.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 16:29 /home/ubuntu/cephtest 2024-09-13T16:29:40.852 INFO:teuthology.orchestra.run.smithi017.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 16:29 /home/ubuntu/cephtest 2024-09-13T16:29:40.854 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T16:29:40.865 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T16:29:40.892 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/postgres}} duration: 3038.8175723552704 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T16:29:40.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T16:29:40.981 INFO:teuthology.run:pass